Image processing device, image processing method, and program

Abstract

To suppress the occurrence of a difference in the appearance of colors between the right and left eyes.SOLUTION: An image processing device 1 for displaying a right-eye image and a left-eye image acquires information on the difference in the appearance of colors between right and left, which represents a difference in the appearance of colors between the right and left eyes of a user. On the basis of the information on the difference in the appearance of colors between right and left, the device 1 performs color conversion of any one of the right-eye image and the left-eye image. One of the color charts displayed in a right display 204 and a left display 206 is fixed and the other is changed by an instruction by the user.SELECTED DRAWING: Figure 5

Description

[Technical field]

[0001] The present invention relates to color reproduction on a display. [Background technology]

[0002] In recent years, in entertainment and industrial applications, there are an increasing number of cases where a head-mounted display (HMD) is worn on the head to watch stereoscopic images. In such HMDs, different images are watched by the left and right eyes, so if there is a difference in the way the colors of the left and right images are viewed, binocular rivalry (a phenomenon in which the images of the left and right eyes do not merge into one, and the images corresponding to the left and right eyes appear alternately) occurs, causing flickering. Patent Document 1 describes a technique for matching colors between displays, in which the colors represented by the reference values ​​and pixel values ​​are expressed in a color system that is independent of the display device and converted into pixel values ​​of the display to which the images are output. As a method using a color system that is independent of the display device, a method is known in which the colors are quantified using the CIE1931 color matching function to match the colors numerically. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2021-110825 A Summary of the Invention [Problem to be solved by the invention]

[0004] Even if the stimuli from the display are the same, if the color matching functions of the receiver are different, differences in color appearance will occur. The causes of differences in color matching functions are said to be cloudiness of the crystalline lens of the eyeball and differences in the influence of the macula due to the viewing angle. Color matching functions differ for each eyeball. Therefore, even if color matching between displays is performed as in Patent Document 1 above, there is an issue that differences in the way colors appear in the left and right viewing images.

[0005] Therefore, an object of the present invention is to suppress the difference in color perception between the left and right eyes. [Means for solving the problem]

[0006] The present invention is an image processing device for displaying an image for the right eye and an image for the left eye, characterized in having an acquisition means for acquiring color vision characteristics that represent the difference in how colors are perceived by a user's left eye and right eye, and a conversion means for color converting at least one of the image for the right eye and the image for the left eye based on the color vision characteristics. Effect of the Invention

[0007] According to the present invention, it is possible to suppress the occurrence of a difference in how colors are seen between the left and right eyes. [Brief description of the drawings]

[0008] [Figure 1] FIG. 2 is a diagram illustrating an example of a hardware configuration of an image processing apparatus. [Diagram 2] FIG. 2 is a diagram illustrating an example of a hardware configuration of a display device. [Diagram 3] FIG. 2 is a diagram illustrating an example of a functional configuration of an image processing device. [Figure 4] FIG. 2 is a diagram illustrating an example of an input image. [Diagram 5] 4 is a flowchart showing a process executed by the image processing apparatus. [Figure 6] FIG. 4 is a diagram illustrating details of a user characteristic acquisition unit. [Figure 7] FIG. 13 is a diagram illustrating an example of a UI display. [Figure 8] FIG. 13 is a diagram showing UI state transitions. [Figure 9] FIG. 11 is a diagram showing an example of color chart evaluation result data. [Figure 10] 13 is a flowchart showing a process for changing a display color. [Figure 11] FIG. 2 is a diagram illustrating a 3D_LUT. [Figure 12] 11 is a flowchart showing a process for calculating a difference in left and right color appearance. [Figure 13] 13 is a flowchart showing a process for selecting a color conversion parameter. [Figure 14] FIG. 11 is a diagram illustrating an example of color conversion information. [Figure 15] FIG. 11 is a diagram illustrating an example of color conversion parameters. [Figure 16A] FIG. 1 is an explanatory diagram of a color chart display. [Figure 16B] FIG. 1 is an explanatory diagram of a color chart display. [Figure 17] FIG. 13 is a diagram illustrating an example of a UI display. [Figure 18] FIG. 13 is a diagram showing UI state transitions. [Figure 19] FIG. 2 is a diagram illustrating an example of a functional configuration of an image processing device. [Figure 20] 4 is a flowchart showing a process executed by the image processing apparatus. [Figure 21] FIG. 4 is a diagram illustrating details of a user characteristic correction unit. [Figure 22] FIG. 11 is a diagram showing an example of a color matching function file group. [Figure 23] 10 is a flowchart showing a process for correcting a difference in color appearance between the left and right. [Figure 24] 4 is a flowchart showing a process executed by the image processing apparatus. [Diagram 25] FIG. 11 is a diagram showing an example of a color matching function file group. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0009] Hereinafter, embodiments 1 to 5 will be described with reference to the accompanying drawings.

[0010] [Embodiment 1] In embodiment 1, when an input image is displayed on left and right displays to be observed by the left and right eyes of a user who is an observer, user characteristics that represent the difference in how colors are perceived by the user's left and right eyes are acquired, and a process of converting the input image is performed based on the acquired user characteristics.

[0011] <Hardware configuration of image processing device> 1 is a diagram showing a hardware configuration of an image processing device 1. The image processing device 1 includes a CPU 101, a ROM 102, and a RAM 103. The image processing device 1 also includes a VC (video card) 104, a general-purpose I / F (interface) 105, a SATA (serial ATA) I / F 106, and a NIC (network interface card) 107. The CPU 101 executes an OS (operating system) and various programs stored in the ROM 102, a HDD (hard disk drive) 113, etc., using the RAM 103 as a work memory. The CPU 101 also controls each component via a system bus 108. Note that, in the processing according to the flowchart described later, program codes stored in the ROM 102, the HDD 113, etc. are expanded in the RAM 103 and executed by the CPU 101.

[0012] A display device 115 is connected to the VC 104. An input device 110 such as a mouse or a keyboard and an imaging device 111 are connected to the general-purpose I / F 105 via a serial bus 109. A general-purpose drive 114 that reads and writes data from and to a HDD 113 and various recording media is connected to the SATA I / F 106 via a serial bus 112. The NIC 107 inputs and outputs information to and from external devices. The CPU 101 uses the various recording media mounted on the HDD 113 and the general-purpose drive 114 as storage locations for various data. The CPU 101 displays a UI (Graphical User Interface) provided by a program on the display device 115 and receives inputs such as user instructions received via the input device 110.

[0013] <Display device hardware configuration> FIG. 2 is a diagram showing a hardware configuration of a display device. The display device 115 is, for example, a video see-through head mounted display (HMD). The display device 115 includes RGB cameras 201 and 202, a distance sensor 203, displays 204 and 206, and eyepieces 205 and 207. The RGB cameras 201 and 202 are cameras for realizing position tracking of the display device 115 by an inside-out method. The RGB camera 201 corresponds to the right eye line of sight, and the RGB camera 202 corresponds to the left eye line of sight. The RGB cameras 201 and 202 include an IMU (inertial measurement unit) such as a gyro sensor or an acceleration sensor (not shown). The distance sensor 203 includes a LiDAR (light detection and ranging) for acquiring depth information. The displays 204 and 206 are display panels for displaying images, and are formed of a liquid crystal panel, an organic EL panel, or the like. The display 204 is a display for the right eye. The display 204 is an example of a first display unit. Display 206 is a display for the left eye. Display 206 is an example of a second display unit. Hereinafter, display 204 may be referred to as right display 204, and display 206 may be referred to as left display 206.

[0014] Eyepieces 205 and 207 are disposed between the displays 204 and 206 and the user's eyes. The user observes an enlarged virtual image of the display image displayed on the displays 204 and 206 through the eyepieces 205 and 207. The right eye eyepiece 205 is disposed in front of the right display 204, and the left eye eyepiece 207 is disposed in front of the left display 206. The display device 115 is worn on the user's head, and allows the user's left eye to observe a left eye display image (an enlarged virtual image), and the right eye to observe a right eye display image (an enlarged virtual image). The image processing device 1 performs processing to generate a left eye display image and a right eye display image, and displays these images on the right display 204 and the left display 206. At this time, by providing an appropriate parallax between the left eye display image and the right eye display image, it is possible to give the user a video perception with a sense of depth. The display device 115 does not necessarily have to be a video see-through HMD, but may be a tablet terminal such as a smartphone, or a display that is not head-mounted. The hardware configuration of the display device 115 is not limited to this, and the display device 115 may include an image processing device and a HDD.

[0015] <Functional configuration of image processing device> Fig. 3 is a diagram showing the functional configuration of the image processing device. The CPU 101 functions as the functional configuration shown in Fig. 3 by using the RAM 103 as a work memory and reading and executing a program stored in the ROM 102 or the HDD 113. Note that it is not necessary for all of the processes shown below to be executed by the CPU 101, and the image processing device 1 may be configured so that part or all of the processes are executed by one or more processing circuits other than the CPU 101.

[0016] The image processing device 1 has the functions of an image acquisition unit 301 , a user characteristic acquisition unit 302 , an image conversion unit 303 , and an image output unit 304 . The image acquisition unit 301 acquires, from the HDD 113 or an external device, an input image to be displayed on the right display 204 and the left display 206. Fig. 4 shows an example of an input image. 4(a) is a single image formed by combining a parallax image 402 to be displayed on the right display 204 and a parallax image 403 to be displayed on the left display 206. If the right display 204 and the left display 206 are configured as an integrated display device, an integrated left and right input image may be acquired. 4(b) is a parallax image to be displayed on the right display 204, and a left-eye input image 403 is a parallax image to be displayed on the left display 206. When the right display 204 and the left display 206 are configured as separate display devices, or when data captured by a right-eye camera and a left-eye camera are acquired, respectively, left and right input images may be acquired.

[0017] The user characteristic acquisition unit 302 acquires color vision characteristics that indicate the difference in color vision between the left eye and the right eye of the user. The color vision characteristics indicate the difference in color vision between the right eye and the left eye, for example, in the CIE L standardized by the International Commission on Illumination (CIE). * a * b * It is expressed as the difference in coordinate values ​​in color space. Hereinafter, the color vision characteristic that represents the difference in how colors are perceived by the user's left eye and right eye may be referred to as the difference in color appearance between the left and right eyes. The image conversion unit 303 selects color conversion parameters corresponding to the difference in left and right color appearance acquired by the user characteristic acquisition unit 302 from the color conversion information stored in the ROM 102 or the like, and performs color conversion of the input image using the selected color conversion parameters. In this embodiment, the image conversion unit 303 performs color conversion of the input image for the right eye, but does not perform color conversion of the input image for the left eye. The image output unit 304 outputs the image data converted by the image conversion unit 303 and the input image to the display device 115. In this embodiment, the image output unit 304 outputs the color-converted right-eye input image and the color-converted left-eye input image to the display device 115.

[0018] <Processing performed by the image processing device> 5 is a flowchart showing the flow of processing executed by the image processing device 1. Hereinafter, each step (process) will be represented by adding an S before the reference symbol. In S501, the CPU 101 displays a UI (FIG. 7) described later on the displays 204 and 206 of the display device 115. In S502, the CPU 101 acquires the color vision characteristics of the user. The color vision characteristics here represent the difference in color appearance between the left and right. A specific method of acquiring the difference in color appearance between the left and right will be described later. In S503, the CPU 101 obtains a right-eye input image and a left-eye input image. In S504, CPU 101 performs color conversion of the right eye input image acquired in S503 using color conversion parameters corresponding to the color vision characteristics of the user acquired in S502. Note that in this embodiment, of the right eye input image and the left eye input image, the right eye input image is the target of color conversion, but the left eye input image may also be the target. Also, color conversion may be performed on both the right eye input image and the left eye input image so as to shift the color in a direction corresponding to the color vision characteristics. In S505, the CPU 101 outputs to the display device 115 the converted image generated in S504 and the left-eye image 403 acquired in S503. This completes the series of processes in this flowchart.

[0019] <Acquisition of color vision characteristics> The method of acquiring the difference in color appearance between the left and right sides of the user in S502 will be described below. In this embodiment, the user characteristic acquisition unit 302 acquires the difference in color appearance between the left and right sides of the user based on the user's evaluation results for the color charts on the UI displayed on the left and right displays 204, 206. Fig. 7 shows an example of a UI display. The color chart on the UI is fixed on one of the left and right displays 204, 206, and the color of the other is changeable.

[0020] FIG. 6 illustrates a functional configuration of the user characteristic acquisition unit 302. As shown in FIG. The user characteristic acquisition unit 302 has the functions of a user input unit 601, a UI control unit 602, and a result calculation unit 603. * a * b * An example of using the value will be described. The user input unit 601 accepts user instructions such as color changes to the color chart on the UI. * a * b * The input of the value itself may be accepted, or the L * a * b * An input of an increment or decrement of the value may be accepted. For example, using the keyboard, the right key and +a * , left key and -a * , Up key and +b * , Down key and -b * , Page Up key and +L * , Page Down key and -L * You can also link L * and a * and b * Alternatively, the user may select either of the items above and change only the selected item. When the display color of the color patch is changed in response to a user's instruction to change the color, the user input unit 601 accepts an input as to whether or not the difference in appearance between the left and right color patches is acceptable.

[0021] The UI control unit 602 controls the display of a UI for acquiring the difference in color appearance between the left and right sides of the user. Specifically, the UI control unit 602 calculates color signal values ​​after the change from the content of the instruction for color change from the user input unit 601. The UI control unit 602 then calculates RGB values ​​of the display from the color signal values ​​after the color change. Display color information is used to calculate the RGB values. The UI control unit 602 then changes the display color of the color patch using the calculated RGB values. The result calculation unit 603 stores the color difference between the left and right color chips and the user's evaluation result indicating whether the difference in color appearance between the left and right color chips is acceptable in association with each other. The result calculation unit 603 then tallies up the color differences for which the difference in color appearance is acceptable, and calculates the representative value of these as the difference in color appearance between the left and right colors.

[0022] <User Interface (UI)> Next, the UI will be described with reference to FIG. The UI 701 is a UI for setting the color change of the color patch and displaying the color patch changed based on the user's instruction. The UI 701 includes a color setting display unit 702 and a result display unit 709. The UI 701 is displayed on the displays 204 and 206 of the display device 115 under the control of the UI control unit 602.

[0023] First, a description will be given of the color setting display section 702. The color setting display section 702 is provided with a display designation radio button 703 and spin boxes 704-707. The display specification radio button 703 is a radio button for specifying whether the display to be changed is to be the left or right display. The spin boxes 704 to 706 are spin boxes for inputting color information for specifying the color direction of the color information. As an example, the spin box 704 includes a * Increase or decrease the value. In the spin box 705, * Increase or decrease the value. The spin box 706 contains * The user inputs an increase or decrease in the value. The spin box 707 is a spin box for inputting the amount by which the color information is to be changed. The values ​​in the spin boxes 704 to 706 are changed by the amount specified here. Note that a button for designating whether the user's dominant eye is the left eye or the right eye may be provided instead of the display designation radio button 703. The UI control unit 602 may set a display to be changed in color in conjunction with the dominant eye of the user.

[0024] Next, a description will be given of the result display section 709. The result display section 709 is provided with a color chart display section 710, evaluation result input buttons 711 and 712, and an end button 713. The color chart display unit 710 displays the color chart whose color has been changed in accordance with a user instruction on the color setting display unit 702. When a color change is instructed, the UI control unit 602 changes the color chart display unit 710 of the specified display of the left and right displays 204, 206. The evaluation result input button 711 is a button that is pressed when the user compares the color chart displayed on the color chart display unit 710 of the left display 206 with the color chart displayed on the color chart display unit 710 of the right display 204 and determines that the difference in appearance between the left and right color charts is acceptable. The evaluation result input button 712 is a button that is pressed when the difference in appearance between the left and right color charts is unacceptable. When the end button 713 is pressed, the result calculation unit 603 tallies up the color differences between the left and right color chips for which differences in color appearance are permitted, and calculates the representative value of these as the left and right color appearance difference. Note that the result calculation unit 603 may obtain the left and right color appearance difference using the color differences between the left and right color chips at the time the end button 713 is pressed.

[0025] Next, the control of user input and UI display will be described. Figure 8 is a state transition diagram that explains the transition of the UI display. In state 801, the UI control unit 602 initializes the application started by the user's instruction and displays the UI. After that, the state transitions to state 802. In state 802, the UI control unit 602 displays the color setting display unit 702 and the result display unit 709, and waits for user input. In the initial state, the color samples displayed on the left and right displays 204, 206 have the same RGB values. Note that the initial state may be configured so that the left and right displays have different RGB values. When the user input unit 601 accepts an operation on the display designation radio button 703, the state transitions to state 803. In state 803, the UI control unit 602 sets the display specified by the display specification radio button 703 as the display whose color is to be changed. After that, the state transitions to state 802. When the user input unit 601 accepts input of a color change value, the state transitions to state 804. In state 804, the UI control unit 602 determines the color signal value (L* a * b * The color signal value after the change (L value) is reflected by the color change value instructed in the spin boxes 704 to 706. * 'a * 'b * After calculating the value of the color change, the process moves to state 805. Note that the instruction to change the color is not limited to the operation of the spin boxes 704 to 706, but may be given by key input or operation of various input interfaces linked to each spin box.

[0026] In state 805, the UI control unit 602 changes the color signal value (L * 'a * 'b * If the result of the determination is that the color signal value (L′) is within the color reproduction range of the display device 115, the UI control unit 602 changes the color signal value (L * 'a * 'b * The display color of the color chart display unit 710 of the display that is the target of the color change is updated with an RGB value corresponding to the RGB value (value of the color chart). After that, the state transitions to state 806. If it is outside the color reproduction gamut, the UI control unit 602 leaves the displayed color as it is and notifies the user that it is outside the color gamut. After that, the state transitions to state 802.

[0027] In state 806, the user input unit 601 waits for input of the evaluation result for the color chart displayed on the result display unit 709. The user visually checks the left and right displays and evaluates whether the difference in color appearance between the left and right color charts is tolerable. When the user input unit 601 accepts operation of either of the evaluation result input buttons 711, 712, the UI control unit 602 records the evaluation result (OK or NG). The state then transitions to state 802. In this way, the image processing device 1 transitions from state 802 to states 804, 805, and 806, allowing the user to visually check the left and right color charts and perform color adjustment so that the difference in appearance between the left and right charts is tolerable.

[0028] FIG. 9 is a diagram showing an example of color chart evaluation result data. Item 901 indicates an evaluation number. Item 902 indicates a color change value specified by a user. The color change value here indicates the color difference between the left and right color charts, and L * a * b * It is represented by each element of the value. Item 903 shows the evaluation result of whether or not the color change value is permitted. If the color change value is permitted, OK is recorded, and if it is not permitted, NG is recorded. In state 802, when the user input unit 601 accepts an operation of the spin box 707, the state transitions to state 807. In state 807, the UI control unit 602 sets the color information change width input in the spin box 707, and then transitions to state 802.

[0029] <Processing to change display color> FIG. 10 shows that in state 805, the changed color signal value (L * 'a * 'b * 13 is a flowchart showing a process of changing the display color of a color chart using a color space. In S1001, the CPU 101 acquires display color information. Here, an example will be described in which a 3D_LUT (three-dimensional lookup table) is used as the display color information. Note that a 1D_LUT and a matrix, or a γ conversion and a matrix may be used. FIG. 11 is a diagram showing a schematic diagram of a 3D_LUT. Item 1101 indicates a data number. Item 1102 indicates a L * a * b * Each element of the value is represented by item 1103. * a * b * The 3D_LUT in Figure 11 shows the RGB values ​​of the display corresponding to the L * a * b * A total of 3N pieces of data are stored, N for each axis.

[0030] In S1002, the CPU 101 acquires a color change value designated by the user. In S1003, the CPU 101 calculates RGB values ​​corresponding to the color change values ​​acquired in S1002 by tetrahedral interpolation using the 3D_LUT acquired in S1001. In S1004, the CPU 101 determines whether or not the result of the tetrahedral interpolation is within the color gamut. If it is within the color gamut, the process proceeds to S1005, and if it is outside the color gamut, the process proceeds to S1006. In S1005, the CPU 101 changes the display color of the color chart display unit 710 of the specified display to the calculated RGB value. In S1006, the CPU 101 notifies the user that the color is outside the color gamut, but does not change the display color of the color chart display unit 710. This completes the series of processes in this flowchart.

[0031] <Processing to calculate the difference in color appearance between the left and right> FIG. 12 is a flowchart showing a process of tallying up the allowed color differences between the left and right color chips and calculating a representative value thereof as the difference in left and right color appearance. In S1201, the CPU 101 performs initialization processing (i=1, n=0) of each variable (i: evaluation number, n: number of additions). In S1202, the CPU 101 acquires the i-th color change value and its evaluation result from the color chart evaluation result data in FIG. In S1203, CPU 101 determines whether the i-th evaluation result is OK (permissible) or not, and if it is OK, proceeds to S1204, and if it is NG, proceeds to S1205. In step S1204, the CPU 101 sets a variable L Sum , a Sum , b Sum The i-th evaluation result L * a * b * The CPU 101 adds up each of the values ​​and increments n, which indicates the number of additions. In S1205, the CPU 101 determines whether all the evaluation results have been processed, and if it determines that all have been processed, the process proceeds to S1206, and if any remain unprocessed, the CPU 101 increments i representing the evaluation number and proceeds to S1203. In S1206, the CPU 101 calculates the average value L ave , a ave , b ave is calculated as the difference in color appearance between the left and right eyes.

[0032]

number

[0033] This completes the series of processes in this flowchart. According to the processes in the flowchart above, the average value of the color differences for which the user accepts (OKs) the difference between the left and right eyes can be acquired as the difference in color appearance between the left and right eyes of the user. Note that the difference in color appearance between the left and right eyes of the user is not particularly limited as long as it is a value acquired based on the color differences between the left and right color charts when different color charts are displayed on displays corresponding to the left and right eyes, respectively, and the user accepts the difference in color appearance between the left and right color charts.

[0034] <Process for selecting color conversion parameters> Next, the average value L calculated according to the flowchart in FIG. ave , a ave , b ave 13 is a flowchart showing the process of selecting color conversion parameters corresponding to the color conversion parameters.

[0035] In S1301, the CPU 101 performs initialization processing (i=1, min=0) of each variable (i: color conversion parameter number, min: minimum value). In S1302, the CPU 101 calculates the average value L ave , a ave , b ave Get the.

[0036] FIG. 14 shows an example of color conversion information. Item 1401 shows the number of the color conversion parameter. Item 1402 shows the L * a * b *Here, the color conversion parameters are expressed as coordinate values ​​in a given L * a * b * For example, the coordinates are set at a=0 and b=0 on the ab plane, with the a-axis and b-axis directions each having a Δ interval of 1.0. * a * b * This shows a file that represents color conversion parameters with adjustment values ​​as the focus.

[0037] Fig. 15 shows an example of color conversion parameters. Item 1501 indicates a data number. Item 1502 indicates coordinate values ​​in the RGB space. Item 1503 indicates the RGB values ​​of the display corresponding to the RGB values. Fig. 15 stores a total of 3N color conversion parameters, N for each axis of RGB.

[0038] In step S1303, the CPU 101 calculates the adjustment central value L ave , a ave , b ave and the value of the i-th color conversion parameter item 1402 in FIG. 14 (L i , a i , b i ) and calculate the color difference ΔE i The following formula (2) is used.

number

[0039] In S1304, the CPU 101 calculates ΔE i Compare with min and ΔE i If is smaller than min, proceed to S1305, otherwise proceed to S1306. In S1305, the CPU 101 sets min to ΔE i to update. In S1306, the CPU 101 calculates the adjustment center value L ave , a ave , b aveIf the CPU 101 determines that the calculations have been performed for all the color conversion parameters, the process proceeds to S1307, and if the CPU 101 determines that there is a color conversion parameter that has not been calculated, the color conversion parameter number i is incremented and the process proceeds to S1302. In S1307, the CPU 101 selects the color conversion parameter corresponding to the number i of the color conversion parameter for which min was last updated. This completes the series of processes in this flowchart.

[0040] According to the process of the above flowchart, it is possible to select color conversion parameters corresponding to the difference in color appearance between the left and right eyes of the user. In S504, by using the color conversion parameters selected in this way, it is possible to perform color conversion by shifting the center to a position corresponding to the difference in color appearance between the left and right eyes of the user.

[0041] According to the present embodiment as described above, it is possible to control the colors of an image so that the colors seen on the left and right displays match, based on the difference in color appearance between the left and right displays to the user.

[0042] [Embodiment 2] In the first embodiment, a method for acquiring a user's color vision characteristics was described in which the user evaluates the difference in color appearance between the color patches on the left and right displays by changing the colors of the color patches displayed on the specified displays. The accuracy of evaluating the difference in color appearance differs depending on the arrangement of the color patches. For example, it is said that a difference of ΔE 0.8 to 1.6 can be distinguished in ΔE (CIE1976) when comparing adjacent color patches. In the second embodiment, a modified method of displaying color patches for evaluating the difference in color appearance will be described. Note that descriptions overlapping with the first embodiment will be omitted.

[0043] <Color chart display section configuration> The following describes an example of the configuration of the color chart display unit 710 in the UI shown in Fig. 7. Figs. 16A and 16B are explanatory diagrams of color chart display. 16A(a) shows an example in which, of two horizontally adjacent regions on the color chart display unit 710, a left region 1601 is displayed on the left display 206 and a right region 1602 is displayed on the right display 204. Here, the sizes of the regions 1601 and 1602 are the same, but they may be of different sizes.

[0044] FIG. 16A(b) shows an example in which the area 1602 in FIG. 16A(a) is divided vertically into five areas 1604-1608, and the areas 1604-1608 are changed to different colors. The area 1603 in FIG. 16A(b) is displayed on the left display 206, and the areas 1604-1608 are displayed on the right display 204. As an example, the area 1604 displays a color patch whose color has been changed by +a compared to the area 1604, and the area 1605 displays a color patch whose color has been changed by -a compared to the area 1604. Similarly, the area 1606 displays a color patch whose color has been changed by -a compared to the area 1604, the area 1607 displays a color patch whose color has been changed by +b compared to the area 1604, and the area 1608 displays a color patch whose color has been changed by -b compared to the area 1604. In this way, a plurality of color change results are displayed simultaneously in the areas 1604-1608. Here, the vertical size of each of the regions 1604 to 1608 is the same and corresponds to a predetermined viewing angle, but they may be of different sizes.

[0045] FIG. 16A(c) shows an example in which, of two vertically adjacent regions in the color chart display section 710, the upper region 1609 is displayed on the left display 206, and the lower region is displayed on the right display 204. The lower region in the color chart display section 710 is divided horizontally into five regions 1610-1614, and the regions 1610-1614 are each displayed with a different color. As an example, the region 1610 displays a color chart with a color change, and the region 1611 displays a color chart with a color change of +a compared to the region 1610. Similarly, the region 1612 displays a color chart with a color change of -a compared to the region 1610, the region 1613 displays a color chart with a color change of +b compared to the region 1610, and the region 1614 displays a color chart with a color change of -b compared to the region 1610. In this way, a plurality of color change results are displayed simultaneously in the regions 1610-1614. Here, the horizontal size of each of the regions 1610 to 1614 is the same and corresponds to a predetermined viewing angle, but they may be of different sizes.

[0046] 16B(d) shows an example in which the sizes of two adjacent regions 1615, 1616 in the color chart display unit 710 are changed when one region 1615 is displayed on the left display 206 and the other region 1616 is displayed on the right display 204. A background region 1617 is displayed on the left display 206, and a background region 1618 is displayed on the right display 204. Here, the color of the background regions 1617, 1618 is black, but may be another color. The color of the background regions 1617, 1618 may be changed according to a user instruction.

[0047] 16B(e) shows a UI 1619 for changing the size of the region using the viewing angle. A spin box 1620 is a spin box for inputting viewing angle information to be displayed. The UI control unit 602 changes the size of each of the regions 1615 and 1616 using the viewing angle information input to the spin box 1620.

[0048] Fig. 16B(f) shows an example in which the color chart display unit 710 is divided into a plurality of vertically oriented regions, which are alternately displayed on the left and right displays 204, 206. Region 1621 (gray portion) is displayed on the left display 206, and region 1622 (shaded portion) is displayed on the right display 204. Here, the divided sizes of the regions are the same and correspond to a predetermined viewing angle, but they may be of different sizes. Any area ratio may be used.

[0049] Fig. 16B(g) shows an example in which the color chart display unit 710 is divided into a plurality of regions in the horizontal direction and each region is displayed alternately on the left and right displays 204, 206. Region 1623 (gray portion) is displayed on the left display 206, and region 1624 (shaded portion) is displayed on the right display 204. Here, the divided sizes of the regions are the same and are equivalent to a predetermined viewing angle, but they may be of different sizes. Any area ratio may be used.

[0050] Fig. 16B(h) shows an example in which the color chart display unit 710 is divided into checkerboard-like regions, which are displayed alternately on the left and right displays 204, 206. Region 1625 (gray portion) is displayed on the left display 206, and region 1626 (shaded portion) is displayed on the right display 204. Here, the divided sizes of the regions are the same and correspond to a predetermined viewing angle, but they may be of different sizes. Any area ratio may be used.

[0051] Fig. 16B(i) shows an example in which the color chart display section 710 is divided into a plurality of regions in the horizontal and vertical directions and each region is displayed alternately on the left and right displays 204, 206. Region 1627 (gray area) is displayed on the left display 206, and region 1628 (shaded area) is displayed on the right display 204. Here, the divided sizes of the regions are the same and are equivalent to a predetermined viewing angle, but they may be of different sizes. Any area ratio may be used.

[0052] 16B(j) shows an example in which an arbitrary figure-shaped area 1630 in the color chart display unit 710 is displayed on the right display 204, and a background area 1629 of the area 1630 is displayed on the left display 206. Here, the area 1630 and the background area 1629 are assumed to have the same area, but they may not be the same.

[0053] 16B(k) shows an example in which an arbitrary character-shaped area 1632 in the color chart display unit 710 is displayed on the right display 204, and a background area 1631 of the area 1632 is displayed on the left display 206. Here, the area 1632 and the background area 1631 are assumed to have the same area, but they may be different.

[0054] In this embodiment, the color chart on the UI is displayed on the left and right displays in various ways, and the color chart of the specified display is changed according to an instruction from the user. This makes it easier for the user to determine whether the difference in appearance between the left and right color charts is acceptable, and allows the appearance of colors on the left and right displays to match with a higher degree of accuracy.

[0055] [Embodiment 3] In embodiment 1, L * a * b * In the past, the user directly inputs the numerical values ​​or increments and decrements to change the color of the color chart of the specified display. The user visually checks the left and right color charts and adjusts the colors so that the difference in appearance between the left and right charts is acceptable. However, such adjustment work is time-consuming, and a user who is not familiar with color adjustment may need time to match the appearance of the colors of the left and right color charts. Therefore, in the third embodiment, another aspect of the user input unit 601 will be described. Note that descriptions that overlap with the first and second embodiments will be omitted.

[0056] <User Interface (UI)> First, a UI 1701 of this embodiment will be described with reference to Fig. 17, focusing on the differences from the UI 701 of embodiment 1. A color setting display section 1702 of the UI 1701 of Fig. 17 is provided with spin boxes 1704 to 1709 instead of the spin boxes 704 to 706 of Fig. 7. A display designation radio button 1703 is similar to the display designation radio button 703 of Fig. 7. The spin boxes 1704 to 1709 are for inputting color information that specifies the color information range. * Upper limit, spin box 1705 has a * Upper limit, spin box 1706 is b * Upper limit, spin box 1707 has L * The lower limit, spin box 1708 contains a * Lower limit, spin box 1709 contains b * The UI control unit 602 acquires a combination image of the color chart to be displayed on the left display 206 and the right display 204 according to the range of the spin boxes 1704 to 1709 and the color information change width input to the spin box 1710. * a * b * The RGB values ​​of the display corresponding to the values ​​may be generated by determining them through tetrahedral interpolation, or may be stored in advance in the HDD 113 for various ranges and acquired from the HDD 113.

[0057] 7. The start button 1711 is a button for starting the display of a color chart in the color information range input in the spin boxes 1704 to 1709. The evaluation result input buttons 1714 and 1715 are similar to the evaluation result input buttons 711 and 712 in FIG.

[0058] The color chart display unit 1713 displays a color chart whose color has been changed in accordance with a user instruction in the color setting display unit 1702. When the start button 1711 is pressed, the UI control unit 602 changes only the color chart display unit 1713 of the specified display of the left and right displays 204, 206 in accordance with the color information range, and does not change the color chart display unit 1713 of the non-specified display. For example, when the start button 1711 is pressed, the display color of the color chart of the specified left or right display is changed one after another at a predetermined interval within the range of the spin boxes 1704 to 1709, and the user presses one of the evaluation result input buttons 1714, 1715 in response.

[0059] Next, the control of user input and UI display will be described. Figure 18 is a state transition diagram that explains the transition of the UI display. In state 1801, the UI control unit 602 initializes the application started by the user's instruction and displays the UI. After that, the state transitions to state 1802. In state 1802, the UI control unit 602 displays the color setting display portion 1702 and the result display portion 1712, and waits for user input. After that, when the user input portion 601 accepts an operation of the display designation radio button 1703, the state transitions to state 1803. In state 1803, the UI control unit 602 sets the display specified by the display specification radio button 1703 as the display whose color is to be changed, and then transitions to state 1802. Thereafter, when the user input unit 601 accepts input of a color information range from the spin boxes 1704 to 1709, the state transitions to state 1804.

[0060] In state 1804, the UI control unit 602 holds the color information range, and then transitions to state 1802. Thereafter, when the user input unit 601 accepts an operation on the spin box 1710, the state transitions to state 1808. In state 1808, the UI control unit 602 holds the color information change width input in the spin box 1710, and then transitions to state 802. Thereafter, when the user input unit 601 accepts an operation of the start button 1711, the state transitions to state 1805. In state 1805, the UI control unit 602 acquires a plurality of color sample images in accordance with the information held in states 1804 and 1808. Furthermore, the UI control unit 602 displays the first color sample image of the acquired color sample images on the color sample display unit 1713 of the display that is the target of color change, and displays the reference color sample image on the color sample display unit 1713 of the other display. After that, the state transitions to state 1806.

[0061] In state 1806, the user input unit 601 waits for input of the evaluation result for the color patch displayed on the result display unit 709. The user visually checks the left and right displays and evaluates whether the difference in color appearance between the left and right color patches is acceptable. When the user input unit 601 accepts the operation of either of the evaluation result input buttons 1714, 1715, the UI control unit 602 judges whether the difference in color appearance between the left and right color patches is acceptable. When the evaluation result input button 1714 is pressed, the UI control unit 602 inputs a color change value (L * a * b * The UI control unit 602 records the evaluation result (value) when the evaluation result input button 1715 is pressed. When the evaluation result input button 1715 is pressed, the UI control unit 602 does nothing. Furthermore, the UI control unit 602 determines whether or not all of the color sample images acquired in state 1805 have been evaluated. When the UI control unit 602 determines that there is an unevaluated color sample image, the UI control unit 602 transitions to state 1807, and when the UI control unit 602 determines that all of the color sample images have been evaluated, the UI control unit 602 transitions to state 1809.

[0062] In state 1807 , the UI control unit 602 updates the color chart display unit 1713 of the display to be changed in color to the next color chart image among the color chart images acquired in state 1805 , and transitions to state 1806 . In state 1809, the result calculator 503 calculates all the recorded color change values ​​(L * a* b * The average value is calculated from the two sets of values ​​and output as the difference in color appearance between the left and right.

[0063] In this embodiment, the color vision characteristics of the user are acquired by sequentially displaying color samples of different colors on the left and right displays and having the user evaluate the difference in how the images appear on the left and right displays, thereby reducing the workload of the user in adjusting colors.

[0064] [Embodiment 4] Since the difference between the color appearance of the left eye and the color appearance of the right eye is also affected by the spectral characteristics of the display, in the fourth embodiment, a method of color conversion of the display is described taking into consideration the spectral characteristics of the display. Note that the description overlapping with the first to third embodiments will be omitted.

[0065] <Functional configuration of image processing device> Fig. 19 is a diagram showing the functional configuration of an image processing apparatus, which differs from Fig. 3 in that a user characteristic correction unit 1901 is provided. The user characteristic correction unit 1901 calculates a correction value for the color vision characteristic of the user. Specifically, the user characteristic correction unit 1901 acquires the spectral characteristics of the left and right displays 204, 206. As an example of the spectral characteristics, the spectral radiance at 380 nm to 780 nm measured in advance is used. Note that other spectral information may be used. The user characteristic correction unit 1901 calculates a correction value for the color appearance difference by a process described later using a group of color matching function files stored in the ROM 102, etc., the left and right color appearance difference acquired by the user characteristic acquisition unit 302, and the display spectral characteristic information. As an example of the group of color matching function files, a color matching function model generated from the model of CIE170-1 Fundamental chromaticity diagram with physiological axes - Part 1 is used. The group of color matching function files is calculated using each age and viewing angle as parameters. The image conversion unit 303 selects a color conversion parameter corresponding to the correction value calculated by the user characteristic correction unit 1901, and performs color conversion of the image for the right eye using the selected color conversion parameter.

[0066] <Processing performed by the image processing device> Fig. 20 is a flowchart showing the flow of processing executed by the image processing device 1. In the flowchart of Fig. 20, processing steps S2001 and S2002 are added between the processing steps S502 and S503 in the flowchart of Fig. 5. In S2001, the CPU 101 acquires the spectral characteristics of the display. In S2002, the CPU 101 performs a color appearance difference correction process, which will be described later.

[0067] <Color appearance difference correction> The method of calculating the correction value for the difference in color appearance between the left and right colors in S2002 will be described below. FIG. 21 shows a schematic functional configuration of the user characteristic correction unit 1901. As shown in FIG. The user characteristic correction unit 1901 has the functions of a color matching function estimation unit 2101 , an XYZ calculation unit 2102 , and a correction value calculation unit 2103 .

[0068] The color matching function estimation unit 2101 estimates color matching functions from the color matching function file group based on the left and right color appearance difference acquired by the user characteristic acquisition unit 302. Fig. 22 shows an example of the color matching function file group. Item 2201 indicates a data number. Item 2202 indicates an L corresponding to the coordinate value of the left and right color appearance difference. * a * b * Item 2203 represents the coordinate value of L * a * b * The color matching function file corresponding to the values ​​is shown below. In the color matching function file, the visibility of each of Sx, Sy, and Sz at wavelengths from 380 nm to 780 nm is described. * a * b * The coordinate is L left , a left , b left (Lab_ left ), L on the right display 204 * a * b * The coordinate is LRight , a Right , b Right (Lab_ Right ) In this case, Lab_ left is the initial value of the color toning * a * b * coordinates, Lab_ Right Lab_ left The coordinates are relative to Lab_ Right is calculated using the color matching function that is closest to the relative relationship between the initial value (any color matching function or the color matching function of the standard observer) and the color adjustment result, among the stored color matching function files.

[0069] An XYZ calculation unit 2102 calculates XYZ values ​​in the CIE XYZ color system of the left display 206 and the right display 204 from the spectral characteristics and color matching functions of the displays. A correction value calculation unit 2103 uses the XYZ values ​​calculated by the XYZ calculation unit 2102 to calculate a correction value for the difference in appearance of the left and right colors.

[0070] FIG. 23 is a flowchart showing the details of the process of correcting the difference in color appearance between the left and right in S2002. In S2301, the CPU 101 executes L of item 2202 in FIG. * a * b * The value is compared with the difference in appearance of the left and right colors acquired in S502. Then, the color matching function (item 2203) corresponding to the right display 204 is estimated by searching for the number with the smallest difference between them. In S2302, the CPU 101 calculates the XYZ values ​​using the color matching functions, the spectral characteristics of the display, and the following formula (3).

[0071]

number

[0072] The XYZ values ​​of the left display 206 are calculated using the spectral distribution of the left display 206, the color matching function of the standard observer (or any color matching function), and the above formula (3). The XYZ values ​​of the right display 204 are calculated using the spectral distribution of the right display 204, the color matching functions estimated in S2301, and the above formula (3). In S2303, the CPU 101 calculates Lab_ Right , Lab_ left Calculate X n Y n Z n are the XYZ values ​​of the white display value of the left display 206.

[0073]

number

[0074] In S2304, the CPU 101 calculates a correction value for the difference in left and right color appearance. The difference in left and right color appearance after correction is expressed by ΔL, Δa, and Δb in the following formula (5). ΔL=L Right -L left Δa=a Right -a left (5) Δb=b Right -b left This completes the series of processes in this flowchart.

[0075] In S504 of this embodiment, color conversion is performed using color conversion parameters corresponding to the correction values ​​of the left and right color appearance differences calculated by the processing of the above flowchart.

[0076] In this embodiment, a correction value is calculated using the spectral characteristics of the display from the difference in color appearance between the left and right. By using this correction value, the results of the user's color adjustment can be applied to other displays, eliminating the need to perform color adjustments.

[0077] [Embodiment 5] According to the model of CIE170-1 Fundamental chromaticity diagram with physiological axes - Part 1, it has been reported that color appearance changes depending on the difference in the viewing angle. Therefore, it is considered that the difference in color appearance between the left eye and the right eye differs depending on the size of the object. In the fifth embodiment, a method of performing color conversion of a display taking into account the viewing angle will be described. Note that the description overlapping with the first to fourth embodiments will be omitted.

[0078] <Functional configuration of image processing device> The functional configuration of the image forming apparatus of this embodiment is similar to that of embodiment 3. The differences from embodiment 3 will be described below with reference to FIG. The user characteristic correction unit 1901 acquires the visual field angle size. As an example, the visual field angle size is calculated from the magnification ratio of the object or the optical flow of the moving object of interest. The user characteristic correction unit 1901 calculates a correction value for the color appearance difference by processing described later using a group of color matching function files stored in the ROM 102 or the like, the left and right color appearance difference acquired by the user characteristic acquisition unit 302, the visual field angle size, and the display's spectral characteristic information. As an example, the color matching function files use a color matching function model generated from the model of CIE170-1 Fundamental chromaticity diagram with physiological axes - Part 1.

[0079] <Processing performed by the image processing device> Fig. 24 is a flowchart showing the flow of processing executed by the image processing device 1. In the flowchart of Fig. 25, processing steps S2401 and S2402 are added between the processing steps S502 and S503 in the flowchart of Fig. 5. In S2401, the CPU 101 acquires the viewing angle size. In S2402, the CPU 101 performs a color appearance difference correction process, which will be described later.

[0080] <Color appearance difference correction> A method for correcting the color appearance difference in S2402 will be described below with reference to FIG. The color matching function estimation unit 2101 estimates color matching functions from the color matching function file group based on the left and right color appearance difference and the viewing angle size acquired by the user characteristic acquisition unit 302. Fig. 25 shows an example of the visual matching function file group. Item 2501 indicates a data number. Item 2502 indicates an L corresponding to the coordinate value of the left and right color appearance difference. * a * b * Item 2503 indicates the viewing angle information. Item 2504 indicates the L * a * b * The color matching function file corresponding to the values ​​and the viewing angle information is shown below. An XYZ calculation unit 2102 calculates XYZ values ​​in the CIE XYZ color system of the left display 206 and the right display 204 from the spectral characteristics and color matching functions of the displays. A correction value calculation unit 2103 uses the XYZ values ​​calculated by the XYZ calculation unit 2102 to calculate a correction value for the difference in appearance of the left and right colors.

[0081] The process of correcting the difference in color appearance between the left and right in S2402 will be described in detail with reference to FIG. In step S2301, the CPU 101 executes the L * a * b *The color matching function (item 2504) corresponding to the right display 204 is estimated by searching for the number with the smallest difference between the left and right color appearances obtained in S502 and the viewing angle information value of item 2503. The processes in S2302 to S2304 are similar to those in the fourth embodiment, and therefore the description thereof will be omitted.

[0082] In S504 of this embodiment, color conversion is performed using color conversion parameters corresponding to the correction values ​​of the left and right color appearance differences calculated by the processing of the above flowchart.

[0083] In this embodiment, a correction value is calculated using the viewing angle size information from the difference in color appearance between the left and right. By using this correction value, the result of the user's color adjustment can be applied to objects of different sizes, and the effort required for color adjustment can be reduced.

[0084] [Other Modifications] In the above-described embodiments, the color is changed in response to the operation of the input device 110 such as a mouse, keyboard, or HMD controller. Note that the color change may be instructed by head tracking or eye tracking. As an example, the color change may be instructed by tracking to the right and +a * , tracking to the left and -a * , upward tracking and +b * , downward tracking and -b * You can also use tracking and +L. * Ya-L * You can also link L * and a * and b * Alternatively, the user may select either of the items and change only the selected item.

[0085] In addition, in each of the above-described embodiments, an example has been described in which the color setting display section and the result display section are arranged in one UI, but the color setting display section and the result display section may be configured as separate UIs. Also, the color setting display section and the result display section may be displayed in a superimposed manner. Furthermore, the display of the superimposed color setting display section may be switched on and off, or active / inactive.

[0086] In the above-described embodiments, the color values ​​are expressed as CIE L * a * b * Although color space values ​​are used, for example, CIELUV space, CIECAM97, CIECAM02, CIECAM16 color space, etc. may also be used.

[0087] In addition, in the above-described embodiments, an application for correcting the difference in color appearance between the left and right sides has been described as an example, but for example, the application may be incorporated into a device as a calibration function. Specifically, the above-described embodiments may be applied as a calibration function for a monitor, which is an output device.

[0088] Furthermore, each of the above-described embodiments may also be realized by executing the following process. That is, computer-readable software (computer program) that realizes the functions of each of the above-described embodiments is supplied to a system or device via a network or various storage media. The computer (or CPU, MPU, etc.) of the system or device reads and executes the program.

[0089] The disclosure of each of the above-described embodiments includes the following configurations, methods, and programs. (Configuration 1) 1. An image processing device for displaying a right-eye image and a left-eye image, comprising: An acquisition means for acquiring color vision characteristics representing a difference in color perception between the left eye and the right eye of a user; a conversion means for converting a color of at least one of the right-eye image and the left-eye image based on the color vision characteristics; 13. An image processing device comprising: (Configuration 2) a control unit that controls the first color patch to be displayed on a first display unit that is a display unit for the right eye and the second color patch to be displayed on a second display unit that is a display unit for the left eye, and controls the first color patch to be different from the second color patch; 2. The image processing device according to configuration 1, wherein the acquiring means acquires the color vision characteristics based on a user's evaluation result regarding a difference in color appearance between the first color patch and the second color patch. (Configuration 3) The image processing device according to configuration 2, wherein the control means changes the color of at least one of the first color patch and the second color patch, which are the same color in an initial state, in response to an instruction from a user. (Configuration 4) The control means displays a plurality of combinations of the first color chip and the second color chip, The image processing device according to configuration 2 or 3, wherein the acquisition means acquires the color vision characteristics based on a result of tallying up differences in colors between the first color patch and the second color patch when a difference in color appearance between the first color patch and the second color patch is allowed. (Configuration 5) The color conversion device further includes a storage unit for storing a color conversion parameter for performing color conversion. The image processing device according to any one of configurations 1 to 4, wherein the conversion means converts colors of at least one of the image for the right eye and the image for the left eye using color conversion parameters corresponding to the color vision characteristics. (Configuration 6) The image processing device according to configuration 3, wherein the control means changes the color of the color chart displayed on one of the first display unit and the second display unit in response to a user instruction. (Configuration 7) 7. The image processing device according to any one of configurations 2 to 6, wherein the control means changes the sizes of the first color patch and the second color patch in response to an instruction from a user. (Configuration 8) 7. The image processing device according to any one of configurations 2 to 6, wherein the control means changes colors of the background regions of the first color patch and the second color patch in response to an instruction from a user. (Configuration 9) The image processing device according to configuration 6, wherein the control means sets either the first display unit or the second display unit as the display unit for changing the color of the color chart based on information indicating whether the user's dominant eye is the left eye or the right eye. (Configuration 10) 4. The image processing apparatus according to configuration 3, wherein the control means receives an input of L*a*b* values ​​or an increase or decrease in L*a*b* values ​​as a user instruction. (Configuration 11) the control means changes at least one of the first color patch and the second color patch, which have the same display color in an initial state, to a plurality of colors within a predetermined color change range, and displays the color; The image processing device according to any one of configurations 2 to 10, wherein the control means acquires the color vision characteristics based on a result of tallying up differences in color between the first color patch and the second color patch when a difference in color appearance between the first color patch and the second color patch is allowed. (Configuration 12) a control unit for controlling the first and second regions obtained by dividing the color chart in the horizontal or vertical direction to display a first region on a first display unit that is a display unit for the right eye and a second region on a second display unit that is a display unit for the left eye, so that the colors of the first and second regions are different from each other; The image processing device according to any one of configurations 1 to 11, wherein the acquisition means acquires the color vision characteristics based on a user's evaluation result regarding a difference in color appearance between the first area and the second area. (Configuration 13) The image processing device according to configuration 12, characterized in that the color chart is divided into three or more regions in at least one of the horizontal and vertical directions, and the multiple regions obtained by the division are displayed alternately on the first display unit and the second display unit. (Configuration 14) 13. The image processing device according to configuration 12, wherein the color chart is divided into a checkerboard pattern, and a plurality of areas obtained by the division are displayed alternately on the first display unit and the second display unit. (Configuration 15) a control means for controlling a first region representing a predetermined shape on a color chart to be displayed on a first display unit which is a display unit for either the right eye or the left eye, and a second region representing a background of the first region on the color chart to be displayed on a second display unit which is the other display unit, so that the colors of the first region and the second region are made different from each other; The image processing device according to any one of configurations 1 to 14, wherein the acquisition means acquires the color vision characteristics based on a user's evaluation result regarding a difference in color appearance between the first area and the second area. (Configuration 16) 16. The image processing device according to claim 12, wherein the control means changes the color of at least one of the first region and the second region in response to an instruction from a user. (Configuration 17) the obtaining means calculates a correction value for the color vision characteristics based on a color matching function according to the color vision characteristics and the spectral characteristics of the first display unit and the second display unit; The image processing device according to any one of configurations 2 to 16, wherein the conversion means converts colors of at least one of the image for the right eye and the image for the left eye based on a correction value for the color vision characteristic. (Configuration 18) The image processing device described in configuration 17, characterized in that the acquisition means calculates a correction value for the color vision characteristics based on a color matching function according to the color vision characteristics and viewing angle information of the first display unit and the second display unit, and the spectral characteristics of the first display unit and the second display unit. (method) 1. An image processing method for displaying a right-eye image and a left-eye image, comprising: An acquisition step of acquiring color vision characteristics that represent a difference in color perception between the left eye and the right eye of a user; a conversion step of converting a color of at least one of the right-eye image and the left-eye image based on the color vision characteristics; 13. An image processing method comprising: (program) a computer of an image processing device for displaying a right-eye image and a left-eye image; An acquisition means for acquiring color vision characteristics representing a difference in color perception between the left eye and the right eye of a user; a conversion means for converting a color of at least one of the right-eye image and the left-eye image based on the color vision characteristics; A program that functions as a [Explanation of symbols]

[0090] 1: image processing device, 115: display device

Claims

1. An image processing device for displaying an image for the right eye and an image for the left eye, A means for acquiring color vision characteristics that represent the difference in how the user's left and right eyes perceive colors, A conversion means for converting the color of at least one of the right-eye image and the left-eye image based on the aforementioned color vision characteristics, A control means that displays a first color swatch on a first display unit which is for the right eye, and displays a second color swatch on a second display unit which is for the left eye, and controls the colors of the first and second color swatches to be different. It has, The image processing apparatus is characterized in that the acquisition means acquires the color vision characteristics based on the user's evaluation result regarding the difference in how the colors of the first color chart and the second color chart appear.

2. The image processing apparatus according to claim 1, characterized in that the control means changes the color of at least one of the first color chart and the second color chart, which are the same color in their initial state, according to the user's instructions.

3. The control means displays the first color chart and the second color chart in multiple combinations, The image processing apparatus according to claim 1, characterized in that the acquisition means acquires the color vision characteristics based on the result of aggregating the difference in color between the first color sample and the second color sample when a difference in the appearance of the colors of the first color sample and the second color sample is permitted.

4. It further has a holding means for holding color conversion parameters for color conversion, The image processing apparatus according to claim 1, characterized in that the conversion means converts the color of at least one of the right-eye image and the left-eye image using a color conversion parameter corresponding to the color vision characteristics.

5. The image processing apparatus according to claim 2, characterized in that the control means changes the color of the color swatch displayed on either the first display unit or the second display unit, based on instructions from the user.

6. The image processing apparatus according to claim 1, characterized in that the control means changes the size of the first color chart and the second color chart according to the user's instructions.

7. The image processing apparatus according to claim 1, characterized in that the control means changes the color of the background area of ​​the first color chart and the second color chart according to the user's instructions.

8. The image processing apparatus according to claim 5, characterized in that the control means sets either the first display unit or the second display unit as the display unit to be used to change the color of the color swatch, based on information that the user's dominant eye is the left eye or the right eye.

9. The control means, as a user instruction, L * a * b * Value or L * a * b * The image processing apparatus according to claim 2, characterized in that it accepts input of an increase or decrease in value.

10. The control means changes at least one of the first and second color swatches, which have the same display color in their initial state, to multiple colors within a predetermined range of color changes and displays them accordingly. The image processing apparatus according to claim 1, characterized in that the acquisition means acquires the color vision characteristics based on the result of aggregating the difference in color between the first color sample and the second color sample when a difference in the appearance of the colors of the first color sample and the second color sample is permitted.

11. The control means controls the color of the first region and the second region to be different in color, by dividing the color sample horizontally or vertically and displaying the first region on the first display unit and the second region on the second display unit. The image processing apparatus according to claim 1, characterized in that the acquisition means acquires the color vision characteristics based on the user's evaluation result regarding the difference in how the colors of the first region and the second region appear.

12. The image processing apparatus according to claim 11, characterized in that the color swatch is divided into three or more sections in at least one direction, horizontally and vertically, and the multiple sections obtained by the division are alternately displayed on the first display unit and the second display unit.

13. The image processing apparatus according to claim 11, characterized in that the color sample is divided in a checkerboard pattern, and the multiple regions obtained by the division are alternately displayed on the first display unit and the second display unit.

14. The control means controls the first region representing a predetermined shape in the color chart to be displayed on either the first display unit or the second display unit, and the second region representing the background of the first region in the color chart to be displayed on the other display unit, so that the colors of the first region and the second region are different. The image processing apparatus according to claim 1, characterized in that the acquisition means acquires the color vision characteristics based on the user's evaluation result regarding the difference in how the colors of the first region and the second region appear.

15. The image processing apparatus according to claim 11 or 14, characterized in that the control means changes the color of at least one of the first region and the second region according to the user's instructions.

16. The acquisition means calculates a color correction value for the color vision characteristics based on the color matching function corresponding to the color vision characteristics and the spectral characteristics of the first display unit and the second display unit. The image processing apparatus according to claim 1, characterized in that the conversion means converts the color of at least one of the right-eye image and the left-eye image based on the color vision correction value.

17. The image processing apparatus according to claim 16, wherein the acquisition means calculates a correction value for the color vision characteristics based on a color matching function corresponding to the color vision characteristics and the viewing angle information of the first display unit and the second display unit, and the spectral characteristics of the first display unit and the second display unit.

18. An image processing method for displaying images for the right eye and images for the left eye, The process involves acquiring color vision characteristics that represent the difference in how the user's left and right eyes perceive colors, and A conversion step of converting the color of at least one of the right-eye image and the left-eye image based on the aforementioned color vision characteristics, A control step of displaying a first color swatch on a first display unit which is a display unit for the right eye, and displaying a second color swatch on a second display unit which is a display unit for the left eye, and controlling the colors of the first color swatch and the second color swatch to be different, Includes, An image processing method characterized in that, in the acquisition step, the color vision characteristics are acquired based on the user's evaluation result regarding the difference in how the colors of the first color chart and the second color chart appear.

19. A computer for an image processing device that displays images for the right eye and images for the left eye, A means for acquiring color vision characteristics that represent the difference in how the user's left and right eyes perceive colors, A conversion means for converting the color of at least one of the right-eye image and the left-eye image based on the aforementioned color vision characteristics, A control means that displays a first color swatch on a first display unit for the right eye, and a second color swatch on a second display unit for the left eye, and controls the colors of the first and second color swatches to be different. To make it function as, The acquisition means is a program characterized by acquiring the color vision characteristics based on the user's evaluation result regarding the difference in how the colors of the first color chart and the second color chart appear.

Images