Information processing device, information processing method, and program

Abstract

An information processing device (100) comprises a measurement pattern generation unit (11) and a crosstalk parameter calculation unit (15). The measurement pattern generation unit (11) generates a crosstalk measurement pattern. The crosstalk parameter calculation unit (15) applies the measurement result of the crosstalk measurement pattern to a crosstalk model (21) including a plurality of degradation features, and calculates a crosstalk parameter (23) set for each degradation feature.

Description

[Technical Field]

[0001] The present invention relates to an information processing device, an information processing method, and a program. [Background technology]

[0002] Crosstalk can be a problem for display devices that display stereoscopic or multi-viewpoint images. To address this issue, a technique has been proposed to suppress crosstalk by using an inverse correction process that performs a transformation opposite to that caused by crosstalk. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2013-183426 Summary of the Invention [Problem to be solved by the invention]

[0004] In the above-mentioned conventional technology, crosstalk is modeled as a simple linear mixed model. However, it is known that crosstalk is caused by various factors, and it is difficult to effectively suppress crosstalk using a simple linear mixed model.

[0005] Therefore, the present disclosure proposes an information processing device, an information processing method, and a program that can effectively suppress crosstalk. [Means for solving the problem]

[0006] According to the present disclosure, there is provided an information processing device including a measurement pattern generation unit that generates a crosstalk measurement pattern, and a crosstalk parameter calculation unit that applies measurement results of the crosstalk measurement pattern to a crosstalk model including multiple degradation characteristics and calculates crosstalk parameters set for each degradation characteristic. Also, according to the present disclosure, there is provided an information processing method in which information processing of the information processing device is executed by a computer, and a program that causes a computer to realize the information processing of the information processing device. [Brief explanation of the drawings]

[0007] [Figure 1] FIG. 1 is an explanatory diagram of a crosstalk model. [Figure 2] FIG. 10 is a diagram illustrating an example of crosstalk correction processing. [Figure 3] 1 is a diagram showing the process of crosstalk correction and crosstalk degradation in succession. [Figure 4] FIG. 10 is a diagram illustrating an example of a method for calculating a crosstalk parameter. [Figure 5] FIG. 10 is a diagram illustrating an example of a crosstalk measurement method. [Figure 6] 10 is a graph showing the coordinate dependency of the left eye level after crosstalk. [Figure 7] 10 is a graph showing the relationship between a tone conversion coefficient and a mixture ratio. [Figure 8] FIG. 10 is a diagram illustrating an example of a left eye image. [Figure 9] FIG. 10 is a diagram illustrating an example of a right-eye image. [Figure 10] 1 is a schematic diagram of an information processing apparatus according to a first embodiment. [Figure 11] 10 is a flowchart illustrating an example of information processing. [Figure 12] FIG. 10 is an explanatory diagram of a second modified example. [Figure 13] FIG. 10 is an explanatory diagram of a third modified example. [Figure 14] FIG. 10 is an explanatory diagram of a fourth modified example. [Figure 15] FIG. 10 is a schematic diagram of an information processing apparatus according to a second embodiment. [Figure 16] 10 is a flowchart illustrating an example of information processing. [Figure 17] FIG. 10 is a diagram illustrating an example of a method for calculating a crosstalk parameter. [Figure 18] FIG. 10 is a diagram illustrating an example of a crosstalk measurement method. DETAILED DESCRIPTION OF THE INVENTION

[0008] Hereinafter, embodiments of the present disclosure will be described in detail with reference to the drawings. In the following embodiments, the same components are designated by the same reference numerals, and redundant description will be omitted.

[0009] The explanation will be given in the following order. [1. Overview of crosstalk correction processing] [1-1. Crosstalk model] [1-2. Crosstalk correction processing] [1-3. Crosstalk parameter calculation method] [2. First embodiment] [2-1. Configuration of information processing device] [2-2. Information processing method] [2-3. Effects] [2-4. Variation 1] [2-5. Variation 2] [2-6. Variation 3] [2-7. Variation 4] [2-8. Variation 5] 3. Second Embodiment [3-1. Configuration of information processing device] [3-2. Information processing method] [3-3. Effects] 4. Third Embodiment [4-1. Crosstalk parameter calculation method] [4-2. Crosstalk correction processing] [4-3. Crosstalk parameter calculation method] [4-4. Effects]

[0010] [1. Overview of crosstalk correction processing] The present disclosure proposes a method for setting multiple degradation characteristics for crosstalk and accurately calculating crosstalk parameters 23 (see FIG. 10) included in each degradation characteristic. Setting multiple degradation factors for crosstalk enables crosstalk correction processing with higher accuracy than when a simple mixture model is used. The crosstalk correction processing of the present disclosure is performed using an information processing device 1 (see FIG. 10) described below. Details of the present disclosure will be described below.

[0011] [1-1. Crosstalk model] FIG. 1 is an explanatory diagram of the crosstalk model 21. As shown in FIG.

[0012] In the present disclosure, for example, a gradation characteristic and a mixture characteristic are set as the crosstalk characteristic. The gradation characteristic indicates the gradation dependency of the crosstalk. The mixture characteristic indicates the degree of interference between viewpoint images of a plurality of viewpoints.

[0013] Conventionally, a simple mixture model between viewpoint images has been used. However, actual crosstalk has luminance dependency, etc. It is difficult to calculate a color mixture rate that is luminance dependent using only a mixture model. Measurement becomes even more complicated when crosstalk characteristics change dynamically depending on the location on the screen, temperature characteristics, the user's viewing position, etc. Therefore, in the present disclosure, crosstalk correction is performed separately in a gradation conversion process and a mixing process. The parameters used in the gradation conversion process and the mixing process are determined based on the crosstalk measurement results. This enables crosstalk correction processing that takes gradation dependency into account.

[0014] The crosstalk correction process of the present disclosure can be applied to crosstalk between two viewpoints and crosstalk between multiple viewpoints (three or more viewpoints). 3D (dimensional) displays are known as displays that target two viewpoints. Below, an example in which the crosstalk correction process of the present disclosure is applied to a 3D display will be described.

[0015] An xy coordinate system is set on the screen where multiple viewpoint images are displayed. The y direction is the parallax direction, and the x direction is the direction perpendicular to the parallax direction. The parallax direction is the direction in which parallax occurs. For example, the direction in which a line connecting the viewer's right eye and left eye extends when projected onto the screen is the parallax direction.

[0016] In the following, the signal value (pixel value) at the (x, y) coordinate in the video signal is expressed as L E (x, y), and for the right eye image, R E If the coordinates are not an issue, omit (x, y) and write L E and R E Similarly, the luminance value perceived by humans through a display is written as L V and R V It is written as follows.

[0017] In a 3D display without crosstalk, the signal value of the left eye image (left eye signal value L E ) is converted by some display characteristics to the luminance value perceived by the left eye (left eye luminance value L V ) is converted into the right eye image. The same is true for the right eye image. E ) is converted by some display characteristics to the luminance value perceived by the right eye (right eye luminance value R V )

[0018] In 3D displays, there are various mixing models with different characteristics, such as mixing in light rays, mixing in devices, and electrical mixing when transmitting signals. Therefore, crosstalk has complex gradation characteristics. In this disclosure, the left eye level and right eye level at the stage where a linear mixing model holds are called L X and R X The crosstalk characteristics are (A) E → X gradation conversion characteristics, (B) L X ,R X It is formulated in three stages: (A) the mixing characteristics between X and E, and (B) the tone conversion characteristics from X to E.

[0019] The tone conversion characteristic (A) above is expressed, for example, by the conversion function of the following formula (1) using a tone conversion coefficient γ.

[0020]

number

[0021] In equation (1), an exponential function is used as the conversion function, but the conversion function does not have to be an exponential function. The conversion function may be any function as long as it is monotonic and its inverse function can be defined. For example, a polynomial or a trigonometric function may be used as the conversion function. E The right eye signal value R E The conversion function of the left eye signal value L E can be expressed by the same function as the transformation function of

[0022] The above-mentioned mixing characteristic (B) is expressed, for example, as the following formula (2) using the mixing ratio α.

[0023]

number

[0024] L X ′ is the left eye level L based on the mixture ratio α X and right eye level R X This is the left eye level after mixing. X ′ is the left eye level L based on the mixture ratio α X and right eye level R X In equation (2), for simplification, the left eye level L that leaks into the right eye is X and the right eye level R X The ratios of are described as the same value. However, these ratios do not necessarily have to be the same. The four matrix elements shown in equation (2) may be independent values.

[0025] The gradation conversion characteristic of (C) above is defined by an inverse function that uniquely corresponds to equation (1), as shown in equation (3) below. X ′, but the right eye level R X The transformation function of ′ is also the left eye level L X ' can be expressed by the same function as the transformation function of

[0026]

number

[0027] L E ′ and R E ′ is the left eye signal value L due to crosstalk with luminance dependency. E and the right eye signal value R E are the left eye signal values ​​and right eye signal values ​​after mixing. E ′ and right eye signal value R E ' is the left eye luminance value L due to display characteristics other than crosstalk characteristics. V ′ and right eye luminance value R V ' is converted to the left eye luminance value L V ′ and right eye luminance value R V ′ is the left eye luminance value L V and right eye luminance value R V Unlike the above, it is the brightness value of an image in which the left eye image and the right eye image are mixed.

[0028] [1-2. Crosstalk correction processing] FIG. 2 is a diagram illustrating an example of the crosstalk correction process.

[0029] Crosstalk correction processing is based on the (D)E→X gradation conversion characteristics, (E)L X ,R XIt is formulated in three stages: the matrix operation processing between (D) and (F) the tone conversion characteristics of X→E. The tone conversion characteristics of (D) above are the same as the tone conversion characteristics of (A) above, and are expressed by the above formula (1). The tone conversion characteristics of (F) above are the same as the tone conversion characteristics of (C) above, and are expressed by the above formula (3). The matrix operation processing of (E) above is expressed as the following formula (4) using the inverse matrix of the above formula (2).

[0030]

number

[0031] In equation (4), L X and R X The hats above indicate the left eye level and right eye level after the matrix calculation process of (E) above. Similarly, in FIG. 2, L E and R E The hats above indicate the left eye signal values ​​and right eye signal values ​​after crosstalk correction processing, obtained by applying the gradation conversion processing (F) above to the left eye level and right eye level after the matrix calculation processing (E) above.

[0032] FIG. 3 shows a continuous diagram of the process of crosstalk correction and crosstalk degradation.

[0033] By combining crosstalk correction and crosstalk degradation, the tone conversion characteristics of (A) and (F) are offset, and the mixed characteristics of (B) and (E) are offset. As a result, the left eye level and right eye level after the tone conversion process of (D) and the left eye level and right eye level after the mixed process of (B) match, as shown in the following formula (5). Therefore, an image without crosstalk degradation is perceived.

[0034]

number

[0035] [1-3. Crosstalk parameter calculation method] FIG. 4 is a diagram illustrating an example of a method for calculating the crosstalk parameter 23. In FIG.

[0036] The crosstalk model 21 includes, for example, a gradation characteristic and a mixture characteristic as degradation characteristics. Therefore, a gradation conversion coefficient γ indicating the gradation characteristic and a mixture ratio α indicating the mixture characteristic are calculated as crosstalk parameters 23.

[0037] If two crosstalk parameters 23, the mixture ratio α and the gradation conversion coefficient γ, are adjusted after measuring the gradation characteristics (E→V) of the display, many measurements are required to calculate the luminance. Furthermore, if there is a measurement error in the perceived luminance value, it is impossible to calculate an accurate crosstalk parameter 23. Therefore, in this disclosure, the crosstalk parameter 23 is calculated based on the luminance difference between adjacent patterns (relative luminance value) without relying on the absolute luminance value.

[0038] The crosstalk measurement pattern CMP includes a plurality of viewpoint images PV corresponding to different viewpoints. The plurality of viewpoint images PV include, for example, a left-eye image LPV and a right-eye image RPV. In measuring crosstalk, the luminance of the crosstalk measurement pattern CMP displayed on the display is measured. In a field sequential display, the plurality of viewpoint images PV are displayed alternately at regular intervals. In a parallax or lenticular display, the plurality of viewpoint images PV are synthesized and displayed on the same screen. In this embodiment, for example, the plurality of viewpoint images PV are displayed alternately using the field sequential method.

[0039] Each viewpoint image PV has multiple line patterns LP aligned in the parallax direction (y direction). The multiple line patterns LP include multiple variable patterns VP and multiple invariant patterns IVP. The variable patterns VP are line patterns LP whose signal values ​​vary depending on the position in the longitudinal direction (x direction) perpendicular to the parallax direction. The invariant patterns IVP are line patterns LP whose signal values ​​are constant throughout the entire longitudinal direction.

[0040] Within one viewpoint image PV, multiple variation patterns VP are periodically arranged in the parallax direction at intervals of two line patterns LP, the same as the number of viewpoints. Line patterns LP other than the variation patterns VP are invariant patterns IVP. When the position of the line pattern LP in the parallax direction is expressed as the number (line number) of the line pattern LP counted from the edge of the viewpoint image PV (for example, the image edge where the y coordinate is smallest), the position of the variation pattern VP in the parallax direction differs for each viewpoint image PV.

[0041] If the longitudinal coordinate is x and the signal value of the fluctuation pattern VP at the coordinate x is P(x), the signal value P(x) is a monotonic function. In the viewpoint images of two adjacent viewpoints, the signal value P(x) of the fluctuation pattern VP increases or decreases in opposite directions. The sum of the signal values ​​P(x) of the fluctuation pattern VP of the viewpoint images PV of two adjacent viewpoints is, for example, constant regardless of the coordinate x.

[0042] In the example of FIG. 4, each area extending in the x direction is a line pattern LP. For example, in the left-eye image LPV, area A is a fluctuation pattern VP, and area B is an invariant pattern IVP. In the right-eye image RPV, area A is an invariant pattern IVP, and area B is a fluctuation pattern VP. The line numbers of areas A and B in the left-eye image LPV are the same as the line numbers of areas A and B in the right-eye image RPV. In one viewpoint image PV, multiple fluctuation patterns VP and multiple invariant patterns IVP are arranged alternately in the parallax direction. In the viewpoint images PV of two adjacent viewpoints, the order in which the fluctuation patterns VP and invariant patterns IVP are arranged is different.

[0043] Signal value L of area A of the left eye image LPV E(A) , the signal value L of the region B of the left eye image LPV E(B) , the signal value R of the area A of the right-eye image RPV E(A) , the signal value R of the area B of the right-eye image RPV E(B) is expressed, for example, as in the following formula (6).

[0044]

number

[0045] The signal value in equation (6) is normalized with the maximum signal value being 1. C is a constant between 0 and 1. In the example of equation (6), the signal value R E(A) is 0, but the signal value R E(A) may be a constant other than 0. In measuring crosstalk, a plurality of crosstalk measurement patterns CMP are generated by varying the combination of signal values ​​of the invariant patterns IVP of each viewpoint image PV.

[0046] FIG. 5 is a diagram illustrating an example of a crosstalk measurement technique.

[0047] The crosstalk measurement pattern CMP is observed through the display. The luminance distribution of the crosstalk measurement pattern CMP without crosstalk correction processing differs from the luminance distribution estimated from the signal value. The deviation in the luminance distribution is caused by crosstalk. For example, in the example of Figure 5, the signal value L of area B of the left eye image LPV is E(B) is a constant C, but the left eye luminance value L perceived through the display V(B) The image ′ has a gradient in the longitudinal direction (x direction). This gradient is caused by interference (crosstalk) with region B of the right-eye image RPV.

[0048] In the present disclosure, in order to check the magnitude of crosstalk, for example, a position (coordinate x) where a varying pattern VP and an invariant pattern IVP are observed to have the same brightness in the same viewpoint image PV is detected as a same-brightness position. At the same-brightness position, the relationship of the following formula (7) holds.

[0049]

number

[0050] The signal value at the same luminance position is expressed by the following equations (8) and (9): The coordinate of the same luminance position is expressed as a bar above the coordinate x.

[0051]

number

[0052]

number

[0053] Substituting equations (8) and (9) into equation (7), we obtain the following equation (10).

[0054]

number

[0055] Figure 6 shows the left eye level L after crosstalk. X 6 is a graph showing the coordinate dependency of γ′. The left side of FIG. 6 is a graph when C=0. The right side of FIG. 6 is a graph when C=0.5. FIG. 7 is a graph showing the relationship between the gradation conversion coefficient γ and the mixture ratio α when C=0 and when C=0.5. FIG. 8 is a diagram showing an example of the left eye image LPV when C=0. FIG. 9 is a diagram showing an example of the right eye image RPV when C=0.

[0056] The luminance is measured for multiple crosstalk measurement patterns CMP with different values ​​of the constant C. From these measurements, multiple relational expressions between the gradation conversion coefficient γ and the mixture ratio α are generated. By combining these relational expressions, the values ​​of the gradation conversion coefficient γ and the mixture ratio α can be found.

[0057] The value of each crosstalk parameter 23 is obtained by solving at least as many simultaneous relational equations as the number of crosstalk parameters 23. However, if the calculated values ​​vary for each measurement due to disturbances or the like, it is possible to increase the number of simultaneous relational equations and calculate multiple parameter values ​​for each crosstalk parameter 23. By calculating the average value of the multiple parameter values ​​as the value of the crosstalk parameter 23, the influence of errors contained in each parameter value is suppressed.

[0058] [2. First embodiment] [2-1. Configuration of information processing device] FIG. 10 is a schematic diagram of the information processing device 1 of the first embodiment.

[0059] The above-described crosstalk correction process of the present disclosure is performed by an information processing device 1. The information processing device 1 includes, for example, a processing device 10, a storage device 20, a display 30, and an imaging device 40.

[0060] The processing device 10 includes a measurement pattern generating unit 11, a video signal output unit 12, an image acquiring unit 13, a brightness position detecting unit 14, a crosstalk parameter calculating unit 15, and a crosstalk correction processing unit 16.

[0061] The measurement pattern generation unit 11 generates a crosstalk measurement pattern CMP based on pattern information 22. The pattern information 22 includes, for example, information related to the crosstalk measurement pattern CMP. Based on the pattern information 22, the measurement pattern generation unit 11 generates a plurality of crosstalk measurement patterns CMP with different combinations of signal values ​​of the invariant pattern IVP.

[0062] The video signal output unit 12 converts the crosstalk measurement pattern CMP into a video signal and outputs it to the display 30. As the display 30, a known display such as an LCD (Liquid Crystal Display) or an OLED (Organic Light Emitting Diode) is used.

[0063] The crosstalk measurement pattern CMP displayed on the display 30 is photographed by the photographing device 40. The photographing device 40 includes an image sensor such as a CCD (Charge Coupled Device Image Sensor) or a CMOS (Complementary Metal Oxide Semiconductor).

[0064] The image acquisition unit 13 acquires a photographed image of the crosstalk measurement pattern CMP from the photographing device 40. For example, only a photographed image of one viewpoint image PV among a plurality of viewpoint images PV included in the crosstalk measurement pattern CMP is used to calculate the crosstalk parameter 23. The image acquisition unit 13 selectively acquires, for example, only a photographed image of one viewpoint image PV from the photographing device 40. In the example of FIG. 5, the left eye luminance value L V Therefore, only the photographed image of the left eye image LPV is selectively acquired by the image acquisition unit 13.

[0065] The same brightness position detection unit 14 analyzes the captured image and detects a position (coordinate x) where the fluctuation pattern VP and the invariant pattern IVP are observed to have the same brightness within the same viewpoint image PV as the same brightness position. The same brightness position is detected, for example, as a position where the brightness difference between the fluctuation pattern VP and the invariant pattern IVP is equal to or less than a threshold. The same brightness position detection unit 14 detects the same brightness position for each crosstalk measurement pattern CMP.

[0066] The crosstalk parameter calculation unit 15 applies the measurement results of the crosstalk measurement pattern CMP to a crosstalk model 21 including a plurality of degradation characteristics to calculate crosstalk parameters 23 set for each degradation characteristic. The plurality of degradation characteristics include, for example, a gradation characteristic and a mixture characteristic. The crosstalk parameter calculation unit 15 calculates, as the crosstalk parameters 23, a gradation conversion coefficient γ indicating the gradation characteristic and a mixture ratio α indicating the mixture characteristic.

[0067] For example, the crosstalk parameter calculation unit 15 applies the measurement results of the luminance difference between line patterns LP in the same viewpoint image PV to the crosstalk model 21. In the example of Fig. 5, the same luminance position detected based on the luminance difference between the varying pattern VP and the invariant pattern IVP of the left-eye image LPV is used to calculate the crosstalk parameter 23. The crosstalk parameter calculation unit 15 applies the measurement results of the same luminance position measured for each crosstalk measurement pattern CMP to the crosstalk model 21.

[0068] The crosstalk parameter calculation unit 15 can statistically calculate the crosstalk parameters 23 using a large number of crosstalk measurement patterns CMP. For example, the measurement pattern generation unit 11 generates a number of crosstalk measurement patterns CMP that is greater than the number of crosstalk parameters 23. The crosstalk parameter calculation unit 15 calculates a plurality of parameter values ​​for each crosstalk parameter 23. The crosstalk parameter calculation unit 15 calculates an average value of the plurality of parameter values ​​as the value of the crosstalk parameter 23.

[0069] Weights can be set for the multiple parameter values. For example, the crosstalk parameter calculation unit 15 calculates a weighted average of the multiple parameter values ​​based on the weights set for each crosstalk measurement pattern CMP. The crosstalk parameter calculation unit 15 outputs the calculated weighted average as the value of the crosstalk parameter 23. Information about the weights is included in the pattern information 22.

[0070] Crosstalk correction processing unit 16 corrects the video signal input from the external device based on crosstalk parameters 23 calculated by crosstalk parameter calculation unit 15. The video signal after crosstalk correction processing is output to display 30 via video signal output unit 12. As a result, an image with reduced crosstalk is displayed on display 30.

[0071] The storage device 20 stores, for example, a crosstalk model 21, pattern information 22, crosstalk parameters 23, and a program 29. The program 29 is a program that causes a computer to execute information processing according to the present disclosure. The processing device 10 performs various processes in accordance with the program 29 stored in the storage device 20. The storage device 20 may be used as a work area for temporarily storing processing results of the processing device 10. The storage device 20 includes, for example, any non-transitory storage medium such as a semiconductor storage medium or a magnetic storage medium. The storage device 20 includes, for example, an optical disk, a magneto-optical disk, or a flash memory. The program 29 is stored, for example, in a non-transitory storage medium readable by a computer.

[0072] The processing device 10 is, for example, a computer configured with a processor and a memory. The memory of the processing device 10 includes a RAM (Random Access Memory) and a ROM (Read Only Memory). By executing a program 29, the processing device 10 functions as a measurement pattern generation unit 11, a video signal output unit 12, an image acquisition unit 13, a brightness position detection unit 14, a crosstalk parameter calculation unit 15, and a crosstalk correction processing unit 16.

[0073] [2-2. Information processing method] 11 is a flowchart showing an example of information processing according to the present disclosure, illustrating an example of the process for calculating the crosstalk parameters 23 of 3D video images described with reference to FIG.

[0074] In step S11, the measurement pattern generation unit 11 sets a variable i to 1. The variable i indicates the number of the crosstalk measurement pattern CMP. Hereinafter, the i-th crosstalk measurement pattern CMP will be referred to as the crosstalk measurement pattern CMP. i It is written as follows.

[0075] In step S12, the measurement pattern generation unit 11 generates the crosstalk measurement pattern CMP i The constant C iSet the constant C i is the signal value L of the area B (invariant pattern IVP) of the left eye image LPV. E(B) The constant C i The value is defined in the pattern information 22.

[0076] In step S13, the measurement pattern generation unit 11 calculates the crosstalk measurement pattern CMP using equation (6). i and outputs it to the video signal output unit 12.

[0077] In step S14, the video signal output unit 12 outputs a crosstalk measurement pattern CMP to the display 30. i Display.

[0078] In step S15, the image capturing device 40 captures the crosstalk measurement pattern CMP displayed on the display 30. i The photographing device 40 photographs, for example, the crosstalk measurement pattern CMP. i The image capturing device 40 selectively captures only the left eye image LPV from among the left eye image LPV and the right eye image RPV included in the image capturing device 40. The image capturing device 40 outputs the captured image to the image acquiring unit 13.

[0079] In step S16, the same-luminance position detection unit 14 acquires a photographed image of the left-eye image LPV from the image acquisition unit 13. The same-luminance position detection unit 14 detects a same-luminance position from the photographed image where the area A and the area B are observed to have the same luminance. The same-luminance position detection unit 14 detects a same-luminance position from the photographed image where the area A and the area B are observed to have the same luminance. i The detected same luminance positions are output to the crosstalk parameter calculation unit 15.

[0080] In step S17, the measurement pattern generation unit 11 determines whether the variable i is N. N is the number of crosstalk measurement patterns CMP for which measurement is to be performed. The number N is defined in the pattern information 22.

[0081] If it is determined in step S17 that the variable i is not equal to N (step S17: No), the process proceeds to step S18. In step S18, the measurement pattern generation unit 11 adds 1 to the variable i and returns to step S12. Then, the processes from step S12 to step S17 are repeated until the variable i becomes equal to N.

[0082] If it is determined in step S17 that the variable i is N (step S17: Yes), the process proceeds to step S19. In step S19, the crosstalk parameter calculation unit 15 calculates the tone conversion coefficient γ and the mixture ratio α based on the same luminance position detected for each crosstalk measurement pattern CMP.

[0083] [2-3. Effects] The information processing device 1 has a measurement pattern generation unit 11 and a crosstalk parameter calculation unit 15. The measurement pattern generation unit 11 generates a crosstalk measurement pattern CMP. The crosstalk parameter calculation unit 15 applies the measurement results of the crosstalk measurement pattern CMP to a crosstalk model 21 including a plurality of degradation characteristics, and calculates crosstalk parameters 23 set for each degradation characteristic. In the information processing method of this embodiment, the processing of the information processing device 1 described above is executed by a computer. A program 29 of this embodiment causes the computer to realize the processing of the information processing device 1 described above.

[0084] This configuration makes it possible to correct crosstalk taking into account various degradation characteristics, thereby effectively suppressing crosstalk.

[0085] The degradation characteristics include a gradation characteristic indicating the gradation dependency of the crosstalk and a mixture characteristic indicating the degree of interference between the viewpoint images PV. The crosstalk parameter calculation unit 15 calculates, as crosstalk parameters 23, a gradation conversion coefficient γ indicating the gradation characteristic and a mixture ratio α indicating the mixture characteristic.

[0086] According to this configuration, not only the crosstalk mixing characteristics but also the gradation characteristics are measured, which enables correction that takes into account the gradation characteristics of the crosstalk, thereby improving the accuracy of the correction.

[0087] The crosstalk measurement pattern CMP includes multiple viewpoint images PV corresponding to different viewpoints. Each viewpoint image PV has multiple line patterns LP aligned in the parallax direction. The crosstalk parameter calculation unit 15 acquires information about the luminance difference between the line patterns LP in the same viewpoint image PV as a measurement result. The crosstalk parameter calculation unit 15 applies the measurement result of the luminance difference between the line patterns LP in the same viewpoint image PV to a crosstalk model 21.

[0088] According to this configuration, the crosstalk parameters 23 are calculated based on the relative values ​​of the luminance of each line pattern LP. Because there is no need to accurately measure the absolute values ​​of the luminance, disturbances such as external light are less likely to affect the calculation results of the crosstalk parameters 23. Furthermore, the crosstalk parameters are calculated based on a combination of signal values ​​that reduces luminance steps as a result of the image output. Therefore, the problem of luminance steps, which is the most problematic aspect of crosstalk, is less likely to occur in the video after crosstalk correction processing.

[0089] The multiple line patterns LP include multiple fluctuation patterns VP and multiple invariant patterns IVP. The fluctuation pattern VP is a line pattern LP whose signal value varies depending on the position in the longitudinal direction perpendicular to the parallax direction. The invariant pattern IVP is a line pattern LP whose signal value is constant throughout the longitudinal direction. The position of the fluctuation pattern VP in the parallax direction differs for each viewpoint image PV. If the longitudinal coordinate is x and the signal value of the fluctuation pattern at coordinate x is P(x), the signal value P(x) is a monotonic function. In the viewpoint images PV of two adjacent viewpoints, the signal value P(x) of the fluctuation pattern VP increases or decreases in opposite directions.

[0090] According to this configuration, the fluctuation pattern VP of each viewpoint image PV strongly interferes with the invariant pattern IVP of the viewpoint image PV of an adjacent viewpoint. The signal value of the fluctuation pattern VP changes monotonically. Therefore, a luminance gradient occurs in the longitudinal direction of the invariant pattern IVP due to interference (crosstalk) with the fluctuation pattern VP. This gradient causes the distribution of luminance differences between line patterns LP in the same viewpoint image PV to slide in the longitudinal direction. The amount of slide of the distribution strongly reflects crosstalk information. By examining the amount of slide of the distribution, the crosstalk parameter 23 can be calculated with high accuracy.

[0091] The measurement pattern generation unit 11 generates a plurality of crosstalk measurement patterns CMP with different combinations of signal values ​​of the invariant pattern IVP. The crosstalk parameter calculation unit 15 applies the measurement results for the coordinate x where the luminance difference is equal to or less than the threshold, measured for each crosstalk measurement pattern CMP, to the crosstalk model 21.

[0092] With this configuration, the amount of shift in the distribution of luminance differences can be determined based on the coordinate x where the luminance difference is equal to or less than the threshold. Because the luminance difference changes gradually along the longitudinal direction and the human eye is highly sensitive to luminance differences between adjacent regions, visual measurement is possible.

[0093] The measurement pattern generation unit 11 generates crosstalk measurement patterns whose number is greater than the number of crosstalk parameters 23. The crosstalk parameter calculation unit 15 calculates multiple parameter values ​​for each crosstalk parameter 23 according to the number of crosstalk measurement patterns CMP. The crosstalk parameter calculation unit 15 calculates an average value of the multiple parameter values ​​as the value of the crosstalk parameter 23.

[0094] This configuration reduces the influence of errors contained in each parameter value.

[0095] The crosstalk parameter calculation unit 15 calculates a weighted average of the multiple parameter values ​​based on the weights set for each crosstalk measurement pattern CMP, and outputs the calculated weighted average as the value of the crosstalk parameter 23.

[0096] This configuration effectively suppresses crosstalk of specific gradations according to the weight. When an image with a bias in gradations, such as a dark or bright image, is displayed, adjusting the weight according to this bias provides an image with less crosstalk.

[0097] [2-4. Variation 1] In the first embodiment described above, the signal value of the fluctuation pattern VP is shown to fluctuate according to the display position. However, the form of the signal value fluctuation is not limited to this. The signal value of the fluctuation pattern VP may fluctuate according to the display time.

[0098] For example, a fluctuation pattern VP is a line pattern LP whose signal value fluctuates with time. An invariant pattern IVP is a line pattern LP whose signal value remains constant regardless of time. If the measurement time is t and the signal value of the fluctuation pattern VP at time t is Q(t), the signal value Q(t) is a monotonic function. In the viewpoint images PV of two adjacent viewpoints, the signal value Q(t) of the fluctuation pattern VP increases or decreases in opposite directions.

[0099] According to this configuration, the fluctuation pattern VP of each viewpoint image PV strongly interferes with the invariant pattern IVP of the viewpoint image PV of an adjacent viewpoint. The signal value of the fluctuation pattern VP changes monotonically. Therefore, the luminance of the invariant pattern IVP changes over time due to interference (crosstalk) with the fluctuation pattern VP. Due to this change in luminance, the luminance difference between line patterns LP in the same viewpoint image PV also changes over time. The amount of change in luminance difference strongly reflects information about crosstalk. By examining the amount of change in luminance difference, the crosstalk parameter 23 can be calculated with high accuracy.

[0100] In this modification, the measurement pattern generation unit 11 generates multiple crosstalk measurement patterns CMP with different combinations of signal values ​​of the invariant pattern IVP. The crosstalk parameter calculation unit 15 applies the measurement results, measured for each crosstalk measurement pattern CMP at time t when the luminance difference becomes equal to or smaller than the threshold, to the crosstalk model 21.

[0101] With this configuration, the amount of change in the luminance difference can be determined based on the time t when the luminance difference becomes equal to or smaller than the threshold value. The luminance difference changes gradually over time, and the human eye is highly sensitive to luminance differences between adjacent regions, making it possible to measure it visually.

[0102] [2-5. Variation 2] FIG. 12 is an explanatory diagram of the second modification.

[0103] The measurement pattern generation unit 11 generates a single test image TI in which multiple crosstalk measurement patterns CMP are incorporated on the same screen. The test image TI has the same number of block areas BA as the number N of crosstalk measurement patterns CMP. In each block area BA, a crosstalk measurement pattern CMP with a different constant C is arranged. The photographing device 40 photographs multiple crosstalk measurement patterns CMP with different constants C in one shot.

[0104] In the first embodiment described above, multiple crosstalk measurement patterns CMP are displayed separately. Therefore, the generation, display, and measurement of the crosstalk measurement patterns CMP are performed multiple times. In contrast, in this modified example, all of the crosstalk measurement patterns CMP are measured in one shot. Therefore, the measurement time is reduced.

[0105] [2-6. Variation 3] FIG. 13 is an explanatory diagram of the third modification.

[0106] In this modified example, multiple crosstalk measurement patterns CMP are incorporated into a single test image TI, as in modified example 2. In modified example 2, the test image TI is divided into the same number of block areas BA as the number N of crosstalk measurement patterns CMP, and each block area BA is assigned a crosstalk measurement pattern CMP with a different constant C. In contrast, the measurement pattern generation unit 11 of this modified example assigns multiple crosstalk measurement patterns CMP to pixels of different colors.

[0107] For example, the display 30 has multiple pixel rows PA extending in the x direction. Each pixel row PA has multiple pixels assigned the same color. On the display 30, multiple pixel rows PA assigned different colors are alternately arranged in the y direction. Multiple crosstalk measurement patterns CMP are assigned to pixel rows PA of different colors, respectively. Multiple line patterns LP belonging to the same crosstalk measurement pattern CMP are displayed dispersedly on multiple pixel rows PA assigned the same color. This configuration increases the spatial density of crosstalk measurement.

[0108] [2-7. Variation 4] FIG. 14 is an explanatory diagram of the fourth modification.

[0109] The measurement pattern generator 11 of this modified example generates a crosstalk measurement pattern CMP as an invisible pattern IVI to be incorporated into a visible light image VI. The display 30 is, for example, a projector including a visible light source and an IR (Infrared Ray) light source, and the crosstalk measurement pattern CMP is displayed using the IR light source. With this configuration, crosstalk can be measured while the visible light image VI is displayed. Because real-time measurement is possible, correction can be made to follow dynamic changes in crosstalk.

[0110] [2-8. Variation 5] In the first embodiment described above, the crosstalk model 21 includes multiple degradation characteristics. However, the method of calculating the crosstalk parameters 23 based on the luminance difference between adjacent patterns can be applied to crosstalk models other than the above-described crosstalk model 21, i.e., to crosstalk models 21 including any number of degradation characteristics equal to or greater than one. For example, the above-described method can also be applied to conventional crosstalk models that do not consider gradation characteristics. In this case, the crosstalk parameter is the mixture ratio α only, and the gradation conversion coefficient γ is a preset fixed value. In this case, too, a crosstalk measurement pattern CMP can be generated based on equation (6), and the crosstalk parameters 23 can be calculated based on equation (10).

[0111] 3. Second Embodiment [3-1. Configuration of information processing device] FIG. 15 is a schematic diagram of an information processing device 2 according to the second embodiment.

[0112] This embodiment differs from the first embodiment in that the detection of the same brightness position is performed visually. Therefore, the processing device 50 of this embodiment does not include the image acquisition unit 13 and the same brightness position detection unit 14. The same brightness position is directly input by the user using an input device 70 such as a keyboard, mouse, or touch panel. A program 69 for performing information processing corresponding to such visual measurement is stored in the storage device 60.

[0113] [3-2. Information processing method] FIG. 16 is a flowchart showing an example of information processing according to this embodiment.

[0114] Steps S21 to S24 are the same as steps S11 to S14 shown in Fig. 11. In this embodiment, in step S25, the user i The user visually inspects the crosstalk measurement pattern CMP. i Of the left-eye image LPV and the right-eye image RPV included in the image, only the left-eye image LPV is observed.

[0115] In step S26, the user detects a position where the area A and the area B of the left-eye image LPV are observed as having the same brightness. i The detected same luminance positions are input to the crosstalk parameter calculation unit 15 using the input device 70. Steps S27 to S29 are the same as steps S17 to S19 shown in FIG.

[0116] [3-3. Effects] This embodiment also provides the same effects as the first embodiment. Although the user performs the measurement visually, the human eye is highly sensitive to adjacent brightness steps, so the accuracy of detecting the same brightness position is not significantly impaired. Since the image capturing device 40 can be omitted, the configuration of the information processing device 2 is simplified.

[0117] 4. Third Embodiment [4-1. Crosstalk parameter calculation method] In this embodiment, an example will be described in which the above-described method for calculating the crosstalk parameter 23 is applied to a multi-viewpoint image. Hereinafter, the i-th viewpoint will be referred to as the i-th viewpoint V i and the i-th viewpoint V i The viewpoint image PV of the i-th viewpoint is referred to as the i-th viewpoint image PVi. As in the first embodiment, the signal value of the i-th viewpoint is V iE and the luminance value of the i-th viewpoint perceived by a human through the display 30 is written as V iV Also, the level at which the linear mixed model holds is V iX In this embodiment, a case where the number of viewpoints is three will be described, but a similar method can also be applied when the number of viewpoints is four or more.

[0118] In this embodiment, the crosstalk characteristics are also formulated in three stages: (A) E → X gradation conversion characteristics, (B) mixed characteristics, and (C) X → E gradation conversion characteristics. The gradation conversion characteristics (A) are expressed, for example, by the conversion function of the following equation (11) using a gradation conversion coefficient γ.

[0119]

number

[0120] In equation (11), an exponential function is used as the conversion function, but the conversion function does not have to be an exponential function. The conversion function may be any function as long as it is monotonic and an inverse function can be defined. For example, a polynomial or a trigonometric function may be used as the conversion function. Equation (11) is expressed as follows: 1E The transformation function of the second viewpoint signal value V 2E and the signal value V of the third viewpoint 3E The transformation function of the first viewpoint signal value V 1E can be expressed by the same function as the transformation function of

[0121] The above-mentioned (B) mixing characteristic is expressed, for example, as in the following formula (12) using the mixing ratios α and β.

[0122]

number

[0123] V iX ′ is the first viewpoint level V 1X , Second viewpoint level V 2X and Third Viewpoint Level V 3X is the level of the i-th viewpoint after mixing based on the mixing ratios α and β. In equation (12), for simplification, the first viewpoint level V 1X The ratio of the second viewpoint level V flowing into the third viewpoint V3 side 2X The ratio of the third viewpoint level V flowing into the first viewpoint V1 side 3X The ratio of the third viewpoint level V2 to the second viewpoint V3 is listed as the same value. 3X The ratio of the first viewpoint level V flowing into the third viewpoint V3 side 1X The ratio of the second viewpoint level V flowing into the first viewpoint V1 side 2X The ratios of are described as the same value. However, these ratios do not necessarily have to be the same. The nine matrix elements shown in equation (12) may have values ​​independent of each other.

[0124] The tone conversion characteristic of (C) above is defined by an inverse function that uniquely corresponds to equation (11), as shown in equation (13) below. 1X ′, but the second viewpoint level V 2X Transformation function of ′ and the third viewpoint level V 3X The transformation function of ′ is also the first viewpoint level V 1X ' can be expressed by the same function as the transformation function of

[0125]

number

[0126] V iE ′ is the signal value V iE is the signal value of the i-th viewpoint after mixing. iE ' is the brightness value V due to display characteristics other than crosstalk characteristics. iV ' is converted to the brightness value V iV ' is the brightness value of the image in which the viewpoint images PV of each viewpoint are mixed.

[0127] [4-2. Crosstalk correction processing] The crosstalk correction process is formulated in three stages: (D) E→X tone conversion characteristics, (E) inverse matrix calculation process, and (F) X→E tone conversion characteristics. The tone conversion characteristics of (D) are the same as the tone conversion characteristics of (A) above, and are expressed by the above formula (11). The tone conversion characteristics of (F) are the same as the tone conversion characteristics of (C) above, and are expressed by the above formula (13). The inverse matrix calculation process of (E) is expressed as the following formula (14) using the inverse matrix of the above formula (12).

[0128]

number

[0129] In equation (14), V iX The hat on the left represents the i-th viewpoint V after inverse matrix processing. iWhen crosstalk correction and crosstalk degradation are combined, the tone conversion characteristics of (A) and (F) above cancel each other out, and the mixed characteristics of (B) and (E) above cancel each other out. As a result, the level of each viewpoint after the tone conversion process of (D) above and the level of each viewpoint after the mixed process of (B) above match, as shown in equation (15) below. Therefore, an image without crosstalk degradation is perceived.

[0130]

number

[0131] [4-3. Crosstalk parameter calculation method] FIG. 17 is a diagram illustrating an example of a method for calculating the crosstalk parameter 23. In FIG.

[0132] Within one viewpoint image PV, multiple variation patterns VP are periodically arranged in the parallax direction at intervals of three line patterns LP, the same as the number of viewpoints. Line patterns LP other than the variation patterns VP are invariant patterns IVP. When the position of the line pattern LP in the parallax direction is expressed as the number (line number) of the line pattern LP counted from the edge of the viewpoint image PV (for example, the image edge where the y coordinate is smallest), the position of the variation pattern VP in the parallax direction differs for each viewpoint image PV.

[0133] If the longitudinal coordinate is x and the signal value of the fluctuation pattern VP at the coordinate x is P(x), the signal value P(x) is a monotonic function. In the viewpoint images of two adjacent viewpoints, the signal value P(x) of the fluctuation pattern VP increases or decreases in opposite directions. The sum of the signal values ​​P(x) of the fluctuation pattern VP of the viewpoint images PV of two adjacent viewpoints is, for example, constant regardless of the coordinate x.

[0134] In the example of Figure 17, each area extending in the x direction is a line pattern LP. For example, in the first viewpoint image PV1, area A is a variation pattern VP, and areas B+ and B- are invariant patterns IVP. In the second viewpoint image PV2, area B+ is a variation pattern VP, and areas A and B- are invariant patterns IVP. In the third viewpoint image PV3, area B- is a variation pattern VP, and areas A and B+ are invariant patterns IVP. The line numbers of areas A, B+, and B- in the first viewpoint image PV1, the line numbers of areas A, B+, and B- in the second viewpoint image PV2, and the line numbers of areas A, B+, and B- in the third viewpoint image PV3 are equal.

[0135] The signal value of each region is expressed, for example, as in the following equation (16).

[0136]

number

[0137] The signal value in equation (16) is normalized with the maximum signal value being 1. C is a constant between 0 and 1. In the example of equation (16), the signal value V 2E(A) , V 3E(A) , V 3E(B+) and V 2E(B-) is 0, but these signal values ​​may be constants other than 0. In measuring crosstalk, a plurality of crosstalk measurement patterns CMP are generated by varying the combination of signal values ​​of the invariant pattern IVP.

[0138] FIG. 18 is a diagram illustrating an example of a crosstalk measurement technique.

[0139] In the present disclosure, the magnitude of crosstalk between the first viewpoint V1 and the second viewpoint V2 and the magnitude of crosstalk between the first viewpoint V1 and the third viewpoint V3 are measured based on the luminance distribution of the first viewpoint image PV1. In the present disclosure, for example, a first isoluminance position where area A and area B+ are observed to have the same luminance in the first viewpoint image PV1, and a second isoluminance position where area A and area B- are observed to have the same luminance are detected.

[0140] The signal value at the first isoluminance position is expressed by the following equations (17) and (18): The coordinate of the first isoluminance position is expressed as a coordinate x with a single bar above it.

[0141]

number

[0142]

number

[0143] At the first same luminance position, the relationship of the following formula (19) holds.

[0144]

number

[0145] The signal value at the second iso-luminance position is expressed by the following equations (20) and (21): The coordinate of the second iso-luminance position is expressed as a coordinate x with a double bar above it.

[0146]

number

[0147]

number

[0148] At the second same luminance position, the relationship of the following formula (22) holds.

[0149]

number

[0150] The luminance is measured for multiple crosstalk measurement patterns CMP with different values ​​of the constant C. From these measurements, multiple relational expressions between the gradation conversion coefficient γ and the mixture ratio α are generated. By combining these relational expressions, the values ​​of the gradation conversion coefficient γ and the mixture ratios α and β can be found.

[0151] The value of each crosstalk parameter 23 is obtained by solving at least as many simultaneous relational equations as the number of crosstalk parameters 23. However, if the calculated values ​​vary for each measurement due to disturbances or the like, it is possible to increase the number of simultaneous relational equations and calculate multiple parameter values ​​for each crosstalk parameter 23. By calculating the average value of the multiple parameter values ​​as the value of the crosstalk parameter 23, the influence of errors contained in each parameter value is suppressed.

[0152] The first and second same-luminance positions may be detected by image analysis as in the first embodiment, or by visual measurement as in the second embodiment.

[0153] [4-4. Effects] In this embodiment, crosstalk in multi-viewpoint images can be effectively suppressed.

[0154] The effects described in this specification are merely examples and are not limiting, and other effects may also be present.

[0155] [Note] The present technology can also be configured as follows. (1) a measurement pattern generation unit that generates a crosstalk measurement pattern; a crosstalk parameter calculation unit that applies a measurement result of the crosstalk measurement pattern to a crosstalk model including a plurality of degradation characteristics and calculates crosstalk parameters set for each degradation characteristic; An information processing device having the above. (2) the plurality of degradation characteristics include a gradation characteristic indicating a gradation dependency of crosstalk and a mixed characteristic indicating a degree of interference between viewpoint images, The crosstalk parameter calculation unit calculates, as the crosstalk parameters, a gradation conversion coefficient indicating the gradation characteristics and a mixture ratio indicating the mixture characteristics. The information processing device according to (1) above. (3) the crosstalk measurement pattern includes a plurality of viewpoint images corresponding to different viewpoints, Each viewpoint image has a plurality of line patterns aligned in the parallax direction, The crosstalk parameter calculation unit applies the measurement result of the luminance difference between line patterns in the same viewpoint image to the crosstalk model. The information processing device according to (1) or (2) above. (4) the plurality of line patterns include a plurality of varying patterns and a plurality of unchanging patterns; the variation pattern is a line pattern in which a signal value varies depending on a position in a longitudinal direction orthogonal to the parallax direction, the invariant pattern is a line pattern in which the signal value is constant over the entire length direction, the position of the variation pattern in the parallax direction differs for each viewpoint image, If the coordinate in the longitudinal direction is x and the signal value of the fluctuation pattern at the coordinate x is P(x), the signal value P(x) is a monotonic function, and the signal value P(x) of the fluctuation pattern increases or decreases in opposite directions in the viewpoint images of two adjacent viewpoints. The information processing device according to (3) above. (5) the measurement pattern generation unit generates a plurality of crosstalk measurement patterns each having a different combination of signal values ​​of the invariant pattern; The crosstalk parameter calculation unit applies the measurement result, measured for each of the crosstalk measurement patterns, to the crosstalk model for a coordinate x where the luminance difference is equal to or less than a threshold value. The information processing device according to (4) above. (6) the plurality of line patterns include a plurality of varying patterns and a plurality of unchanging patterns; the variation pattern is a line pattern in which a signal value varies with time, the invariant pattern is a line pattern whose signal value is constant regardless of the time, the position of the variation pattern in the parallax direction differs for each viewpoint image, If the measurement time is t and the signal value of the fluctuation pattern at time t is Q(t), the signal value Q(t) is a monotonic function, and the signal value Q(t) of the fluctuation pattern increases or decreases in opposite directions in the viewpoint images of two adjacent viewpoints. The information processing device according to (5) above. (7) the measurement pattern generation unit generates a plurality of crosstalk measurement patterns each having a different combination of signal values ​​of the invariant pattern; The crosstalk parameter calculation unit applies the measurement result measured for each of the crosstalk measurement patterns at a time t when the luminance difference becomes equal to or smaller than a threshold value to the crosstalk model. The information processing device according to (6) above. (8) the measurement pattern generation unit generates the crosstalk measurement patterns in a number greater than the number of the crosstalk parameters; The crosstalk parameter calculation unit calculates a plurality of parameter values ​​for each crosstalk parameter according to the number of the crosstalk measurement patterns, and calculates an average value of the plurality of parameter values ​​as the value of the crosstalk parameter. The information processing device according to (5) or (7) above. (9) The crosstalk parameter calculation unit calculates a weighted average of the plurality of parameter values ​​based on a weight set for each crosstalk measurement pattern, and outputs the weighted average as the value of the crosstalk parameter. The information processing device according to (8) above. (10) The measurement pattern generation unit generates a single test image in which the plurality of crosstalk measurement patterns are incorporated into the same screen. The information processing device according to any one of (5) or (7) to (9) above. (11) The measurement pattern generation unit assigns the plurality of crosstalk measurement patterns to pixels of different colors. The information processing device according to (10) above. (12) The measurement pattern generation unit generates the crosstalk measurement pattern as an invisible pattern to be incorporated into a visible light image. The information processing device according to any one of (1) to (10) above. (13) Generate a crosstalk measurement pattern, applying the measurement results of the crosstalk measurement pattern to a crosstalk model including a plurality of degradation characteristics, and calculating crosstalk parameters set for each degradation characteristic; 10. A computer-implemented information processing method comprising: (14) Generate a crosstalk measurement pattern, applying the measurement results of the crosstalk measurement pattern to a crosstalk model including a plurality of degradation characteristics, and calculating crosstalk parameters set for each degradation characteristic; A program that makes a computer do something. (15) a measurement pattern generation unit that generates a crosstalk measurement pattern; a crosstalk parameter calculation unit that applies a measurement result of the crosstalk measurement pattern to a crosstalk model including one or more degradation characteristics and calculates crosstalk parameters set for each degradation characteristic; and the crosstalk measurement pattern includes a plurality of viewpoint images corresponding to different viewpoints, Each viewpoint image has a plurality of line patterns aligned in the parallax direction, the crosstalk parameter calculation unit applies the measurement result of the luminance difference between line patterns in the same viewpoint image to the crosstalk model; Information processing device. (16) Generate a crosstalk measurement pattern, Applying the measurement results of the crosstalk measurement pattern to a crosstalk model including one or more degradation characteristics, and calculating crosstalk parameters set for each degradation characteristic. Having that, the crosstalk measurement pattern includes a plurality of viewpoint images corresponding to different viewpoints, Each viewpoint image has a plurality of line patterns aligned in the parallax direction, In calculating the crosstalk parameters, the measurement result of the luminance difference between line patterns in the same viewpoint image is applied to the crosstalk model. A computer-implemented information processing method. (17) Generate a crosstalk measurement pattern, Applying the measurement results of the crosstalk measurement pattern to a crosstalk model including one or more degradation characteristics, and calculating crosstalk parameters set for each degradation characteristic. Having that, the crosstalk measurement pattern includes a plurality of viewpoint images corresponding to different viewpoints, Each viewpoint image has a plurality of line patterns aligned in the parallax direction, In calculating the crosstalk parameters, the measurement result of the luminance difference between line patterns in the same viewpoint image is applied to the crosstalk model. A program that is implemented on a computer. [Explanation of symbols]

[0156] 1,2 Information processing device 11 Measurement pattern generation unit 15 Crosstalk parameter calculation section 21 Crosstalk Model 23 Crosstalk parameters CMP crosstalk measurement pattern IVI invisible patterns IVP Immutable Pattern LP Line Pattern PV viewpoint image TI test image VI Visible light image VP fluctuation pattern α,β mixing ratio γ tone conversion coefficient

Claims

1. a measurement pattern generation unit that generates a crosstalk measurement pattern; a crosstalk parameter calculation unit that applies a measurement result of the crosstalk measurement pattern to a crosstalk model including a plurality of degradation characteristics and calculates crosstalk parameters set for each degradation characteristic; and the crosstalk measurement pattern includes a plurality of viewpoint images corresponding to different viewpoints, Each viewpoint image has a plurality of line patterns aligned in the parallax direction, the crosstalk parameter calculation unit applies the measurement result of the luminance difference between line patterns in the same viewpoint image to the crosstalk model; Information processing device.

2. the plurality of degradation characteristics include a gradation characteristic indicating a gradation dependency of crosstalk and a mixed characteristic indicating a degree of interference between viewpoint images, The crosstalk parameter calculation unit calculates, as the crosstalk parameters, a gradation conversion coefficient indicating the gradation characteristics and a mixture ratio indicating the mixture characteristics. The information processing device according to claim 1 .

3. the plurality of line patterns include a plurality of varying patterns and a plurality of unchanging patterns; the variation pattern is a line pattern in which a signal value varies depending on a position in a longitudinal direction orthogonal to the parallax direction, the invariant pattern is a line pattern in which the signal value is constant over the entire length direction, the position of the variation pattern in the parallax direction differs for each viewpoint image, If the coordinate in the longitudinal direction is x and the signal value of the fluctuation pattern at the coordinate x is P(x), the signal value P(x) is a monotonic function, and the signal value P(x) of the fluctuation pattern increases or decreases in opposite directions in the viewpoint images of two adjacent viewpoints. The information processing device according to claim 1 .

4. the measurement pattern generation unit generates a plurality of crosstalk measurement patterns each having a different combination of signal values ​​of the invariant pattern; The crosstalk parameter calculation unit applies the measurement result, measured for each of the crosstalk measurement patterns, to the crosstalk model for a coordinate x where the luminance difference is equal to or less than a threshold value. The information processing device according to claim 3 .

5. the plurality of line patterns include a plurality of varying patterns and a plurality of unchanging patterns; the variation pattern is a line pattern in which a signal value varies with time, the invariant pattern is a line pattern whose signal value is constant regardless of the time, the position of the variation pattern in the parallax direction differs for each viewpoint image, If the measurement time is t and the signal value of the fluctuation pattern at time t is Q(t), the signal value Q(t) is a monotonic function, and the signal value Q(t) of the fluctuation pattern increases or decreases in opposite directions in the viewpoint images of two adjacent viewpoints. The information processing device according to claim 4 .

6. the measurement pattern generation unit generates a plurality of crosstalk measurement patterns each having a different combination of signal values ​​of the invariant pattern; The crosstalk parameter calculation unit applies the measurement result, measured for each of the crosstalk measurement patterns, at a time t when the luminance difference becomes equal to or smaller than a threshold value to the crosstalk model. The information processing device according to claim 5 .

7. the measurement pattern generation unit generates the crosstalk measurement patterns in a number greater than the number of the crosstalk parameters; The crosstalk parameter calculation unit calculates a plurality of parameter values ​​for each crosstalk parameter according to the number of the crosstalk measurement patterns, and calculates an average value of the plurality of parameter values ​​as the value of the crosstalk parameter. The information processing device according to claim 4 .

8. The crosstalk parameter calculation unit calculates a weighted average of the plurality of parameter values ​​based on a weight set for each crosstalk measurement pattern, and outputs the weighted average as the value of the crosstalk parameter. The information processing device according to claim 7 .

9. The measurement pattern generation unit generates a single test image in which the plurality of crosstalk measurement patterns are incorporated into the same screen. The information processing device according to claim 4 .

10. The measurement pattern generation unit assigns the plurality of crosstalk measurement patterns to pixels of different colors. The information processing device according to claim 9 .

11. The measurement pattern generation unit generates the crosstalk measurement pattern as an invisible pattern to be incorporated into a visible light image. The information processing device according to claim 1 .

12. Generate a crosstalk measurement pattern, applying the measurement results of the crosstalk measurement pattern to a crosstalk model including a plurality of degradation characteristics, and calculating crosstalk parameters set for each degradation characteristic; Having that, the crosstalk measurement pattern includes a plurality of viewpoint images corresponding to different viewpoints, Each viewpoint image has a plurality of line patterns aligned in the parallax direction, fitting the measurement result of the luminance difference between line patterns in the same viewpoint image to the crosstalk model; A computer-implemented information processing method.

13. Generate a crosstalk measurement pattern, applying the measurement results of the crosstalk measurement pattern to a crosstalk model including a plurality of degradation characteristics, and calculating crosstalk parameters set for each degradation characteristic; Let the computer realize this, the crosstalk measurement pattern includes a plurality of viewpoint images corresponding to different viewpoints, Each viewpoint image has a plurality of line patterns aligned in the parallax direction, A program that causes the computer to apply the measurement results of the luminance difference between line patterns in the same viewpoint image to the crosstalk model.

Images