Information processing systems and information processing devices

Abstract

We propose an information processing system and information processing device that can help eliminate image quality degradation in stereoscopic displays. [Solution] The video output device is an information processing system comprising a generation unit that generates a display control signal based on correction information including thickness information showing the thickness distribution of a light distribution member, wherein the light distribution member is arranged on a display unit on which pixels are arranged and gives directionality to the light rays emitted from the pixels.

Description

[Technical Field]

[0001] This disclosure relates to an information processing system and an information processing device. [Background technology]

[0002] Conventionally, stereoscopic displays are known that use light-distributing elements such as lenticular lenses or parallax barriers arranged on a display device such as a liquid crystal panel to give directionality to the light rays emitted from pixels, thereby providing viewers with a stereoscopic display using parallax images.

[0003] In such stereoscopic displays, precise control of the light ray direction by the light distribution element is necessary to ensure accurate display relative to the viewer's viewpoint. Therefore, a technique has been proposed for determining the optical parameters of a stereoscopic display for this control.

[0004] For example, in the technology disclosed in Patent Document 1, two different reference images are displayed on the display device, and the relative tilt angle and period of the light distribution member with respect to the display device are uniquely determined as optical parameters from the difference in the period and tilt angle of the interference fringes observed by the reference images. [Prior art documents] [Patent Documents]

[0005] [Patent Document 1] Japanese Patent Publication No. 2014-066539 [Overview of the project] [Problems that the invention aims to solve]

[0006] However, the conventional technologies described above still have room for further improvement in terms of eliminating image quality degradation in stereoscopic displays. For example, light distribution components may develop unevenness within their surface due to manufacturing misalignment or misalignment caused by thermal or mechanical stress during use, resulting in errors in the desired light ray direction.

[0007] In such a case, distortion occurs in the period and tilt angle of the interference fringes, so there is a problem in the conventional technology described above that optical parameters cannot be accurately measured. Further, since pattern analysis of the interference fringes is required to calculate the optical parameters, it is necessary to secure a display area of a pattern sufficient for the analysis, and there is also a problem that local parameters cannot be calculated. Therefore, when performing stereoscopic display using such parameters, there is a risk of image quality degradation such as display unevenness occurring.

[0008] Therefore, in the present disclosure, an information processing system and an information processing apparatus that can contribute to eliminating image quality degradation in stereoscopic display are proposed.

Means for Solving the Problems

[0009] In order to solve the above problems, an information processing system according to one aspect of the present disclosure is an information processing system including a generation unit that generates a display control signal based on correction information including thickness information indicating the distribution of the thickness of a light distribution member, wherein the light distribution member is disposed on a display unit on which pixels are arranged and imparts directivity to light rays emitted from the pixels.

Brief Description of the Drawings

[0010] [Figure 1] It is a diagram showing the directivity of light rays by the lenticular lens method and the parallax barrier method. [Figure 2] It is a diagram showing an example of pixel arrangement. [Figure 3] It is a diagram (part 1) showing the design values of the light distribution member. [Figure 4] It is a diagram (part 2) showing the design values of the light distribution member. [Figure 5] It is a diagram showing the state of display unevenness. [Figure 6] It is a diagram showing the repetition of viewpoints by the light distribution member. [Figure 7] It is a diagram showing the distribution of viewpoints by the light distribution member. [Figure 8] 1]It is a diagram showing the difference in observed luminance at different observation positions. [Figure 9] It is a diagram showing the phase shift from the reference position of the light distribution member. [Figure 10] It is a diagram (part 1) showing a method for calculating the amount of phase shift. [Figure 11] It is a diagram (part 2) showing a method for calculating the amount of phase shift. [Figure 12] It is a diagram showing the difference in phase difference due to thickness error. [Figure 13] It is a diagram showing the phase difference generated by thickness error. [Figure 14] It is a block diagram showing a configuration example of the measuring device according to the first embodiment of the present disclosure. [Figure 15] It is a block diagram showing a configuration example of the measuring device according to the second embodiment of the present disclosure. [Figure 16] It is a block diagram showing a configuration example of the measuring device according to the third embodiment of the present disclosure. [Figure 17] It is a supplementary explanatory diagram of the measuring device according to each embodiment. [Figure 18] It is a block diagram showing a configuration example of the video output device according to the first embodiment of the present disclosure. [Figure 19] It is a block diagram showing a configuration example of the video output device according to the second embodiment of the present disclosure. [Figure 20] It is a block diagram showing a configuration example of the video output device according to the third embodiment of the present disclosure. [Figure 21] It is an explanatory diagram (part 1) of the correction information output unit. [Figure 22] It is an explanatory diagram (part 2) of the correction information output unit. [Figure 23] It is a hardware configuration diagram showing an example of a computer that realizes the functions of the measuring device.

Embodiments for Carrying Out the Invention

[0011] Hereinafter, embodiments of the present disclosure will be described in detail based on the drawings. In each of the following embodiments, the same parts are denoted by the same reference numerals, and redundant descriptions are omitted.

[0012] Furthermore, in the following, the image display portion of a stereoscopic display, such as an LCD panel, in which pixels are arranged, will be appropriately referred to as the "display unit."

[0013] Furthermore, this disclosure will be explained in the order of the items shown below. 1. Information processing method according to the first embodiment 2. Information processing method according to the second embodiment 3. Information processing method according to the third embodiment 4. Information processing apparatus using the information processing method according to each embodiment 4-1. Configuration of the measuring device according to the first embodiment 4-2. Configuration of the measuring device according to the second embodiment 4-3. Configuration of the measuring device according to the third embodiment 4-4. Supplementary Information Regarding the Measuring Devices According to Each Embodiment 4-5. Configuration of the video output device according to the first embodiment 4-6. Configuration of the video output device according to the second embodiment 4-7. Configuration of the video output device according to the third embodiment 4-8. About the Correction Information Output Unit 5. Variations 6. Hardware Configuration 7. Conclusion

[0014] <<1. Information Processing Method According to the First Embodiment>> First, the information processing method according to the first embodiment of this disclosure will be described with reference to Figures 1 to 7. Figure 1 is a diagram showing the directivity of light rays using a lenticular lens method and a parallax barrier method. Figure 2 is a diagram showing an example of a pixel array.

[0015] Figure 3 is a diagram (part 1) showing the design values ​​of the light distribution member. Figure 4 is a diagram (part 2) showing the design values ​​of the light distribution member. Note that Figure 3 shows the positional relationship when the display unit is viewed from the front, and Figure 4 shows the positional relationship when the display unit is viewed in cross-section.

[0016] Figure 5 shows the state of display unevenness. Figure 6 shows the repetition of viewpoints by the light distribution member. Figure 7 shows the distribution of viewpoints by the light distribution member.

[0017] The information processing method according to the first embodiment of this disclosure is a stereoscopic display having a light distribution member arranged on a display unit, wherein the light distribution member imparts directionality to the light rays emitted from the pixels of the display unit, and the method displays a striped image on the display unit while shifting the phase, acquires brightness information of interference fringes observed through the light distribution member, calculates phase information of the interference fringes using the acquired brightness information, and outputs the light distribution state of the light distribution member at the observation position as phase information using the calculated phase information.

[0018] As shown in Figure 1, when a light distribution member such as a lenticular lens Ls or a parallax barrier Br is provided on a display unit where pixels are arranged, the lens of the lenticular lens Ls or the aperture of the parallax barrier Br gives directionality to the light rays emitted from the pixels.

[0019] By utilizing this directivity, different images can be displayed separately to the left and right eyes of the viewer. Therefore, by displaying images corresponding to the left and right eyes, the viewer can observe a stereoscopic display. In other words, the stereoscopic display shown in Figure 1 is configured to present stereoscopic objects by directly providing different images to the left and right eyes of the viewer via a light distribution member. Such stereoscopic displays that provide stereoscopic objects without the need for dedicated wearable optical devices are sometimes commonly called light field displays.

[0020] At this time, the direction of the light rays from each pixel is determined by the positional relationship between the pixels of the display unit and the light distribution member, and is determined according to the various pixel arrangements of the display unit shown in Figure 2, and the design values ​​of the light distribution member such as the pitch shown in Figure 3, the tilt angle, the offset, and the thickness shown in Figure 4.

[0021] However, due to manufacturing errors such as molding errors in the light distribution components and misalignment during the bonding of the display units, as well as errors caused by heat and mechanical stress during use, the positional relationship between the pixels of the display unit and the light distribution components deviates from the design value, and the direction of the light rays is affected by this deviation.

[0022] In such cases, as shown in Figure 5, inconsistencies in the display occur, making it crucial to accurately measure the positional relationships during actual use in order to achieve a comfortable stereoscopic display.

[0023] Consider a stereoscopic display shown in Figure 1, on which a light distribution member is provided. Here, let x be the position of the pixels in the x-direction of the display, y be the position of the pixels in the y-direction of the display, A be the display brightness of the display, o be the offset amount of the light distribution member, and d be the brightness noise during observation.

[0024] Then, the frequency f in the x direction xd , frequency f in the y direction yd Then, divide one period of the fringe into N parts and display the phase-shifted cosine wave, and the frequency f in the x direction xs , frequency f in the y direction ys The luminance distribution I of the interference fringes observed through a light distribution member arranged to sample light rays is expressed by the following equation (1).

[0025]

number

[0026] Furthermore, the initial phase θ of the interference fringes is given by equation (2) below.

number

[0027] Then, θ can be determined using multiple phase-shifted luminance distributions as shown in equations (3) and (4) below.

[0028]

number

[0029]

number

[0030] If measurements are taken with N=3 or greater, equations (3) and (4) can be solved, and the accuracy of the phase measurement increases as N increases. Then, using the obtained θ, the phase information of the light distribution member can be obtained as shown in equation (5) below.

[0031]

number

[0032] The phase information in equation (5) indicates the light distribution state of the light rays from each pixel provided by the light distribution member, meaning that the viewpoint repeats with a period of 2π. Therefore, when 0 to 2π is discretized to a certain number of viewpoints M, the light rays from the pixels corresponding to each viewpoint position are spatially distributed.

[0033] Therefore, by assigning images corresponding to each viewpoint position to each pixel and displaying them, viewers can see the display corresponding to each viewpoint. In Figure 6, the measured phase is assigned to each viewpoint with M=256, and in Figure 7, the viewpoints represent the m~m+2 (1≦m≦M-2)th ray. Since the viewpoints are discretized and assigned, it is desirable that the intensity peaks of the rays for the same viewpoint fall between adjacent viewpoints.

[0034] Furthermore, examples of the configuration of an information processing apparatus using the information processing method according to each embodiment, including the first embodiment and the second and third embodiments described later, will be described later with reference to Figure 14 and subsequent figures.

[0035] <<2. Information Processing Method According to the Second Embodiment>> Next, an information processing method according to the second embodiment of this disclosure will be described with reference to Figures 8 to 11. Figure 8 is a diagram showing the difference in observed brightness at different observation positions. Figure 9 is a diagram showing the phase shift of the light distribution member from the reference position.

[0036] Figure 10 is a diagram (part 1) showing the method for calculating the phase shift amount. Figure 11 is a diagram (part 2) showing the method for calculating the phase shift amount.

[0037] The information processing method according to the second embodiment of this disclosure is a method that, in addition to the information processing method according to the first embodiment, measures the observation position and adjusts the striped image displayed on the display unit using the phase shift amount corresponding to the measured position information.

[0038] Specifically, in the first embodiment, the luminance distribution of interference fringes corresponding to a particular observation position is measured, and the phase information of the light distribution member corresponding to that observation position is calculated. Therefore, as shown in Figure 8, if the observation position moves, different luminance distributions will be measured for each observation position, and the phase information will also differ for each observation position.

[0039] Therefore, when determining the viewpoint position using phase information measured at a specific observation position, the desired stereoscopic display can only be achieved near that observation position. In the second embodiment, in order to maintain accurate stereoscopic display regardless of the observation position, the relationship between the pixel position of the display unit and the position of the light distribution member is determined as phase information, and adjustments are made to this information taking into account the amount of phase shift according to the observation position, thereby achieving the desired stereoscopic display.

[0040] For this purpose, for example, as shown in Figure 9, if a lenticular lens Ls is used as the light distribution element and the center of the lens is taken as the reference position, a phase shift amount β from the reference position occurs at each pixel, depending on the observation position. By calculating this phase shift amount β for each pixel and adjusting the brightness distribution of the cosine wave displayed on the display unit, the positional relationship between the pixel and the light distribution element can be determined as phase information, regardless of the observation position.

[0041] Consider obtaining the amount of phase shift when the light distribution member is a lenticular lens Ls while using FIGS. 10 and 11. As shown in FIG. 10, when looking at the position of the pixel of interest for which the amount of phase shift is to be obtained from the observation position, let the angle be θ1, the angle of the light ray incident on the light distribution member be θ2, the thickness of the light distribution member be d, the refractive index of the medium on the incident side of the light distribution member be n1, and the refractive index of the light distribution member be n2. The difference l in the distance between the position of the pixel of interest and the actually visible position can be approximated by the following formula (6).

[0042]

Equation

[0043] In the case where the light distribution member is made of a stack of a plurality of different media, etc., formula (6) can be applied by converting and adding the thickness according to the refractive index with the refractive index and thickness of each layer fixed.

[0044] Here, as shown in FIG. 11, when separating l into x and y with the viewing angle α in the xy plane when looking at the pixel of interest from the observation position (see the white circle in the figure), the distance difference l x in the x direction and the distance difference l y in the y direction are given by the following formula (7).

[0045]

Equation

[0046] Then, using the distance differences l x , l y in formula (7) and the design parameters (tilt angle Φ, pitch p) of the light distribution member, the phase differences β x , β y caused by l x , β y are obtained as the following formula (8). Note that the design parameters may be measured values.

[0047]

Equation

[0048] The phase shift amount β obtained here is either added to or subtracted from depending on the arrangement of the light distribution members. As shown in Figure 11, if the light distribution members are arranged at an inclination angle Φ, and the phase is calculated to be 0 to 2π from left to right in a front view over one period in the x-direction of the light distribution members, then β x When a difference occurs to the left of the pixel of interest relative to the phase of the displayed cosine wave, it is subtracted; when a difference occurs to the right, it is added.

[0049] On the other hand, β y When a difference occurs upward from the pixel of interest, it is added; when a difference occurs downward, it is subtracted. By adjusting equation (1) as described above and performing measurement and phase information calculation in the same manner as the information processing method according to the first embodiment, phase information of the light distribution member that does not depend on the observation position can be obtained.

[0050] <<3. Information Processing Method According to the Third Embodiment>> Next, an information processing method according to the third embodiment of this disclosure will be described with reference to Figures 12 and 13. Figure 12 is a diagram showing the difference in phase difference due to thickness error. Figure 13 is a diagram showing the phase difference caused by thickness error.

[0051] The information processing method according to the third embodiment of this disclosure is a method for measuring the thickness of a light distribution member using interference fringes or phase information of a light distribution member acquired from two or more different observation positions, in addition to the information processing method according to the second embodiment.

[0052] For example, as shown in Figure 12, the design value d of the thickness of the light distribution member. d A discrepancy occurs relative to the actual thickness d. r If this is the case, the expected difference l d In reality, the difference is l r Therefore, when the observation position changes, errors will occur in the calculation of the phase shift amount.

[0053] Therefore, in the third embodiment, we consider determining the thickness distribution of the light distribution member and using that value to calculate the accurate phase shift amount. The actual thickness of the light distribution member (i.e., the measured thickness) can be determined by calculating the phase information at two different points and comparing the phase difference with the difference in the calculated phase shift amount.

[0054] As shown in Figure 13, the design value for the thickness of the light distribution member is d d Therefore, the amount of phase shift expected at the first and second observation positions is β d1 ,β d2 This is the result. However, when a phase measurement is performed, the actual thickness d r Since the phase information of the pixels observed is measured, the phase information includes γ as a result at each observation position. m1 and gamma m2 The measurement is taken with that factor added on.

[0055] Therefore, if we take the phase difference of the measured values ​​at two different points, γ = γ m1 +γ m2 This is calculated. This is the thickness design value d d The phase shift amount β calculated as d1 ,β d2 and the actual thickness d r Phase shift amount β r1 ,β r2 Since it is considered to be equal to the difference, if the arrangement of the light distribution members is the same as in Figures 10 and 11, and the expected angles from the first observation position and the second observation position are α1 and α2, then using equations (6) to (8), the actual thickness d r This can be expressed by the following equation (9).

[0056]

number

[0057] In addition, in the second term on the right-hand side of equation (9), the two terms in parentheses in the denominator are either added or subtracted depending on the direction of the tilt angle Φ of the light distribution member, and in the example similar to that in Figure 11, they are subtracted.

[0058] By using these measurement results to calculate the phase shift amount and either performing another phase measurement or correcting the previously measured phase information, it is possible to obtain phase information free from thickness errors, and to adjust the phase shift amount when the observation position changes without errors.

[0059] <<4. Information Processing Device Using the Information Processing Method According to Each Embodiment>> Next, examples of the configuration of an information processing device using the information processing methods according to the above-described embodiments will be explained with reference to Figures 14 to 20. Figures 14 to 17 will be used to describe the measuring devices 10, 10A, and 10B. Figures 18 to 20 will be used to describe the video output devices 30, 30A, and 30B. The measuring devices 10, 10A, and 10B and the video output devices 30, 30A, and 30B all correspond to examples of "information processing devices".

[0060] <4-1. Configuration of the measuring device according to the first embodiment> Figure 14 is a block diagram showing an example configuration of the measuring device 10 according to the first embodiment of this disclosure. Note that Figure 14 and Figures 15, 16, 18-20 shown later only show the components necessary to explain the features of this embodiment, and descriptions of general components are omitted.

[0061] In other words, the components illustrated in Figures 14-16 and 18-20 are functional concepts and do not necessarily need to be physically configured as shown. For example, the specific forms of distribution and integration of each block are not limited to those shown, and it is possible to configure all or part of them by functionally or physically distributing and integrating them in any unit according to various loads and usage conditions.

[0062] Furthermore, in the explanations using Figures 14-16 and 18-20, explanations of components that have already been explained may be simplified or omitted.

[0063] The measuring device 10 generates a fringe image in the display control unit based on the phase information calculated by the calculation unit, inputs it to the drive unit of the stereoscopic display, observes the fringe image displayed on the display unit as interference fringes by the imaging device via the light distribution member, stores the observed interference fringe image in the storage unit as an captured image, inputs the captured image to the calculation unit, and calculates the phase information of the interference fringes and the light distribution member.

[0064] Specifically, as shown in Figure 14, the measuring device 10 comprises a storage unit 11 and a control unit 12. The measuring device 10 is also connected to an imaging device 3 and a stereoscopic display 5. The stereoscopic display 5 has a drive unit 5a, a display unit 5b, and a light distribution member 5c.

[0065] The imaging device 3 captures a striped image, which is displayed on the display unit 5b and transmitted via the light distribution member 5c. The imaging device 3 can be implemented, for example, by a monocular camera, in which case the observation position corresponds to the midpoint position of both eyes.

[0066] The storage unit 11 is implemented by, for example, semiconductor memory elements such as RAM (Random Access Memory), ROM (Read Only Memory), or flash memory, or by a storage device such as a hard disk or optical disc. In the example shown in Figure 14, the storage unit 11 stores the captured image 11a, the capture position 11b, and the phase information 11c.

[0067] The captured image 11a is an image captured by the imaging device 3. The imaging position 11b is the position where the captured image 11a was captured. In the first embodiment, the imaging position 11b is a specific position.

[0068] Phase information 11c is information that indicates the light distribution state of the light rays from each pixel provided by the light distribution member 5c, and is calculated by the calculation unit 12c described later. The phase information 11c is included in the correction information for correcting display unevenness in the stereoscopic display 5.

[0069] The control unit 12 is a controller, and is implemented, for example, by a CPU (Central Processing Unit) or MPU (Micro Processing Unit) executing various programs stored in the memory unit 11 using RAM as the working area. The control unit 12 can also be implemented by an integrated circuit, for example, an ASIC (Application Specific Integrated Circuit) or an FPGA (Field Programmable Gate Array).

[0070] The control unit 12 includes an image acquisition unit 12a, an image acquisition position acquisition unit 12b, a calculation unit 12c, and a display control unit 12d, and realizes or executes the information processing functions and operations described below.

[0071] The image acquisition unit 12a acquires the image captured by the imaging device 3 and stores it as the captured image 11a. The imaging position acquisition unit 12b acquires the imaging position 11b.

[0072] The calculation unit 12c includes a light distribution state calculation unit 12ca. The light distribution state calculation unit 12ca calculates the light distribution state of each pixel observed at the imaging position 11b based on the captured image 11a. The light distribution state calculation unit 12ca calculates the light distribution state using the calculation method in the information processing method according to the first embodiment described above. The light distribution state calculation unit 12ca also outputs the calculated light distribution state and stores it in the storage unit 11 as phase information 11c.

[0073] The display control unit 12d generates and outputs a display control signal to the stereoscopic display 5. The display control unit 12d includes a generation unit 12da. The generation unit 12da generates a striped image while changing the stripe pattern, i.e., the phase pattern, based on the phase information 11c, and outputs a display control signal to the drive unit 5a to display the striped image.

[0074] This series of actions by the image acquisition unit 12a, image acquisition position acquisition unit 12b, calculation unit 12c, and display control unit 12d is performed repeatedly, and the phase information 11c can be updated as needed according to the results.

[0075] <4-2. Configuration of the measuring device according to the second embodiment> Next, Figure 15 is a block diagram showing an example configuration of the measuring device 10A according to the second embodiment of this disclosure. Since Figure 15 corresponds to Figure 14, only the differences from the measuring device 10 shown in Figure 14 will be explained here.

[0076] The measuring device 10A, in addition to the measuring device 10, measures the imaging position (observation position) and stores it in the storage unit 11, inputs the imaging position 11b to the calculation unit 12c, and inputs the calculated phase shift amount to the display control unit 12d to adjust the fringe image.

[0077] Specifically, as shown in Figure 15, the measuring device 10A differs from the measuring device 10 in that the imaging position acquisition unit 12b calculates and acquires the imaging position 11b based on the captured image 11a.

[0078] Furthermore, the measuring device 10A differs from the measuring device 10 in that its storage unit 11 further stores optical parameter information 11d. The optical parameter information 11d includes information such as the inclination angle, pitch, and thickness of the light distribution member 5c, and is included in the correction information mentioned above.

[0079] Furthermore, the measuring device 10A differs from the measuring device 10 in that the calculation unit 12c further includes a phase shift amount calculation unit 12cb. The phase shift amount calculation unit 12cb calculates the phase shift amount based on the imaging position 11b and optical parameter information 11d using the calculation method in the information processing method according to the second embodiment described above. The calculated phase shift amount is stored, for example, in the phase information 11c.

[0080] Furthermore, the measuring device 10A differs from the measuring device 10 in that the display control unit 12d further includes an adjustment unit 12db. The adjustment unit 12db adjusts the stripe image generated by the generation unit 12da based on the phase shift amount calculated by the phase shift amount calculation unit 12cb.

[0081] <4-3. Configuration of the measuring device according to the third embodiment> Next, Figure 16 is a block diagram showing an example configuration of the measuring device 10B according to the third embodiment of this disclosure. Since Figure 16 corresponds to Figure 15, only the differences from the measuring device 10A shown in Figure 15 will be explained here.

[0082] The measuring device 10B, in addition to the measuring device 10A, stores the measurement position information and the calculation results of interference fringes or phase information of the light distribution member 5c at two or more different observation positions in the storage unit 11, inputs these results into the calculation unit 12c, and calculates the thickness of the light distribution member 5c.

[0083] Specifically, as shown in Figure 16, the measuring device 10B differs from the measuring device 10A in that the storage unit 11 further stores thickness information 11e. The thickness information 11e is information that includes the actual thickness distribution of the light distribution member 5c (i.e., the distribution of measured thickness values) and is included in the correction information mentioned above.

[0084] Furthermore, the measuring device 10B differs from the measuring device 10A in that the calculation unit 12c further includes a thickness calculation unit 12cc. The thickness calculation unit 12cc calculates the thickness distribution using the calculation method in the information processing method according to the third embodiment described above, based on the calculation results of the light distribution state calculation unit 12ca at two or more different imaging positions 11b. The calculated thickness distribution is stored in the thickness information 11e.

[0085] Furthermore, the measuring device 10B differs from the measuring device 10A in that the phase shift amount is calculated using the thickness distribution calculated by the thickness calculation unit 12cc, and the adjustment unit 12db adjusts the fringe image taking into account the thickness information 11e.

[0086] <4-4. Supplementary Information Regarding the Measuring Devices in Each Embodiment> Furthermore, in the measuring devices 10, 10A, and 10B, each function may be separated from or integrated with the respective device. Some or all of the functions of the measuring devices 10, 10A, and 10B may be incorporated into the stereoscopic display 5, and some or all of the functions of the measuring devices 10, 10A, and 10B may be incorporated into the imaging device 3.

[0087] Furthermore, the measuring devices 10, 10A, and 10B can modify the optical parameter information 11d and the phase information 11c based on the measured phase information 11c. For example, the tilt angle and pitch of the light distribution member 5c can be calculated using the phase difference between adjacent pixels of the phase information of the light distribution member 5c.

[0088] If the measured value differs from the design value, the phase shift amount can be corrected by adjusting the value to match the measured value, recalculating the phase shift amount using the corrected optical parameter value, and then correcting the already acquired phase information 11c of the light distribution member 5c using that value. Alternatively, the phase information 11c of the light distribution member 5c can be corrected by adjusting the fringe image using the newly measured optical parameter value and measuring the interference fringes. In other words, the optical parameter information 11d includes the measured value relative to the design value.

[0089] Similarly, if the thickness distribution is obtained by measurement, the phase information 11c of the light distribution member 5c can be corrected using that thickness distribution. In phase measurement, by feeding back the calculation result of the phase information 11c to the generation of the fringe image, distortion of the interference fringe image being measured can be suppressed, and the accuracy of the phase calculation using that image can be improved. Therefore, by repeating the phase information measurement of the light distribution member 5c multiple times, the accuracy of the calculated phase information 11c can be improved.

[0090] Furthermore, in the measuring devices 10A and 10B, the position of the imaging device 3 can be estimated by displaying a calibration pattern resembling a chessboard on the display unit 5b in order to calculate the imaging position 11b.

[0091] In this case, if the position of the imaging device 3 can be fixed during measurement, the observation position can be calculated using a chessboard before measuring the interference fringes. By using this information to adjust the fringe image, it becomes unnecessary to update the position information for each measurement, thus enabling faster measurement.

[0092] On the other hand, if the end user holds the imaging device 3 by hand and performs calibration, the position of the imaging device 3 may move with each shot, so it is necessary to acquire positional information at the same time as capturing interference fringes.

[0093] Figure 17 is a supplementary explanatory diagram for the measuring devices 10, 10A, and 10B according to each embodiment. In such cases, as shown in Figure 17, for example, the calibration pattern and the fringe image are displayed on the display unit 5b in different display colors, the displayed image is acquired, color separation is performed by signal processing, and position measurement and interference fringe phase measurement are performed from each pattern. However, in this case, the observation position at the time of imaging is unknown, so it is not possible to adjust the fringe image according to the observation position.

[0094] Therefore, in such cases, the fringe image is acquired with unadjusted phase information, and then the phase information is adjusted using the amount of phase shift estimated from the observation position, thereby making it possible to obtain phase information 11c of the light distribution member 5c that is independent of the observation position.

[0095] <4-5. Configuration of the video output device according to the first embodiment> Next, Figure 18 is a block diagram showing an example configuration of the video output device 30 according to the first embodiment of this disclosure.

[0096] The video output device 30 is a device that controls the display of the stereoscopic display 5 to correct display unevenness in the stereoscopic display 5 based on correction information output from the measuring device 10, for example, using the information processing method according to the first embodiment described above. The video output device 30 may be configured integrally with the stereoscopic display 5.

[0097] Specifically, as shown in Figure 18, the video output device 30 comprises a storage unit 31 and a control unit 32. Furthermore, a stereoscopic display 5 is connected to the video output device 30.

[0098] The storage unit 31, like the storage unit 11 described above, is implemented by, for example, a semiconductor memory element such as RAM, ROM, or flash memory, or a storage device such as a hard disk or optical disc. In the example shown in Figure 18, the storage unit 31 stores the viewing position 31a and phase information 31b.

[0099] The viewing position 31a corresponds to the viewing position of the displayed image by the viewer. In the first embodiment, the viewing position 31a is a specific position.

[0100] Phase information 31b is information that corresponds to phase information 11c, which is calculated by, for example, the measuring device 10 and included in the output correction information.

[0101] The control unit 32, like the memory unit 11 described above, is a controller and is implemented, for example, by a CPU or MPU executing various programs stored in the memory unit 31 using RAM as a working area. The control unit 32 can also be implemented by an integrated circuit such as an ASIC or FPGA.

[0102] The control unit 32 includes a viewing position acquisition unit 32a and a display control unit 32c, and realizes or executes the information processing functions and operations described below.

[0103] The viewing position acquisition unit 32a acquires the viewing position 31a. The display control unit 32c generates and outputs a display control signal for the stereoscopic display 5. The display control unit 32c includes a generation unit 32ca. The generation unit 32ca generates a display image while correcting display unevenness based on the phase information 31b, and outputs a display control signal to the drive unit 5a to display the display image.

[0104] <4-6. Configuration of the video output device according to the second embodiment> Next, Figure 19 is a block diagram showing an example configuration of the video output device 30A according to the second embodiment of this disclosure. Since Figure 19 corresponds to Figure 18, only the differences from the video output device 30 shown in Figure 18 will be explained here.

[0105] The video output device 30A, in addition to the video output device 30, measures the viewing position (observation position) and stores it in the storage unit 31, calculates the amount of phase shift based on the viewing position 31a, and inputs the calculated amount of phase shift to the display control unit 12d to adjust the displayed image.

[0106] Specifically, as shown in Figure 19, the video output device 30A differs from the video output device 30 in that a position measuring device 7 is further connected to it. The position measuring device 7 measures the viewing position. Possible methods for position measurement include methods that estimate the viewing position by detecting the viewer's face from the captured image, or methods that detect it using 3D measurement.

[0107] Furthermore, the video output device 30A differs from the video output device 30 in that the viewing position acquisition unit 32a acquires the viewing position 31a from the position measurement device 7.

[0108] Furthermore, the video output device 30A differs from the video output device 30 in that its memory unit 31 further stores optical parameter information 31c. The optical parameter information 31c corresponds to the optical parameter information 11d included in the correction information output from the measuring device 10A.

[0109] Furthermore, the video output device 30A differs from the video output device 30 in that the control unit 32 further includes a phase shift amount calculation unit 32b. The phase shift amount calculation unit 32b calculates the phase shift amount based on the viewing position 31a and optical parameter information 31c using the calculation method in the information processing method according to the second embodiment described above.

[0110] Furthermore, the video output device 30A differs from the video output device 30 in that its display control unit 32c further includes an adjustment unit 32cb. The adjustment unit 32cb adjusts the display image generated by the generation unit 32ca based on the phase shift amount calculated by the phase shift amount calculation unit 32b.

[0111] <4-7. Configuration of the video output device according to the third embodiment> Next, Figure 20 is a block diagram showing an example configuration of the video output device 30B according to the third embodiment of this disclosure. Since Figure 20 corresponds to Figure 19, only the differences from the video output device 30A shown in Figure 19 will be explained here.

[0112] As shown in Figure 20, the video output device 30B differs from the video output device 30A in that the storage unit 31 further stores thickness information 31d. The thickness information 31d corresponds to the thickness information 11e included in the correction information output from the measuring device 10B.

[0113] Furthermore, the video output device 30B differs from the video output device 30A in that the phase shift amount calculation unit 32b further uses the thickness information 31d to calculate the phase shift amount, and the adjustment unit 32cb adjusts the displayed image based on this phase shift amount.

[0114] <4-8. About the Correction Information Output Unit> Furthermore, the "calculation unit" and "display control unit" of the information processing device according to each embodiment described so far can be rephrased as "correction information output unit" that outputs correction information for correcting display unevenness. This point will be explained using Figures 21 and 22, with the above-mentioned measuring device 10 as an example.

[0115] Figure 21 is an explanatory diagram (part 1) of the correction information output unit. Figure 22 is an explanatory diagram (part 2) of the correction information output unit.

[0116] As shown in Figure 21, the measuring device 10 has a calculation unit 12c, which can be called a "correction information output unit" that outputs correction information for the stereoscopic display 5, including the calculated phase information 11c and the like.

[0117] For example, the measuring device 10 outputs correction information for the stereoscopic display 5 to the storage unit 11. Also, for example, the measuring device 10 outputs correction information for the stereoscopic display 5 to the video output device 30. The output to the video output device 30 may be transmitted via a network, transferred via a recording medium, or distributed via a cloud server or the like.

[0118] On the other hand, as shown in Figure 22, the measuring device 10 has a display control unit 12d, which can be described as a "correction information output unit" that outputs correction information for the stereoscopic display 5, including phase information 11c and the like, as a display control signal.

[0119] Furthermore, although Figures 21 and 22 show measuring device 10 as an example, the same applies to measuring devices 10A, 10B, etc. Therefore, the correction information output by the "correction information output unit" includes, for example, the optical parameter information 11d and thickness information 11e mentioned above.

[0120] <<5. Variation>> Furthermore, several modifications can be given to each of the embodiments described above. For example, in the embodiments described above, the main example given was when the light distribution member 5c is a lenticular lens Ls, but this does not limit the light distribution member 5c.

[0121] The light distribution member 5c may, of course, be the parallax barrier Br shown in Figure 1, or it may be any other member.

[0122] Furthermore, among the processes described in each of the above embodiments, all or part of the processes described as being performed automatically can be performed manually, or all or part of the processes described as being performed manually can be performed automatically by known methods. In addition, the processing procedures, specific names, and information including various data and parameters shown in the above documents and drawings can be changed at will unless otherwise specified. For example, the various information shown in each figure is not limited to the information shown.

[0123] Furthermore, each component of the illustrated device is a functional concept and does not necessarily have to be physically configured as shown. In other words, the specific forms of distribution and integration of each device are not limited to those shown, and all or part of them can be functionally or physically distributed and integrated in any unit according to various loads and usage conditions. As already mentioned, for example, the video output device 30 may be configured integrally with the stereoscopic display 5.

[0124] Furthermore, each of the above embodiments can be appropriately combined in areas where the processing content does not contradict each other.

[0125] <<6. Hardware Configuration>> The measuring devices 10, 10A, 10B and video output devices 30, 30A, 30B according to the embodiments described above are implemented by a computer 1000 having a configuration such as that shown in Figure 23. The measuring device 10 will be used as an example for explanation. Figure 23 is a hardware configuration diagram showing an example of a computer 1000 that implements the functions of the measuring device 10. The computer 1000 has a CPU 1100, RAM 1200, ROM 1300, HDD (Hard Disk Drive) 1400, communication interface 1500, and input / output interface 1600. The various parts of the computer 1000 are connected by a bus 1050.

[0126] The CPU 1100 operates based on programs stored in the ROM 1300 or HDD 1400, and controls various parts. For example, the CPU 1100 loads the programs stored in the ROM 1300 or HDD 1400 into the RAM 1200 and executes processing corresponding to various programs.

[0127] ROM1300 stores boot programs such as the BIOS (Basic Input Output System) executed by CPU1100 when computer 1000 starts up, as well as programs that depend on the computer 1000's hardware.

[0128] HDD1400 is a computer-readable recording medium that non-temporarily records programs executed by CPU1100 and data used by such programs. Specifically, HDD1400 is a recording medium that records an information processing program related to this disclosure, which is an example of program data 1450.

[0129] The communication interface 1500 is an interface for the computer 1000 to connect to an external network 1550 (e.g., the Internet). For example, the CPU 1100 can receive data from other devices or transmit data it generates to other devices via the communication interface 1500.

[0130] The input / output interface 1600 is an interface for connecting the input / output device 1650 and the computer 1000. For example, the CPU 1100 receives data from input devices such as a keyboard or mouse via the input / output interface 1600. The CPU 1100 also transmits data to output devices such as a display, speaker, or printer via the input / output interface 1600. The input / output interface 1600 may also function as a media interface for reading programs recorded on a predetermined recording medium (media). Examples of media include optical recording media such as DVDs (Digital Versatile Discs) and PDs (Phase Change Rewritable Disks), magneto-optical recording media such as MOs (Magneto-Optical Disks), tape media, magnetic recording media, or semiconductor memory.

[0131] For example, when the computer 1000 functions as a measuring device 10 according to the embodiment, the CPU 1100 of the computer 1000 realizes the functions of the control unit 12 by executing an information processing program loaded on the RAM 1200. The HDD 1400 stores the information processing program according to this disclosure and the data in the storage unit 11. The CPU 1100 reads and executes the program data 1450 from the HDD 1400, but as another example, these programs may be obtained from other devices via an external network 1550.

[0132] <<7. Conclusion>> As described above, according to one embodiment of the present disclosure, the measuring devices 10, 10A, and 10B include: an image acquisition unit 12a that acquires an image of a stereoscopic display 5 which has a light distribution member 5c arranged on the display unit 5b that distributes the light rays of an image displayed on the display unit 5b to make a stereoscopic object visible; an image position acquisition unit 12b that acquires the imaging position at the time the image is acquired; and a calculation unit 12c or display control unit 12d (corresponding to an example of a "correction information output unit") that outputs correction information for the stereoscopic display 5 to correct display unevenness of the stereoscopic display 5 based on the change in the phase pattern generated according to the imaging position and the imaging position included in the image. This helps to eliminate image quality degradation in stereoscopic displays.

[0133] Although the embodiments of this disclosure have been described above, the technical scope of this disclosure is not limited to the embodiments described above, and various modifications are possible without departing from the gist of this disclosure. Furthermore, components from different embodiments and modifications may be combined as appropriate.

[0134] Furthermore, the effects described in each embodiment of this specification are merely illustrative and not limiting, and other effects may also occur.

[0135] Furthermore, this technology can also be configured as follows. (1) A stereoscopic display equipped with a light distribution member positioned on the display unit to distribute the light rays of an image displayed on the display unit to make a stereoscopic object visible, and an image acquisition unit that acquires an image of the stereoscopic display, A unit for acquiring the imaging position at the time the captured image is acquired, A correction information output unit outputs correction information for the stereoscopic display to correct display unevenness in the stereoscopic display based on the changes in the phase pattern generated according to the imaging position and the imaging position included in the captured image, An information processing device equipped with the following features. (2) The correction information is a display control signal that controls the display of the stereoscopic display in order to correct the display unevenness of the stereoscopic display. The information processing device described in (1) above. (3) The correction information output unit is, Based on the phase information indicating the light distribution state of the light rays from each pixel of the display unit, which is provided by the light distribution member based on the change in the phase pattern, the display control signal is generated. The information processing device described in (2) above. (4) The correction information output unit is, The display control signal is generated based on the phase information obtained when the phase pattern is changed by displaying the striped image on the display unit while shifting the phase. The information processing device described in (3) above. (5) The correction information output unit is, Based on the phase information obtained when a cosine wave obtained by dividing one period of the stripe into three or more phase shifts is displayed on the display unit, the display control signal is generated. The information processing device described in (4) above. (6) The phase information includes the positional relationship between the pixel position of the display unit and the positional relationship of the light distribution member. The correction information output unit is, Based on the phase information, the display control signal is generated based on the amount of phase shift from a predetermined reference position of the light distribution member corresponding to the imaging position, which is calculated based on the phase information. The information processing device described in (3) above. (7) The correction information output unit is, Based on the phase shift amount calculated based on the measured thickness of the light distribution member, which is determined based on a comparison of the phase information of each of the different imaging positions, the display control signal is generated. The information processing device described in (6) above. (8) The correction information includes measured values ​​relative to the design values ​​for the arrangement of the light distribution member. The information processing device described in (1) above. (9) The measured value includes the measured thickness of the light distribution member relative to the display portion. The information processing device described in (8) above. (10) The correction information output unit is, Based on the change in the phase pattern, phase information including the light distribution state of the light rays from each pixel of the display unit provided by the light distribution member is calculated, and the measured value of the thickness is calculated based on the phase information. The information processing device described in (9) above. (11) The correction information output unit is, The brightness distribution of interference fringes when the fringe image is displayed on the display unit while phase-shifting is calculated from the captured image, and the phase information is calculated based on the brightness distribution. The information processing device described in (10) above. (12) The correction information output unit is, The measured value of the thickness is calculated based on a comparison of the phase information of each of the different imaging positions. The information processing device described in (10) or (11) above. (13) The phase information includes the positional relationship between the pixel position of the display unit and the positional relationship of the light distribution member. The correction information output unit is, Based on the phase information, the amount of phase shift from a predetermined reference position of the light distribution member corresponding to the imaging position is calculated, and the amount of phase shift is adjusted based on the measured value of the thickness. The information processing device described in (10), (11), or (12) above. (14) The light distribution member is a lenticular lens or a parallax barrier. An information processing device as described in any one of the above (1) to (13). (15) The stereoscopic display is configured to present the stereoscopic object by directly providing different images to the left and right eyes of the viewer via the light distribution member. The information processing device described in (14) above. (16) The process involves acquiring an image of a stereoscopic display equipped with a light distribution member positioned on the display unit, which distributes the light rays of the image displayed on the display unit to make the stereoscopic object visible, To obtain the imaging position at the time the aforementioned image was acquired, Based on the changes in the phase pattern generated according to the imaging position and the imaging position included in the captured image, correction information for the stereoscopic display is output to correct the display unevenness of the stereoscopic display. Information processing methods, including those mentioned above. (17) On the computer, To acquire an image of a stereoscopic display equipped with a light distribution member placed on the display unit that distributes the light rays of an image displayed on the display unit to make a stereoscopic object visible. To obtain the imaging position at the time the aforementioned image was acquired, Based on the changes in the phase pattern generated according to the imaging position and the imaging position included in the captured image, correction information for the stereoscopic display is output to correct the display unevenness of the stereoscopic display. A computer-readable recording medium containing a program to achieve this. [Explanation of symbols]

[0136] 3. Imaging device 5. Stereoscopic display 5a Drive unit 5b Display section 5c Light distribution member 10,10A,10B measuring device 12a Image acquisition unit 12b Imaging position acquisition unit 12c calculation part 12d Display Control Unit 30, 30A, 30B Video Output Device 31a Viewing position 31b Phase Information 31c Optical Parameter Information 31d Thickness Information 32a Viewing position acquisition unit 32b Phase shift amount calculation unit 32c Display Control Unit Br Parallax Barrier Ls lenticular lenses

Claims

1. A generation unit that generates a display control signal based on correction information including thickness information showing the thickness distribution of the light distribution member. An information processing system comprising, The light distribution member is arranged on a display unit on which pixels are arranged, and gives directionality to the light rays emitted from the pixels. Information processing system.

2. A stereoscopic display having the display unit and the light distribution member, Equipped with, The correction information is information for correcting display unevenness in the stereoscopic display. The information processing system according to claim 1.

3. The aforementioned correction information is, The phase pattern generated according to the viewing position of the stereoscopic display and the setting based on the viewing position, The generating unit is Based on the phase information indicating the light distribution state of the light rays from each pixel of the display unit, which is provided by the light distribution member based on the change in the phase pattern, the display control signal is generated. The information processing system according to claim 2.

4. The generating unit is The display control signal is generated based on the phase information obtained when the phase pattern is changed by displaying the striped image on the display unit while shifting the phase. The information processing system according to claim 3.

5. The generating unit is Based on the phase information obtained when a cosine wave obtained by dividing one period of the stripe into three or more phase shifts is displayed on the display unit, the display control signal is generated. The information processing system according to claim 4.

6. The phase information includes the positional relationship between the pixel position of the display unit and the positional relationship of the light distribution member. The generating unit is Based on the phase information, the display control signal is generated based on the amount of phase shift from a predetermined reference position of the light distribution member corresponding to the viewing position, which is calculated based on the phase information. The information processing system according to claim 3.

7. The generating unit is Based on the phase shift amount calculated based on the thickness distribution determined by comparing the phase information of each of the different viewing positions, the display control signal is generated. The information processing system according to claim 6.

8. The correction information includes measured values ​​relative to the design values ​​for the arrangement of the light distribution member, The thickness distribution is the distribution of the measured thickness of the light distribution member relative to the display portion. The information processing system according to claim 3.

9. The measured value of the aforementioned thickness is calculated based on the phase information. The information processing system according to claim 8.

10. The aforementioned phase information is Calculated based on the luminance distribution of interference fringes when a fringe image is displayed on the display unit while phase shifting, The information processing system according to claim 9.

11. The measured value of the aforementioned thickness is, Calculated based on a comparison of the phase information for each of the different viewing positions, The information processing system according to claim 9.

12. The phase information includes the positional relationship between the pixel position of the display unit and the positional relationship of the light distribution member. The generating unit is Based on the phase information, the amount of phase shift from a predetermined reference position of the light distribution member corresponding to the viewing position is calculated and adjusted based on the measured value of the thickness. The information processing system according to claim 9.

13. A display unit in which pixels are arranged, A light distribution member is arranged on the display unit and gives directionality to the light rays emitted from the pixels, A drive unit that drives the display unit using a display control signal generated based on correction information including thickness information showing the thickness distribution of the light distribution member, An information processing device equipped with the following features.

14. The aforementioned light distribution member is The light rays of the image displayed on the aforementioned display unit are distributed to allow the viewer to perceive a stereoscopic object. The information processing apparatus according to claim 13.

15. The correction information is information for correcting display unevenness in the display unit. The information processing apparatus according to claim 13.

16. The aforementioned correction information is, The phase pattern changes generated according to the viewer's viewing position and are set based on the viewing position. The aforementioned display control signal is Based on the phase information indicating the light distribution state of the light rays from each pixel of the display unit, which is provided by the light distribution member based on the change in the phase pattern, the following is generated: The information processing apparatus according to claim 13.

17. The phase information includes the positional relationship between the pixel position of the display unit and the positional relationship of the light distribution member. The aforementioned display control signal is Based on the phase information, the amount of phase shift from a predetermined reference position of the light distribution member corresponding to the viewing position is calculated, The information processing apparatus according to claim 16.

18. The correction information includes measured values ​​relative to the design values ​​for the arrangement of the light distribution member, The thickness distribution is the distribution of the measured thickness of the light distribution member relative to the display portion. The measured value of the aforementioned thickness is calculated based on the phase information. The information processing apparatus according to claim 16.

19. The light distribution member is a lenticular lens or a parallax barrier. The information processing apparatus according to claim 13.

20. The system is configured to present the stereoscopic object by directly providing different images to the left and right eyes of the viewer via the light distribution member. The information processing apparatus according to claim 14.

Images