Three dimensional video display device

Abstract

To provide a three dimensional video display device that can widen both the viewing zone and the depth reproduction range.SOLUTION: A three dimensional video display device 20 includes a first three-dimensional display 30A arranged in front of an observer K, a second three dimensional display 30B arranged perpendicular to the first three dimensional display 30A, a half mirror 40 arranged diagonally to the first three dimensional display 30A, and a calculation device 50 that synthesizes the depth reproduction range of the three dimensional image such that the spatial frequency of the three-dimensional image is continuous with the viewing spatial frequency.SELECTED DRAWING: Figure 2

Description

[Technical Field]

[0001] The present invention relates to a ray reproduction type three-dimensional image display device. [Background technology]

[0002] The integral method is a ray-reproduction type stereoscopic display method that allows full-parallax display without the need for special glasses. As shown in FIG. 10(a), the integral 3D imaging device 9A includes an imaging element 90 and a lens array 91 arranged in front of it. The lens array 91 is an array of element lenses 92. The integral 3D imaging device 9A captures an image of the subject α using the same number of light rays as the number of pixels of the imaging element 90. In this case, each element image e is an inverted image of the subject α.

[0003] 10(b), the integral 3D display device 9B includes a flat panel display 93 such as a liquid crystal display or an organic EL display, and a lens array 91 arranged in front of it. Element lenses 92 correspond to element images e, and the element images e are projected into space by the element lenses 92 to form a spatial image. The integral 3D display device 9B then reproduces the light rays from the subject α using the same number of light rays as the number of pixels on the flat panel display 93.

[0004] The integral method reproduces images from many viewpoints, so it requires a very large number of pixels (amount of information). There are three parameters that determine the quality of integral 3D images: viewing zone, spatial frequency characteristics (depth reproduction range), and 3D resolution (number of elemental images). There is a trade-off between these three parameters.

[0005] The viewing zone is the range in which a 3D image can be viewed continuously, i.e., the range within which the observer can move. The viewing zone determined by optical design is called the "optical viewing zone." The angle θ of the optical viewing zone OVZ is expressed by the following formula (1): where e is the size of the element image, fl represents the focal length of the element lens.

[0006]

number

[0007] The depth reproduction range indicates the reproduction performance in the depth direction of 3D images. To define the depth reproduction range, we will explain the spatial frequency characteristics of integral 3D images. The upper spatial frequency γ is the ratio of the visual spatial frequency β to the Nyquist frequency β. n The smaller value of z is expressed by the following equations (2) to (4): where z is the distance from the lens array to the reconstructed image (positive for the near side), L is the viewing distance, and p p is the pixel pitch of the flat panel display, p l indicates the pitch of the element lenses.

[0008]

number

[0009] Based on these formulas (2) to (4), the spatial frequency characteristics of integral 3D images are plotted in a trapezoidal graph as shown in FIG. 11 (Non-Patent Document 1). In the graph of FIG. 11, the horizontal axis represents the depth position of the reproduced image from the lens array surface, and the vertical axis represents the upper limit spatial frequency. The maximum width from the front to the back at a certain spatial frequency is called the "depth reproduction range" of integral 3D images. The depth reproduction range D at a certain viewing spatial frequency β is r (β) is approximately expressed by the following equation (5).

[0010]

number

[0011] In order to improve the performance of 3D images in the integral system, a method of expanding the depth reproduction range using depth synthesis technology has been proposed (Non-Patent Document 2). As shown in FIG. 12, the integral 3D display device 9C has two 3D displays 94 (94 A ,94 B ) and a half mirror 95. The 3D display 94 is the same as the integral 3D display device 9B in FIG. 10(b). Specifically, the integral 3D display device 9C has two 3D displays 94 A ,94 B The 3D display 94 is perpendicular to the horizontal plane and a half mirror 95 is placed between them. B The depth reproduction range is D from the half mirror 95 r (β) from the 3D display 94. A Depth reproduction range D r 3D display 94 located at a distance of (β) B Illusion of 94 B ´, allowing two 3D images to be spatially synthesized.

[0012] Furthermore, a method for expanding the viewing zone using viewpoint tracking technology has been proposed (Non-Patent Documents 3 and 4). In this method, a camera is used to estimate the observer's viewpoint, and elemental images are generated for each frame so that the center of the optical viewing zone is centered on the center of both eyes, thereby dynamically controlling the optical viewing zone to expand the viewing zone. Here, the viewing zone expanded by viewpoint tracking technology is called the "system viewing zone." [Prior art documents] [Non-patent literature]

[0013] [Non-Patent Document 1] H. Hoshino, F. Okano, and I. Yuyama, “Analysis of resolution limitation of integral photography,” J. Opt. Soc. Am. A, Vol. 15, No. 8, pp. 2059-2065 (1998) [Non-patent document 2] SW. Min, B. Javidi, and B. Lee, “Enhanced three-dimensional integral imaging system by use of double display devices,” Appl. Opt., Vol. 42, No. 20, pp. 4186-4195 (2003) [Non-patent document 3] Naoto Okaichi, Hisayuki Sasaki, Masanori Kano, Masahiro Kawakita, and Takeshi Naemura, “Development of a viewpoint-tracking integral 3D video display system,” Journal of the Institute of Image Information and Television Engineers, Vol. 75, No. 1, pp. 125-130 (2021) [Non-patent document 4] N. Okaichi, H. Sasaki, M. Kano, J. Arai, M. Kawakita, and T. Naemura, “Design of optical viewing zone suitable for eye-tracking integral 3D display,” OSA Contin., Vol.4, No.5, pp.1415-1429 (2021) Summary of the Invention [Problem to be solved by the invention]

[0014] However, conventional depth synthesis technology has a narrow viewing zone, and conventional viewpoint tracking technology has a narrow depth reproduction range.

[0015] Therefore, an object of the present invention is to provide a three-dimensional image display device that can widen both the viewing zone and the depth reproduction range. [Means for solving the problem]

[0016] In order to solve the above problems, the 3D image display device of the present invention is a 3D image display device that uses depth synthesis technology and viewpoint tracking technology to display 3D images using a ray reproduction method, and is configured to include a first 3D display using the ray reproduction method, a second 3D display using the ray reproduction method, a half mirror, and a computing device.

[0017] The first stereoscopic display is placed in front of the viewer and displays the first elemental image. The second stereoscopic display is disposed perpendicular to the first stereoscopic display and displays a second elemental image. The half mirror is disposed in front of the first stereoscopic display so as to be oblique to the first stereoscopic display. The second stereoscopic display is spaced from the half mirror by a distance corresponding to the depth reproduction range that corresponds to the Nyquist frequency or the viewing spatial frequency of the first stereoscopic display.

[0018] The calculation device includes a viewpoint position detection unit, a first elemental image generation unit, and a second elemental image generation unit. The viewpoint position detector detects the viewpoint position of the observer. The first elemental image generating section generates a first elemental image at a predetermined viewing distance so as to follow the viewpoint position. The second elemental image generating section generates the second elemental image so as to follow the viewpoint position, with the viewing distance increased by a depth reproduction range according to the Nyquist frequency or the viewing spatial frequency. The first elemental image generating unit and the second elemental image generating unit synthesize the depth reproduction range of the three-dimensional video so that the spatial frequency of the three-dimensional video is continuous at the Nyquist frequency or the visual spatial frequency.

[0019] In addition, in order to solve the above-mentioned problems, the 3D image display device of the present invention is a 3D image display device that uses depth synthesis technology and viewpoint tracking technology to display 3D images using a ray reproduction method, and is configured to include a 3D display using the ray reproduction method, a half mirror, a reflecting mirror, and a computing device.

[0020] The stereoscopic display has a first display section positioned in front of the viewer and displaying a first elemental image, and a second display section separated from the first display section and displaying a second elemental image. The half mirror is disposed in front of the first display unit so as to be oblique to the first display unit. The reflecting mirror is disposed in front of the second display unit so as to be oblique to the second display unit. The second display unit is separated from the half mirror by a depth range according to the Nyquist frequency or the viewing spatial frequency of the stereoscopic display.

[0021] The calculation device includes a viewpoint position detection unit, a first elemental image generation unit, and a second elemental image generation unit. The viewpoint position detector detects the viewpoint position of the observer. The first elemental image generating section generates a first elemental image at a predetermined viewing distance so as to follow the viewpoint position. The second elemental image generating section generates the second elemental image so as to follow the viewpoint position, with the viewing distance increased by a depth reproduction range according to the Nyquist frequency or the viewing spatial frequency. The first elemental image generating unit and the second elemental image generating unit synthesize the depth reproduction range of the three-dimensional video so that the spatial frequency of the three-dimensional video is continuous at the Nyquist frequency or the visual spatial frequency.

[0022] In addition, in order to solve the above-mentioned problems, the 3D image display device of the present invention is a 3D image display device that uses depth synthesis technology and viewpoint tracking technology to display 3D images using a ray reproduction method, and is configured to include a foldable ray reproduction method stereoscopic display, a half mirror, and a computing device.

[0023] The stereoscopic display has a first display section positioned in front of the viewer and displaying a first elemental image, and a second display section positioned perpendicular to the first display section and displaying a second elemental image. The half mirror is disposed in front of the first display unit so as to be oblique to the first display unit. The second display unit is spaced from the half mirror by a distance corresponding to the depth reproduction range according to the Nyquist frequency or the viewing spatial frequency.

[0024] The calculation device includes a viewpoint position detection unit, a first elemental image generation unit, and a second elemental image generation unit. The viewpoint position detector detects the viewpoint position of the observer. The first elemental image generating section generates a first elemental image at a predetermined viewing distance so as to follow the viewpoint position. The second elemental image generating section generates the second elemental image so as to follow the viewpoint position, with the viewing distance increased by a depth reproduction range according to the Nyquist frequency or the viewing spatial frequency. The first elemental image generating unit and the second elemental image generating unit synthesize the depth reproduction range of the three-dimensional video so that the spatial frequency of the three-dimensional video is continuous at the Nyquist frequency or the visual spatial frequency.

[0025] In addition, in order to solve the above-mentioned problems, the 3D image display device of the present invention is a 3D image display device that uses depth synthesis technology and viewpoint tracking technology to display 3D images using a ray reproduction method, and is configured to include a first 3D display using the ray reproduction method, a second 3D display using the ray reproduction method, a half mirror, and a calculation device.

[0026] The first stereoscopic display is placed in front of the viewer and displays the first elemental image. The second stereoscopic display is disposed perpendicular to the first stereoscopic display, has a wider viewing zone than the first stereoscopic display, and displays a second elemental image generated in advance. The half mirror is disposed in front of the first stereoscopic display so as to be oblique to the first stereoscopic display. The second stereoscopic display is spaced from the half mirror by a distance corresponding to the depth reproduction range that corresponds to the Nyquist frequency or the viewing spatial frequency of the first stereoscopic display.

[0027] The calculation device includes a viewpoint position detection unit and a first element image generation unit. The viewpoint position detector detects the viewpoint position of the observer. The first elemental image generating section generates a first elemental image at a predetermined viewing distance so as to follow the viewpoint position. The first elemental image generating section generates the first elemental image so that the spatial frequency of the three-dimensional video is continuous at the Nyquist frequency or the visual spatial frequency. [Effects of the Invention]

[0028] According to the present invention, the depth synthesis technology and the viewpoint tracking technology are used in combination, so that it is possible to widen both the viewing zone and the depth reproduction range. [Brief explanation of the drawings]

[0029] [Figure 1] In the first embodiment, (a) is a graph showing the spatial frequency characteristics when synthesized within a depth reproduction range according to the Nyquist frequency, and (b) is a graph showing the spatial frequency characteristics when synthesized within a depth reproduction range according to the visual spatial frequency. [Figure 2] 1 is a schematic diagram illustrating the configuration of a 3D video display system according to a first embodiment. [Figure 3] 1 is a block diagram showing the configuration of a three-dimensional video display device according to a first embodiment. [Figure 4] FIG. 2 is an explanatory diagram for explaining generation of element images in the first embodiment. [Figure 5] FIG. 10 is a schematic diagram illustrating the configuration of a 3D video display system according to a second embodiment. [Figure 6] FIG. 10 is a block diagram showing the configuration of a three-dimensional video display device according to a second embodiment. [Figure 7] FIG. 10 is a schematic diagram illustrating the configuration of a 3D video display system according to a third embodiment. [Figure 8] FIG. 10 is a schematic diagram illustrating the configuration of a 3D video display system according to a fourth embodiment. [Figure 9] FIG. 10 is a block diagram showing the configuration of a three-dimensional video display device according to a fourth embodiment. [Figure 10] FIG. 1(a) is an explanatory diagram illustrating a conventional integral 3D imaging device, and FIG. 1(b) is an explanatory diagram illustrating a conventional integral 3D display device. [Figure 11] 1 is a graph showing spatial frequency characteristics in the prior art. [Figure 12] FIG. 1 is an explanatory diagram illustrating a conventional depth synthesis technique. DETAILED DESCRIPTION OF THE INVENTION

[0030] Hereinafter, each embodiment of the present invention will be described with reference to the drawings. However, each embodiment described below is intended to embody the technical idea of the present invention, and unless otherwise specified, the present invention is not limited to the following. Furthermore, the same means will be given the same reference numerals, and their description may be omitted.

[0031] (First embodiment) [Depth Range Composition] Referring to FIG. 1, synthesis of depth reproduction ranges will be described as a premise of the three-dimensional video display system 1 (FIG. 2) according to the first embodiment.

[0032] As shown in Figure 1, by shifting the depth reproduction ranges of two aerial images and combining them, the trapezoidal spatial frequency characteristics are linked, making it possible to expand the depth reproduction range. In Figure 1, γ represents the upper limit spatial frequency, and z represents the depth direction. Also in Figure 1, the depth reproduction range of the aerial image formed by the first elemental image is shown by a thick line, and the depth reproduction range of the aerial image formed by the second elemental image is shown by a thin line.

[0033] FIG. 1(a) shows a first stereoscopic display 30 (described later). A The Nyquist frequency β n The graph in FIG. 1(a) shows a case where the depth reproduction range of the 3D image is synthesized so that the first 3D display 30 A and a second stereoscopic display 30 B The lens array surface is set at the Nyquist frequency β n Depth reproduction range D according to r (β n ) distance. r (β n) is the ratio of the visual spatial frequency β in the above equation (5) to the Nyquist frequency β n It can be found by replacing

[0034] FIG. 1(b) also shows a first stereoscopic display 30 A The graph in FIG. 1(b) shows the case where the depth reproduction range of the 3D image is synthesized so that the first 3D display 30 is continuous at the visual spatial frequency β. A and a second stereoscopic display 30 B The lens array surface is set to a depth reproduction range D according to the visual spatial frequency β. r (β) away. Depth reproduction range D r (β) is calculated by the above formula (5).

[0035] If the entire ranges of the two spatial images formed by the first and second elemental images were combined, high spatial frequency (solid line) and low spatial frequency (dashed line) images would be mixed at a certain depth reproduction position, resulting in image quality degradation. Therefore, using boundary position P, where the depth reproduction ranges of the two spatial images intersect, as the boundary, the depth reproduction range of the spatial image formed by the first elemental image is allocated to the foreground, and the depth reproduction range of the spatial image formed by the second elemental image is allocated to the background. This allows 3D images to be displayed at the higher spatial frequency indicated by the solid line at all depth reproduction positions, thereby suppressing image quality degradation. In other words, when combining the depth reproduction ranges of 3D images, the lower spatial frequency indicated by the dashed line is eliminated.

[0036] The depth position Zp of the boundary position P can be calculated using the following equation (6): This equation (6) is a modification of the above equation (2).

[0037]

number

[0038] [Overview of 3D image display system] An overview of the three-dimensional video display system 1 will be described with reference to FIGS. The 3D image display system 1 displays 3D images using a light reproduction method. In this embodiment, the light reproduction method is described as an integral method. In addition, in Figure 2, the horizontal direction is the x-axis, the vertical direction is the y-axis, and the depth direction is the z-axis.

[0039] As shown in FIGS. 2 and 3, the three-dimensional image display system 1 includes a camera 10 and a three-dimensional image display device 20. The three-dimensional image display device 20 includes a camera 10 and a three-dimensional image display device 20. The camera 10 and the three-dimensional image display device 20 are similar to those shown in FIGS. The camera 10 photographs the observer K to detect the viewpoint position of the observer K, and outputs the photographed image of the observer K to the three-dimensional image display device 20. In this embodiment, the first three-dimensional display 30 is positioned in front of the observer K. A For example, camera 2 may be a general small camera. The three-dimensional image display device 20 displays three-dimensional images by a ray reproduction method using depth synthesis technology and viewpoint tracking technology.

[0040] [Configuration of 3D image display device] The configuration of the three-dimensional image display device 20 will be described below. The three-dimensional image display device 20 includes a first stereoscopic display 30 A and the second stereoscopic display 30 B 3, the half mirror 40 is omitted from the illustration.

[0041] Hereafter, the first stereoscopic display 30 A The elemental image displayed on the second stereoscopic display 30 is called the first elemental image. B The element image displayed in is called the second element image. For example, when the light reproduction method is an integral method, the first stereoscopic display 30 A and the second stereoscopic display 30 B has the same configuration as a general integral 3D display device 9B (FIG. 10(b)).

[0042] First stereoscopic display 30 Ais a ray reproduction type three-dimensional display that is placed in front of the observer K and displays the first elemental image. In this embodiment, the first three-dimensional display 30 A is arranged so that its lens array surface is parallel to the xy plane. Second stereoscopic display 30 B is the first stereoscopic display 30 A The second stereoscopic display 30 is a ray reproduction type stereoscopic display that is disposed perpendicular to the first stereoscopic display 30 and displays the second elemental image. B is arranged so that its lens array surface is parallel to the yz plane.

[0043] The half mirror 40 is A The first stereoscopic display 30 is positioned obliquely relative to the A In this embodiment, the half mirror 40 is disposed in front of the first stereoscopic display 30. A and the second stereoscopic display 30 B The half mirror 40 is disposed so as to face each of the first and second stereoscopic displays 30. A and the second stereoscopic display 30 B The half mirror 40 is disposed at an angle of 45° with respect to each lens array surface. A The positions of both ends of the half mirror 40 in the horizontal direction are aligned with the lens array surface of the first stereoscopic display 30. A The light from the second stereoscopic display 30 is transmitted to the observer K. B It reflects the light from the object towards observer K.

[0044] Here, the second stereoscopic display 30 B is the depth reproduction range D according to the visual spatial frequency β r Specifically, the second stereoscopic display 30 is spaced from the half mirror 40 by a distance (β) from the half mirror 40 in the horizontal direction. B The lens array surface of the half mirror 40 is located within the depth reproduction range D rWith this arrangement, the first stereoscopic display 30 A and a second stereoscopic display 30 B The lens array surface has a depth reproduction range of D r As a result, the three-dimensional image display device 20 can reproduce a situation in which the first stereoscopic display 30 is distant from the first stereoscopic display 30. A Depth reproduction range D r The second 3D display 30 is located at the back, away from the display (β). B This creates a virtual image, expanding the depth reproduction range.

[0045] The calculation device 50 performs calculations necessary to generate the first elemental image and the second elemental image. As shown in Fig. 3, the calculation device 50 includes a viewpoint position detection unit 51, a first elemental image generation unit 52, and a second elemental image generation unit 53.

[0046] The viewpoint position detection unit 51 detects the viewpoint position of the observer K. In this embodiment, the viewpoint position detection unit 51 applies face detection processing and processing for solving a PnP (Perspective-n-Point) problem to the captured image of the observer K captured by the camera 10, and detects the viewpoint position of the observer K (three-dimensional position of the pupil of the observer K). For example, examples of face detection processing include OpenCV (Reference 1), Dlib (Reference 2), and MediaPipe (Reference 3). Also, examples of processing for solving the PnP problem include OpenCV.

[0047] Reference 1: “OpenCV-Open Computer Vision Library”, [online], [Retrieved January 17, 2024], Internet,<URL:http: / / tokkyo.shinsakijun.com / information / newtech.html> Reference 2: “dlib C++ Library”, [online], [Retrieved January 17, 2024], Internet,<URL:http: / / dlib.net / > Reference 3: “MediaPipe”, [online], [Retrieved January 17, 2024], Internet,<URL:https: / / developers.google.com / mediapipe>

[0048] The viewpoint position detection unit 51 outputs the detected viewpoint position of the viewer K to the first elemental image generation unit 52 and the second elemental image generation unit 53.

[0049] The first elemental image generating unit 52 generates a first elemental image at a predetermined viewing distance L so as to follow the viewpoint position of the observer K detected by the viewpoint position detecting unit 51. Then, the first elemental image generating unit 52 displays the generated first elemental image on the first stereoscopic display 30. A Output to. The viewing distance L is the distance from the first stereoscopic display 30 A This is the distance between the lens array surface and the pupil of the observer K.

[0050] The second element image generating unit 53 generates a depth reproduction range D according to the visual spatial frequency β. r The second element image generating unit 53 generates the second element image so as to follow the viewpoint position of the observer K detected by the viewpoint position detecting unit 51, with a viewing distance L of (β) away from the observer K. Then, the second element image generating unit 53 displays the generated second element image on the second stereoscopic display 30. B Output to.

[0051] <Generation of element images> Here, the first elemental image generating unit 52 and the second elemental image generating unit 53 simultaneously generate the first elemental image and the second elemental image according to the viewpoint position of the observer K. For example, the first elemental image and the second elemental image can be generated using a method of generating elemental images from a multi-viewpoint virtual camera 201 (Non-Patent Documents 3 and 4).

[0052] In this elemental image generation method, as shown in Fig. 4, a subject (three-dimensional model) α is photographed by a virtual camera array 200, and the photographed multi-viewpoint image V is converted into an elemental image E. Fig. 4 illustrates a virtual display 210 corresponding to the first stereoscopic display 30 in the virtual space and a virtual lens array 220. The virtual lens array 220 is an array of virtual lenses 221.

[0053] Here, viewpoint tracking can be achieved by generating elemental images E so that the viewpoint position (center of both eyes) of observer K coincides with the center of the optical viewing field. Specifically, the center C of the virtual camera array 200 and the viewpoint position of observer K should coincide. In this way, by generating elemental images E according to the viewpoint position of observer K and dynamically forming the optical viewing field, a wide system viewing field can be formed. Furthermore, when mapping pixel information from multi-viewpoint images, elemental images can be generated in real time by performing parallel processing using a GPU (Graphics Processing Unit).

[0054] In this elemental image generation method, the visual volume of each virtual camera 201 is calculated based on the first stereoscopic display 30. A and the second stereoscopic display 30 B Specifically, the first elemental image generating unit 52 and the second elemental image generating unit 53 synthesize the depth reproduction ranges of the 3D images so that the spatial frequencies of the 3D images are continuous at the visual spatial frequency β. The synthesis of the depth reproduction ranges is as described in FIG. 1(b).

[0055] When this elemental image generation method is used, two first stereoscopic displays 30 A and the second stereoscopic display 30 B is the depth reproduction range D r Therefore, when rendering the first element image and the second element image, the arrangement of the virtual camera array 200 is the same, and the viewing distance is the same as the depth reproduction range D rSpecifically, when rendering the first element image, the first element image generating unit 52 sets the viewing distance in the rendering parameters to L. On the other hand, when rendering the second element image, the second element image generating unit 53 sets the viewing distance in the rendering parameters to L+D. r Let (β).

[0056] The system viewing zone can be formed and a wider viewing zone can be realized by performing the above processing for each frame according to the viewpoint position of the observer K. Note that the method for generating elemental images is not limited to the above processing, and ray tracing may also be used.

[0057] In addition, in FIG. 2, the second stereoscopic display 30 B is the depth reproduction range D r Although the second stereoscopic display 30 is shown as being separated from the half mirror 40 by (β), B Depth reproduction range D r (β n ) from the half mirror 40. In this case, the second element image generating unit 53 may be spaced apart from the half mirror 40 by a distance of 1 / 2 the Nyquist frequency β n Depth reproduction range D according to r (β n ) at a viewing distance L, and generate the second elemental image so as to follow the viewpoint position of the observer K.

[0058] [Actions and Effects] As described above, the 3D image display device 20 uses both depth synthesis technology and viewpoint tracking technology, thereby widening both the viewing zone and the depth reproduction range. In other words, the 3D image display device 20 enables ray reproduction type 3D image display that combines a wide depth reproduction range and a wide viewing zone.

[0059] Furthermore, when synthesizing the depth reproduction range of a three-dimensional image, the three-dimensional image display device 20 utilizes the higher spatial frequency and ignores the lower spatial frequency, thereby preventing the mixing of images with high and low spatial frequencies and suppressing deterioration in image quality.

[0060] (Second embodiment) With reference to FIGS. 5 and 6, a 3D image display system 1B according to the second embodiment will be described, focusing on differences from the first embodiment. The first embodiment uses two stereoscopic displays, whereas the second embodiment differs in that one stereoscopic display 32 is divided into two screens and the depth reproduction ranges are combined.

[0061] As shown in FIGS. 5 and 6, the three-dimensional image display system 1B includes a camera 10 and a three-dimensional image display device 20B. The camera 10 is the same as in the first embodiment except that it is located on the upper left side of the stereoscopic display 32, so a description thereof will be omitted.

[0062] [Configuration of 3D image display device] The configuration of the three-dimensional image display device 20B will be described below. The three-dimensional image display device 20B includes a stereoscopic display 32, a half mirror 40B, a computing device 50B, and a reflecting mirror 60. Note that the half mirror 40B and the reflecting mirror 60 are not shown in FIG.

[0063] The stereoscopic display 32 is a typical stereoscopic display of a light reproduction type. The stereoscopic display 32 includes a first display unit 32 positioned in front of the viewer and displaying a first elemental image. A , and the first display unit 32 A a second display section 32 that displays a second elemental image divided from the first elemental image; B The 3D display 32 is divided at the center of the screen, with the left half being the first display section 32. A The right half is the second display section 32 B That is, the first display unit 32 A The first stereoscopic display 30 in FIG. A and the second display unit 32 B The second stereoscopic display 30 in FIG. B In this embodiment, the stereoscopic display 32 is disposed so that its lens array surface is parallel to the xy plane.

[0064] Here, the first display unit 32 A and second display unit 32 B and the depth reproduction range D r The first display unit 32 is arranged to reproduce a state where the distance between the first display unit 32 and the second display unit 32 is (β). A and second display unit 32 B Specifically, in the horizontal direction, the second display unit 32 B The width of the depth reproduction range D r It is equal to (β).

[0065] The half mirror 40B is a first display unit 32 A The first display unit 32 is positioned diagonally relative to the A In this embodiment, the half mirror 40B is disposed so as to face the stereoscopic display 32. The half mirror 40B is disposed so as to be tilted at 45° with respect to the lens array surface of the stereoscopic display 32. The half mirror 40B is disposed so as to face the first display unit 32. A In contrast, both ends are aligned horizontally.

[0066] The calculation device 50 performs calculations necessary for generating the first element image and the second element image. A and outputs the second element image to the second display unit 32. B Since the second embodiment is the same as the first embodiment except for outputting the data to the first embodiment, the description thereof will be omitted.

[0067] The reflecting mirror 60 is B The second display unit 32 is positioned diagonally relative to the B In this embodiment, the reflecting mirror 60 is disposed in front of the second display unit 32, tilted at 45° with respect to the lens array surface of the stereoscopic display 32. B In contrast, both ends are aligned horizontally.

[0068] As shown in FIG. 5, the reflecting mirror 60 is B The light from the second display unit 32 is reflected toward the half mirror 40B. B The first display unit 32A The half mirror 40B can be positioned perpendicular to the first display unit 32. A The light from the second display unit 32 is transmitted to the viewer K and reflected by the reflecting mirror 60. B It reflects the light from the object towards observer K.

[0069] With this arrangement, the first display unit 32 A and second display unit 32 B and the depth reproduction range D r In other words, the three-dimensional image display device 20B can reproduce a situation in which the object is far away from the second display unit 32, which is the right half of the stereoscopic display 32. B Virtual Image 32 B The three-dimensional image display device 20B then forms a virtual image on the first display unit 32 by using a half mirror 40B corresponding to this virtual image. A Depth reproduction range D r Virtual image 32 at the back, separated by (β) B This creates a ´´, expanding the depth reproduction range.

[0070] [Actions and Effects] As described above, the three-dimensional image display device 20B uses both the depth synthesis technology and the viewpoint tracking technology in the same way as in the first embodiment, and therefore can widen both the viewing zone and the depth reproduction range. Furthermore, the three-dimensional image display device 20B can prevent a situation in which images with high spatial frequencies and low spatial frequencies are mixed together, thereby suppressing deterioration in image quality. Furthermore, the three-dimensional image display device 20B only needs to include one stereoscopic display 32, which simplifies the configuration.

[0071] (Third embodiment) With reference to FIG. 7, a three-dimensional image display system 1C according to the third embodiment will be described, focusing on the differences from the first embodiment. The difference between the first embodiment and the third embodiment is that two stereoscopic displays are arranged vertically, whereas one stereoscopic display 33 is folded vertically in the third embodiment.

[0072] As shown in FIG. 7, a three-dimensional image display system 1C includes a camera 10 and a three-dimensional image display device 20C. The camera 10 is the same as in the first embodiment, and therefore a description thereof will be omitted.

[0073] [Configuration of 3D image display device] The configuration of the three-dimensional image display device 20C will be described below. The three-dimensional image display device 20C includes a stereoscopic display 33, a half mirror 40C, and a computing device 50.

[0074] The stereoscopic display 33 is a foldable stereoscopic display of a light reproduction type. The stereoscopic display 33 includes a first display unit 33 positioned in front of the observer K and displaying a first elemental image. A , and the first display unit 33 A a second display section 33 positioned perpendicular to the first display section 31 and displaying a second elemental image; B It has.

[0075] In addition, by folding the stereoscopic display 33 by 90 degrees, the orthogonal first display unit 33 can be displayed in the same manner as in the first embodiment. A and second display unit 33 B In this embodiment, the first display unit 33 A becomes parallel to the xy plane, and the second display unit 33 B is parallel to the yz plane.

[0076] The half mirror 40C is a first display unit 33 A The first display unit 33 is positioned diagonally relative to the A In this embodiment, the half mirror 40C is disposed in front of the first display unit 33. A and second display unit 33 B The half mirror 40C is disposed so as to face the first display unit 33. A The half mirror 40C is disposed at an angle of 45° to the first display unit 33. A The positions of both ends of the half mirror 40C are aligned in the horizontal direction with respect to the first display unit 33. AThe light from the second display unit 33 is transmitted to the viewer K. B It reflects the light from the object towards observer K.

[0077] Here, the second display unit 33 B is the depth reproduction range D according to the visual spatial frequency β r Specifically, the second display unit 33 is spaced from the half mirror 40C by a distance (β) from the second display unit 33 in the horizontal direction. B is the depth reproduction range D from the right edge of the half mirror 40C. r The stereoscopic display 33 is folded so that it is spaced apart by (β).

[0078] With this arrangement, the first display unit 33 A and second display unit 33 B and the depth reproduction range D r As a result, the three-dimensional image display device 20C can reproduce a situation in which the object is distant by a distance of (β). A Depth reproduction range D r The second display unit 33 is located at the back, separated by (β). B This allows for the creation of a virtual image, thereby expanding the depth reproduction range.

[0079] The calculation device 50 performs calculations necessary for generating the first element image and the second element image. A and outputs the second element image to the second display unit 33 B Since the second embodiment is the same as the first embodiment except for outputting the data to the first embodiment, the description thereof will be omitted.

[0080] [Actions and Effects] As described above, the three-dimensional image display device 20C uses both the depth synthesis technology and the viewpoint tracking technology in the same way as in the first embodiment, and therefore can widen both the viewing zone and the depth reproduction range. Furthermore, the three-dimensional image display device 20C can prevent a situation in which images with high spatial frequencies and low spatial frequencies are mixed together, thereby suppressing deterioration in image quality. Furthermore, the three-dimensional image display device 20C only needs to include one stereoscopic display 33, which simplifies the configuration.

[0081] (Fourth embodiment) With reference to FIGS. 8 and 9, a three-dimensional image display system 1D according to the fourth embodiment will be described, focusing on the differences from the first embodiment. In the first embodiment, moving images are displayed on two stereoscopic displays, whereas in the fourth embodiment, moving images are displayed on one of the two stereoscopic displays, and still images are displayed on the other, which is different from the first embodiment.

[0082] As shown in FIGS. 8 and 9, the three-dimensional image display system 1 includes a camera 10 and a three-dimensional image display device 20D. The camera 10 is the same as in the first embodiment, and therefore a description thereof will be omitted.

[0083] [Configuration of 3D image display device] The configuration of the three-dimensional image display device 20D will be described below. The three-dimensional image display device 20D includes a first stereoscopic display 30 A 9, the stereoscopic display 30 includes a first stereoscopic display 34, a half mirror 40, and a computing device 50D. Note that the half mirror 40 is not shown in FIG.

[0084] First stereoscopic display 30 A The first stereoscopic display 30 is disposed in front of the observer K and is a stereoscopic display of a ray reproduction type that displays the first elemental image. A is the same as in the first embodiment, and therefore further explanation will be omitted.

[0085] The second stereoscopic display 34 is a stereoscopic display having a plurality of pixels. A and the first stereoscopic display 30 A The second stereoscopic display 34 has a wider viewing zone (optical viewing zone) than the first stereoscopic display 34 and displays a second elemental image generated in advance. For example, the second stereoscopic display 34 includes a film on which the second elemental image is printed and a lens array arranged in front of the film.

[0086] Here, since the second 3D display 34 cannot follow the viewpoint position of the observer K, it is preferable to design it so that it can form an optical viewing zone that is approximately the same as the system viewing zone described above. For example, the optical viewing zone of the second 3D display 34 can be widened by shortening the focal length of the lens array.

[0087] Increasing the focal length of the lens array of the second stereoscopic display 34 causes problems with widening the viewing area, such as narrowing the depth reproduction range. A In the three-dimensional image display device 20D, a background with no depth may be used as a second element image to be displayed on the second three-dimensional display 34. In other words, in a scene consisting of a dynamic subject α and a static background, the three-dimensional image display device 20D displays the former as a first element image to be displayed on the first three-dimensional display 34. A and the latter is displayed on the second stereoscopic display 34.

[0088] If several types of films on which second elemental images that serve as backgrounds are printed are prepared, the background of the second stereoscopic display 34 can be easily changed by replacing the films.

[0089] The half mirror 40 is A The first stereoscopic display 30 is positioned obliquely relative to the A The half mirror 40 is the same as that in the first embodiment, and therefore the description thereof will be omitted.

[0090] The calculation device 50D performs calculations necessary to generate the first elemental image. As shown in Fig. 9, the calculation device 50D includes a viewpoint position detection section 51 and a first elemental image generation section 52D.

[0091] The viewpoint position detection unit 51 detects the viewpoint position of the observer K. Note that the viewpoint position detection unit 51 is the same as that in the first embodiment, and therefore the above description will be omitted.

[0092] The first element image generating unit 52D generates the first element image so that the spatial frequency of the 3D video is continuous with the visual spatial frequency. In this embodiment, since the second element image is generated in advance, the first element image generating unit 52D generates the first element image in accordance with the second element image. Note that the first element image generating unit 52D can generate the first element image in the same procedure as in the first embodiment, and therefore further explanation will be omitted.

[0093] [Actions and Effects] As described above, the three-dimensional image display device 20D uses both the depth synthesis technology and the viewpoint tracking technology in the same way as in the first embodiment, and therefore can widen both the viewing zone and the depth reproduction range. Furthermore, the three-dimensional image display device 20D can prevent a situation in which images with high and low spatial frequencies are mixed together, thereby suppressing deterioration in image quality. Furthermore, the three-dimensional image display device 20D only needs to include one dynamic stereoscopic display, which simplifies the configuration. [Example]

[0094] Below, as an example, the specifications of the first stereoscopic display and the second display used in the 3D image display device according to the first embodiment are illustrated. Here, it is assumed that the first stereoscopic display and the second display are of the lens array type and have the same specifications.

[0095] Lens array lens pitch: 0.3 mm Lens array focal length: 1.2mm Lens array arrangement: Square arrangement Lens array rotation angle: 45° Display pixel pitch: 31.5 μm Display resolution: 3840 x 2160

[0096] Viewing distance: 500mm Optical viewing area aspect ratio: 2:1 Nyquist frequency: 20.6cpd Depth reproduction range according to Nyquist frequency (distance between 3D displays): 16.1 mm Depth reproduction range (distance between 3D displays) when visual spatial frequency is 15cpd: 22.2mm Depth reproduction range (distance between 3D displays) when visual spatial frequency is 10cpd: 33.2mm

[0097] In this embodiment, the first stereoscopic display and the second display have the same specifications, but they may have different specifications.

[0098] (Variation) Although each embodiment has been described in detail above, the present invention is not limited to the above-described embodiments, and includes design modifications and the like within the scope of the present invention.

[0099] In the above-described embodiments, the light reproduction method is described as being an integral method, but this is not limiting. For example, the present invention can also be applied to light reproduction methods such as a lenticular lens method, a point light source method, a line light source method, a parallax barrier method, and a pinhole method.

[0100] In each of the above-described embodiments, the depth reproduction range D according to the visual spatial frequency β is r Although the above description has been given assuming that the viewing distance is increased by (β), this is not limiting. n Depth reproduction range D according to r (β n ) viewing distance may be increased. [Explanation of symbols]

[0101] 1,1B,1C,1D 3D image display system 10 Camera 20, 20B, 20C, 20D 3D image display device 30 A First 3D display 30 B ,34 Second 3D display 32 3D display 32 A 1st display section 32 B 2nd display 33 3D display 33 A 1st display section 33 B 2nd display 40, 40B, 40C Half mirror 50,50B,50D arithmetic unit 51 Viewpoint position detection unit 52, 52D First element image generation unit 53 Second element image generation unit 60 Reflector

Claims

1. A 3D image display device that displays 3D images using a ray reproduction method by using depth synthesis technology and viewpoint tracking technology, a first stereoscopic display of a ray reproduction type disposed in front of a viewer and displaying a first elemental image; a second stereoscopic display of a ray reproduction type disposed perpendicular to the first stereoscopic display and displaying a second elemental image; a half mirror disposed in front of the first stereoscopic display so as to be oblique to the first stereoscopic display; a computing device, the second three-dimensional display is spaced from the half mirror by a depth reproduction range corresponding to a Nyquist frequency or a viewing spatial frequency of the first three-dimensional display, The computing device a viewpoint position detection unit for detecting a viewpoint position of the observer; a first element image generating unit that generates the first element image at a predetermined viewing distance so as to follow the viewpoint position; a second element image generating unit that generates the second element image so as to follow the viewpoint position by increasing the viewing distance by a depth reproduction range corresponding to the Nyquist frequency or the viewing spatial frequency, The first element image generation unit and the second element image generation unit synthesize the depth reproduction range of the three-dimensional image so that the spatial frequency of the three-dimensional image is continuous at the Nyquist frequency or the visual spatial frequency.

2. A 3D image display device that displays 3D images using a ray reproduction method by using depth synthesis technology and viewpoint tracking technology, a ray reproduction type three-dimensional display having a first display unit located in front of a viewer and displaying a first elemental image, and a second display unit separated from the first display unit and displaying a second elemental image; a half mirror disposed in front of the first display unit so as to be oblique to the first display unit; a reflecting mirror disposed in front of the second display unit so as to be oblique to the second display unit; a computing device, the second display unit is spaced from the half mirror by a depth reproduction range corresponding to a Nyquist frequency or a viewing spatial frequency of the three-dimensional display, The computing device a viewpoint position detection unit for detecting a viewpoint position of the observer; a first element image generating unit that generates the first element image at a predetermined viewing distance so as to follow the viewpoint position; a second element image generating unit that generates the second element image so as to follow the viewpoint position by increasing the viewing distance by a depth reproduction range corresponding to the Nyquist frequency or the viewing spatial frequency, The first element image generation unit and the second element image generation unit synthesize the depth reproduction range of the three-dimensional image so that the spatial frequency of the three-dimensional image is continuous at the Nyquist frequency or the visual spatial frequency.

3. A 3D image display device that displays 3D images using a ray reproduction method by using depth synthesis technology and viewpoint tracking technology, a foldable ray reproduction type three-dimensional display having a first display unit positioned in front of a viewer and displaying a first elemental image, and a second display unit positioned perpendicular to the first display unit and displaying a second elemental image; a half mirror disposed in front of the first display unit so as to be oblique to the first display unit; a computing device, the second display unit is spaced from the half mirror by a depth reproduction range corresponding to a Nyquist frequency or a viewing spatial frequency of the three-dimensional display, The computing device a viewpoint position detection unit for detecting a viewpoint position of the observer; a first element image generating unit that generates the first element image at a predetermined viewing distance so as to follow the viewpoint position; a second element image generating unit that generates the second element image so as to follow the viewpoint position by increasing the viewing distance by a depth reproduction range corresponding to the Nyquist frequency or the viewing spatial frequency, The first element image generation unit and the second element image generation unit synthesize the three-dimensional images so that the spatial frequency of the three-dimensional images is continuous at the Nyquist frequency or the visual spatial frequency.

4. the first element image generation unit generates the first element image within a depth reproduction range on the front side from a preset boundary position, 4. The three-dimensional video display device according to claim 1, wherein the second elemental image generating section generates the second elemental image within a depth reproduction range on the far side from the boundary position.

5. 5. The three-dimensional image display device according to claim 4, wherein the light reproduction method is an integral method.

6. A 3D image display device that displays 3D images using a ray reproduction method by using depth synthesis technology and viewpoint tracking technology, a first stereoscopic display of a ray reproduction type disposed in front of a viewer and displaying a first elemental image; a second stereoscopic display of a ray reproduction type, which is disposed perpendicular to the first stereoscopic display, has a wider viewing zone than the first stereoscopic display, and displays a second element image generated in advance; a half mirror disposed in front of the first stereoscopic display so as to be oblique to the first stereoscopic display; a computing device, the second three-dimensional display is spaced from the half mirror by a depth reproduction range corresponding to a Nyquist frequency or a viewing spatial frequency of the first three-dimensional display, The computing device a viewpoint position detection unit for detecting a viewpoint position of the observer; a first element image generating unit that generates the first element image at a predetermined viewing distance so as to follow the viewpoint position, The three-dimensional image display device, wherein the first elemental image generation unit generates the first elemental image so that the spatial frequency of the three-dimensional image is continuous at the Nyquist frequency or the visual spatial frequency.

7. 7. The three-dimensional video display device according to claim 6, wherein the first elemental image generating unit generates the first elemental image within a depth reproduction range on the front side from a preset boundary position.

8. 8. The three-dimensional image display device according to claim 7, wherein the light reproduction method is an integral method.

Images