Imaging device

The imaging device addresses the challenges of omnidirectional stereo imaging by optimizing the arrangement and distance ratios of optical systems at polygon vertices, achieving high-quality 360-degree stereo imaging with improved depth perception and reduced stitching issues.

JP2026115299APending Publication Date: 2026-07-09CANON KK
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
JP2024231914
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2024-12-27
Publication Date
2026-07-09

Smart Images

  • Figure 2026115299000001_ABST
    Figure 2026115299000001_ABST
Patent Text Reader

Abstract

To provide an imaging device capable of performing good 360° stereo imaging. [Solution] The imaging device is arranged such that a first pair of optical systems, consisting of a first optical system Rj and a second optical system Lj, is located at each vertex of a polygon with five or more sides. When the distance between the vertices of the optical surfaces closest to the object in each of the first and second optical systems forming a second pair of first and second optical systems for stereo imaging in a combination different from the first pair is denoted as IPD, and the distance between the vertices of the optical surfaces closest to the object in each of the first optical systems or second optical systems in two adjacent first pairs of optical systems in the circumferential direction of the polygon is denoted as NPD, the condition 0.01 ≤ NPD / IPD ≤ 0.70 is satisfied.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to an imaging device capable of omnidirectional stereo imaging.

Background Art

[0002] Patent Document 1 discloses an imaging device that performs omnidirectional stereo imaging by arranging a pair of cameras composed of a right-eye camera and a left-eye camera arranged in parallel so as to face each other in different directions along a circle. Each pair of cameras can perform stereo imaging that reproduces the binocular parallax of a person. In such an imaging device, a plurality of images obtained by a plurality of right-eye cameras and a plurality of images obtained by a plurality of left-eye cameras are respectively joined together by stitching processing to generate an omnidirectional panoramic image capable of stereo viewing.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] There is a need for an imaging device that can perform omnidirectional stereo imaging better than before.

Means for Solving the Problems

[0005] An imaging device as one aspect of the present invention is an imaging device in which a first pair of optical systems, consisting of a first optical system and a second optical system, are arranged so as to be located at each of the vertices of a polygon with five or more sides. When the distance between the vertices (or nodal points) of the optical surfaces closest to the object in each of the first and second optical systems forming a second pair of first optical systems for stereo imaging in a combination different from the first pair is defined as IPD, and the distance between the vertices of the optical surfaces closest to the object in each of the first optical systems or second optical systems in two adjacent first pairs of optical systems in the circumferential direction of the polygon is defined as NPD, 0.01 ≤ NPD / IPD ≤ 0.70 It is characterized by satisfying the following conditions. [Effects of the Invention]

[0006] According to the present invention, it is possible to provide an imaging device that can perform good 360-degree stereo imaging. [Brief explanation of the drawing]

[0007] [Figure 1] Schematic diagrams of the optical systems of the imaging devices in Examples 1 to 10. [Figure 2] Schematic diagram of the first pair of optical systems of the imaging devices of Examples 1 to 10. [Figure 3] Another schematic diagram of the first pair of optical systems. [Figure 4] A diagram showing the arrangement of the optical system in the imaging apparatus of Examples 1 to 3. [Figure 5] A diagram showing the arrangement of the optical system in the imaging apparatus of Examples 4 and 5. [Figure 6] A diagram showing the arrangement of the optical system in the imaging device of Example 6. [Figure 7] A diagram showing the arrangement of the optical system in the imaging device of Example 7. [Figure 8] A diagram showing the arrangement of the optical system in the imaging device of Example 8. [Figure 9] A diagram showing the arrangement of the optical system in the imaging device of Example 9. [Figure 10] A diagram showing the arrangement of the optical system in the imaging device of Example 10. [Figure 11] Cross-sectional view of the optical system of Numerical Example 1. [Figure 12] Aberration diagram of the optical system of Numerical Example 1. [Figure 13] Cross-sectional view of the optical system of Numerical Example 2. [Figure 14] Aberration diagram of the optical system of Numerical Example 2.

Embodiments for Carrying out the Invention

[0008] Hereinafter, embodiments of the present invention will be described with reference to the drawings. In the following description, the X direction and the Z direction are represented on the drawing, and the direction orthogonal to the X direction and the Z direction (the direction perpendicular to the paper surface of the drawing) is represented as the Y direction.

[0009] FIG. 1 shows the basic configuration (XZ cross-section) of the optical system 101 used in the imaging devices of Examples 1 to 10. The X direction is the direction in which the optical axis AX of the optical system 101 extends (the optical axis direction), the Y direction is the horizontal direction, and the Z direction is the vertical direction. The optical system 101 has a horizontal viewing angle HFOV and a vertical viewing angle VFOV (not shown). The optical axis AX passes through the vertex of the optical surface (lens surface) on the most object side of the optical system 101 (hereinafter simply referred to as the vertex of the most object side surface) and is orthogonal to the image plane of the optical system 101. On the image plane, the imaging surface of the imaging device 102 is arranged.

[0010] The imaging device of each embodiment includes five (5 pairs) or more first pairs of optical systems each consisting of a right-eye optical system as a first optical system and a left-eye optical system as a second optical system, which are configured by the optical system 101 shown in FIG. 1. These five or more first pairs of optical systems are respectively arranged at the vertices of a polygon having five or more sides, as will be described later with reference to the drawings. Specifically, the vertices of the lens surfaces on the most object side of all the first optical systems, the vertices of the lens surfaces on the most object side of all the second optical systems, the nodal points (no-parallax points) of all the first optical systems or the nodal points of all the second optical systems are arranged at the vertices of a polygon having five or more sides. An imaging device having a plurality of optical systems 101 arranged in this way performs 360° full-round stereoscopic imaging around the center of the polygon.

[0011] Note that each optical system 101 may be referred to as an imaging device (camera), and the first pair of optical systems 101 may be referred to as the first pair of imaging devices. Even in this case, an imaging system including a plurality of first pairs of imaging devices corresponds to the "imaging device" described in each embodiment.

[0012] In the optical system 101 shown in FIG. 1, La is the distance on the optical axis from the vertex of the lens surface closest to the object side to the image plane, and represents the overall optical length of the optical system 101.

[0013] FIG. 2 and FIG. 3 respectively show the arrangements of the right-eye optical system 101R and the left-eye optical system 101L4 in the first pair of optical systems 103 as the first example and the first pair of optical systems 104 as the second example. The right-eye optical system 101R and the left-eye optical system 101L are arranged such that their optical axes AX form an angle θ with each other. The angle θ is the angle measured counterclockwise from the optical axis AX of the left-eye optical system 101L to the light-emitting axis AX of the right-eye optical system 101R. The angle θ may be 180° as shown in FIG. 2 or less than 180° as shown in FIG. 3, and preferably satisfies the condition of the following formula (2). Also, let the distance between the vertices of the surfaces closest to the object side of the first pair of right-eye optical systems 101R and left-eye optical systems 101L be Lb.

[0014] FIG. 4, FIG. 5, FIG. 6, FIG. 7, FIG. 8, FIG. 9, and FIG. 10 respectively show the arrangements of five or more first pairs of optical systems in Embodiments 1 to 10. In each figure, when j is the order (1, 2, 3,...) counted in the clockwise direction, the right-eye optical system is denoted as Rj and the left-eye optical system is denoted as Lj. The first pair of optical systems is a pair of the right-eye optical system Rj and the left-eye optical system Lj with the same j.

[0015] As described above, five or more first pairs of optical systems are arranged at the vertices of a pentagon or more polygon. In other words, the lines connecting the vertices of the surfaces closest to the object side of five or more right-eye optical systems 101Rj and the lines connecting the vertices of the surfaces closest to the object side of five or more left-eye optical systems 101Lj are arranged such that they each form a pentagon or more polygon. FIG. 4 shows an example in which five pairs of first pairs of optical systems are arranged at the vertices of a pentagon, and the other figures show that N pairs of first pairs of optical systems are arranged at the vertices of an N-sided polygon.

[0016] Furthermore, the imaging device in each embodiment acquires an image that has parallax between the two and allows for stereoscopic viewing (a parallax image consisting of a right-eye image and a left-eye image) by imaging with a second pair of right-eye optical systems and left-eye optical systems in a different combination than the first pair. In the following description, the second pair will also be referred to as a stereo pair. If N pairs of the first pair of optical systems are arranged, the number of stereo pairs will also be N.

[0017] The distance IPD shown in Figures 4 to 10 is the distance between the vertices of the surfaces closest to the object in the right-eye and left-eye optical systems of a stereo pair, and is also called the baseline length. To enable good stereoscopic viewing of disparity images, the distance IPD is preferably set in the range of approximately 50 to 80 mm, corresponding to the approximately 65 mm distance between human eyes. However, to enhance the sense of depth for distant objects, the distance IPD may be set to 100 mm or 150 mm, etc. Thus, the distance IPD should be set according to the object being primarily imaged.

[0018] The distance NPD shown in Figures 4 to 10 is the distance between the object-side vertices of the right-eye optical systems or left-eye optical systems in two adjacent (i.e., closest) first pairs of optical systems in the circumferential direction of the polygon. To obtain a panoramic right-eye image and a panoramic left-eye image of the entire circumference, the imaging device stitches together multiple right-eye images acquired by all right-eye optical systems and multiple left-eye images acquired by all left-eye optical systems. In this case, if the distance NPD is too large, the parallax between the two images stitched together will become too large, resulting in mismatch at the seam, or requiring complex stitching to reduce this mismatch.

[0019] The distance NPD is uniquely determined by the distance (baseline length) IPD of each stereo pair, the distance Lb in each first pair of optical systems, and the arrangement of five or more first pairs of optical systems. Furthermore, it is preferable that the imaging device of each embodiment satisfies the conditions of the following equation (1).

[0020] 0.01 ≤ NPD / IPD ≤ 0.70 (1) The conditions in equation (1) indicate an appropriate relationship between the baseline length of the stereo pair and the distance between the two optical systems used to acquire the two images stitched together. Figures 4 to 10 show the IPD and NPD based on one representative first pair of optical systems (left eye optical system L1), but if N pairs of first pairs of optical systems are arranged, the IPD can be measured at N locations and the NPD can be measured at 2 × N locations. It is preferable that all IPD and NPD satisfy equation (1).

[0021] If the NPD / IPD ratio exceeds the upper limit of equation (1), the parallax between the two optical systems used to acquire the image stitched together when sufficient baseline length is ensured for the stereo pair becomes too large, leading to the aforementioned stitching problems. Furthermore, it becomes impossible to ensure sufficient baseline length for the stereo pair in order to perform good stitching, resulting in a loss of the sense of depth experienced by the viewer. In addition, for the NPD / IPD ratio not to exceed the upper limit of equation (1), the number of optical systems in the first pair must be five or more. In the case of four pairs, the NPD / IPD value must be at least 0.71 or higher.

[0022] On the other hand, if NPD / IPD falls below the lower limit of equation (1), the number of first-pair optical systems becomes very large, resulting in an enormous number of images to be stitched, making stitching difficult. For example, if NPD / IPD falls below 0.10, the required number of first-pair optical systems becomes 32 or more.

[0023] Furthermore, it is more preferable to set the lower limit of formula (1) to 0.05, 0.10, 0.15, 0.20, or 0.25, and the upper limit of formula (1) to 0.69 or 0.65.

[0024] Furthermore, in equation (1), the IPD and NPD are defined as the vertices of the faces closest to the object in the two optical systems, but they may be replaced with nodal points (no-parallax points). That is, the IPD may be the distance between the nodal points of the right-eye optical system and the left-eye optical system of a stereo pair, and the NPD may be the distance between the nodal points of the right-eye optical systems or the left-eye optical systems of two adjacent first pairs of optical systems in the circumferential direction of the polygon. The vertices of the faces closest to the object in the optical systems and the nodal points may coincide, or there may be a difference between them.

[0025] By satisfying the above configuration and the conditions of equation (1), it is possible to ensure sufficient baseline length for the stereo pair while performing good stitching.

[0026] In each embodiment, the angle θ between the optical axes of the first pair of right-eye optical systems and left-eye optical systems described above preferably satisfies the condition of equation (2) below.

[0027] 100° < θ < 270° (2) If θ exceeds the upper limit of equation (2), both the right-eye and left-eye optical systems of the first pair will be used to image the area inside the imaging device. This area inside the imaging device becomes an extra imaging area in 360-degree stereo imaging. Such an extra imaging area increases the horizontal field of view (HFOV) required per optical system in 360-degree stereo imaging. For example, if the number of the first pair is N=5 and θ=270°, then an HFOV of at least 200° is required. A larger required HFOV reduces the number of pixels acquired by the image sensor per 1° of HFOV, decreasing the angular resolution, which is an indicator of resolution. For this reason, it is preferable that θ is less than 270°.

[0028] On the one hand, when θ is below the lower limit of Equation (2), the horizontal visual fields of the first pair of right and left optical systems overlap with each other. There is almost no parallax in imaging in these overlapping horizontal visual fields, which becomes unnecessary imaging in all-around stereo imaging. For example, when θ = 100° when N = 5, an overlap of approximately 8° occurs in the horizontal visual field between the first pair of right and left optical systems. Therefore, θ is preferably greater than 100°.

[0029] It is more preferable that the lower limit of Equation (2) is 110° or 120°, and it is more preferable that the upper limit of Equation (2) is 260°, 250° or 200°.

[0030] Also, in each embodiment, it is preferable that one or more first pairs of optical systems are arranged between the right and left optical systems of the stereo pair. For example, in FIG. 4, the number of the first pair of optical systems arranged between the stereo pairs in the circumferential direction of the polygon is one, and Q = 1. Q preferably satisfies the condition of the following Equation (3) using the [ ] of the Gaussian symbol.

[0031] Q ≤ [N / 2] - 1 (3) In Equation (3), for all N, Q is preferably 1 or more. This is because when Q = 0, IPD < NPD, and for all N, the angle θ exceeds the upper limit of Equation (1).

[0032] Furthermore, when Q = [N / 2] - 1, it is preferable that N is an odd number. When N is an even number when Q = [N / 2] - 1, one left-eye optical system and the other right-eye optical system of the two first pairs of optical systems located on the longest diagonal of the polygon form a stereo pair. For example, in the case of N=6 and Q=2 shown in Figure 6, the stereo pair is the left-eye optical system L1 and the right-eye optical system R4. In this case, when a stereoscopic image of the same imaging area is acquired with the left-eye optical system L1 and the right-eye optical system R4, the right-eye optical system R2 and the left-eye optical system L3 are reflected in the stereoscopic image. That is, if there are six right-eye optical systems and six left-eye optical systems forming the first pair in the imaging device, then a horizontal field of view of 360 / 6 = 60° is required for each optical system to generate a horizontal 360° panoramic right-eye image and a panoramic left-eye image. At this time, because it coincides with one side of the hexagon at one end of the horizontal field of view of the left eye optical system L1, a portion of the right eye optical system R2 is reflected in the panoramic left eye image acquired by the left eye optical system L1. Such reflections necessitate stitching that avoids the imaging area where the reflection occurs, making the stitching process more complex. For this reason, when Q = [N / 2] - 1, it is preferable that N is an odd number.

[0033] Furthermore, in each embodiment, when R is the distance between the centroid P of the polygon and the midpoint M between the vertices of the faces closest to the object, respectively, of the right-eye optical system and the left-eye optical system of the stereo pair, it is preferable that the following condition of equation (4) is satisfied.

[0034] 0.05≦R·2tan(3π / 2N) / IPD<1.00 (4) The distance R can be set arbitrarily within the range where the condition of equation (1) is satisfied.

[0035] If R·2tan(3π / 2N) / IPD exceeds the upper limit of equation (4), the number of first pairs of optical systems required to satisfy the conditions of equation (1) becomes very large, which is undesirable because it increases the number of images to be stitched. If R·2tan(3π / 2N) / IPD falls below the lower limit of equation (4), the aforementioned distance Lb becomes very small, which is undesirable because it becomes difficult to secure space for the required number of first pairs of optical systems.

[0036] Furthermore, it is more preferable to set the lower limit of formula (4) to 0.10, 0.15, or 1.16, and the upper limit of formula (4) to 0.97 or 0.95.

[0037] In each embodiment, Lc is defined as the distance between the vertices of the face closest to the object of the first and second optical systems (for example, the right eye optical system R1 and the left eye optical system L5 in Figure 4) that are closest to each other in the circumferential direction of the polygon without forming a first pair. At this time, it is desirable that the following condition of equation (5) is satisfied.

[0038] 0.10 ≤ Lb / Lc ≤ 1.00 (5) If Lb / Lc exceeds the upper limit of equation (5), it is undesirable because the number of first pairs of optical systems required to satisfy the conditions of equation (1) becomes very large, increasing the number of images to be stitched. If Lb / Lc falls below the lower limit of equation (5), it is undesirable because the distance Lb becomes very small, making it difficult to secure space for the required number of first pairs of optical systems.

[0039] Furthermore, it is more preferable to set the lower limit of formula (5) to 0.15, 0.20, or 0.50, and the upper limit of formula (5) to 0.95 or 0.90.

[0040] In each embodiment, it is preferable that the angle of view (vertical field of view VFOV) in the vertical direction perpendicular to the plane containing the polygon of at least one of the first pair of right-eye optical systems and left-eye optical systems is 150° or more.

[0041] This means that if the vertical field of view (VFOV) is 150° or more, a wide imaging area can be covered in the vertical direction. In particular, when using 360° stereo images for applications such as VR (Virtual Reality), displaying an image with a wide display range in the vertical direction allows for a more immersive viewing experience of stereoscopic images. If the VFOV is less than 150°, the display range in the vertical direction of the stereoscopic image becomes narrower, and the sense of immersion decreases. When stitching the bottom and top of the 360° stereo image, it is preferable that the VFOV be 180° or more, and even 190° or more. Alternatively, the VFOV of the parts excluding the bottom and top may be 180° or more, and the VFOV of the bottom and top where the support members for the imaging device are located may be 150° or more.

[0042] Furthermore, it is preferable that the horizontal field of view (horizontal field of view HFOV) in a direction parallel to the plane containing the polygon of at least one of the first pair of right-eye optical systems and left-eye optical systems is 100° or more.

[0043] This allows for coverage of the imaging area in 360° panoramic imaging. If the HFOV field is smaller than 100°, it becomes difficult to obtain a sufficient field of view to generate a panoramic stereo image, and there is a high risk that the images stitched together will not connect smoothly, which is undesirable. An HFOV of 110° or more, and even more preferably 120° or more, is preferable.

[0044] In each embodiment, it is preferable that the following condition of formula (8) is satisfied.

[0045] 40.0mm ≤ IPD ≤ 150.0mm (8) The conditions in equation (8) indicate the appropriate baseline length range for a stereo pair optical system to obtain good stereoscopic images. If the IPD exceeds the upper limit of equation (8), it is undesirable because the parallax becomes too large, especially for near objects, making it difficult for the viewer to fuse near objects or preventing them from being seen with natural stereoscopic vision. If the IPD falls below the lower limit of equation (8), it is undesirable because it becomes difficult to obtain sufficient stereoscopic vision even for near objects.

[0046] Furthermore, it is more preferable to set the lower limit of formula (8) to 45.0 mm, 50.0 mm, or 60 mm, and the upper limit of formula (8) to 100.0 mm, 90.0 mm, or 85 mm.

[0047] In each embodiment, it is preferable that the following condition of formula (9) is satisfied.

[0048] 0.01 ≤ La / IPD ≤ 0.25 (9) The conditions in equation (9) indicate an appropriate relationship between the total optical length La of the right and left eye optics and the baseline length. If La / IPD exceeds the upper limit of equation (9), the optics will be visible in the 360-degree stereo imaging, which is undesirable. If La / IPD falls below the lower limit of equation (9), the total optical length of the optics becomes very small, reducing the degree of freedom in optical design, which is also undesirable. Furthermore, if the IPD becomes very large, the parallax for near objects increases, making it difficult for the viewer to fuse near objects or preventing them from seeing near objects with a natural sense of depth, which is also undesirable.

[0049] Furthermore, it is more preferable to set the lower limit of formula (9) to 0.03 or 0.05, and the upper limit of formula (9) to 0.23, 0.20, or 0.15.

[0050] Examples 1 to 10 will be described in detail below. Following the description of Example 10, numerical examples 1 and 2 of the optical system 101 are shown. [Examples]

[0051] The imaging device of Example 1 has a configuration in which five pairs of first pairs of optical systems are arranged at each vertex of a pentagon, as shown in Figure 4. The optical systems shown in Numerical Example 1 are used for the right and left eye optical systems in this embodiment. The vertical and horizontal fields of view of the optical system in Numerical Example 1 are 180°, and the total optical length is 7.95 mm.

[0052] In each first pair of optical systems, the angle θ between the optical axes AX of the right and left eye systems is 180°, and the distance Lb is 20.00 mm.

[0053] The five stereo pairs in this embodiment are L1 and R3, L2 and R4, L3 and R5, L4 and R1, and L5 and R2. All of these stereo pairs have equal IPD and Q=1. The third pair of optical systems (hereinafter referred to as the stitch pair) that acquires two images to be stitched together is L1 and L2, L2 and L3, L3 and L4, L4 and L5, L5 and L1, R1 and R2, R2 and R3, R3 and R4, R4 and R5, and R5 and R1. All of these stitch pairs have equal NPD. The IPD is 70.0 mm and the NPD is 48.5 mm.

[0054] Furthermore, the two optical systems separated by distance Lc (the fourth pair; hereafter referred to as the close-proximity pair) are L1 and R2, L2 and R3, L3 and R4, L4 and R5, and L5 and R1. In all of these close-proximity pairs, Lc is equal. Lc is 30.90 mm. [Examples]

[0055] The imaging device of Example 2 has a configuration in which five pairs of first optical systems are arranged at each vertex of a pentagon, as shown in Figure 4. The optical systems shown in Numerical Example 1 are used for the right and left eye optical systems in this example.

[0056] In each first pair of optical systems, the angle θ between the optical axes AX of the right and left eye systems is 140°, and the distance Lb is 18.79 mm.

[0057] The stereo pair, stitched pair, and adjacent pair in this embodiment are the same as in Embodiment 1. In this embodiment, the IPD is 70.0 mm and the NPD is 48.1 mm. The Lc is 31.65 mm. [Examples]

[0058] The imaging device of Embodiment 3 has a configuration in which five pairs of first optical systems are arranged at each vertex of a pentagon, as shown in Figure 4. The optical systems shown in Numerical Example 1 are used for the right and left eye optical systems in this embodiment.

[0059] In each first pair of optical systems, the angle θ between the optical axes AX of the right and left eye systems is 125°, and the distance Lb is 17.74 mm.

[0060] The stereo pair, stitched pair, and adjacent pair in this embodiment are the same as in Embodiment 1. In this embodiment, the IPD is 70.0 mm and the NPD is 47.8 mm. The Lc is 32.30 mm. [Examples]

[0061] The imaging device of Embodiment 4 has a configuration in which six pairs of first optical systems are arranged at each vertex of a hexagon, as shown in Figure 5. The optical systems shown in Numerical Example 1 are used for the right and left eye optical systems in this embodiment.

[0062] In each first pair of optical systems, the angle θ between the optical axes AX of the right and left eye systems is 180°, and the distance Lb is 20.00 mm.

[0063] The six stereo pairs in this embodiment are L1 and R3, L2 and R4, L3 and R5, L4 and R6, L5 and R1, and L6 and R2. All of these stereo pairs have equal IPD and Q=1. The stitch pairs are L1 and L2, L2 and L3, L3 and L4, L4 and L5, L5 and L6, L6 and L1, R1 and R2, R2 and R3, R3 and R4, R4 and R5, R5 and R6, and R6 and R1. All of these stitch pairs have equal NPD. The IPD is 70.0 mm and the NPD is 47.3 mm.

[0064] Furthermore, the closest pairs are L1 and R2, L2 and R3, L3 and R4, L4 and R5, L5 and R6, and L6 and R1. In all of these closest pairs, Lc is equal. Lc is 28.87 mm. [Examples]

[0065] The imaging device of Example 5 has a configuration in which six pairs of first optical systems are arranged at each vertex of a hexagon, as shown in Figure 5. The optical systems shown in Numerical Example 1 are used for the right and left eye optical systems in this example.

[0066] In each first pair of optical systems, the angle θ between the optical axes AX of the right and left eye systems is 125°, and the distance Lb is 17.74 mm.

[0067] The stereo pair, stitched pair, and proximity pair in this embodiment are the same as in Embodiment 4. In this embodiment, the IPD is 70.0 mm and the NPD is 46.4 mm. The Lc is 30.17 mm. [Examples]

[0068] The imaging device of Embodiment 6 has a configuration in which six pairs of first optical systems are arranged at each vertex of a hexagon, as shown in Figure 6. The optical systems shown in Numerical Example 1 are used for the right and left eye optical systems in this embodiment.

[0069] In each first pair of optical systems, the angle θ between the optical axes AX of the right and left eye systems is 150°, and the distance Lb is 19.32 mm.

[0070] In this embodiment, the stereo pairs are L1 and R4, L2 and R5, L3 and R6, L4 and R1, L5 and R2, and L6 and R3, and the IPD of all these stereo pairs is equal, and Q=2. The stitch pairs are L1 and L2, L2 and L3, L3 and L4, L4 and L5, L5 and L6, L6 and L1, R1 and R2, R2 and R3, R3 and R4, R4 and R5, R5 and R6, and R6 and R1. The NPD of all these stitch pairs is equal. The IPD is 70.0 mm and the NPD is 38.8 mm.

[0071] Furthermore, the closest pairs are L1 and R2, L2 and R3, L3 and R4, L4 and R5, L5 and R6, and L6 and R1. The Lc of all these closest pairs is equal. The Lc is 20.86 mm. [Examples]

[0072] The imaging device of Embodiment 7 has a configuration in which eight pairs of first optical systems are arranged at each vertex of an octagon, as shown in Figure 7. The optical systems shown in Numerical Example 1 are used for the right and left eye optical systems in this embodiment.

[0073] In each first pair of optical systems, the angle θ between the optical axes AX of the right and left eye systems is 180°, and the distance Lb is 20.00 mm.

[0074] In this embodiment, the stereo pairs are L1 and R3, L2 and R4, L3 and R5, L4 and R6, L5 and R7, L6 and R8, L7 and R1, and L8 and R2. The IPD of all these stereo pairs is equal, and Q=1. The stitch pairs are L1 and L2, L2 and L3, L3 and L4, L4 and L5, L5 and L6, L6 and L7, L7 and L8, L8 and L1, R1 and R2, R2 and R3, R3 and R4, R4 and R5, R5 and R6, R6 and R7, R7 and R8, and R8 and R1. The NPD of all these stitch pairs is equal. The IPD is 70.0 mm and the NPD is 46.2 mm.

[0075] Furthermore, the closest pairs are L1 and R2, L2 and R3, L3 and R4, L4 and R5, L5 and R6, L6 and R7, L7 and R8, and L8 and R1. The Lc of all these closest pairs is equal. The Lc is 27.06 mm. [Examples]

[0076] The imaging device of Embodiment 8 has a configuration in which eight pairs of first optical systems are arranged at each vertex of an octagon, as shown in Figure 8. The optical systems shown in Numerical Example 2 are used for the right and left eye optical systems in this embodiment.

[0077] In each first pair of optical systems, the angle θ between the optical axes AX of the right and left eye systems is 180°, and the distance Lb is 14.00 mm.

[0078] In this embodiment, the stereo pairs are L1 and R4, L2 and R5, L3 and R6, L4 and R7, L5 and R8, L6 and R1, L7 and R2, and L8 and R3. All of these stereo pairs have equal IPD and Q=2. The stitch pairs are L1 and L2, L2 and L3, L3 and L4, L4 and L5, L5 and L6, L6 and L7, L7 and L8, L8 and L1, R1 and R2, R2 and R3, R3 and R4, R4 and R5, R5 and R6, R6 and R7, R7 and R8, and R8 and R1. All of these stitch pairs have equal NPD. The IPD is 80.0 mm and the NPD is 435.8 mm.

[0079] Furthermore, the closest pairs are L1 and R2, L2 and R3, L3 and R4, L4 and R5, L5 and R6, L6 and R7, L7 and R8, and L8 and R1. The Lc of all these closest pairs is equal. The Lc is 22.42 mm. [Examples]

[0080] The imaging device of Embodiment 9 has a configuration in which 12 pairs of first optical systems are arranged at each vertex of a dodecagon, as shown in Figure 9. The optical systems shown in Numerical Example 1 are used for the right and left eye optical systems in this embodiment.

[0081] In each first pair of optical systems, the angle θ between the optical axes AX of the right and left eye systems is 180°, and the distance Lb is 20.00 mm.

[0082] In this embodiment, the stereo pairs are L1 and R3, L2 and R4, L3 and R5, L4 and R6, L5 and R7, L6 and R8, L7 and R9, L8 and R10, L9 and R11, L10 and R12, L11 and R1, and L12–R3. The IPD of all these stereo pairs is equal, and Q=1. The stitch pairs are L1 and L2, L2 and L3, L3 and L4, L4 and L5, L5 and L6, L6 and L7, L7 and L8, L8 and L9, L9 and L10, L10 and L11, L11 and L12, L12 and L1, R1 and R2, R2 and R3, R3 and R4, R4 and R5, R5 and R6, R6 and R7, R7 and R8, R8 and R9, R9 and R10, R10 and R11, R11 and R12, and R12 and R1. The NPDs in all of these stitch pairs are equal. The IPD is 80.0 mm and the NPD is 50.6 mm.

[0083] Furthermore, the closest pairs are L1 and R2, L2 and R3, L3 and R4, L4 and R5, L5 and R6, L6 and R7, L7 and R8, L8 and R9, L9 and R10, L10 and R11, L11 and R12, and L12 and R1. The Lc of all these closest pairs is equal. The Lc is 31.06 mm. [Examples]

[0084] The imaging device of Example 10 has a configuration in which 12 pairs of first optical systems are arranged at each vertex of a dodecagon, as shown in Figure 10. The optical systems shown in Numerical Example 2 are used for the right and left eye optical systems in this example.

[0085] In each first pair of optical systems, the angle θ between the optical axes AX of the right and left eye systems is 125°, and the distance Lb is 10.64 mm.

[0086] In this embodiment, the stereo pairs are L1 and R3, L2 and R4, L3 and R5, L4 and R6, L5 and R7, L6 and R8, L7 and R9, L8 and R10, L9 and R11, L10 and R12, L11 and R1, and L12 and R3. The IPD of all these stereo pairs is equal, and Q=4. The stitch pairs are L1 and L2, L2 and L3, L3 and L4, L4 and L5, L5 and L6, L6 and L7, L7 and L8, L8 and L9, L9 and L10, L10 and L11, L11 and L12, L12 and L1, R1 and R2, R2 and R3, R3 and R4, R4 and R5, R5 and R6, R6 and R7, R7 and R8, R8 and R9, R9 and R10, R10 and R11, R11 and R12, and R12 and R1. The NPDs in all of these stitch pairs are equal. The IPD is 80.0 mm and the NPD is 22.3 mm.

[0087] Furthermore, the closest pairs are L1 and R2, L2 and R3, L3 and R4, L4 and R5, L5 and R6, L6 and R7, L7 and R8, L8 and R9, L9 and R10, L10 and R11, L11 and R12, and L12 and R1. The Lc of all these closest pairs is equal. The Lc is 11.89 mm.

[0088] In Examples 1 to 10, imaging devices capable of 360° stereo imaging were shown having 5, 6, 8, and 12 pairs of the first optical system, but the number of the first optical system is not limited to these.

[0089] The numerical values ​​for Examples 1 to 10 and the conditions described above are summarized in Table 1 below.

[0090] [Table 1]

[0091] Figures 11 and 13 show the optical system configurations for numerical example 1 and numerical example 2, respectively. In these figures, the left side is the object side and the right side is the image side. SP indicates the aperture diaphragm, and IP indicates the image plane. GB indicates an optical block corresponding to an optical filter, faceplate, low-pass filter, or infrared cut filter, etc.

[0092] The optical system in each numerical example consists of seven lenses. To shorten the overall optical length and reduce reflections from each lens, it is preferable that the optical system consists of seven or fewer lenses. Specifically, the optical system in each numerical example consists of two convex meniscus lenses on the object side, two positive lenses, a negative lens, a positive lens, and a negative lens, arranged in order from the object side to the image side. The use of two meniscus lenses facilitates widening the angle of view and correcting various aberrations such as field curvature. The aperture diaphragm SP is positioned between the two positive lenses, and the optical system has a symmetrical optical configuration with respect to the aperture diaphragm SP. This makes it easier to correct off-axis aberrations and ensure sufficient peripheral illumination.

[0093] Figures 12 and 14 show the longitudinal aberrations (spherical aberration, astigmatism, distortion, and chromatic aberration) of the optical systems for numerical example 1 and numerical example 2, respectively. In the spherical aberration diagram, Fno indicates the F number, the solid line shows the spherical aberration at the d line (wavelength 587.6 nm), and the dashed line shows the spherical aberration at the g line (wavelength 435.8 nm). In the astigmatism diagram, the solid line ΔS shows the astigmatism at the sagittal image plane, and the dashed line ΔM shows the astigmatism at the meridional image plane. The distortion diagram shows the distortion at the d line. The chromatic aberration diagram shows the lateral chromatic aberration at the g line. ω is the half-angle of view (°).

[0094] The specific numerical data for numerical examples 1 and 2 are shown below. The surface number i indicates the order of the surfaces when counted from the object side. r is the radius of curvature (mm) of the i-th surface from the object side, d is the lens thickness or air gap (mm) on the optical axis between the i-th and (i+1)-th surfaces, and nd is the refractive index of the optical material at the d-line between the i-th and (i+1)-th surfaces. νd is the Abbe number with respect to the d-line of the optical material between the i-th and (i+1)-th surfaces.

[0095] The Abbe number νd, with respect to the d line, is expressed as νd = (Nd-1) / (NF-NC), where Nd, NF, and NC are the refractive indices of the Fraunhofer lines d (587.6 nm), F (486.1 nm), and C (656.3 nm), respectively.

[0096] In each numerical example, d, focal length f (mm), F-number, and half-angle of view (°) are all values ​​when the optical system is focused on an object at infinity. BF represents the back focus (mm). The back focus is the distance along the optical axis from the image-side lens surface (final surface) of the optical system to the paraxial image plane, expressed in terms of air-equivalent length. The optical block GB surface is not included as the final surface. The total lens length is the distance along the optical axis from the object-side lens surface (frontmost surface) of the optical system to the final surface plus the back focus, and corresponds to the total optical length La.

[0097] The total optical length La and the focal length f of the entire optical system preferably satisfy the following condition (10).

[0098] 2.0 ≤ La / f ≤ 5.5 (10) If La / f falls below the lower limit of equation (10), the total optical length La becomes too short, making it difficult to correct various aberrations such as spherical aberration, coma aberration, and field curvature, which is undesirable. If La / f exceeds the upper limit of equation (10), the total optical length La becomes too long, making it difficult to minimize reflections from each lens, which is also undesirable. In numerical example 1, La=7.95mm and f=2.49, so La / f=3.19. In numerical example 2, La=4.97mm and f=1.55, so La / f=3.21.

[0099] Furthermore, in the surface data for each numerical example, the "*" appended to the surface number indicates that the surface has an aspherical shape. The aspherical shape is expressed by the following formula, where x is the displacement from the surface vertex in the optical axis direction, h is the height from the optical axis in the direction perpendicular to the optical axis, the direction of light propagation is positive, R is the radius of paraxial curvature, K is the cone constant, and A4, A6, and A8 are aspherical coefficients. The "e±x" of the cone constant and aspherical coefficients is ×10 ±x This means x=( h 2 / R) / [1+{1-(1+k)(h / R) 2} 1 / 2 ] +A4·h 4 +A6·h 6+A8·h 8 [Numerical Example 1] Unit: mm Surface data Face number rd nd νd 1 16.518 0.55 1.53504 55.7 2* 1.708 1.29 3* 3.268 0.64 1.68040 18.1 4* 3.210 0.53 5* 2.009 0.58 1.54450 56.0 6* -5.213 0.05 7 (aperture) ∞ 0.24 8* -12.630 0.50 1.54450 56.0 9* -1.581 0.04 10* -5.212 0.40 1.63277 23.3 11* 4.406 0.46 12* 4.272 0.85 1.53504 55.7 13* -8.825 0.78 14* -1.553 0.40 1.53504 55.7 15* -22.540 0.04 16 ∞ 0.20 1.51633 64.1 17 ∞ 0.40 Image plane ∞ Aspherical data 2nd side K = 2.49324e-02 A 4= 5.12098e-04 A 6= 2.92036e-04 A 8= 7.49998e-04 3rd page K = 3.29902e+00 A 4= 2.73775e-02 A 6= 5.17711e-03 A 8= 1.36676e-03 Side 4 K = 7.38603e+00 A 4= 7.25329e-02 A 6= 1.04584e-02 A 8= 1.81091e-02 Page 5 K =-1.28307e-01 A 4= 2.20358e-02 A 6= 7.40155e-04 A 8=-4.06109e-02 Page 6 K = 1.51271e+00 A 4=-2.55416e-02 A 6=-3.17946e-02 A 8= 4.71462e-03 Page 8 K = 6.24411e+01 A 4=-2.36172e-03 A 6=-5.15184e-02 Page 9 K = 9.25963e-01 A 4= 1.44439e-01 A 6=-2.46036e-01 A 8= 1.34628e-01 Page 10 K = 2.72676e+01 A 4=-5.56691e-02 A 6=-1.06849e-01 A 8=-1.02783e-02 Page 11 K =-9.23750e+01 A 4=-3.61608e-02 A 6= 2.64295e-03 A 8= 2.42555e-03 Page 12 K =-3.91600e+01 A 4=-7.86181e-03 A 6= 2.89901e-03 A 8=-2.40888e-04 Page 13 K = 3.49187e+00 A 4=-3.43225e-03 A 6= 3.40743e-03 A 8=-2.52366e-04 Page 14 K =-9.87255e-01 A 4= 3.86995e-02 A 6=-7.92113e-04 A 8=-6.03662e-05 Page 15 K = 4.27288e+01 A 4=-2.85577e-03 A 6= 5.01753e-05 A 8= 1.25099e-05 Various data Focal length 2.49 F-number 2.80 Half-angle (°): 90.0 Image height 3.89 Lens length 7.95 BF 0.40 [Numerical Example 2] Unit: mm Surface data Face number rd nd vd 1 10.324 0.34 1.53504 55.7 2* 1.067 0.81 3* 2.042 0.40 1.68040 18.1 4* 2.007 0.33 5* 1.255 0.36 1.54450 56.0 6* -3.258 0.03 7 (aperture) ∞ 0.15 8* -7.894 0.31 1.54450 56.0 9* -0.988 0.03 10* -3.257 0.25 1.63277 23.3 11* 2.754 0.29 12* 2.670 0.53 1.53504 55.7 13* -5.516 0.48 14* -0.971 0.25 1.53504 55.7 15* -14.088 0.03 16 ∞ 0.12 1.51633 64.1 17 ∞ 0.25 Image plane ∞ Aspherical data 2nd side K = 2.49324e-02 A 4= 2.09755e-03 A 6= 3.06221e-03 A 8= 2.01326e-02 Page 3 K = 3.29902e+00 A 4= 1.12138e-01 A 6= 5.42859e-02 A 8= 3.66886e-02 Page 4 K = 7.38603e+00 A 4= 2.97095e-01 A 6= 1.09665e-01 A 8= 4.86113e-01 Page 5 K =-1.28307e-01 A 4= 9.02585e-02 A 6= 7.76109e-03 A 8=-1.09014e+00 Page 6 K = 1.51271e+00 A 4=-1.04618e-01 A 6=-3.33390e-01 A 8= 1.26557e-01 Page 8 K = 6.24411e+01 A 4=-9.67360e-03 A 6=-5.40210e-01 Page 9 K = 9.25963e-01 A 4= 5.91622e-01 A 6=-2.57988e+00 A 8= 3.61389e+00 Page 10 K = 2.72676e+01 A 4=-2.28021e-01 A 6=-1.12039e+00 A 8=-2.75907e-01 Page 11 K =-9.23750e+01 A 4=-1.48115e-01 A 6= 2.77134e-02 A 8= 6.51104e-02 Page 12 K =-3.91600e+01 A 4=-3.22020e-02 A 6= 3.03983e-02 A 8=-6.46628e-03 Page 13 K = 3.49187e+00 A 4=-1.40585e-02 A 6= 3.57295e-02 A 8=-6.77439e-03 Side 14 K =-9.87255e-01 A 4= 1.58513e-01 A 6=-8.30590e-03 A 8=-1.62044e-03 Page 15 K = 4.27288e+01 A 4=-1.16972e-02 A 6= 5.26127e-04 A 8= 3.35809e-04 Various data Focal length 1.55 F-number 2.80 Half-angle (°): 90.0 Image height 2.43 Lens length 4.97 BF 0.25 The above embodiments include the following configuration.

[0100] (Composition 1) An imaging device in which a first pair of optical systems, consisting of a first optical system and a second optical system, are arranged so as to be located at each of the vertices of a polygon with five or more sides, When the distance between the vertices of the optical surfaces closest to the object in the first and second optical systems forming a second pair for stereo imaging in a combination different from the first pair is defined as IPD, and the distance between the vertices of the optical surfaces closest to the object in the first optical systems or the second optical systems in two adjacent first pairs of optical systems in the circumferential direction of the polygon is defined as NPD, 0.01 ≤ NPD / IPD ≤ 0.70 An imaging device characterized by satisfying the following conditions. (Configuration 2) When θ is the angle between the optical axes of the first optical system and the second optical system in the first pair, 100° < θ < 270° The imaging apparatus according to configuration 1, characterized by satisfying the following conditions. (Composition 3) The imaging apparatus according to configuration 1 or 2, characterized in that one or more of the first pair of optical systems are arranged between the second pair of the first optical system and the second optical system. (Composition 4) When Q is the number of one or more first pairs of optical systems, N is the total number of all first pairs of optical systems, and the Gaussian symbol is [ ], Q ≤ [N / 2] - 1 The imaging apparatus according to configuration 3, characterized by satisfying the following conditions. (Composition 5) The imaging apparatus according to configuration 4, characterized in that when Q = [N / 2] - 1, N is an odd number. (Composition 6) When R is the distance between the centroid of the polygon and the midpoint between the vertices of the optical surfaces closest to the object in the second pair of the first and second optical systems, 0.05≦R·2tan(3π / 2N) / IPD<1.00 An imaging device according to any one of configurations 1 to 5, characterized by satisfying the following conditions. (Composition 7) When Lb is the distance between the vertices of the optical surfaces closest to the object in the first optical system and the second optical system in the first pair, and Lc is the distance between the vertices of the optical surfaces closest to the object in the first optical system and the second optical system that are closest to each other in the circumferential direction of the polygon, rather than in the first pair, 0.10 ≤ Lc / Lb ≤ 1.00 An imaging device according to any one of configurations 1 to 6, characterized by satisfying the following conditions. (Composition 8) The imaging apparatus according to any one of configurations 1 to 7, characterized in that the angle of view in a direction perpendicular to the plane containing the polygon of at least one of the first optical system and the second optical system in the first pair is 150° or more. (Composition 9) The imaging apparatus according to any one of configurations 1 to 8, characterized in that the angle of view in a direction parallel to the plane containing the polygon of at least one of the first optical system and the second optical system in the first pair is 100° or more. (Composition 10) 40.0mm ≤ IPD ≤ 150.0mm An imaging device according to any one of configurations 1 to 9, characterized by satisfying the following conditions. (Composition 11) When the total optical length of the first and second optical systems is La, 0.01 ≤ La / IPD ≤ 0.25 An imaging device according to any one of configurations 1 to 10, characterized by satisfying the following conditions. (Composition 12) The imaging device is characterized in that the vertices of the lens surfaces closest to the object in all of the first optical systems in the imaging device are located at each of the vertices of the polygon. (Composition 13) The imaging device is characterized in that the vertices of the lens surfaces closest to the object in all of the second optical systems in the imaging device are located at each of the vertices of the polygon, as is the case in any one of configurations 1 to 11. (Composition 14) An imaging device characterized in that all nodal points of the first optical system in the imaging device are located at each of the vertices of the polygon, in any one of configurations 1 to 11. (Composition 15) An imaging device characterized in that all nodal points of the second optical system in the imaging device are located at each of the vertices of the polygon, in any one of configurations 1 to 11. (Composition 12) An imaging device in which a first pair of optical systems, consisting of a first optical system and a second optical system, are arranged so as to be located at each of the vertices of a polygon with five or more sides, When the distance between the nodal points of the first and second optical systems forming a second pair for stereo imaging in a combination different from the first pair is defined as IPD, and the distance between the nodal points of the first optical systems or the second optical systems in two adjacent first pairs of optical systems in the circumferential direction of the polygon is defined as NPD, 0.01 ≤ NPD / IPD ≤ 0.70 An imaging device characterized by satisfying the following conditions.

[0101] The embodiments described above are merely representative examples, and various modifications and changes can be made to each embodiment when implementing the present invention. [Explanation of symbols]

[0102] 100 Optical system R Right eye optical system L Left eye optical system

Claims

1. An imaging device in which a first pair of optical systems, consisting of a first optical system and a second optical system, are arranged so as to be located at each of the vertices of a polygon with five or more sides, When the distance between the vertices of the optical surfaces closest to the object in the first and second optical systems forming a second pair for stereo imaging in a combination different from the first pair is defined as IPD, and the distance between the vertices of the optical surfaces closest to the object in the first optical systems or the second optical systems in two adjacent first pairs of optical systems in the circumferential direction of the polygon is defined as NPD, 0.01 ≤ NPD / IPD ≤ 0.70 An imaging device characterized by satisfying the following conditions.

2. When θ is the angle between the optical axes of the first optical system and the second optical system in the first pair, 100°<θ<270° The imaging apparatus according to claim 1, characterized in that it satisfies the following conditions.

3. The imaging apparatus according to claim 1, characterized in that one or more of the first pair of optical systems are arranged between the second pair of the first optical system and the second optical system.

4. When Q is the number of one or more first pairs of optical systems, N is the total number of all first pairs of optical systems, and the Gaussian symbol is [ ], Q ≤ [N / 2] - 1 The imaging apparatus according to claim 3, characterized in that it satisfies the following conditions.

5. The imaging apparatus according to claim 4, characterized in that when Q = [N / 2] - 1, N is an odd number.

6. When R is the distance between the centroid of the polygon and the midpoint between the vertices of the optical surfaces closest to the object in the second pair of the first and second optical systems, 0.05≦R・2tan(3π / 2N) / IPD<1.00 The imaging apparatus according to claim 1, characterized in that it satisfies the following conditions.

7. When Lb is the distance between the vertices of the optical surfaces closest to the object in the first optical system and the second optical system in the first pair, and Lc is the distance between the vertices of the optical surfaces closest to the object in the first optical system and the second optical system in the circumferential direction of the polygon that are closest to each other, rather than in the first pair, 0.10 ≤ Lc / Lb ≤ 1.00 The imaging apparatus according to claim 1, characterized in that it satisfies the following conditions.

8. The imaging apparatus according to claim 1, characterized in that the angle of view in a direction perpendicular to the plane containing the polygon of at least one of the first optical system and the second optical system in the first pair is 150° or more.

9. The imaging apparatus according to claim 1, characterized in that the angle of view in a direction parallel to the plane containing the polygon of at least one of the first optical system and the second optical system in the first pair is 100° or more.

10. 40.0mm≦IPD≦150.0mm The imaging apparatus according to claim 1, characterized in that it satisfies the following conditions.

11. When the total optical length of the first and second optical systems is La, 0.01 ≤ La / IPD ≤ 0.25 The imaging apparatus according to claim 1, characterized in that it satisfies the following conditions.

12. The imaging device according to claim 1, characterized in that the vertices of the lens surfaces closest to the object in all of the first optical systems in the imaging device are located at the vertices of the polygon.

13. The imaging device according to claim 1, characterized in that the vertices of the lens surfaces closest to the object in all of the second optical systems in the imaging device are located at the vertices of the polygon.

14. The imaging device according to claim 1, characterized in that all nodal points of the first optical system in the imaging device are located at each of the vertices of the polygon.

15. The imaging device according to claim 1, characterized in that all nodal points of the second optical system in the imaging device are located at each of the vertices of the polygon.

16. An imaging device in which a first pair of optical systems, consisting of a first optical system and a second optical system, are arranged so as to be located at each of the vertices of a polygon with five or more sides, When the distance between the nodal points of the first and second optical systems forming a second pair for stereo imaging in a combination different from the first pair is defined as IPD, and the distance between the nodal points of the first optical systems or the second optical systems in two adjacent first pairs of optical systems in the circumferential direction of the polygon is defined as NPD, 0.01 ≤ NPD / IPD ≤ 0.70 An imaging device characterized by satisfying the following conditions.

Citation Information

Patent Citations

  • US10,750,153