Image pickup system
Patent Information
- Authority / Receiving Office
- GB · GB
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2022-06-22
- Publication Date
- 2026-08-10
AI Technical Summary
Existing image pickup systems face challenges in securing a sufficient angle of view and high resolution in peripheral areas using a single optical system, as previous systems either maintain constant imaging magnification or suffer from uneven image sizing of objects in different directions.
An optical system with a first area for a smaller angle of view and a second area for a larger angle of view, where the number of pixels per unit angle of view is higher in the second area, and the optical axis is non-parallel to the horizontal direction, satisfying specific conditions to achieve varying resolution and distortion control.
The system provides a sufficient angle of view and high resolution in peripheral areas, enabling detailed imaging of multiple objects in different directions without the need for multiple optical systems, improving visibility and recognition accuracy.
Smart Images

Figure 00000001_0000 
Figure 00000001_0001 
Figure 00000002_0000
Abstract
Description
SPECIFICATION TITLE OF THE INVENTION: IMAGE PICKUP SYSTEM FIELD OF ART
[0001] The present invention relates to an image pickup system including an image pickup apparatus, such as an on-board camera. BACKGROUND ART
[0002] Some image pickup apparatuses using image sensors are mounted on a movable body such as an automobile and acquire image data around the movable body. By using the acquired image data, an object such as an obstacle around the movable body can be visually recognized or machine recognized. Such an image pickup apparatus is used, for example, in a so-called electronic mirror or digital mirror (referred to as an E-mirror hereinafter) that displays image data acquired by an image pickup apparatus disposed on a side surface of a vehicle body, on an on-board monitor. The E-mirror is demanded to capture a large image of a vehicle behind and also capture a large image near the front wheel
[0003] Furthermore, in addition to the E-mirror, there are systems for use with image data acquired by imaging for automatic recognition, etc., and these systems are demanded to acquire image data including a large amount of information without increasing the number of image pickup apparatuses.
[0004] Patent Document 1 discloses an optical system having a fisheye characteristic that allows an image pickup apparatus placed on the side surface of the vehicle body to image a wide range including the rear and the vicinity of the front wheel. Further, Patent Document 2 discloses an optical system having a projection characteristic that realizes two optical characteristics of a fisheye lens and a telephoto lens using a single optical system. PRIOR ART DOCUMENT PATENT DOCUMENT
[0005] Patent Document 1: Japanese Patent Laid-Open No. 2006-224927 Patent Document 2: Japanese Patent Laid-Open No. 2018-120125 SUMMARY OF THE INVENTION PROBLEMS TO BE SOLVED BY THE INVENTION
[0006] However, with the fisheye characteristic of the optical system in Patent Document 1, the imaging magnification (resolution) relative to the angle of view is constant. Therefore, it is difficult to enlarge and image the vehicle behind or the vicinity of the front wheel of the user's vehicle. Further, the optical system of Patent Document 2 has a characteristic such that the central area serves as the telephoto lens and the peripheral area serves as the fisheye lens. Thus, if this optical system is directed to the rear and the vicinity of the front wheel, one of them is imaged in a large size, but the other is imaged in a small size. Thus, it is difficult to enlarge and image a plurality of objects to be imaged that exist in different directions through a single optical system.
[0007] The present invention provides an image pickup system that can secure a sufficient angle of view and high resolution in a peripheral area using a single optical system. MEANS TO SOLVE THE PROBLEM
[0008] An optical system as one aspect of the present invention includes an image pickup apparatus mounted on a movable body. The image pickup apparatus includes an optical system and an image sensor configured to image an object via the optical system. An imaging surface of the image sensor has a first area for imaging an object included in a first angle of view, and a second area for imaging an object included in a second angle of view larger than the first angle of view. The number of pixels per unit angle of view in the second area is larger than the number of pixels per unit angle of view in the first area. In a case where the movable body moves in a horizontal direction, the image pickup apparatus is installed so that an optical axis of the optical system is non-parallel to the horizontal direction. The optical system satisfies the following conditions: 55° <Omax 20% < |d®max| where 6max is a maximum half angle of view, and d0max is a distortion amount at a position corresponding to a maximum image height of the optical system. EFFECT OF THE INVENTION
[0009] The present invention can provide an image pickup system that can secure a sufficient angle of view and high resolution in a peripheral area using a single optical system. BRIEF DESCRIPTION OF THE DRAWINGS
[0010] FIG. 11s a cross-sectional view of an optical system according to Example 1. FIG. 2 is an aberration diagram at an imaging distance of co of the optical system according to Example 1. FIG. 3 is a cross-sectional view of an optical system according to Example 2. FIG. 4 is an aberration diagram at an imaging distance of co of the optical system according to Example 2. FIG. 5 is a cross-sectional view of an optical system according to Example 3. FIG. 6 is an aberration diagram at an imaging distance of co of the optical system according to Example 3. FIG. 7 is a cross-sectional view of an optical system according to Example 4. FIG. 8 is an aberration diagram at an imaging distance of oo of the optical system according to Example 4. FIG. 9 is a diagram illustrating the projection characteristics of the optical systems according to Examples 1 to 4. FIG. 10 is a diagram illustrating resolution against an angle of view of the optical systems according to Examples 1 to 4. FIG. 11 is a diagram illustrating changes in the curvature of an aspheric surface of the optical system according to Example 4. FIG. 12 is a schematic diagram illustrating the arrangement of an image pickup apparatus for an E-mirror. FIG. 13 1s a diagram illustrating the arrangement of the image pickup apparatus for the vehicle body. FIG. 14 is a diagram illustrating simulation results of images acquired using an fb lens and the optical systems according to Examples 1 to 4. FIG. 15 is a diagram explaining an image sensor. FIG. 16 is a diagram illustrating simulation results for various parameters. FIG. 17 is a block diagram illustrating the configuration of an on-board system. FIG. 18 is a flowchart illustrating an operation example of the on-board system. EMBODIMENTS FOR PRACTICING THE INVENTION
[0011] A description will now be given of examples according to the present invention with reference to the drawings. Prior to a specific description of Examples 1 to 4, a description will be given of common matters to each example.
[0012] The optical system according to each example is a single optical system in which the imaging magnification (resolution) is different between the central area near the optical axis and the peripheral area outside it (on the off-axis side) and a sufficient angle of view and high resolution in the peripheral area can be realized.
[0013] In each example, resolution (mm / deg) is a length of an image height y per unit angle of view (the number of pixels of the image sensor in practical use), a projection characteristic y(8) is a relationship between the image height y and the angle of view 8, and a maximum half angle of view is an angle formed between the optical axis of the optical system and the most off-axis principal ray.
[0014] A general 9 lens has a projection characteristic such that the resolution at each image height is constant and the image height and resolution are in a proportional relationship. On the other hand, the optical system according to each example has a projection characteristic such that the resolution of the peripheral area (second area) is higher than that of the central area (first area), and is used, for example, for an E-mirror.
[0015] FIG. 12(a) illustrates an image pickup apparatus for an E-mirror, disposed on the side of a vehicle body 700 of an automobile as a movable body, and using a normal fisheye lens for its optical system. The E-mirror is an image pickup system that enables the vehicle behind to be confirmed by imaging rear a, and a relationship between the front wheel and the frontage (or service) road to be confirmed by imaging lower front b. In a case where the optical system includes a fisheye lens, within an angle of view FA of the image pickup apparatus, the rear a and the lower front b are imaged with the same resolution, and lower rear c is also imaged with the same resolution as that of each of the rear a and the lower front b. Since particularly detailed information is not required for the lower rear c, imaging of the lower rear c is wasteful if its resolution is the same as that of the rear a and the lower front b.
[0016] FIG. 12(b) illustrates an image pickup apparatus for an E-mirror, similarly disposed on the side of the vehicle body 700 and using the optical system according to each example. As described above, the optical system according to each example has a projection characteristic such that the resolution of the peripheral area FA2 is higher than that of the central area FA1 of its angle of view, and thus can perform imaging to acquire more detailed information about the rear a and the lower front b than that of the lower rear c. That is, the optical system according to each example can enlarge and image objects located in different directions, although it is a single optical system.
[0017] FIG. 1 illustrates the configuration of the optical system (at an imaging distance of oo) according to Example 1. Various specific numerical values of the optical system according to Example 1 will be described in Table 1 as numerical example 1.
[0018] The optical system according to Example 1 (numerical example 1) includes, in order from the object side (enlargement conjugate side) to the image side (reduction conjugate side), a plurality of (eight) lenses L1 to L8, and has the maximum half angle of view of 90°. The optical system according to Example 1 includes an aperture stop ST1 between the lens L4 and the lens L5. The lenses L1 to L4 constitute a front group, and lenses L5 to L8 constitute a rear group.
[0019] A flat plate P1 such as an IR cut filter is disposed between the lens L8 and the image plane. An imaging surface of an image sensor 11 such as a CMOS sensor is disposed on the image plane. The image pickup apparatus generates image data from the output of the image sensor 11.
[0020] FIG. 9(a) illustrates the 6-y projection characteristic (a relationship between the half angle of view 6 and the image height y) of the optical system according to Example 1. The optical system according to Example 1 has a projection characteristic such that the increase rate (slope) of the image height y is small in the central area where the angle of view near the optical axis is small, and the increase rate of the image height y increases as the angle of view increases in the peripheral area. This projection characteristic is a projection characteristic such that the change in image height y is larger than that of each of the generally known equidistant projection (y=fb) and the stereoscopic projection (y=2ftan(6 / 2)).
[0021] In order to realize such a projection characteristic y(8), the optical systems according to Example 1 and other examples satisfy the condition of the following equation (1), where Omax is the maximum half angle of view and f is the focal length.
[0022] 0.20 < 2ftan(Bmax / 2) / y(6max) < 0.95 (1) In a case where the value of equation (1) becomes lower than the lower limit, various aberrations such as curvature of field and distortion increase and image data with excellent image quality cannot be acquired, which is not preferable. Furthermore, in a case where the value of equation (1) becomes higher than the upper limit, a difference in resolution between the central area and the peripheral area increases, and the desired projection characteristic cannot be achieved, which is not preferable.
[0023] It 1s more preferable to set the numerical range of equation (1) as follows.
[0024] 0.25 < 2ftan(Bmax / 2) / y(6max) < 0.94 (la) Furthermore, it is more preferable to set the numerical range of equation (1) as follows.
[0025] 0.30 < 2ftan(fmax / 2) / y(6max) < 0.80 (1b) FIG. 10(a) illustrates a O-resolution characteristic of the optical system according to Example 1. This 6-resolution characteristic is illustrated for a full high-definition (1920x1080 pixels) image sensor. As can be seen from this figure, in a case where y=19, the resolution is always the same for the angle of view, and in a case where y=2ftan (6 / 2), the resolution increases as the angle of view becomes larger.
[0026] On the other hand, in the optical system according to Example 1, the increase rate (inclination) of resolution is larger than that of y=2ftan (6 / 2) in the peripheral area. Thereby, a difference between the resolution of the central area 1 and the resolution near the maximum half angle of view in the peripheral area is made larger than that of y=2ftan (6 / 2).
[0027] Further, it is preferable that the optical system according to each example satisfies the condition of the following equation (2), where 8s0 is an angle of view of 80% of the maximum half angle of view.
[0028] 1.35 < {y(6max)-y(6s0) } / (fBmax-fbso) < 2.50 2) Equation (2) defines a condition regarding the resolution distribution in the peripheral area of the optical system according to each example for the fisheye lens. In a case where the value of equation (2) becomes lower than the lower limit, various aberrations such as curvature of field and distortion increase and image data of excellent image quality cannot be obtained, which is not preferable. Furthermore, in a case where the value of equation (2) becomes higher than the upper limit, a difference in resolution between the central area and the peripheral area decreases and the desired projection characteristic cannot be achieved, which is not preferable.
[0029] It is more preferable to set the numerical range of equation (2) as follows.
[0030] 1.40 < {y(Bmax)-y(Bs0) } / (fdmax-fbso) < 2.30 (2a) Furthermore, it is more preferable to set the numerical range of equation (2) as follows.
[0031] 1.44 < {y(6max)-y(680) } / (fomax-fo80) < 2.10 (2b) FIG. 10(b) illustrates a O-resolution characteristic of the optical system according to Example 2 having a maximum half angle of view of 60°, and FIG. 10(c) illustrates 6- resolution characteristics according to Examples 3 and 4 each having a maximum half angle of view of 90°. Even in the optical systems according to Examples 2 to 4, as in Example 1, the resolution increases as the angle of view increases. Example 2 makes a difference in resolution between the central area and the peripheral area larger than that in the optical systems of other examples. Thus, even if the specification, such as the maximum half angle of view, maximum image height, and Fno, changes, an optical system can be realized which has a sufficiently large angle of view and a required projection characteristic described above.
[0032] Furthermore, the optical system according to each example can have a better projection characteristic by satisfying the condition of the following equation (3) where fsinf is an orthogonal projection.
[0033] 0.1 < fsinBmax / y(6max) < 0.8 3) In a case where the value of equation (3) becomes lower than the lower limit, various aberrations such as curvature of field and distortion increase, image data with excellent image quality cannot be obtained, which is not preferable. Furthermore, in a case where the value of equation (3) becomes higher than the upper limit, the difference in resolution between the central area and the peripheral area decreases and the desired projection characteristic cannot be achieved, which is not preferable.
[0034] It 1s more preferable to set the numerical range of equation (3) as follows.
[0035] 0.1 < fsinBmax / y(6max) < 0.6 (3a) Furthermore, it is more preferable to set the numerical range of equation (3) as follows.
[0036] 0.2 < fsinfmax / y(Bmax) <0.5 (3b) In addition, in applications where the image pickup apparatus having the optical system according to each example is actually used, a difference in the angle of view between the central area and the peripheral area to a certain extent or more can more effectively enhance the effect of the difference in resolution between the central area and the peripheral area, and thus 6max may satisfy the condition of equation (4) below.
[0037] Bmax 2 60° 4) In a case where the movable body (automobile) moves in the horizontal direction, the image pickup apparatus is installed so that the optical axis of the optical system is nonparallel to the horizontal direction. In this case, the following conditions are preferably satisfied: 55° < Bmax 20% < |d®max| where max is the maximum half angle of view, and d®max is a distortion amount at a position corresponding to a maximum image height of the optical system.
[0038] Furthermore, the optical system according to each example has an optical configuration that can control distortion and curvature of field in order to realize the desired projection characteristic. More specifically, at least one aspherical surface is disposed on at least one of the lenses L1 and L2, which have a high off-axis ray height. Furthermore, at least one aspherical surface is disposed on at least one of the lens L7 and lens L8 on the image side. Due to these aspheric surfaces, distortion and curvature of field can be effectively controlled.
[0039] Furthermore, the aspherical surface having a shape including an inflection point can more effectively realize the desired projection characteristic. The inflection point referred to here is a position where the positive / negative sign of the curvature switches (inverts). More specifically, FIGs. 11(a) and (b) illustrate a height h (vertical axis) and curvature (horizontal axis) of the aspheric surfaces (third and fifteenth surfaces) provided in the optical system according to Example 4 in the radial direction from the optical axis. The third surface is the object-side surface of the lens L2, and the fifteenth surface is the object-side aspheric surface of the lens L8. These aspheric surfaces have an inflection point in the radial direction, which is a position where the sign of the curvature is inverted.
[0040] Furthermore, in order to achieve the desired projection characteristic described above, it is preferable that the aspheric surface on the object side has a plurality of inflection points. In the third surface illustrated in FIG. 11(a), the curvature from the optical axis (h=0 mm) to the inflection point near the paraxial h=4.0 mm is positive, the curvature from this inflection point to an inflection point near the off-axis point h=6.5 is negative, and the curvature beyond it toward the periphery is positive. That is, the third surface has a convex shape toward the object side on the paraxial side, gradually changes to a concave shape toward the object side, and changes again to a convex shape toward the object side. By providing the aspherical surface with a plurality of inflection points in this manner, the desired projection characteristic can be effectively realized.
[0041] In addition, in order to realize the desired projection characteristic, wide angle of view, and high image quality described above, the optical system preferably includes, in order from the object side to the image side, a first lens having negative refractive power, a second lens having negative refractive power, a third lens having negative refractive power, an aperture stop, and a lens having positive refractive power and disposed closest to the image side. For example, in the optical system according to Example 1, the lens L1 has negative refractive power, the lens L2 has negative refractive power, the lens L3 has negative refractive power, and the lens L4 has positive refractive power. Furthermore, an aperture stop ST1 is provided between the lens L4 and the lens L5, and the lens L5 has positive refractive power, the lens L6 has positive refractive power, the lens L7 has negative refractive power, and the lens L8 has positive refractive power.
[0042] In such a refractive power arrangement, satisfying at least equation (1) described above (preferably the conditions of equations (2) to (4)) can provide an optical system that can secure a sufficient angle of view, sufficient resolution in the central area, and higher resolution in the peripheral area even with a single optical system, and furthermore have excellent optical performance over the entire angle of view.
[0043] In particular, making the three lenses from the object side negative lenses can bend the light ray at the peripheral angle of view in stages and suppress various aberrations such as excess distortion and curvature of field.
[0044] Furthermore, making the lens closest to the image side a positive lens can make gentle the angle of the light ray incident on the image sensor and secure a sufficient light amount captured by the image sensor.
[0045] In addition, in order to realize the desired projection characteristic and high image quality, the optical system more preferably includes, in this order from the object side to the image side, a first lens having negative refractive power, a second lens having negative refractive power, a third lens having negative refractive power, a fourth lens having positive or negative refractive power, an aperture stop, a fifth lens having positive refractive power, a sixth lens having negative refractive power, a seventh lens having positive refractive power, and an eighth lens having positive refractive power.
[0046] Examples 1 to 4 illustrate representative configuration illustrations of the present invention, and the examples according to the present invention include other configuration illustrations. For example, the projection characteristic and the positions and numbers of inflection points on the aspheric surface are not limited to those in Examples 1 to 4.
[0047] A description will now be given of an E-mirror as an image pickup system including an E-mirror image pickup apparatus using the optical system according to each example. The image pickup apparatus is installed on the side of the vehicle body 700, as illustrated in FIG. 12(b), and images an object at the rear and lower side in the vertical direction (directly below and lower front side).
[0048] The image pickup apparatus includes an optical system according to each example configured to form an object image, and an image sensor configured to photoelectrically convert the object image (to image the object via the optical system). A plurality of pixels two-dimensionally arranged are provided on the imaging surface of the image Sensor.
[0049] An imaging surface 11a on the image sensor illustrated in FIG. 15(a) includes a first area R1 for imaging an object included in the central area (first angle of view) among angles of view of the optical system, and a second area R2 for imaging the object included in a peripheral area (second angle of view larger than the first angle of view). The optical system has a projection characteristic such that the number of pixels per unit angle of view in the second area R2 is larger than the number of pixels per unit angle of view in the first area R1. That is, in a case where the resolution is defined as the number of pixels per unit angle of view, the image pickup apparatus is configured such that the resolution of the peripheral area is higher than the resolution of the central area.
[0050] FIG. 14(a) illustrates a simulation result of image data (captured image) obtained by an image pickup apparatus for an E-mirror using an f9 lens as an optical system. FIG. 14(b) illustrates a simulation result of a captured image obtained by an image pickup apparatus for an E-mirror using the optical system according to each example. In each figure, the upper side illustrates the rear of the vehicle body, the right side illustrates the vicinity of the side surface of the vehicle body, the lower right side illustrates the vicinity of the front wheel, and the left side illustrates the side of the vehicle body. FIG. 14(b) also illustrates an enlarged image of the rear portion of the captured image.
[0051] In FIG. 14(b), in comparison with FIG. 14(a), a bicycle and vehicle behind are enlarged and imaged in a large size. Therefore, detailed information about the rear can be obtained from the captured image, and visibility as an E-mirror can be improved and recognition accuracy in automatic recognition can be improved.
[0052] In order to realize such an E-mirror, the image pickup apparatus 10 is disposed as illustrated in FIGs. 12(b) and 13(a). FIG. 13(a) illustrates the vehicle body 700 viewed from the front in the horizontal direction (front-back direction) as the moving direction (first direction) of the vehicle body 700. The lower part of FIG. 13(a) is the vertical direction (second direction) orthogonal to the horizontal direction, and the left direction is the side (third direction) orthogonal to the horizontal direction and the vertical direction.
[0053] The image pickup apparatus 10 is located on the side of the vehicle body 700 (portion facing the third direction), at a position distant by a distance L from the vehicle body side surface 710 laterally (in the third direction), as illustrated in FIG. 13(a). Further, as illustrated in FIG. 12(b), the image pickup apparatus 10 is installed so that the optical axis AX faces diagonally downward from the rear (road surface side), that is, toward the rear downward direction c.
[0054] Further, the image pickup apparatus 10 is installed so that an optical axis L1 (AX) is tilted by an angle 6L relative to the vertical direction (second direction) when the vehicle body 700 moving in the horizontal direction is viewed from the front, as illustrated in FIG. 13(a). More specifically, it is preferable to install it so as to satisfy the condition of the following equation (5).
[0055] 0° <6L <£90° [&)] where OL larger than 0° indicates a slope angle of the optical axis AX to the side away from the vehicle body side surface 710 toward the side direction with respect to the vertical direction.
[0056] FIG. 16(a) illustrates a simulation result of a captured image where 6L is 90°. In this case, the lanes on the road surface are not imaged along the sides of the imaging surface of the image sensor, a captured image is difficult to intuitively recognize for the driver, but the image that can be easily recognized can be generated by performing image processing such as distortion correction.
[0057] More preferably, the numerical range of equation (5) may be set as follows:
[0058] 0°<0L<20° (5a) FIG. 16(b) illustrates a simulation result of a captured image where 6L is 0°. In this case, since the lanes are imaged along the sides of the imaging surface and a captured image that is easy to visually recognize in a straight line, there is no need to perform image processing such as distortion correction. Therefore, high-response imaging that can provide captured images with high real-time performance with a simple configuration can be performed. Further, in this case, since the side surface of the user’s vehicle can also be imaged, a captured image can be provided in which a distance between the side surface of the user’s vehicle and the obstacle can be easily recognized. A similar captured image can also be obtained in a case where 6L is greater than 0° and less than 20°.
[0059] Furthermore, the optical system may be disposed so that the optical axis AX is shifted away from the side surface of the vehicle body with respect to the center of the imaging surface 11a (referred to as the sensor center hereinafter) SAX, as illustrated in FIG. 15(b). Thereby, a captured image can be obtained with higher visibility, as illustrated in FIG. 16(c).
[0060] FIG. 16(c) illustrates a captured image where the optical axis AX is shifted in a direction separating from the vehicle body side with respect to the sensor center SAX. In comparison with the captured image illustrated in FIG. 16(b) where the optical axis AX and the sensor center SAX coincide with each other, this captured image has a minimum necessary area for illustrating the side surface of the own vehicle and illustrates a wide range of objects on the side of the vehicle body.
[0061] The shift amount (shifted amount) La of the optical axis AX from the sensor center SAX preferably satisfies a condition of the following equation (6), where Ls is a length of a side extending from the sensor center SAX toward the optical axis AX on the imaging surface 11a.
[0062] 03Ls<La<0.5Ls 6) Further, as illustrated in FIG. 13(b), in a case where the vehicle body 700 moving in the horizontal direction is viewed from the front, the image pickup apparatus 10 is installed so that the optical axis L1 of the optical system is parallel to the vertical direction. The image pickup apparatus 10 is installed away from the vehicle body side surface 710. At this time, it is preferable that the shift amount La satisfies a condition of the following equation (7):
[0063] 0.3Ls <Latya <0.5Ls [@)) where a is an angle formed between the optical axis L1 (AX) of the optical system and a straight line L2 that connects an intersection of the surface of the optical system closest to the object and the optical axis L1 (AX), and an endpoint of the vehicle body side surface 710 in the vertical direction (ground point of the front wheel), when the vehicle body 700 is viewed from the front. Moreover, ya is a distance from the intersection of the straight line (first straight line) L2 and the imaging surface to the optical axis L1. Proper imaging can be performed even if the image pickup apparatus 10 is installed at an arbitrary distance from the vehicle body side surface within a range that satisfies the condition of equation (7).
[0064] FIG. 13(c) illustrates an installation angle of the image pickup apparatus 10 relative to the vehicle body 700. When the vehicle body 700 is viewed from the side, 6b is a slope angle of the image pickup apparatus 10 (optical axis L1 of the optical system) toward the rear relative the vertical direction, and 6f is a tilt angle toward the front. The tilt angle Of is an angle between the optical axis L1 and a straight line that connects an intersection the surface closest to the object of the optical system of the image pickup apparatus 10 and the optical axis L1, and an endpoint of the front wheel of the vehicle body 700 in the peripheral area of the angle of view (second angle of view) in the moving direction. At this time, it is preferable that the following condition of equation (8) or (9) is satisfied:
[0065] 0.76max < 6b < Omax (8) 0.76max < 6f < Omax (9) In order to satisfy equation (8) or (9) for objects at the rear and lower front, the optical axis L1 is tilted from the horizontal direction toward the vertical direction to face the lower rear or lower front. Setting the horizontal installation angle (orientation of the optical axis) of the image pickup apparatus 10 so as to satisfy equation (8) or (9) can image objects in different directions, rear and lower front, with sufficient resolution and in a proper area on the imaging surface.
[0066] Since a target of the movable body is often an object behind, it is preferable to tilt the optical axis L1 backward, that is, to satisfy equation (8). Equation (8) can be replaced with equation (8a) below:
[0067] Bmax < 6f < 1.36max (8a) FIG. 16(d) illustrates a simulation result of a captured image where 6b=0.956max (6f=1.056max). The area around the front wheels is illustrated at sufficient resolution in the lower part of the center area, and a vehicle behind as a main object is illustrated at higher resolution in the peripheral area.
[0068] Regarding the peripheral area of the imaging surface on the image sensor, Lb is a distance between an image position (image point) of an object behind on the imaging surface and the sensor center SAX, Lf is a distance between an image position of an object at the lower front on the imaging surface and the sensor center SAX, and Lh is a length of a side extending in a direction in which these two image positions are separated on the imaging surface. In other words, when the vehicle body 700 is viewed from the side, Lf is a distance between the image point of the endpoint (front endpoint) of the front wheel of the vehicle body 700 in the moving direction in the peripheral area of the angle of view (second angle of view) and the sensor center SAX, and Lf is a length of the side of the imaging surface extending in a direction from the sensor center SAX to the image point of the front endpoint. At this time, it is preferable that at least one of the following equations (10) and (11) be satisfied:
[0069] 0.35Lh<Lb<0.5Lh (10) 0.35Lh<Lf<0.5Lh (11) Equations (10) and (11) define conditions for effectively using the most peripheral area R3 of the imaging surface 11a, as illustrated in FIG. 15(C). Unless these conditions are satisfied, high-resolution imaging in the most peripheral area R3 is unavailable and it becomes difficult to obtain detailed information from the captured image. In other words, satisfying at least one of equations (10) and (11) can provide high-resolution imaging in the most peripheral area R3. Then, cutting out a high-resolution partial image obtained in the most peripheral area R3 and outputting it to the vehicle body monitor (display unit) for display can provide the driver with detailed information about the rear. Since a target of the movable body is often the object in the back, it is preferable that equation (10) be satisfied. Further, equation (11) can be replaced with equation (11a) below.
[0070] 0.5Lh<Lf<0.65Lh (11a) The image pickup system described above is merely illustrative, and other configurations and arrangements may be adopted. For example, in an E-mirror, the optical axis of an image pickup apparatus installed on the side of the vehicle body is tilted from the horizontal direction (moving direction) to the vertical direction orthogonal to it to image the rear or lower front side. On the other hand, an image pickup apparatus may be installed at the front or rear of the vehicle body, and the optical axis may be tilted toward the side orthogonal to the horizontal direction to image the front and sides or the rear and sides.
[0071] An image pickup system configured similarly to the E-mirror may be installed in a movable body other than an automobile, such as an aircraft or a ship.
[0072] A specific description will now be given of the optical systems according to Examples 1 to 4 EXAMPLE 1
[0073] As described above, the optical system according to Example 1 illustrated in FIG. 1 includes, in order from the object side to the image side, a first lens L1 having negative refractive power, a second lens L2 having negative refractive power, a third lens L3 having negative refractive power, a fourth lens L4 having positive refractive power, an aperture stop ST1, a fifth lens LS having positive refractive power, a sixth lens L6 having positive refractive power, a seventh lens L7 having negative refractive power, and an eighth lens L8 having positive refractive power.
[0074] (A) lens configuration of numerical example 1 corresponding to this example illustrated in Table 1 illustrates a focal length f (mm), an aperture ratio (F number) F, and a maximum half angle of view (°) of the optical system. ri represents a radius of curvature (mm) of the i-th surface counted from the object side, di represents a lens thickness or air gap (mm) between i-th and (i+1)-th surfaces, and ni represents a refractive index for the d-line of an optical material between i-th and (i+1)-th surfaces. vi is an Abbe number based on the d-line of the optical material between i-th and (i+1)- th surfaces.
[0075] The Abbe number vd is expressed as vd = (Nd-1) / (NF-NC), where Nd, NF, and NC are refractive indices for the d-line (587.6 nm), F-line (486.1 nm), C-line (656.3 nm) in the Fraunhofer line, respectively.
[0076] ST represents an aperture stop. Further, "*" means that a surface to which it is attached is an aspherical surface. The aspherical shape is expressed by the following equation, where z is a coordinate in the optical axis direction, y is a coordinate in a direction orthogonal to the optical axis, a light traveling direction is set positive, ri is a paraxial radius of curvature, K is a conic constant, and A to G are aspheric coefficients. (B) aspherical coefficient in Table 1 indicates the conic constant K and the aspherical coefficients Ato G "E+-x" means x107%
[0077] z(y)=(y*ri) / [1+{1-(1+K)(y* / 1i?)}' 2]+Ay*+ByS+Cy®+Dy'+Ey'*+Fy'*+Gy'® A description regarding a numerical example is similarly applied to numerical examples corresponding to other examples described below.
[0078] The optical system according to this example (numerical example 1) satisfies the conditions of equations (1) to (4). Table 5 summarizes the values for each condition.
[0079] FIG. 2 illustrates longitudinal aberrations (spherical aberration, astigmatism, and distortion) at the imaging distance of o of the optical system according to this example (numerical example 1). In the spherical aberration diagram, a solid line indicates the spherical aberration for the d-line (wavelength 587.6 nm). In the astigmatism diagram, a solid line S indicates a sagittal image plane, and a broken line T indicates a meridional image plane. In the distortion diagram, a solid line indicates the distortion for the d-line. A description of these aberration diagrams is similarly applied to the aberration diagrams of other examples described below.
[0080] Furthermore, as described above, FIG. 9(a) illustrates the projection characteristic of the optical system according to this example, and FIG. 10(a) illustrates the 6-resolution characteristic of the optical system according to this example. EXAMPLE 2
[0081] FIG. 3 illustrates the configuration of an optical system (imaging distance of oo) according to Example 2. The optical system according to this example includes, in order from the object side to the image side, a first lens L21 having negative refractive power, a second lens L22 having negative refractive power, a third lens L23 having negative refractive power, a fourth lens L24 having positive refractive power, an aperture stop ST2, a fifth lens L25 having positive refractive power, a sixth lens L26 having negative refractive power, and a seventh lens L27 having positive refractive power. In FIG. 3, P21 denotes a flat plate such as an IR cut filter, and 21 denotes an image sensor.
[0082] As can be seen from numerical example 2 corresponding to this example illustrated in Table 2, the maximum half angle of view 6max of the optical system according to this example is 60°, which is different from 90° of the optical system according to Example 1.
[0083] The optical system according to this example (numerical example 2) satisfies the conditions of equations (1) to (4). Table 5 summarizes the values for each condition.
[0084] FIG. 4 illustrates the longitudinal aberration at imaging distance oo of the optical system of this example (numerical example 2). Further, FIG. 9(b) illustrates the projection characteristic of the optical system of this example, and as described above, and FIG. 10(b) illustrates the B-resolution characteristic of the optical system according to this example. EXAMPLE 3
[0085] FIG. 5 illustrates the configuration of an optical system (imaging distance of oo) according to Example 3. The optical system according to this example includes, in order from the object side to the image side, a first lens L31 having negative refractive power, a second lens L32 having negative refractive power, a third lens L33 having negative refractive power, a fourth lens L34 having negative refractive power, an aperture stop ST3, a fifth lens L35 having positive refractive power, a sixth lens L36 having positive refractive power, a seventh lens L37 having negative refractive power, and an eighth lens L38 having positive refractive power. In FIG. 5, P31 and P32 denote flat plates such as IR cut filters, and 31 denotes an image sensor.
[0086] As can be seen from numerical example 3 corresponding to this example illustrated in Table 3, the optical system according to this example has a maximum half angle of view of 90°, which is the same as Example 1, and a height y (6max) of 1.79 mm, which is different from Example 1 (3.64 mm).
[0087] The optical system according to this example (numerical example 3) satisfies the conditions of equations (1) to (4). Table 5 summarizes the values for each condition.
[0088] FIG. 6 illustrates the longitudinal aberration at an imaging distance of co of the optical system according to this example (numerical example 3). Further, FIG. 9(c) illustrates the projection characteristic of the optical system according to this example, and as described above, and FIG. 10(c) illustrates the 8-resolution characteristic of the optical system according to this example. EXAMPLE 4
[0089] FIG. 7 illustrates the configuration of the optical system (imaging distance of oo) according to Example 4. The optical system according to this example includes, in order from the object side to the image side, a first lens L41 having negative refractive power, a second lens L42 having negative refractive power, a third lens L43 having negative refractive power, a fourth lens L44 having negative refractive power, an aperture stop ST4, a fifth lens L45 having positive refractive power, a sixth lens L46 having positive refractive power, a seventh lens L47 having negative refractive power, and an eighth lens L48 having positive refractive power. In FIG. 7, P41 is a flat plate such as an IR cut filter, and 41 is an image sensor.
[0090] As can be seen from numerical example 4 corresponding to this example illustrated in Table 4, the optical system according to this example has an F-number of 1.80, which is brighter than that of Example 1 (2.80), and satisfies the value of the condition of equation (1) is 0.92, which is larger than that of Example 1 (0.78).
[0091] The optical system according to this example (numerical example 4) satisfies the conditions of equations (1) to (4). Table 5 summarizes the values for each condition.
[0092] FIG. 8 illustrates the longitudinal aberration at the imaging distance o of the optical system according to this example (numerical example 4). Further, FIG. 9(c) illustrates the projection characteristic of the optical system according to this example, and as described above, and FIG. 10(c) illustrates the 8-resolution characteristic of the optical system according to this example.
[0093] (TABLE 1) NUMERICAL EXAMPLE 1 (A) LENS CONFIGURATION f (FOCAL LENGTH) 1.42mm F (APERTURE RATIO) 2.80 MAXIMUM HALF ANGLE OF VIEW 90.0° l= 1748 dl = 1.00 nl = 1.868 vli=41.7 = 800 d2= 343 * 3= 4402 d3= 1.00 n2 =1498 v2=684 * y4= 75] d4= 2.75 S= 723 ds = 0.60 n3=1.767 v3=498 = 2.15 de = 2.06 * 7= 932 d7= 224 n4 =1851 v4 =401 8= 460 d8 = 0.81 ST 9= wo do9= 082 rl0=-1621 d10= 0.71 ns =1742 vS=25"7 rll = -4.05 dll= 1.14 r12=158.10 d12= 1.44 né = 1.694 v6=526 rl3= 2.26 d13='024 n7=1922 v7I=208 rld= 13.82 dl4= 0.10 * r15= 7.74 dl15= 2.70 nk =1583 v8=594 * rlo= 2.78 dle= 2.10 rl7= oo d17=0.65 n9=1516 vo9=641 (B) ASPHERIC COEFFICIENT 7] 0 EB “A EB £ 3 0 1.380E-03 | -2.469E-05 | 3.957E-07 | 0 [sores ee _17 | | _0 -5.784E-03 | 5.098E-04 | -1.431E-04 rlS | -1.777E-10 | -4.898E-03 116 | -1.566E+00 | -1.758E-03 | -2.258E-04 | -1.643E-06 D_ _E_ FE =. 3 | 2087E09| _0 0 0 r4 | 2886E-00 | _0 0 0 17 | 1.201E-05 | 2842E07 | _0 0 r15 5.174E-12 | -9.931E-15 16
[0094] (TABLE 2) NUMERICAL EXAMPLE 2 (A)LENS CONFIGURATION f (FOCAL LENGTH) 1.30mm F (APERTURE RATIO) 2.80 MAXIMUM HALF ANGLE OF VIEW 60.0° * rl= 2040 dl = 1.50 nl =1789 vl=479 * m= 801 d2= 2.18 r3= 8.94 d3= 123 n2=1770 v2=489 4= 238 d4= 214 * r5=-18.79 ds= 235 n3 =1851 v3=40.1 * r6=-6371 dé = 038 r7= 5.12 d7= 1.96 n4 =1611 v4=346 ST r8=-1026 dg = 1.40 19 =-154.62 d9= 1.78 ns = 1.666 v5=354.0 rl0= -2.35 d10= 0.40 n6 = 1.895 v6=213 rll =-56.68 dil1= 0.10 * ri2= 513 dl12= 4.54 N7>= 1.583 v7I=594 * rl3= «1.70 di13= 1.00 rl4= «© dl4= 0.65 n8=1516 v8 =64.1 rl15= wo dis= 1.10 (B) ASPHERIC COEFFICIENT rs 0 3.653E-03 -1.060E-04 1 | 0 3 105E-05 | -2.642E-04 -4 884E-01 | -5.567E-03 rl3 Xx A Ff ~L 0 3.794E-04 | -3428E-06 | -1.765E-09 2 | _0 _-9885E-04 | 1577E05 as 0 3.653E-03 _-1.060E-04 | -6.700E-05 6 0 3.105E-05 | -2.642E-04 r12 | -4884E-01 | -5.567E-03 | 3275E-04 | -9.070E-06 113 6.647E-03 | 1385E-03 -2.008E-04 rl3 _D _E _F _G rl 4845E-10 0 0 0 _12_|_-1.088E-10 0 0 0 _15_|_3.041E-06 |_1388E-06 0 0 r6 | 3857E-05 | -4.037E-06 | _0 0 r12 | 1374E-07 | -1218E-09 | 6.168E-12 | -1.415E-14 13 | 1624E-05 | -6.596E-07 | 1281E-08 | -9.506E-11
[0095] (TABLE 3) NUMERICAL EXAMPLE 3 (A) LENS CONFIGURATION f (FOCAL LENGTH) 0.80mm F (APERTURE RATIO) 2.00 MAXIMUM HALF ANGLE OF VIEW 90 0° rl = 1924 dl = 120 nl = 1.883 +] =40.8 2= 900 d2= 5.16 * r3= 45.70 d3 = 1.00 n2 =1.883 v2=4028 * 4= 7.03 dd = 3.06 5S= 18.85 ds = 050 n3=1774 v3=495 6= 286 de = 1.59 * ¢]= 787 d7 = 048 n4 =1851 v4 =401 Pe: 8=12724 d8 = 2.12 ST O= oo do9= 085 rl0= 13.04 d10= 0.66 nS =1871 vs=218 Il = «720 dll = 267 rI2= 765 dl2= 138 n6é =1.698 vo=524 ri3= 2.40 d13 = 048 n7=1922 v7i=208 rld= 984 dl14= 0.10 * rl5= 478 dls= 1.86 nd =1583 v8=3594 * rl6= -2.92 dle= 1.21 17= oo d17= 095 n9 =1.560 v9 =560 riI8= oo dil8 = 164 r19= oo d19= 030 nl0=1.500 v10=63.0 20= oo d20= 0.10 (B) ASPHERIC COEFFICIENT rls =-1.777E-10 rlé -2.039E+00 X_ A B ~£ B30 1227-03 _-2336E-05 | 3.436E-07 | rd 0 _-3.097E-04 | 1.607E-05 | -6.544E-07 7 0 _-1208B-02 | 5.124E-04 | -2.807E-05 18 0 _-4179E-03 | 3.391E-04 | 7.445E-05 _r15 _-1.777E-10 | -5342E-03 | 1716E-04 | -3.133E-06 116 -2.039E+00 -1.905E-04 | -5.068E-06 _D _E _F _G _r3 _-1388E-09 0 0 0 _r4 __1.030E-09 0 0 0 17 _4846E-05 | 7.157607 | 0 0 _18 _7.554E-05 | _1.622E-06 0 0 _r15 _3.322B-08 | -2.118E-10 | 7.829E-13 | -1317E-15 116 2.725E-06 | -1297E-07
[0096] (TABLE 4) NUMERICAL EXAMPLE 4 (A) LENS CONFIGURATION f (FOCAL LENGTH) 1.68mm F(APERTURE RATIO) 1.80 MAXIMUM HALF ANGLE OF VIEW 90 .0° * r1=137.12 dl = 1.00 nl =1851 vl =40.1 n= 822 d2= 513 * r3= 1498 d3= 1.00 n2=1583 v2=594 * r4= 510 d4 = 2.55 r5= 9.11 d5= 0.80 n3 =1516 v3=64.1 6= 397 dé6= 3.28 r7= -3.56 d7= 0.71 n4=1516 v4 =064.1 8= 402 dg = 193 ST 19= o d9= 0.10 rl0= 9.23 d10= 2.10 ns =1673 v5=32.1 1] =-1390 dil = 3.04 rl2= 8.45 dl2= 3.03 n6 =1.703 v6=3524 r13= -426 d13= 0.50 n7=1923 v71=209 rld= 9.75 dl4= 020 * rl5= 5385 dis= 3.79 n8 =1.583 v8=159.4 * rl6= -537 die= 210 r17= ow d17= 0.65 n9=1516 vo =64.1 rl18= wo dig= 1.10 (B) ASPHERIC COEFFICIENT 0 9 495E-06 | -1.551E-05 | 2.363E-07 0 -3 736E-04 -1.777E-10 _K _A _B C 3 0 1.993E-04 | -1433E-06 | 8.854E-09 4 0 -9.495E-06 | -1.551E-05 | 2.363E-07 | 7 0 -3.736E-04 -7.118E-07 r15| -1.777E-10 | -2.345E-03 -8.009E-06 rl6 2.378E-04 | -1.752E-05 -5.323E-08 0 0 _0 5 016E-07 | -4.676E-09 | 3.446E-11 | -9.581 LE EG 3 | 37E11 | 5492E-14 | 0 0 w IE 7 oo 0 rl5| 2916E-07 -4.676E-09 3.446E-11 -9.581E-14 rl6 | 5.855E-07 | -9.714E-09 | 7.901E-11 | -2.521E-13
[0097] (TABLE 5) VALUES OF CONDITIONAL EQUATIONS CONDITIONAL | EXAMPLE1 | EXAMPLE2 |EXAMPLE3 |EXAMPLE 4 EQUATION @ 0.78 0.41 0.89 0.92 2) 1.65 2.09 155 1.45 3) 0.39 0.31 0.45 0.46 4)(6max 90° 60° 90° 90° y(6max) 3.64 3.65 1.79 3.64
[0098] FIG. 17 illustrates the configuration of an on-board system (driving support apparatus) 600 as the above E-mirror (image pickup system). The on-board system 600 described here is a system for supporting driving (maneuvering) of a vehicle based on image data of the rear, lower, and lower front views of the vehicle acquired by the image pickup apparatus 10.
[0099] The on-board system 600 includes an image pickup apparatus (on-board camera) 10, a vehicle information acquiring apparatus 20, a control apparatus (control unit; ECU: electronic control unit) 30, and a waming apparatus (warning unit) 40. The image pickup apparatus 10 includes an imaging unit 1 including an optical system and an image sensor, an image processing unit 2, a parallax calculator 3, a distance acquiring unit (acquiring unit) 4, and a danger determining unit 5. The imaging unit 1 is provided on each of the left and right sides of the vehicle. The image processing unit 2, the parallax calculator 3, the distance acquiring unit 4, and the danger determining unit 5 constitute a processing unit.
[0100] A flowchart in FIG. 18 illustrates an operation example of the on-board system 600. First, in step S1, the imaging unit 1 images an object such as an obstacle and a pedestrian behind, below, and at the lower front of the vehicle to obtain a captured image (image data).
[0101] In step S2, the vehicle information acquiring apparatus 20 acquires vehicle information. The vehicle information is information including a vehicle speed, a yaw rate, a steering angle, etc.
[0102] In step S3, the image processing unit 2 performs image processing for the image data acquired by the imaging unit 1. More specifically, image feature analysis is performed to analyze a feature amount such as an amount and direction of an edge and a density value in the image data.
[0103] In step S4, the parallax calculator 3 calculates parallax (image shift) information between a plurality of image data acquired by the imaging unit 1. A method for calculating the parallax information can use a known method such as the SSDA method and the area correlation method, and thus a description thereof will be omitted here. Steps S2, S3, and S4 may be performed in the above order or may be performed in parallel.
[0104] In step S5, the distance acquiring unit 4 acquires (calculates) distance information from the object imaged by the imaging unit 1. The distance information can be calculated based on the parallax information calculated by the parallax calculator 3 and the internal parameters and external parameters of the imaging unit 1. The distance information here refers to information about a relative position to the object, such as a distance to the object, a defocus amount, and an image shift amount, and the distance to the object may also be directly or indirectly expressed.
[0105] Then, in step S6, the danger determining unit 5 determines whether the distance to the object is included in a set distance range using the vehicle information acquired by the vehicle information acquiring apparatus 20 and the distance information calculated by the distance acquiring unit 4. Thereby, it can be determined whether an object exists within the set distance behind the vehicle, and whether a dangerous event is likely such as a collision with a diagonally rear vehicle in changing lanes, a front wheel falling into a ditch, or running onto a sidewalk. The danger determining unit 5 determines “dangerous” if the object exists within the set distance and the dangerous event (step S7) is likely, and determines “not dangerous” (step S8) if the object does not exist within the set distance.
[0106] Next, in a case where the danger determining unit 5 determines “dangerous,” it notifies (sends) the determination result to the control apparatus 30 and warning apparatus 40. At this time, the control apparatus 30 controls the vehicle based on the determination result of the danger determining unit 5 (step S6), and the warning apparatus 40 warns the vehicle user (driver, passenger) based on the determination result of the danger determining unit 5 (step S7). The determination result may be notified to at least one of the control apparatus 30 and the warning apparatus 40.
[0107] In the case of “dangerous,” the control apparatus 30 controls the vehicle, such as returning the steering wheel so as not to change lanes, not to fall into a ditch or not to run onto a sidewalk, or to generate a braking force on the wheels. The warning apparatus 40 issues a warning to the user, such as by emitting a warning sound (alarm), displaying warning information on a screen of a car navigation system, or applying vibration to a seat belt or steering wheel.
[0108] There are various methods for calculating distance information. For example, a case will be described in which a pupil division type image sensor having a plurality of pixel portions arranged in a two-dimensional array is used as the image sensor included in the imaging unit 1. In the pupil division type image sensor, a single pixel unit includes a microlens and a plurality of photoelectric converters, receives a pair of light beams passing through different areas in the pupil of the optical system, and can output a pair of image data from each photoelectric converter.
[0109] An image shift amount in each area is calculated by correlation calculation between the paired image data, and the distance acquiring unit 4 calculates image shift map data representing a distribution of the image shift amount. The distance acquiring unit 4 may further convert the image shift amount into a defocus amount and generate the defocus map data representing the distribution of the defocus amount (distribution on a two- dimensional plane of a captured image). Further, the distance acquiring unit 4 may acquire distance map data of the distance to the target converted from the defocus amount.
[0110] The on-board system 600 may include a notifying apparatus (notifying unit) for notifying the manufacturer of the on-board system, the vehicle seller (dealer), etc. if a dangerous event such as a collision actually occurs. For example, the notifying apparatus may be one that transmits information about a dangerous event to a preset external notification destination via e-mail or the like.
[0111] Thus, the configuration in which the notifying apparatus automatically notifies information on a dangerous event can promptly take measures such as inspection and repair after the dangerous event occurs. The notification destination of the dangerous event information may be an insurance company, a medical institution, the police, or an arbitrary notification destination set by the user.
[0112] In addition, this example applies the on-board system 600 to driving support (collision damage reduction), but the on-board system 600 is not limited to this and can be used for cruise control (including adaptive cruise control function) and automatic driving etc. Further, an image pickup system having a configuration equivalent with that of the on- board system 600 may be mounted on a movable body such as an aircraft, a ship, or even an industrial robot.
[0113] Furthermore, in the above examples, a case has been described in which the lens apparatus is applied to the image pickup apparatus 10 as a distance measuring apparatus, but it may be applied to an image pickup apparatus (on-board camera) other than a distance measuring apparatus. For example, an on-board camera may be placed at the rear or side of the vehicle, and the acquired image information may be displayed on a display unit (monitor) inside the vehicle to provide driving assistance. In this case, it is not necessary to provide a component for distance measurement, such as a parallax calculator, a distance acquiring unit, and a collision determining unit.
[0114] Furthermore, the above example has described a case in which the lens apparatus is applied to an imaging unit in an on-board system, but this embodiment is not limited to this. For example, the lens apparatus may be applied to an image pickup apparatus such as a digital still camera, a digital video camera, or a film-based camera, or may be applied to an optical apparatus such as a telescope or a projection apparatus such as a projector.
[0115] Each example described above is merely a typical example, and various modifications and changes can be made to each example in implementing the present invention.
Claims
CLAIMS
1. An image pickup system comprising an image pickup apparatus mounted on a movable body, wherein the image pickup apparatus includes an optical system and an image sensor configured to image an object via the optical system, wherein an imaging surface of the image sensor has a first area for imaging an object included in a first angle of view, and a second area for imaging an object included in a second angle of view larger than the first angle of view, wherein the number of pixels per unit angle of view in the second area is larger than the number of pixels per unit angle of view in the first area, wherein in a case where the movable body moves in a horizontal direction, the image pickup apparatus is installed so that an optical axis of the optical system is non-parallel to the horizontal direction, and ‘wherein the optical system satisfies the following conditions: 55° < Bmax 20% < |d®max| where Bmax is a maximum half angle of view, and dOmax is a distortion amount at a position corresponding to a maximum image height of the optical system.
2. The image pickup system according to claim 1, wherein in a case where the movable body moves in the horizontal direction, the image pickup apparatus is installed so that the optical axis is parallel to a vertical direction when viewed from the moving direction of the movable body.
3. The image pickup system according to claim 1 or 2, wherein in a case where the movable body moves in the horizontal direction, the image pickup apparatus is installed so that the optical axis is tilted toward a side away from the movable body relative to a vertical direction when viewed from the moving direction of the movable body.
4. The image pickup system according to any one of claims 1 to 3, wherein in a case where the movable body moves in the horizontal direction, the image pickup apparatus is installed so as to image an object on a lower side in a vertical direction relative to the optical system.
5. The image pickup system according to any one of claims 11 to 14, wherein the movable body moves in a horizontal direction, when viewed from the moving direction of the movable body, the optical system satisfies the following condition: 0° <@L <20° where OL is an angle between the optical axis and a vertical direction.
6. The image pickup system according to any one of claims 1 to 5, wherein the optical system is disposed so that the optical axis is shifted toward a side away from the movable body with respect to a center of the imaging surface.
7. The image pickup system according to claim 6, wherein the optical system satisfies the following condition: 03Ls<La<0.5Ls where La is a shift amount of the optical axis from the center of the imaging surface, and Ls is a length of a side of the imaging surface extending in a direction from the center of the imaging surface toward the optical axis.
8. The image pickup system according to claim 6 or 7, wherein in a case where the movable body moves in the horizontal direction, when viewed from a moving direction of the movable body, the optical system satisfies the following condition: 0.3Ls<Latya <0.5Ls where a is an angle between the optical axis and a first straight line connecting an intersection of a surface closest to an object of the optical system and the optical axis, and an endpoint of the movable body in a vertical direction, ya is a distance from an intersection of the first straight line and the imaging surface to the optical axis, La is a shift amount of the optical axis from the center of the imaging surface, and Ls is a length of a side of the imaging surface extending in a direction from the center of the imaging surface toward the optical axis.
9. The image pickup system according to any one of claims 1 to 8, wherein in a case where the movable body moves in the horizontal direction, when viewed from a direction orthogonal to a moving direction of the movable body and a vertical direction, the optical system satisfies the following condition: Bmax < 6f <1.36max where 0f is an angle formed between the optical axis and a straight line connecting an intersection of a surface closest to an object of the optical system and the optical axis, and an endpoint of a front wheel of the movable body in the moving direction in the second angle of view, and 6max is a maximum half angle of view.
10. The image pickup system according to any one of claims 1 to 9, wherein in a case where the movable body moves in the horizontal direction, when viewed from a third direction orthogonal to a moving direction of the movable body and a vertical direction, the optical system satisfies the following condition: 05Lh<Lf<0.65Lh where Lf is a distance between an image point at an endpoint image point of a front wheel of the movable body in the moving direction at the second angle of view and a center of the imaging surface, and Lh is a length of a side of the imaging surface extending in a direction from the center of the imaging surface toward the image point.
11. The image pickup system according to any one of claims 1 to 10, further comprising a display unit configured to display image data generated using an output from the image sensor.
12. The image pickup system according to any one of claims 1 to 11, further comprising a processing unit configured to process image information acquired by the image pickup apparatus.
13. The image pickup system according to claim 12, further comprising a determining unit configured to determine whether a dangerous event is likely based on distance information to the object acquired by the image pickup apparatus.
14. The image pickup system according to claim 13, further comprising a control apparatus configured to control the vehicle in a case where it is determined that the dangerous event is likely.
15. The image pickup system according to claim 13 or 14, further comprising a warning apparatus configured to issue a warning to a user of the movable body in a case where it is determined that the dangerous event is likely.
16. The image pickup system according to any one of claims 13 to 15, further comprising a notifying apparatus configured to notify outside of information about the dangerous event.
17. A movable body comprising the accor ar one claims 1 to 16.
Citation Information
Patent Citations
ViewJP2013156793AonEspacenetopensinnewtab
ViewCN112788204AonEspacenetopensinnewtab
ViewJP2005110207AonEspacenetopensinnewtab
ViewWO2020/153317A1onEspacenetopensinnewtab