Single aperture low f-number zoom camera
The camera system with an adaptive aperture and processor dynamically adjusts the aperture and sensor cropping to address optical aberrations, achieving improved low-light sensitivity and high image resolution in mobile device cameras without increasing height.
Patent Information
- Application Number
- JP2026503900
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2023-10-25
- Filing Date
- 2024-07-25
- Publication Date
- 2026-08-25
- Estimated Expiration
- 2044-07-25
AI Technical Summary
Designing lenses for mobile device cameras with low f/# to achieve good low-light sensitivity, strong bokeh effect, and high image resolution is challenging due to optical aberrations and increased camera height, which is undesirable in thin mobile devices.
Implementing a camera system with an adaptive aperture (AA) and processor to dynamically adjust the aperture diameter and crop the image sensor, allowing for a wide-angle and telephoto camera to switch between field of view states while maintaining a low f/# and reducing optical aberrations.
The solution enables a low f/# camera system that achieves improved low-light sensitivity, natural bokeh effect, and high image resolution without increasing camera height, by adaptively adjusting the aperture and cropping the sensor to maintain optimal optical performance.
Smart Images

Figure 2026528705000001_ABST
Abstract
Description
[Technical Field]
[0001] Cross-references to related applications This application relates to and claims priority over U.S. Provisional Patent Application No. 63 / 515,841, filed on 27 July 2023, and U.S. Provisional Patent Application No. 63 / 592,928, filed on 25 October 2023, both of which are incorporated herein by reference in their entirety.
[0002] The subject matter of this disclosure generally relates to the field of digital cameras used in mobile electronic devices (or simply “mobile devices”), and more particularly to optical designs in such cameras. [Background technology]
[0003] definition
[0004] In this application, and throughout the description and drawings, the following symbols and abbreviations are used to describe optical and other properties, all of which are known in the art.
[0005] Total track length (TTL): The maximum distance measured along a direction parallel to the optical axis between a point on the front surface S1 of the first lens element L1 of the lens (or "lens assembly") and the image sensor, when the lens, including the camera system, is focused on an infinity subject.
[0006] Back focal length (BFL): The final lens element L of the lens (or "lens assembly") when the lens, including the camera system, is focused on a subject at infinity. N After surface S 2N The minimum distance measured between the point above and the imaging sensor, along a direction parallel to the first optical axis.
[0007] Effective focal length (EFL): Lens element L1 to LN The distance between the rear principal point P' and the rear focal point F' of the lens assembly.
[0008] F-number (f / #): The ratio of the effective focal length (EFL) to the aperture diameter DA of the camera's entrance pupil: f / # = EFL / DA.
[0009] Aperture diameter (DA): Represents the entrance pupil diameter of the optical lens system.
[0010] Entrance pupil: The optical image of the aperture diaphragm "visible" through the front aperture of the lens system. The front aperture is the aperture on the subject-facing side of the lens.
[0011] Optical lens system: This system comprises an image sensor and a lens containing multiple lens elements. Each lens element has two surfaces: a front surface (facing the subject) and a rear surface (facing the image sensor).
[0012] Clear aperture diameter (CA): Represents the optically effective aperture diameter of the lens element's surface.
[0013] Dual and triple cameras (or generally multi-camera systems) are known for mobile electronic devices such as smartphones, tablets, laptops, headsets, and smartwatches. In a typical triple camera system, one camera has an ultra-wide (UW) field of view (FOV). UW It has, and another camera has FOV UW A narrower wide-angle field of view (FOV). W It has, and yet another camera has FOV W A narrower telephoto (Tele) field of view (FOV) T These cameras are also referred to herein as the ultra-wide-angle (or UW) camera, the wide-angle (or W) camera, and the telephoto (or T) camera, respectively. Generally, the wide-angle camera is considered the main camera of a smartphone.
[0014] FIG. 1A illustrates a dual camera 150 that includes a telephoto zoom camera 100 along with a wide - angle camera 130. The telephoto camera 100 includes an optical path bending element (OPFE) 102 (e.g., a prism or a mirror), a lens 110, and an imaging sensor 106. The OPFE 102 bends the optical path from a first optical path 112 (perpendicular to the back of the mobile device) to a second optical path 114 (parallel to the back of the mobile device). Generally, the back of the mobile device is the side opposite the display screen. The wide - angle camera 130 includes a lens 134 having an optical axis 136 parallel to the first optical path 112 and an imaging sensor 138. The wide - angle camera 130 is a non - bending type (or “upright type” or “normal type”) camera.
[0015] FIG. 1B illustrates a known camera 160 that includes a lens 162 having an effective focal length (EFL) and an imaging sensor 164 having an imaging sensor diagonal length (SD) in a side view. FIG. 1C illustrates a top view of the known camera 160 of FIG. 1B. The camera 160 forms an image of light from a field of view 166 over the entire imaging sensor 164, as shown by a light cone 168. Since the entire imaging sensor 164 is used for imaging, this represents the “full field of view” (or “F - FOV”) state of the camera 160. In the F - FOV state, the camera 160 has an aperture diameter DA F-FOV , f / # F-FOV = EFL / DA F-FOV , and has a full field of view 166 indicated by an angle α.
[0016] In some examples, the camera 160 may be a wide - angle camera having f / # F-FOV = 1.25 to 3 or f / # F-FOV = 1.5 to 2.5 and satisfying a ratio SD / TTL = 0.5 to 1, referred to as the “slim factor” or “SF”. SD may be in the range of 5 mm to 25 mm, for example, SD = 16.3 mm (“1 - inch” type sensor) or SD = 14.6 mm (“1 / 1.12 - inch” type sensor). For the wide - angle camera, DA F-FOVThe range may be within 2 to 8 mm, SD / DA F-FOV The ratio may be within the range of approximately 0.2 to 0.5. Table 1 shows typical values for wide-angle cameras included in recent smartphones. EFL, TTL, SD, and DA are shown in millimeters.
[0017] [Table 1]
[0018] In another example, camera 160 has f / # F-FOV It may also be a telephoto camera having a ratio of 1.75 to 5 and generally satisfying a telephoto ratio (TTL / EFL) of 0.7 to 1. The EFL may be in the range of 6mm to 50mm. For telephoto cameras, DA F-FOV The range may be within 2 to 10 mm, SD / DA F-FOV The ratio may be in the range of approximately 0.2 to 2, or 0.2 to 1, or 0.5 to 1. A telephoto camera included in a dual camera, such as the Dual Camera 150, has a zoom ratio ("ZF") relative to the wide-angle camera. The ZF is given by the ratio of the 35mm equivalent focal length of the telephoto camera to the 35mm equivalent focal length of the wide-angle camera, and may be in the range of 2x to 15x.
[0019] Table 2 shows typical values for telephoto cameras included in recent smartphones. EFL, SD, and DA are shown in millimeters. In Table 2, 3x telephoto cameras are non-folding cameras, and 5x telephoto cameras are folded cameras.
[0020] [Table 2]
[0021] In recent years, the spatial resolution (or "pixel" resolution) of image sensors included in multi-camera systems has increased dramatically, reaching 200 megapixels (MP) in 2022. Generally, image sensors with a resolution of approximately 30 MP or higher are configured to perform "pixel binning," as is well known in the art (Figures 1D-E). Such image sensors are referred to herein as "binning sensors." Pixel binning is a technique that combines (or "binned," "grouped," or "merged") multiple adjacent or "nearby" (smaller) pixels on an image sensor to function together as a single (larger) pixel.
[0022] Figure 1D shows a segment of the image sensor 170 containing four pixels numbered 1 to 4 in the first configuration. These four pixels capture scene information independently of each other. That is, when capturing an image, each of the four pixels 1 to 4 provides a different pixel value. We refer to this configuration as the "full resolution mode".
[0023] Figure 1E shows a segment of the image sensor 100 in the second configuration. Four pixels are combined into one pixel. That is, when capturing an image, the combined four pixels together provide a single pixel value. We refer to such a configuration as the "binning mode." Specifically, the second configuration in which four pixels are combined into one pixel is referred to as "4-binning." In other examples, nine pixels ("9-binning"), sixteen pixels ("16-binning"), or 1 / 36 ("36-binning") or more pixels may be combined into one pixel.
[0024] Generally, segments of a binning sensor, such as segment 170, are covered by a single (or uniform) color filter. That is, all pixels within the segment function to receive light of a specific color, or in other words, all pixels within the segment function to receive light within a specific wavelength range. For example, a segment may be covered by a single red filter ("R"), a single green filter ("G"), a single blue filter ("B"), or a single "white" or "transparent" color filter ("W" or "C") that transmits all colors. Specifically, this means that multiple adjacent pixels are covered by the same color filter. Note that this is generally not the case for image sensors that are not binning sensors, where adjacent pixels are generally covered by different color filters.
[0025] In binning mode, the spatial resolution of the binning sensor is reduced compared to its full-resolution mode. For example, in 4-binning (Figure 1E), the spatial resolution is 1 / 4 of the spatial resolution obtained in full-resolution mode (Figure 1D). In other examples, the spatial resolution in binning mode is 1 / 9 (9-binning), 1 / 16 (16-binning), or 1 / 36 (36-binning) of the spatial resolution obtained in full-resolution mode. Hereafter, when the binning sensor is operating in binning mode, it will be referred to as "binning resolution," and when it is operating in full-resolution mode, it will be referred to as "full resolution." In some examples, there may be further binning steps. For example, in a binning sensor capable of 16-binning and having a pixel resolution of 200 megapixels ("MP"), the first step may be 4-binning, resulting in a resolution of 50MP, which is 1 / 4 of the full resolution. In the second step, another 4-binning may be performed, resulting in a resolution of 12.5MP, which is 1 / 16 of the full resolution. For simplicity, the following discussion will only refer to the "binary" option for binning; that is, we will only distinguish between "binning resolution" and "full resolution." This means that, in light of the examples above, a 200MP pixel resolution is always referred to as "full resolution," and a 12.5MP pixel resolution is always referred to as "binning resolution." However, a 50MP pixel resolution may be referred to as "full resolution" when discussing a transition to (or from) a lower pixel resolution (12.5MP) in the first example, and may be referred to as "binning resolution" when discussing a transition to (or from) a higher pixel resolution (200MP) in the second example.
[0026] By changing the binning sensor mode from binning resolution to full resolution, a zoom effect is achieved because the same camera FOV segment is captured (or "imaged") by a larger number of pixels. For example, changing from 4-binning, 9-binning, 16-binning, and 36-binning to full resolution yields zoom effects of 2x, 3x, 4x, and 6x, respectively.
[0027] Low f / # is desirable for smartphone cameras. This is because such a low f / # offers three main advantages: good low-light sensitivity, a strong "natural" bokeh effect, and high image resolution. These will be explained below:
[0028] 1. Low-light sensitivity is a major performance drawback in today's mobile device cameras compared to, for example, digital single-lens reflex (DSLR) cameras. This is mainly due to their relatively small aperture diameter (DA). For example, doubling the camera's DA halves the camera's f / # (for the same EFL), which quadruples the aperture area, meaning four times more light enters the camera.
[0029] 2. Bokeh is the aesthetic quality of the blur produced in the out-of-focus segments of an image, and it is a highly sought-after feature in today's smartphones. The bokeh effect is inversely correlated with the depth of field (DOF) of an image, where DOF ~ f / #. A low f / # is beneficial for supporting a strong, "natural" bokeh effect.
[0030] 3. To convert pixel resolution to image resolution, the camera uses the pixel spatial frequency k of the image sensor. Pixel This must be supported. In a properly designed (diffraction-limited) camera lens, the resolvable spatial frequency k of the lens Lens k is inversely proportional to f / #. Lens ~ 1 / f / #. In other words, a lower f / # is required for higher pixel resolution.
[0031] A major challenge in low f / # cameras is designing lenses that can compensate for the strong optical aberrations (e.g., chromatic aberration) imposed by the required large forward aperture. Lower f / # can be achieved through more complex lens designs, such as those involving more lens elements. However, this generally leads to an increase in the total optical length (TTL) and, consequently, the camera's height, which is undesirable in thin mobile devices. Therefore, for f / #, there is a "de facto" lower limit defined by the height of the mobile device containing the camera and the specific camera FOV requirements, as shown in the examples in Tables 1-2. Generally, optical aberrations are lower (or "weaker") in the center of the camera's FOV and higher (or "stronger") towards the periphery of the camera's FOV.
[0032] Adapting the camera's DA according to scene conditions is necessary and beneficial for dynamically achieving a low f / #. Optical lens systems and methods for such cameras are disclosed herein. [Overview of the project]
[0033] In various exemplary embodiments, a camera system comprising a wide-angle camera and a processor is provided. The wide-angle camera has a lens comprising N (L1 to LN) lens elements and an image sensor having optical length (TTL), effective focal length (EFL), adaptive aperture (AA), and total sensor diagonal length (SD) in the range of 5 mm to 25 mm. Here, the wide-angle camera is a zoom camera with a ratio TTL / SD < 0.8. The wide-angle camera has a full-field-of-view (F-FOV) camera state and an F-FOV lens aperture diameter DA F-FOV It has, compared to DA F-FOV / SD is within the range of 0.2 to 0.5. The wide-angle camera is in a zoom field of view (Z-FOV) camera state that satisfies Z-FOV < F-FOV, and the Z-FOV lens aperture diameter DA Z-FOV , and SD Z < SD is the diagonal length of the zoom sensor SD ZIt has. For switching between F-FOV camera state and Z-FOV camera state, AA is DA Z-FOV ≥ 1.2 x DA F-FOV DA F-FOV and DA Z-FOV It functions to switch between and the SD, and the processor Z It functions to crop (cut out) the image sensor so that ≤ 0.8 x SD, and DA Z-FOV / SD Z > 1.5 x DA F-FOV It is / SD.
[0034] In some examples, N=8.
[0035] In some cases, wide-angle cameras exhibit f / # in F-FOV camera mode. F-FOV = EFL / DA F-FOV The F-number f / # given by F-FOV It has f / # F-FOV It is in the range of 1.5 to 8. In some examples, f / # F-FOV It is within the range of 1.5 to 2.5.
[0036] In some cases, 2mm ≤ EFL ≤ 15mm. In some cases, 2mm ≤ EFL ≤ 10mm. In some cases, 2mm ≤ EFL ≤ 7.5mm.
[0037] In some examples, DA Z-FOV ≥ 1.4 x DA F-FOV In some examples, DA Z-FOV ≥ 1.5 x DA F-FOV That is the case.
[0038] In some cases, TTL / SD < 0.75. In some cases, TTL / SD < 0.7.
[0039] In some examples, DA Z-FOV / SD Z-FOV> 2 x DA F-FOV / SD. In some examples, DA Z-FOV / SD Z-FOV > 3 x DA F-FOV / SD. In some examples, DA Z-FOV / SD Z-FOV > 4 x DA F-FOV / SD. In some examples, DA Z-FOV / SD Z-FOV > 5 x DA F-FOV It is / SD.
[0040] In some cases, wide-angle cameras have an F-number f / # in F-FOV camera mode. F-FOV and the f-number f / # in Z-FOV camera mode Z-FOV It has f / # F-FOV / f / # Z-FOV > 1.25. In some examples, f / # F-FOV / f / # Z-FOV > 1.4. In some examples, f / # F-FOV / f / # Z-FOV > 1.5. In some examples, f / # F-FOV / f / # Z-FOV > 1.6.
[0041] In some cases, 7.5mm ≤ SD ≤ 20mm. In some cases, 7.5mm ≤ SD ≤ 15mm.
[0042] In some cases, the transition between the F-FOV camera state and the Z-FOV camera state is discrete, and the wide-angle camera is a two-state virtual zoom camera. In some cases, the transition is discrete, and the wide-angle camera is a multi-state virtual zoom camera. In some cases, the transition is continuous, and the wide-angle camera is a continuous virtual zoom camera.
[0043] In some examples, the imaging sensor is a binning sensor. In some examples, the imaging sensor is a 4-binning sensor. In some examples, the imaging sensor is a 9-binning sensor. In some examples, the imaging sensor is a 16-binning sensor.
[0044] In some cases, the image sensor operates at a first pixel resolution in F-FOV camera mode, and at a second pixel resolution higher than the first pixel resolution in Z-FOV camera mode.
[0045] In some cases, the image sensor operates at a resolution corresponding to a total sensor pixel resolution of 12.5MP or more in Z-FOV camera mode. In some cases, the image sensor operates at a resolution corresponding to a total sensor pixel resolution of 50MP or more in Z-FOV camera mode. In some cases, the image sensor operates at a resolution corresponding to a total sensor pixel resolution of 100MP or more. In some cases, the image sensor operates at a resolution corresponding to a total sensor pixel resolution of 200MP or more. In some cases, the image sensor operates at a resolution corresponding to a total sensor pixel resolution of 300MP or more.
[0046] In some examples, AA is positioned on the subject side of multiple lens elements. In some examples, AA is positioned between two of the multiple lens elements. In some examples, AA is positioned between L3 and L4.
[0047] In various exemplary embodiments, a camera system comprising a telephoto camera and a processor is provided. The telephoto camera has a lens comprising N lens elements L1 to LN and an image sensor having an optical length (TTL), an effective focal length (EFL) in the range of 6 mm to 50 mm, an adaptive aperture (AA), and a total sensor diagonal length (SD). Here, the telephoto camera is a zoom camera with a ratio TTL / EFL < 1.1. The telephoto camera has a full field-of-view (F-FOV) camera state and an F-FOV lens aperture diameter DA F-FOV It has, compared to DAF-FOV / SD is within the range of 0.2 to 1. The tele camera is in a zoom field of view Z-FOV camera state satisfying Z-FOV < F-FOV, a Z-FOV lens aperture diameter DA Z-FOV , and SD Z-FOV is the Z-FOV sensor diagonal length SD where SD Z-FOV < SD. For switching between the F-FOV camera state and the Z-FOV camera state, AA is such that DA Z-FOV ≧ 1.2 x DA F-FOV and DA F-FOV and DA Z-FOV are switched between so as to function, and the processor functions to crop the imaging sensor such that SD Z-FOV ≦ 0.8 x SD, and DA Z-FOV / SD Z-FOV > 1.5 x DA F-FOV / SD.
[0048] In some examples, N = 8.
[0049] In some examples, the tele camera has an F-number f / # F-FOV = EFL / DA F-FOV given by the F-number f / # F-FOV where f / # F-FOV is within the range of 1.5 to 8. In some examples, f / # F-FOV is within the range of 2 to 5.
[0050] In some examples, TTL / EFL < 1.05. In some examples, TTL / EFL < 1.
[0051] In some examples, DA Z-FOV ≧ 1.3 x DA F-FOV is true. In some examples, DA Z-FOV ≧ 1.4 x DA F-FOV is true. In some examples, DA Z-FOV ≧ 1.5 x DA F-FOV is true. In some examples, DA Z-FOV≧ 1.6 x DA F-FOV is satisfied.
[0052] In some examples, DA Z-FOV / SD F-FOV > 2 x DA F-FOV / SD is satisfied. In some examples, DA Z-FOV / SD Z-FOV > 3 x DA F-FOV / SD is satisfied. In some examples, DA Z-FOV / SD Z-FOV > 3.5 x DA F-FOV / SD is satisfied.
[0053] In some examples, the telephoto camera has an F - value f / # in the F - FOV camera state F-FOV and a Z - FOV F - value f / # in the Z - FOV camera state Z-FOV such that f / # F-FOV / f / # Z-FOV > 1.25. In some examples, f / # F-FOV / f / # Z-FOV > 1.4. f / # F-FOV / f / # Z-FOV > 1.6. f / # F-FOV / f / # Z-FOV > 1.7.
[0054] In some examples, 7.5mm ≦ EFL ≦ 25mm. In some examples, 7.5mm ≦ EFL ≦ 15mm.
[0055] In some examples, 5mm ≦ SD ≦ 17mm. In some examples, 5mm ≦ SD ≦ 14mm.
[0056] In some cases, the transition between the F-FOV camera state and the Z-FOV camera state is discrete, and the telephoto camera is a two-state virtual zoom camera. In some cases, the transition is discrete, and the telephoto camera is a multi-state virtual zoom camera. In some cases, the transition between the F-FOV camera state and the Z-FOV camera state is continuous, and the telephoto camera is a continuous virtual zoom camera.
[0057] In some examples, the imaging sensor is a binning sensor. In some examples, the imaging sensor is a 4-binning sensor. In some examples, the imaging sensor is a 9-binning sensor. In some examples, the imaging sensor is a 16-binning sensor.
[0058] In some cases, in F-FOV camera mode, the image sensor operates at a first pixel resolution, and in Z-FOV camera mode, the image sensor operates at a second pixel resolution higher than the first pixel resolution.
[0059] In some cases, in Z-FOV camera mode, the image sensor operates at a pixel resolution corresponding to a total sensor pixel resolution of 12.5MP or higher. In some cases, in Z-FOV camera mode, the image sensor operates at a pixel resolution corresponding to a total sensor pixel resolution of 50MP or higher. In some cases, in Z-FOV camera mode, the image sensor operates at a pixel resolution corresponding to a total sensor pixel resolution of 100MP or higher. In some cases, in Z-FOV camera mode, the image sensor operates at a pixel resolution corresponding to a total sensor pixel resolution of 200MP or higher. In some cases, in Z-FOV camera mode, the image sensor operates at a pixel resolution corresponding to a total sensor pixel resolution of 300MP or higher.
[0060] In some examples, AA is positioned on the subject side of multiple lens elements. In some examples, AA is positioned between two of the multiple lens elements.
[0061] In various exemplary embodiments, a camera system comprising a camera and a processor is provided. The camera comprises a lens including a plurality of lens elements having an optical length (TTL) and effective focal length (EFL) in the range of 2.5 mm to 50 mm, an adaptive aperture (AA), and an image sensor having a total sensor diagonal length (SD) in the range of 5 mm to 25 mm, wherein the camera is a virtual zoom camera. Here, the camera is in full field of view (F-FOV) camera state, F-FOV lens aperture diameter DA F-FOV , and f / # F-FOV = EFL / DA F-FOV F-FOV F-number f / # that satisfies the conditions F-FOV It has, here f / # F-FOV The range is 1.2 to 8. The camera is in a zoom field of view (Z-FOV) camera state that satisfies Z-FOV < F-FOV, and the Z-FOV lens aperture diameter DA Z-FOV Z-FOV sensor diagonal length SD Z-FOV , and f / # Z-FOV = EFL / DA Z-FOV Z-FOV F-number f / # that satisfies the following conditions Z-FOV It has. For switching between F-FOV camera state and Z-FOV camera state, AA is DA Z-FOV ≥ 1.2x DA F-FOV DA F-FOV and DA Z-FOV It functions to switch between the two, and the processor is SD Z-FOV It functions to crop the image sensor so that ≤ 1.2x SD, and f / # F-FOV / f / # Z-FOV > 1.25.
[0062] In some examples, f / # F-FOV / f / # Z-FOV > 1.4. In some examples, f / # F-FOV / f / # Z-FOV > 1.5. In some examples, f / # F-FOV / f / # Z-FOV > 1.6. In some examples, f / # F-FOV / f / # Z-FOV > 1.6. In some examples, f / # F-FOV / f / # Z-FOV The value is ≥ 1.75.
[0063] In some cases, 2.5 mm ≤ EFL ≤ 15 mm. In some cases, 7.5 mm ≤ EFL ≤ 30 mm.
[0064] In some cases, 7.5mm ≤ SD ≤ 15mm.
[0065] In some cases, the virtual zoom camera is a wide-angle camera and SD / TTL < 0.8. In some cases, SD / TTL < 0.7.
[0066] In some cases, the virtual zoom camera is a telephoto camera, and EFL / TTL < 1.
[0067] In some examples, DA Z-FOV ≥ 1.5x DA F-FOV In some examples, DA Z-FOV ≥ 1.6x DA F-FOV That is the case.
[0068] In some examples, the imaging sensor is a binning sensor. In some examples, the imaging sensor is a 4-binning sensor. In some examples, the imaging sensor is a 9-binning sensor. In some examples, the imaging sensor is a 16-binning sensor.
[0069] In some cases, the image sensor operates at a first pixel resolution in F-FOV camera mode, and at a second pixel resolution higher than the first pixel resolution in Z-FOV camera mode.
[0070] In some cases, the image sensor operates at a resolution corresponding to a total sensor pixel resolution of 12.5MP or more in Z-FOV camera mode. In some cases, the image sensor operates at a resolution corresponding to a total sensor pixel resolution of 50MP or more in Z-FOV camera mode. In some cases, the image sensor operates at a resolution corresponding to a total sensor pixel resolution of 100MP or more in Z-FOV camera mode. In some cases, the image sensor operates at a resolution corresponding to a total sensor pixel resolution of 200MP or more in Z-FOV camera mode. In some cases, the image sensor operates at a resolution corresponding to a total sensor pixel resolution of 300MP or more in Z-FOV camera mode.
[0071] In some examples, AA is positioned on the subject side of multiple lens elements. In some examples, AA is positioned between two of the multiple lens elements.
[0072] In various exemplary embodiments, a camera is provided comprising: a lens having a plurality of lens elements arranged along the optical axis of the lens and having an effective focal length EFL in the range of 1 mm to 50 mm; an image sensor; an adaptive aperture AA having an adaptive aperture diameter DA for receiving light from a scene; an actuator; and an adaptive aperture actuator including a diaphragm having a concentric hole having a hole diameter HD defining the AA. Here, the camera has an F-number f / # = EFL / DA, and the actuator is configured to extend and relax the diaphragm, respectively, to increase or decrease the HD to control the F-number.
[0073] In some cases, 5mm ≤ EFL ≤ 30mm.
[0074] In some examples, the diaphragm has an L-shape. In some examples, the diaphragm includes a plurality of wires. In some examples, the plurality of wires define a stationary region and an extended region, the extended region defining the HD.
[0075] In some examples, the actuator includes at least one voice coil motor (VCM), for example, one, two, or four VCMs.
[0076] In some examples, the actuator includes a stamp (stamping member).
[0077] In some cases, the DA is continuously adaptable. In some cases, the DA is discretely adaptable. In some cases, the DA is symmetrically adaptable. In some cases, the DA is asymmetrically adaptable.
[0078] In some cases, the HD is the smallest size HD in the range of 0.25mm - 5mm. MIN It has. In some cases, 0.5mm ≤ HD MIN The limit is ≤ 2.5 mm.
[0079] In some cases, the HD is the maximum size HD within the range of 2.5mm - 15mm. MAX It has. In some cases, 4mm ≤ HD MAX The value is ≤ 12mm.
[0080] In some examples, the AA is positioned on the subject side of the lens. In some examples, the AA is positioned between two of the plurality of lens elements.
[0081] In some cases, 1.0 ≤ f / # MIN ≤ 5.0. In some examples, 1.4 ≤ f / # MIN The value is ≤ 2.5.
[0082] In some cases, 2.5 ≤ f / # MAX The value is ≤ 50.
[0083] In some cases, the imaging sensor has a total imaging sensor diagonal length SD, and TTL / SD ≤ 0.8. In some cases, TTL / SD ≤ 0.7.
[0084] In some cases, TTL / EFL ≤ 1. In some cases, TTL / EFL ≤ 0.9.
[0085] In some cases, the total optical length TTL is in the range of 2.5 mm to 15 mm. In some cases, the TTL is in the range of 5 mm to 10 mm.
[0086] In some examples, the camera height H is within the range of 3mm to 20mm. CAM It has H CAM The range is 5mm to 12.5mm.
[0087] In various embodiments, any of the above or below-described cameras and / or camera systems may be included in a mobile device, such as a smartphone. [Brief explanation of the drawing]
[0088] Non-limiting examples of embodiments disclosed herein are described below with reference to the drawings accompanying this specification, which are listed after this paragraph. The drawings and descriptions are intended to illuminate and clarify the embodiments disclosed herein and should not be considered limiting in any sense. Similar elements in different drawings may be indicated by similar reference numerals. Elements in the drawings are not necessarily drawn to a consistent scale.
[0089] [Figure 1A]This illustrates a known dual-camera setup that includes a bent camera alongside an upright (non-bent) camera. [Figure 1B] A known camera is illustrated with a cross-sectional view. [Figure 1C] Figure 1B shows a known camera in a top view. [Figure 1D] This shows the segments of known imaging sensors in full resolution mode. [Figure 1E] This shows segments of known imaging sensors in binning mode. [Figure 2A] An example of a binning sensor is shown. [Figure 2B] An example of a low f / # virtual zoom camera disclosed herein is schematically illustrated in a cross-sectional view. [Figure 2C] Figure 2B shows a top view of the low f / # virtual zoom camera. [Figure 2D] The steps of the method disclosed herein are shown. [Figure 3A] A camera capable of operating as a virtual zoom camera as disclosed herein is shown in the first camera state. [Figure 3B] Figure 3A shows the camera in the second camera state. [Figure 3C] Another camera capable of operating as a virtual zoom camera as disclosed herein is shown in the first camera state. [Figure 3D] Figure 3C shows another camera in the second camera state. [Figure 4] This specification schematically illustrates embodiments of a mobile device configured to perform the methods disclosed herein. [Figure 5A] An optical lens system capable of operating as a 3x (3x) virtual zoom camera disclosed herein is shown in a first camera state. [Figure 5B] Figure 5A shows the optical lens system in the second camera configuration. [Figure 6A]An optical lens system capable of operating as a 4x (4x) virtual zoom camera as disclosed herein is shown in a first camera state. [Figure 6B] Figure 6A shows the optical lens system in the second camera state. [Figure 7A] A camera including the adaptive aperture actuator ("AAA") disclosed herein is schematically illustrated in a cross-sectional view. [Figure 7B] A diaphragm disclosed herein is schematically illustrated in the top view. [Figure 7C] Another camera including the adaptive aperture actuator ("AAA") disclosed herein is schematically illustrated in a cross-sectional view. [Figure 7D] The sliders disclosed herein are illustrated in cross-sectional views. [Figure 7E] Further cameras, including the AAA disclosed herein, are schematically illustrated in cross-sectional views. [Figure 7F] This illustrates yet another camera with a diaphragm in a non-extended state. [Figure 7G] Figure 7F illustrates yet another camera with an extended diaphragm. [Figure 8A] An adaptive aperture actuator ("AAA") disclosed herein is shown in a perspective view. [Figure 8B] Figure 8A shows AAA as a cross-sectional perspective view in the first state. [Figure 8C] The AAA component in Figure 8A is shown in a perspective view. [Figure 8D] Figure 8A shows AAA in a perspective view of the second state. [Figure 8E] Figure 8D shows AAA in a cross-sectional perspective view. [Figure 8F] Figure 8D shows other components of AAA in a perspective view. [Figure 8G] Figure 8D shows other components of AAA in a perspective view. [Figure 8H]Figure 8A shows other components of AAA in a perspective view. [Figure 9A] An optical lens system capable of operating as a 2x (2x) virtual zoom camera as disclosed herein is shown in a first camera state. [Figure 9B] The optical lens system in Figure 9A is shown in the second camera configuration. [Figure 10A] Another optical lens system capable of operating as a 2x (2x) virtual zoom camera as disclosed herein is shown in the first camera configuration. [Figure 10B] Figure 10A shows the optical lens system in the second camera configuration. [Modes for carrying out the invention]
[0090] The following detailed description includes numerous specific details to provide a complete understanding. However, as those skilled in the art will understand, the subject matter currently disclosed can be carried out without these specific details. In other examples, known methods are not described in detail so as not to obscure the subject matter currently disclosed.
[0091] Certain features of the currently disclosed subject matter are described in the context of individual embodiments for clarity, but it is understood that they may also be provided in combination in a single embodiment. Conversely, various features of the currently disclosed subject matter described in the context of a single embodiment for brevity may also be provided individually or in any appropriate subcombination.
[0092] Figure 2A illustrates an example of a binning sensor 200. The first "binning resolution" sensor segment 202 (or "S BinnedIn the first sensor segment 202 (which here illustrates the entire binning sensor 200), the binning sensor 200 is captured at binning resolution. In the second "full resolution" sensor segment 204 (or "S"), the binning sensor 200 is used in binning mode. Full In the first sensor segment (where it is exemplified and centrally located), the segment of the binning sensor 200 is captured at full resolution. In the second sensor segment 204, the binning sensor 200 is used in full resolution mode. The binning sensor 200 may function to switch any sensor segment from binning mode to full resolution mode and vice versa. A single camera including the binning sensor 200 may be configured to capture images (or video streams of images) in different binning modes sequentially or simultaneously. For example, a single camera may be configured to capture S Binned The camera may be configured to capture an image or a video stream of an image at binning resolution, which are referred to as the “binning image” and the “binning video stream,” respectively. A single camera may also be configured to capture an image or video stream of an image at binning resolution. Full The camera may be configured to capture an image or a video stream of an image at full resolution, which are referred to as the “full-resolution image” and the “full-resolution video stream,” respectively. In some examples, instead of only one sensor segment, such as the second sensor segment 204, operating (or readout) to provide the full-resolution image, two, three, or more different sensor segments may operate simultaneously to provide the full-resolution image. In some examples, the size of the second sensor segment 204 may be constant (or fixed). In other examples, the size of the second sensor segment 204 may be variable. The camera may also have S Binned To capture an image or video stream of an image at binning resolution, and in addition to this, simultaneously or sequentially, S FullThe system may be configured to capture both an image or a video stream of an image at full resolution, thereby obtaining a "dual-resolution image" and a "dual-resolution video stream," respectively. In some examples where a specific pixel resolution is required, along with a second sensor segment 204 of variable size, the image may be upsampled or downsampled depending on the size of the second sensor segment 204 so that the specific pixel resolution is achieved. Referring to the above example, this can be achieved, for example, by:
[0093] 1. When the second sensor segment 204 corresponds to the entire binning sensor 200, the imaging sensor operates in 16-binning mode. For example, the image output to the user will be a binning resolution image with a pixel resolution of 12.5 MP.
[0094] 2. If the second sensor segment 204 represents an area larger than 1 / 4 of the binning sensor 200, the imaging sensor may be used in 4-binning mode. For example, the image output to the user may be downsampled to achieve a pixel resolution of 12.5 MP.
[0095] 3. If the second sensor segment 204 represents an area smaller than 1 / 4 of the binning sensor 200 and larger than 1 / 16 of the binning sensor 200, the imaging sensor may be used in full resolution mode. For example, the image output displayed to the user may be downsampled to achieve a pixel resolution of 12.5 MP.
[0096] Although the binning mode changes discretely, users perceive (or feel) a continuous zoom-in operation. Typical ranges for the total sensor pixel resolution are as follows: • For 4-binning sensors, the resolution is 30MP to 60MP. • For 9-binning sensors, the resolution is 75MP to 130MP. • For 16-binning sensors, the range is 150MP to 250MP. • For 36-binning sensors, 250MP to 500MP or higher.
[0097] An image or video stream of an image may be output at one or more fixed (or constant) specific pixel resolutions. For example, a specific pixel resolution for still image capture may be around 12MP, i.e., in the range of 11MP to 13MP, or around 50MP, i.e., in the range of 48MP to 52MP. A specific pixel resolution for video capture may be around 33MP (in the range of 32MP to 34MP) for "8K video", around 8MP (in the range of 7MP to 9MP) for "4K video", or around 2MP (in the range of 1.5MP to 2.5MP) for "2K video". In video capture, each frame (or single image) of the video stream has the aforementioned specific resolution. The frame rate of the video stream may range from 5 frames per second ("fps") to 500fps. Typically, the video frame rate may range from 15fps to 60fps.
[0098] Figure 2B includes a lens such as lens 162 and an image sensor such as image sensor 164, and in the cross-sectional view, the "zoom" sensor diagonal length SD ZFigure 2C schematically illustrates a low f-number virtual zoom camera 210 disclosed herein, having the following characteristics. Figure 2C illustrates the camera 210 of Figure 2B in a top view. The image sensor 164 is used only partially for imaging, representing a “zoom field of view” (or “Z-FOV”) state of a camera such as camera 160. In the Z-FOV state, camera 210 represents another camera state of camera 160. That is, camera 160 and camera 210 represent two different states of the same (single) camera. This same camera can be switched between camera 160 and camera 210 (states) by using an adaptive aperture (“AA”, Figures 3A-D, 7A-G, 8A-H) and by cropping the image sensor 164, as discussed with respect to Figure 2C. For clarity, camera 210 also images light from the field of view (FOV) 166 onto the entire image sensor 164. However, as indicated by the optical cone 218, only the central portion (or "segment") of the image sensor 164 corresponding to the FOV 216 may be used for imaging. The diagonal size of this central portion is the image sensor SD Z This represents SD. In some examples, Z is SD Z = is given by SD / ZF, where ZF corresponds to the zoom magnification relative to the F-FOV state.
[0099] Camera 210 is DA Z-FOV F-number f / # Z-FOV = EFL / DA Z-FOV , and has an FOV 216 indicated by angle β. Compared to camera 160, camera 210 may satisfy the following conditions: EFL is the same, FOV 216 < FOV 166 (i.e., β < α), SD Z-FOV <SD F-FOV , and DA Z-FOV > DA F-FOV And as a result, f / # Z-FOV < f / # F-FOV As discussed, a smaller f-number is desirable. Specifically, cameras 210 and 160 can satisfy the following range: SD F-FOV / SDZ-FOV = 1.2 ~ 10, and DA Z-FOV / DA F-FOV = 1.2 ~ 3 or more, DA Z-FOV / SD Z-FOV > 1.5 x DA F-FOV / SD F-FOV As a result, f / # F-FOV / f / # Z-FOV = 1.2 ~ 4. Since FOV 216 < FOV 166, camera 160 may be called a normal camera and camera 210 a zoom camera or "virtual" zoom camera. Therefore, camera 210 represents a low f-number virtual zoom camera.
[0100] As mentioned above, optical aberrations are lower in the center of the camera's FOV and higher towards the periphery of the camera's FOV. In Z-FOV mode, SD Z-FOV <SD F-FOV Therefore, the optical aberrations that lens 162 needs to correct are fewer (or lower). This fact means that DA does not necessarily impair the optical performance at the relevant FOV. Z-FOV > DA F-FOV This makes it possible to do so. By limiting the FOV of camera 210, lens 162 does not need to correct aberrations in the peripheral part of FOV 166, and only needs to correct aberrations present when FOV 216 < FOV 166. Therefore, camera 210 can achieve a lower F-number compared to camera 160 without adversely affecting the image quality of camera 210. In other words, there is a first de facto lower limit for the F-number for camera 160, and a second de facto lower limit for the F-number for camera 210, where the second de facto lower limit is lower than the first de facto lower limit.
[0101] The low f-number virtual zoom camera 210 may be a wide-angle camera or a telephoto camera. In some examples of wide-angle cameras, camera 210 may have f / # = 1.5 to 2.5 or 1.2 to 3. For wide-angle cameras, DA Z-FOVThe range may be 2.5 to 12.5 mm. In the example of a telephoto camera, camera 210 may be a telephoto camera having f / # = 1.75 to 5, or 1 to 6, DA Z-FOV It may be within the range of 2.5 to 15 mm or more.
[0102] In some examples, a single (identical) camera may be discretely (or "discontinuously") switched between camera 160 and camera 210. That is, camera 160 and camera 210 have two characteristic camera states, namely, f / # in the F-FOV state. F-FOV and the f / # when using the imaging sensor 164 or in the Z-FOV state. Z-FOV And, when using the image sensor 214, it functions to capture images and video streams of images. A camera in such an example is referred to as a "two-state virtual zoom camera".
[0103] In other examples, a single (identical) camera may be discretely switched between the states of camera 160 and camera 210, but there may be one or more additional intermediate camera states between these two characteristic camera states. Cameras in such examples are referred to as "multi-state virtual zoom cameras."
[0104] In yet another example, a single (identical) camera may be continuously switched between the states of camera 160 and camera 210. That is, any intermediate state between the two characteristic camera states may be operable. The camera in such an example is referred to as a "continuous virtual zoom camera."
[0105] Figure 2D shows steps of an embodiment of a method for implementing a low f-number virtual zoom camera disclosed herein. Method 220 may be performed in a mobile device such as a mobile device 400 (Figure 4) which includes at least one camera having AA, a processor such as an application processor ("AP") 430, and (optionally) a binning sensor. Method 220 is referred to as the method for “low f-number virtual zoom photography”.
[0106] In step 222, the user points the mobile device at the scene; that is, the user “targets” the scene. The camera captures image data, such as a continuous stream of images (or “video stream”) or a single image. Since the binning sensor and generally the camera sensor are used in binning mode in step 222, the captured image data is referred to as “binning image data”. The user may input (or “send” or “select”) the desired zoom scenario for the scene, generally by touching (or “pinch” or “slide”) the touchscreen. In other examples, the user may input the desired zoom scenario for the scene using voice commands, gesture commands, gaze commands, etc.
[0107] In the optional step 224, the processor is configured to analyze image data of a desired zoom scenario of the scene to obtain scene information. Examples of such scene analysis may include detection of brightness, depth, etc. Other examples of scene analysis may include object detection, person detection, calculation of spleness maps, face detection, object motion detection, and detection of aesthetic image composition. In some examples, the processor may be configured to suggest (or “present”) aesthetic image composition to the user related to the zoom scenario.
[0108] In some instances referred to as "automatic bokeh photography," the processor may be configured to define (or suggest) a beneficial DA (i.e., f-number) and, optionally, a beneficial zoom range (i.e., SD) for bokeh photography based on scene analysis. As is known, low f-numbers are beneficial for supporting strong "natural" bokeh. In addition, in bokeh photography, image quality at the periphery of the camera's FOV (where optical aberrations that can be induced by lower f-numbers are higher than in the center of the camera's FOV) is generally less important. This is especially true when used in conjunction with methods known as "artificial bokeh" or "portrait mode," which artificially blur areas of the image that do not contain the target object. For example, in scene analysis, the image size and position of the target object on the image sensor may be estimated. The size and position estimates may be used to define a beneficial DA, where a larger image size corresponds to a smaller DA, and vice versa.
[0109] In some instances referred to as "action video shooting," the processor may be configured to define a useful DA and, optionally, a useful zoom region for capturing tracking video of a moving object, based on scene analysis. A low f-number is beneficial to support relatively high frame rates due to the high amount of light per unit time. In addition, when a user tracks a moving object with a mobile device, i.e., when a user "pans" the mobile device to keep the moving object within the camera's FOV, the background blurs. Therefore, high image quality at the edges of the camera's FOV is generally not required.
[0110] In some instances referred to as "full-focus macro photography," the processor may be configured to define a beneficial DA (i.e., f-number) and optionally a beneficial zoom range (i.e., SD) for macro (or "close-up") photography based on scene analysis. In macro photography, a relatively small target object is typically captured from a relatively small object-to-lens distance "u," for example, 2.5 cm to 50 cm. DOF ~ u2 Therefore, in macro photography, it is often difficult to capture the entire target object in focus. To overcome this challenge, the processor may be configured to propose a DA that provides a relatively large DA in order to achieve the entire target object in focus and a relatively high SNR, or to obtain a relatively strong bokeh effect.
[0111] In some examples referred to as "eye-tracking focus," the processor may be configured to primarily focus the camera on the area of the person's eyes when capturing a portrait image at a relatively low f-number. Due to the relatively shallow depth of field (DOF), some (depth) ranges of the face may be slightly out of focus. Scene analysis may include detecting the person's eyes.
[0112] In step 226, a desired zoom scenario is selected. The selection is made according to user input (step 222) or according to a processor suggestion (step 224, if implemented).
[0113] In step 228, the processor is configured to configure camera AA. By configuring camera AA, the camera can be switched between two camera states, namely camera 160 and camera 210 (Figures 3A-D). The switching may be as described for two-state virtual zoom cameras, multi-state virtual zoom cameras, or continuous virtual zoom cameras.
[0114] With respect to the binning sensor, in step 232, the processor is configured to configure the camera's binning sensor. When switching between camera 160 and camera 210, the camera sensor may be switched between binning mode and full resolution mode. In this context, two considerations are noted that relate to both the size of a single pixel and the camera's F-number. The first consideration concerns the camera's maximum achievable image resolution (or "diffraction limit"), as discussed in the background art. The second consideration concerns the camera's signal-to-noise ratio ("SNR").
[0115] Diffraction limit of the camera
[0116] In some cases, when the camera operates as camera 160, the f-number may be sufficient to resolve (or "utilize") the larger combined pixels. However, the camera's f-number may be insufficient to resolve a single, smaller pixel. By switching to camera 210, the associated lower f-number may enable the resolution of the single, smaller pixel.
[0117] In some cases, when the camera operates as camera 160, it can only be used in binning resolution mode. This is because, for example, the full pixel resolution is not resolvable anyway. The camera can only be used in full resolution mode when operating as camera 210.
[0118] Camera's SNR (Signal-to-Noise Ratio)
[0119] Note that in full-resolution mode, the area size (or "area") of a single pixel is reduced. The reduction in area of a single smaller pixel compared to a larger combined pixel follows the number of pixels combined in each binning mode. For 4-binning, the area reduction is 4 times; for 9-binning, it is 9 times; for 16-binning, it is 16 times; and for 36-binning, it is 36 times. The area reduction results in a decrease in the amount of light incident on (or "collected") a single smaller pixel, which is measured, for example, by the number of photons incident on a single smaller pixel per unit time. The attenuation of a single smaller pixel is scaled according to the pixel area of that single smaller pixel.
[0120] It should be noted that the lower f-number achieved when switching from camera 160 to camera 210 can partially compensate for (or "mitigate") the reduction in light per pixel. This is particularly beneficial in relatively low-light (or "dark") scenes, such as many indoor and nighttime scenes. Generally, the signal-to-noise ratio (SNR) of a single image sensor pixel behaves differently in low-light and bright scenes. In low-light scenes, the SNR increases almost linearly with light intensity. The dominant noise in low-light scenes is referred to as "random noise" or "readout noise." In bright scenes, the SNR increases almost according to the square root of light intensity. The dominant noise in bright scenes is referred to as "shot noise."
[0121] In the first example, assume that a 4-binned combined large pixel is switched to four single small pixels, resulting in a fourfold reduction in the amount of light incident on the single small pixels compared to the combined large pixel. Without any changes to the camera, this corresponds to a fourfold decrease in SNR in low-light scenes. Increase the camera aperture DA by approximately 1.4 times (i.e., DA Z-FOV / DA F-FOV= 1.4), and the aperture area doubles, meaning twice as much light enters the camera. Overall, the amount of light entering a single small pixel is only twice as much as that entering a combined large pixel. In low-light scenes, this corresponds to only a twofold decrease in SNR. In bright scenes, this corresponds to a 2.8fold decrease in SNR. In the second example, four binned combined large pixels are switched to four single small pixels, and the camera's DA increases by approximately 1.7 times (i.e., DA Z-FOV / DA F-FOV = 1.7) which can occur, resulting in a threefold increase in the camera's aperture area. Overall, the amount of light incident on a single small pixel is reduced by only 1.3 times compared to a combined large pixel. In low-light scenes, this corresponds to a mere 1.3 times decrease in SNR. In bright scenes, this corresponds to a 2.3 times decrease in SNR. Therefore, in the third example, the 4-binned combined large pixel is switched to 4 single small pixels, and the camera's DA increases by approximately 2 times (i.e., DA Z-FOV / DA F-FOV This can sometimes result in a value of 2.0. This means that there is no decrease in SNR for combined large pixels.
[0122] Step 232 is optional. Note that even for "normal" image sensors where pixel binning is not possible, the decrease in F-number due to increasing DA is beneficial to the SNR of the pixels contained in those normal image sensors. Example 1 (DA Z-FOV / DA F-FOV Referring to (1.4), a 2x and 1.4x increase in pixel SNR is achieved in low-light scenes and bright scenes, respectively.
[0123] In step 234, the mobile device is configured to use the camera to capture the desired zoom scenario of the scene. For the binning sensor, the desired zoom scenario of the scene is generally captured at full resolution.
[0124] Figure 3A schematically illustrates a camera 300 including an adaptive aperture ("AA") mechanism that functions to perform low f-number virtual zoom shooting as disclosed herein. The camera 300 comprises a lens 302 having multiple lens elements L1-L5 and an effective focal length EFL, an image sensor 304 having an image sensor diagonal length ("SD"), and an AA 310. The camera 300 is shown in a first camera state, where the AA 310 is relatively closed, resulting in DA F-FOV An aperture diameter like the following is achieved. The entire SD of the image sensor 304 is used, and the F-number is f / #1 = EFL / DA F-FOV This is given by f / #1.
[0125] Figure 3B schematically illustrates camera 300 in Figure 3A in the second camera state. AA 310 is relatively open, and as a result, DA 210 > DA F-FOV An aperture diameter such as the SD of the central part of the imaging sensor 304 is achieved. 210 Only is used, and the F-value is given by f / #2 = EFL / DA210 < f / #1.
[0126] As you can see, the AA 310 is positioned between two of the multiple lens elements. In this example, the AA 310 is positioned between L2 and L3.
[0127] Figure 3C schematically illustrates another camera 320 that includes the AA mechanism disclosed herein and functions to perform low f-number virtual zoom shooting disclosed herein. Camera 320 is shown in a first camera state having f / #1. Figure 3D schematically illustrates the camera 320 of Figure 3C in a second camera state. In the second camera state, camera 320 has f / #2 < f / #1. As can be seen, the AA 322 is located on the subject side of lens 302.
[0128] Figure 4 schematically shows an embodiment of a mobile device (e.g., a smartphone) denoted 400 configured to perform low f-number virtual zoom photography as disclosed herein. The mobile device 400 comprises a first camera 410 having a field of view (FOV) 1 and including a first lens 412, a first image sensor 414, and an AA mechanism 416. The first image sensor 414 may be a binning sensor. Optionally, the mobile device 400 further comprises a second camera 420 having a field of view (FOV) 2 and including a second lens 422 and a second image sensor 424. In some examples, the first camera 410 may be a wide-angle camera having an FOV 1 = 60-100 degrees, an effective focal length ("EFL") of EFL 1 = 3mm-15mm, and an SD in the range of 5mm to 25mm. In other examples, the first camera 410 may be a telephoto camera having an FOV 1 = 5-60 degrees and an EFL 1 = 7mm-50mm. The optional second camera 420 may be an ultra-wide-angle camera with an FOV2 of 100 to 180 degrees and an EFL2 of 1.5 mm to 7.5 mm, or it may be a telephoto camera.
[0129] The mobile device 400 further includes an AP 430, which includes an (optional) scene analyzer 432 configured to analyze image data of a scene to provide scene information, for example, as detailed in step 224; a zoom selector 434 configured to perform zoom region selection, as detailed in step 226; an aperture control unit 436 configured to control the AA 416, as detailed in step 228; and an (optional) sensor control unit 438 configured to configure a binning sensor, as detailed in step 232.
[0130] The mobile device 400 further includes a screen 440 for displaying information to the user and receiving user input. The screen 440 may be a touchscreen configured to detect specific locations touched by the user or to detect specific touch patterns of the user. The mobile device 400 further includes a memory 450 for storing, for example, image data for an image gallery or calibration data between the first camera 410 and the second camera 420. The mobile device 400 may further include several additional sensors for acquiring additional information. For example, the additional sensors may be a microphone or directional microphone, a position sensor such as a GPS, an inertial measurement unit (IMU), etc.
[0131] All optical lens systems disclosed below function to perform low f-number virtual zoom photography as disclosed herein, and the resulting low f-number virtual zoom camera may be used in mobile devices such as mobile device 400. For clarification, all examples of optical lens systems disclosed herein are useful for use in smartphones, tablets, etc. The numerical values and dimensions of cameras and mobile devices, including optical lens systems used in wide-angle cameras, are presented in Table 3 herein, and the optical lens systems used in telephoto cameras are presented in Table 4 herein. • "N" indicates the number of lens elements in the lens. • SD is the diagonal length of the image sensor (unit: mm). • "DA" indicates the aperture diameter (unit: mm). The (diagonal) field of view ("FOV") is expressed in degrees. • "ZF" indicates the zoom magnification. · L3-L4 This is the minimum distance between the third lens element and the fourth lens element. · "d-on L3-L4 This is the on-axial distance between the third lens element and the fourth lens element. DA, EFL, TTL, SD, d L3-L4It is expressed in millimeters. ΔL represents the difference in the amount of light incident on the central portion of the imaging sensor 304 in the second camera state compared to the first camera state. ΔL = (f / #1 / f / #2) 2 That is the case.
[0132] [Table 3]
[0133] [Table 4]
[0134] Figure 5A shows an optical lens system 500 that functions to perform low f-number virtual zoom photography as disclosed herein. The optical lens system 500 includes a lens 502 having an effective focal length (EFL) and comprising a plurality of lens elements L1 to L8, N = 8, an image sensor 504, and an optional optical element 506, such as an infrared (IR) filter. The optical lens system 500 includes an adaptive aperture (AA) 510 positioned between two of the plurality of lens elements. Specifically, the AA 510 is positioned between L3 and L4. The camera 500 has the AA 510 relatively closed, and as a result, DA F-FOV This is shown in a first camera state (like camera 160) where an aperture diameter like the one shown is achieved. The field of view (FOV) 508 of the optical lens system 500 is indicated by angle α. In the first camera state, the entire diagonal length (SD) of the image sensor 504 is used. That is, the optical lens system 500 images light from FOV 508 onto the entire image sensor 504, as indicated by the optical cone 512. In the first camera state, the F-number is f / #1, which is given by f / #1 = EFL / DA F-FOV It is given by.
[0135] The minimum distance between L3 and L4 ("d L3-L4 ) is relatively large, for example d L3-L4> 0.3mm. Relatively large d L3-L4 This is useful for implementing AA like the AA 510, which requires a specific physical distance between lens elements.
[0136] Figure 5B shows the optical lens system 500 in Figure 5A in the second camera state. The field of view (FOV) 514 of the optical lens system 500 in the second camera state is indicated by angle β. Compared to the first camera state in Figure 5A: AA 510 is relatively open, and as a result, DA 210 > DA F-FOV An aperture diameter such as the above is achieved. Only the central portion of the image sensor 504 is used. Specifically, only 1 / 3 of the SD of the image sensor 504 is used here. That is, the optical lens system 500 images the light from the FOV 514 onto the central region of the image sensor 504, as indicated by the optical cone 516. In the second camera state, the F-number is f / #2, where f / #2 = EFL / DA 210 < is given by f / #1. The difference in the amount of light ("ΔL") that enters the central part of the image sensor 504 in the second camera state compared to the first camera state is given by ΔL. For the optical lens system 500, ΔL = 2.38. In the second camera state, the central part of the image sensor 504 receives more than twice the amount of light compared to the first camera state.
[0137] If the image sensor 504 is a binning sensor, it may function to perform 9-binning. In the first camera state, the binning sensor may operate in binning mode. In the second camera state, the binning sensor may operate in full-resolution mode. Note that the same output resolution is achieved when using 9-binning mode in the first camera state and full-resolution mode in the second camera state, using 1 / 3 of the SD. A single smaller pixel in the second camera state receives approximately 2.38 / 9 ≈ 26% of the light intensity compared to the combined larger pixel in the first camera state. Without changing the aperture, a single smaller pixel in the second camera state receives only about 1 / 9 ≈ 11% of the light intensity compared to the combined larger pixel.
[0138] Because 1 / 3 of the SD of the image sensor 504 is used, the camera including the optical lens system 500 is referred to as a "low f-number 3x virtual wide-angle zoom camera".
[0139] Detailed optical and surface data for the optical lens system 500, as shown in the examples of lens elements in Figures 5A and 5B, are presented in Tables 5 through 7. The numerical values provided in these examples are purely illustrative, and other values may be used depending on the other examples.
[0140] The surface types are defined in Table 5, and the coefficients for the surfaces are defined in Table 6. Table 7 lists the different characteristics between the first and second camera states. The surface types are as follows:
[0141] a) Plano: A flat surface without curvature.
[0142] b) Q-type 1 (QT1) surface sag type:
number
[0143] c) Even-order aspherical (ASP) surface sag formula:
number
[0144] [Table 5] JPEG2026528705000009.jpg84170
[0145] [Table 6-1] JPEG2026528705000011.jpg32165 [Table 6-2] JPEG2026528705000013.jpg38114
[0146] In Table 7, "CA7 / 2" gives the effective diameter (CA) of the surface 7 ("S7") mechanically defined by the adaptive aperture (AA) 510. "DA" gives the entrance pupil diameter used to calculate the F-number. DA is determined by S7 in both the first and second camera states.
[0147] [Table 7]
[0148] Figure 6A shows another optical lens system 600 that functions to perform low f-number virtual zoom photography disclosed herein. The optical lens system 600 comprises a lens 602 having an effective focal length (EFL) and including a plurality of lens elements L1 to L8, N = 8, an image sensor 604, and an optional optical element 606. The optical lens system 600 includes an adaptive aperture (AA) 610 positioned between L3 and L4. The camera 600 has the AA 610 relatively closed and DA F-FOV This is shown in the first camera state in which an aperture diameter like the one shown is achieved. The field of view (FOV) 608 of the optical lens system 600 is indicated by angle α. In the first camera state, the entire diagonal length (SD) of the image sensor 604 is used. That is, the optical lens system 600 images the light from FOV 608 onto the entire image sensor 604, as indicated by the optical cone 612. In the first camera state, the F-number is f / #1, which is given by f / #1 = EFL / DA F-FOV It is given by d L3-L4 It is relatively large.
[0149] Figure 6B shows the optical lens system 600 in Figure 6A in the second camera state. The field of view (FOV) 614 of the optical lens system 600 in the second camera state is indicated by angle β. Compared to the first camera state in Figure 6A: AA 610 is relatively open, DA Z-FOV > DA F-FOV An aperture diameter such as the above is achieved. Only the central portion of the image sensor 604 is used. Specifically, only 1 / 4 of the SD of the image sensor 604 is used here. That is, the optical lens system 600 images the light from the FOV 614 onto the central region of the image sensor 604, as indicated by the optical cone 616. In the second camera state, the F-number is f / #2, where f / #2 = EFL / DA Z-FOV < This is given by f / #1. For optical lens system 600, ΔL = 2.59.
[0150] If the image sensor 604 is a binning sensor, it can function to perform 16-binning. In the first camera state, the binning sensor can operate in binning mode. In the second camera state, the binning sensor can operate in full-resolution mode. Note that the same output resolution is achieved when using 16-binning mode in the first camera state and full-resolution mode in the second camera state, using 1 / 4 of the SD. A single smaller pixel in the second camera state receives approximately 2.59 / 16 ≈ 16% of the light intensity compared to the combined larger pixel in the first camera state. If the aperture is not changed, a single smaller pixel in the second camera state will receive only approximately 1 / 16 ≈ 6% of the light intensity compared to the combined larger pixel. If the image sensor 604 is a binning sensor, it can function to perform 16-binning. In the first camera state, the binning sensor can operate in binning mode. In the second camera state, the binning sensor can operate in full resolution mode. Note that if 16-binning mode is used in the first camera state and full resolution mode is used in the second camera state using 1 / 4 of the SD, the same output resolution will be achieved. A single smaller pixel in the second camera state receives approximately 2.59 / 16 ≈ 16% of the light intensity compared to the combined larger pixel in the first camera state. If the aperture is not changed, a single smaller pixel in the second camera state will receive only about 1 / 16 ≈ 6% of the light intensity compared to the combined larger pixel.
[0151] In other examples, the image sensor 604 may function to perform 4-binning. Since 1 / 4 of the SD of the image sensor 604 is used, the camera including the optical lens system 600 is referred to as a "low f-number 4x virtual wide-angle zoom camera". Detailed optical and surface data of the optical lens system 600 for the lens element examples in Figures 6A and 6B are shown in Tables 8 and 9. Table 10 lists the different characteristics between the first and second camera states.
[0152] [Table 8] JPEG2026528705000016.jpg84169
[0153] [Table 9-1] JPEG2026528705000018.jpg31165 [Table 9-2] JPEG2026528705000020.jpg35114
[0154] [Table 10]
[0155] In Table 10, "CA7 / 2" gives the effective diameter (CA) of the surface 7 ("S7") mechanically defined by the adaptive aperture (AA) 610. The aperture diameter (DA) is determined by S7 in both the first and second camera states.
[0156] Figure 7A schematically illustrates a camera 700 including an adaptive aperture actuator ("AAA") disclosed herein in a cross-sectional view. The camera 700 includes a lens 702 having a lens optical axis ("OA") parallel to the z-axis. The lens 702 includes a plurality of lens elements L1-L5, an image sensor 704, and the AAA 706 disclosed herein. The AAA 706 controls the AA 710, which defines the aperture diameter (DA). That is, the AAA 706 functions to change the DA, and therefore to define the F-number of the camera 700. The lens 702 may be contained in a lens barrel (not shown), and the lens barrel may be contained in a lens carrier 712. In some examples, the lens 702 may be moved axially and / or radially within the lens carrier 712 and relative to the image sensor 704 to perform, for example, focusing ("lens-shift focusing") and / or optical image stabilization (OIS), specifically lens-shift OIS. In some examples, the image sensor 704 may be moved axially and / or radially relative to the lens 702 to perform, for example, focusing ("sensor-shift focusing") and / or OIS (sensor-shift OIS).
[0157] AAA 706 includes a diaphragm (or “membrane”) 708. The diaphragm 708 may be made of any stretchable material known in the art. A first side 708-1 and a second side 708-2 of the diaphragm 708 are visible. The diaphragm 708 includes a hole (or void) 707 having a hole diameter (“HD”) that defines (or “forms”) AA 710. The diaphragm 708 has an “L-shape,” that is, the first part of the diaphragm 708 is parallel to the y-axis and the second part of the diaphragm 708 is parallel to the z-axis. In fact, the L-shape of the diaphragm 708 is formed similarly to the shape of the lens carrier 712, and as a result, the L-shape of the diaphragm 708 follows (or is “guided by”) the shape of the lens carrier 712. AAA 706 functions to modify HD by extending and relaxing the diaphragm 708 so that the hole 707 expands or contracts, as indicated by arrows 709 and 711, respectively. Specifically, when the diaphragm 708 is in a non-expanded (or "contracted" or "relaxed") state, the HD and the associated DA of camera 700 have a minimum size, which corresponds to the maximum f-number. Minimum size of HD (HD MIN ) is HD MIN = It may be within the range of 0.25 to 5 mm. When the diaphragm 708 is in its maximum extended state, the DA of the HD and the associated camera 700 has its maximum size, which corresponds to the minimum F-number. Maximum size of HD (HD MAX ) is HD MAX = may be in the range of 2.5 to 15 mm. AAA 706 may include an actuator (not shown) that functions to extend and relax the diaphragm 708. Camera 700 has an optical length (TTL) in the range of 5 to 20 mm, preferably in the range of 5 to 15 mm or 5 to 10 mm, and a camera height (H) in the range of 5.25 to 25 mm, preferably in the range of 5.25 to 15 mm or 5.25 to 10 mm. CAM It has the optical total length (TTL) and mechanical camera height (H). CAMThe penalty ("p") between ) may be in the range of 0.25 to 5 mm, preferably p < 1 mm or p < 0.5 mm. As can be seen, AA 710 is located on the subject side of lens 702. In other examples, AA may be located between two of the multiple lens elements. In some of these examples, by including AA H CAM It will not increase.
[0158] Figure 7B schematically illustrates the diaphragm 720 disclosed herein in a top view. The diaphragm 720 functions to be used in an AAA such as AAA 706. The diaphragm 720 exemplary includes eight wires 722a-722h within a first region 724. The wires 722a-722h are non-expandable, i.e., they have a constant wire length. The wires 722a-722h prevent the first region 724 from expanding when a radial force is applied ("stationary region"). In addition, the wires 722a-722h ensure that the force is distributed uniformly (or "equally") along the radial axis. A second region 726 of the diaphragm 720 does not contain wires and expands when a radial force is applied ("expanded region"). The expanded region 726 causes the holes 728 contained in the diaphragm 720 to expand or contract. This expansion or contraction changes the HD and therefore the f-number of the camera, including the diaphragm 720. In other examples, the diaphragm may include 4 to 40 non-stretchable wires.
[0159] Figure 7C schematically illustrates a camera 730, including the AAA 732 disclosed herein, in a cross-sectional view. Camera 730 includes all the components of camera 700. In addition, camera 730 includes an actuator 732. The actuator 732 functions to apply force to the diaphragm 708 so that the diaphragm 708 expands and contracts, causing the HD to change as described for camera 700. The actuator 732 includes a first voice coil motor ("VCM") 740 and a second VCM 750, as well as a first slider 742 and a second slider 752. The first VCM 740 and the second VCM 750 may include the same components. The first VCM 740 and the second VCM 750 each include magnets 744 and 754, and coils 746 and 756, respectively, which are fixedly attached to sliders 742 and 752. Coils 746 and 756 do not move relative to the mobile device including the camera 730. Sliders 742 and 752 are both fixedly attached to the diaphragm 708. Sliders 742 and 752 move relative to the mobile device including the camera 730, for example, sliders 742 and 752 move relative to the lens 702. As sliders 742 and 752 move in the directions indicated by arrows 748 and 758, the diaphragm 708 is stretched, and HD increases as indicated by arrows 734 and 736. Note that the axes of symmetry of the first VCM 740 and the second VCM 750 are parallel to the y-axis. The first VCM 740 and the second VCM 750 provide driving forces parallel to the z-axis and parallel to the lens optical axis (OA), respectively. HD changes along the y-axis. In other examples, there may be only one VCM, which is located on only one side of the lens barrel 712. In yet another example, there may be three to eight VCMs.
[0160] In some examples, AA 710 may be modified symmetrically, i.e., the same force may be applied to the first side 708-1 and the second side 708-2 of the diaphragm 708, respectively. In other examples, AA 710 may be modified asymmetrically, i.e., different forces may be applied to the first side 708-1 and the second side 708-2 of the diaphragm 708, respectively.
[0161] Figure 7D illustrates a slider 742 in cross-sectional view. The slider 742 includes an outer ring 743, an inner ring 745, and an air gap between the outer ring 743 and the inner ring 745. The outer ring 743 moves relative to and concentrically within the inner ring 745, i.e., along an axis parallel to the z-axis. The relative movement between the outer ring 743 and the inner ring 745 can be driven by a first VCM 740. A diaphragm, such as diaphragm 708, may be fixedly attached to the outer ring 743.
[0162] Figure 7E schematically illustrates another camera 760, including the AAA 770 disclosed herein, in a cross-sectional view. Camera 760 includes all the components of camera 700. However, camera 760 includes a different diaphragm 762, and in addition, camera 760 includes the AAA 770. The AAA 770 functions to apply force to the diaphragm 762 so that the diaphragm 762 expands and relaxes, causing the HD to change as described for camera 700. The diaphragm 762 has a linear (or "straight") shape, i.e., the entire diaphragm 762 is oriented parallel to the y-axis. The AAA 770 includes a first VCM 772 and a second VCM 776. The first VCM 772 and the second VCM 776 may include the same components. The first VCM 772 and the second VCM 776 each include magnets 774 and 778 fixedly attached to the first side 762-1 and the second side 762-2 of the diaphragm 762, respectively. In some examples, as illustrated, magnets 774 and 778 may be embedded (or "integrated") into the first side 762-1 and the second side 762-2, respectively. The first VCM 772 and the second VCM 776 each include coils 775 and 779. Coils 775 and 779 do not move relative to the mobile device, including the camera 760. When magnets 774 and 778 move, the diaphragm 762 expands or contracts as indicated by arrows 764 and 765, and the HD changes as described for the camera 700. The axes of symmetry of the first VCM 772 and the second VCM 776 are parallel to the z-axis. The first VCM 772 and the second VCM 776 provide a driving force parallel to the y-axis, which changes HD along the y-axis and perpendicular to the lens optical axis (OA). HD changes along the y-axis.
[0163] Figures 7F-G schematically illustrate components of yet another camera 780, including the AAA 782 disclosed herein in cross-section. Only one side of the AAA 782 is shown. The AAA 782 includes a diaphragm 784, and a stamp 786 that includes a movable stamp 786-1 and a stationary (or "base") stamp 786-2. The movable stamp 786-1 moves with respect to a mobile device that includes the camera 780. The diaphragm 784 has a stamp region 788 where the stamp 786 is disposed. The stationary stamp 786-2 does not move with respect to a mobile device that includes the camera 780.
[0164] Figure 7F illustrates a camera 780 with a diaphragm 784 in a non-expanded (or "relaxed") state corresponding to a minimum HD and a maximum F value. In the non-expanded state, the stamp 786 does not apply any force to the diaphragm 784. In other examples, the stamp 786 may apply a relatively weak preload to the diaphragm 784.
[0165] Figure 7G illustrates a camera 780 with a diaphragm 784 in an expanded state corresponding to a greater HD and a lower F value compared to the non-expanded state. In the expanded state, the stamp 786 applies a force to the diaphragm 784. Specifically, when the movable stamp 786-1 is lowered (or "moved downward") as indicated by arrow 787, the diaphragm 784 is stretched, the aperture 710 expands as indicated by arrow 789, thereby lowering the F value of the camera 780. The stamp region 788 of the diaphragm 784 is deformed to amplify (or "increase") the degree of stretching of the diaphragm 784. In some examples, the movable stamp 786-1 and the base stamp 786-2 may have holes to prevent vacuum adsorption of the diaphragm 784 to the movable stamp 786-1 and the base stamp 786-2, respectively. "Vacuum adsorption" means that the diaphragm is fixedly attached to the movable stamp 786-1 or the base stamp 786-2 by contact force, which is not desirable.
[0166] Figures 8A - 8H show another AAA 800 disclosed herein. The AAA 800 includes a lens carrier 806, and a diaphragm 802 having a hole 804 with HD and defining AA.
[0167] Figures 8A - 8C and Figure 8G show the AAA 800 in a configuration where the diaphragm 802 is in a non - expanded state, and as a result, the HD of the camera including the AAA 800 has a minimum size and corresponds to the maximum F - value (「f / # MAX 」). The f / # MAX may be in the range of 2.5 to 50, or 2.5 to 8, or simply 2.5 to 4. Figures 8D - 8F and Figure 8H show the AAA 800 in a configuration where the diaphragm 802 is in a maximum - expanded state, and as a result, the HD of the camera including the AAA 800 has a maximum size and corresponds to the minimum F - value (「f / # MIN 」). The f / # MIN may be in the range of 1.0 to 5.0, or 1.25 to 3, or simply 1.4 to 2.5. The transition (or 「switching」) between the non - expanded state and the maximum - expanded state may be continuous or discrete.
[0168] Figures 8A and 8D show the AAA 800 in perspective views. The diaphragm 802 includes 24 wires, among which the exemplary first wire 808 and the second wire 809 are marked. Compared with Figure 8A, a larger HD is visible in Figure 8D.
[0169] Figures 8B and 8E show a cross-sectional perspective view of the AAA 800. The AAA 800 includes a lens carrier 806 and four VCMs (Figure 8C), where the first VCM 810 and the second VCM 820 are visible. All four VCMs may contain identical components. The first VCM 810 and the second VCM 820 each contain magnets 812 and 822, respectively, both of which are fixedly attached to a movable ring 816. The movable ring 816 is fixedly attached to a diaphragm 802 and moves relative to the lens carrier 806. The lens carrier 806 does not move relative to the mobile device containing the AAA 800. The first VCM 810 and the second VCM 820 each contain coils 814 and 824, respectively, both of which are fixedly attached to the lens carrier 806. With respect to the z-axis, in Figure 8E, compared to Figure 8C, a lower position of the movable ring 816 relative to the lens carrier 806 is visible, resulting in an extension of the diaphragm 802.
[0170] Figures 8C and 8F show perspective views of the four VCMs included in the AAA 800. The first VCM 810, the second VCM 820, and the third VCM 830 and fourth VCM 840 are visible. The third VCM 830 and fourth VCM 840 each contain magnets 832 and 842, respectively, both of which are fixedly mounted to the movable ring 816. The third VCM 830 and fourth VCM 840 each contain coils 834 and 844, respectively, both of which are fixedly mounted to the lens carrier 806. With respect to the z-axis, in Figure 8F, the four magnets 812-842 are shown lower relative to the four coils 814-844 compared to Figure 8C.
[0171] Figure 8G shows a perspective view of the AAA 800, excluding the diaphragm 802 and lens carrier 806. Inside, the movable ring 816 includes four rails, of which the first rail 818 and the second rail 826 are visible. The angular distance between two adjacent rails is 90 degrees.
[0172] Figure 8H shows a perspective view of the AAA 800, excluding the diaphragm 802, lens carrier 806, and movable ring 816. Outward, the lens carrier 806 includes four rails, of which the third rail 828 and the fourth rail 829 are visible. The angular distance between any two adjacent rails is 90 degrees. The four rails included in the lens carrier 806 are aligned with the four rails included in the movable ring 816, resulting in the formation of four gaps (or "spaces"). Each of the four gaps may contain one or more balls, resulting in the formation of four ball bearings. The four ball bearings function to convert the forces generated by the VCMs 810-840 into axial movement to control the state of the diaphragm 802.
[0173] Figure 9A shows yet another optical lens system 900 that functions to perform low f-number virtual zoom photography disclosed herein. The optical lens system 900 may be used in a non-folding zoom telephoto ("T") camera such as camera 160, or in a folded zoom T camera such as folded zoom T camera 100. The same applies to optical lens system 1000. The optical lens system 900 comprises a lens 902 having an effective focal length (EFL) and containing N = 8 lens elements L1 to L8, an image sensor 904, and an optional optical element 906. The optical lens system 900 includes an AA 910 positioned between L3 and L4. Camera 900 has the AA 910 relatively closed, DA F-FOV This is shown in the first camera state in which an aperture diameter like the one shown is achieved. The field of view (FOV) 908 of the optical lens system 900 is indicated by the angle α. In the first camera state, the optical lens system 900 images the light from FOV 908 onto the entire image sensor 904, as indicated by the optical cone 912. In the first camera state, the F-number is f / #1, where f / #1 = EFL / DA F-FOVThe optical lens system 900 represents the T camera, and the lens 902 is divided into a first lens group ("G1") including L1 to L3 and a second lens group ("G2") including L4 to L8. The air gap ("d") between G1 and G2 is given. G The ) is relatively large. Generally, G1 has positive lens power, and G2 has negative lens power.
[0174] Figure 9B shows the optical lens system 900 in Figure 9A in the second camera state. The field of view (FOV) 914 of the optical lens system 900 in the second camera state is indicated by angle β. Compared to the first camera state in Figure 9A: AA 910 is relatively open, DA Z-FOV > DA F-FOV An aperture diameter such as the above is achieved. Only the central portion of the image sensor 904 is used. Specifically, only half of the SD of the image sensor 904 is used here, and as a result, the camera including the optical lens system 900 is referred to as a "low f-number 2x virtual telephoto zoom camera". The optical lens system 900 images light from the FOV 914 onto the central region of the image sensor 904, as shown by the optical cone 916. In the second camera state, the f-number is f / #2, and f / #2 = EFL / DA Z-FOV < This is given by f / #1. For optical lens system 900, ΔL = 3.06.
[0175] If the image sensor 904 is a binning sensor, it may function to perform 4-binning. In the first camera state, the binning sensor may operate in binning mode. In the second camera state, the binning sensor may operate in full-resolution mode. Note that the same output resolution is achieved when using 4-binning mode in the first camera state and full-resolution mode in the second camera state, which uses half of the SD. A single smaller pixel in the second camera state receives approximately 3.06 / 4 ≈ 77% of the light intensity compared to the combined larger pixel in the first camera state. If the aperture is not changed, a single smaller pixel in the second camera state will receive 1 / 4 of the light intensity compared to the combined larger pixel.
[0176] Detailed optical and surface data for the optical lens system 900 are shown in Tables 11-12. Table 13 lists the different characteristics between the first and second camera states.
[0177] [Table 11] JPEG2026528705000023.jpg85170
[0178] [Table 12] JPEG2026528705000025.jpg31164
[0179] [Table 13]
[0180] In Table 13, "CA7 / 2" gives the effective diameter (CA) of the surface 7 ("S7") mechanically defined by the adaptive aperture (AA) 910. The aperture diameter (DA) is determined by S7 in the first camera state and by L1 in the second camera state.
[0181] Figure 10A schematically shows in cross-sectional view yet another optical lens system 1000 that functions to perform low f-number virtual zoom photography disclosed herein. The optical lens system 1000 comprises a lens 1002 including N = 8 lens elements L1 to L8, an image sensor 1004, and an optional optical element 1006. The optical lens system 1000 includes AA 1010 positioned between L4 and L5. The camera 1000 has AA 1010 that is relatively closed, with an aperture diameter DA F-FOV This is shown in the first camera state in which this is achieved. The field of view (FOV) 1008 of the optical lens system 1000 is indicated by angle α.
[0182] In the first camera state, the optical lens system 1000 images the light from the FOV 1008 onto the entire image sensor 1004, as indicated by the optical cone 1012. In the first camera state, the F-number is f / #1, which is given by f / #1 = EFL / DA F-FOV The optical lens system 1000 represents a telephoto (T) camera. Lens 1002 is divided into a first lens group (G1) containing L1 to L4 and a second lens group (G2) containing L5 to L8. Intergroup distance d G The values are relatively large. G1 has positive lens power, and G2 has negative lens power.
[0183] Figure 10B shows the optical lens system 1000 of Figure 10A in the second camera state. The field of view (FOV) 1014 of the optical lens system 1000 in the second camera state is indicated by angle β. Compared to the first camera state in Figure 10A: AA 1010 is relatively open, DA Z-FOV > DA F-FOVAn aperture diameter as described above is achieved, and only half of the diagonal length (SD) of the imaging sensor 1004 is used. That is, as shown by the light cone 1016, the optical lens system 1000 images the light from the FOV 1014 onto the central region of the imaging sensor 1004. The camera including the optical lens system 1000 is referred to as a "low F-number 2x virtual telephoto zoom camera". In the second camera state, the F-number is f / #2, and f / #2 = EFL / DA Z-FOV < is given by f / #1. For the optical lens system 1000, ΔL = 3.06. When the imaging sensor 1004 is a binning sensor, the imaging sensor 1004 can function to perform 4-binning as described for the imaging sensor 904.
[0184] The detailed optical data and surface data of the optical lens system 1000 are shown in Tables 14 - 15. Table 16 lists the different characteristics in the first camera state and the second camera state.
[0185] For the optical lens systems 900 and 1000 included in the non-folded (upright) camera, the penalty ("p") between the total optical length (TTL) and the mechanical camera height (H CAM ) is within the range of 0.25 - 5 mm, preferably p < 2 mm or p < 1 mm.
[0186] For the optical lens systems 900 and 1000 included in the folded camera, the penalty ("p") between the value of the optical effective diameter (CA) and the mechanical camera height (H CAM ) is within the range of 0.25 - 5 mm, preferably p < 2 mm or p < 1 mm. In some examples, one or more lens elements included in the optical lens systems 900 and 1000 may be cut as known in the art, and as a result, the imaging sensors 904 and 1004 can define the height of the folded camera respectively. Even in these examples, the sensor height and the mechanical camera height (H CAMThe value of p between ( ) and ( ) may be in the range of 0.25 to 5 mm, preferably p < 2 mm or p < 1 mm.
[0187] [Table 14] JPEG2026528705000028.jpg73170
[0188] [Table 15] JPEG2026528705000030.jpg32164
[0189] [Table 16]
[0190] In Table 16, "CA1 / 2" gives the effective diameter (CA) of surface 1 ("S1") mechanically defined by the adaptive aperture (AA) 1010. The aperture diameter (DA) is determined by lens 1 (L1) in both the first and second camera states.
[0191] It should be noted that optical lens systems such as optical lens systems 600, 700, 900, and 1000 are linearly scalable, as is known in the art. During scaling, the field of view (FOV) and, in particular, the f-number remain unchanged. For example, using a smaller image sensor reduces the total optical length (TTL), and therefore the height of the camera containing the optical lens system is reduced. The reverse is also true. Table 17 includes exemplary TTL values for optical lens systems 600 and 700 with smaller (1 / 1.57 inch) and larger (1 / 1.12 inch, 1 inch) image sensors. In other examples, optical lens systems 600 and 700 may be scaled so that the image sensor diagonal length (SD) is within the range of 7.5 mm ≤ SD ≤ 25 mm.
[0192] [Table 17]
[0193] Table 18 includes illustrative examples of total optical length (TTL) values for optical lens systems 900, including smaller image sensors (1 / 1.7 inch, 1 / 2 inch, 1 / 2.5 inch, 1 / 3 inch, and 1 / 3.5 inch).
[0194] [Table 18]
[0195] Table 19 includes illustrative examples of total optical length (TTL) values for optical lens systems 900, including smaller image sensors (1 / 1.7 inch, 1 / 2 inch, 1 / 2.5 inch, 1 / 3 inch, and 1 / 3.5 inch).
[0196] [Table 19]
[0197] In other examples, optical lens systems 900 and 1000 may be scaled such that the effective focal length (EFL) is within the range of 6 mm ≤ EFL ≤ 30 mm.
[0198] Unless otherwise specified, the use of the expression "and / or" between the last two members of a list of options for selection indicates that one or more of the listed options are appropriate and may be selected.
[0199] Where the claims or this specification refer to an element “one (a)” or “an (an),” it should be understood that such reference should not be construed as meaning that there is only one such element.
[0200] All patents and patent applications referenced herein are incorporated herein by reference in whole to the same extent as each individual patent or patent application is specifically and individually indicated as being incorporated herein by reference. In addition, no citation or specification of any reference in this application should be construed as an admission that such reference is available as prior art to this disclosure.
Claims
1. A camera system comprising a wide-angle camera and a processor, The wide-angle camera has a lens comprising N lens elements L1 to LN, and an image sensor having an optical length TTL, effective focal length EFL, adaptive aperture AA, and total sensor diagonal length SD in the range of 5 mm to 25 mm. The aforementioned wide-angle camera is a zoom camera, The ratio TTL / SD < 0.8, The wide-angle camera has a full field of view (F-FOV) camera state and an F-FOV lens aperture diameter DA F-FOV It has, DA F-FOV The ratio of / SD is in the range of 0.2 to 0.
5. The wide-angle camera is in a zoom field of view (Z-FOV) camera state where Z-FOV < F-FOV, and the Z-FOV lens aperture diameter DA Z-FOV , and zoom sensor diagonal length SD Z <SD has, For switching between the F-FOV camera state and the Z-FOV camera state, the adaptive aperture AA is DA Z-FOV ≥ 1.2 × DA F-FOV DA F-FOV and DA Z-FOV It functions to switch between the two, The processor crops the imaging sensor such that SD Z ≤ 0.8 × SD, and functions as follows: DA Z-FOV / SD Z > 1.5 × DA F-FOV A camera system that uses SD.
2. The camera system according to claim 1, wherein N = 8.
3. The wide-angle camera, in the F-FOV camera state, f / # F-FOV = EFL / DA F-FOV The F-number given by f / # F-FOV It has the above f / # F-FOV The camera system according to claim 1, wherein the value is in the range of 1.5 to 2.
5.
4. The camera system according to claim 1, wherein the effective focal length EFL is in the range of 2 mm to 10 mm.
5. DA Z-FOV ≥ 1.4 × DA F-FOV The camera system according to claim 1.
6. The camera system according to claim 1, wherein TTL / SD < 0.
75.
7. The camera system according to claim 1, wherein TTL / SD < 0.
7.
8. The wide-angle camera has an F-number f / # in the F-FOV camera state. F-FOV And, the F-number f / # in the Z-FOV camera state. Z-FOV It has and f / # F-FOV / f / # Z-FOV The camera system according to claim 1, wherein the pressure is > 1.
5.
9. The wide-angle camera has an F-number f / # in the F-FOV camera state. F-FOV And, the F-number f / # in the Z-FOV camera state. Z-FOV It has and f / # F-FOV / f / # Z-FOV The camera system according to claim 1, wherein the pressure is > 1.
5.
10. The camera system according to claim 1, wherein the transition between the F-FOV camera state and the Z-FOV camera state is discrete, and the wide-angle camera is a two-state virtual zoom camera.
11. The camera system according to claim 1, wherein the imaging sensor is a binning sensor.
12. The camera system according to claim 11, wherein in the F-FOV camera state, the image sensor operates at a first pixel resolution, and in the Z-FOV camera state, the image sensor operates at a second pixel resolution higher than the first pixel resolution.
13. The camera system according to claim 12, wherein in the Z-FOV camera state, the imaging sensor operates at a resolution corresponding to a total sensor pixel resolution of more than 12.5 MP.
14. The camera system according to claim 12, wherein in the Z-FOV camera state, the imaging sensor operates at a resolution corresponding to a total sensor pixel resolution of 50MP or more.
15. The camera system according to claim 12, wherein in the Z-FOV camera state, the imaging sensor operates at a resolution corresponding to a total sensor pixel resolution of 200MP or more.
16. The camera system according to claim 1, wherein the adaptive aperture AA is positioned on the subject side of the plurality of lens elements.
17. The camera system according to claim 1, wherein the adaptive aperture AA is positioned between two of the plurality of lens elements.
18. The camera system according to claim 1, wherein the adaptive aperture AA is located between L3 and L4.
19. A mobile device comprising the camera system described in any one of claims 1 to 18.
20. The mobile device according to claim 19, wherein the mobile device is a smartphone.