Handheld electronic device

Abstract

A handheld electronic device comprising: a camera having a camera optical axis and including an image sensor and a lens having a lens axis substantially parallel to the camera optical axis, the camera having an effective focal length EFL > 7 mm; a motion sensor for sensing an undesired linear motion of the handheld electronic device; a depth estimator for estimating a distance between the camera and an object; and an actuator operative to move the camera or a component of the camera to compensate for the undesired linear motion of the handheld electronic device, wherein when the distance is less than 50 cm, the compensation depends on the undesired linear motion and the distance between the camera and the object.

Description

[0001] Interactive reference with existing applications This application is a divisional application of U.S. Patent Application No. 202180037757.6 (PCT Application No. PCT / IB2021 / 057311), filed on August 9, 2021, entered the national phase on November 24, 2022, and entitled "Pop-up Zoom Camera". The application claims priority to U.S. Provisional Patent Application No. 63 / 080,047, filed on September 18, 2020, and U.S. Provisional Patent Application No. 63 / 173,446, filed on April 11, 2021, both of which are incorporated herein by reference in their entirety. Technical Field

[0002] The subject of this disclosure generally relates to the field of digital cameras, and in particular to multiple zoom compact multi-aperture cameras. Background Technology

[0003] Small multi-camera systems and their integration in multiple handheld electronic devices (also referred to herein as “devices”), such as multiple tablets or multiple mobile phones (the latter generally referred to as “smartphones”), are known. These cameras offer advanced imaging capabilities, such as zoom, see, for example, the co-owned PCT patent application number PCT / IB2063 / 060356. A typical three-camera system exemplarily includes an ultra-wide-angle (or “UW” or “UW”) camera, a wide-angle (or “W” or “W”) camera, and a telephoto (or “T” or “T”) camera, wherein their fields of view (FOVs) satisfy FOV. UW FOV W FOV T .

[0004] The first smartphones to offer macro photography capabilities by using a relatively short focal length (e.g., 2.5mm) UW camera for very close focusing have entered the consumer market. Several drawbacks of UW macro cameras include the need for a small object-to-lens distance (“u”) and a small object-to-image magnification ratio (“M”). For example, when a 2.5mm UW lens is pointed at an object 5cm (lens-to-object distance), the object-to-image M of the UW camera is approximately 19:1.

[0005] The challenges of multiple zoom cameras are related to the camera's height or length (e.g., in relation to a total track length or "TTL"), effective focal length (EFL), and the size of the camera's image sensor ("sensor diagonal" or "SD"). Figure 1ASchematically illustrates definitions of various entities, such as TTL, EFL and back focal length ("BFL"). TTL is defined as the maximum distance between the object-side surface of a first lens element facing the object and the plane of a camera image sensor. BFL is defined as the minimum distance between the image-side surface of a last lens element facing the image sensor and the plane of a camera image sensor.

[0006] Figure 1B Shows an exemplary camera system, comprising a lens with a FOV, an EFL and an image sensor with a sensor width W and height H. SD is represented by SD=√(W 2 +H 2 ) which is associated with a sensor width W and a height H. For an image sensor with a fixed width / height ratio (generally rectangular), the sensor diagonal is proportional to the width and height of the sensor. The relationship between the diagonal field of view (FOV), EFL and SD is as follows: (Equation 1) This shows that a camera with a larger SD but the same FOV requires a larger EFL.

[0007] A telephoto lens can achieve optical zoom. The TTL of a telephoto lens is smaller than its EFL, and generally satisfies 0.7<TTL / EFL<1.0. In a plurality of vertical telephoto cameras, typical telephoto EFL values range from 6 mm to 10 mm (without 35 mm equivalent conversion). In a plurality of folded telephoto cameras, their EFL values range from 10 mm to 40 mm. A larger EFL is desirable for enhancing the optical zoom effect, but this results in a larger TTL, which is undesirable.

[0008] In order to continuously improve the obtained image quality, it is necessary to incorporate larger image sensors into a plurality of telephoto cameras. A plurality of larger sensors allow improved low-light performance and more pixels, thus also improving the spatial resolution. Other image quality characteristics, such as noise characteristics, dynamic range and color fidelity, may also be improved with the increase of sensor size. In most telephoto cameras, the SD of the sensor pixel array ranges from about 4.5 mm (generally referred to as a 1 / 4-inch sensor) to 7 mm (generally referred to as a 1 / 2.5-inch sensor).

[0009] If a telephoto camera design can support a large EFL to achieve the following objectives, it will be very beneficial: large optical zoom effect; incorporating a plurality of large sensors (e.g., SD > 10 mm or 1 / 1.7-inch sensors); large magnification M (e.g., 2:1 to 10:1), with a plurality of lens-object distances of 5 to 15 cm, At the same time, a small TTL is still available for slim designs. This can be achieved with a "pop-up camera," i.e., a camera with two or more lens states. In a first ("pop-up") lens state, the camera is operable and has a large height H. O The second lens state is a folded lens state, in which the camera is not operable and has a height H. N-O <H O Such a design is proposed, for example, in the jointly owned international patent application number PCT / IB2020 / 058697.

[0010] Modern multi-camera systems typically also include optical image stabilization (OIS). OIS is needed to mitigate unwanted camera-hosting motion (“hand movement” or “shake”). With OIS, the lens, image sensor, or the entire camera can move linearly in two directions perpendicular to the camera's optical axis (see [link to OIS]). Figure 14A ).

[0011] Unintended host device motion causes the camera to move in 6 degrees of freedom, i.e., multiple linear motions in the XYZ region (see reference). Figure 6A The coordinate system shown gives multiple coordinates: roll (tilt towards or tilt around) the Y-axis, yaw (tilt around the Y-axis), and pitch (tilt around the X-axis), with yaw and pitch being the most significant causing image degradation. Since the impact of undesired linear motion in the XYZ on image quality is negligible at lens-object distances of 1 meter or more, most known advanced smartphones include OIS that corrects only yaw and pitch. Conversely, for macro photography using a telephoto camera that allows for a 10:1 or greater aspect ratio, undesired linear motion in the XY can significantly affect image quality. Therefore, it would be beneficial to have an OIS mechanism that corrects undesired linear motion during macro shooting. Summary of the Invention

[0012] In various embodiments, multiple cameras are provided, including: a lens comprising N lens elements L1 to L2. N Starting from L1 on the object side, the lenses are arranged along the optical axis of the lens and ending at L on the image side. N Where N≥5, wherein the plurality of lens elements are divided into two or more lens groups, and two adjacent lens groups are separated along the optical axis of the lens by their respective air gaps d1; an image sensor is connected to the lens element L along the optical axis by an air gap d2. NSeparately, the image sensor has a sensor diagonal S between 7 and 20 millimeters. D ; and an actuator for controlling the plurality of air gaps d1 and d2 to switch the camera between M≥1 operational pop-up states and a folded state, and to focus the camera on an object with an object-lens distance of less than 30 cm, wherein in each operational pop-up state m∈{1,2,...M}, the lens has its own effective focal length EFL. m and a total track length TTL m In the folded state, the lens has a total track length c-TTL, wherein a minimum EFL in the set of m EFLs is equal to or greater than 7 mm, and wherein c-TTL < 0.7 EFL.

[0013] In some embodiments, M = 2, 3, or 4.

[0014] In some embodiments, the operating states are continuous, such that the EFL changes from EFL1 to EFL2. M Continuous change.

[0015] In some embodiments, for the smallest EFL in the set of m EFLs, c-TTL < 0.65EFL.

[0016] In some embodiments, a camera can focus its lens on an object at a distance of less than 25 centimeters.

[0017] In some embodiments, a camera can focus its lens on an object less than 15 centimeters away.

[0018] In some embodiments, the actuator includes a spring.

[0019] In some embodiments, d1 is greater than TTL. M / 6.

[0020] In some embodiments, d1 is greater than TTL. M / 5.

[0021] In various embodiments, multiple camera systems are provided, including a camera as described above or below (hereinafter referred to as "first camera") and a second camera including a second lens system having at least one air gap, wherein in the folded state, the second lens has a total track length c-TTL2, wherein the actuator is operable to control the at least one air gap of the second camera to simultaneously switch the first camera and the second camera between an M≥1 pop-up state and a folded state. In some embodiments, cTTL2 = cTTL ± 10%. The camera or camera system described above or below may be incorporated into a handheld electronic device. The handheld electronic device may have an outer surface of the device, wherein in an operating state, any of the multiple cameras extends 2 mm to 10 mm beyond the outer surface of the device, and in a non-operating state, any of the multiple cameras extends less than 2 mm beyond the outer surface of the device.

[0022] In various embodiments, a plurality of handheld electronic devices are provided, including: a telephoto camera having a camera optical axis and including an image sensor and a lens having a lens axis substantially parallel to the camera optical axis, the telephoto camera having an EFL ≥ 9 mm; a motion sensor for sensing an undesired linear motion of the handheld electronic device; a depth estimator for estimating the distance between the telephoto camera and an object; and an actuator for moving the telephoto camera or a component of the telephoto camera to compensate for the undesired linear motion of the handheld electronic device, wherein the compensation depends on the undesired linear motion and the distance between the telephoto camera and the object, wherein the distance between the telephoto camera and the object is less than 50 cm.

[0023] In some embodiments, a handheld device further includes an ultra-wide-angle camera having a field of view (FOV). UW The field of view (FOV) of the telescope camera is greater than that of the telescope camera. T .

[0024] In some embodiments, a handheld device further includes a wide-angle camera having a field of view (FOV). W The field of view (FOV) of the telescope camera is greater than that of the telescope camera. T .

[0025] In some embodiments, the estimation of the distance between the telephoto camera and an object is based on phase detection autofocus (PDAF).

[0026] In some embodiments, the estimation of the distance between the telephoto camera and an object is based on the wide-angle camera and the telephoto camera, or on the ultra-wide-angle camera and the telephoto camera.

[0027] In some embodiments, sensing the linear motion includes measuring the linear motion in one or more directions.

[0028] In some embodiments, sensing the linear motion includes measuring the linear motion in two or more directions.

[0029] In some embodiments, the moving component is the lens. A lens movement amount d Lens by The calculation is performed, where d0 is a non-desired linear motion of the device, EFL is the effective focal length, and u is an object-lens distance.

[0030] In some embodiments, the moving component is the image sensor. An image sensor movement amount d Sensor by Calculate, where d0 is a non-desired linear motion of the device and u is an object-lens distance.

[0031] In some embodiments, the motion sensor includes an inertial measurement unit (IMU). Attached Figure Description

[0032] Several non-limiting embodiments of the subject matter disclosed herein will now be described with reference to the accompanying drawings listed later in this paragraph. Multiple identical structures, elements, or components appearing in more than one drawing may be labeled with the same numerals in the figures in which they appear. The drawings and description are for illustration and clarification of the various embodiments disclosed herein and should not be construed as limiting in any way.

[0033] Figure 1A This illustration illustrates the definitions of various entities within a camera.

[0034] Figure 1B An exemplary camera system is illustrated schematically, comprising a lens having a field of view (FOV), an image sensor (EFL), and an image sensor having a sensor width (W).

[0035] Figure 1C The diagram schematically shows a cross-section of an exemplary telephoto camera lens system disclosed herein in a folded, non-operating state.

[0036] Figure 1D Displayed in the first operating telescope head state Figure 1C The camera mentioned above.

[0037] Figure 1E Displayed in a second operating telescope head state Figure 1C The camera mentioned above.

[0038] Figure 1F Displayed in macro lens operation mode Figure 1CThe camera mentioned above.

[0039] Figure 2A This image shows a cross-sectional view of a pop-up telescope disclosed in this article in an extended state, incorporated into a camera that hosts a handheld electronic device.

[0040] Figure 2B show Figure 2A A cross-sectional view of the pop-up mechanism of the camera in a pop-up state.

[0041] Figure 3A The display is in a folded or inactive state. Figure 2A The pop-up camera mentioned above.

[0042] Figure 3B The displays are in their respective folded states. Figure 3A The pop-up mechanism of the camera.

[0043] Figure 4A An optical module in a pop-up state is shown in cross-section.

[0044] Figure 4B The display is in a folded state with a folded c-TTL. Figure 4A The optical module.

[0045] Figure 4C A lens system in a pop-up state is shown schematically in cross-section.

[0046] Figure 4D The diagram schematically shows a cross-section of a structure in a first folded state. Figure 4C The lens system described above.

[0047] Figure 5A Another optical module is shown in cross-section in a pop-up state.

[0048] Figure 5B The display is in a folded state. Figure 5A The optical module.

[0049] Figure 5C Another lens system in a folded state is shown schematically in cross-section.

[0050] Figure 5D and 5E This is an embodiment of another lens system that switches between a pop-up state and a folded state.

[0051] Figure 6A An embodiment of a handheld electronic device is shown, wherein a camera system of the handheld electronic device includes a standing wide-angle camera and a pop-up telephoto camera in a pop-up state.

[0052] Figure 6B show Figure 6A The device described herein has its pop-up telescope in a folded state.

[0053] Figure 7A Another embodiment of a handheld electronic device is shown, wherein a camera system of the handheld electronic device includes a standing wide-angle camera and a pop-up telephoto camera in a pop-up state.

[0054] Figure 7B show Figure 7A The device described herein has its pop-up telescope in a folded state.

[0055] Figure 8A This document shows an embodiment of the single-lens system disclosed herein.

[0056] Figure 8B This document shows an embodiment of another lens system disclosed herein.

[0057] Figure 9 This article discloses another camera system in a pop-up camera state.

[0058] Figure 10 This article discloses another camera system in a pop-up camera state.

[0059] Figure 11A This article discloses another camera system that is in a first pop-up camera state.

[0060] Figure 11B The display shows the camera is in a second, macro pop-up lens state. Figure 11A The lens system described above.

[0061] Figure 12A This article discloses another camera system that is in a first pop-up camera state.

[0062] Figure 12B The display shows the camera is in a second, macro pop-up lens state. Figure 12A The lens system described above.

[0063] Figure 13A This article discloses another camera system that is in a first pop-up camera state.

[0064] Figure 13B The display shows the camera is in a second, macro pop-up lens state. Figure 13A The lens system described above.

[0065] Figure 14A Displays a known sensor shift setting.

[0066] Figure 14BThis document shows a sensor shifting setup disclosed herein.

[0067] Figure 15A An exemplary optical system is shown at an initial time, for example, when the image sensor begins exposure for image capture.

[0068] Figure 15B show Figure 15A The optical system then takes place during a period of time when its image sensor is exposed to acquire an image, and after the camera of the handheld device has undergone an undesired linear motion in the negative Y direction relative to a stationary object at a distance d0.

[0069] Figure 16A A block diagram schematically illustrates the operation of a handheld electronic device used to perform OIS to correct undesired linear motion in the X and Y directions as described herein.

[0070] Figure 16B A block diagram schematically shows another handheld electronic device used to perform OIS to correct undesired linear motion in the X and Y directions as described herein.

[0071] Figure 17A This document shows an example of a pop-up optical lens system in a pop-up state.

[0072] Figure 17B The display is in a folded state. Figure 17A The pop-up optical lens system.

[0073] Figure 18A This document shows another embodiment of a pop-up optical lens system in a pop-up state as disclosed herein.

[0074] Figure 18B The display is in a folded state. Figure 18A The pop-up optical lens system.

[0075] Figure 19A This illustrates yet another embodiment of the pop-up optical lens system disclosed herein in a pop-up state.

[0076] Figure 19B The display is in a folded state. Figure 19A The pop-up optical lens system.

[0077] Figure 20A This illustrates yet another embodiment of the pop-up optical lens system disclosed herein in a pop-up state.

[0078] Figure 20B The display is in a folded state. Figure 20A The pop-up optical lens system.

[0079] Figure 21A This illustrates yet another embodiment of the pop-up optical lens system disclosed herein in a pop-up state.

[0080] Figure 21B The display is in a folded state. Figure 21A The pop-up optical lens system. Detailed Implementation

[0081] Figure 1C -F schematically shows a cross-sectional view of an embodiment of a telephoto camera lens system (or simply "lens system") disclosed herein, designated 100. Figure 1C The display lens system 100 is in a folded, non-operational state. Figure 1D The display lens system 100 is in a first operating telescope head state (or "telescope state"). Figure 1E The display lens system 100 is in a second operating telescope state. Figure 1F The lens system 100 is displayed in an operating macro lens state (or "macro state"). The lens system 100 includes a lens (with multiple lens elements), an optional optical window, and an image sensor.

[0082] Lens system 100 may include a pop-up telephoto camera such as camera 200, and an optical module such as optical module 240 (see Figure 4A -B) or 500 (see Figure 5A -B) wherein the optical module may be included in a pop-up mechanism such as pop-up mechanism 210 (see -B) Figure 2A -B、 Figure 3A -B and Figure 4A -B) forms a pop-up camera. Unless otherwise specified, a "telephoto mode" refers to a mode in which the lens system can focus on multiple objects within a range from infinity to approximately 50 cm, while a "macro mode" refers to a mode in which the lens system can focus on multiple objects within a range from approximately 50 cm to approximately 5 cm or less. Multiple telephoto modes enable telephoto photography, while multiple macro modes enable macro photography.

[0083] For simplicity, the term "pop-up" may be omitted before various components thereafter, but it should be understood that if a component is defined as a "pop-up" component the first time it is defined, then that component will be defined as such throughout the specification. The lens system 100 includes two sets of lens elements, namely group 1 (G1) and group 2 (G2). G1 and G2 are movable along a common optical axis to occupy different positions corresponding to different telephoto states. In some embodiments, two, three, four, or five specific lens states can be supported, for example, Figure 1C -E shows the four lens states. For example, PCT / IB2020 / 051405 describes a folding lens divided into several lens groups to achieve various lens states. Figure 1C -E also indicates the meaning of TTL, the first folded back focal length c-BFL, the first operating telescope state ("second" back focal length) back focal length BFL1, the third back focal length BFL2 and the fourth back focal length BFL3.

[0084] The pop-up design allows the camera to have an ultra-thin lens when not in use. When the camera is in use (“activated”), the lens pops out from the surface of an external device, entering an operational state as an optical system to produce a clear image on an image sensor. Each lens group includes multiple lens elements spaced at multiple fixed distances from each other, but with an air gap d between G1 and G2. G1-G2 It can be changed between different lens states. G1 and G2 can be moved relative to each other via an actuator, as described below, actuator 212. The actuator can move G1 and G2 relative to each other, for example, 0.05-8.5 mm (e.g., for modifying d...). G1-G2 (a gap), or it can move G1 and G2 together relative to the image sensor to switch from one lens state to another, such as from a telephoto state to a macro state.

[0085] In some embodiments, the transition between different lens focusing distances can be continuous; for example, the pop-up camera can continuously focus from infinity to, for example, 5 cm. In other embodiments, the transition can be discrete, with a continuous focusing range. For example, in a telephoto state, the pop-up camera can continuously focus on an object-lens distance (“u”) from infinity to, for example, 1 meter, and in a macro state, the pop-up camera can continuously focus on, for example, 40 cm to 5 cm. When transitioning between different lens states, the F-number (f / #) may only change slightly, for example, less than 5%, less than 10%, or less than 30% relative to the lens states at infinity, 10 cm, or 5 cm, respectively. In other embodiments, only two different lens states may be provided, such as a folding lens state and a telephoto lens state. The telephoto lens state can be switched to a macro lens state by simply changing the BFL, i.e., by moving all the lens elements.

[0086] Figure 1C The lens system 100 is shown in a folded state. Here, the folded TTL (“c-TTL”) of the lens can be 4-13 mm, the folded BFL (“c-BFL”) can be 0.15-4 mm, and the folded air gap “cd” is...G1-G2 "It can be 0.02-2.5 mm. In the folded state, the camera is not functional, that is, the optics cannot project a scene as a clear image onto the image sensor."

[0087] As an example of TTL and SD (“SD-example”), we will apply Equation 1 to a telephoto camera with a FOV of 30 degrees below. We assume EFL = TTL, and an image sensor can be in a 4:3 width / height format, so the sensor width W ~ 0.8SD.

[0088] Figure 1D The display lens system 100 is in a first extended (or "operated" or "pop-up") state, having a first zoom factor ZF1. The lens serves as a telephoto lens. Here, the first extended state TTL (TTL1) can be 5-13 mm, the first extended state BFL (BFL1) can be 0.25-5 mm, and the first extended air gap d... 1 G1-G2 It can be 0.15-3 mm. For an example SD with a TTL1=12 mm, SD=8.1 mm.

[0089] Figure 1E The display lens system 100 is in a second lens state, having a second zoom factor ZF2 > ZF1. The lens functions as a telephoto lens. Here, TTL2 can be 6-17 mm, BFL2 can be 0.45-6 mm, and d... 2 G1-G2 It can be 0.25-5 mm. For an SD example with a TTL2=14 mm, SD=9.5 mm.

[0090] Figure 1F The display lens system 100 is in a third lens configuration, having a third zoom factor ZF3 > ZF2. In this configuration, the lens functions as both a telephoto lens and a macro lens. When the camera-object distance is <15 cm, the magnification M for macro photography can be 15:1-2:1. TTL3 can be 7-20 mm, and BFL3 can be 0.5-8 mm. 3 G1-G2 It can be 0.35-8 mm. For an example with a TTL3=19 mm SD, SD=13 mm (corresponding to a 1 / 1.3" sensor).

[0091] For multiple embodiments that support a continuous change in shot state, in Figure 1C-F indicates that there can be continuous transitions between the multiple lens states. In some embodiments, G1 may include most of the optical power Φ of the entire lens, and G2 may correct the field curvature. "Most of the optical power" refers to a multiple greater than 2 between the optical powers of G1 and G2, i.e., ΦG1>2. ΦG2, where Φ=1 / EFL.

[0092] Figure 2A This illustration shows an embodiment of a pop-up telescope, numbered 200, disclosed herein, in an extended state and incorporated into a device 250. Camera 200 includes a pop-up optical module 240, which includes a pop-up lens 206. Camera 200 also includes an image sensor 208 and a pop-up mechanism 210, which includes an actuator 212 and a window frame 214 carrying a window 216. The window covers an aperture 218 of the pop-up telescope 200. The optical module 240 is covered by a cover 232.

[0093] The entrance pupil (or “aperture size”) of camera 200 can be, for example, 4-9 mm. For comparison, the entrance pupil of a pop-up telephoto camera is typically less than 4.5 mm, while the entrance pupil of a dedicated macro camera is typically less than 1 mm. Assuming the aperture size of pop-up telephoto camera 200 is 7 mm, and the aperture size of a pop-up telephoto camera is 4 mm, camera 200 will receive approximately 3 times more light, corresponding to a better low-light signal-to-noise ratio (“SNR”). Compared to the aforementioned dedicated macro camera with a 1 mm aperture size, camera 200 will have a 6-fold larger EFL and an approximately 40-fold shallower depth of field (DOF), translating to an approximately 40-fold stronger optical bokeh effect.

[0094] The lens, image sensor, and (optionally) an optical window or "filter" (not shown here, but present in, for example, lens systems 800, 850, 900, 1000, 1100, 1200, 1300, 1700, 1800, 1900, 2000, 2100) form a pop-up lens system 260. The camera may have a telephoto FOV of 15-50 degrees. T .

[0095] The TTL of the lens in the pop-up telephoto camera disclosed herein can be 5-35 mm. The image sensor can have a sensor diagonal SD in the range of 3.5-25 mm and an EFL from 6 mm to 45 mm.

[0096] Figure 2BA cross-sectional view showing an embodiment of the pop-up mechanism 210 in a pop-up state. The pop-up mechanism 210 is essentially a camera 200 without the optical module 240. The camera 200 also has a folded (“c” or “non-operating”) state, such as... Figure 3A -B is shown. Figure 3A A cross-sectional view of the camera 200 in the folded state is shown. Figure 3B Displays a cross-sectional view of the pop-up mechanism 210 in its respective folded states. The camera 200 switches between a pop-up state and a folded state according to a first method, wherein the gap d between G1 and G2... G1-G2 It is folded. The BFL remains unchanged. The lens system 800 switches according to the first method.

[0097] A pop-up optical module 240 and window frame 214 form an air gap (or simply a "gap") 222 between lens 206 and window 216, which may be, for example, 0.15-1.2 mm. The air gap 222 allows for a combined movement of approximately 0.1-1.1 mm between a first lens barrel portion 202 and a second lens barrel portion 204, thereby moving the lens to perform autofocus (AF) and OIS. The first lens barrel portion 202 includes G1. The second lens barrel portion 204 includes G2. In other embodiments, the air gap 222 can be much larger, for example, 6 mm. A module seal 224 prevents multiple particles and fluids from entering the camera.

[0098] The camera 200 has a significant pop-up protrusion height H on an outer surface 252 of the host device 250. P-O-B 226. “Significant” can be, for example, 1.0 mm to 15.0 mm. In the extended state, the camera 200 increases the height of the hosting device 250 to a “height in a pop-up state” H. P-O (Not displayed). H P-O It is by passing H P-O-B 226 is obtained by adding to the height H0 of a device excluding the protrusion, see, for example, H0606, H P-O =H0+H P-O-B .exist Figure 2A In this configuration, a single spring 230 pushes the first mirror barrel portion 202 toward the window frame 214. In other embodiments, the single spring may be replaced by multiple springs. In the pop-out state, the spring is in an extended state (characterized by an increased gap between G1 and G2), also see Figure 4A A guide pin 236 and a guide pin 238 guide the movement of the first lens barrel section 202.

[0099] Generally, lens 206 includes N ≥ 5 lens elements. In some embodiments, there may be more than two lens barrel sections, each lens barrel section having a lens group. For example, there may be 3, 4, or 5 lens barrel sections, each lens barrel section having a lens group. An example of a multiple lens system having two lens groups is... Figure 8A , Figure 8B , Figure 13A , Figure 13B , Figure 17A , Figure 17B , Figure 20A and Figure 20B The lens systems shown are 206-1, 206-2, 206-3, 206-4, 206-6, 206-7, 206-8, 206-9, 206-10, and 206-11. Examples of lens systems with three lens groups are shown in... Figure 12B and Figure 21A The multiple lens systems 206-5 and 206-12 are shown in section -B. These multiple lens barrel sections can be divided into multiple fixed lens barrel sections and multiple movable lens barrel sections. In lens 206, G1 may include lens elements L1-LN-1, and G2 includes lens element LN. Depending on the relative movement of the lens groups, multiple air gaps with varying thickness d can be formed between the multiple lens groups. In examples with more than two lens barrel sections, some or all of the lens barrel sections may be movable, forming their respective multiple air gaps between the multiple lens groups. In some examples, all air gaps between the multiple lens groups can be folded in a non-operating camera state. In other examples, only some, but not all, of the air gaps between the lens groups can be folded in a non-operating state. The total length of such air gaps can be 1-9.5 mm.

[0100] A lens group can be determined by the maximum air gap between a plurality of consecutive lens elements. For example, the maximum air gap existing between two consecutive lens elements can be used to divide a lens into two lens groups, and the maximum air gap and a second large air gap existing between two consecutive lens elements can be used to define three lens groups, and so on. In some examples, a foldable air gap is formed between two consecutive lens elements. In other examples, a foldable air gap is formed between a lens element and another optical component, such as between a lens element and an optical filter, or between a lens element and an image sensor (i.e., the air gap is the BFL).

[0101] For an example supporting two, three, or four specific lens states, there can be two, three, or four specific air gap values. For other embodiments supporting a continuous change in lens states, multiple values ​​for multiple air gaps can change continuously.

[0102] In the extended state and referring to Figure 2A air gap dG1-G2 The diameter can be 1-9 mm. Guide pins 236 and 238 can guide the movement of the first cylinder section 202 and G1 in the XZ plane to provide mechanical stability and repeatability in the XZ plane.

[0103] In some embodiments, a guiding and positioning mechanism as described in PCT / IB2020 / 058697 may be based on a motion coupling mechanism.

[0104] An optical system, such as camera 200, can be designed to support, for example, a guiding positioning mechanism based on a motion coupling mechanism, in some examples, an eccentricity tolerance of, for example, ±20 micrometers (µm) in the XZ plane, an eccentricity tolerance of, for example, ±10 micrometers in the Y direction, and ±0.5 The eccentricity repeatability tolerance can be, for example, ±10 micrometers in the XZ plane and ±5 micrometers in the Y direction, as well as ±0.25. The tilt. In other examples, the eccentricity tolerance can be, for example, ±10 micrometers in the XZ plane and ±5 micrometers in the Y direction, and for example, ±0.15. The eccentricity repeatability tolerance can be, for example, ±5 micrometers in the XZ plane and ±2.5 micrometers in the Y direction, as well as ±0.08. The eccentricity tolerance can be, for example, ±5 micrometers in the XZ plane and ±2.5 micrometers in the Y direction, and for example, ±0.1 micrometers. The eccentricity repeatability tolerance can be, for example, ±1.5 micrometers in the XZ plane and ±0.8 micrometers in the Y direction, as well as ±0.05 micrometers. A tilt.

[0105] "Accuracy tolerance" refers to the maximum variation in multiple distances between multiple optical elements and multiple mechanical elements. "Repeatability tolerance" refers to the maximum variation in multiple distances between multiple optical elements and multiple mechanical elements during different pop-up cycles; that is, the ability of multiple mechanical and optical elements to return to their previous positions after one or more pop-up (or folding) events. Tolerances in the Y direction can be less important because variations in the Y direction can be compensated for by optical feedback and autofocusing by moving the lens.

[0106] Figure 3A The pop-up camera 200 is displayed in a folded or inactive state. To switch the optical module 240 to the folded state, the actuator 212 reduces the air gap d by moving the window frame 214. G1-G2Applying pressure to the first (here, foldable) lens barrel portion 202 translates into a movement of the foldable lens barrel portion toward the image sensor. The TTL of the camera is now a folded TTL (c-TTL) and can be 4.5-12 mm. A "folded air gap" CD G1-G2 It can be 0.05-2.5 mm. It has a foldable air gap d. G1-G2 Examples of lens systems for a pop-up camera with a non-folding BFL include lens systems 800, 1200, and 1300.

[0107] exist Figure 3A In the middle, the camera 200 forms a foldable bump (c-bump) with a height H relative to the outer surface 252 of the device. C- B 228. H C-B It can be 0-3 mm. In the folded state, the camera increases the height of the hosting device 250 to a "folded state height" H. C =H0+H C-B .

[0108] like Figure 1C The multiple lens states shown in -F can be modified by changing the air gap, for example, d G1-G2 This is achieved through [the following methods]. In other examples, a pop-up mechanism can have more than two lens states, such as three or four states. Three lens states can include one folded state and two pop-up (operation) states, with two different or identical pop-up protrusion heights. Four lens states can include one folded state and three pop-up (operation) states, with three different or identical pop-up protrusion heights.

[0109] Figure 4A The optical module 240 is shown in cross-section in a pop-up state. Figure 4B An optical module 240 with a folded c-TTL is shown in cross-section in a folded state. The BFL (Browser Flange) remains unchanged when switching from the pop-up state to the folded state. According to the first method, the camera 240 switches between a pop-up state and a folded state.

[0110] Figure 4C A lens system 400 in a pop-up state is schematically shown in cross-section. System 200 includes a pop-up lens 206 and an image sensor 208. Lens 206 includes two lens groups (G1 and G2) separated by a large gap (BG). The thicknesses of G1 and G2 (along an optical axis of the lens) are respectively expressed as T... G1 and T G2 express. Figure 4DA lens system 400 in a first folded state is schematically shown in cross-section. Camera 400 switches between a pop-up state and a folded state according to a second method, wherein the BFL folds into a c-BFL, but the gap between G1 and G2 remains unchanged. Lens systems 850, 900, 1000, 1700, and 1800 switch between a pop-up state and a folded state according to the second method.

[0111] Figure 5A The optical module 500 is shown in cross-section in a pop-up state. Figure 5B The optical module 500 is shown in a folded state in cross-section. To form a pop-up camera, the optical module 500 can be integrated into a pop-up mechanism, such as 210 (not shown), which has a window 216 covering an aperture 518. In the folded state, the CD... G1-G2 The distance can be 0.05-1.5 mm, and c-BFL can be 0.05-2.5 mm. Here, BFL changes when switching from the pop-up state to the folded state. The difference between c-TTL and TTL stems from two correction distances: the correction distance between G1 and G2, determined by d... G1-G2 and CD G1-G2 The difference is given, as well as the corrected distance between G2 and image sensor 208, given by the difference between BFL and c-BFL. Camera 500 switches between a pop-up state and a folded state according to a third method, wherein a gap between the two lens groups is folded, and the BFL is also folded. Lens systems 850, 900, 1000, 1900, and 2000 switch between a pop-up state and a folded state according to the third method.

[0112] Figure 5C Another lens system 510 in a folded state is schematically shown in cross-section. In a pop-up state, camera 510 is identical to camera 400. According to the third method, camera 510 switches between a pop-up state and a folded state.

[0113] Figure 5D-5E This document illustrates an embodiment of a lens system 550 that switches between a pop-up state and a folded state according to a fourth method, wherein two gaps between three lens groups are folded. The system 550 includes a pop-up lens 552 and an image sensor 554. Figure 5D The display system 550 is in a pop-up state. The lens 552 includes two lens groups G1 and G2, separated by a first large gap (BG1), and a field lens separated from G2 by a second large gap (BG2).

[0114] Figure 5EThe lens system 550 is shown in a folded state. BG1 is folded into a folded BG1 (“c-BG1”), and BG2 is folded into a folded BG2 (“c-BG2”). BFL remains unchanged. According to the fourth method, lens systems 1100, 1200, 1300, and 2100 switch between a pop-up state and a folded state. Figure 6A This illustration shows an embodiment of a handheld electronic device (e.g., a smartphone) 600, wherein a camera system of the handheld electronic device includes a conventional (upright) wide-angle camera 602 and a pop-up telephoto camera 604 in an operational pop-up state. Height H0606 is the height of the device 600 (excluding a "camera protrusion"). In the pop-up state, the telephoto pop-up camera operates at a height of H0606. P-O-B A camera protrusion 608 of 226 extends (raises) the outer surface 252 of the device. A large image sensor such as 208 (not visible here) and a pop-up mechanism such as pop-up mechanism 210 (not fully visible here), required for switching between a folded and pop-up camera state, can define a minimum area of ​​the outer surface 252 of the device, which is covered by the pop-up camera (in the XZ plane). Figure 6B The display shows the host device 600 and the pop-up telescope 604 in a folded state, illustrating the small height H of the c-bump 608' when the telescope 604 is in the folded state. C-B 228.

[0115] Figure 7A This displays another embodiment of a device 700, the device having a camera system including a wide-angle pop-up camera 702 and a telephoto pop-up camera 704, both disclosed herein in an operational pop-up state. Height is H. P-O-B The pop-out protrusion 708 of 226 is visible. A pop-out cover 706 covers the telescope and the wide-angle camera. A similar pop-out mechanism 210 (not shown) simultaneously switches the telescope and the wide-angle camera between one or more pop-out states and a folded state, i.e., an actuator such as actuator 212 for state switching can control one or more air gaps of both the telescope and the wide-angle camera. Figure 7B The display host device 700, with its multiple cameras in a folded state, has a height of H. C-B The 228 c-bump 708' is visible. The wide-angle camera features a folded TTL, c-TTL... W It can be similar to the folded TTL, c-TTL of the aforementioned telescope camera. T For example, cTTL W =cTTL T ±10% or cTTL2=cTTL±20%. All the lens systems shown below can be included in a pop-up optical module, such as 240 or 500, and in a pop-up camera, such as 200.

[0116] Figure 8A A lens system 800 is shown in a pop-up state. Lens system 800 includes a first embodiment of a lens 206-1. Lens 206-1 includes eight lens elements labeled L1-L8, starting with L1 on the object side facing the object and ending with L8 on the image side facing the image sensor. These lens elements are arranged in two lens groups G1 and G2. G1 includes lens elements L1-L6, and G2 includes L7 and L8. An optional window 802 may be, for example, an optical filter. The optical axis is indicated as 804. Lens 206-1 is shown in a first zoom state, having ZF1 and EFL. T =13mm, F#=1.1-1.8, and TTL=19.84mm. Lens 206-1 can be modified by changing d G1-G2 And / or BFL continuously or discontinuously switches to further zoom mode (with specific ZF2 or ZF3).

[0117] In the pop-up state, G1 and G2 are separated by an air gap d. G1-G2 =6.22 mm (i.e., T13, S in Table 1) 13 and S 14 The distance between them is separated by an air gap d17 = 0.51 mm (T17, S in Table 1). 13 and S 14 The distance between them is 1.02 mm.

[0118] In a folded state with a folded c-TTL, G1 and G2 can communicate via cd. G1-G2 The distance between G2 and the image sensor 208 can be 0.02-2.5 mm, and c-BFL can be 0.2-0.8 mm. The c-TTL of the lens system 800 can be c-TTL = 12.6-16 mm, c-TTL / EFL can be equal to or greater than 0.97, and c-TTL / TTL can be equal to or greater than 0.64.

[0119] In other examples, only the air gap d is affected when switching between a pop-up state and a folded state. G1-G2 It can be changed to cd G1-G2 It can be 0.2-2.5 mm. BFL can remain unchanged.

[0120] In some examples, G1+G2 can be relative to the image sensor 208 within a range RAF The internal movement allows the camera to focus from infinity to 1 meter or even 4 centimeters. AF It can achieve a resolution of 1 millimeter when focused at 1 meter and 7 millimeter when focused at 4 centimeters.

[0121] The lens system 800 is represented by Tables 1-2. Table 1 provides the optical data of the lens 206-1 in the pop-up state, and Table 2 provides the aspherical data.

[0122]

[0123] Table 1

[0124] Table 2 Figure 8B Another lens system 850 is shown. Lens system 850 is shown in a pop-up state. Design data is given in Tables 3-5. Lens system 850 includes a lens 206-7 with six lens elements L1-L6, an optical window 802, and an image sensor 208. L1-L3 form G1, and L4-L6 form G2. The TTL is 13.5 mm, and the BFL is 5.49 mm. The focal length is EFL = 15.15 mm, F-number = 2.0, and FOV = 32.56 degrees. Air gap d G1-G2 It measures 1.78 millimeters. In a folded state, a "folded" cTTL can be 5-11 mm. The difference between cTTL and TTL stems from a modified air gap between L3 and L4, namely a folded air gap cd. G1-G2 The thickness can be 0.05-1.0 mm, and a modified BFL, c-BFL, can be 0.1-1.5 mm. For lens system 850, the TTL / EFL ratio is 0.89, meaning EFL > TTL. The cTTL / EFL ratio can be 0.35-0.75.

[0125]

[0126] Table 3

[0127] Table 4

[0128] Table 5 Figure 9A lens system 900 is shown in a pop-up state. The lens system 900 includes a second embodiment of a lens, designated 206-2. Lens 206-2 includes five lens elements, labeled L1-L5, arranged at G1 (L1 and L2) and G2 (L3, L4, and L5). Lens 206-2 is shown in a first zoom state, featuring ZF1 and EFL. T =7.97mm, F#=1.2-2.0, TTL=7.78mm. Lens 206-2 can be modified by changing d G1-G2 And / or BFL continuously or discontinuously switches to further zoom mode (with specific ZF2 or ZF3).

[0129] In the pop-up state, G1 and G2 are separated by an air gap d. G1-G2 =0.974 mm (T4 in Table 3) is separated from G2 by an air gap d10 = 2.66 mm (T10). The BFL is 3.27 mm.

[0130] In a folded state with a folded c-TTL, G1 and G2 can be connected by cd. G1-G2 = 0.02-0.75 mm apart, G2 and image sensor 208 can be separated by c-BFL = 0.2-2.5 mm.

[0131] In several other examples, when switching between a pop-up state and a folded state, only the BFL can be modified to c-BFL = 0.2-2.5 mm, and the air gap d G1-G2 This can remain unchanged. The c-TTL of the lens system 900 can be 3.6-7.7 mm. The c-TTL / EFL ratio can be equal to or greater than 0.45, and the c-TTL / TTL ratio can be equal to or greater than 0.46.

[0132] G1+G2 is relative to the image sensor 208 and is within a range R AF The interior can move together.

[0133] Lens system 900 is represented by Table 6-7.

[0134]

[0135] Table 6

[0136] Table 7 Figure 10A lens system 1000 is displayed in a pop-up state. The lens system 1000 includes a third embodiment of a lens numbered 206-3. Lens 206-3 includes five lens elements L1-L5 arranged in G1 (L1) and G2 (L2-L5), and is displayed in a first zoom state with ZF1, EFL. T =16mm and TTL=15mm. Lens 206-3 can be modified by changing d. G1-G2 And / or BFL continuously or discontinuously switches to further zoom mode (with specific ZF2 or ZF3).

[0137] In the pop-up state, G1 and G2 are separated by an air gap d. G1-G2 =1.547 mm (T2 in Table 5) is separated from G2 by an air gap d10 = 4.115 mm (T10). The BFL is 6.998 mm.

[0138] In a folded state with a folded c-TTL, G1 and G2 can communicate via cd. G1-G2 =0.02-0.75 mm separation, G2 and image sensor 208 can be separated by c-BFL = 0.2-5 mm. In several other examples, when switching between a pop-up state and a folded state, only BFL can be modified to c-BFL = 0.2-2.5 mm, and the air gap d G1-G2 It can remain unchanged. The c-TTL of the lens system 1000 can be 6.2-13mm. The c-TTL / EFL ratio can be equal to or greater than 0.39, and the c-TTL / TTL ratio can be equal to or greater than 0.41.

[0139] G1+G2 is relative to the image sensor 208 and is within a range R AF They can move together within the range. R AF The focusing depth can reach 0.6 mm when focusing downwards to 1 meter, and 8 mm when focusing downwards to 0.04 meters.

[0140] Lens system 1000 is represented by Tables 8-9. Table 5 provides optical data for lens 206-3 in a pop-up state, and Table 6 provides aspherical data.

[0141]

[0142] Table 8

[0143] Table 9 Figure 11A-B indicates that the lens system 1100 is in two pop-up states. The lens system 1100 includes a fourth embodiment of a lens numbered 206-4. Lens 206-4 includes six lens elements L1-L6 arranged in G1 (L1-L2) and G2 (L3-L6), separated by an air gap d. G1-G2 Separate. The lens system 1100 can continuously focus from infinity to, for example, 5 centimeters. Figure 11A The display lens system 1100 is focused at infinity in a telephoto lens configuration. Figure 11B The display lens system 1100 is focused at 5 cm in macro lens mode. For the focusing lens 206-4, d G1-G2 And the BFL is modified, that is, the two air gaps present in 1100 are modified. The TTL changes continuously and depends on u, from TTL=15 mm (focused at infinity) to TTL=20.9 mm (focused at 5 cm).

[0144] In the telescopic state (see) Figure 11A ), with ZF1 and focused at infinity, 206-4 has F / #=1.3-1.9, EFL T =14.98 mm, and TTL=15 mm. In the telescope configuration, G1 and G2 are separated by an air gap d. T G1-G2 =1.909 mm (i.e., T5, the distance between S5 and S6 in Table 8) separated G2 and the image sensor by a BFL T =0.586 mm (i.e., T13 in Table 8) separation. For the aforementioned telescope state, a ratio of c-TTL / EFL can be c-TTL / EFL ≥ 0.57, and a ratio of c-TTL / TTL can be c-TTL / EFL ≥ 0.57. 206-4 can be modified by d G1-G2 And / or BFL continuously or discontinuously switches to further zoom mode (with specific ZF2 or ZF3).

[0145] In the macro configuration (see) Figure 11B And focusing at 5 cm, 206-4 has F / #=1.7-2.8, EFL M =14.8 mm, TTL=20.9 mm. In this macro state, G1 and G2 are separated by an air gap d. M G1-G2 =1.441 mm apart, G2 and the image sensor are separated by BFL M =6.955 mm apart. According to the thin lens equation (Equation 2):

[0146] For EFL≈15 mm and u=50 mm, the effective lens-image distance v≈21 mm, achieving a ratio of approximately 2.4:1 to M.

[0147] In a folded state with a folded c-TTL, G1 and G2 can be connected via, for example, cd. G1-G2 The distance between G2 and the image sensor 208 can be 0.02-1.4 mm, and c-BFL can be 0.2-0.8 mm. The c-TTL of the lens system 1100 can be 8.5-14 mm. For the macro mode, the ratio c-TTL / EFL can be equal to or greater than 0.57, and the ratio c-TTL / TTL can be equal to or greater than 0.41.

[0148] In some examples, another (large) air gap, such as an air gap d11 between L5 and L6, can be folded when switching to a folded state. For an example with a foldable air gap d11, the c-TTL of the lens system 1100 can be 8.5-11 mm.

[0149] In several other examples, only d... G1-G2 =0.02-1.4 mm can be modified to cd G1-G2 =0.02-1.4 mm, and BFL can remain unchanged. In other examples, when switching between a pop-up state and a folded state, only BFL can be modified to c-BFL=0.2-0.8 mm, and the air gap d G1-G2 It doesn't have to be changed.

[0150] Lens system 1100 is represented by Tables 10-13. Tables 10 and 11 provide optical data for lens 206-4 in pop-up mode and (focused at infinity (left) and 5 cm (right)). Table 12 provides aspherical data, and Table 13 provides data for multiple focal lengths L1-L6, as well as data for G1 and G2.

[0151]

[0152] Table 10

[0153] Table 11

[0154] Table 12

[0155] Table 13 Figure 12A-B indicates that the lens system 1200 is in one of two pop-up states. The lens system 1200 includes a fifth embodiment of a lens 206-5. Lens 206-5 includes six lens elements L1-L6, divided into three lens groups G1 (L1-L3), G2 (L4-L5), and G3 (L6). G1 and G2 are separated by an air gap d. G1-G2 Separated, G2 and G3 are separated by an air gap d G2-G3 Separate. The lens system 1200 can continuously focus from infinity to, for example, 5 centimeters. Figure 12A The display lens system 1200 is focused at infinity in a telephoto lens configuration. Figure 12B The display lens system 1200 is focused at 5 cm in macro lens mode. For the focusing lens 206-5, d G1-G2 and d G2-G3 The TTL is increased or decreased. The TTL varies continuously from TTL=15 mm (focused at infinity) to TTL=20.9 mm (focused at 5 cm).

[0156] In the telescopic state (see) Figure 12A ), with ZF1 and focused at infinity, 206-5 has F / #=1.2-1.8, EFL T =15 mm and TTL=18.7 mm. In the telescope state, d T G1-G2 =5.073 mm (i.e., T7, the distance between S7 and S8 in Table 11), G2 and G3 are separated by d T G2-G3 =4.813 mm (i.e., T11) separation. For the aforementioned telescope state, the ratio c-TTL / EFL can be equal to or greater than 0.59, and the ratio c-TTL / TTL can be equal to or greater than 0.48. 206-5 can be modified by d G1-G2 d G2-G3 And / or BFL, continuously or discontinuously switching to further zoom states (with specific ZF2 or ZF3).

[0157] In the macro configuration (see) Figure 12B Focusing at 5 cm, 206-5 has F / #=1.3-1.9, EFL M = 9.8 mm and TTL = 20.9 mm. In the macro state, d M G1-G2 =2.908 mm, d M G2-G3=9.175 mm. The BFL of 206-5 is =0.95 mm, not modified for focusing. According to Equation 2, for EFL≈10 mm and u=50 mm, the lens-image distance (“v”) is v≈12.5 mm, achieving approximately 4:1 M.

[0158] In a folded state with a folded c-TTL, G1 and G2 can be connected by cd. G1-G2 =0.02-2.5 mm apart, G2 and G3 can be separated by cd G2-G3 =0.02-4.5 mm gap. The two air gaps can be modified when switching between a pop-up state and a folded state. The c-TTL of the lens system 1200 can be 8.8-15 mm. For the macro state, the ratio c-TTL / EFL can be equal to or greater than 0.89, and the ratio c-TTL / TTL can be equal to or greater than 0.43.

[0159] In some examples, another (large) air gap, such as the air gap d9 between L4 and L5, can be folded when switching to a folded state. For an example with a foldable air gap d9, the c-TTL of the lens system 1200 can be 7.6-15 mm, corresponding to a c-TTL / EFL ratio ≥0.76.

[0160] In other examples, only d... G1-G2 It can be changed to cd G1-G2 = 0.02-1.4 mm, d G2-G3 It can remain unchanged. In other examples, only d changes when switching between a pop-up state and a collapsed state. G2-G3 It can be changed to cd G2-G3 =0.02-4.5 mm, d G1-G2 It doesn't have to be changed.

[0161] Lens system 1200 is represented by Tables 14-17. Tables 14 and 15 provide optical data for lens 206-5 in the pop-up state (focused at infinity and 5 cm), Table 16 provides aspherical data, and Table 17 provides focal length and data for G1, G2, and G3 for each lens element.

[0162]

[0163] Table 14

[0164] Table 15

[0165] Table 16

[0166] Table 17 Figure 13A -B shows the lens system 1300 in two pop-up states. The lens system 1300 includes a lens 206-6 in a sixth embodiment. Figure 13A The display lens system 1300 is focused at infinity in a telephoto lens configuration (“Configuration A”). Figure 13B The display lens system 1300 is focused at 5 cm in a macro lens configuration (“Configuration C”). Lens 206-6 comprises two lens groups G1 (L1-L2) and G2 (L3-L6), connected by an air gap d. G1-G2 Separate. Lens system 1300 can continuously focus from infinity to, for example, 5 cm. For focusing lens 206-6, d G1-G2 And BFL is changed. TTL changes continuously and depends on u, from TTL=15.8 mm (focusing at infinity) to TTL=20.4 mm (focusing at 5 cm). That is to say, in order to focus, G1 and G2 have a relative movement, and in addition, G1 and G2 move together (see Table 20).

[0167] In the telescopic state (see) Figure 13A The lens, 206-6, features ZF1 focusing at infinity and has an f / # of 1.3-1.9 and an EFL. T =15 mm and TTL=15.8 mm. In the telescope state, d T G1-G2 =2.625 mm (i.e., T5, the distance between S5 and S6 in Table 20), BFL = 0.844 mm. 206-6 can be modified by changing d. G1-G2 And / or BFL continuously or discontinuously switches to further zoom mode (with specific ZF2 or ZF3).

[0168] In the macro configuration (see) Figure 13B Focusing at 5 cm, 206-6 has F / #=1.5-2.6, EFL M =15 mm and TTL=20.4 mm. In the macro state, d M G1-G2 =1.303 mm, BFL=6.818 mm. Achieve an AM ratio of approximately 2.5:1.

[0169] In a folded state with a folded c-TTL, G1 and G2 can be connected via, for example, cd. G1-G2 =0.02-1.5 mm separation, L3 and L4 can be separated by c-d7=0.02-2.5 mm. The c-TTL of lens system 1200 can be 9.5-13.5 mm.

[0170] In other examples, when switching between a pop-up state and a folded state, only d7 can be modified to c-d7 = 0.02-2.5 mm, d G1-G2 It can remain unchanged. In other examples, only d changes when switching between a pop-up state and a collapsed state. G1-G2 It can be changed to cd G1-G2 =0.02-1.5 mm, d7 can remain unchanged.

[0171] Lens system 1300 is represented by Tables 18-21. FOV is expressed as half field of view (HFOV). Tables 18 and 19 provide optical data for lens 206-5 in its pop-up position. Table 20 provides data for aspherical lenses.

[0172] Table 20 shows three focusing configurations of lens system 1300: focusing to infinity (“Configuration A”), focusing to 100 mm (“Configuration B”, not shown), and focusing to 50 mm (“Configuration C”). Surface 0 in Table 20 gives the focused value u. Table 21 provides data for half field of view (HFOV), M, and f / #. Lens system 1300 can continuously focus from infinity to 50 mm. For continuously changing the focus of lens system 1300, d G1-G2 And the value of BFL changes continuously.

[0173]

[0174] Table 18

[0175] Table 19

[0176] Table 20

[0177] Table 21 Examples of lens systems such as 800, 850, 900, 1000, 1100, 1200, and 1300 have focusing ranges from infinity to less than 150 mm, from infinity to, for example, 1 or 2 meters, and from, for example, 350 mm to less than 150 mm, for example, down to 50 mm. The focusing range of a lens system is defined as all the distances u that a camera mechanism can focus on by controlling the distance between the lens and the image sensor. That is, for each object within the focusing range, a focusing mechanism can set a specific v such that the image of the object has maximum contrast. Maximum contrast means that for multiple lens-image sensor distances beyond a specific lens-image sensor distance, the contrast of the object will decrease. A minimum object distance (MIOD) is defined as the lower limit of the focusing range, i.e., the MIOD is the smallest u that the lens system can focus on. For example, some embodiments shown above can focus from infinity to 50 mm, i.e., the MIOD is 50 mm.

[0178] Figure 14A This displays a known sensor shift setting. The sensor is shown from an observation point on the camera's optical axis (not shown on the camera). Most mobile devices equipped with OIS today correct for unwanted device movement in the yaw and pitch directions. As indicated by arrow 1402, for yaw correction, the sensor is moved parallel to the X direction. As indicated by arrow 1404, for pitch correction, the sensor is moved parallel to the Y direction.

[0179] Figure 14B This document illustrates a sensor shifting configuration disclosed herein. The sensor is coupled with... Figure 14A Displayed from the same perspective. For example... Figure 14B As shown, a correction for the undesired linear motion in the X direction (indicated by arrow 1406) and the Y direction (indicated by arrow 1408) can be performed along the same axes used for yaw and pitch corrections, respectively. The corrections for the undesired linear motion in the X and Y directions can be superimposed on the corrections for the hand rotational motions of yaw and pitch.

[0180] Figure 15A An exemplary optical system 1500 is shown, having an optical axis 1502 parallel to X. It includes an object 1504, a lens 1506, and an image 1508 of the object 1504 formed at an image sensor 1510. The lens 1506 may have a principal plane 1512. Figure 15A The optical system 1500 is displayed at an initial time, such as when the image sensor begins exposure for image capture. The optical system 1500 has an M ratio of 1:1.

[0181] Figure 15B The display optical system 1500 is shown at a subsequent time during image sensor 1510 exposure for image capture, and after the camera-hosting device has experienced an undesired linear motion of a distance d0 (relative to the stationary object) in the negative Y direction. This undesired linear motion results in a linear movement of an object point at a distance d0 in the positive Y direction. On image sensor 1510, this results in a linear image shift of a distance d in the negative Y direction, ultimately leading to image blurring. d depends not only on the magnitude and direction of the actual undesired linear motion, but also on u: on image sensor 1510, the actual undesired linear motion is determined according to... The relationship with u and v is amplified or attenuated. According to equation 2, d sensor The relationship with d0 is:

[0182] (Equation 3) From Equation 3, we learn that for a typical image acquisition scenario of a wide-angle camera (wide-angle example: EFL = 5 mm, u > 10 cm) or a telephoto camera (telephoto example: EFL = 13 mm, u > 100 cm), a linear shift d0 in the object plane results in a linear shift d in the image sensor 1510. S For the wide-angle example (u=10 cm), d S ≈0.05 For the example telescope (u = 100 cm), d0 S ≈0.01 d0. Generally, assuming u >> EFL, undesirable linear motion such as d0 does not significantly degrade image quality. However, this assumption is invalid for cameras with high magnification M, such as the pop-up camera in the macro configuration described in this paper. Consider, as an example, a telephoto camera with EFL = 13 mm, focused at an object-lens distance of u = 10 cm (first macro example: EFL = 13 mm, u = 10 cm) and u = 5 cm (second macro example: EFL = 13 mm, u = 5 cm). For the first macro example d S ≈0.15 d0, for the second macro example d S ≈0.35 d0. This shows that a significant degradation in image quality caused by unintended linear motion in the X and Y directions is to be expected. An unintended linear motion of a handheld device can be sensed by a motion sensor, such as an inertial measurement unit (IMU). An IMU provides data on linear acceleration, which will be integrated to determine the linear displacement.

[0183] Figure 16AA block diagram schematically shows a device 1600 for performing OIS (Optical Interference System) to correct undesired linear motion in the X and Y directions as described herein. Device 1600 includes a field of view (FOV). T A telescope 1610. In some examples, camera 1610 is a (upright) pop-up camera with macro capability. In other examples, camera 1610 is a folding or upright telescope with macro capability. Telescope 1610 includes an actuator 1612 and a position sensor 1614 (e.g., a Hall sensor) for closed-loop actuation and control, a lens 1616, and an image sensor 1618. If telescope 1610 is a pop-up camera, lens 1616 may include a foldable lens. If telescope 1610 is a folding camera, it may include an optical path folding element (OPFE, not shown) for folding an optical path, typically folding it 90 degrees. If telescope 1610 is a double-folding camera, it may include two OPFEs (not shown) for folding an optical path twice, typically folding it 90 degrees each time. OIS can be performed as either "lens-shift" OIS or "sensor-shift" OIS. In a collapsible telephoto camera, OIS can be performed as "prism OIS," where one or both OPFEs can rotate or move linearly to perform the OIS described herein. For sensor-shift OIS, the image sensor 1618 moves relative to the lens 1616 and the device 250. For sensor-shift OIS, it is necessary to use d S A sensor shift is used to correct an unwanted linear motion of d0 given by Equation 3. In lens-shift OIS, the lens moves relative to the image sensor 1618 and the device 250. For lens-shift OIS, it is necessary to correct the unwanted linear motion of d0 by shifting the sensor. L A camera shift is used to correct an unwanted linear motion of d0. The camera shift d L Depends on d S (Equation 4) and d0 (Equation 5), according to: (Equation 4) as well as (Equation 5) In other examples, OIS can be performed by moving the entire telescope, meaning that multiple components of the telescope, such as the lens and image sensor, do not move relative to each other for the purpose of performing OIS, but move together relative to device 1600. Device 1600 includes an application processor (AP) 1620, which includes a depth estimator 1622, an OIS controller 1624, and a microcontroller unit (MCU, not shown). Device 1600 also includes an IMU 1604, at least one second camera 1630, and a memory 1640. The MCU can be used to read and process data from the IMU 1604. In some examples, the MCU can be controlled by an OIS controller 1624, which is part of the AP 1620. Camera 1630 can be, for example, a wide-angle camera or an ultra-wide-angle camera. FOV W For example, 60-90 degrees, FOV UW The angle can be, for example, 90-130 degrees. In other examples, 1600 may include multiple additional cameras. These additional cameras may be, for example, a wide-angle camera, an ultra-wide-angle camera, an additional telephoto camera, or a time-of-flight (ToF) camera. Memory 1640 may be, for example, a non-volatile memory (NVM) for storing calibration data. The calibration data may be, for example, for calibration between telephoto camera 1610 and the second camera 1630. In other examples, the calibration data may be stored in storage element 1640 and / or multiple additional storage elements (not shown). These multiple additional storage elements may be integrated into the camera 1610 and the second camera 1630, or integrated into only one of the multiple camera modules, and may be electrically erasable programmable read-only memory (EEPROM). Memory 1640 may also store image data, depth data, or metadata of a specific scene, scene segment, or object. The metadata may be, for example, one or more depth values.

[0184] Another example of a device numbered 1650, operated to perform OIS to correct undesired linear motion in the X and Y directions as described herein, is shown in Figure 16B The device 1650 includes an MCU 1630 configured to read and process motion data provided by the IMU 1604, and to read and supply multiple OIS control signals to the telescope 1610, i.e., to read and process data from the position sensor 1614 and supply multiple control signals to the driver of the actuator 1612.

[0185] For depth estimation, image data from telephoto camera 1610, camera 1630, or multiple additional cameras or components is transmitted to the depth estimator 1622. The depth estimator 1622 calculates the depth in a manner known in the art. In some examples, the depth estimator 1622 calculates the depth by the field of view (FOV). T A depth map covering the entire scene. In other examples, depth estimator 1622 calculates a depth map of the multiple image segments of the scene, including a specific object of interest (OOI) or region of interest (ROI). In still other examples, depth estimator 1622 calculates only a single value, which corresponds to a depth range of a focused object. In still other examples, depth information may be provided by a laser rangefinder (“Laser AF”), which performs a time-of-flight measurement. The image data transmitted to depth estimator 1622 may be, for example: Phase detection autofocus (PDAF) data from the second camera 1630; PDAF data from the aforementioned telescope 1610; Stereoscopic image data, for example, from telescope 1610 and second camera 1630; Focused overlay of visual image data; Focus on overlay PDAF data; Visual image data from telephoto camera 1610 and / or second camera 1630 (used to estimate depth from defocus). Visual image data from telescope 1610 and / or second camera 1630 (used to estimate depth from object motion). Depth data from a second camera 1630, which may be a time-of-flight (ToF) camera.

[0186] In some examples, visual image data from telescope 1610 and / or camera 1630 can be used to estimate depth from motion, for example, from a preview video stream comprising multiple images. By disabling OIS, d0 between two or more frames can be estimated from IMU information, and d can be estimated from the movement of an image point between two or more frames. S By estimating u according to Equation 3, the depth can be estimated from the motion.

[0187] The OIS controller 1624 receives linear acceleration data from the IMU 1600 and depth data of the focused object (or a large segment of the scene) u from the depth estimator 1622. For OIS with undesired linear motion in X and Y, the OIS controller 1624 and / or an MCU such as MCU 1630 estimate d0 from the linear acceleration data of the IMU and calculate d for sensor-shift OIS or lens-shift OIS according to Equation 3 or Equation 5, respectively. S or d L The OIS controller 1624 and / or MCU 1630 transmit multiple control signals to the actuator 1612. The actuator 1612 can actuate an image sensor to achieve sensor shift OIS and / or lens shift OIS. The OIS controller 1624 and / or MCU 1630 receive position data from the position sensor 1614 regarding the lens 1616 (for lens shift OIS) or the image sensor 1618 (for sensor shift OIS) to perform closed-loop control. In all the lens examples, the EFL for the entire G1 group is labeled as EFL. G1 (or “EFL(G1)”), the EFLs in the entire G2 group are labeled as EFLs. G2 Multiple focal lengths of individual lens elements are marked with element numbers, that is, the refractive index of L1 is marked as f1, the focal length of L2 is marked as f2, etc.

[0188] An average glass thickness (“MGT”) of a lens group or an entire lens is defined by the average thickness of the plurality of individual lens elements it comprises. The average glass thickness of a group, such as G1, is designated as “MGT(G1)”, while the average glass thickness of an entire lens is designated as “MGT”.

[0189] An average air gap (“MAG”) of a lens group or an entire lens is defined by the average thickness of the plurality of air gaps along the optical axis between the plurality of individual lens elements within its lens groups G1 and G2. This means that the calculation of the average air gap only considers the distances within the lens group, and not the multiple distances between the plurality of lens groups. Specifically, BG, BG1, BG2, and BFL are not considered when calculating the MAG. The average air gap of a group, such as G1, is denoted as “MAG(G1)”, while the average air gap of an entire lens is denoted as “MAG”.

[0190] All the pop-up optical lens systems described below can be focused by moving an entire lens relative to the image sensor.

[0191] Table 22 summarizes the values ​​and ratios of various features included in the multiple lens systems shown above and below (TTL, c-TTL, EFL, f, BG, c-BG, BFL, c-BFL, TG1, TG2, T1, T3, MGT, MAG are given in millimeters, and H-FOV is given in degrees). For c-TTL, a minimum value is given. "PO method" refers to a method for switching between a pop-up state and a folded state of each lens system, where the number "I" indicates the i-th method embodiment (e.g., "1" indicates a switch according to a first method embodiment, "2" indicates a switch according to a second method embodiment, etc.).

[0192] Table 22

[0193] Table 22 (continued) Figure 17A This document shows an example of a pop-up optical lens system, numbered 1700, in a pop-up state. The lens system 1700 includes a pop-up lens 206-8 divided into two lens groups G1 and G2, an image sensor 208, and optionally an optical element (“window”) 802. Figure 17B The pop-up optical lens system 1700 is shown in a folded state.

[0194] Optical element 802 may be, for example, an infrared (IR) filter and / or a glass image sensor dust cover. Light passes through lenses 206-8 and forms an image on image sensor 208. Figure 17A The diagram shows three fields, each with three rays: an upper edge ray, a lower edge ray, and a leader ray. All subsequent diagrams also show these three rays.

[0195] Tables 23-26 provide detailed optical and surface data for the pop-up lens 206-8. Table 23 provides the surface type, Table 24 provides the aspherical coefficient, and Table 25 shows the BFL (“T”) of lens 206-8 in the pop-up state and the c-BFL of lens 206-8 in the folded state. Table 26 shows the lens element L. N-1 and L N The distances of the first, second, and third deflection points ("DP1", "DP2", and "DP3") from the optical axis.

[0196] These surface types are: a) Plane: A flat surface with no curvature. b) Q-type 1 (QT1) surface sagging formula:

[0197]

[0198]

[0199]

[0200]

[0201]

[0202]

[0203] Where {z, r} are standard cylindrical polar coordinates, c is the paraxial curvature of the surface, k is the conic parameter, and r norm Typically, it is half the net aperture (CA) of the surface, A n This refers to the aspherical coefficient shown in the lens datasheet. The Z-axis is positive when facing the image. The CA value is given as a net aperture radius, i.e., D / 2. The reference wavelength is 555.0 nm. Except for the refractive index (“index”) and Abbe number, all other units are in millimeters. Each lens element Li has its own focal length fi, and all lens elements in a group Gi have their own focal length fi together, both given in Table 23. The FOV is given as half FOV (HFOV). The definitions of surface type, Z-axis, CA value, reference wavelength, unit, focal length, and HFOV are valid for all the following tables.

[0204]

[0205] Table 23 Table 24 shows the aspheric coefficients.

[0206]

[0207] Table 24

[0208] Table 24 (continued)

[0209] Table 25

[0210] Table 26 Figure 18A Another embodiment of the pop-up optical lens system disclosed herein is shown, and is numbered 1800. Figure 18BThis displays a pop-up optical lens system 1800 in a folded state. The lens system 1800 includes a pop-up lens 206-9, divided into two lens groups G1 and G2, an image sensor 208, and optionally an optical element 802. Table 27 provides surface types, Table 28 provides aspherical coefficients, Table 29 displays the BFL and c-BFL, and Table 30 displays the distance of the deflection point from the optical axis.

[0211]

[0212] Table 27

[0213] Table 28

[0214] Table 28 (continued)

[0215] Table 29

[0216] Table 30 Figure 19A This illustrates yet another embodiment of a pop-up optical lens system, numbered 1900 and in a pop-up state, disclosed herein. Figure 19B The image shows a pop-up optical lens system 1900 in a folded state. The lens system 1900 includes a pop-up lens 206-10, which is divided into two lens groups G1 and G2, an image sensor 208, and optionally an optical element 802.

[0217] Table 31 provides the surface type, Table 32 provides the aspheric coefficient, and Table 33 shows the BG and BFL in the pop-up state and the c-BG and c-BFL in the folded state. Table 34 shows the distance of the deflection point from the optical axis.

[0218]

[0219] Table 31

[0220] Table 32

[0221] Table 32 (continued)

[0222] Table 33

[0223] Table 34 Figure 20A This illustrates yet another embodiment of a pop-up optical lens system, numbered 2000 and in a pop-up state, disclosed herein. Figure 20B The image shows a pop-up optical lens system 2000 in a folded state. The lens system 2000 includes a pop-up lens 206-11, which is divided into two lens groups G1 and G2, an image sensor 208, and optionally an optical element 802.

[0224] Table 35 provides the surface type, Table 36 provides the aspheric coefficient, and Table 37 shows the BG and BFL in the pop-up state and the c-BG and c-BFL in the folded state. Table 38 shows the distance of the deflection point from the optical axis.

[0225] The combined focal length of L3 and L4 is f 3+4 =-17.34.

[0226]

[0227] Table 35

[0228] Table 36

[0229] Table 36 (continued)

[0230] Table 37

[0231] Table 38 Figure 21A This illustrates yet another embodiment of a pop-up optical lens system, numbered 2100 and in a pop-up state, disclosed herein. Figure 21B The display shows a pop-up optical lens system 2100 in a folded state. The lens system 2100 includes a pop-up lens 206-12, which is divided into three lens groups G1, G2 and a field lens 808, an image sensor 208 and optionally an optical element 802.

[0232] Table 39 provides the surface types, Table 40 provides the aspheric coefficients, and Table 41 shows BG1 and BG2 in the pop-up state and c-BG1 and c-BG2 in the folded state. Table 42 shows the distance of the deflection point from the optical axis.

[0233]

[0234] Table 39

[0235] Table 40

[0236] Table 40 (continued)

[0237] Table 41

[0238] Table 42 While this disclosure describes certain embodiments and generally related methods, variations and combinations of embodiments and methods will be apparent to those skilled in the art. This disclosure should be understood not to be limited to the specific embodiments described herein, but only to the scope of the appended claims.

[0239] Unless otherwise stated, the use of the word "and / or" between the last two members of the list of options indicates that one or more options in the list are appropriate and can be selected.

[0240] It should be understood that when the claims or specification refer to an element as “a” or “an”, such a statement should not be interpreted as meaning that there is only one such element.

[0241] Furthermore, for clarity, the term "substantially" as used herein refers to the possibility of numerical variation within an acceptable range. By one example, the term "substantially" as used herein should be interpreted as meaning a possible variation exceeding or falling below any specified value by 5%. By another example, the term "substantially" as used herein should be interpreted as meaning a possible variation exceeding or falling below any specified value by 2.5%. By yet another example, the term "substantially" as used herein should be interpreted as meaning a possible variation exceeding or falling below any specified value by 1%.

[0242] All references mentioned in this specification are incorporated herein by reference in their entirety, to the same extent that each individual reference is specifically and individually identified and incorporated herein by reference. Furthermore, any reference or identification in this application should not be construed as an admission that such reference is prior art to this disclosure.

Claims

1. A handheld electronic device, characterized in that: include: A camera having a camera optical axis and including an image sensor and a lens, the lens having a lens axis parallel to the camera optical axis, the camera having an effective focal length (EFL) in the range of 6 mm to 16 mm. A motion sensor for sensing an undesired linear motion of the handheld electronic device; A depth estimator is used to estimate the distance between the camera and an object; as well as An actuator, operated to move the camera or a component of the camera to compensate for the undesired linear motion of the handheld electronic device, wherein the compensation depends on the undesired linear motion and the distance between the camera and the object, and the distance is less than 50 cm.

2. The handheld electronic device as described in claim 1, characterized in that: The distance is less than 40 centimeters.

3. The handheld electronic device as described in claim 1, characterized in that: The distance is less than 30 centimeters.

4. The handheld electronic device as described in claim 1, characterized in that: The distance is less than 20 centimeters.

5. The handheld electronic device as claimed in claim 1, characterized in that: The effective focal length (EFL) is ≥ 9 mm.

6. The handheld electronic device as claimed in claim 1, characterized in that: The handheld electronic device also includes an ultra-wide-angle camera with a field of view (FOV). UW It is greater than the field of view (FOV) of the camera.

7. The handheld electronic device as claimed in claim 1, characterized in that: The handheld electronic device also includes a wide-angle camera with a field of view (FOV). W It is greater than the field of view (FOV) of the camera.

8. The handheld electronic device as claimed in claim 1, characterized in that: The depth estimator uses phase detection autofocus to estimate the distance between the camera and the object.

9. The handheld electronic device as claimed in claim 1, characterized in that: The depth estimator uses time-of-flight imagery data to estimate the distance between the camera and the object.

10. The handheld electronic device as claimed in claim 1, characterized in that: The depth estimator uses the depth from the motion to estimate the distance between the camera and the object.

11. The handheld electronic device as claimed in claim 1, characterized in that: The depth estimator uses the depth from the defocus to estimate the distance between the camera and the object.

12. The handheld electronic device as claimed in claim 6, characterized in that: The depth estimator uses stereo image data selected from a group consisting of image data from a wide-angle camera and the camera, image data from an ultra-wide-angle camera and the camera, and image data from the wide-angle camera and the ultra-wide-angle camera to estimate the distance between the camera and the object.

13. The handheld electronic device as claimed in claim 7, characterized in that: The depth estimator uses stereo image data selected from a group consisting of image data from the wide-angle camera and the camera, image data from an ultra-wide-angle camera and the camera, and image data from the wide-angle camera and the ultra-wide-angle camera to estimate the distance between the camera and the object.

14. The handheld electronic device as claimed in claim 1, characterized in that: The compensation for the undesired linear motion of the handheld electronic device is in one direction.

15. The handheld electronic device as claimed in claim 1, characterized in that: The compensation for the undesired linear motion of the handheld electronic device is in two or more directions.

16. The handheld electronic device as claimed in claim 1, characterized in that: The component is the lens.

17. The handheld electronic device as claimed in claim 16, characterized in that: One lens movement d Lens by The calculation is performed, where d0 is the undesired linear motion of the handheld electronic device, EFL is the effective focal length, and u is an object-lens distance.

18. The handheld electronic device as claimed in claim 1, characterized in that: The component is the image sensor.

19. The handheld electronic device as claimed in claim 18, characterized in that: An image sensor movement d Sensor by The calculation is performed, where d0 is the undesired linear motion of the handheld electronic device, and u is an object-lens distance.

20. The handheld electronic device as claimed in claim 1, characterized in that: The motion sensor includes an inertial measurement unit.

21. The handheld electronic device according to any one of claims 1 to 20, characterized in that: The camera in question is a telephoto camera.

22. The handheld electronic device according to any one of claims 1 to 20, characterized in that: The camera is a pop-up camera.

23. The handheld electronic device according to any one of claims 1 to 20, characterized in that: The camera is a folding camera, including an optical path folding element.

24. The handheld electronic device according to any one of claims 1 to 20, characterized in that: The camera is a double-folding camera, comprising two optical path folding elements.

25. The handheld electronic device according to any one of claims 1 to 20, characterized in that: The handheld electronic device is a smartphone.

Images