Imaging system with discrete diaphragms

Abstract

An imaging system can include an image sensor. The imaging system can include a strip having a diaphragm, wherein a portion of the strip is positioned along an optical path that directs light to the image sensor. The imaging system can include a diaphragm shifter configured to move the strip relative to the optical path, thereby allowing light propagating along the optical path to pass through one of the diaphragms of the strip and to be incident on the image sensor. The imaging system can include a controller configured to control the image sensor and the diaphragm shifter.

Description

[0001] Cross-references to related applications

[0002] This application claims priority and benefit to U.S. Provisional Application No. 63 / 531,055, filed August 7, 2023, entitled “Mechanical Improvements for Camera Module,” the subject matter of which is incorporated herein by reference in its entirety. Technical Field

[0003] This disclosure relates in its entirety to the field of imaging systems, and more particularly to imaging systems with variable apertures. Background Technology

[0004] Many cameras include an iris aperture to control the size of the camera stop. An iris aperture typically consists of a series of overlapping blades that can be adjusted to change the size of the central aperture. Adjusting these blades narrows or widens the aperture, allowing control over light intensity and focus. However, by forming the camera stop with these overlapping blades, the resulting aperture shape includes angles that can cause diffraction spikes and affect the shape of bokeh in the image. Therefore, an iris aperture cannot form an aperture with a smooth shape (e.g., circular or elliptical), especially within a range of aperture size settings. Additionally, an iris aperture is relatively large and requires space around the entire optical axis. Therefore, an iris aperture is insufficient for space-constrained cameras or cameras that do not include equal space around the optical axis. Attached Figure Description

[0005] The disclosed embodiments have advantages and features that will become more apparent from the detailed description, the appended claims, and the accompanying drawings (or illustrations). A brief description of the drawings is given below.

[0006] Figure 1A and Figure 1B An imaging system housed in a mobile device according to one or more embodiments is illustrated.

[0007] Figures 2A to 2C An imaging system for capturing images of different portions of a view of the external environment according to one or more embodiments is illustrated.

[0008] Figure 2D An image illustrating a portion of a view according to one or more implementation schemes is shown.

[0009] Figure 2E Examples are given based on one or more implementation schemes by Figure 2D The image in the image forms a view of the external environment.

[0010] Figure 3A It is a diagram of the aperture strip according to one or more implementation schemes.

[0011] Figure 3B It is a block diagram of an imaging system with an aperture system according to one or more embodiments.

[0012] Figures 4A to 4C It is a diagram of another imaging system with an aperture system according to one or more embodiments.

[0013] Figure 5 This is a diagram of an aperture strip coupled to a linear actuator according to one or more implementation schemes.

[0014] Figure 6 This is a diagram of an aperture strip coupled to a gear according to one or more implementation schemes.

[0015] Figure 7 This is a flowchart of an example method 700 for capturing an image using different apertures, according to one or more implementation schemes.

[0016] Figures 8A to 8E It is a diagram of another imaging system with an aperture system according to one or more embodiments.

[0017] Figure 9 This is a block diagram illustrating components of an example machine, according to an embodiment, capable of reading instructions from a machine-readable medium and executing those instructions in a processor (or controller). Detailed Implementation

[0018] The accompanying drawings and the following description relate to preferred embodiments only by way of illustration. It should be noted that, based on the following discussion, alternative embodiments of the structures and methods disclosed herein will readily be considered as feasible alternative embodiments that can be employed without departing from the claimed principles.

[0019] Reference will now be made in detail to several embodiments, examples of which are illustrated in the accompanying drawings. It should be noted that similar or identical reference numerals may be used in the drawings where feasible, and may indicate similar or identical functions. The drawings depict embodiments of the disclosed system (or method) for illustrative purposes only. Those skilled in the art will readily recognize from the following description that alternative embodiments of the structures and methods illustrated herein may be employed without departing from the principles described herein.

[0020] Introduction

[0021] An imaging system may include an aperture system with multiple discrete apertures that can be switched during operation of the imaging system. Each aperture in the system may be different from one another to provide the imaging system with a wide variety of apertures that can be quickly switched for different image capture applications or scenarios.

[0022] refer to Figures 3A to 8ELet's further describe the aperture system. But first, Figures 1A to 2E The description illustrates an example imaging system with a reflector. The aperture system described herein can be used in a wide variety of different imaging systems (such as reference optics). Figures 1A to 2E This is implemented in the described imaging system. For example, the aperture strips (e.g., 315, 415) of the aperture system can be placed between: (a) a reflector (e.g., 105) and a housing window (e.g., 102), or (b) a reflector (e.g., 105) and a lens module (e.g., 107). The length of the aperture strip can be along the y-axis (e.g., see [reference]). Figure 1B ).

[0023] Example imaging system

[0024] Figures 1A to 1B (Collectively referred to as "Figure 1") illustrates an example imaging system 101 housed in an example mobile device 103 according to an embodiment. Specifically, Figure 1A The front view, rear view, and side view of the mobile device 103 are illustrated, and Figure 1B A rear cross-sectional view and a side cross-sectional view of the mobile device 103 are illustrated. The mobile device 103 includes an imaging system 101, a housing 117 with a window 102, and a display 119. The imaging system 101 includes a rotatable reflector 105, a motor 111, a motor 112, a lens module 107 (also referred to as a lens design), an image sensor 109, and a controller module 113.

[0025] Reflector 105 directs light passing through window 102 downward toward lens module 107. Lens module 107 focuses the light onto image sensor 109. Motor 111 rotates reflector 105 about axis 115, which is substantially parallel to the plane of image sensor (e.g., within three degrees). Rotating reflector 105 allows it to direct light from different parts of the external environment toward image sensor 109. Controller 113 is electrically coupled to image sensor 109 and motor 111. To form an image of the external environment, imaging system 101 captures images of portions of the view of the external environment as reflector 105 rotates. The rotation of reflector 105 from an initial angular position to a final angular position can be referred to as a scan. The sequence of captured images contains information about several adjacent parts of the environment, and after combining (e.g., stitching or fusion) the images together, imaging system 101 forms a larger image of the external environment with a predetermined aspect ratio.

[0026] The housing 117 houses one or more components of the imaging system 101. The positions and orientations of the imaging system components can be described relative to the housing 117 and the housing window 102. For example, the housing 117 is defined by a plurality of walls housing the imaging system 101, and one of the walls includes the housing window 102, which has a plane defined, for example, by the boundary of the window 102. This plane may be parallel to the yz (or yyz) plane in a three-dimensional reference frame. The housing 117 may have a low profile along an axis perpendicular to the plane of the window 102 (e.g., along the x-axis). The length of the housing along the x-axis may be referred to as the thickness of the housing 117 and may range, for example, from 5 mm to 15 mm. In embodiments where the housing 117 is part of a mobile device 103, the window plane may be parallel to the display 119 of the mobile device 103. Unlike conventional imaging systems, the image sensor surface does not face the window plane. For example, the image sensor surface is perpendicular to the window plane (e.g., parallel to the xy plane) and outside the boundary of the window 102. Therefore, reflector 105 can be aligned with window 102 to guide light propagating through window 102 to the image sensor plane. Lens module 107 can be located between reflector 105 and image sensor 109. Aperture plane can be located between reflector 105 and lens module 107, and can be perpendicular to the window plane and parallel to the image sensor plane. The reflector allows the optical path of imaging system 101 to fold into the yz plane. This folding allows the optical path to increase beyond the housing thickness and into the housing width (e.g., length along the y-axis) and height (e.g., length along the z-axis), which are typically greater than their thickness. Therefore, the aperture of reflector, image sensor, and / or lens module 107 can have an aspect ratio that is not 1:1, and their major axes can be parallel to each other.

[0027] As used in this article, the terms “parallel” and “perpendicular” can refer to parts that are substantially parallel or substantially perpendicular (e.g., within three degrees), because it may be practically difficult to manufacture parts that are perfectly parallel or perpendicular.

[0028] Image sensor 109 is an imaging device that captures an image of a portion of the external environment. Examples of image sensors 109 include CCD sensors and CMOS sensors. As illustrated in Figure 1, the image sensor surface may be located in the xy-plane relative to the xy-plane of the moving device 103, and the image sensor surface faces a direction perpendicular to the xy-plane surface (along the z-axis). Due to this positioning, the sensor plane of image sensor 109 does not face the view of the external environment. By placing image sensor 109 in the xy-plane, the size of image sensor 109 can be larger than that of image sensors in conventional cameras. The smaller dimension of the image sensor plane (along the x-axis) may be limited by the thickness of the moving device, while the larger dimension (along the y-axis) may be limited by the width of the moving device, which may be many centimeters longer. This allows image sensor 109 to have a high aspect ratio, such as a ratio greater than 17:9 (e.g., 1:10). Conventional cameras produce scene images with a less high aspect ratio. Due to the high aspect ratio of image sensor 109, image sensor 109 can create narrow images (“image stripes”) corresponding to a narrow view of the scene. For conventional imaging systems in mobile devices, the size of the image sensor can be limited by the focal length of the camera lens. However, by changing the position and orientation of the image sensor 109 as described herein, the image sensor size can be larger than that of the image sensor in a conventional imaging system with the same or similar housing.

[0029] As described above, reflector 105 (also called a scanning mirror) is an optical component that rotates about axis 115 to guide light to image sensor 109. Typically, axis 115 is substantially parallel to the long dimension of the image sensor plane, and reflector 105 is centered on window 102. If the plane of window 102 (e.g., the yz plane) is perpendicular to the plane of image sensor 109 (e.g., the xy plane), reflector 105 can guide light at approximately a 45-degree angle relative to the image sensor plane to direct light toward image sensor 109. Due to the high aspect ratio of image sensor 109, reflector 105 can also have a high aspect ratio to ensure that light is reflected across the entire surface of image sensor 109. Reflector 105 in Figure 1B The example shown is a rectangular plane; however, other shapes are possible, such as concave or convex (e.g., which can be used to expand or shrink the field of view).

[0030] This document describes reflector 105 in terms of “guiding” light, however, this is for ease of description. Reflector 105 can optically guide, broaden, narrow, reflect, diffract, refract, disperse, magnify, reduce, combine, separate, polarize, or otherwise alter the properties of light as it propagates in imaging system 101. For this purpose, reflector 105 may include reflective coatings, metallized features, optical gratings, mirrors, prism structures, Fresnel structures, corner reflectors, retroreflectors, etc., on one or more of its surfaces.

[0031] Lens module 107 includes one or more optical components and is designed to form an image on image sensor 109. Lens module 107 can diffuse, focus, redirect, and otherwise modify the light passing through it. Lens module 107 can be as simple as a single lens, or it can include additional optical components such as diffusers, phase screens, beam expanders, mirrors, and lenses (e.g., anamorphic lenses). In some embodiments, the entrance pupil of lens module 107 is adjacent to reflector 105. This allows reflector 105 to have a smaller size. In some embodiments, lens module 107 includes an asymmetric aperture with a large axis and a small axis (the stretched axis can be used in devices with size constraints such as smartphones, and in these cases, the aperture can be much larger if it is not symmetrical).

[0032] Due to the high aspect ratio of the image sensor 109, the lens module 107 can be designed and manufactured as non-circular or asymmetrical, and conforms to the dimensions of the image sensor 109 in terms of its aperture. Using a lens module 107 with an asymmetrical aperture allows it to fit within the mobile device housing 117. Furthermore, the focal length of the lens module 107 can differ in the x and y directions. In some embodiments, this causes the imaging system 101 to not maintain an aspect ratio, so, for example, a 4:3 scene can be imaged by an 8:3 image sensor. One or more optical components of the lens module 107 may have cylindrically symmetrical surfaces, but the apertures of other components may be rectangular or another elongated shape. The lens module 107 can be manufactured using wafer-level technology, which can facilitate the production of rectangular optical components by dicing the lens surface to the desired aspect ratio. In some embodiments, the lens module 107 is manufactured using injection molding technology by creating a mold with an asymmetrical aperture. The components of the lens module 107 can be glass or plastic injection molded or machined (e.g., via wafer-level technology).

[0033] Motor 112 is controlled by controller 113 and configured to move one or more optical components of lens module 107 or lens module 107. For example, motor 112 moves one or more optical lenses along the optical axis to focus light onto the sensing plane of image sensor 109. The imaging system may include multiple motors 112, for example, if multiple optical components are to move individually or by different amounts. Motor 112 may include one or more actuator-type mechanisms, one or more galvanometer-type mechanisms, one or more MEMS-type mechanisms, one or more motor-type mechanisms, one or more stepper motor-type mechanisms, or some combination thereof. Motor 112 may also be referred to as a lens shifting mechanism.

[0034] As described above, motor 111 causes reflector 105 to rotate about axis 115. For this purpose, motor 111 may include one or more actuator-type mechanisms, one or more galvanometer-type mechanisms, one or more MEMS-type mechanisms, one or more motor-type mechanisms, one or more stepper motor-type mechanisms, or some combination thereof. In some embodiments, motor 111 may move reflector 105 in other directions. For example, motor 111 may translate and / or rotate reflector 105 along the x-axis, y-axis, z-axis, or some combination thereof.

[0035] In some embodiments, while image sensor 109 is capturing an image of a portion of a scene, motor 111 tilts reflector 105 (e.g., tilts it a few degrees in either direction) to compensate for motion (e.g., hand movement). For example, if a user tilts moving device 103 slightly downward, the motor can tilt reflector 105 upward to compensate for that motion, so that image sensor 109 still receives the same portion of the scene despite the tilt. In some embodiments, imaging system 101 includes a sensor shifting mechanism (e.g., another motor) to shift image sensor 109 in one or more directions (e.g., in the xy plane) to compensate for the motion. In some embodiments, imaging system 101 includes motor 112 to shift lens module 107 (or a component thereof) in one or more directions (e.g., in the xy plane) to compensate for the motion. If imaging system 101 includes multiple motion compensation mechanisms, controller 113 can coordinate these multiple mechanisms to work together to counteract motion. For example, motor 111 tilts reflector 105 to compensate for movement in one direction, and sensor shifting mechanism or lens shifting mechanism (e.g., 112) compensates for movement in another direction. In some embodiments, reflector 105 rotates about multiple substantially perpendicular axes (e.g., x-axis and z-axis) to compensate for movement (e.g., instead of sensor shifting mechanism or lens shifting mechanism).

[0036] Motor 111 and shifting mechanism (e.g., 112) can also function as autofocus mechanism. For example, a lens shifting mechanism moves lens module 107 (or a component thereof) closer to or further away from image sensor 109 (e.g., along the z-axis) to achieve a desired focus. In another example, a sensor shifting mechanism moves image sensor 109 closer to or further away from lens module 107 (e.g., along the z-axis) to achieve a desired focus.

[0037] The controller module 113 may be configured as software (e.g., program code embodied in a machine-readable medium and executable by a processing system to cause the processing system to operate in a particular manner) and / or hardware to provide control signals (also referred to as adjustment signals) to the motor 111, motor 112, image sensor 109, or some combination thereof. Thus, the controller 113 may: (1) rotate the reflector 105 via the motor 111 to direct light from different parts of the external environment toward the image sensor 109; (2) focus light onto the image sensor 109 by adjusting the optical components of the lens module 107 via the motor 112; (3) synchronize the image sensor 109 with the reflector 105 to capture images of different parts of the environment; or (4) some combination thereof. Additionally, the controller 113 may receive the captured images and combine them to form a larger, continuous image of the external environment.

[0038] In some implementations, the imaging system 101 includes one or more motion sensors (e.g., accelerometers, gyroscopes, etc.) to track the motion of the imaging system relative to the external environment. The controller module 113 can receive motion data from the motion sensors. If the determined motion exceeds a threshold amount, the module 113 can provide instructions to the motor 111 and / or the sensor shifting mechanism to compensate for the motion.

[0039] In some embodiments, the imaging system 101 is not included in the mobile device 103. For example, the imaging system 101 is included in a separate device, such as a protective case for the mobile phone 103.

[0040] Figures 2A to 2C An imaging system 101 is illustrated according to an embodiment, which captures images of different portions of a view of the external environment. Figures 2A to 2C In the example, the external environment includes one or more objects within the field of view. For ease of discussion, in this example, the objects are a vertically aligned cube 211A, a sphere 211B, and a pyramid 211C. Figure 2A In the first rotational position, the reflector 105 is tilted (e.g., it forms an angle relative to the yz plane). θ1 This directs light from the top portion of the external environment toward the image sensor 109. Therefore, the image sensor 109 captures an image of the cube 211A. Figure 2BIn this configuration, the reflector is tilted at the second rotational position (e.g., forming an angle θ2 > θ1 relative to the yz plane) to direct light from the middle portion of the external environment toward the image sensor 109. Therefore, the image sensor 109 captures an image of the sphere 211B. Figure 2C In this configuration, the reflector is tilted at a third rotational position (e.g., forming an angle θ3 > θ2 relative to the yz plane) to direct light from the bottom portion of the external environment toward the image sensor 109. Thus, the image sensor 109 captures an image of the pyramid 211C. In some example embodiments, to capture a set of images, the reflector angle θ can vary symmetrically around a 45-degree position relative to the xy plane (e.g., from 25 degrees to 65 degrees).

[0041] Figure 2D Three image strips captured by image sensor 109 according to an embodiment are illustrated. Since each image strip is captured when reflector 105 is in different rotational positions, each image strip is an image of a different part of the external environment. The image strips have a high aspect ratio due to the high aspect ratio of reflector 105, lens module 107, and image sensor 109. Image strip A is an image of cube 211A, and is... Figure 2A The image system 101 captures the image. Image strip B is an image of sphere 211B, and is captured by... Figure 2B The image system 101 in the image is captured. Image strip C is an image of pyramid 211C, and is captured by... Figure 2C The image system 101 in the middle captures the image.

[0042] The exposure time for capturing each image strip may be limited by user movement (unintentional movement of the device while holding device 103) and object movement in the scene. Additionally, the total exposure time for the image strips may be limited by possible changes in the external environment between captured image strips. The image strip exposure time and the total exposure time may be limited to a predetermined threshold time or dynamically determined (e.g., based on the amount of movement of the mobile device 103).

[0043] Figure 2E Image 201 illustrates a view of the external environment according to an implementation scheme. Image 201 is created by combining (e.g., merging or stitching). Figure 2D The image strips A to C illustrated in the figure are used to form the composite image 201. The composite image 201 may be referred to as a synthetic image. The horizontal field of view of the composite image 201 may be based on the width (along the y-axis) of the window 102, reflector 105, lens module 107 (e.g., its aperture), and / or image sensor 109, and the vertical field of view of the composite image 201 may be based on the scanning range of reflector 105. Typically, the vertical field of view is larger than the horizontal field of view.

[0044] Depending on the position of reflector 105 when capturing image strips, the image strips may have some overlap with each other (e.g., 10 to 300 rows of pixels). Capturing overlapping image strips helps ensure that the image strips do not lose portions of the ambient view (e.g., capturing the entire view) and can reduce the noise value of the combined image 201. Capturing overlapping image strips can also aid the combination process to ensure that the image strips are correctly combined. For example, controller 113 uses the overlapping portion to align the image strips during the combination process. In another example, if an object in the environment moves between the captures of the image strips, or if the moving device 103 moves between the captures of the image strips, control system 101 can use the overlapping portion to correct for artifacts caused by that movement.

[0045] Rotating reflector

[0046] The rotation of reflector 105 can be discrete, such that it rotates from an initial (e.g., maximum) angular position to a final (e.g., minimum) angular position, with N stopping positions in between, where N is the number of image strips that will form the combined image. N can be as small as two. N can depend on the expected exposure time of the combined image and / or the size of the smaller dimension of image sensor 109 and the expected size or aspect ratio of the combined image. For example, if the image sensor has 24,000 pixels by 6,000 pixels, and if the final combined image has a 4:3 aspect ratio, reflector 105 will have three discrete positions, and the combined image will be 24,000 pixels by 18,000 pixels. The previous scanning example does not include any overlap in the image strips. If N increases, some areas in the scene will appear more than once in the image strips. For example, if the scan is completed using six discrete angular positions, each point in the scene will appear in two image strips.

[0047] Imaging system 101 may be able to capture video. In these cases, the combined images can form video frames. If the video frame rate or preview frame rate is, for example, 25 FPS (frames per second), the total exposure time for each combined image is 40 milliseconds or less. In the case of scanning at three discrete locations, each location may be exposed for 13.33 milliseconds. However, reflector 105 needs time to change its position and stop, meaning that for each image strip, the exposure time could be approximately 10 milliseconds.

[0048] For still image capture, when the user presses the capture button, the image preview displayed to the user can be interrupted, and a longer exposure than the exposure limited by the image preview speed can be allowed.

[0049] The above considerations are considered as a complete field of view. If the imaging system 101 captures a narrower field of view, it can reduce the scanning range of the reflector 105. For example, if the user zooms in three times (i.e., 3x zoom), the imaging system 101 may not perform any scanning. Therefore, the reflector 105 may be stationary. For example, if the image sensor 109 has 24,000 pixels by 6,000 pixels, and the final image has a height of 6,000 pixels and an aspect ratio of 4:3, the reflector 105 may not rotate, and another dimension of the image may be 8,000 pixels (e.g., read out and cropped from the 24,000-pixel dimension of the image sensor 109).

[0050] In some implementations, the rotation of reflector 105 is continuous rather than discrete. In continuous scan mode, reflector 105 rotates continuously at a speed slow enough to ensure the captured image is not blurred, but fast enough to complete scanning the desired field of view at a desired frame rate (e.g., 40 milliseconds). In continuous mode, the rotation rate of reflector 105 can be determined by the desired frame rate. For example, if the frame rate is 30 FPS (33 milliseconds between frames), a scene scan takes approximately 25 milliseconds, after which reflector 105 rotates back to its initial position. Other example values, such as 30 milliseconds, are possible depending on how quickly the reflector can rotate back to its initial position. In implementations where reflector 105 is double-sided, reflector 105 may not need to rotate back to its initial position.

[0051] In continuous scan mode, points in the external environment may appear on each row of pixels during the scan. Image sensor 109 can capture enough images such that for a continuous strip of images, each point is captured by each row of pixels. For example, if image sensor 109 includes 6000 rows of pixels, 6000 images can be captured during a single scan. To do this, for example, the image sensor can integrate charge from changing pixels instead of integrating charge on a single pixel for several milliseconds. If this change (scan) is synchronized with the rotation speed of the reflector, the output can correspond to a point in space. An example implementation of this using image sensor 109 is to read out only one row of pixels, which can be done very quickly. Thus, for example, a sensor operating at 30 FPS (frames per second) and having 6000 rows can perform 15000 FPS with only one row read out. As an alternative to capturing enough images such that points are captured by each row of pixels, image sensor 109 can capture a predetermined number of images less than the number of rows of pixels during the scan.

[0052] Example aperture system

[0053] As previously explained, an imaging system may include an aperture system with multiple discrete apertures that can be switched during operation of the imaging system. Each aperture in the aperture system may be different from one another to provide the imaging system with a wide variety of apertures that can be quickly switched for different image capture applications or scenarios. Furthermore, the aperture system described herein may be advantageous for imaging systems where space is limited at or around the aperture location. For example, the thickness of the aperture strip along the optical path (described further below) may be thinner than the thickness of the iris aperture at the same location. Similarly, the iris aperture requires space around the entire optical path axis at the location of the aperture. In contrast, components of the aperture system described herein can be positioned remotely from the aperture (except for the aperture strip). See, for example... Figures 4A to 4C and Figures 8A to 8E Furthermore, the aperture stop of the iris aperture includes corners that may produce diffraction spikes and affect the shape of the bokeh in the image. In contrast, the aperture stop system described herein may include aperture stops with smooth shapes (e.g., circular and elliptical) for a range of aperture stop sizes.

[0054] Figure 3A This is a diagram illustrating an example aperture layout (e.g., aperture strip 315) according to one or more embodiments. Strip 315 includes seven discrete apertures 317 along the length of the strip. Strip 315 can be moved (e.g., horizontally translated) to align one of the apertures with the optical path of the imaging system. The aperture strip (e.g., 315) is generally planar in shape. Furthermore, although the shape of strip 315 (in...) Figure 3A In a 2D plane, the aperture strip is rectangular, and the term "strip" refers to a rectangular shape (in a 2D plane), but this is not mandatory. The aperture strip can have other shapes (in a 2D plane), such as squares or circles. The aperture strip (for example, for wavelengths detectable by an image sensor of the corresponding imaging system) can be opaque. The aperture strip (e.g., 315) can be made of a flexible material (e.g., configured to be wound around a spool), or it can be made of a robust or rigid material configured to maintain its shape even when moved. To achieve both opacity and flexibility, the aperture strip can be made of materials such as polyester, silicone film, polyamide, metallized polymer film, BoPet, or combinations thereof.

[0055] exist Figure 3AIn the example, the first aperture (the first aperture on the left) has a large elliptical shape, with its major axis parallel to the length strip. The second aperture (from the left) has a smaller elliptical shape, with its major axis parallel to the length of the strip. The third aperture (from the left) has a large elliptical shape, with its major axis perpendicular to the length of the strip. The fourth aperture (from the left) has a smaller elliptical shape, with its major axis perpendicular to the length of the strip. The fifth aperture (from the left) has a large circular shape, the sixth aperture (from the left) has a medium circular shape, and the fifth aperture (from the left) has a smaller circular shape. Other aperture strips may include different, additional, or fewer apertures.

[0056] The aperture of an aperture strip (e.g., 315) may include filters (or multiple filters). For example, the aperture of an aperture strip may include a vertical polarizer, a horizontal polarizer, a circular polarizer, an apodization filter, a neutral density filter, a linear gradient filter, a radial gradient filter, or some combination thereof. The filter may filter out or allow any combination of the following: visible wavelengths or invisible wavelengths.

[0057] As indicated by the elliptical aperture of strip 315, the aperture strip may include an asymmetric aperture comprising a major axis and a minor axis. This may be useful for imaging systems with asymmetric lenses or image sensors with a high aspect ratio.

[0058] Figure 3B This is a top view block diagram of an example imaging system 301 including an aperture strip 315 according to one or more embodiments. The imaging system further includes a lens module 307, an image sensor 305, an aperture shifter 313, and a controller 391. The controller 391 is coupled to the aperture shifter 313 and the image sensor 305. The lens module 307 is configured between the image sensor 305 and the aperture strip 315. The aperture shifter 313, the controller 391, and the strip 315 may be collectively referred to as the aperture system. The imaging system 301 may include different, additional, or fewer components than those illustrated.

[0059] Image sensor 305 is an imaging device that captures images of the external environment. Image sensor 305 may be, for example, a charge-coupled device (CCD) sensor or a complementary metal-oxide-semiconductor (CMOS) sensor.

[0060] Lens module 307 includes one or more optical components and is designed to form an image on image sensor 305. Lens module 307 can diffuse, focus, redirect, and otherwise modify light passing through it. Lens module 307 may be a single lens, or it may include additional optical components such as diffusers, phase screens, beam expanders, mirrors, and lenses (e.g., anamorphic lenses). Lens module 307 may be designed and manufactured to be non-circular or asymmetrical. The focal length of lens module 307 may be different along two dimensions perpendicular to the optical axis. Lens module 307 may be manufactured using wafer-level technology. In some embodiments, lens module 307 is manufactured using injection molding technology by creating a mold with an asymmetrical aperture. Components of lens module 307 may be glass or plastic injection molded or machined (e.g., via wafer-level technology).

[0061] In the imaging system, optical path 323 exemplifies (when the aperture stop is aligned with optical path 323) the propagation of light through the aperture stop strip 315, through the lens module 307, and to the image sensor 305. However, other optical path arrangements are also possible. For example, the aperture stop strip 315 may be placed between the lenses of the lens module 307 or between the lens module 307 and the image sensor 305.

[0062] The aperture shifter 313 is controlled by a signal transmitted from the controller 391. The aperture shifter 313 includes components for holding the aperture strip 315 in place and moving the aperture strip 315 to align one of the apertures with the optical path 323. To hold the aperture strip 315 in place, the aperture shifter 313 may (depending on the structure and material of the strip 315) include any combination of the following: one or more sliders, one or more tracks (or guides), one or more trays, one or more clamps, one or more wheels, one or more spools, and one or more rollers, as well as other possible components. To move the strip 315, the aperture shifter 313 (among other possible components) may (depending on the structure and material of the strip 315) include one or more actuators (e.g., piezoelectric actuators), one or more galvanometers, one or more MEMS mechanisms, one or more motors (e.g., linear or rotary motors), or some combination thereof. Regarding... Figures 4A to 6 The following description includes an additional description of the aperture shifter.

[0063] exist Figure 3BIn the example, the aperture shifter 313 can move the strip 315 horizontally (i.e., along the y-axis, as indicated by the dashed horizontal arrow). However, depending on the position and alignment of the aperture on the strip 315 relative to the optical path 323 or the lens module 307, the aperture shifter 313 can be configured to translate or rotate the strip 315 along any combination of the x, y, and z axes. Figure 3B In the example, the aperture shifter 313 is located only on the left side of the strip 315; however, the aperture shifter 313 (or a component of the aperture shifter 313) may be located on other sides of the strip 315 or on multiple sides of the strip 315 (e.g., on the left and right sides).

[0064] The controller 391 (also referred to as the “controller module”) may be configured as software (e.g., program code embodied in a machine-readable medium and executable by a processing system to cause the processing system to operate in a particular manner) and / or hardware to provide control signals (also referred to as adjustment signals) to the aperture shifter 313, the image sensor 305, or some combination thereof. Thus, the controller 391 may: (1) move the strip 315 relative to the optical path 323 (by controlling the aperture shifter 313) such that the aperture 317 of the strip 315 is aligned with the optical path 323, (2) capture an image through the image sensor 305 (by controlling the image sensor 305), or some combination thereof.

[0065] In some implementations, the controller can (1) move the strip so that the aperture is not precisely aligned with the optical path, but rather allows light to pass through the lens module to the image sensor, and (2) capture an image through the image sensor. This process can be repeated two or more times with different aperture positions, so that the image sensor captures data that can be used to analyze scene information (e.g., object distance from the imaging system). Alternatively, the aperture position for the first image can be optically aligned, while the position for the second image can be not (and vice versa). To collect additional data, two images can be captured using the aperture in two different positions regardless of whether the optical axis is aligned, or two different apertures that may or may not be aligned with the optical axis can be used to capture two images.

[0066] Controller 391 can determine which aperture stop is aligned with optical path 323. For example, controller 391 receives a signal from a user of imaging system 301 based on (e.g., specifying aperture stop settings) an input, which is used to generate a signal transmitted to aperture shifter 313. Aperture shifter 313, upon receiving the signal, moves the aperture strip to align the desired aperture stop with optical path 323. Additionally or alternatively, controller 391 can determine the aperture stop based on signals from one or more sensors of imaging system 301. For example, if a signal from image sensor 305 indicates low ambient light, controller 391 can determine that a larger size and / or shape of aperture stop is appropriate. Subsequently, controller 391 generates a signal that is transmitted to aperture shifter 313. Aperture shifter 313, upon receiving the signal, shifts the aperture strip to align the determined aperture stop with optical path 323.

[0067] Controller 391 may be able to perform additional functions. In addition, controller 391 may be part of other controllers (e.g., if imaging system 101 includes an aperture system, controller 391 may be part of controller 113).

[0068] Figure 4A This is a perspective view of an example imaging system 401 having an aperture system 403 capable of changing the aperture according to one or more embodiments. Figure 4B It is based on one or more implementation schemes. Figure 4B A top-view cross-sectional view of an example imaging system. Figure 4A and Figure 4B They are described together. In addition to the aperture system 403, the imaging system 401 also includes a lens module 407 and an image sensor 405 mounted in the housing 409. The imaging system 401 is an example embodiment of the imaging system 301. The imaging system 401 may include additional or fewer components that are different from those illustrated. For example, the aperture system 403 additionally includes a motor that rotates the reel and a controller (e.g., 391) that controls the reel motor.

[0069] The aperture system 403 includes an aperture strip 415, a reel 411, a reel 413, a support roller 419, and a support roller 412. Similar to the aperture strip 315, the aperture strip 415 includes an assembly of discrete apertures 417 along the length of the strip (in... Figure 4A and Figure 4BThe example illustrates only two apertures. Reels 411 and 413 hold the aperture strip 415 in place and store portions of the aperture strip 415. In other words, a first portion of the aperture strip 415 is wound around reel 413, and a second portion of the aperture strip 415 is wound around reel 411. The aperture system 403 can be kept taut by the torque generated by reels 411 and 413, thereby enabling the rapid cyclic switching of different discrete apertures. As illustrated, reel 413 is located on the left side of optical path 423, and reel 411 is located on the right side of optical path 423.

[0070] Rollers 419 and 421 support the aperture strip 415, keeping it flat and aligned in front of the lens module 407. Rollers 419 and 421 can rotate when the strip 415 is moved.

[0071] The aperture strip can be moved (e.g., rapidly) relative to the optical path 423 to change the aperture of the imaging system 401. For this purpose, reels 413, 415 can be rotated (e.g., by one or more motors controlled by a controller (not shown)) to slide between the apertures in strip 415. For example, both reels rotate clockwise, causing strip 415 to move to the left. Thus, a first portion of strip 415 can be further wound around one of the reels (e.g., 413), while a second portion of the strip unwound around the other reel (e.g., 415) to expose another portion of the strip, causing the other aperture to become aligned with the optical path 423 (thus allowing light to propagate to lens module 407 and image sensor 405). For example, Figure 4C Possible directions of movement 425 for the reels 411, 413 and the strip 415 are illustrated. Figure 4C This is another perspective view of imaging system 401. Figure 4C Also illustrated is strip 415 (due to the reel relative to...) Figure 4A Different apertures (rotation).

[0072] Figures 4A to 4C An example aperture shifter is illustrated, which allows the aperture strip to be moved relative to the optical path (e.g., in a plane) of the imaging system. Specifically, Figures 4A to 4C The aperture shifter includes spools 411, 413 and rollers 419, 421, and one or more motors (not shown) configured to rotate the spools (individually or jointly). Spools 411 and 413 are individually or jointly coupled to a motor. The motor may be controlled by a controller. Other example aperture shifters may additionally or alternatively move the aperture strip. Figures 5 to 6 An example aperture shifter is shown that allows the aperture strip to be moved. Figure 5 This is a diagram of an aperture strip 515 and a linear actuator motor 503 coupled to the strip 515, according to one or more embodiments. Figure 6 This is a diagram of a toothed aperture strip 615 and a gear 603 (having teeth that mesh with the teeth of the strip 615) according to one or more embodiments. Although Figures 5 to 6 An example of an aperture shifter located on the left side of the strip is shown, but the aperture shifter may be located on the other side (e.g., the right side) or multiple sides of the strip.

[0073] Figures 8A to 8E This is a diagram of another imaging system 801 with an aperture system according to one or more embodiments. Figure 8A This is a perspective view of the imaging system 801. Figure 8B This is an exploded view of the imaging system 801. Figures 8C to 8D It is a cross-sectional view of the imaging system 801 along a plane parallel to the xy plane. Figure 8E It is a cross-sectional view of the imaging system 801 along a plane parallel to the xz plane.

[0074] Imaging system 801 includes an aperture strip 815, a lens module 807, an image sensor 805, and an actuator 845 (an example component of an aperture shifter). Imaging system 801 also includes a sensor 847 (e.g., a Hall effect sensor) to track the movement of aperture strip 815. Aperture strip 815 can be slid back and forth by actuator 845 (see [link to documentation]). Figures 8B to 8C The dashed arrows (in the image) are used to align different apertures with the optical path. Figure 8C In this configuration, when the aperture strip 815 slides, there is additional space for the aperture strip to move. Figure 8D In the imaging system 801, an aperture strip 815 is wound around a reel 811 (similar to imaging system 401). Figures 8C to 8E It includes various guiding features 835, 837 for guiding the aperture strip 815 as it slides. These features are incorporated into the imaging system 801.

[0075] Additional example aperture system

[0076] The following paragraphs provide an additional description of an example imaging system with an aperture system.

[0077] Some embodiments relate to an imaging system (e.g., 301, 401, 801) comprising an image sensor (e.g., 305, 405, 805), a strip (e.g., 315, 415, 515, 615, 815) having apertures (e.g., 317, 417), an aperture shifter (e.g., 313), and a controller (e.g., 391). A portion of the strip is positioned along an optical path (e.g., 323, 423) that directs light to the image sensor. The aperture shifter is configured to move the strip relative to the optical path to allow light propagating along the optical path to pass through one of the apertures in the strip and be incident on the image sensor (e.g., the aperture shifter is a rotary motor or linear actuator). The controller is configured to control the image sensor and the aperture shifter.

[0078] Some embodiments relate to an imaging system (e.g., 301, 401, 801) comprising: an image sensor (e.g., 305, 405, 805); an aperture shifter (e.g., 313); a strip (e.g., 315, 415, 515, 615, 815) having a plurality of apertures (e.g., 317, 417) coupled to the aperture shifter, a portion of the strip being positioned along an optical path (e.g., 323, 423) through which light passes to the image sensor; and a controller (e.g., 391) coupled to the image sensor and the aperture shifter (e.g., the aperture shifter is a rotary motor or linear actuator), the controller identifying the amount of light for the image sensor and transmitting signals to the aperture shifter to align the apertures of the strip with the optical path.

[0079] An aperture shifter can be configured to slide this portion of the strip in a direction substantially perpendicular (e.g., within three degrees) to the optical path. In some embodiments, the aperture shifter includes: (a) a first reel (e.g., 411) located on a first side of the optical path, wherein at least a first subset of the strip is wound around the first reel; and (b) a second reel (e.g., 413) located on a second side of the optical path, wherein at least a second subset of the strip is wound around the second reel (see, for example, see...). Figures 4A to 4C The second side of the optical path can be located on the opposite side of the first side (see, for example, [reference needed]). Figures 4A to 4C The reel 411 is located on the opposite side of the optical path 423 relative to the reel 413. In order to move the strip relative to the optical path, the aperture shifter can be configured to rotate one or both reels (e.g., the aperture shifter also includes a motor to rotate the reels).

[0080] In some embodiments, each stop of the strip has a different shape, different size, different filter, or some combination thereof relative to each of the other stops. For example, each stop on the strip is unique relative to all other stops on the strip (e.g., a unique combination of shape, size, and filter). However, in other embodiments, two or more stops may be identical (e.g., the same shape, size, and filter). For example, if a particular combination of stops is typically used, the strip may have multiple instances of the strip spaced apart above it to reduce the movement of the strip toward that combination of stops.

[0081] In some implementations, the edges of the apertures in the strips are spaced apart from each other by at least a threshold distance. For example, this can reduce or eliminate aperture interference and keep each aperture distinct.

[0082] The first stop of the strip may include a filter. The first stop of the strip includes at least one of the following: a vertical polarizer, a horizontal polarizer, a circular polarizer, an apodization filter, a neutral density filter, a linear gradient filter, or a radial gradient filter.

[0083] In some implementations, at least one of the apertures in the strip is asymmetric.

[0084] Other aspects include components, devices, systems, improvements, methods, processes, applications, computer-readable media, and other technologies related to any of the foregoing.

[0085] Example methods for capturing images using different apertures.

[0086] Figure 7 This is a flowchart of an example method 700 for capturing images using different apertures, according to one or more embodiments. Figure 7 In the example, method 700 is performed by a component (such as controller 391) of the imaging system (e.g., 301, 401). However, some or all of the steps may be performed by other entities or components. Additionally, some embodiments may perform the steps in parallel, in a different order, or by performing different steps. The steps of method 700 may be performed by a component (e.g., controller 391) that executes instructions stored on a non-transitory computer-readable storage medium.

[0087] At step 710, the image sensor (e.g., 305, 405) captures a first image of the external environment, wherein light incident on the image sensor passes through a first aperture (e.g., 317, 417).

[0088] At step 720, the first aperture is replaced with a second aperture by controlling the movement of a strip (e.g., 315, 415, 515, 615) having multiple apertures (e.g., 317, 417) via controller 391, wherein a portion of the strip is positioned along an optical path (e.g., 323, 423) that directs light from the external environment to the image sensor. Replacing the first aperture with the second aperture may include sliding that portion of the strip in a direction substantially perpendicular (e.g., within three degrees) to the optical path.

[0089] At step 730, the image sensor captures a second image of the external environment, wherein light incident on the image sensor passes through a second aperture.

[0090] In some embodiments, replacing the first aperture with a second aperture includes rotating a first reel (e.g., 411) on a first side of the optical path, wherein at least a subset of the strips is wound around the first reel. Replacing the first aperture with a second aperture may also include rotating a second reel (e.g., 413) on a second side of the optical path, wherein at least a second subset of the strips is wound around the second reel. The second side of the optical path may be located on the opposite side of the first side.

[0091] Other aspects include components, devices, systems, improvements, methods, processes, applications, computer-readable media, and other technologies related to any of the foregoing.

[0092] Example machine architecture

[0093] Now for reference Figure 9 , Figure 9 This is a block diagram illustrating components of an example machine capable of reading instructions from a machine-readable medium and executing those instructions within a processor system. Specifically, Figure 9 A schematic diagram of a computer system 1300 (also referred to as a “computing system”) is shown. The imaging systems described herein (e.g., 101, 301, 401) can be computer systems and therefore may include references. Figure 9 One or more (or all) of the described components and / or functions. Computer system 1300 may be used to execute instructions 1324 (e.g., program code or software) to cause the machine to perform any or more of the methods (or processes) described herein. In an alternative embodiment, the machine operates as a standalone device or a connected (e.g., networked) device connected to other machines. In a networked deployment, the machine may operate as a server machine or a client machine in a server-client network environment, or as a peer machine in a peer-to-peer (or distributed) network environment.

[0094] The machine can be a standalone device with processing units having a processor system and storage devices as described below. The machine can also be part of a system that includes devices coupled to server computers, client computers, personal computers (PCs), tablet PCs, set-top boxes (STBs), smartphones, Internet of Things (IoT) devices, or any machine capable of executing instructions 1324 (sequential or otherwise) specifying the operations to be performed by the machine, and the machine may have a small volumetric space to integrate an imaging system as described herein. Furthermore, while only a single machine is illustrated, the term "machine" should also be considered as including any collection of machines that individually or collectively execute instructions 1324 to perform any or more of the methods discussed herein. Instructions can be, for example, for controlling references. Figures 1A to 8E The instructions for the described imaging system and / or aperture system.

[0095] Example computer system 1300 includes processor system 1302, which includes one or more processing units (e.g., processors). If processor system 1302 includes multiple processing units, these units can perform operations individually or collectively. Processor system 1302 is, for example, a central processing unit (CPU), graphics processing unit (GPU), neural processing unit (NPU), tensor processing unit (TPU), digital signal processor (DSP), controller, state machine, application-specific integrated circuit (ASIC), radio frequency integrated circuit (RFIC), or any combination of these processors. Computer system 1300 also includes main memory 1304. The computer system may include storage unit 1316. Processor 1302, memory 1304, and storage unit 1316 communicate via bus 1308.

[0096] Additionally, the computer system 1300 may include static memory 1306 and a display driver 1310 (e.g., for driving a plasma display panel (PDP), liquid crystal display (LCD), or projector). The computer system 1300 may also include an alphanumeric input device 1312 (e.g., a keyboard), a cursor control device 1314 (e.g., a mouse, trackball, joystick, motion sensor, or other pointing instrument), a signal generation device 1318 (e.g., a speaker), and a network interface device 1320, all of which are configured to communicate via a bus 1308.

[0097] Storage unit 1316 includes (e.g., non-transitory) machine-readable medium 1322 on which instructions 1324 (e.g., software) embodying any one or more of the methods or functions described herein are stored. Instructions 1324 may also reside wholly or at least partially within main memory 1304 or processor system 1302 (e.g., within the processor's cache memory) during execution by computer system 1300, which also constitute machine-readable medium. Instructions 1324 may be transmitted or received via network 1326 via network interface device 1320.

[0098] Although machine-readable medium 1322 is shown as a single medium in the example embodiment, the term "machine-readable medium" should be considered to include a single medium or multiple media (e.g., a centralized or distributed database, or associated caches and servers) capable of storing instructions 1324. The term "machine-readable medium" should also be considered to include any medium capable of storing instructions 1324 for machine execution and causing the machine to perform any or more of the methods disclosed herein. The term "machine-readable medium" includes, but is not limited to, data repositories in the form of solid-state memory, optical media, and magnetic media.

[0099] Additional considerations

[0100] Throughout this specification, multiple instances may be implemented as components, operations, or structures described as a single instance. Although individual operations of one or more methods are illustrated and described as individual operations, one or more operations within an individual operation may be performed simultaneously, and the operations are not required to be performed in the illustrated order. Structures and functions presented as individual components in the example configuration may be implemented as composite structures or components. Similarly, structures and functions presented as single components may be implemented as individual components. These and other variations, modifications, additions, and improvements fall within the scope of this document.

[0101] Some embodiments herein are described as including logic or multiple components, modules, or mechanisms, such as controller module 113 and controller module 391. Modules can constitute software modules (e.g., code embodied on a machine-readable medium or in transmitted signals) or hardware modules. A hardware module is a tangible unit capable of performing certain operations and can be configured or arranged in a particular manner. In example embodiments, a computer system (e.g., a standalone computer system, a client computer system, or a server computer system) or one or more hardware modules (e.g., processors or groups of processors) of a computer system may be configured by software (e.g., an application or application portion) to operate as hardware modules to perform certain operations as described herein.

[0102] In various implementations, the hardware module can be implemented mechanically or electronically. For example, a hardware module may include dedicated circuitry or logic components that are permanently configured (e.g., as a dedicated processor, such as a field-programmable gate array (FPGA) or application-specific integrated circuit (ASIC)) to perform certain operations. A hardware module may also include programmable logic components or circuitry that are temporarily configured by software to perform certain operations (e.g., contained within a general-purpose processor or other programmable processor). It should be understood that the decision to implement the hardware module mechanically in a dedicated and permanently configured circuit or in a temporarily configured circuit (e.g., configured by software) may be driven by cost and time considerations.

[0103] The various operations of the example methods described herein can be performed at least in part by one or more processors, such as processor system 1302, which are temporarily or permanently configured (e.g., by software) to perform the relevant operations. Whether temporarily or permanently configured, such processors can constitute processor-implemented modules that operate to perform one or more operations or functions. In some example embodiments, the modules mentioned herein may include processor-implemented modules.

[0104] The one or more processors may also operate to support the execution of related operations in a “cloud computing” environment or as “Software as a Service” (SaaS). For example, at least some of the operations may be performed by a group of computers (as an example of a machine including processors), and these operations may be accessible via a network (e.g., the Internet) and via one or more appropriate interfaces (e.g., application programming interfaces (APIs)).

[0105] The execution of certain operations in the operation can be distributed across one or more processors, residing not only within a single machine but also deployed across multiple machines. In some example implementations, the one or more processors or processor-implemented modules may reside in a single geographic location (e.g., in a home environment, office environment, or server farm). In other example implementations, the one or more processors or processor-implemented modules may be distributed across multiple geographic locations.

[0106] Some portions of this specification are presented in the form of algorithms or symbolic representations for manipulating data stored in machine memory (e.g., computer memory) as bit or binary digital signals. These algorithms or symbolic representations are examples of techniques used by those skilled in the art of data processing to communicate the substance of their work to others skilled in the art. As used herein, an "algorithm" is a series of self-consistent operations or similar processes that result in a desired outcome. In this context, algorithms and operations involve the physical manipulation of physical quantities. Typically, but not necessarily, such quantities may take the form of electrical, magnetic, or optical signals that can be stored, accessed, transmitted, combined, compared, or otherwise manipulated by a machine. Primarily for reasons of common usage, it is sometimes convenient to use terms such as "data," "content," "bit," "value," "element," "symbol," "character," "term," "number," "numeral," etc., to refer to such signals. However, these terms are merely convenient labels and are associated with appropriate physical quantities.

[0107] Unless otherwise expressly stated, the use of words such as “processing,” “computing,” “calculating,” “determining,” “presenting,” “displaying,” etc. in this document may refer to the actions or processes of a machine (e.g., a computer) that manipulates or transforms data represented as physical (e.g., electronic, magnetic, or optical) quantities within one or more memories (e.g., volatile memory, non-volatile memory, or combinations thereof), registers, or other machine components that receive, store, transmit, or display information.

[0108] As used herein, any reference to “one implementation,” “some implementations,” or “implementation” means that a particular element, feature, structure, or characteristic described in connection with an implementation is included in at least one implementation. The appearance of the phrase “in one implementation” in various places in the specification does not necessarily refer to the same implementation.

[0109] Some implementations can be described using the expressions “coupling” and “connection” and their derivatives. For example, the term “coupling” can be used to describe some implementations to indicate that two or more elements are in direct physical or electrical contact. However, the term “coupling” can also mean that two or more elements are not in direct contact with each other, but still cooperate or interact with each other. In this context, the implementation is not limited to this.

[0110] As used herein, the terms “comprise,” “comprising,” “include,” “including,” “has,” “having,” or any other variation thereof are intended to cover non-exclusive inclusion. For example, a process, method, article of manufacture, or apparatus that includes a list of elements is not necessarily limited to those elements, but may include other elements not expressly listed or not inherent to such process, method, article of manufacture, or apparatus. Furthermore, unless expressly stated to the contrary, “or” refers to inclusive or, not exclusive or. For example, condition A or condition B is satisfied by either: A is true (or exists) and B is false (or does not exist); A is false (or does not exist) and B is true (or exists); and both A and B are true (or exist).

[0111] Furthermore, the terms "an" or "a kind" are used to describe elements and components of the embodiments described herein. This is done merely for convenience and to give the general meaning of the invention. The description should be understood to include one or at least one, and the singular includes the plural, unless it is obvious otherwise.

[0112] Upon reading this disclosure, those skilled in the art will understand additional alternative structural and functional designs for the systems and processes used to form combined images through the principles disclosed herein. Therefore, while specific embodiments and applications have been illustrated and described, it should be understood that the disclosed embodiments are not limited to the precise constructions and components disclosed herein. Various modifications, alterations, and variations that will be apparent to those skilled in the art may be made in the arrangement, operation, and details of the methods and apparatus disclosed herein without departing from the spirit and scope defined in the appended claims.

Claims

1. An imaging system, the imaging system comprising: Image sensor; Aperture shifter; A strip having a plurality of apertures coupled to the aperture shifter, a portion of the strip being positioned along an optical path that allows light to pass through the apertures of the plurality of apertures to reach the image sensor; as well as A controller coupled to the image sensor and the aperture shifter, the controller identifying the amount of light for the image sensor and transmitting a signal to the aperture shifter to align the aperture of the strip with the optical path.

2. The imaging system of claim 1, wherein the aperture shifter is configured to slide the portion of the strip in a direction substantially perpendicular to the optical path.

3. The imaging system as claimed in any of the preceding claims, wherein the aperture shifter comprises: A first reel, the first reel being located on a first side of the optical path, wherein at least a first subset of the strips is wound around the first reel; as well as A second reel, located on a second side of the optical path, wherein at least a second subset of the strips is wound around the second reel.

4. The imaging system of claim 3, wherein the second side of the optical path is located on the opposite side of the first side.

5. The imaging system of claim 3 or 4, wherein, in order to move the strip relative to the optical path, the aperture shifter is configured to rotate the first reel and / or the second reel.

6. The imaging system as claimed in any of the preceding claims, wherein each stop of the strip has a different shape, a different size, a different filter, or some combination thereof relative to each of the other stops.

7. The imaging system of any of the preceding claims, wherein the edges of the apertures of the strips are spaced apart from each other by at least a threshold distance.

8. The imaging system as claimed in any of the preceding claims, wherein the first aperture of the strip comprises a filter.

9. The imaging system of claim 8, wherein the first aperture of the strip comprises at least one of the following: Vertical polarizer Horizontal polarizer Circular polarizer apodization filter, Neutral density filter, Linear gradient filter, or Radial gradient filter.

10. The imaging system as claimed in any of the preceding claims, wherein at least one of the apertures of the strip is asymmetric.

11. The imaging system as claimed in any of the preceding claims, wherein, in order to move the strip, the aperture shifter comprises at least one of the following: a rotary motor or a linear actuator.

12. A method, the method comprising: A first image of the external environment is captured by an image sensor, wherein light incident on the image sensor passes through a first aperture. The first aperture is replaced with a second aperture by controlling the movement of a strip having multiple apertures, wherein a portion of the strip is positioned along an optical path that directs light from the external environment to the image sensor; and A second image of the external environment is captured by the image sensor, wherein light incident on the image sensor passes through the second aperture.

13. The method of claim 12, wherein replacing the first aperture with the second aperture comprises sliding the portion of the strip in a direction substantially perpendicular to the optical path.

14. The method of claim 12 or 13, wherein replacing the first aperture with the second aperture includes rotating the first reel on a first side of the optical path, wherein at least a subset of the strips is wound around the first reel.

15. The method of claim 14, wherein replacing the first aperture with the second aperture further comprises rotating the second reel on a second side of the optical path, wherein at least a second subset of the strip is wound around the second reel.

16. The method of claim 15, wherein the second side of the optical path is located on the opposite side of the first side.

17. A non-transitory computer-readable storage medium storing instructions, said instructions causing the computing system to perform operations when executed by the computing system, said operations including: A first image of the external environment is captured by an image sensor, wherein light incident on the image sensor passes through a first aperture. The first aperture is replaced with a second aperture by controlling the movement of a strip having multiple apertures, wherein a portion of the strip is positioned along an optical path that directs light from the external environment to the image sensor; and A second image of the external environment is captured by the image sensor, wherein light incident on the image sensor passes through the second aperture.

18. The non-transitory computer-readable storage medium of claim 17, wherein replacing the first aperture with the second aperture comprises sliding the portion of the strip in a direction substantially perpendicular to the optical path.

19. The non-transitory computer-readable storage medium of claim 17 or 18, wherein replacing the first aperture with the second aperture comprises rotating a first reel on a first side of the optical path, wherein at least a subset of the strips is wound around the first reel.

20. The non-transitory computer-readable storage medium of claim 19, wherein replacing the first aperture with the second aperture further comprises rotating a second spool on a second side of the optical path, wherein at least a second subset of the strip is wound around the second spool.

Images