This includes devices for multi-aperture imaging, methods for manufacturing them, and methods for detecting the entire field of view.

Abstract

The device according to the invention includes a housing and a multi-aperture imaging device. The multi-aperture imaging device includes an array of adjacently arranged optical channels and a beam deflection device for deflecting the beam paths of the optical channels. In a first operating state of the device, the housing encloses a housing volume. In the first operating state of the device, the beam deflection device has a first position within the housing volume, and in a second operating state of the device, the beam deflection device has a second position in which the beam deflection device is at least partially arranged outside the housing volume.

Description

[0001] This application is a divisional application of the Fraunhofer Society for the Promotion of Applied Research, filed on October 19, 2016, with application number 201680075298.X, entitled "Apparatus including a multi-aperture imaging device, a method for manufacturing the same, and a method for detecting the full field of view". Technical Field

[0002] This invention relates to apparatuses including multi-channel imaging devices, methods for manufacturing them, and methods for capturing the entire field of view. Furthermore, this invention relates to multi-aperture imaging systems including linear channel arrangements and extendable housings. Background Technology

[0003] Traditional cameras transmit the entire field of view in a single channel and are limited in minimization. In mobile devices (such as smartphones), two cameras are used, oriented to and opposite the surface normal of the display. Multi-aperture cameras, which demonstrate a linear channel arrangement with reduced construction height, have been proposed. Deflecting mirrors are used here; however, this is limited in its extension and thus causes an undesirable increase in construction height, or a decrease in brightness due to vignetting of the optical path. Furthermore, when mounted in the housing of a smartphone, other components (display, battery, electronics) can obstruct the path, preventing the beam deflection mechanism from freely deflecting the light path in different viewing directions. Summary of the Invention

[0004] Therefore, the concept of miniaturized devices that allow for capturing the entire field of view while ensuring high image quality would be desirable.

[0005] Therefore, the purpose of this invention is to provide an apparatus and a method of manufacturing the same, which allows for miniaturized implementation of the apparatus and capture of high-quality images.

[0006] This objective is achieved by the subject matter of the independent claims.

[0007] The central idea of ​​this invention lies in the recognition that the observation direction of a multi-aperture imaging device is minimally affected in quality when it is outside the housing. High-quality images can be achieved by deflecting the optical path of the optical channel outside the multi-aperture imaging device or outside the housing. Furthermore, deflecting the optical path allows the orientation of the multi-aperture imaging device within the housing to be at least partially independent of its observation direction. This is, for example, influenced or determined by beam deflection components. Independent orientation of the multi-aperture imaging device within the housing allows for miniaturization of the surrounding housing in at least one direction (e.g., thickness). The arrangement of the beam deflection components within the housing additionally allows elements of the multi-aperture imaging device and any possible illumination components to remain concealed in this operating state, resulting in a high degree of aesthetics for the entire device, since the aperture, lens, LED, or other devices are inconspicuous in this state.

[0008] According to an embodiment, the device includes a housing and a multi-aperture imaging device. The multi-aperture imaging device includes an array of optical channels arranged adjacent to each other and a beam deflecting member for deflecting the optical paths of the optical channels. In a first operating state of the device, the outer surface of the housing encloses a housing volume. The beam deflecting member includes a first position within the housing volume in the first operating state of the device. In a second operating state of the device, the beam deflecting member includes a second position in which at least a beam deflecting member is at least partially arranged outside the housing volume.

[0009] According to another embodiment, a method of providing an apparatus includes providing a housing and arranging a multi-aperture imaging device within the housing. The multi-aperture imaging device includes an array of optical channels arranged adjacent to each other and a beam deflecting member for deflecting the optical paths of the optical channels. The multi-aperture imaging device is arranged such that the outer surface of the housing encloses a housing volume in a first operating state of the apparatus, and such that the beam deflecting member includes a first position within the housing volume in the first operating state of the apparatus. The multi-aperture imaging device is arranged such that in a second operating state of the apparatus, the beam deflecting member includes a second position in which at least a beam deflecting member is at least partially arranged outside the housing volume.

[0010] According to another embodiment, a method for capturing the entire field of view includes moving a beam deflection member of a multi-aperture imaging device to a position in which at least the beam deflection member is at least partially disposed outside a housing volume, the housing volume being enclosed by an outer surface of the housing in a first operating state of the device, and the beam deflection member being disposed in a first position in the first operating state. The method includes capturing the entire field of view using an array of optical channels of the multi-aperture imaging device arranged adjacent to each other, the optical routes of the optical channels being deflected by the beam deflection member.

[0011] According to another embodiment, at least one actuator in the image stabilizer and / or focusing member is arranged such that it is at least partially positioned between two planes spanned or defined by the sides of a cuboid. The sides of the cuboid are aligned parallel to each other and to portions of the optical path of the optical channel between the image sensor and the beam deflection member. The direction of the surface normals of the planes can be understood as the thickness direction of the device. The volume of the cuboid is minimal and includes the image sensor, the array, and the beam deflection member in all cases. This allows the housing to be implemented as flat. Compared to existing methods, this allows the camera not to protrude from the cuboid volume of the housing in the thickness direction in any state.

[0012] Other advantageous embodiments are the subject of the dependent claims. Attached Figure Description

[0013] Preferred embodiments of the present invention will be described in detail below with reference to the accompanying drawings, wherein:

[0014] Figure 1a This is a schematic cross-sectional side view of the device according to the embodiment in a first operating state;

[0015] Figure 1b It is in the second operating state Figure 1a A schematic cross-sectional side view of the device;

[0016] Figure 2a This is a schematic cross-sectional side view of a device according to another embodiment, including the cover;

[0017] Figure 2b It is in the second operating state Figure 2a A schematic cross-sectional side view of the device;

[0018] Figure 2c In the third position Figure 2a A schematic cross-sectional side view of the device;

[0019] Figure 3a It is a schematic cross-sectional side view of a device according to another embodiment, including at least a partially transparent cover, in a first operating state;

[0020] Figure 3b It is in the second operating state Figure 3a A schematic cross-sectional side view of the device;

[0021] Figure 3c The beam deflection component is additionally movable in a translational manner. Figure 3a A schematic cross-sectional side view of the device;

[0022] Figure 4a This is a schematic cross-sectional side view of the device according to an embodiment, including a translationally movable cover, in a first operating state;

[0023] Figure 4b It is in the second operating state Figure 4a A schematic cross-sectional side view of the device;

[0024] Figure 5a This is a schematic cross-sectional side view of the device according to an embodiment, in which the cover is arranged to be rotatably movable;

[0025] Figure 5b The displacement support is movable by translation. Figure 5a A schematic cross-sectional side view of the device;

[0026] Figure 5c It is in the second operating state Figure 5a A schematic cross-sectional side view of the device.

[0027] Figure 6a Compared to Figure 5a A schematic cross-sectional side view of the device according to an embodiment, including at least a partially transparent cover, in a first operating state.

[0028] Figure 6b The beam deflection component includes an intermediate position between the first and second positions. Figure 6a A schematic cross-sectional view of the device;

[0029] Figure 6c The beam deflection component extends completely from the housing volume. Figure 6a A schematic cross-sectional view of the device;

[0030] Figure 6d The distance between at least partially transparent caps compared to Figures 6a to 6c Increased Figure 6a A schematic cross-sectional view of the device;

[0031] Figure 7 This is a schematic perspective view of an apparatus according to an embodiment, including three multi-aperture imaging devices;

[0032] Figure 8 yes Figure 7 An enlarged perspective view of a portion of the device;

[0033] Figure 9 This is a schematic perspective view of an embodiment in which the beam deflection component is connected to the multi-aperture imaging device by means of a mounting element;

[0034] Figure 10a This is a schematic perspective view of an apparatus according to an embodiment, including a lid of an exemplary shape, in a first operating state;

[0035] Figure 10b In the second operating state according to the embodiment Figure 10a A schematic diagram of the device;

[0036] Figure 10c According to the embodiments Figure 10a An illustrative illustration of the alternative;

[0037] Figure 11a -c is a detailed description of the multi-aperture imaging apparatus according to the embodiments;

[0038] Figure 11d -f illustrates the case where, according to an embodiment, the optical channel is supported by a common support member in an optical device. Figure 11a Implementation of -c multi-aperture imaging devices;

[0039] Figure 12The illustration shows an embodiment supplemented by additional components for achieving relative movement for optical image stabilization and for adapting to focus. Figure 11a -c multi-aperture imaging device;

[0040] Figure 13a This is a schematic diagram of a multi-aperture imaging device arranged in a flat housing according to an embodiment;

[0041] Figure 13b A schematic setup of a multi-aperture imaging device for stereo capture of the entire field of view is shown;

[0042] Figure 14 This is a schematic diagram of a 3D multi-aperture imaging device according to an embodiment;

[0043] Figure 15a This is a schematic diagram of another multi-aperture imaging device according to an embodiment, which, according to an embodiment, is supplemented by additional components for achieving relative movement for focus control and for optical image stabilization;

[0044] Figure 15b -e is a schematic side view of the beam deflection device according to an embodiment;

[0045] Figure 16a This is a schematic diagram of a multi-aperture imaging apparatus according to an embodiment, including adjustment members for individually adjusting the optical properties of each channel;

[0046] Figure 16b This illustrates a variation of a multi-aperture imaging apparatus including an adjustment component according to an embodiment;

[0047] Figure 17 According to the embodiment, it is supplemented with an additional actuator Figure 15a A schematic diagram of the device;

[0048] Figure 18 This is a schematic diagram of the arrangement of actuators in a multi-aperture imaging device according to an embodiment; and

[0049] Figures 19a-19f An advantageous implementation of the beam deflection member of the imaging apparatus according to an embodiment is shown. Detailed Implementation

[0050] Before discussing embodiments of the invention in more detail below with reference to the accompanying drawings, it should be noted that those elements, objects and / or structures or equivalent functions or effects are provided with equivalent reference numerals in different drawings so that the descriptions of these elements shown in different embodiments are interchangeable or mutually applicable.

[0051] Figure 1aA schematic cross-sectional side view of the device 10 according to an embodiment is shown in a first operating state. The device 10 may be a mobile or non-mobile device, such as a mobile phone, smartphone, mobile computer (e.g., tablet computer), and / or mobile music playback component.

[0052] Device 10 includes a multi-aperture imaging device 11, which includes an image sensor 12, an array 14 of optical channels 16 arranged adjacent to each other, and a beam deflection member 18. The beam deflection member 18 is used to deflect the optical path 17 of the optical channels 16 and will be discussed in more detail below. Device 10 includes a housing 22, which includes an outer surface 23 that encloses a housing volume 24. This means that the housing volume 24 can include both the internal volume of the housing 22 and the volume of the housing 22. Therefore, the housing volume also includes the volume occupied by the housing walls and thus enclosed by the outer surface 23 of the housing. The housing 22 can be formed to be transparent or opaque and, exemplarily, includes plastic and / or metallic materials. The beam deflection member 18 includes a first location within the housing volume 24. When determining the housing volume 24, holes or openings in the sides of the housing (such as acoustic channels for microphones or electrical connections for device 10) can be ignored. The housing 22 and / or devices disposed within the housing 22 may block the optical path 17 of the optical channel 16 after it has been deflected by the beam deflector 18, so that the field of view 26 disposed outside the housing 22, to be captured by the multi-aperture imaging device 11, cannot be captured or is captured only to a limited extent. The devices may be energy storage devices, plates, opaque areas of the housing 22, etc. Alternatively, another potentially non-optical element may be disposed at the housing instead of the previous camera objective.

[0053] The housing 22 may include a hole 28, through which the housing volume 24 is connected to the outer volume 25 of the housing 22. The hole 28 may be temporarily closed completely or partially by the cover 32. The first operating state of the device 10 may be the non-use operating state of the multi-aperture imaging device 11, in which the optical channel 16 is deflected, for example, to the inside of the housing 22 or is not deflected.

[0054] In other words, the structural height of the multi-aperture imaging device is at least partially determined by the diameter of the optics (lens) of the optical channel 16. In one (potentially optimal) case, the extension of the mirror (beam deflector) in the thickness direction is equal to the extension of the lens in that direction. However, the optical path of the optical channel 16 is constrained by the mirror (beam deflector 18). This results in a reduction in image brightness, which depends on the field of view. This embodiment addresses this problem by moving a portion or the entire multi-channel camera setup so that, in the camera's operating state, the portion of the setup protrudes beyond, for example, the housing of a smartphone, compared to the state when the camera is not in use. The moving portion (e.g., the beam deflector) can be done by rotation (folding), translation (extending), or a combination of these methods. Similar to zoom lenses known in compact cameras, the additional movement of part or the entire system allows for a minimal structural form in the camera's non-use mode and a larger structural form that is optimal for achieving the technical functionality in the camera's use mode.

[0055] Figure 1b A schematic cross-sectional side view of the device 10 in a second operating state is shown. In the second operating mode, the beam deflecting member 18 includes a second position outside the housing volume 24. This allows the beam deflecting member 18 to deflect the optical path 17 of the optical channel 16 outside the housing volume 24 and allows the field of view 26 outside the housing 22 to be captured by the multi-aperture imaging device 11. The cover 32 can be removed as shown in the figure. Figure 1a The position is adjusted so that the beam deflecting member 18 can be moved out of the housing volume 24 through the hole 28 of the housing 22. The beam deflecting member 18 can be moved between a first position and a second position by translation and / or rotation. Advantageously, the components within the housing 22 and / or the housing 22 does not obstruct the deflected optical path 17 of the optical channel 16.

[0056] The multi-aperture imaging device 11 can be arranged within a camera housing, which is at least partially arranged within a housing 22. The camera housing can, for example, be at least partially formed by a displacement support, such as in combination with... Figure 5a As described in -c. This differs from the concept in which a single-channel camera is oriented in different directions by means of a flip mechanism, in which case rotation or tilting of the image sensor and / or imaging optics can be avoided.

[0057] The entire field of view can be captured by means of device 10, so that the beam deflection member moves from a first position to a second position, in which the beam deflection member is at least partially placed outside the housing volume. If the beam deflection member is in the second position, the entire field of view can be captured using an array of optical channels of a multi-aperture imaging device arranged adjacent to each other, the optical path being deflected by the beam deflection member.

[0058] Figure 2aA schematic cross-sectional side view of a device 20 according to another embodiment is shown in a first operating state. The device 20 includes a cover 23, which is supported, for example via connecting elements 34a and / or optional connecting elements 34b, to be rotatable at the housing 22. Connecting elements 34a and / or 34b can be configured to allow tilting, and thus allow rotational movement of the cover 23 of the beam deflection member 18 relative to the housing 22, and are formed, for example, as hinges or roll bearings.

[0059] The beam deflector 18 may form a cover of the housing or may be a part thereof. One of the beam deflection surfaces of the beam deflector 18 may be an outer edge of the housing. The beam deflector 18 includes a first position and partially or completely closes the housing 22. The beam deflector 18 may, for example, include a reflective region for deflecting the optical path 17 and may include a contact region for forming mechanical contact with the housing 22 in the first position. In a simple manner, the camera is invisible or nearly invisible when not in use.

[0060] Figure 2b A schematic cross-sectional side view of the device 20 in a second operating state is shown. In the second operating state, the beam deflector 18 can be moved relative to the housing 22 in a rotatable manner (deployed) to open the housing volume 24. Rotational tilting allows the beam deflector 18 to be oriented obliquely or tilted relative to the path of the optical path 17 of the optical channel 16 between the image sensor 12 and the beam deflector 18, so that the optical path 17 is deflected at the beam deflector 18 to a first direction 19a.

[0061] Figure 2c A schematic cross-sectional side view of the device 20 in the third position is shown. The device 20 can demonstrate a second operating state. Compared to... Figure 2b In the second position shown, the beam deflector 18 can deflect the optical path 17 of the optical channel 16 to another direction 19b so that another field of view or a field of view located at a different position can be captured. This could, for example, be the optical path 17 being deflected to a first side and opposite side of the device 20 and / or the user, such as the front and back sides, left and right sides, or top and bottom. For example, connecting elements 34a and 34b can be connected to the frame structure and the beam deflector 18 so that the beam deflector 18 can alternately include the second or third position. By means of the switchable viewing direction of the multi-aperture imaging device, especially in smartphones, the previous scheme using two cameras with viewing directions facing the front and back can be replaced by a single structure.

[0062] Figure 3a A schematic cross-sectional side view of a device 30 according to another embodiment is shown in a first operating state. Compared to... Figure 2aThe apparatus 20 and apparatus 30 described in -c include a at least partially transparent cover 36 disposed between the outer edge 23 of the housing 22 and the multi-aperture imaging device 11. The at least partially transparent cover is connected to and is movable based on the movement of the beam deflection member 18. For example, the at least partially transparent cover 36 may comprise a polymer and / or glass material.

[0063] In other words, among other things, a device can be provided that allows the packaging of optical components to prevent contamination, while still allowing for changes in the volume of the package (removable protective glass).

[0064] Figure 3b A schematic cross-sectional side view of the device 30 in a second operating state is shown. Compared to Figure 2b In the device 20, at least a partially transparent cover is at least partially removed from the housing volume 24. This can be accomplished by rotational movement of a beam deflecting member about a connecting element 34. The beam deflecting member 18 is used to deflect the optical path 17 of the optical channel 16 so that the optical channel passes through the at least partially transparent cover. 36 is used to reduce or prevent particles, dust, and / or moisture from entering the housing volume 24. Therefore, the cover 36 can be formed to be transparent to the optical path 17 and / or implemented as partially opaque. Exemplarily, the cover 36 can be opaque to electromagnetic radiation within a specific wavelength range. The advantage of using the cover 36 is that a longer operating time and / or persistently high image quality can be obtained due to the reduced amount of particles, dust, and / or moisture, resulting in low contamination of the optics in the optical channel.

[0065] Figure 3c A schematic cross-sectional side view of the device 30 is shown, in which the beam deflection member 18 is translatably movable in the direction y by an optional actuator 38, the direction y being perpendicular to the direction x of the optical path 17 between the image sensor 12 and the optical channel 16 and perpendicular to the direction z perpendicular to the linear extension direction of the array of optical channels 16. The beam deflection member 18 can also be translated based on rotational movement about the connecting element 34, for example using a guide, rod, etc. The folding (rotational movement) can occur manually or using an actuator. An optional actuator 38 can be arranged at the beam deflection member 18. Alternatively, the actuator 38 can be arranged between the housing 22 and the beam deflection member 18. The actuator 38 can be arranged, for example, between the housing 22 and the connecting element 34a and / or between the connecting element 34a and the beam deflection member 18. Here, it is advantageous that the obstruction of the field of view to be captured by the housing 22 can be reduced by the translational movement of the beam deflection member along the x-direction of the housing.

[0066] Figure 4aA schematic cross-sectional side view of the device 40 according to an embodiment is shown in a first operating state. In the first position, the beam deflection member 18 is arranged within the housing volume of the housing 22 and configured to move from the first position to the second position based on translational movement 42, as... Figure 4b As shown in the illustration. Figure 4a As shown, in the first operating state, the housing may include a cover 32 or an opening therein for closing the housing 22. In the first operating state, the beam deflection member 18 may be oriented such that it includes a minimum extension perpendicular to the direction x defined by the optical path within the housing 22.

[0067] Figure 4b A schematic cross-sectional side view of the device 40 in the second operating state is shown. The beam deflection member moves out of the housing volume 24 based on, for example, a translational movement 42 along the x-direction. Here, the beam deflection member 18 can move through the aperture 28. The beam deflection member 18 can be moved to be rotatable about the rotation axis 44. During the translational movement between the first and second operating states, the beam deflection member 18 can perform a rotational movement about the rotation axis 44. Compared to Figure 4a In the first operating state, the angular orientation of the beam deflection member can be changed so that the area of ​​the beam deflection member used in the optical path of the multi-aperture imaging device increases compared to the first operating state. Rotational movement 46 about the rotation axis 44 allows for variable tilting of the beam deflection member 18 relative to the optical path 17 between the optical channel 16 and the beam deflection member 18, and thus allows the optical path 17 of the optical channel 16 to be deflected to its variable direction. The optical channel 16 may include optics 64a-b.

[0068] In the second operating state, in addition to the beam deflector 18, the optics 64a-b and / or image sensor 12 of the optical channel 16 can be arranged outside the housing volume 24. Exemplarily, the optics 64a-b and / or image sensor 12 of the optical channel 16 can move together with the beam deflector 18, for example, in a translational manner. This allows for a small to minimal distance between the optics 64a-b of the optical channel and the beam deflector 18, particularly in the second operating state. The small distance allows for a small area extension of the beam deflector 18. Increasing the distance would require a larger area of ​​the beam deflector 18, and to obtain equal imaging parameters, a greater distance of the optical channel would be required to fully deflect the optical path of the optical channel 16. Due to the small or minimal distance, the beam deflector 18 can also comprise a small area, which is advantageous because it specifically achieves minimal extension in the y-direction perpendicular to the x-direction in the observation plane, and because the smaller component must be moved and rotated, the thickness of the device must only increase slightly or not at all compared to the state without the beam deflector 18. The small size also has an advantage in terms of the space required, for example, in the first or second operating state.

[0069] In other words, a multi-aperture camera with a linear channel arrangement comprises several optical channels arranged adjacent to each other, each transmitting a portion of the full field of view. Advantageously, mirrors are arranged in front of the imaging lenses, which can be used for beam deflection and contribute to a reduction in structural height. Combined with mirrors adapted to each channel (e.g., faceted mirrors, where the facets can be planar or curved in any way or provided with free-form surfaces), the imaging optics of the optical channels can also be advantageously configured to have substantially identical settings, while the observation direction of the channel is pre-determined by the individual facets of the mirror array. The surface of the beam deflection member is mirrored at least at the reflective facets associated with the optical channel. The imaging optics of the channels can also be configured differently so that different observation directions result from the angles of the mirror facets and the design of the respective optical channels. Several channels can also use the same area of ​​the beam deflection member, thus reducing the number of facets to the number of channels. The deflecting mirrors can be rotatably supported, with the axis of rotation, for example, parallel to the direction of the channel's extension. The deflecting mirrors can be reflective on both sides, where metal or dielectric layers (sequences) can be employed. The rotating mirror can be operated in an analog, bistable, or multistable manner. Based on rotational movement, the beam deflection member can move between at least a first and a second position, wherein the optical path is deflected to mutually different directions in each position. Similarly, as for... Figure 2a The beam deflection member 18 discussed in section -c can also move about a rotation axis. In addition to the translational movement of the housing cover 32 and the beam deflection member 18, some or all of the additional components of the multi-aperture imaging device can also be moved in the same direction by translation, where equal or different displacement paths are possible.

[0070] Figure 5a A schematic cross-sectional side view of device 50 is shown, wherein cover 32 is arranged at housing side 22b of housing 22 for rotational mobility via connecting element 34. Beam deflection member 18 may be mechanically connected to displacement bracket 47. Displacement bracket 47 can be understood as a mechanical transport member for moving at least beam deflection member 18. Device 50 may include an actuator for translating displacement bracket 47. The actuator may include any drive, such as a stepper motor, piezoelectric drive, or voice coil drive. Alternatively, or in addition to actuator 33, device 50 may include actuator 33' for releasing a mechanical lock 35 that locks cover 32 and housing to at least housing side 22a. Beam deflection member or displacement bracket 47 may be displaceable from housing by means of spring force, for example, when mechanical lock 35 is released. This means that lock 35 may be used to hold beam deflection member 18 in a first position. Displacement bracket 47 may also be arranged in device 40. This means that displacement bracket 47 may also be translated by cover 32.

[0071] Figure 5b A schematic cross-sectional side view of the device 50 is shown, in which the displacement bracket 47 moves along the translational direction of the movement 42 so that the beam deflection member 18 moves out of the housing volume 24. The optics of the image sensor 12 and / or the optical channel 16 may also be mechanically connected to the displacement bracket 47 and may move to the same extent as the beam deflection member 18. Alternatively, the optics of the image sensor 12 and / or the optical channel 16 may be less movable than the beam deflection member 18 so that the distance between the image sensor 12, the optics, and / or the beam deflection member 18 increases when moved out. Alternatively or additionally, the optics of the image sensor 12 and / or the optical channel may be arranged in a fixed position relative to the housing so that only the beam deflection member 18 moves by means of the displacement bracket 47. The increased distance between the image sensor 12, the optics, and / or the beam deflection member 18 when moved out allows for smaller distances between components in the first operating state so that the multi-aperture imaging device can be housed in the housing 22, which requires minimal space.

[0072] Figure 5c A schematic cross-sectional side view of the device 50 in a second operating state is shown. The beam deflection member can be rotatably supported to perform rotational movement 46, as described for the device 40. Figure 4b As described, the angular orientation of the beam deflection member 18 can be compared to Figure 5a First operating state or Figure 5b The state is changed so that the area of ​​the beam deflection unit used by the optical path of the multi-aperture imaging device increases compared to the first operating state. The side of the beam deflection member 18 facing the optical channel 16 or image sensor 12 may exhibit a dimension B (e.g., along the y-direction) perpendicular to the translation direction of the movement 42. Dimension B is larger than the dimension A of the image sensor 12 or optical channel 16 along this direction. Dimension B is, for example, perpendicular to the line extension direction of the array and parallel to the surface of the image sensor onto which the optical channel strikes. The result can be a high degree of light that can be deflected by the beam deflection member 18 and a high brightness of the captured image. (See diagram...) Figure 5a In the positioning, the extension or dimension B is less than shown. Figure 5c The positioning element 18 guides the optical path to different observation directions in the positioning element.

[0073] Figure 6a A schematic cross-sectional side view of the device 60 according to an embodiment is shown in a first operating state. The beam deflection member 18 includes a first position. Compared to device 40 and as... Figure 4a and 4bThe device 50 described herein includes at least partially transparent covers 36a and 36b connected to a cover 32 and movable about the cover 32 in a translational direction along movement 42. The at least partially transparent covers 36a and 36b can be arranged on different sides of the beam deflecting member 18, respectively, between the beam deflecting member 18 and the housing 22. In a first operating state, covers 36a and 36b can be arranged partially or entirely within the housing volume 24. Covers 36a and 36b can be arranged, for example, in the manner shown in… Figure 5a -c can be the displacement bracket 47 or the transparent area of ​​the displacement bracket 47.

[0074] Figure 6b A schematic cross-sectional side view of a device 60 in which the beam deflection member 18 includes an intermediate position between a first position and a second position is shown. For example, the intermediate position of the beam deflection member 18 can be obtained, for example, by retracting the beam deflection member 18 into the housing volume 24 or extending it out of the housing volume 24. The beam deflection member 18 is partially removed from the housing volume 24.

[0075] Figure 6c A schematic cross-sectional side view of a device 60 in which the beam deflector 18 includes a second position (i.e., the beam deflector 18 is, for example, completely removed from the housing volume 24) is shown. The at least partially transparent covers 36a and 36b include a mutual distance 48 smaller than the comparable distance between the lateral areas 22a and 22b of the housing.

[0076] Figure 6d The distance between at least partially transparent covers 36a and 36b is shown. Figure 6a -c Schematic cross-sectional side view of the added device 60. At least partially transparent covers 36a and / or 36b are movable in the direction of translation (e.g., along the positive or negative y-direction) of movements 52a and 52b opposite to their respective other at least partially transparent covers 36a and 36b. (Shown in...) Figure 6a The state of at least partially transparent covers 36a and 36b of -c can be understood as a retracted or collapsed state. (Shown...) Figure 6d The state can be understood as an extended or unfolded state, wherein the distance 48' between at least partially transparent covers 36a and 36b is altered (e.g., increased) compared to distance 48. Distance 48' can, for example, be greater than or equal to the distance between comparable sides of housing 22. A beam deflecting member 18 is used to deflect the optical path of the optical channel so that it passes through at least partially transparent covers 36a and / or 36b. (As in combination) Figure 4b , Figure 5a and Figure 5b As described, the angular orientation of the beam deflection member 18 can be compared to Figure 6a First operating state or Figure 6bThe state in 6c is changed so that the area of ​​the beam deflection unit used by the optical path of the multi-aperture imaging device is increased compared to the first operating state. The increased distance 48' may alternatively or additionally allow an increased degree of rotational movement 46. Using rotational movement 46, the beam deflection member 18 can be switchable between at least a first and another position, where each position can be associated with the observation direction of the multi-aperture imaging device. The mirror can be rotated in an analog, bistable, or multistable manner. The rotational movement 46 for changing the observation direction of the multi-aperture imaging device can be combined with rotational movement of the beam deflection member 18 for optical image stabilization, which combines Figure 12 Description. Covers 36a and / or 36b can encapsulate other components of the multi-aperture imaging device.

[0077] The opposing covers 36a and / or 36b, or their transparent areas, may include switchable apertures such that the switchable apertures can be introduced, for example, above and / or below, or along any other direction of the beam deflection member. The apertures can be switched depending on the camera's operating state and the viewing direction. Exemplarily, the unused viewing direction of the multi-aperture imaging device can be at least partially closed by the aperture to reduce the amount of stray light entering. For example, the aperture can be mechanically movable or can be electrochromic. The area affected by the aperture can be additionally equipped with a switchable aperture that covers the optical structure when not in use. The aperture can be electrically controllable and includes an electrochromic layer (sequence). The aperture may include a mechanical moving part. Movement can be generated using pneumatic, hydraulic, piezoelectric actuators, DC electrodes, stepper motors, thermal actuators, electrostatic actuators, electrostrictive and / or magnetostrictive actuators, or drives. In a state of the multi-aperture imaging device in which the viewing direction penetrates the aperture, the aperture can be switched to transmit the light path of the light channel. This means that the multi-aperture imaging device can include a first operating state and a second operating state. In the first operating state, a beam deflecting member can deflect the optical path of the optical channel so that the optical path passes through a first transparent region of cover 36a. In the second operating state, the optical path of the optical channel can be deflected so that the optical path passes through a second transparent region of cover 36b. A first aperture 53a can be used to at least partially optically close the first transparent region in the second operating state. A second aperture 53b can be used to optically close the second transparent region, either midway through or at least partially, the second transparent region in the first operating state. Therefore, stray light entering from directions other than the current viewing direction of the multi-aperture imaging device can be reduced, which has a beneficial effect on image quality. The first aperture 53a and / or the second aperture 53b can be effective for at least one, at least two, or all optical channels. Exemplarily, at least one, at least two, or all optical channels of the multi-aperture imaging device can pass through the first aperture when the optical path of the optical channel is guided through the first transparent region, and through the second aperture when the optical path of the optical channel is guided through the second transparent region.

[0078] It should be noted that, according to Figure 2a The mechanisms for deploying the beam deflection member as described in -c and 3a-c are combined with mechanisms for translational movement, i.e., a hybrid arrangement is possible. Deploying the housing and / or extending the beam deflection member can occur so that the imaging module (i.e., the optical path, its optics, and / or image sensor) can be moved out of the housing volume. Angular variations in the beam deflection member can allow for a large extension of the multi-aperture imaging device in the thickness direction and / or allow the beam deflection member to deflect the optical path to the "front" and "back" sides in an unobstructed manner. A protective glass (such as cover 36) can also be fixed relative to the deployed or extended element. The protective glass can comprise any planar or non-planar area.

[0079] Figure 7 A schematic perspective view of an apparatus 70 according to an embodiment, including three multi-aperture imaging devices 11a-c, is shown. The multi-aperture imaging devices 11a-c are translatably movable along their respective translational directions of movement 42a-c. The multi-aperture imaging devices 11a-c can be arranged in the secondary sides 22c-f of a housing 22. The housing can be formed flat, meaning that a first extension of housing 22 along a first housing direction (e.g., the x-direction) and a second extension of housing 22 along a second housing direction (e.g., the z-direction) can include at least three times, at least five times, or at least seven times the size of a third extension of housing 22 along a third housing direction (e.g., the y-direction). The main sides 22a and / or 22b of housing 22 can include first and second dimensions and can be exemplarily arranged parallel to the x / z plane in space. The secondary sides 22c-f can connect to or be arranged between the main sides 22a and 22b.

[0080] Multiaperture imaging devices 11a and 11b can be arranged within housing 22 or on the same side 22d within housing 22, and can include a basic distance BA between them, for example, for stereoscopic purposes. More than two modules are also conceivable. Thus, the entire field of view can be captured stereoscopically or at a higher elevation, for example, by using multiaperture imaging device 11c and at least one other multiaperture imaging device 11a and / or 11b. Multiaperture imaging devices 11a, 11b, and / or 11c can be individually movable. Alternatively, two or more modules can also be movable together as a whole system.

[0081] As will be described in more detail below, device 70 can be used to capture the entire field of view at least stereoscopically. The entire field of view can be arranged, for example, at one of the main sides 22a or 22b, but can also be arranged at the secondary sides 22c-f. Multiaperture imaging devices 11a-c can, for example, each capture the entire field of view. Although multiaperture imaging devices 11a-c are shown as arranged spatially separated from each other, multiaperture imaging devices 11a, 11b and / or 11c can also be arranged spatially adjacent or in combination. For example, an array of multiaperture imaging devices 11a, 11b, which can be formed as a single line, can be arranged adjacent to or parallel to each other, as in combination. Figure 13b As described. The arrays can form lines between each other, and each multi-aperture imaging device 11a and 11b includes a single-line array. The multi-aperture imaging devices 11a and 11b may include a common support and / or a common image sensor for optics sharing a beam deflection member and / or an optical path.

[0082] Figure 8 An enlarged perspective view of a portion of device 70 and multi-aperture imaging devices 11a and 11b is shown. Device 70 has a second operating state. Exemplarily, multi-aperture imaging devices 11a and / or 11b protrude beyond the original housing side. Beam deflection members 18a and 18b are moved at least partially outside the housing volume based on the translational directions of movements 42a and 42b. Alternatively, in the second operating state, only a portion of the beam deflection members of multi-aperture imaging devices 11a-c may be moved outside the housing volume of housing 22.

[0083] Multi-aperture imaging devices 11a-b exemplarily each include four optical channels 16a-d and four optical channels 16e-h. Beam deflecting members 18a and 18b are respectively used to deflect the optical paths 17a-d and 17e-h of optical channels 16a-d and 17e-h. Other multi-aperture imaging devices may include different numbers of optical channels than each other, as will be described in more detail below. Multi-aperture imaging devices 11a-b may include equal or different numbers of optical channels.

[0084] Multi-aperture imaging devices 11a and 11b each include illumination elements 54a and 54b, and 54c and 54d, respectively. Illumination elements 54a-d are used to at least partially illuminate the entire field of view to be captured, and may, for example, be used to illuminate the center (target region) of the entire field of view to be captured. According to an embodiment, at least one of illumination elements 54a or 54b and 54c or 54d may be arranged such that it illuminates the entire field of view along the average viewing direction of optical channels 16a-d and 16e-h. The entire field of view may include mutually different local fields of view captured by at least one optical channel 16a-d and 16e-h. The average viewing direction of optical channels 16a-d or 16e-h may, for example, be the geometric mean of the viewing directions or the median of the viewing directions.

[0085] Illumination components 54a-b and 54c-d can be operated as flash lamps for their respective multiaperture imaging devices 11a or 11b and include any light source. Advantageously, the light source can be implemented, for example, as a light-emitting diode (LED) because these exhibit small space requirements and low energy consumption. According to other embodiments, the multiaperture imaging device may exclude or include one or more than two illumination components 54a-d, wherein the number of illumination components 54a-d in the multiaperture imaging device may differ from or be equal to the number of other multiaperture imaging components in the device. At least one of the illumination components 54a-d can be used to illuminate several target areas. Exemplarily, light can optionally be emitted by the illumination component in one or more directions. The illumination component can emit light along at least two viewing directions of the multiaperture imaging device. Here, the illumination component may include at least two light sources. The light sources can emit light from opposite sides of the device. Each light source can be applied, for example, to the top or bottom, front and back, and / or left and right sides of the displacement bracket 47, wherein only the respective light source on the side opposite the target area to be captured in the direction of emission, corresponding to the selected orientation and therefore the operating state of the beam deflection member 18. The terms front, back, top, and bottom, as well as left or right, mentioned above are for illustrative purposes only and are not to be construed as limiting, as they are interchangeable in relation to their respective orientations in space. This means that light source 54i can be arranged, for example, on the front and back sides of the displacement bracket 47b, and the corresponding light source can be used depending on the positioning of the beam deflection member 18b. Other, opposite light sources can remain unused.

[0086] Illumination components 54a and 54b are arranged, for example, between the beam deflection member 18a and the image sensor 12a of the multi-aperture imaging apparatus 11a. The beam deflection member 18a can be used to deflect the illumination radiation emitted by the illumination components 54a and / or 54b (e.g., a flash lamp). The illumination components 54a-b can be arranged within the housing volume in a first and second operating state of the apparatus 70. The illumination radiation can be at least partially a portion of the optical paths 17a-d. As shown for the multi-aperture imaging apparatus 11b, for example, illumination components 54c and / or 54d can be arranged laterally adjacent to the beam deflection member at the displacement support 47b. Illumination components 54c and 54d can be moved into or out of the housing 22 using translational movement 42b. Although illumination components have been described in conjunction with apparatus 70, other apparatuses or multi-aperture imaging apparatuses described herein may also include illumination components.

[0087] Lighting components 54c and 54d may be mechanically connected to displacement bracket 47a and arranged within volume 24 in a first operating state, and thus arranged to be invisible to the user. Lighting components 54a and 54b may alternatively or additionally be arranged in housing 22 to be stationary. Moving displacement bracket 47b may cause movement of lighting components 54c and 54d.

[0088] Optical components 16a-d or 16e-f and possibly image sensors 12a or 12b can be removed from the housing volume along with beam deflection components 18a and 18b via displacement supports 47a and 47b.

[0089] In other words, LEDs can be applied to movable parts to achieve additional lighting (flashlights). LEDs can be arranged so that they radiate in the average direction of the channel or that beam deflection components can be used to deflect radiation in other areas.

[0090] Figure 9 A schematic perspective view of the apparatus 90 according to an embodiment, including a second operating state, is shown. The beam deflection member 18 can be connected to the multi-aperture imaging apparatus by means of mounting elements 56a and 56b. Mounting elements 56a and 56b can be parts of a displacement support.

[0091] Figure 10a A schematic perspective view of the device 100 according to an embodiment is shown in a first operating state. The cover 32 may form a plane with the main side and / or secondary side of the housing (e.g., secondary side 22c). There may be no gap between the cover 32 and the housing side 22c, or only a small gap (e.g., less than or equal to 1 mm, less than or equal to 0.5 mm, or less than or equal to 0.1 mm), so that the transition between the cover 32 and the housing side 22c is imperceptible or difficult to perceive. In a simplified manner, the cover 32 may be invisible.

[0092] Figure 10b A schematic diagram of the device 100 in a second operating state is shown. The beam deflection member 18 includes a second location outside the housing volume. Viewed from the outside, the extended multi-aperture imaging device may be surrounded by a stationary housing frame on all sides and / or have a button-like shape. The device 100 may, for example, be configured to use according to Figure 10a Mechanical pressure on cover 32 releases the mechanical lock so that the beam deflecting member can be moved out of housing 22, for example, based on spring force. The mechanical pressure can be generated by an actuator and / or the user, such as finger pressure. From the second position, the beam deflecting member can be moved back to the first position by means of an actuator or by means of mechanical pressure, and there the lock is disengaged. The actuator can be, for example, actuator 33 or 33'. In other words, movement can also be made manually so that the user can extend or retract or fold or unfold part or the entire system by his or her own force. Movement can be particularly a combination of manual actuation and spring force effect. Thus, the user manually folds or pushes part or the entire system into or into the housing of a device (e.g., a smartphone) to close the camera, thus biasing the spring, and the locking mechanism holds this position. When the camera is opened, for example, by means of suitable software on a smartphone, the switchable locking mechanism is released by a suitable controllable mechanism (e.g., a relay), and the spring force of the spring causes part or the entire system of the camera to extend or unfold. Furthermore, the cover forming part of the housing, the extendable and / or tiltable portion, and / or another mechanism located therein can be implemented such that pressure release locking on the cover (by a finger), extension or deployment of part or the entire system, and possibly activation of the image capture software on the device. The movable cover (which may form part of the housing at the subsurface) can be surrounded by a fixed housing on all sides while still being visible from the outside, or the subsurface can be truncated in terms of overall height (= thickness direction of the housing).

[0093] Figure 10c The cover 32 is formed such that a continuous gap is formed in the secondary side surface 22c between the main side surfaces of the housing 22. Figure 10a An illustrative example of an alternative. This allows for only two columns (instead of) Figure 10a The four pillars shown are perceptible within the housing 22. An extendable cover 32 and / or other cover may be formed as part of the housing 22 on one or more sub-sides of the flat housing.

[0094] Subsequently, reference will be made to some possible embodiments of the multi-aperture imaging device, such as those used in the embodiments.

[0095] Figure 11a -c illustrates a multi-aperture imaging device 11 according to an embodiment of the present invention. Figure 11aThe multi-aperture imaging device 11 includes a single-line array 14 of optical channels 16a-d arranged adjacent to each other. Each optical channel 16a-d includes optics 64a-d for imaging a respective local field of view 74a-d of the full field of view 72 of the multi-aperture imaging device 11 onto a respective associated image sensor region 58a-d of the image sensor 12. The image sensor regions 58a-d may, for example, each be formed of a chip including a corresponding pixel array, wherein the chip is as follows: Figure 11a The -c designation indicates that the pixels can be mounted on a common substrate or common board 62. Alternatively, and of course, it is possible that the image sensor regions 58a-d are each formed from portions of a common pixel array extending continuously over the image sensor regions 58a-d, wherein the common pixel array is formed, for example, on a single chip. In this case, only the pixel values ​​of the common pixel array in the image sensor regions 58a-d are read out. Of course, different combinations of these alternatives are also possible, for example, one chip for two or more channels and another chip for different channels, etc. In the case of multiple chips in the image sensor 12, these are mounted, for example, on one or more boards, for example, all together or in groups, etc.

[0096] exist Figure 11a In the embodiment of -c, the four optical channels 16a-d are arranged adjacent to each other in a single line along the line extension direction of array 14; however, the number four here is merely exemplary and could be any other number greater than 1. Furthermore, array 14 may also include additional lines extending along the line extension direction.

[0097] The optical axes or optical paths 17a-d of the optical channels 16a-d are parallel to each other between the image sensor regions 58a-d and the optics 64a-d. Furthermore, the image sensor regions 58a-d are arranged, for example, in a common plane, such as the optical center of the optics 64a-d. The two planes are parallel to each other, i.e., parallel to the common plane of the image sensor regions 58a-d. Moreover, in the case where the plane is projected perpendicularly onto the image sensor regions 58a-d, the optical center of the optics 64a-d coincides with the center of the image sensor regions 58a-d. In other words, in these parallel planes, the optics 64a-d (on one hand) and the image sensor regions 58a-d are arranged along the linear extension direction with equal repeating distances.

[0098] The image-side distance between image sensor regions 58a-d and their respective optics 64a-d is adjusted such that the imaging to image sensor regions 58a-d is adjusted to a desired object distance. This distance is, for example, within a region equal to or greater than the focal length of optics 64a-d, or, for example, within a range between one and two times the focal length of optics 64a-d (inclusive). The image-side distance along the optical axis 17a-d between image sensor regions 58a-d and optics 64a-d can also be adjusted, for example, manually by the user or automatically via autofocus control.

[0099] Without additional measures, the local fields of view 74a-d of optical channels 16a-d substantially completely overlap due to the parallelism of the optical paths or optical axes 17a-d. A beam deflection member 18 is provided to cover a larger full field of view 72 and to make the local fields of view 74a-d only partially overlap in space. The beam deflection member 18 deflects the optical paths 17a-d or optical axes to the full field of view direction 76 by a channel-specific offset. The full field of view direction 76 is, for example, parallel to a plane perpendicular to the line extension direction of array 14 and parallel to the path of the optical axes 17a-d before or without beam deflection. Exemplarily, the full field of view direction 76 is obtained from the optical axes 17a-d by rotating around the line extension direction at an angle >0° and <180° (e.g., between 80 and 100°, and, for example, 90°). The full field of view of the multi-aperture imaging device 11, corresponding to the full coverage of the local fields of view 74a-d, is therefore not in the direction of extension in which the image sensor 12 and the array 14 are connected in series in the direction of the optical axis 17a-d, but due to beam deflection, the full field of view is laterally opposite to the image sensor 12 and the array 14 in the direction of measuring the construction height of the multi-aperture imaging device 11 (i.e., the lateral direction perpendicular to the line extension direction). Additionally, the beam deflection member 18 uses individual channel deflection from the aforementioned deflection resulting in direction 76, deflecting the optical path of each optical path or each optical channel 16a-d. Therefore, the beam deflection member 18 includes reflective facets 68a-d for each optical channel 16a-d. These are slightly tilted relative to each other. The mutual tilt of the reflective facets 68a-d is chosen such that, when deflected by the beam deflection member 18, the local fields of view 74a-d are provided with a slight divergence, so that the local fields of view 74a-d only partially overlap. Therefore, as in Figure 11a As exemplarily indicated in the text, the individual deflections can also cause the local fields of view 74a-d to cover the entire field of view 72 in two dimensions, i.e., to be arranged to be distributed in two dimensions in the entire field of view 72.

[0100] It should be noted that many of the details described for the multi-aperture imaging device 11 are selected only as examples. For example, this is correct for the number of optical channels mentioned above. The beam deflection member 18 can also be formed differently from what is currently described. For example, the beam deflection member 18 does not have to be reflective. It can also be implemented in a form different from a faceted mirror, such as a transparent prism wedge. In this case, the average beam deflection can be, for example, 0°, i.e., direction 76 can be, for example, parallel to the optical paths 17a-d before any beam deflection or in the absence of any beam deflection, or in other words, the multi-aperture imaging device 11 can still “appear straight ahead” despite the presence of the beam deflection member 18. The individual deflection of the channels of the beam deflection member 18 will again result in the local fields of view 74a-d overlapping each other only slightly, for example, having <10% overlap in pairs with respect to the solid angle regions of the local fields of view 74a-d.

[0101] Furthermore, the optical paths or optical axes may deviate from the described parallelism, and nevertheless, the parallelism of the optical paths of the optical channels can still be evident, so that the local fields of view covered by or imaged to the respective image sensor regions 58a-d by the individual optical channels 16a-N will overlap greatly without other measures (such as beam deflection), so that, in order to cover a larger full field of view by the multi-aperture imaging device 11, the beam deflection member 18 provides an optical path with additional divergence, so that the local fields of view of the N optical channels 16a-N overlap with each other to a lesser extent. The beam deflection member 18 exemplarily provides the full field of view to exhibit an aperture angle larger than 1.5 times the aperture angle of the individual local fields of view of the optical channels 16a-N. Using a pre-divergence of the optical paths 17a-d, it will also be possible that not all facet bevels, for example, are different, but some groups of channels include facets with equal bevels. The latter can be formed integrally or continuously altered to each other, i.e., as a facet associated with this group of channels adjacent in the linear extension direction. The divergence of the optical axes of these channels can then originate from the divergence of these optical axes, such as by lateral offset between the image sensor region of the channel and the optical center of the optics, or by prism structures or off-center lens portions. Pre-divergence can, for example, be confined to a plane. For instance, before and / or without beam deflection, the optical axes may be in a common plane, but in a divergent manner, and the facets only cause additional divergence in other lateral planes, i.e., they are all parallel to the line extension direction and tilted differently relative to each other only with respect to the common plane of the aforementioned optical axes, wherein again, several facets exhibit the same tilt or are associated together with a group of channels whose optical axes are already paired different in the common plane of the aforementioned optical axes, for example, before or without beam deflection.

[0102] When the beam deflection component is omitted or implemented as a plane mirror, the overall divergence can be obtained by the lateral offset between the optical center of one optical device and the center of the image sensor area on the other hand, or by the prism structure or the eccentric lens portion.

[0103] The aforementioned pre-divergence can be achieved, for example, by having the optical center of the optics located on a straight line along the line extension direction, while the center of the image sensor region is arranged to deviate from the projection of the optical center along the normal to the plane of the image sensor region onto a straight line in the image sensor plane, for example, at a point along the line extension direction and / or along a direction perpendicular to the extension direction and the normal to the image sensor, in a channel-specific manner from the point on the straight line in the image sensor plane mentioned above. Alternatively, pre-divergence can be obtained by having the center of the image sensor located on a straight line along the line extension direction, while the center of the optics is arranged to deviate from the projection of the optical center of the image sensor along the normal to the plane of the optical center of the optics onto a straight line in the optical center plane, for example, at a point along the line extension direction and / or along a direction perpendicular to the line extension direction and the normal to the optical center plane, in a channel-specific manner from the point on the straight line in the optical center plane. It is preferable that the channel-specific deviation of the respective projections mentioned above exists only in the line extension direction, i.e., pre-divergence is provided only for the optical axes located in the common plane. The optical center and the image sensor region center are then each located on a straight line parallel to the line extension direction, but at different distances from each other. In contrast, a lateral offset between the lens and the image sensor in a lateral direction perpendicular to the line extension direction results in an increase in the structure height. A purely coplanar offset in the line extension direction does not change the structure height, but the result can be fewer facets and / or facets consisting only of angularly oriented tilts, thus simplifying the setup.

[0104] This is Figure 11d and 11e The example shown illustrates an optical device held on a common support, wherein adjacent optical channels 16a and 16b on one side and adjacent optical channels 16c and 16d on the other side include optical axes 17a and 17b and 17c and 17d located in the same plane and inclined relative to each other (i.e., provided with pre-divergence). Reflective facets 68a and 68b may be formed by facets, and reflective facets 68c and 68d may be formed by another facet, as indicated by the dashed line between their respective facets, with only the two facets inclined in only one direction and both parallel to the direction of line extension. Alternatively, each facet may only include inclination in the spatial direction.

[0105] Additionally, some optical channels can be provided to be associated with the same local field of view, for example, for super-resolution purposes or to increase the resolution used by scanning the local field of view corresponding to these channels. For example, the optical channels in such a group are parallel before the beam is deflected and will be faceted to the local field of view. Preferably, the pixel images of the image sensor for the channels of the group are located at an intermediate position between the pixel images of the image sensor for the other channels of the group.

[0106] For stereoscopic purposes only, not for super-resolution purposes, implementations are conceivable, for example, in which a set of directly adjacent channels in the linear extension direction completely cover the entire field of view using their local field of view, and another set of directly adjacent channels sequentially completely cover the entire field of view, with the optical paths of the two channel sets passing through the substrate or support 66. This means that a multi-aperture imaging device can include a first plurality of optical channels for potentially capturing the entire field of view completely. A second plurality of optical channels of the multi-aperture imaging device can also be used to capture the entire field of view, and potentially completely. Thus, the entire field of view can be captured at least stereoscopically by the first plurality of optical channels and by the second plurality of optical channels. The first plurality of optical channels and the second plurality of optical channels can strike a common image sensor, using a common array (array optics) and / or deflected by a common beam deflection member. Forming a continuous array camera, which is controllable as a whole (e.g., with regard to focusing and / or image stabilization) compared to an array formed by individual cameras, is advantageous because all channels are affected simultaneously and using the same actuators. Furthermore, the advantages arise from the monolithic setup regarding the mechanical stability of the overall arrangement (especially with temperature variations). This is advantageous for synthesizing a full image from sub-images of each channel, and for obtaining 3D object data when using stereo, triple, quadruple, and other systems by scanning the full field of view multiple times from different optical channels (16 times).

[0107] The following discussion relates to optics 64a-d, whose lens planes are also parallel to the common plane of image sensor regions 58a-d. As described below, the lenses of optics 64a-d in the light channels 16a-d are mounted to the main side 66a of substrate 66 using one or more lens holders and are mechanically connected to each other using substrate 66. In particular, the light paths 17a-d of the multiple light channels 16a-d pass through substrate 66. Therefore, substrate 66 is at least partially formed of a transparent material and has a plate shape, or for example, a shape having a parallelepiped or a planar main side 66a and an opposing, also planar, main side 66b. The main side is preferably positioned perpendicular to the light paths 17-d. As will be described below, according to embodiments, deviations from the true hexahedral shape of the lenses of optics implemented as integrated with the substrate may exist.

[0108] exist Figure 11aIn the embodiment of -c, the flat support substrate 66 is, for example, a substrate made of glass or polymer. Exemplarily, the support substrate 66 may include a glass plate. The material of the substrate 66 may be selected based on high light transmittance and a low temperature coefficient or other mechanical properties (such as hardness, elastic modulus, or Poisson's ratio).

[0109] The substrate 66 can be implemented as a simple planar portion of the optical path without any additional lenses directly housed thereon. Additionally, apertures (such as aperture or stray light apertures) and / or filter layers (such as IR blocking filters) can be applied to the substrate surface, or different substrates may include several layers on which apertures and filter layers can be applied, which can be different for each channel, for example in spectral absorption.

[0110] The substrate 66 may include a material having different properties (particularly non-constant absorption) in different regions of an electromagnetic spectrum that can be detected by an image sensor.

[0111] exist Figure 11a In the embodiment of -c, each optics 64a-d includes three lenses. However, the number of lenses can be selected as needed. The number can be one, two, or any other number. Lenses can be convex, comprising only optical imaging functional regions (such as spherical, aspherical, freeform regions) or two regions (such as two opposing regions) to result in, for example, convex and concave lens shapes. For example, by forming lenses from several materials, several light-effective lens regions are also possible.

[0112] exist Figure 11a In embodiment -c, each optical channel 16a-d or the first lens 78a-d of the optics is formed on the main side 66a. For example, the lenses 78a-d have been manufactured by molding on the main side 66a of the substrate 66 and are made of, for example, a polymer (such as a UV-curable polymer). Molding is performed, for example, by a molding tool and curing can be performed, for example, by temperature and / or UV irradiation.

[0113] exist Figure 11aIn the embodiment of -c, each optical device 64a-d includes additional second and third lenses 82a-d and 84a-d, respectively. These lenses are exemplarily fixed relative to each other within their respective lens holders by means of axial tubular lens holders 86a-d, and are fixed to the lens holder at the main side 66, for example, by means of adhesive or other bonding techniques. The aperture 88a-d of the lens holder 86a-d is provided, for example, with a circular cross-section in which lenses 82a-d and 84a-d are mounted. Thus, for each optical device 64a-d, the lenses are coaxially located on their respective optical axes of the optical paths 17a-d. The lens holder 86a-d may also include a cross-section that varies along its length or along its respective optical axis. Here, the cross-section may exhibit increasing rectangular or square characteristics with decreasing distance from the image sensor 12. The external shape of the lens holder can therefore also differ from the shape of the aperture. The material of the lens holder may be light-absorbing. Corresponding to bonding Figure 11d and 11e The tilted optical device described above, the lens retainer can also be implemented as non-rotationally symmetric and / or non-coaxial.

[0114] The installation using the aforementioned lens holders occurs exemplarily so that the lens apex of the supported lenses is separated from the substrate 66.

[0115] As previously mentioned, substrate 66 can be planar on two sides and therefore does not exhibit a refractive force effect. However, substrate 66 may also include mechanical structures (e.g., recesses or protrusions) that allow for simple forward and / or reverse orientation of components, such as connecting individual lens or housing portions. Figure 11a In embodiment -c, on the main side 66b, the substrate 66 may include, for example, structures at the respective ends of the tubes of the lens holders 86a-d that mount the respective optics 64a-d, to facilitate mounting or orientation. These structures may, for example, be circular or differently shaped recesses that engage on the sides of the respective lens holders 86a-d, corresponding to the shape of the sides of the respective lens holders facing the substrate. It should be noted again that different aperture profiles, and therefore lens apertures that may correspond to circular apertures, are possible.

[0116] therefore, Figure 11a The embodiment of -c retains the classic structure of the camera module, which includes individual lenses and a transparent housing support that completely surrounds them to support the individual lenses. The above embodiment uses a transparent body 66 as a substrate support. It extends over several adjacent optical channels 16a-d so as not to be penetrated by the imaging optical path of the optical channels. It does not interfere with imaging and does not increase the structural height.

[0117] However, it was pointed out Figure 11a-c The embodiments can be modified in various ways. Exemplarily, substrate 66 does not necessarily have to extend over all channels 66a-d of the multi-aperture imaging device 11. Compared to what has already been described, each optic 64a-d may include lenses held on two sides 66a and 66b via lens supports, such as... Figure 11f As shown.

[0118] The presence of only lenses 82e-h on the main side 66a, i.e., without lenses 82a-d and / or 84a-d on the other side 66b, is also possible, because lenses 82a-d and / or 84a-d are provided on the other side 66a (i.e., the side facing away from the substrate 66 of the image sensor 12, not the side facing the image sensor 12, i.e., 66a). Furthermore, the number of lenses in the lens supports 86a-d can be selected as needed. Therefore, such supports 86a-h can contain only one lens or can provide more than two lenses. Figure 11f As shown, the lenses can be mounted on the two sides 66a and 66b respectively via their respective lens supports 86a-d and 86e-h on their respective sides 66a and 66b.

[0119] Figure 12 Exemplary Figure 11a -c multi-aperture imaging devices can be supplemented by one or more additional components described below.

[0120] Figure 12 An exemplary embodiment is shown, comprising a component 91 for rotating the beam deflection member 18 about a rotation axis 44 parallel to the linear extension direction of array 14. The rotation axis 44 is, for example, located in the plane of optical paths 17a-d or separated from them by a distance less than one-quarter the diameter of the optics 64a-d. Alternatively, the rotation axis may, for example, be located away from, for example, by a distance less than the diameter of the optics or less than four optics diameters. For example, a component 92 may be provided to rotate the beam deflection member 18 with a short response time only within a small angular range (e.g., within a span of less than 1°, less than 10°, or less than 20°) to compensate for, for example, the shaking of the multi-aperture imaging device 11 during photography. In this case, component 92 would be driven, for example, by an image stabilization controller.

[0121] Alternatively or additionally, component 92 can be used to change the orientation of the local field of view 74a-d by a larger angle. Figure 11a The full field of view is defined by the full coverage of the multi-aperture imaging device 11. Therefore, deflection can be achieved by rotating the beam deflection member 18, wherein the full field of view is arranged in opposite directions relative to the multi-aperture imaging device 11, for example by implementing the beam deflection member 18 as a mirror array that is reflective on both sides.

[0122] Alternatively or additionally, the multi-aperture imaging device 11 may include a component 94 for moving optics 64a-d by means of substrate 66 or for moving substrate 66 itself and thus moving optics 64a-d in a translational manner along the line extension direction. Component 94 may also be driven, for example, by the aforementioned image stabilization controller to achieve lateral image stabilization with image stabilization achieved by a rotating mirror deflection device that moves 96 along the line extension direction.

[0123] Alternatively or additionally, the multi-aperture imaging device 11 may include a component 98 for adjusting the depth of field by changing the image-side distance between the image sensor 12 and the optics 64a-d or between the image sensor 12 and the support 66. The component 98 may be driven by manual user control, automatic focus control, or the focusing component of the multi-aperture imaging device 11.

[0124] Component 94 is therefore used to suspend the substrate 66 and, as Figure 12 The components indicated herein are preferably arranged laterally adjacent to the substrate 66 along the line extension direction to avoid increasing the structural height. This also applies to components 92 and 98 below: they are preferably arranged in the plane of the optical path to avoid increasing the structural height. Component 98 may also be connected to the beam deflection component 18 and move the beam deflection component 18 simultaneously or nearly simultaneously so that the distance between the optics 64a-d and the beam deflection component 18 remains substantially constant or constant when the image-side distance between the image sensor 12 and the optics 64a-d is changed. Components 94, 92, and / or 98 may be implemented based on pneumatic, hydraulic, piezoelectric actuators, DC motors, stepper motors, thermal actuators, electrostatic actuators, electrostrictive and / or magnetostrictive actuators or drives.

[0125] It is noted that the optics 64a-d can be held in a constant relative position not only, for example, using the aforementioned transparent substrates, but also, for example, using a suitable frame relative to the beam deflection member. This suitable frame preferably does not increase the structural height and is therefore preferably located in the plane of components 12, 14, and 18 or in the plane of the optical path. The stability of the relative position can be limited to the distance along the optical axis between the optics and the beam deflection member, such that component 98 can, for example, move the optics 64a-d in a translational manner along the optical axis in conjunction with the beam deflection member. The distance from the optics to the beam deflection member can also be set to a minimum so that the optical path of the channel is not laterally restricted by a portion of the beam deflection member 18, thereby reducing the structural height. This is because portions 68a-d would otherwise have to be sized with respect to the lateral extension for the maximum distance from the optics to the beam deflection member to avoid intersecting the optical path. Additionally, the stability of the relative positions of the aforementioned frames can rigidly maintain the optics and beam deflection components relative to each other along the x-axis, so that component 94 can move the optics 64a-d and the beam deflection components in a translational manner along the line extension direction.

[0126] The beam deflecting member 18 described above for deflecting the optical path, combined with the actuator 92 for generating the rotational movement of the beam deflecting member 18 in the optical image stabilization controller of the multi-aperture imaging device 11, allows for image or full-field-of-view stabilization in two dimensions, i.e., image stabilization along a first image axis substantially parallel to the line extension direction, achieved by translational movement of the substrate 66, and image stabilization along a second image axis, achieved by generating the rotational movement of the beam deflecting member 18, which is substantially parallel to the optical axis before or without beam deflection, or perpendicular to the optical axis and line extension direction when considering the deflected optical axis. Furthermore, the described arrangement can, for example, cause translational movement of the beam deflecting member and array 14 fixed in the aforementioned frame perpendicular to the line extension direction by the actuator described, which can be used to achieve focus adjustment and thus autofocus functionality.

[0127] Alternatively, or in addition to rotational movement for achieving image stabilization along the second image axis, translational relative movement between the image sensor 12 and the array 14 may be implemented. This relative movement may be provided, for example, by component 94 and / or component 98.

[0128] For the sake of completeness, it should still be noted regarding the above discussion that, during image capture, the device captures an image of the scene across each channel of the image sensor area (through which the channel has already been imaged onto the image sensor area), and the device may optionally include a processor that merges or fuses the images to form a full image corresponding to the scene in the full field of view and / or provides additional data, such as 3D image data and depth information of the object scene for generating a depth map, as well as data for software implementation, such as refocusing (determining the area of ​​sharpness after the actual image capture), a fully focused image, a virtual green screen (separation of foreground and background), etc. The latter task can also be performed by any processor or externally. However, the processor can also be a component external to the multi-aperture imaging device.

[0129] Figure 13a The multi-aperture imaging device 11, illustrating the aforementioned alternative example, can be mounted, for example, in a flat housing of a portable device 130 (such as a mobile phone, smartphone, or media player), wherein, in this case, the plane of the image sensor 12 or the image sensor region and the lens plane of the optics of the light channel 16 are oriented perpendicular to the flat extension direction of the flat housing or parallel to the thickness direction. In this way, the beam deflection member 18 will, for example, provide the full field of view of the multi-aperture imaging device 11 in front of the front side 12 of the flat housing, which, for example, also includes a screen. Alternatively, such deflection will also be possible: the field of view is located in front of the back side of the flat housing opposite the front side 12. The housing 22 of the device 130 or the device itself can be flat because the structural height of the multi-aperture imaging device 11, which is parallel to the thickness of the housing, can be kept small by the illustrated position of the multi-aperture imaging device 11 within the housing. Switchability can also be provided, for example, by providing a window on the side opposite to side 102 and by moving the beam deflecting member between two positions, such as when the beam deflecting member is implemented as a mirror that is specularly reflective on both the front and back sides and is rotated from one position to another, or when it is implemented as a faceted mirror having one set of facets for one position and another set of facets for another position, wherein the facet sets are adjacent to each other in the linear extension direction, and switching between positions occurs by moving the beam deflecting member back and forth in a translational manner along the linear extension direction. It is also certainly possible to mount the multi-aperture imaging device 11 into another device that may not be portable (e.g., a car).

[0130] The local field of view of its channel completely or optionally, or even overlappingly, covers several modules 11 of the same field of view, which can be at a basic distance BA that is equal to each other along the line extension direction (compared to) Figure 7The multi-aperture imaging device 11 is installed in the apparatus 130, for example, for stereoscopic purposes. More than two modules are also possible. The line extension directions of the modules 11 can be non-collinear, but only parallel to each other. However, it should be mentioned again that, as previously mentioned, the multi-aperture imaging device 11 or modules can also be equipped with channels so that they can each group completely cover the same full field of view. The modules can be arranged as one / several lines / rows or at any location in the apparatus. In an arrangement with several modules, these can be formed as equal or different. Exemplarily, a first module can be used to perform full-field stereo capture. A second module can be used to perform simple capture, stereo capture, or higher-order capture.

[0131] It should still be mentioned that in alternative embodiments equivalent to the embodiments described above, the beam deflection component may also be omitted. This can be achieved, for example, by a mutual lateral offset between the center of the image sensor region and the optical center of the corresponding channel's optics when only partial overlap of the local field of view is required. However, despite this, it is possible to apply according to... Figure 12 The actuator, in which, as a replacement for component 92, actuator 94 may, for example, additionally be able to perform translational movement of the optical device or support 66.

[0132] In other words, the above embodiments illustrate a multi-aperture imaging device with a single-line array of optical channels arranged adjacent to each other, wherein a substrate, for example made of glass or polymer and extending along the channel for enhancing stability, is located at any desired position in the optical path of the multi-aperture imaging device. The substrate may additionally include lenses on the front and / or back sides. The lenses may be made from the material of the substrate (e.g., formed by thermoforming) or molded thereon. Other lenses may also be present in front of and behind the substrate, not located on the substrate and mounted separately. Several substrates may be present in the arrangement along the line extension direction and perpendicular to the line extension direction. Thus, several substrates may also be connected in series with lenses along the optical path, i.e., additionally held in a predetermined positional relationship one after another using a frame (without needing to be joined). In this way, more than twice the number of main sides of the support substrate used will be available for providing or mounting lenses, for example according to the example above (exemplarily according to...). Figure 11bThe substrate 66 can be equipped with lenses, and according to the example above, it can also be equipped with lenses, i.e., lenses mounted to the main sides 66a and / or 66b via lens holders. However, this is exemplarily shown here as being integrally manufactured, for example by injection molding, so that the lenses are formed on the sides 66a and 66b. Of course, molded lenses made of materials different from the parallelepiped substrate 66 will be possible, such as lenses on only one of the sides 66a and 66b. Both substrates are transparent and are penetrated by the light path through the main sides 66a and 66b. The above embodiments can therefore be implemented as multi-aperture imaging devices with a single-channel arrangement, wherein each channel transmits a partial field of view of the full field of view and the partial fields of view partially overlap. It is possible to set up several such multi-aperture imaging devices for stereo, triple, quadruple, etc. configurations for 3D image capture. Therefore, multiple modules can be implemented as a continuous line. Continuous lines can use the same actuators and common beam deflection elements. One or more mechanically reinforced substrates may exist in the optical path, extending along the entire line, and may form a three-dimensional, triple, or quadruple configuration. A super-resolution approach can be employed, where multiple optical channels image the same local field of view. The optical axis may already be diverged without beam deflection components, so that fewer facets are required on the beam deflection unit. In this case, the facets advantageously include only a single angular element. The image sensor may consist of only one sheet, comprising only a continuous pixel matrix or several discontinuous pixel matrices. The image sensor may be configured by, for example, a plurality of partial sensors arranged adjacent to each other on a printed circuit board. The autofocus drive of the focusing component can be implemented such that the beam deflection element moves synchronously with the optics, or remains stationary. When pre-divergence is absent, the embodiment provides that the optical path between the image sensor 12 and the beam deflection component 18 is substantially or completely parallel.

[0133] Figure 13bA schematic arrangement including a first multiaperture imaging device 11a and a second multiaperture imaging device 11b, which may be arranged in device 130, is shown. The two multiaperture imaging devices 11a and 11b may form a common multiaperture imaging device 11 and include a common image sensor 12 and / or a common array 14. Single-line arrays 14a and 14b exemplarily form common lines in the common array 14. Image sensors 12a and 12b may form a common image sensor 12 and may be mounted, for example, on a common substrate or a common circuit support (such as a common board or a common flexible board). Alternatively, image sensors 12a and 12b may also include different substrates. Different combinations of these alternatives are of course possible, such as multiaperture imaging devices including a common image sensor, a common array, and / or a common beam deflection member 18, as well as other multiaperture imaging devices including individual components. The advantage of having a common image sensor, a common single-line array, and / or a common beam deflection member is that the movement of the respective components can be achieved with high precision by driving a small number of actuators, and synchronization between actuators can be reduced or avoided. Furthermore, high thermal stability can be achieved. Alternatively or additionally, other multiaperture imaging devices may include a common array, a common image sensor, and / or a common beam deflection member. The arrangement of multiaperture imaging device 11 can, for example, be used to stereo capture the full or local field of view when the optical channels of different partial multiaperture imaging devices 11a and 11b are pointed onto the same local field of view. Similarly, other multiaperture imaging devices can be integrated into a common multiaperture imaging device so that higher-order capture compared to stereo is possible.

[0134] Figure 14 A 3D multi-aperture imaging device 140, which can be used according to the embodiments described herein, is shown. It has, for example... Figure 14 The image sensor indicated herein can be divided into two components 121 and 122 (i.e., one component 121 for the "right" optical channel 161 and another component 122 for the "left" optical channel 162). Figure 14 In the example, the right and left optical channels 161 and 162 have the same configuration, but are laterally offset from each other by a basic distance BA to obtain as much depth information as possible about the scene present in the field of view of device 140. Exemplarily, the 3D multi-aperture imaging device may be formed by two or more multi-aperture imaging devices 11. The element provided with index 1 at a first position from the left therefore belongs to the first component 1 or first module (module 1) of device 140 for the right channel, and the element provided with index 2 at a first position from the left therefore belongs to the second component 2 or second module (module 2) of device 140 for the left channel. Although in Figure 14 The number of modules is 2, but the device may also include more modules arranged at their respective basic distances from each other.

[0135] exist Figure 14 In the exemplary case, each plurality of optical channels 161 and 162 comprises four optical channels arranged adjacent to each other. Individual "right" channels are distinguished from each other by a second subscript index. Channels are indexed from right to left. This means that optical channel 16... 11 (Due to the need for clarity, only a partial sectional view was selected.) Figure 14 (Not shown) is exemplarily arranged at the rightmost edge along the basic distance direction 108 (along which the left and right channels are arranged to be offset from each other by a basic distance BA), i.e., furthest from the plurality of 162 left channels, of which the other 16... 12 Up to 16 14 Follow along the basic distance direction 108. Channel 16 11 Up to 16 14 Therefore, the optical channels of a single-line array are formed, with their line extension directions corresponding to the basic distance direction 108. The left channel 162 shows the same setup. They are also distinguished from each other by their second subscript index. Left channel 16 21 Up to 16 24 Arranged adjacent to each other and following one another in the same direction, such as right aisle 16. 11 and 16 14 Similarly, this method enables channel 16 21 Closest to the right passage and passage 16 24 The furthest from the right passage.

[0136] Right Aisle 16 11 Up to 16 14 Each includes a corresponding optical component, such as... Figure 14 The light channel is indicated by a lens system. Alternatively, each channel may include a lens. Each optical channel has 16 lenses. 11 Up to 16 14 Capture one of the overlapping local fields of view 74a-d of the full field of view 72, as combined Figure 11a As described. Channel 16 11 For example, the local field of view is 74. 11 Imaging or projection onto image sensor area 58 11 Above, optical channel 16 12 Local field of view 74 12 Imaging to image sensor area 58 12 Above, optical channel 16 13 Associated local field of view 74 13 Image is projected onto the corresponding image sensor area 58 of image sensor 12. 13 (exist Figure 14 (Invisible in the middle) and optical channel 16 14 Associated local field of view 7414 Imaged onto the corresponding image sensor area 58 14 (Because it is hidden and not in) Figure 14 (As shown in the image)

[0137] exist Figure 14 In the image sensor 12, the image sensor area 58 11 Up to 58 14 The components 121 of the image sensor 12 are arranged in a plane parallel to the fundamental distance direction BA or parallel to the line extension direction 108, wherein the optical channel 16 11 Up to 16 14 The lens plane of the optical device is also parallel to this plane. Furthermore, the image sensor area 58... 11 Up to 58 14 They are arranged with a lateral channel spacing of 110, and have 16 optical channels. 11 Up to 16 14 They are also arranged in the direction at that distance from each other so that the light channels 16 11 Up to 16 14 The optical axis and optical path are in the image sensor area 58 11 Up to 58 14 and optical components 16 11 Up to 16 14 They are parallel to each other. For example, image sensor region 58 11 Up to 58 14 Center and optical channel 16 11 Up to 16 14 The optical center of the optical device is arranged perpendicular to the previously mentioned image sensor region 58. 11 Up to 58 14 On their respective optical axes in the common plane.

[0138] Optical Channel 16 11 Up to 16 14 The optical axis or optical path is deflected by the beam deflection member 181, and is thus provided with a path leading to the optical channel 16. 11 Up to 16 14 Local field of view 74 11 -74 14 Divergence that only partially overlaps with each other, for example, to provide a local field of view 74 11 -74 14 They overlap in pairs with a maximum of 50% in the sense of solid angle. The beam deflection member 181 can be as follows: Figure 14 The instructions indicate that 16 are used for each optical channel. 11 Up to 16 14 The reflective facets, these reflective facets in channel 16 11 Up to 16 14They are tilted relative to each other in different ways. The average tilt of the reflective surface relative to the image sensor plane will affect the right channel 16. 11 Up to 16 14 The entire field of view is deflected, for example, in a direction perpendicular to the plane (in which optical channel 16) 11 Up to 16 14 The optical axis of the optics passes through the beam deflection member 181 before or without beam deflection, or deviates from this vertical direction by less than 10°. Alternatively, the beam deflection member 181 may also use a prism for the optical channel 16. 11 Up to 16 14 The deflection of the beam along each optical axis or optical path.

[0139] Beam deflection component 181 is optical channel 16 11 Up to 16 14 The optical path provides divergence so that channels 16 are arranged virtually linearly adjacent to each other in direction 108. 11 Up to 16 14 Two-dimensional ground coverage of the entire field of view 72.

[0140] It should be noted that the optical path or optical axis may deviate from the described parallelism, but the parallelism of the optical path of the optical channel can still be significant so that it can be obtained from the individual channels 16 11 Up to 16 14 Covered or projected onto their respective image sensor areas 58 11 Up to 58 14 The local field of view on the beam will overlap significantly without other measures (such as beam deflection). In order to cover a larger full field of view through the multi-aperture imaging device 140, the beam deflection member 18 provides additional divergence to the optical path, so that channel 16 11 Up to 16 14 The local fields of view overlap with each other to a small extent. The beam deflection member 181 exemplarily provides a full field of view including an aperture angle averaged over all azimuth angles or all lateral directions, the aperture angle being greater than that of the optical channel 16. 11 Up to 16 14 The corresponding average aperture angle of the local field of view is 1.5 times larger.

[0141] Left Aisle 16 21 Up to 16 24 Set to be the same as right channel 16 11 Up to 16 14 The same, and relative to their respective associated image sensor regions 58 21 Up to 58 24 It was located, including optical channel 16. 21 Up to 16 24 In and in channel 16 11 Up to 16 14The optical axes that pass parallel to each other in the same plane are deflected by the corresponding beam deflection member 182 so that the optical channel 16 21 Up to 16 24 The same full field of view 72 is captured in an almost superimposed manner, that is, in the local field of view 74 into which the full field of view 72 is divided in two dimensions. 21 and 74 24 In the middle, the local field of view is 74. 21 and 74 24 They overlap each other, and each of them is almost completely connected to the right channel 16. 11 Up to 16 14 The corresponding local field of view of the corresponding channel 74 11 Up to 74 14 Overlap. For example, a local field of view 74. 11 and local field of view 74 21 Almost completely overlapping, local field of view 74 12 and 74 22 Same here. Image sensor area 58 11 Up to 58 24 It can be formed, for example, from individual chips, such as Figure 11a -f describes the image sensor 12.

[0142] In addition to the components mentioned above, the 3D multi-aperture imaging device includes a processor 112, which has the function of merging data already transmitted by the 3D multi-aperture imaging device 10 through the right optical channel 16. 11 Up to 16 14 The task is to capture images to form the first full image. The problems to be solved are as follows: due to the right channel 16... 11 Up to 16 14 The inter-channel distance between adjacent channels is 110, in image region 58. 11 Up to 58 14 via channel 16 11 Up to 16 14 The captured images cannot be simply offset relative to each other or translated, nor can one be placed on top of another. In other words, they cannot be simply combined. When capturing the same scene, corresponding images located in different image sensor regions 58 11 Up to 58 14 This lateral offset along direction B, 108, or 110 in the image is called the difference. The difference between corresponding image contents, in turn, depends on the distance of the image contents in the scene, i.e., the distance of the corresponding object from device 140. Processor 112 can now attempt to evaluate the image sensor region 58 itself. 11 Up to 58 14The differences between the images are used to merge these images to form a first full image, namely the "right full image". However, a disadvantage is that there is an inter-channel distance 110, which thus exacerbates the problem. On the other hand, the inter-channel distance 110 is relatively small so that the depth resolution or estimation is simply inaccurate. Therefore, attempts are made, for example, by means of correlation, to determine the overlapping region between the two images (e.g., image sensor region 58). 11 Up to 58 14 It is difficult to find the corresponding image content in the overlapping areas (114) between the images.

[0143] therefore, Figure 14 The processor, in a local field of view of 74 11 and 74 12 The overlapping region 114 between the two images uses the differences in the paired images for merging, one of which has already been merged by the left channel 16. 21 Or 16 22 One capture, left channel 16 21 Or 16 22 The second local field of view of the imaging (i.e., 74) 21 Or 74 22 The overlapping regions 114 are used. For example, to merge image sensor regions 58... 11 Up to 58 12 The image, processor 112 evaluates the image (one of which has been evaluated by image sensor area 58). 21 Or 58 22 One capture is made by one of the channels that contribute to the overlapping region 114, namely by the image sensor region 58. 11 Or 58 12 The differences in one captured image. Such a pair will then include the basic distance BA plus / minus one of the channel basic distances 110 or not plus / minus the basic distance of the channel basic distance 110. The later basic distance is much larger than the individual channel basic distances 110, which is why differences in the overlapping region are more easily determined by the processor 112. Therefore, in order to merge the image of the right channel, the processor 112 evaluates the differences between one of the right channel and one of the left channel images caused by the image of the left channel, preferably non-exclusively.

[0144] More specifically, the processor 112 may also more or less directly access the image 58. 11 Take over the local field of view that does not overlap with any other local field of view in the right channel 74 11 Part of it, and based on image sensor region 58 12 Up to 58 14 The image, for a local field of view of 74 12 74 13and 74 14 The same operation is performed in the non-overlapping regions, where the image sensor region 58 11 Up to 58 14 Images may have already been captured simultaneously. Only in adjacent local fields of view (e.g., local field of view 74) 11 and 74 12 In the overlapping region of the image pairs, the processor 112 uses the difference from the image pairs. The overlap of the image pairs is in the overlapping region in the full field of view 74, but mainly but not exclusively, one of the image pairs has been captured by one of the right channels and the other by one of the left channels (e.g., again at the same time).

[0145] However, according to an alternative process, processor 112 can also bend the entire image of the right channel based on an evaluation of the difference between a pair of images, one of which has been captured by the right channel and the other by the left channel. Therefore, for the image of the right channel, the full image calculated by processor 112 can, for example, be not only in the local field of view 74 of the right channel. 11 Up to 74 14 The overlapping regions are virtually "bent," also for example, by the processor 85 through non-overlapping local fields of view 74. 11 Up to 74 14 These regional assessments, derived from the differences between image pairs (one image captured by one of the right channels and the other by one of the left channels), are also virtually "bent" laterally to the right channel in non-overlapping regions. 11 Up to 16 14 From the viewpoint at the center between them.

[0146] Figure 14 The 3D multi-aperture imaging device 140 is not only capable of generating a full image from the image in the right channel, but also Figure 14 The 3D multi-aperture imaging device 140 is also capable, in at least one operating mode, of generating a full image of the left channel in addition to the full image of the first channel and / or generating a depth map in addition to the full image of the right channel from the captured images.

[0147] According to the first alternative example, processor 112 is used, for example, to merge the signals generated by the left optical channel 16. 21 Up to 16 24 or image sensor area 58 21 Up to 58 24 The captured image is used to form a second full image (i.e., the full image of the left channel), and within the local field of view 74 of the left light channel. 21 Up to 74 24 In the overlapping regions of the lateral adjacent local fields of view, paired images are used (primarily but not exclusively, one of which has been generated by the right optical channel 16). 11Up to 16 14 Capture and pair local fields of view 74 21 Up to 74 24 The corresponding overlapping areas overlap, and another has preferably been captured by one of the left light channels, with the local field of view overlapping with the corresponding overlapping area) in the difference.

[0148] According to the first alternative example, processor 112 outputs two full images for a captured picture, namely one in the right light channel and the other in the left light channel. These two full images can be supplied to the user's eye separately, thus resulting in a three-dimensional impression of the captured scene.

[0149] According to another alternative example mentioned above, in addition to the full image of the right channel, processor 112 uses paired images (at least for the right channel 16). 11 Up to 16 14 Each of the following methods (including at least one pair of images) generates a depth map by the differences in the images captured by the corresponding right channel and another image captured by one of the left channels.

[0150] In embodiments where the processor 112 generates the depth map, the aforementioned bending can also be applied to the entire image captured by the right channel based on the depth map. Since the depth map includes depth information across the entire field of view 72, the entire image captured by the right channel (not only in its overlapping regions but also in non-overlapping regions) can be bent to a virtual common aperture point or virtual optical center.

[0151] Two alternative examples can also be processed by processor 112: First, two full images can be generated, namely, as already described, one full image of the right optical channel and another full image of the left optical channel, by using the difference from the paired images (one of which belongs to the left channel) when merging the right channel images in the overlapping region between the right channel images, and by using the difference from the paired images (one of which belongs to the right channel) when merging the left channel images in the overlapping region between the left channel images, so that a full image including a matching depth map is then generated from the full images representing the scene in the full field of view at different perspectives, such as the full image located between (but possibly non-exclusively, at the center) the optical centers of the optics in the right and left optical channels relative to the virtual vision or virtual optical center. To calculate the depth map and to bend one of the two full images or to bend and merge the two full images into the virtual vision, processor 85 then uses the right and left full images, arguably as intermediate results resulting from the previous merging of the respective left and right images. Thus, the processor here evaluates the difference in the two intermediate full images to obtain the depth map and performs its bending or bending / merging.

[0152] It should be mentioned that the processor 112 evaluates the differences in pairs of images by means of, for example, cross-correlation of image regions.

[0153] It should be mentioned that, through the different coverage of the full field of view 72 of the local field of view of the left channel on the one hand and the local field of view of the right channel on the other hand, more than four passbands can also overlap each other (regardless of whether they belong to the left or right channel), for example, in the case of mutual overlap between overlapping areas of the local fields of view (adjacent in the line direction or column direction) with the example above, wherein the local fields of view of the right channel and the local fields of view of the left channel are respectively arranged in columns and rows. This is typically applied to the number of sources of difference, where N limits the number of local fields of view that overlap with each other.

[0154] In addition to the above description, it should be mentioned that the processor 112 may also optionally perform channel-by-channel correction of perspective imaging errors for each channel.

[0155] It should be pointed out that, Figure 14 The embodiments described are merely exemplary in many respects. For example, this applies to the number of optical channels. Exemplarily, the number of right optical channels is not 4, but any number greater than 2 or between 2 and 10 (inclusive), and when considering each local field of view or each channel paired with its respective local field of view with maximum overlap, for all these pairs, in terms of the area of ​​interest, the overlapping area of ​​the local field of view of the right optical channel can be defined by image region 58. 11 Up to 58 14 The average image size of the captured image (e.g., measured in the image plane, i.e., the plane of the image sensor region) is between 1 / 2 and 1 / 1000. For example, the same applies to the left channel. However, the number of right and left channels can be different. This means that the number N of the left optical channels... L And the number of right optical channels N R They do not have to be equal, and the local field of view divided into the left channel and the local field of view divided into the right channel of the full field of view do not have to be as... Figure 14 The situation is approximately equal. Regarding the local field of view and its overlap, if we consider an image distance or object distance of 10m, at least for all pairs with maximum overlap, the local field of view can protrude from each other by, for example, at least 20 pixels, where this can be applied to the right and left channels.

[0156] Compared to what has been discussed above, it is additionally not required that the left and right channels be formed as single lines. The left and / or right channels can also form the optical channels of a two-dimensional array. Furthermore, a single-line array does not necessarily include collinear line extension directions. However, Figure 14The arrangement is advantageous because it results in a minimum structural height of the plane to which the optical axis perpendicular to the optical channels (i.e., both the right and left channels) points before or without beam deflection. Regarding image sensor 12, it has already been mentioned that it can be formed from one, two, or several chips. Exemplarily, there are chips for each image sensor region 58. 11 Up to 58 14 and 58 21 Up to 58 24 A chip is provided, wherein in the case of several chips, these chips can be mounted on one or more boards, for example, one board for the left channel or left-channel image sensor, and one board for the right channel image sensor.

[0157] exist Figure 14 In one embodiment, it is also possible to place adjacent channels as densely as possible within the right or left channel, where the channel distance 110 corresponds optimally to the lens diameter. The result here is a small channel distance and therefore low difference. On the one hand, the right channel and on the other hand, the left channel can be arranged relative to each other at any distance BA to achieve a large difference. In summary, artifact reduction or artifact-free image fusion and depth map formation using a passive optical imaging system become possible.

[0158] Compared to the embodiment above, it would be possible to use more than two groups of channels 161 and 162. The number of groups can be represented by N. If, in this case, the number of channels in each group is equal, and the division from full field of view to local field of view is equal for all groups, for example, generating a local field of view for each overlapping region of group 161. The differences in the number of channels are due to various sources. However, for groups of channels, different divisions of the entire field of view are also possible, as mentioned above.

[0159] Finally, it should be noted that the above description has only discussed an exemplary case in which the processor 112 fuses the image of the right channel. The same process (as mentioned above) can be performed by the processor 112 for two or all channel groups, or also for the left channel, etc.

[0160] Figure 15a An embodiment of a multi-aperture imaging device 150 is shown. Preferably, image sensors 58a to d are arranged in a common plane (i.e., the image plane of the optical channel 16 or its optics). Figure 15a In this context, this plane is, for example, in the Cartesian coordinate system (for simplicity, the following description is in...). Figure 15a The z-axis and y-axis, indicated and provided by reference numeral 115, span a plane parallel to each other.

[0161] Utilizing a linear array of optical channels, as downwardly constrained by image sensor 12 and optics 64, the extension of the multi-aperture imaging device 150 along the linear extension direction is greater than the diameter of the lens. While the minimum extension of the multi-aperture imaging device 150, determined by the mutual arrangement of image sensor 12 and optics 64 along the z-axis (i.e., along the optical axis or optical path of optical channels 16a to d), is less than the minimum extension along the z-axis, it is greater than the minimum extension of the multi-aperture imaging device in the lateral direction y, perpendicular to the linear extension direction z, due to the implementation of optical channels 16a to d as a single linear array. The latter is determined by the lateral extension of each individual optical channel 16a to d (e.g., the extension of optics 64a to d (possibly including support 66) along the y-axis).

[0162] As described above, in Figure 15a In embodiments, before or without deflection by the beam deflection member 18 or at the optics 64a to d, the optical axes 17a to d are, for example, parallel to each other, such as... Figure 15a As shown, or they are only slightly offset. The corresponding centering of the optics 64a to d and the image sensor regions 58a to d is easy to manufacture and suitable for minimizing the structural space. The parallelism of the optical paths of the optical channels also causes the local fields of view of the images of each image sensor region 58a to d, covered by the respective channels 16a to d, to overlap almost completely without other measures (such as beam deflection). In order to cover a larger full field of view by the multi-aperture imaging device 150, another function of the beam deflection member 18 is to provide divergence to the optical path so that the local fields of view of the channels 16a to d overlap with each other to a smaller extent.

[0163] Suppose, for example, before the beam deflection member 18 or without the beam deflection member 18, the optical axes 17a to d of the optical paths of optical channels 16a to d are parallel to each other or deviate by less than one-tenth of the minimum aperture angle relative to the parallel orientation averaged for all channels in the local field of view of optical channels 16a to d. Without additional measures, the local fields of view will largely overlap. Figure 15a The beam deflection member 18 therefore includes reflective facets 68a to d clearly associated with each optical channel 16a to d, each reflective facet 68a to d being optically planar and inclined relative to each other, so that the local fields of view of the optical channels overlap to a small extent with respect to the solid angle, and cover, for example, the entire field of view including the aperture angle, which is, for example, larger than 1.5 times the aperture angle of the respective local fields of view of the optical channels 16a to d. Figure 15a In an exemplary case, the mutual tilt of the reflective facets 68a to d provides, for example, optical channels 16a to d that are actually arranged linearly adjacent to each other along the z-axis to cover the entire field of view 72 according to the two-dimensional arrangement of the local fields of view 74a to d.

[0164] When in Figure 15a In the embodiment, the optical axes 17a to d of the optical channels 16a to d are considered to be in a plane spanned by the average direction of the optical axis before beam deflection and the average direction of the optical axis after beam deflection (i.e., in... Figure 15a In the example, in the zy plane) and on the other hand, in the plane perpendicular to the last mentioned plane and parallel to the average direction of the optical axis after beam deflection, angular deflection, Figure 15a The example corresponds to an exemplary case where the average direction of the beam after deflection corresponds to the y-axis. On average, the optical path of the optical channel is deflected 90° about the z-axis in the yz plane, and the optical axis is not tilted from the yz plane on average.

[0165] For example, This refers to the tilt angle of the reflection surface 68a relative to the xz plane, measured in the xy plane, that is, the tilt of the reflection surface 68a about the z-axis relative to the xz plane in which the optical axis 17a to d is located. This corresponds to the orientation of the reflection surface 68a, which is parallel to the xz plane. Therefore, applying... Accordingly, The reflection plane 68a, defined by measurement along the z-axis, is tilted relative to the xz plane. And the tilt angle of the plane parallel to the z-direction. Accordingly, the following applies: The same constraint applies to other channels: For each optical channel, the setting angle can be greater than the tilt angle of the reflective facet associated with this channel relative to the angle of the support substrate through which the optical channel passes. Here, the support substrate can be positioned parallel to the line extension direction of array 14, and the setting angle can be in a plane perpendicular to the line extension direction.

[0166] Figures 15b to 15e A side view of a beam deflection member according to an embodiment is shown for four exemplary optical channels arranged linearly or in a single line. Figures 15b to 15e The beam deflection component can be used as Figure 11a The beam deflection device, however, in this case, the local field of view is not clockwise 3, 4, 2, 1 (as shown in the diagram). Figure 11a (As shown) Instead, it covers the entire field of view in a clockwise direction in the order of 4, 2, 1, 3. The tilt angles of the reflecting surfaces 68a to d are... Figure 15b As shown in e. They are distinguished from each other by subscript indices 1 to 4 and are associated with their respective channels. 0° Similarly, the back side of the support substrate (i.e., the side opposite to the surface provided with facets 68a to d) is... Figures 15b to 15eThe material forming the parallelepiped shape of the support substrate 123 is located below the dashed line 125. It can be seen that the added material comprises a small volume, making molding easy.

[0167] The support substrate 123 is positioned relative to the image sensor 12 to set an angle. Inclination, that is, the axis on which the average direction of deflection about the optical axis of the optical channel is based, i.e., in Figure 15a The z-axis in the image sensor 12. This setting angle provides the surface of the beam deflection member 18 facing the image sensor 12, thereby causing a “coarse deflection” of the optical path of the optical channel.

[0168] For the deflection angle of the optical path of each optical channel deflected by the beam deflection member 18, this means that these are each based on the setting angle. And based on the respective tilts of the reflective facets associated with the optical channel relative to the support substrate 123. The individual tilts of these facets 68a-d, as just described, are described by the tilt angle in the xy plane and the tilt angle relative to the normal of the support substrate 123 in the plane perpendicular to the support substrate 123. Preferably, when for each angle, an angle is set... Greater than the tilt, meaning for all channels. When on or even When the aforementioned inequality is already satisfied, it is even more preferred. In other words, it is preferred that the setting angle is so large relative to the tilt angle of the reflecting facets 68a-d that the additional material is less compared to a beam deflector member with a pure parallelepiped shape. For example, it can be between 30° and 60° (inclusive).

[0169] manufacture Figure 15b The beam deflection member 18 of -e can be completed, for example, by molding additional material onto a support substrate 123 using a molding tool. The support substrate 123 can here be, for example, glass, and the additional material molded thereon is a polymer. For Figure 15b Another possibility for the beam deflection member 18 of -e is that it will be integrally formed by injection molding or the like. The result here is that the surface of the beam deflection member facing the image sensor is mirror-like, at least at the reflective facets associated with the light channel. The support substrate can be supported and rotatably rotated, such as by, for example, combining... Figure 4b As described.

[0170] For example, some aspects of the setup of the multi-aperture imaging apparatus described so far relate to desired or instantaneous adjustments before or during the capture of the full image. Figure 15aThe multi-aperture imaging device 150 includes a processor, such as processor 112, which merges images captured by image sensors 58a-d simultaneously with, for example, the aforementioned adjustments, to form a full image representing the scene in the full field of view 72. The algorithm used by processor 112 for merging or fusing images projected onto image sensor regions 58a-d by optical channels 16a-d and already captured by image sensor regions 58a-d to form the full image is designed, for example, such that assumptions regarding specific parameters of the device of the multi-aperture imaging device 150 described above are maintained, in order to satisfy specific prerequisites for the quality of the full image or to make the algorithm fully applicable. Exemplarily, the algorithm assumes maintaining one or more of the following assumptions:

[0171] 1) The distance from the optics along the x-axis to the image sensor region is equal for all optical channels 16a-d;

[0172] 2) The relative positions of the local fields of view 74a-d, and in particular the overlap between the local fields of view 74a-d corresponds to a predetermined default value or deviates from the latter by a maximum deviation less than a predetermined value.

[0173] However, for various reasons, one or more of the assumptions just mentioned may not be maintained or not maintained adequately. Reasons for not maintaining these assumptions could include, for example, manufacturing variations, such as inaccuracies in the relative positions of the optical components 64a-d with respect to each other and to the image sensor 12. Manufacturing inaccuracies may also include inaccuracies in the mounting of the mirror deflection device, and may include inaccuracies in the relative positions of the facets 68a-d with respect to each other when the beam deflection member 18 includes facets 68a-d. Additionally, or as an alternative to permissible deviations caused by manufacturing, temperature variations may cause one or more of the aforementioned assumptions to be unapplied or not maintained adequately.

[0174] To a certain extent, the algorithm executed by processor 112 for merging or fusing images of image sensor regions 58a-d to form a full image can compensate for deviations from the optimal orientation and arrangement of components, such as deviations in the positions of local fields of view 74a-d within the full field of view 72 and the set clusters of relative positions of the local fields of view to each other. When merging or fusing images, processor 112 can, for example, compensate for such deviations to a certain degree. However, when a certain deviation limit is exceeded (not adhering to assumption 2), processor 112 will, for example, be unable to compensate for the deviations.

[0175] Manufacturing the multi-aperture imaging device 150 to maintain the aforementioned assumption, for example, across a certain temperature range, tends to increase the manufacturing cost of the multi-aperture imaging device 150. To avoid this, Figure 15aThe multi-aperture imaging device 150 includes an adjustment member 116, which is used to individually change the relative position between the image sensor region 58i of each respective optical channel 16i, the optics 64i of each optical channel 16i, and its beam deflection member 18 or corresponding portion 68i, or to individually change the optical characteristics 16i or the optical characteristics of the portion 68i of the beam deflection member 18 associated with the optical path deflecting the respective optical channel. The adjustment member 116 is driven by default values ​​and performs adjustment tasks according to the default values. These are provided by the memory 118 and / or the controller 122, as will be discussed below.

[0176] The device 150 exemplarily includes a memory 118 having stored default values ​​for individually driving the adjustment member 116 via a channel. The default values ​​may be predetermined by the manufacturer and stored in the memory 118. Additionally, the processor 112 may, for example, be in... Figure 15a The evaluation of captured images (e.g., images merged or fused by processor 112 to form a full image) of image sensor regions 58a-d, indicated by dashed line 124, improves or updates the default values ​​stored in memory 118. Exemplarily, processor 112 captures a scene by adjusting the multi-aperture imaging device 150 with the currently stored default values ​​using adjustment member 116, as will be described in more detail below. Therefore, the default values ​​are read from memory 118 and used by adjustment member 116 for channel-specific adjustments. By analyzing the images of image sensor regions 58a-d captured in this manner, processor 112 obtains information about how the default values ​​stored in memory 118, used only for capture, have been modified so that the aforementioned assumptions are maintained more accurately or in an improved manner when subsequent photographs are taken using these improved or updated default values.

[0177] The stored default values ​​can include a complete set of adjustment values, i.e., a set of adjustment values ​​used to fully adjust device 150. They are selected, as described above and discussed further below, to reduce or eliminate individual channel deviations between the optical characteristics of the channel and the set characteristics.

[0178] Default values ​​may include several groups of adjustment values, such as one group for each consecutive temperature range sequence, so that it is always that group of adjustment values ​​that will be used for image capture suitable for the current situation. Therefore, controller 122 may, for example, perform an access to or lookup of a table in memory 118 showing the correlation between default value groups and different preset situations. For the access, controller 122 obtains sensor data reflecting the current situation, such as data related to temperature, pressure, humidity, the position of device 150 in space, and / or the instantaneous acceleration or instantaneous rotational speed of device 150, and determines from these data one of several default value groups in memory 118, namely the preset situation most closely associated with the current situation described by the sensor data. The sensor data may also have been obtained from image sensor data in the image sensor region. Exemplarily, one group from the corresponding temperature range where the current temperature is located is selected by controller 122. The default values ​​of the group selected from memory 118 by adjustment member 116 for a particular image capture can then be updated again when optional feedback 124 is used.

[0179] The stored default values ​​can be configured, for example, to reduce discrete measurements of the distribution of one or more characteristics of the optical channel by means of the stored default values ​​(i.e., the lateral deviation of the local field of view from the normal distribution of the local field of view, the focal length of the optics, or the depth of field distance of the optical channel) driven by the adjustment device.

[0180] Alternatively, for example, when the mapping from the current sensor data to appropriate default values ​​is fixedly integrated into controller 122, the default values ​​in controller 122 can be determined without using memory 118. The mapping can be described by a functional relationship between the sensor data and the default values. This functional relationship can also be parameter-modifiable. The parameters can be modified using feedback 124.

[0181] Memory 118 can be, for example, non-volatile memory. It can be, for example, read-only memory, however, rewritable memory is also possible. Controller 122 and processor 112 can be implemented in software, hardware, or programmable hardware. They can be programs executing on a common microprocessor. Sensors used to provide sensor data to controller 122 can belong to device 150, such as an image sensor area, or be external components, such as components of devices mounted in the device, as will be discussed below with reference to the following figures.

[0182] The following describes a possible implementation of adjusting component 116. Figure 15a Adjustment component 116 can be applied here to one, several, or all of the implementation variations described below. Specific combinations will also be discussed below.

[0183] In the illustrated variant, the adjustment member 116 exemplarily includes an actuator 126i for each channel 16i, which moves the optics 64i of the corresponding channel 16i laterally along the optical axis 17i or along the axial direction of the optical path and / or along the z-axis and / or y-axis. Alternatively, the actuator 126i may also move, for example, the image sensor 12 or the respective image sensor regions 58i. Typically, the actuator 126i can cause relative movement of the image sensor regions 58i, the optics 64i, and / or the corresponding portions 64i of the beam deflection member 24.

[0184] According to Figure 16a Related variations include adjustment member 116 comprising a phase-changing optical element or phase-changing element 128i for each channel 16i, such as Figure 16a The phase-changing optical element 128i, as indicated herein, can be integrated into the respective optical device 64i (128i”), integrated into the portion 68i (128i””), positioned between the image sensor region 58i and the optical device 64i (128’), or between the optical device 64i and the beam deflection member portion 68i (128i”’), wherein combinations of the aforementioned possibilities are also possible. The phase-changing optical element 128i can, for example, cause a positional change in refractive index, i.e., its regional distribution, through liquid crystal. Alternatively or additionally, the phase-changing optical element 128i causes a change in the shape of the optically active surface, for example, when using piezoelectricity that mechanically acts on a flexible, solid, transparent material and causes deformation, or by using an electrowetting effect. The phase-changing element 128i’ can, for example, change the refractive index of the optical device 64i. Alternatively, the phase-changing element 128i’ can change the shape of the optical lens region of the optical device 64i, and thus change the effective refractive power of the optical device 64i. The phase-changing element 128i”” can, for example, generate a sinusoidal phase grid on the optically correlated surface (e.g., the reflective surface) of a portion of 68i to cause a virtual tilt of the corresponding surface. Similarly, the phase-changing element 128i' or the phase-changing element 128i” can deflect the optical path.

[0185] In other words, the phase change caused by the phase-changing optical element 128i can be highly rotationally symmetric, for example, rotationally symmetric about the optical axis 17i, and thus cause a change in the focal length of the optical device 64i, for example, in the case of 128i". However, the phase change caused by element 128i can also be highly linear, for example, linear along the z-axis or along the y-axis, to cause a change in the deflection angle or the deflection of the optical axis 17i in the corresponding direction.

[0186] Rotationally symmetric phase changes can be used for focusing, just as linear phase changes can be used to correct the position of the local field of view of the corresponding optical channel 16i.

[0187] according to Figure 16b Another variant shown in the diagram includes an adjustment member 116 for each channel 16i, oriented at its angle relative to the optical axis 17i (i.e., setting the angle). Actuators 132i that change the reflective facets of portions 68i (e.g., the respective channels 16i). It should be noted that portions 68i are not limited to reflective facets. Each portion 68i can also be implemented as a prism that deflects the direction of the optical axis 17i in the yz plane, through which the optical path of the optical channel 16i passes.

[0188] Pneumatic, hydraulic, piezoelectric, thermal, electrostatic, or electric drives, or DC or stepper motors or voice coil drives, can be used, for example, to achieve relative movement via actuators 126i and 132i, i.e., to generate movement of optical device 68i (e.g., implemented in a translational manner) and to tilt portion 68i via actuator 132i and z-axis.

[0189] Steering Figure 15a The dashed line indicates that the multi-aperture imaging device 150, in addition to the adjustment member 116, may include one or more actuators 134 for generating global relative movement of the image sensor 12, the optical array 14, and the beam deflection member 18 for all optical channels 16a-d. Therefore, as... Figure 15a As indicated herein, one or more additional actuators 134 may be part of an optional autofocus controller 136 (focusing element) and / or an optional image stabilization controller of a multi-aperture imaging apparatus.

[0190] Supplemented by additional actuators Figure 15a A specific example of the device 150 is shown in Figure 17 middle. Figure 17 Show Figure 15a A multi-aperture imaging device 150 is provided, wherein optics 64a-d of optical channels 16a-d are mechanically fixed to each other via a common support 66. Using the common support, the optics 64a-d can undergo a global movement equal to that of all channels, for example, by translational movement of the support 66 in the z-direction (i.e., along the linear extension direction of the array 14). An actuator 134a is provided here. The actuator 134a thus produces translational movement of the optics 64a-d, by which the common support 66 undergoes translational movement along the z-axis, the translational movement of the optics 64a-d being equal to that of all optical channels 16a-d. For the type of actuator 134a, see Reference 150. Figure 16a and 16b The example mentioned. Furthermore, the device 150 includes an actuator 134b for a global channel change (which is equal for all optical channels 16a-d) of the distance between the image sensor region 58i and the optics 64i along the z-axis or along the optical axis 17i. Figure 17 As indicated, actuator 134b does not cause optical components 64a-d to undergo translational movement along the z-axis, but is used to change the distance from the associated image sensor portions 58a-d using support 66 and actuator 134a, which thus also undergoes translational movement along the x-axis and thus serves as a suspension for support 66.

[0191] also, Figure 17 The device 150 includes an actuator 134c for rotating a beam deflection member 18 about an axis parallel to or located in or not far from the plane containing the optical axes 17a-d. For details regarding actuators 134b and 134c, refer to the preceding reference. Figure 16a and 16b A list of examples of possible implementations is provided. The rotational movement applied to the beam deflection member 18 by the actuator 134c has the same effect on all channels 16a-d, i.e., it is channel-wide.

[0192] Using actuator 134b, autofocus controller 136 is able, for example, to control the focusing of device 150 by means of channels 16a-d in a channel-wide sense. Image stabilization controller 138 is able to stabilize the entire field of view 72 from user shake, for example, by means of actuator 134c in a first direction 142 and by means of actuator 134a in a direction 144 perpendicular to the first direction 142. The first direction 142 can be generated by rotational movement about rotation axis 44. As indicated by the first direction 142', alternatively or additionally, translational movement of beam deflection member 18 and / or array 14 can be generated by actuator 134. Directions 142, 142' and 144 can therefore be parallel to the image axis, in the plane of direction or corresponding to it. The image stabilizer described herein can be implemented to have a combined effect on two, more or all optical paths of the optical channel. This means that individual image stabilization of each channel can be omitted, which is advantageous.

[0193] For example, Figure 15a The device 150 includes actuators for each channel 16a-d, such as actuator 126i for each channel 16i, to cause the image sensor regions 58a-d to undergo translational movement along the z-axis and / or along the y-axis in a channel-by-channel manner, in order to compensate for manufacturing inaccuracies or temperature-induced drift in local fields of view within the full field of view. Figure 15a The device 150 may alternatively or additionally include an actuator 128i” to compensate for undesirable differences in the focal length of the optics 64a-d caused by manufacturing defects. Additionally or alternatively, Figure 15aThe device 150 may include actuators 128i”' to compensate for deviations in the relative tilt of portions 68a-d between each other caused by manufacturing or due to temperature, so that the relative tilt causes desired coverage of the full field of view 72 through the local fields of view 74a-d. Additionally or alternatively, the device 150 may ultimately include actuators of the type 128i' and / or 128i”'.

[0194] In summary, the device 150 may include an actuator 134c for rotating the beam deflection member 18 about an axis parallel to the line extension direction z of the array 14. The rotation axis may be located, for example, in the plane of the optical axes 17a-d or spaced apart from them by a factor less than one-quarter the diameter of the optics 68a-d. Alternatively, the rotation axis may, of course, be further away, for example, by a factor less than the diameter of the optics or less than four optics diameters. For example, the actuator 134c may be provided to rotate the beam deflection member 18 with a short response time only within a small angular range (e.g., within a span of less than 5° or less than 10°) to compensate for, for example, user-induced shaking of the multi-aperture imaging device 150 during image capture. In this case, the actuator 134c would be driven, for example, by an image stabilization controller 138.

[0195] Alternatively or additionally, actuator 134c can be used to adjust the full field of view 72 (defined by the full coverage of the local fields of view 74a-d) at a larger angle in its direction. Figure 15a Therefore, deflection can also be achieved by rotating the beam deflection member 18, wherein the entire field of view is arranged in opposite directions relative to the device 150 by, for example, implementing the beam deflection member 18 as an array of mirrors reflecting on two sides.

[0196] Alternatively or additionally, the device 150 may include an actuator 134a for moving the optics 64a-d by means of the substrate 66 or moving the substrate 66 itself and thus moving the optics 64a-d in a translational manner along the line extension direction. The actuator 134a may also be driven, for example, by the aforementioned image stabilization controller to achieve lateral image stabilization with image stabilization achieved by the movement 96 along the line extension direction, which is achieved by a rotating mirror deflection device.

[0197] Furthermore, the device 150 may additionally or alternatively include features for adjusting the depth of field by changing the image-side distance between the image sensor 12 and the optics 64a-d or between the image sensor 12 and the body 66 (compare). Figure 12 The actuator 134b. Component 98 can be driven by manual user control or automatic focus control of device 150.

[0198] Actuator 134a is also used to suspend substrate 66, and as in Figure 15aAs indicated, they are preferably arranged laterally adjacent to the substrate 66 along the line extension direction to avoid increasing the structural height. This also applies to actuators 134b and 134c, which are preferably arranged in the plane of the optical path to avoid increasing the structural height.

[0199] It should be noted that the optics 64a-d can be held in a constant relative position not only, for example, via the already mentioned transparent substrate, but also, for example, with a suitable frame relative to the beam deflection member, preferably without increasing the structural height and therefore preferably located in the plane of components 12, 14, and 66 or in the plane of the optical path. The stability of the relative position can be limited to the distance between the optics and the beam deflection member along the optical axis, so that the actuator 134b moves the optics 64a-d and the beam deflection member 18 together in a translational manner along the optical axis. The distance between the optics and the beam deflection member can be adjusted to a minimum so that the optical path of the channel is not laterally restricted by the portion of the beam deflection member 18, thereby reducing the structural height, since the portion 68i would otherwise have to have a lateral extension with respect to the maximum distance between the optics and the beam deflection member sized to avoid interrupting the optical path. Additionally, the stability of the relative positions can mean that the aforementioned frame holds the optics and beam deflection components in a mutually rigid manner along the z-axis, so that the actuator 134a will move the optics 64a-d and the beam deflection components together in a translational manner along the line extension direction.

[0200] By combining the actuator 134c for generating the rotational movement of the beam deflection member 18 and the actuator 134a of the optical image stabilization controller of the multi-aperture imaging device 150, the beam deflection member 18 for deflecting the optical path of the optical channel, as described above, allows image or full-field-of-view stabilization in two dimensions: image stabilization along a first image axis substantially parallel to the line extension direction, achieved by translational movement of the substrate 66, and image stabilization along a second image axis (substantially parallel to the optical axis before or without beam deflection, or perpendicular to the optical axis and line extension direction when considering the deflected optical axis), achieved by generating the rotational movement of the beam deflection member 18. Furthermore, the described arrangement can cause translational movement of the beam deflection member and array 14 fixed in the aforementioned frame, for example, by the described actuator 54, which can be used to achieve focus adjustment and thus autofocus functionality.

[0201] Figure 18A schematic diagram illustrating an advantageous arrangement of actuators, such as a multi-aperture imaging device 180 for image stabilization and / or focus adjustment, is shown. The image sensor 12, array 14, and beam deflection member 18 may span a cuboid in space. The cuboid can also be understood as a virtual cuboid and may include, for example, a minimum volume and a minimum vertical extension, particularly along a direction parallel to the y-direction or thickness direction, including the image sensor 12, single-line array 14, and beam deflection member 18. The minimum volume can also be understood as the cuboid spanned by the arrangement and / or operative movement of the image sensor 12, array 14, and / or beam deflection member 18. Array 14 may include optical channels 16a and 16b arranged in a linear extension direction 146 adjacent to each other (potentially parallel). The linear extension direction 146 may be arranged at a fixed position in space.

[0202] The virtual cuboid may include two sides oriented parallel to each other, parallel to the line extension direction 146 of the single-line array 14, and parallel to portions of the optical paths 17a and / or 17b of the optical channels 16a and 16b between the image sensor 12 and the beam deflection member 18. In a simplified but not limiting manner, these may be, for example, the top and bottom sides of the virtual cuboid. The two sides may span the first plane 148a and the second plane 148b. This means that each side of the cuboid may be a portion of planes 148a and 148b. Other components of the multi-aperture imaging device may be arranged wholly, but at least partially, within the region between planes 148a and 148b, so that the space requirement of the multi-aperture imaging device 180 along directions parallel to the surface normals of planes 148a and / or 148b is small, which is advantageous. The volume of the multi-aperture imaging device may include a small or minimal structural space between planes 148a and 148b. The structural space along the lateral sides of the multi-aperture imaging device for extending planes 148a and / or 148b can be large or as large as desired. The volume of the virtual cuboid is influenced, for example, by the arrangement of the image sensor 12, the single-line array 14, and the beam deflection member 18, wherein the arrangement of these components can be adapted, according to the embodiments described herein, such that the structural space along the direction perpendicular to the plane, and thus the mutual distance between planes 148a and 148b, becomes small or minimal. Compared to other arrangements of components, the volume of the virtual cuboid and / or the distance between other sides can be increased.

[0203] The multi-aperture imaging device 180 includes an actuator component 152 for generating relative movement between an image sensor 12, a single-line array 14, and a beam deflection member 18. The actuator component 152 is at least partially arranged between planes 148a and 148b. The actuator component 152 can be configured to move at least one of the image sensor 12, the single-line array 14, or the beam deflection member 18 in a rotational manner about at least one axis and / or in a translational manner along one or more directions. Here, the actuator component 152 may include at least one actuator (such as actuators 128i, 132i, and / or 134) for individually changing the relative position between the image sensor region 58i of the respective optical channel 16i, the optics 64i of the respective optical channel 16i, and the beam deflection member 18 or its corresponding portion 68i, or for individually changing the optical characteristics 16i or the optical characteristics of the portion 68i of the beam deflection member 18 associated with the optical path deflecting the respective optical channel. Alternatively or additionally, the actuator components may implement autofocus and / or optical image stabilization, as described above.

[0204] Actuator component 152 may include a dimension or extension 154 parallel to the thickness direction. Up to 50%, up to 30%, or up to 10% of dimension 154 may protrude beyond planes 184a and / or 184b from the region between planes 148a and 148b, or protrude from the region itself. This means that actuator component 152 protrudes at most insignificantly beyond planes 148a and / or 148b. According to an embodiment, actuator component 152 does not protrude beyond planes 148a and 148b. It is advantageous that the extension of the multi-aperture imaging device 180 along the thickness direction is not increased by actuator component 152.

[0205] Reference Figure 19a The preferred embodiment of the beam deflection member 18 is described in section f. The embodiment shows several advantages that can be performed individually or in any combination, but is not intended to be limiting.

[0206] Figure 19a The following are examples of beam deflection components that can be used in the description herein (e.g., Figure 4a A schematic cross-sectional side view of the beam deflecting element 172 of beam deflecting member 18 (or 6a-c). Beam deflecting element 172 may be effective for one, more, or all of the optical channels 16a to d and includes a sequence of polygonal cross-sections. Although a triangular cross-section is shown, it may show any other polygon. Alternatively or additionally, the cross-section may also include at least one curved surface, particularly having a reflective surface; implementation that is planar at least in part may be advantageous to avoid imaging errors.

[0207] For example, beam deflection element 172 includes a first side surface 174a, a second side surface 174b, and a third side surface 174c. At least two sides (such as sides 174a and 174b) are implemented as reflective so that beam deflection element 172 is implemented as being reflective on both sides. Side surfaces 174a and 174b can be the main sides of beam deflection element 172, i.e., the sides with an area larger than side surface 174c.

[0208] In other words, the beam deflection element 172 can be formed in a wedge shape and is reflective on both sides. In contrast to area 174c, that is, between areas 174a and 174b, there can be another area, however much smaller than area 174c. In other words, the wedge formed by areas 174a, b, and c does not taper to a point, but is provided with area, and is therefore flat at the pointed side.

[0209] Figure 19b A schematic cross-sectional side view of the beam deflecting element 172, in which the suspension or displacement axis 176 describing the beam deflecting element 172 is shown. The displacement axis 176 about which the beam deflecting element 172 can move in the beam deflecting member 18 in a rotational and / or translational manner can be offset eccentrically relative to the centroid 178 of the section. The centroid can alternatively be a point describing half the dimension of the beam deflecting element 172 along the thickness direction 182 and along the direction perpendicular to it 184.

[0210] For example, the displacement axis can be constant along the thickness direction 182 and exhibit any offset in the direction perpendicular to it. Alternatively, offset along the thickness direction 182 is also possible. For example, a displacement can occur so that a higher actuation path is obtained by rotating the beam deflection element 172 about the displacement axis 176 than when rotating about the centroid 178. Thus, the path covered by the edge between the sides 174a and 174b in rotation can be increased by an equal rotation angle compared to rotation about the centroid 178. Preferably, the beam deflection element 172 is arranged such that the edge between the sides 174a and 174b (i.e., the pointed side of the wedge profile) faces the image sensor. The respective other sides 174a or 174b can each move the optical path of the deflection channel with a small rotation. It becomes clear that rotation can be performed such that the space consumption of the beam deflection member along the thickness direction 182 is small due to the movement of the beam deflection element 172, so that the main side does not need to be perpendicular to the image sensor.

[0211] Side 174c can also be referred to as a subsidence side or backside. Several beam deflection elements can be connected to each other such that connecting elements are arranged at side 174c, or through the cross-section of the beam deflection element, i.e., arranged within the beam deflection element, as in the region of displacement axis 176. In particular, retaining elements can be arranged such that they do not protrude beyond beam deflection element 172 along direction 182, or only to a small extent (i.e., at most 50%, 30%, or 10%), so that retaining elements do not increase or define the overall extension of the arrangement along direction 182. Extension in the thickness direction 182 can alternatively be defined by lenses of the optical path, i.e., these lenses exhibit dimensions defining a minimum thickness.

[0212] The beam deflection element 172 may be formed of glass, ceramic, glass-ceramic, plastic, metal, or a combination of these materials and / or other materials.

[0213] In other words, the beam deflection element 172 can be arranged such that its tip (i.e., the edge between the main sides 174a and 174b) faces the image sensor. The beam deflection element can be held so that it exists only on the back side or within the beam deflection element, i.e., the main side is not hidden. A common holding or connecting element can extend on the back side 174c. The axis of rotation of the beam deflection element 172 can be arranged eccentrically.

[0214] Figure 19c A schematic perspective view of a multi-aperture imaging apparatus 190 is shown, comprising an image sensor 12 and optical channels 16a to d arranged adjacent to each other, in a single-line array 14. The beam deflection member 18 includes a plurality of beam deflection elements 172a to d corresponding to the number of optical channels. Alternatively, a smaller number of beam deflection elements may be arranged, for example, when at least one beam deflection element is used by two optical channels. Alternatively, a higher number may be arranged, for example, when the deflection direction of the beam deflection member 18 is switched by translational movement. Each beam deflection element 172a to d may be associated with an optical channel 16a to d. The beam deflection elements 172a to d may be shown according to… Figure 19a -b Multiple elements 172. Alternatively, at least two, several or all of the beam deflection elements 172a to d may be integrally formed.

[0215] Figure 19d A schematic cross-sectional side view of a beam deflecting element 172, whose cross-section is formed in a freeform shape, is shown. Thus, side surface 174c may include a recess 186 that allows for mounting of the element, wherein the recess 186 may also be formed as a protruding element, such as a groove in a tongue and slot system. The cross-section additionally includes a fourth side surface 174d, which has an area smaller than that of the main sides 174a and 174b and connects the main sides 174a and 174b to each other.

[0216] Figure 19e A schematic cross-sectional side view is shown of a first beam deflecting element 172a and a second beam deflecting element 172b located behind it in the shown direction. Recesses 186a and 186b can therefore be arranged such that they substantially overlap, making it possible to arrange connecting elements within the recesses.

[0217] Figure 19f A schematic perspective view of a beam deflection member 18, exemplarily including four beam deflection elements 172a to d connected to a connecting element 188, is shown. The connecting element may be available so that it is movable by an actuator in a translational and / or rotational manner. The connecting element 188 may be integrally formed and in the extending direction (e.g., Figure 5c The connection element 188 is located at or within the beam deflection elements 172a to d in the y-direction. Alternatively, the connection element 188 may also be connected only to at least one side of the beam deflection member 18, as when the beam deflection elements 172a to d are integrally formed. Alternatively, the connection to the actuator and / or the connection to the beam deflection elements 172a to d may occur in any other manner, such as by means of bonding, twisting, or welding.

[0218] Although some aspects of the apparatus have been described, it should be understood that these aspects also represent a description of the corresponding method, so that blocks or elements of the apparatus are also understood as corresponding method steps or features of method steps. Similarly, aspects that have been described as a combination or as a method step also represent a description of the corresponding block or details or features of the corresponding apparatus.

[0219] The embodiments described above are merely illustrative of the principles of the invention. It should be understood that modifications and variations of the arrangements and details described herein will be apparent to those skilled in the art. Therefore, the invention is intended to be limited only by the scope of the following claims and not by the specific details presented herein in the description and discussion of the embodiments.

Claims

1. A device (10; 20; 30; 40; 50; 60; 70; 90; 100; 130) including a multi-aperture imaging device, comprising: Shell (22); as well as Multi-aperture imaging device (11; 140; 150; 180), including: An array (14) of adjacent optical channels (16a-d; 16N); and A beam deflection member (18) is used to deflect the optical path (17a-d) of the optical channel (16a-d; 16N). The outer surface (23) of the housing (22) forms a housing volume (24) in the first operating state of the device, and the beam deflection member (18) includes a first position within the housing volume (24) in the first operating state of the device. The beam deflection member (18) includes a second position in the second operating state of the device, in which the beam deflection member (18) is at least partially arranged outside the housing volume (24); The beam deflection member is used to perform rotational movement about a rotation axis arranged next to the optical channel, thereby moving the beam deflection member between the first position and the second position; wherein the beam deflection member (18) is rotatably connected to the housing (22) on one side of the beam deflection member (18) arranged parallel to the line extension direction of the array (14) of the optical channels (16a-d; 16N).

2. The apparatus according to claim 1, wherein, Different positions are arranged on different main sides of the housing.

3. The apparatus of claim 1, comprising a at least partially transparent cover (36) disposed on an outer surface (23) of the housing (22) between the multi-aperture imaging device (11; 140; 150; 180), wherein the at least partially transparent cover (36) is connected to the beam deflection member (18) and is movable based on rotational movement of the beam deflection member (18) such that the at least partially transparent cover is at least partially removed from the housing volume (24) in the second position.

4. The apparatus according to claim 1, wherein, The multi-aperture imaging device in the second position deflects the optical path (17a-d) of the optical channel (16a-d; 16N) outside the housing volume (24).

5. The apparatus according to claim 1, wherein, The beam deflection member (18) is connected to the housing (22) via connecting elements (34a; 34b) at different positions and is used to alternately include the second position and the third position in the second operating state, in which the beam deflection member (18) deflects the optical channel (16a-d; 16N) in different directions.

6. The apparatus of claim 5, wherein the connecting elements (34a; 34b) are connected to the frame structure and the beam deflection member (18) such that the beam deflection member (18) can alternately include a second position or a third position.

7. The apparatus according to claim 1, wherein, The beam deflection member (18) is movable through the hole (28) of the housing (22), which is closed by the cover (32) in the first position of the beam deflection member (18).

8. The apparatus of claim 1, comprising at least one actuator (33) for moving the beam deflection member (18) from the first position to the second position, or for releasing a lock (35) holding the beam deflection member (18) in the first position.

9. The apparatus according to claim 8, wherein, The beam deflection member (18) is movable between the first position and the second position, wherein the beam deflection member (18) closes the housing (22) in the first position to not capture the field of view and deflects the optical path (17a-d) of the optical channel (16a-d; 16N) toward the field of view in the second position.

10. The apparatus according to claim 9, wherein, The beam deflection member (18) is used to move between the first position and the second position when performing the rotational movement in which the housing swings open from the closed state.

11. The apparatus according to claim 9, wherein, The beam deflection member (18) is movable between the first position, the second position and the third position of closing the housing (22), wherein the beam deflection member (18) deflects the optical path (17a-d) of the optical channel (16a-d; 16N) in the first direction (19a) in the second position and deflects the optical path (17a-d) of the optical channel (16a-d; 16N) in the second direction (19b) in the third position.

12. The apparatus according to claim 1, wherein, The beam deflection member (18) is connected to the transparent cover (36), wherein when the beam deflection member (18) is moved from the first position to the second position, the transparent cover (36) is at least partially removed from the housing (22), wherein the beam deflection member (18) is used to deflect the optical path (17a-d) of the optical channel (16a-d; 16N) so that the optical channel (16a-d; 16N) passes through the transparent cover (36).

13. The apparatus according to claim 1, wherein, The multi-aperture imaging device includes an illumination component (54a-c) for illuminating the area of ​​the object to be captured.

14. The apparatus according to claim 13, wherein, The lighting component (54a-c) includes at least one light-emitting diode.

15. The apparatus according to claim 13, wherein, The illumination components (54a-c) are used to emit light along the average viewing direction of the light channel (16a-d; 16N).

16. The apparatus according to claim 13, wherein, The illumination components (54c-d) are arranged inside the housing volume (24) in the first position of the beam deflection component (18) and outside the housing volume (24) in the second position of the beam deflection component (18).

17. The apparatus according to claim 16, wherein, The lighting component (54a-c) is mechanically connected to the displacement bracket (47), which is movable along the translational direction (x) to move the lighting component (54a-c) between the first position and the second position.

18. The apparatus according to claim 13, wherein, The beam deflection member (18) is used together with the optical path (17a-d) of the optical channel (16a-d; 16N) to deflect the illumination radiation emitted by the illumination member (54a-b).

19. The apparatus of claim 13 for capturing at least two object regions along at least two observation directions of the multi-aperture imaging device (11; 140; 150; 180), wherein the illumination member is used to emit light along the at least two observation directions.

20. The apparatus according to claim 1, wherein, The array (14) is formed in single lines.

21. The apparatus according to claim 1, wherein, The lenses (82a-h; 84a-d) of the optical devices (64a-d) of the optical channels (16a-d; 16N) are mounted to the main side (66a-b) of at least one substrate (66) by one or more lens holders and are mechanically connected via the at least one substrate (66), wherein the optical paths (17a-d) of the multiple optical channels (16a-d; 16N) pass through the at least one substrate (66).

22. The apparatus according to claim 21, wherein, The substrate (66) includes a glass plate.

23. The apparatus according to claim 21, wherein, The lenses (82a-h; 84a-d) of the optical device of the optical channel (16a-d; 16N) are formed of polymer.

24. The apparatus according to claim 21, wherein, The substrate (66) is suspended in the line extension direction (z; 146) of the array adjacent to the substrate (66).

25. The apparatus according to claim 1, wherein, The beam deflection member (18) includes a first position and a second position, the beam deflection member (18) being movable between the first position and the second position, wherein the beam deflection member (18) is used to deflect the optical path (17a-d) of each optical channel to different directions (19a-b) in the first position and the second position.

26. The apparatus according to claim 1, wherein, The beam deflection member (18) is formed as an array of facets (68a-d; 68i) arranged along the line extension direction (z; 146) of the array (14) of the optical channel (16a-d; 16N); The deflection angle of the optical path (17a-d) deflecting each optical channel is based on the setting angle of the support substrate (123) of the beam deflection member (18) relative to the image sensor (12) that strikes the optical channel (16a-d; 16N). And based on the tilt angle of the reflective facet (68i) associated with the light channel (16i) of the surface of the beam deflection member (18) facing the image sensor (12) relative to the support substrate (123). The tilt angle The optical channels (16a-d; 16N) vary.

27. The apparatus according to claim 26, wherein, For each optical channel (16a-d; 16i; 16N), the setting angle The tilt angle of the reflective surface (68i) associated with this channel (16i) relative to the tilt of the supporting substrate (123) is greater than the tilt angle of the reflective surface (68i) associated with this channel (16i). .

28. The apparatus according to claim 27, wherein, The support substrate (123) is positioned parallel to the line extension direction (z; 146) of the array (14) and the setting angle is... It lies in a plane perpendicular to the direction of line extension (z; 146).

29. The apparatus according to claim 26, wherein, The surface of the beam deflection member (18) facing the image sensor (12) is mirrored at least at the reflective facets (68a-d; 68i) associated with the optical channel (16a-d; 16N).

30. The apparatus according to claim 26, wherein, The support substrate (123) and the reflective surface (68a-d; 68i) associated with the optical channel (16a-d; 16N) are integrally formed in the surface facing the image sensor (12).

31. The apparatus according to claim 26, wherein, Multiple optical channels (16a-d; 16N) form a single-line array (14) and the support substrate (123) is supported so that it is rotatable about a rotation axis (44) parallel to the line extension direction (z; 146) of the single-line array (14).

32. The apparatus of claim 1 further comprises an optical image stabilizer (94; 134; 138; 152) effective together for two, more or all of the optical paths (17a-d) of the optical channels (16a-d; 16N) for image stabilization along a first image axis (144) and a second image axis (142) by generating a translational relative movement (96) between the image sensor (12) and the array (14) or the beam deflection member (18), wherein the translational movement is parallel to the first image axis (144) and the second image axis (142) of the image captured by the multi-aperture imaging device.

33. The apparatus of claim 1 further includes optical image stabilizers (94; 134; 138; 152), which are effective together for two, more or all of the optical paths (17a-d) of the optical channels (16a-d; 16N) for image stabilization along a first image axis (144) by generating a translational relative movement (96) between the image sensor (12) and the array (14), and for image stabilization along a second image axis (142) by generating a rotational movement of the beam deflection member (18).

34. The apparatus according to claim 32, wherein, The optical image stabilizer (94; 134; 138; 152) includes at least one actuator and is arranged to be at least partially arranged between two planes (148a-b) spanned by the sides of a cuboid, wherein the sides of the cuboid are oriented to be parallel to each other and to the line extension direction (z; 146) of the array (14) and a portion of the optical path (17a-d) of the optical channel (16a-d; 16N) between the image sensor (12) and the beam deflection member (18), and the cuboid has a minimum volume and includes the image sensor (12), the array (14) and the beam deflection member (18).

35. The apparatus according to claim 34, wherein, The image stabilizers (94; 134; 138; 152) protrude by up to 50% from the area between the planes (148a-b).

36. The apparatus according to claim 34, wherein, At least one actuator of the image stabilizer (94; 134; 138; 152) includes at least one of a pneumatic actuator, a hydraulic actuator, a piezoelectric actuator, a DC motor, a stepper motor, a voice coil motor, an electrostatic actuator, an electrostrictive actuator, a magnetostrictive actuator, and a thermal actuator.

37. The apparatus of claim 1 further comprises a focusing member (98; 134b; 136) including at least one actuator for adjusting the focal length of the multi-aperture imaging apparatus, said at least one actuator being used to provide relative movement between at least one optical element (64a-d) and the image sensor (12) of one of the optical channels (16a-d; 16N).

38. The apparatus according to claim 37, wherein, The focusing member (98; 134b; 136) is arranged such that it is at least partially arranged between two planes (148a-b) spanned by the side of the cuboid, wherein the side of the cuboid is oriented parallel to each other and parallel to the line extension direction (z; 146) of the array (14) and a portion of the optical path (17a-d) of the optical channel (16a-d; 16N) between the image sensor (12) and the beam deflection member (18), and the cuboid has a minimum volume and includes the image sensor (12), the array (14) and the beam deflection member (18).

39. The apparatus according to claim 37, wherein, The focusing components (98; 134b; 136) are used to adjust the focal length equally for all optical channels (16a-d; 16N).

40. The apparatus according to claim 37, wherein, The focusing member (98; 134b; 136) is used to perform relative movement between at least one optical element of one of the optical channels (16a-d; 16N) and the image sensor (12) when the focal length is adjusted, while performing movement of the beam deflection member (18) simultaneously with the relative movement.

41. The apparatus according to claim 38, wherein, The focusing members (98; 134b; 136) are arranged such that they protrude from the area between the planes (148a-b) by a maximum of 50%.

42. The apparatus according to claim 37, wherein, At least one actuator of the focusing member (98; 134b; 136) includes at least one of a pneumatic actuator, a hydraulic actuator, a piezoelectric actuator, a DC motor, a stepper motor, a voice coil motor, an electrostatic actuator, an electrostrictive actuator, a magnetostrictive actuator, and a thermal actuator.

43. The apparatus according to claim 1, comprising: Adjustment component (116) is used to individually change the optical channels (16a-d) of each channel; The relative positions between the image sensor regions (58a-d) of 16i, at least one optics (64a-d) of each optical channel, and the beam deflection member (18), or the optical characteristics of a portion (68a-d; 68i) of the beam deflection member (18) associated with the optical path (17a-d) deflecting the respective optical channels (16a-d; 16i) for individually altering the optical characteristics of the beam deflection member (18) associated with the respective optical channels (16a-d; 16i); and A memory (118) with stored default values ​​and / or a controller (122) for converting sensor data into default values ​​for channel-specific driving of the adjustment member (116).

44. The apparatus according to claim 43, wherein, The adjusting component (116) includes: The first actuator, for at least one channel, for at least two channels, or for each channel (16a-d; 16i), includes an optical device (64a-d) for moving the respective channel (16a-d; 16i) laterally and / or longitudinally with respect to the optical path (17a-d) of the respective optical channel (16a-d; 16i).

45. The apparatus according to claim 43, wherein, The adjusting component (116) includes: The phase-changing elements (128i; 128i'; 128i''; 128i'''; 128i'''') for at least one channel, for at least two channels, or for each channel (16a-d; 16i), the shape or refractive index distribution of the optical surface of the optics (64a-d) for changing the respective optical channels (16a-d; 16i) or the portion (68a-d; 68i) of the beam deflection member (18) associated with the optical path (17a-d) deflecting the respective optical channels (16a-d; 16i).

46. ​​The apparatus according to claim 43, wherein, The adjusting component (116) includes: The second actuator (132i), for at least one channel, for at least two channels, or for each channel (16a-d; 16i), is used to tilt a portion (68a-d; 68i) of the beam deflection member (18) associated with the optical path (17a-d) of the respective optical channel (16a-d; 16i).

47. The apparatus according to claim 43, wherein, The default value or the controller (122) is configured such that discrete measurements of the distribution of one or more characteristics of the optical channels (16a-d; 16i) are reduced by means of the adjustment device (116) driven by the stored default value: Lateral deviation of the local field of view (74a-d) of the full field of view (72) from the conventional distribution of the local field of view (74a-d), The focal length of the optical device (64a-d), The depth of field distance of the optical channels (16a-d; 16N).

48. The apparatus according to claim 43, wherein, The default value or the conversion of the controller (122) includes the dependence of image sensor data on the image sensor region (58a-d) of the image sensor (12) of the multi-aperture imaging device and / or the sensor data related to the temperature, pressure, humidity and spatial position of the multi-aperture imaging device and / or the acceleration and / or the rotational speed of the multi-aperture imaging device.

49. The apparatus according to claim 1, wherein, The housing (22) is implemented as flat, wherein a first extension of the housing (22) along a first housing direction (x) and a second extension of the housing (22) along a second housing direction (z) comprise a size at least three times that of a third extension of the housing (22) along a third housing direction (y).

50. The apparatus according to claim 49, wherein, The beam deflection member (18) in the second position protrudes at least partially from the housing volume (24) at a subside (22c-f) of the housing (22) including the third housing direction.

51. The apparatus according to claim 1, wherein, The beam deflection member (18) deflects the optical path (17a-d) of the optical channel (16a-d; 16N) in a first positioning so that the optical path (17a-d) passes through a first transparent region (36a), and in a second positioning deflects the optical path (17a-d) of the optical channel (16a-d; 16N) so that the optical path (17a-d) passes through a second transparent region (36b).

52. The apparatus of claim 1, comprising at least one other multi-aperture imaging device (11; 140; 150; 180), wherein the device is used to capture the entire field of view (72) at least stereoscopically.

53. The apparatus of claim 1, wherein the multi-aperture imaging apparatus (11; 140; 150; 180) includes a first plurality of optical channels (16a-d; 16N) for capturing the full field of view (72) and a second plurality of optical channels (16a-d; 16N) for capturing the full field of view (72), wherein the full field of view is captured at least stereoscopically by the first plurality of optical channels (16a-d; 16N) and the second plurality of optical channels (16a-d; 16N).

54. The apparatus according to claim 53, wherein, The first plurality of optical channels (16a-d; 16N) and the second plurality of optical channels (16a-d; 16N) satisfy at least one of the following conditions: The first plurality of optical channels (16a-d; 16N) and the second plurality of optical channels (16a-d; 16N) collide with a common image sensor (12); The first plurality of optical channels (16a-d; 16N) and the second plurality of optical channels (16a-d; 16N) are deflected by a common beam deflection member (18); The first plurality of optical channels (16a-d; 16N) and the second plurality of optical channels (16a-d; 16N) are used together in the array (14).

55. The device according to claim 1, implemented as a portable device.

56. The apparatus of claim 55 is implemented as a mobile phone, smartphone, tablet computer, or monitor.

57. The apparatus according to claim 1, comprising: The first multiple optical channels (16) 11 -16 14 ), used to combine the first local field of view (74) of the full field of view (72) with each other. 11 -74 14 Image is imaged onto the first image sensor region (58) of the image sensor (12) of the multi-aperture imaging device. 11 -58 14 )superior; as well as The second set of multiple optical channels (16) 21 -16 24 ), used to also connect with the first local field of view (74) 11 -74 14 The overlapping full field of view (72) and the overlapping second local field of view (74) 21 -74 24 Imaged onto the second image sensor region (58) of the image sensor (12). 21 -58 24 On the above, the first plurality of optical channels and the second plurality of optical channels (16a-d; 16N) are arranged to be laterally offset from each other by a fundamental distance (BA).

58. A method of providing an apparatus (10; 20; 30; 40; 50; 60; 70; 90; 100; 130) including a multi-aperture imaging device, comprising: Provide housing (22); as well as A multi-aperture imaging device (11) is arranged inside the housing (22); 140；150；18 0), the multi-aperture imaging device includes: An array (14) of adjacent optical channels (16a-d; 16N); and A beam deflection member (18) is used to deflect the optical path (17a-d) of the optical channel (16a-d; 16N). The multi-aperture imaging device is arranged such that the outer surface (23) of the housing (22) forms a housing volume (24) in the first operating state of the device, so that the multi-aperture imaging device includes a first position within the housing volume (24) in the first operating state of the device; and So that the beam deflection member (18) in the second operating state of the device includes a second position in which the beam deflection member (18) is arranged at least partially outside the housing volume (24); So that the beam deflection member is used to perform rotational movement about a rotation axis arranged next to the optical channel, thereby moving the beam deflection member between the first position and the second position; such that the beam deflection member (18) is rotatably connected to the housing (22) on one side of the beam deflection member (18) arranged parallel to the line extension direction of the array (14) of the optical channels (16a-d; 16N).

59. A method for capturing the entire field of view (72), comprising: The beam deflection member (18) of the multi-aperture imaging device (11; 140; 150; 180) is moved between a first position and a second position by performing a rotational movement about a rotational axis arranged next to the optical channel. The beam deflection member (18) is moved to the second position where the beam deflection member (18) is at least partially arranged outside the housing volume (24), which is surrounded by the outer surface (23) of the housing (22) in the first operating state of the device, and the beam deflection member (18) is arranged in the first position within the housing volume (24) in the first operating state of the device. The beam deflection member (18) is rotated along one side of the beam deflection member (18) which is arranged parallel to the line extension direction of the array (14) of the optical channels (16a-d; 16N) when it is connected to the housing (22); as well as The full field of view (72) is captured using an array of optical channels (16a-d; 16N) of the multi-aperture imaging device arranged adjacent to each other, the optical paths (17a-d) of the optical channels (16a-d; 16N) being deflected by the beam deflection member (18).

Images