Multi-channel imaging device and device having a multi-aperture imaging device

Abstract

A multi-aperture imaging device includes an image sensor component having multiple image sensor regions and multiple optical channels, wherein each optical channel includes an optical component for imaging a partial field of view of a full field of view onto the image sensor region of the image sensor component associated with the optical channel. The multiple optical channels are configured to completely image the full field of view. A first partial field of view of the full field of view and a second partial field of view of the full field of view are acquired by different numbers of optical channels.

Description

Technical Field

[0001] The invention relates to a multi-channel imaging device and a device having a multi-channel imaging device. The invention further relates to a portable device having a multi-aperture imaging device. Background Art

[0002] Known cameras transmit the full field of view in one channel and are limited in terms of their miniaturization. For example, in mobile devices such as smartphones, two cameras are employed that are oriented in the direction of the surface normal of the display and opposite to said direction.

[0003] Therefore, concepts that enable miniaturized devices to capture the full field of view while ensuring high image quality are desirable. Summary of the invention

[0004] It is therefore an object of the present invention to provide a multi-aperture imaging device which simultaneously allows a high level of image quality and a small installation space for the multi-aperture imaging device.

[0005] This object is achieved by the subject matter of an independent technical solution.

[0006] The core idea of ​​the present invention is to find that the above purpose can be achieved because for a partial image of the combined total image, it is sufficient to determine the depth information of a part of the total image added to the reference part, and the reference part does not necessarily require stereo information, which allows the channel to be omitted and at the same time avoids occlusion of the image part to be changed.

[0007] According to one embodiment, a multi-aperture imaging device includes: an image sensor member having multiple image sensor regions; and multiple optical channels, wherein each optical channel includes an optical member for imaging a partial field of view of a full field of view onto the image sensor region of the image sensor member associated with the optical channel. The multiple optical channels are configured to image the full field of view. A first partial field of view of the full field of view and a second partial field of view of the full field of view are acquired by different numbers of optical channels.

[0008] Further advantageous embodiments are the subject matter of the dependent claims. BRIEF DESCRIPTION OF THE DRAWINGS

[0009] Preferred embodiments of the present invention will be explained below with reference to the accompanying drawings, in which:

[0010] Figure 1 shows a schematic perspective view of a device according to an embodiment;

[0011] Figure 2 A schematic diagram showing a main side of a device according to another embodiment;

[0012] Figure 3ashows the state of the beam deflecting member and the diaphragm in a first operating state according to an embodiment;

[0013] Figure 3b showing the beam deflecting member and the diaphragm in a second operating state;

[0014] Figure 4a A schematic diagram showing a beam deflecting member according to an embodiment, wherein the beam deflecting member comprises a plurality of beam deflecting regions;

[0015] Figure 4b A schematic diagram showing a beam deflecting member according to a configuration and according to an embodiment, the configuration being Figure 4a alternatives;

[0016] Figure 4c to Figure 4h An advantageous implementation of a beam deflecting member of an imaging device according to an embodiment is shown;

[0017] Figure 5a A schematic perspective view showing an imaging device according to an embodiment;

[0018] Figure 5b shows a schematic perspective view of a multi-aperture imaging device according to an embodiment, the multi-aperture imaging device comprising an illumination member configured to emit a temporal or spatial illumination pattern;

[0019] Figure 5c shows a schematic cross-sectional side view of an improved imaging device, wherein a beam deflecting member is rotationally switchable between a first position and a second position in a first operating state;

[0020] Figure 6a A schematic diagram showing a full field of view including four overlapping partial fields of view;

[0021] Figure 6b Shown with Figure 6a a full field of view distributed in different ways in a first direction, wherein partial fields of view are acquired secondarily and arranged adjacently along a first direction;

[0022] Figure 6c Shown with Figure 6a a full field of view distributed in different ways in a second direction, wherein partial fields of view are acquired secondarily and arranged adjacently along a second direction;

[0023] Figure 7a A schematic perspective view showing a device including two multi-aperture imaging devices for stereoscopically acquiring a full field of view according to an embodiment;

[0024] Figure 7bshows a schematic perspective view of a device comprising two multi-aperture imaging devices according to an embodiment, the devices being configured to create depth information from acquisition in one of the wavelength ranges instead of stereo acquisition;

[0025] Figure 7c A schematic perspective view showing a preferred implementation of a multi-aperture imaging device according to an embodiment, the preferred implementation comprising a single viewing direction;

[0026] Figure 8 A schematic structure of a first multi-aperture imaging device and a second multi-aperture imaging device including a shared image sensor is shown.

[0027] Figures 9a to 9d A schematic diagram showing a multi-aperture imaging device using different wavelength ranges according to an embodiment; and

[0028] Fig.10 Schematic diagram showing sensitivity of an image sensor area of ​​an image sensor of a multi-aperture imaging device across wavelengths of first and second wavelength ranges according to an embodiment.

[0029] Fig.11a A schematic perspective illustration of a multi-aperture imaging device for acquiring a full field of view using three optical channels according to an embodiment is shown;

[0030] Fig.11b Show Fig.11a A schematic top view of a multi-aperture imaging device and a schematic illustration of the full field of view;

[0031] Fig.12a A schematic perspective view of a multi-aperture imaging device according to an embodiment is shown, wherein compared to Fig.11a A multi-aperture imaging device is used to change the arrangement of optical components of an optical channel;

[0032] Figure 12b Show Fig.12a A schematic top view of a multi-aperture imaging device together with an illustration of the full field of view;

[0033] Figures 13a to 13d shows a schematic top view of multi-aperture imaging devices according to an embodiment, each of which is configured to acquire two overlapping fields of view;

[0034] Fig.14 shows a schematic top view of a multi-aperture imaging device according to an embodiment, wherein the optical channels are arranged in two opposing optical channels; and

[0035] Fig.15A schematic top view of an optical channel array according to an embodiment is shown, the optical channel array comprising a mutual substrate for several optical channels. DETAILED DESCRIPTION

[0036] Before explaining the embodiments of the present invention in more detail below with reference to the accompanying drawings, it should be noted that the same components, objects and / or structures having the same functions or effects will have the same figure marks in the various drawings, so that the descriptions of the components in different embodiments can be interchangeable and / or applicable to each other.

[0037] Subsequent embodiments relate to the use of different wavelength ranges for imaging on an image sensor. The wavelength range relates to electromagnetic radiation, in particular to light. For example, an example for different wavelength ranges is the use of visible light, for example in a wavelength range of about 380 nm to about 650 nm. For example, wavelength ranges different therefrom may be: an ultraviolet spectrum, which has a wavelength of less than 380 nm; and / or an infrared spectrum, which has a wavelength greater than 700 nm, from about 1000 nm to about 1000 μm, in particular a near infrared spectrum, which has a wavelength in the range of about 700 nm or 780 nm up to about 3 μm. The first and second wavelength ranges include at least partially different wavelengths. According to an embodiment, the wavelength ranges do not include any overlap. According to an alternative embodiment, the wavelength ranges include an overlap, which is, however, only partial, so that there are distinguishable wavelengths in both ranges.

[0038] Subsequently, the described embodiments relate to a beam deflection region of a beam deflection member. The beam deflection region may be a surface region or an object region configured to perform a deflection of an optical path in at least one wavelength range. This may be a sequence of at least one applied layer such as a dielectric layer, and may also be a sequence of conductive layers providing or adjusting reflectivity. This may be an electrically passive or active property.

[0039] In the embodiments described subsequently, reference will be made to the major side and minor side of the device. In the embodiments described herein, the major side of the device may be understood as the side of the housing or device that is larger or of maximum size than the other sides. For example, the first major side may represent the front side and the second major side may represent the back side, even if this does not have any limiting effect. The minor side may be understood as the middle side or front side that connects the major sides to each other.

[0040] Even though the embodiments described below relate to a portable device, the aspects described can be easily transferred to other mobile or fixed devices. It should be understood that the portable device described may have been installed in other devices (e.g., in a vehicle). In addition, the housing of the device can be configured to be non-portable. This is why the embodiments described below are not intended to be limited to portable devices but can refer to any implementation of the device.

[0041] Figure 1 A schematic perspective view of a portable device 10 according to an embodiment is shown. The portable device 10 includes a housing 12, which includes a first transparent area 14a and a second transparent area 14b. For example, the housing 12 can be formed by opaque plastic, metal or the like. The transparent areas 14a and / or 14b can be formed integrally with the housing 12 or in a multi-part manner. For example, the transparent areas 14a and / or 14b can be recesses in the housing 12. Alternatively, a transparent material can be arranged in the recess or in the area of ​​the transparent areas 14a and / or 14b. The transparent material of the transparent areas 14a and / or 14b can be transparent at least in this wavelength range of electromagnetic radiation, and the imaging device, especially the multi-aperture imaging device 16 or its image sensor is easily acceptable to the electromagnetic radiation. This means that the transparent areas 14a and / or 14b can be configured to be partially or completely opaque in a wavelength range different from the former. By way of example, the imaging device 16 may be configured to: acquire first and second wavelength ranges, such as a visible wavelength range; and acquire a wavelength range at least partially different therefrom.

[0042] An imaging device or multi-aperture imaging device 16 is disposed inside the housing 12. The imaging device 16 includes a beam deflecting member 18 and an image acquisition member 19. The image member 19 may include two or more optical channels, each of which includes one or more optical components for changing the optical path (e.g., gathering, focusing, or scattering) of the imaging device 16 and the image sensor. The optical components may be separate, or undivided, or channel-independent with respect to different optical channels. Alternatively, the optical components may also include components that work together for two, several, or all optical channels, such as a converging lens combined with a channel-independent lens, a mutual filter, and the like.

[0043] For example, the image acquisition member 19 may include one or more image sensors, the assigned optical paths of which are guided to the beam deflecting member 18 via one or more optical channels and deflected by the latter. Figure 6aAs described in the context of , at least two optical channels can be deflected so that they will acquire mutually overlapping partial fields of view (partial object areas) of the full field of view (full object area). The imaging device 16 can be referred to as a multi-aperture imaging device. Each image sensor area of ​​the image sensor can be assigned to an optical channel. Structural gaps can be arranged between adjacent image sensor areas, or the image sensor areas can be implemented as different image sensors or parts thereof, however, alternatively or additionally, it is also possible for adjacent image sensor areas to be directly close to each other and separated from each other by the reading of the image sensors.

[0044] The portable device 10 has a first operating state and a second operating state. The operating state may be related to the position, location or orientation of the beam deflecting member 18. This may affect which wavelength range is deflected by the beam deflecting member 18 by using sides having different effectiveness for deflection. Alternatively or additionally, the two different operating states may affect the deflection direction of the optical path. In the exemplary multi-aperture imaging device 16, there may be four operating states, for example two operating states for two different viewing directions and two operating states for different wavelength ranges. One reason is that the beam deflecting member 18 includes a first beam deflecting region that is operable for a first wavelength range of electromagnetic radiation passing through the optical channel; and includes a second beam deflecting region that is operable for a second wavelength range of electromagnetic radiation passing through the optical channel, the second wavelength range being different from the first wavelength range.

[0045] Relative to the viewing direction, in a first operating state, the beam deflecting member 18 can deflect the optical path 22 of the imaging device 16 so that the optical path passes through the first transparent area 14a, as indicated by the optical path 22a. In a second operating state, the beam deflecting member 18 can be configured to deflect the optical path 22 of the imaging device 16 so that the optical path passes through the second transparent area 14b, as indicated by the optical path 22b. This can also be understood to mean that the beam deflecting member 18 guides the optical path 22 through one of the transparent areas 14a and / or 14b at a point in time and based on the operating state. Based on the operating state, the positioning of the field of view (object area) acquired by the imaging device 16 can be arranged in a spatially varying manner.

[0046] A first beam deflection region operable for a first wavelength range and a second beam deflection region operable for a second wavelength range may alternatively be used in order to deflect the optical path of the optical channel or the optical path 22. This enables a portion of the spectrum operable for the beam deflection region to be directed towards the image sensor. For example, the beam deflection region may comprise a bandpass function and may deflect, i.e. reflect, the wavelength range for which the bandpass function is configured, while other wavelength ranges are suppressed, filtered out or at least strongly attenuated, e.g. by at least 20 dB, at least 40 dB or at least 60 dB.

[0047] The beam deflection regions can be arranged on the same side of the beam deflection member 18, thereby providing the advantage that the beam deflection member can be displaced translationally. Alternatively or additionally, different beam deflection regions can also be arranged at different sides of the beam deflection member 18, wherein the regions can alternately face the image sensor based on a rotational movement of the beam deflection member 18. In this case, any tilt angle can be used. However, when using two possibly opposite viewing directions of the multi-aperture imaging device 16, it is advantageous to choose an angle of about 45° so that a rotational movement of 90° is sufficient to change the viewing direction. On the other hand, in the case of only one viewing direction, another degree of freedom can be selected.

[0048] By alternately turning to different beam deflection regions to face, the full field of view of the respective viewing directions can be acquired using different wavelength ranges, due to the fact that the multi-aperture imaging device is configured to: acquire a first acquisition of the full field of view using a first beam deflection region using an image sensor, such that the first acquisition is based on a first wavelength range; and acquire a second acquisition of the full field of view using a second beam deflection region using an image sensor, such that the second acquisition is based on a second wavelength range. Thus, for example, wavelength ranges that are invisible to the human eye can be used to obtain additional image information such as a depth map.

[0049] The portable device 10 may include a first diaphragm 24a and a second diaphragm 24b. The diaphragm 24a is arranged in the region of the transparent area 14a and is arranged to at least partially optically close the transparent area 14a when the diaphragm 24a is in a closed state. According to an embodiment, the diaphragm 24a is arranged to completely close the transparent area 14a or to close at least 50%, 90% or at least 99% of the surface area of ​​the transparent area 14a when the diaphragm is in a closed state. The diaphragm 24b is configured to close the transparent area 14b in the same or similar manner as described for the diaphragm 24a in the case of the transparent area 14a. In the first operating state, during which the beam deflecting member 18 deflects the optical path 22 toward the optical path 22a, the diaphragm 24b may at least partially optically close the transparent area 14b so that stray light enters the housing 12 to a lesser extent or may not completely pass through the transparent area 14b. This enables the stray light entering the diaphragm 24b to have a lesser effect on the field of view acquired in the first operating state. In a second operating state in which, for example, the optical path 22b leaves the housing 12, the diaphragm 24a can at least partially optically close the transparent area 14a. In short, the diaphragm 24a and / or 24b can be configured so that it closes the transparent area 14a and / or 14b, so that stray light enters from an undesired direction (for example, the acquired field of view is not located in the direction) through it to a lesser extent or does not enter at all. The diaphragm 24a and / or 24b can be configured to be continuous and can be arranged in each case with respect to all optical channels of the imaging device 16. This means that based on the respective operating states, the diaphragms 24a and 24b can be used by any of the optical channels of the multi-aperture imaging device. According to an embodiment, one diaphragm 24a or 24b used by all optical channels is arranged for each optical channel, rather than a separate circular diaphragm being configured for each optical channel. The diaphragm 24a and / or 24b can have a shape consistent with a polygonal chain, for example, a rectangular, oval, circular or elliptical shape.

[0050] Switching between the first operating state and the second operating state may comprise a movement of the beam deflecting member 18 , for example based on a translational movement 26 and / or based on a rotational movement 28 .

[0051] For example, the diaphragm 24a and / or 24b can be configured as a mechanical diaphragm. Alternatively, the diaphragm 24a and / or 24b can be configured as an electrochromic diaphragm. This enables the use of a small number of mechanically movable parts. In addition, configuring the diaphragm 24a and / or 24b as an electrochromic diaphragm enables noiseless opening and / or closing of the transparent area 14a and / or 14b and an implementation that can be easily integrated into the optical parts of the portable device 10. For example, the diaphragm 24a and / or 24b can be configured so that it is hardly or not completely perceived by the user when it is in the closed state, because there is almost no optical difference compared to the housing 12.

[0052] The housing 12 can be configured to be flat. For example, the main side 13a and / or 13b can be spatially arranged in an x / y plane or a plane parallel to the plane. The secondary side or secondary front 15a and / or 15b located between the main side 13a and 13b can be spatially configured so that they are inclined or perpendicular to it, which is possible for the main side 13a and / or 13b, and / or the secondary side 15a and / or 15b can be configured as a curved surface or a plane. For example, in a manner parallel or antiparallel to the surface normal of the display of the portable device 10, the extension of the housing 12 between the main side 13a and 13b along the first housing direction z can be smaller than other dimensions of the housing 12 along other extensions (i.e., along the extension direction of the main side 13a and / or 13b). The secondary side 15a and 15b can be parallel or antiparallel to the surface normal of the display. The main side 13a and / or 13b can be spatially configured to be perpendicular to the surface normal of the display of the portable device 10. Thus, for example, the extension of the housing along the x-direction and / or along the y-direction may be at least three times, at least five times or at least seven times the extension of the housing 12 along the first extension z. In short, however, without any limiting effect, the extension z of the housing may be understood as the thickness or depth of the housing 12.

[0053] Figure 2A schematic diagram of the main side of a portable device 20 according to an embodiment is shown. The portable device may include a device 10. The portable device 20 may include a display 33 (e.g., a screen). For example, the device 20 may be a portable communication device including an imaging device 16, such as a mobile phone (smart phone), a tablet computer, a mobile music player, a monitor, or a visual display unit. The transparent area 14a and / or the transparent area 14b may be arranged in the area of ​​the housing 12, and the display 33 is arranged in the area. This means that the diaphragm 24a and / or 24b may be arranged in the area of ​​the display 33. For example, the transparent area 14a and / or 14b and / or the diaphragm 24a and / or 24b may be hidden by the display 33. In the area of ​​the display 33 in which the diaphragm 24a and / or 24b is arranged, the information of the display may be presented at least periodically. The presentation of information may be any operation of the portable device 20. For example, a view finder function may be presented on the display 33, wherein a field of view sampled or acquired by an imaging device inside the housing 12 may be presented. Alternatively or additionally, an image or any other information that has been acquired may be presented. In short, the transparent area 14a and / or the membrane 24a may be hidden by the display 33 so that the transparent area 14a and / or the membrane 24a are barely perceptible or unperceptible during operation of the portable device 20.

[0054] Transparent areas 14a and 14b can each be arranged in at least one main side 13a of housing 12 and / or in the relative main side. In short, housing 12 can have a transparent area at the front and a transparent area at the rear. In this context, it should be noted that, for example, without limiting any of the embodiments described herein, the terms "front" and "rear" can be arbitrarily replaced by other terms such as "left side" and "right side", "top" and "bottom" or the like. According to other embodiments, transparent areas 14a and / or 14b can be arranged in the secondary side. The configuration of the transparent areas can be arbitrary and / or depend on the direction to which the optical path of the optical channel can be deflected.

[0055] In the region of the transparent region 14a or the membrane 24a, the display 33 can be configured, for example, to be activated periodically when an image is acquired with the aid of an imaging device, or to increase the transparency of the display 33 outside the housing 12. Alternatively, the display 33 can also remain active in this region, for example, when the display 33 does not or hardly emits any electromagnetic radiation in the relevant wavelength range into the interior of the portable device 20 and / or the housing 12 or does not or hardly emits toward the imaging device 16.

[0056] Figure 3a1 and 2 show the state of the beam deflecting member 18 and the multi-aperture imaging device, for example, which is accompanied by the operating state of the first diaphragm 24a and the second diaphragm 24b. Figure 3b The optical path 22 is deflected by the beam deflection region 18A shown in the figure so that it passes through the transparent region 14a according to the optical path 22a. The diaphragm 24b can periodically at least partially close the transparent region 14b so that stray light does not enter, or only enters to a small extent through the transparent region 14b into the interior of the housing of the portable device.

[0057] Figure 3b The beam deflecting member 18, the diaphragm 24a and the diaphragm 24b are shown in a second operating state, for example, wherein the beam deflecting member 18 comprises different viewing directions using a 90° rotational movement 28. However, the beam deflecting member now deflects the optical path with a beam deflecting region 18B operable for a second wavelength range, so that acquiring a full field of view arranged in the viewing direction of the optical path 22b can be implemented within the range of the second wavelength range.

[0058] When the beam deflecting member is rotated about 90° more than the original state and thus rotated about 180°, Figure 3a However, the first viewing direction described in will again be adopted under the influence of the beam deflection area 18B. Although it is possible to obtain only one full field of view, for example by providing viewing directions 22a or 22b using arbitrary angles, a higher number of full fields of view, for example 2, 3 or more, can thus be obtained.

[0059] The beam deflecting member 18 can deflect the optical path 22 so that it passes through the transparent area 14b according to the optical path 22b when the diaphragm 24a at least partially optically closes the transparent area 14a. In the second operating state, the diaphragm 24b can exhibit an at least partially or completely open state. The open state can relate to the transparency of the diaphragm. For example, without moving the mechanical components, the electrochromic diaphragm can be called open or closed depending on the control state. During the second operating state, the diaphragm 24b configured as an electrochromic diaphragm can be at least periodically partially or completely transparent to the wavelength range to be detected by the imaging device. In the second operating state, the diaphragm 24b can be at least ... Figure 3a In the first operating state depicted in FIG, the diaphragm 24b may be partially or completely opaque or non-transmissive to this wavelength range. Figure 3a The first operating state is Figure 3b The switching between the second operating state can be obtained based on the rotational movement 28 of the deflection member 18 and / or based on the translational movement (e.g. Figure 4a and Figure 4b ), or may include at least one of said movements.

[0060] Figure 4a A schematic diagram of a beam deflection member 18 including a plurality of beam deflection regions 32a to 32h is shown. For example, the imaging device may include a plurality or a plurality of optical channels, such as two, four or a greater number. For example, if the imaging device includes four optical channels, the beam deflection member 18 may include a number of beam deflection components 32a to 32h according to the plurality of optical channels multiplied by the number of operating states (between which the beam deflection member 18 or the portable device may switch). For example, beam deflection components 32a and 32e may be associated with a first optical channel, beam deflection component 32a deflecting the optical path of the first optical channel in a first operating state, and beam deflection component 32e deflecting the optical path of the first optical channel in a first operating state. Similarly, beam deflection components 32b and 32f, 32c and 32g, and 32d and 32h may be associated with other optical channels, respectively.

[0061] The beam deflection member can be translationally moved along the translation direction of the movement 26 and / or can be moved back and forth between a first position and a second position of the beam deflection member 18 with respect to an optical channel of the imaging device so as to change between a first operating state and a second operating state. A distance 34 across the movement of the beam deflection member 18 between the first position and the second position can correspond at least to a distance between four optical channels of the imaging device. The beam deflection member 18 can include beam deflection components 32a to 32h arranged in a block-by-block manner. For example, the beam deflection components 32a to 32d can be configured to deflect the optical path of the imaging device to a first viewing direction toward a first field of view, each optical channel may be associated with a partial field of view of the full field of view. The beam deflection components 32e to 32h can be configured to deflect the optical path of the imaging device to a second viewing direction toward a second field of view, each optical channel may be associated with a partial field of view of the full field of view. According to other embodiments, the optical paths of at least two optical channels may be deflected by the beam deflection components, so that the number of beam deflection components of the beam deflection member 18 can be small.

[0062] The beam deflection components 32a to 32h may be regions of the beam deflection member 18 having mutually different curvatures, or they may be planar facets of a faceted mirror. By way of example, the beam deflection member 18 may be understood as presenting an array of facets and / or deflection components 32a to 32h having mutually different inclinations, such that the optical paths of the optical channels impinging on the beam deflection member 18 are directed to mutually different partial fields of view of the field of view in the first operating state, and the optical paths impinging on the deflection components 32e to 32h are deflected thereby and directed to mutually different partial fields of view of the field of view in the second operating state.

[0063] Figure 4b Show that according to different Figure 4a Schematic diagram of the configuration of the beam deflecting member 18. Figure 4a The configuration can be understood as a block-by-block ordering of the beam deflection components 32a to 32h based on the operating state, and Figure 4b The configuration can be understood as a channel-by-channel ordering of the beam deflection components 32a to 32h based on the sequence of the optical channels of the imaging device. The beam deflection components 32a and 32e associated with the first optical channel can be arranged adjacent to each other. By a similar method, the beam deflection components 32b and 32f, 32c and 32g, and 32d and 32h associated with optical channels 2, 3 and 4, respectively, can be arranged adjacent to each other, respectively. For example, if the optical channels of the imaging device have a sufficiently large distance to each other, the distance 34' across the movable beam deflection member 18 to move back and forth between the first position and the second position can be less than the distance 34, for example, it can be a quarter or half of the latter. This enables other reduced structural designs of imaging devices and / or portable devices.

[0064] Instead of assigning beam deflection components only to the optical channels, each of them can also provide a different type of beam deflection area, so that for example the first optical channel can be deflected by deflecting in a first wavelength range using beam deflection component 32a or by deflecting in a second wavelength range using beam deflection component 32e.

[0065] The rotational movement can be combined with the translational movement. Thus, for example, it is conceivable that the translational movement switches between wavelength ranges, i.e. different beam deflection components 32a to 32h are arranged at a common side of the beam deflection member 18, wherein the implementation of being reflective on both sides enables switching of the viewing direction and vice versa.

[0066] With the help of Figure 4c to Figure 4h , an advantageous implementation of the beam deflecting member 18 will be described. The explanation will illustrate several advantages which may be implemented individually or in any combination but are not intended to be limiting.

[0067] Figure 4c 1 shows a schematic cross-sectional side view of a beam deflection assembly 32 that may be used in the beam deflection components described herein, for example, Figure 4a or Figure 4b The beam deflecting member 18. The beam deflecting assembly 32 may have a cross section in the manner of a polygonal chain. Even though a triangular cross section is shown, any other polygon is possible. Alternatively or additionally, the cross section may also include at least one curved surface; in detail, a configuration with a reflective surface, at least in part being planar, may be advantageous in order to avoid aberrations. Beam deflecting regions that operate differently with respect to the wavelength may be arranged at different and opposite main side faces 35a and 35b.

[0068] For example, the beam deflection assembly 32 includes a first side 35a, a second side 35b, and a third side 35c. At least two sides, such as sides 35a and 35b, are configured to be reflective, so that the beam deflection assembly 32 is configured to be reflective on both sides. Sides 35a and 35b can be the main sides of the beam deflection assembly 32, that is, the sides whose surface area is larger than the side 35c.

[0069] In other words, the beam deflecting member 32 may have a wedge shape and be formed to have reflectivity on both sides. However, another front face significantly smaller than the front face 35c may be arranged opposite to the front face 35c, that is, between the front faces 35a and 35b. In other words, in this case, the wedge formed by the front faces 35a, 35b, and 35c is not arbitrarily tapered but has a front face on a pointed side and is thus truncated.

[0070] Figure 4d A schematic cross-sectional side view of the beam deflection assembly 32 is shown, wherein a suspension or displacement axis 37 of the beam deflection assembly 32 is depicted. The displacement axis 37 (about which the beam deflection assembly 32 can be rotated and / or moved in translation in the beam deflection member 18) can be displaced eccentrically about a centroid 43 of the cross section. The centroid can alternatively also be a point describing half the dimensions of the beam deflection assembly 32 along a thickness direction 45 and along a direction 47 perpendicular to said direction.

[0071] The displacement axis may be constant, for example, along the thickness direction 45, and may have any offset in a direction perpendicular thereto. Alternatively, an offset along the thickness direction 45 is also possible. The displacement may be achieved, for example, such that after a rotation of the beam deflection assembly 32 about the displacement axis 37, a travel range is obtained that is greater than the travel range obtained after a rotation about the center of mass 43. Thus, if the rotation angle is the same, the travel (by which the edge movement between the sides 35a and 35b is moved) may be increased after the rotation due to the displacement of the displacement axis 37 compared to the rotation about the center of mass 43. Preferably, the beam deflection assembly 32 is arranged such that the edge positioned between the sides 35a and 35b, i.e. the pointed side of the wedge-shaped cross section, faces the image sensor. Thus, the other side 35a or 35b, respectively, may deflect the optical path of the optical channel by means of a smaller rotational movement. This shows that the rotation can be performed such that the space requirement of the beam deflecting member along the thickness direction 45 is smaller, since the movement of the beam deflecting assembly 32 is such that the main side faces will be perpendicular to the image sensor which is not necessary.

[0072] The side surface 35c may also be referred to as a secondary side surface or rear side surface. Several beam deflection components may be connected to one another such that the connection component is arranged on the side surface 35c or extends through a cross section of the beam deflection component, i.e. is arranged inside the beam deflection component, for example in the region of the displacement axis 37. In detail, the holding component may be arranged not to protrude or to protrude only to a lesser extent in the direction 45 beyond the beam deflection component 32 by at most 50%, at most 30% or at most 10%, such that the holding component does not increase or determine the extension of the overall design in the direction 45. Alternatively, the extension in the thickness direction 45 may be determined by the lens of the optical channel, i.e. the lens has a dimension that defines a minimum thickness.

[0073] The beam deflecting assembly 32 may be formed of glass, ceramic, glass-ceramic, plastic, metal, or any combination of the aforementioned materials and / or other materials.

[0074] In other words, the beam deflection assembly 32 can be arranged so that the tip, i.e. the edge positioned between the main sides 35a and 35b, points toward the image sensor. Retention of the beam deflection assembly can be achieved so that it only occurs on or inside the rear side of the beam deflection assembly, i.e., without hiding the main sides. The shared retention or connection assembly can extend across the rear side 35c. The rotation axis of the beam deflection assembly 32 can be arranged eccentrically.

[0075] Figure 4e A schematic perspective view of a multi-aperture imaging device 40 comprising an image sensor 36 and a one-line array 38 of adjacently arranged optical channels 42a to 42d is shown. The beam deflection member 18 comprises a number of beam deflection components 32a to 32d which may correspond to the number of optical channels. Alternatively, a small number of beam deflection components may be arranged, for example, when at least one beam deflection component is used by two optical channels. Alternatively, a larger number may be arranged, such as when the deflection direction of the beam deflection member 18 is switched by a translational movement, such as in combination with Figure 4a and Figure 4b Each beam deflection assembly 32a to 32d may be associated with an optical channel 42a to 42d. The beam deflection assemblies 32a to 32d may be configured according to Figure 4c and Figure 4d Alternatively, at least two, a plurality of, or all of the beam deflecting components 32a to 32d may be formed integrally with each other.

[0076] Figure 4fA schematic cross-sectional side view of a beam deflection assembly 32 is shown, the cross section of which is formed as a free-form surface. Thus, the side 35c may include a recess 49 enabling attachment of a retaining assembly; the recess 49 may also be formed as a protruding assembly, such as a key of a sliding key engagement system. The cross section further includes a fourth side 35d having a smaller surface area than the main sides 35a and 35b and connected to each other.

[0077] Figure 4g A side view in schematic cross section showing a first beam deflection assembly 32a and a second beam deflection assembly 32b, the latter being located behind the former as seen in the presentation direction. The recesses 49a and 49b may be arranged substantially congruent, making it possible to arrange a connection assembly in said recesses.

[0078] Figure 4h A schematic perspective view of a beam deflection member 18 is shown, which comprises, for example, four beam deflection components 32a to 32d connected to a connection component 51. The connection component can be used for translational and / or rotational movement by an actuator. The connection component 51 can be integrally formed and can extend across the extension direction on or in the beam deflection components 32a to 32d, for example Figure 4e Alternatively, the connection component 51 may, for example, be coupled only to at least one side surface of the beam deflecting member 18 when the beam deflecting components 32a to 32d are integrally formed. Alternatively, the connection to the actuator and / or the connection of the beam deflecting components 32a to 32d may also occur in any other manner, for example, by means of gluing, twisting or welding, for example.

[0079] Figure 5a A schematic perspective view of an imaging device 16 is shown. The imaging device 16 includes a beam deflecting member 18, an image sensor 36, and a single line array 38 of adjacently arranged optical channels 42a to 42d. Each optical channel 42a to 42d may include an optic configured to optically affect an optical path 22-1 to 22-4 of the imaging device 16. The optic may be channel-independent, or may include a common component for a group of two or more optical channels.

[0080] The image sensor 36 may include image sensor regions 44a to 44d; the optical paths 22-1 to 22-4 of the optical channels 22a to 22d may each illuminate the image sensor regions 44a to 44d. In short, each image sensor region 44a to 44d may have an optical channel 22a to 22d and / or an optical path 22-1 to 22-4 associated therewith. The beam deflection member 18 may be configured to deflect the optical paths 22-1 to 22-4 to different directions and / or different wavelengths based on different operating states of the portable device and / or different positions of the beam deflection member 18, such as in combination with Figure 1 , Figure 2 , Figure 3a , Figure 3b and Figure 4a to Figure 4h This means that the imaging device 16 may be formed as or include a multi-aperture imaging device 40 .

[0081] The image sensor areas 44a to 44d can each be formed by, for example, a chip including a corresponding pixel array; the image sensor areas can be mounted on a shared substrate and / or a shared circuit board. Alternatively, of course, the image sensor areas 44a to 44d may also each be formed by a portion of a shared pixel array extending continuously across the image sensor areas 44a to 44d, the shared pixel array being formed on, for example, a separate chip. For example, only the pixel values ​​of the shared pixel array will then be read out in the image sensor areas 44a to 44d. Of course, various combinations of the alternatives are also possible, such as the presence of one chip for two or more channels and another chip for other channels or the like. In the case of several chips of the image sensor 36, the chips can be mounted on one or more circuit boards, for example all together or in groups or in a similar manner.

[0082] The single line array 38 may include a carrier 39, at which the optical elements 41a to 41d of the optical channel are arranged. The carrier 39 may be passed through the optical paths 22-1 to 22-4 for imaging in the corresponding optical channel. The optical channel of the multi-aperture imaging device may cross the carrier 39 between the beam deflection member 18 and the image sensor 36. The carrier 39 may maintain the relative positions between the optical elements 41a to 41d in a stable manner. The carrier 39 may be transparently formed and include (for example) a glass material and / or a polymer material. The optical elements 41a to 41d may be arranged on at least one surface of the carrier 39. This enables a smaller size of the carrier 39, and therefore of the single line array 38 along a direction parallel to the image sensor 36 and perpendicular to the line extension direction 56, since the housing of the optical elements 41a to 41d in its circumferential region may be omitted. According to an embodiment, the carrier 39 is not configured to be larger, or is configured to be only slightly larger, i.e. at most 20%, at most 10% or at most 5% larger than the corresponding dimensions of the optical elements 41a to 41d along a direction parallel to the main side of the image sensor 36 and perpendicular to the line extension direction 56.

[0083] The beam deflecting member may be configured such that in the first position and the second position it deflects the optical path 22-1 to 22-4 of each optical channel 42a to 42d in mutually different directions. This means that the deflected optical paths 22-1 to 22-4 may have mutual angles, such as Figure 6a . The optical channels 16a to 16d may be arranged in at least one line along a line extension direction 56. The array 38 may be formed as a multi-line array comprising at least two lines or as a single-line array comprising (exactly) one line of optical channels. The optical channels may be guided by the beam deflection member 18 based on a viewing direction set towards a varying field of view. The optical channels may have angles with respect to each other within the viewing direction such that the optical channels are guided into only partially overlapping parts of the full field of view (such as they completely overlap). Different angles of the optical channels may be obtained based on the optics of the optical channels and / or based on mutually different deflections of the optical channels at the beam deflection member 18.

[0084] The imaging device 16 may include an actuator 48a, for example, which is part of an optical image stabilizer 46a and / or can be used to switch the position of the beam deflection member 18. The optical image stabilizer 46 can be configured to allow optical image stabilization of the image acquired by the image sensor 36. For this purpose, the actuator 48a can be configured to generate a rotational movement 52 of the beam deflection member 18. The rotational movement 52 can occur around a rotation axis 54; the rotation axis 54 of the beam deflection member 18 can be arranged in the central area of ​​the beam deflection member 18 or at a distance therefrom. The rotational movement 52 can be superimposed on the rotational movement 28 and / or the translational movement 26 for switching the beam deflection member between the first and second positions or operating states. If the beam deflection member 18 can be translationally movable, the translational movement 26 can be spatially arranged parallel to a line extension direction 56 of the single line array 38. The line extension direction 56 can be with respect to a direction along which the optical channels 42a to 42d are arranged adjacently. Based on the rotational movement 52 , an optical image stabilization along a first image axis 58 (possibly perpendicular to the line extension direction 56 ) may be achieved.

[0085] Alternatively or additionally, the optical image stabilizer 46 may include an actuator 48b configured to move the single line array 38 translationally along the line extension direction 56. Based on the translational movement of the single line array 38 along the line extension direction 56, optical image stabilization along the second image axis 62 (possibly parallel to the line extension direction 56 and / or parallel to the movement direction of the single line array 38) can be obtained. By way of example, the actuators 48a and 48b may be formed as piezoelectric actuators, pneumatic actuators, hydraulic actuators, DC motors, stepper motors, thermal actuators, electrostatic actuators, electrostrictive actuators, and / or magnetostrictive actuators. The actuators 48a and 48b may be formed identically or differently from each other. Alternatively, it is also possible to arrange an actuator that is configured to move the beam deflection member 18 rotationally and the single line array 38 translationally. By way of example, the rotation axis 54 may be parallel to the line extension direction 56. The rotational movement 52 about the rotation axis 54 may result in minimal installation space required for the imaging device 16 in a direction parallel to the image axis 58, so that a portable device including the imaging device 16 inside the housing may also have small dimensions. In short, the portable device may include a flat housing.

[0086] The translation movement 26 can be implemented, for example, parallel or substantially parallel to the extension of the main side 13a and / or 13b of the device 10, so that the additional installation space required for switching the beam deflection between operating states can be arranged along the line extension direction 56 and / or so that the installation space can be omitted in the thickness direction of the device. The actuators 48a and / or 48b can be arranged along the line extension direction and / or perpendicular thereto, parallel to the extension direction of the main side of the housing of the device. In short, this can be described as such that the actuator for switching between operating states and / or the actuator of the optical image stabilizer can be arranged in the immediate vicinity of the extension between the image sensor, the single line array 38 and the beam deflection member 18, in front of or behind it, the arrangement above and / or below the extension being omitted hereinafter in order to make the installation height of the imaging device 16 smaller. This means that the actuator for switching the operating state and / or the optical image stabilizer can be arranged in a plane in which the image sensor 36, the single line array 38 and the beam deflection member 18 are arranged.

[0087] According to other embodiments, the actuator 48 b and / or other actuators may be configured to change the distance between the image sensor 36 and the single line array 38 and / or the optics of the optical channel. For this purpose, for example, the actuator 48 b may be configured to move the single line array 38 and / or the image sensor 36 relative to each other along the optical paths 22 - 1 to 22 - 4 and / or perpendicularly to the line extension direction 56 in order to change the focus of the imaging of the field of view and / or to obtain an autofocus function.

[0088] The imaging device 16 may include a focusing member configured to change the focus of the imaging device. The focusing member may be configured to provide a relative movement between the single line array 38 and the image sensor 36. The focusing member may be configured to perform the relative movement while performing a movement of the beam deflection member 18 simultaneously with the relative movement. By way of example, the actuator 48b or another actuator may be configured to keep the distance between the single line array 38 and the beam deflection member 18 at least substantially constant, or at least substantially constant, possibly precisely constant when no additional actuator is used, i.e. to move the beam deflection member 18 as much as the single line array 38 moves. In the case where the camera does not include a beam deflection member, the implementation of the focusing function may result in an increase in the size (thickness) of the device.

[0089] Based on the beam deflection member, this can be done without generating any additional dimensions along the dimensions parallel to the main side of the image sensor 36 and perpendicular to the line extension direction 56 (e.g., thickness) of the multi-aperture imaging device, since the installation space allowing the movement can be arranged perpendicular to the movement. Based on the constant distance between the single line array 38 and the beam deflection member 18, the beam deflection can be maintained in an adjusted (possibly optimal) state. In short, the imaging device 16 may include a focusing member for changing the focus. The focusing member may be configured to provide a relative movement (focusing movement) between at least one optical element 41a to 41d of the optical channel of the multi-aperture imaging device 16 and the image sensor 36. The focusing member may include an actuator for providing the relative movement, for example, actuators 48b and / or 48a. The beam deflection member 18 may continue to move (simultaneously with the focusing movement) when another actuator is used, possibly due to a corresponding structural configuration or utilization. This means that the distance between the single line array 38 and the beam deflection member remains unchanged and / or the beam deflection member 18 moves simultaneously or with a time lag to the same or comparable extent as when the focusing movement occurs, so that it is unchanged compared to the distance before the focus change, at least at the point in time when the field of view is acquired by the multi-aperture imaging device.

[0090] The imaging device 16 comprises a control member 53 configured to receive image information from the image sensor 36. For this purpose, an image of the full field of view is evaluated, which image is obtained by deflecting the optical paths 22-1 to 22-4 of the optical channels 42a to 42d by means of a first beam deflection region, and a corresponding (i.e. matching) image is evaluated, which image is obtained by deflecting the optical paths 22-1 to 22-4 of the optical channels 42a to 42d by means of a second beam deflection region, wherein any order of the first and second images can be used.

[0091] The control member 53 may, for example, use a method for combining (stitching) images to generate two total images of the acquired full field of view, wherein the first total image is based on the first wavelength range and the second total image is based on the second wavelength range.

[0092] The control member can be configured to determine a depth map for the first acquisition using a second acquisition, for example based on a wavelength range that is not visible to humans, such as an infrared range, in particular a near infrared range (NIR). For this purpose, the control member can be configured to, for example, evaluate a pattern visible in the second wavelength range. Thus, for example, a predefined pattern such as a dot pattern can be emitted towards the full field of view in the NIR wavelength range, and a distortion of the pattern can be evaluated in the second acquisition or image. The distortion can be related to the depth information. The control member 53 can be configured to provide a depth map using an evaluation of the depth information. As an alternative or in addition to the spatial information of the pattern, the temporal information can also be evaluated, for example, when the temporal variation of the pattern is known.

[0093] The illumination source can be configured to emit a temporal and / or spatial illumination pattern with a third wavelength range that fully or partially includes the second wavelength range, such that the third wavelength range at least partially corresponds to the second wavelength range. This includes the fact that partial reflection of the wavelengths of the emission pattern already represents sufficient light source for reaching the second wavelength range of the image sensor, and also includes wavelength shifts or partial reflections, for example based on absorption. For example, the second wavelength range and the third wavelength range can also overlap.

[0094] As combined Figure 1 As described, the deflected optical path of the optical channel can pass through a transparent area of ​​the housing of the device, in which a diaphragm can be configured. In at least one operating state of the device, the diaphragm configured in the area of ​​the transparent area can at least partially optically close the area so that the diaphragm is operable for two, more or all of the optical channels, that is, in an at least partially closed state. In different operating states, the diaphragm can be in an open state for two, more or all of the optical channels. This means that the diaphragm can be operable for at least two optical channels of the multi-aperture imaging device. In a first operating state, the diaphragm 24b can at least partially optically close the transparent area 14b for two, more or all of the optical channels. In a second operating state, the diaphragm 24a can at least partially optically close the transparent area 14a for two, more or all of the optical channels.

[0095] Figure 5b A schematic perspective view of a multi-aperture imaging device 16 according to an embodiment is shown, wherein the array 38 illustratively includes two optical channels, which include optical elements 41a to 41b, wherein any higher number is possible, such as three, four, five or more. The optical channels 41a and 41b are each configured to acquire a partial field of view 64a or 64b of the full field of view 60. The partial fields of view 64a and 64b overlap each other and together form the full field of view 60.

[0096] The multi-aperture imaging device 16 comprises an illumination member 55 configured to emit a temporal or spatial illumination pattern 55a, in particular towards the full field of view 60. The illumination pattern 55a may comprise a third wavelength range at least partially overlapping or corresponding to the second wavelength range, such that when the optical path is deflected using the second beam deflection region, a distorted pattern in the full field of view hits the image sensor and may be evaluated by the control member 53.

[0097] Figure 5c A schematic cross-sectional side view of a modified imaging device 16' is shown, wherein the beam deflection member 18 can be moved between a first position Pos1 in a first operating state and a second position Pos2 in a second operating state based on a rotational movement 52' about a rotation axis 54. In the first operating state, the imaging device 16' can include a first viewing direction 57a. In the second operating state, the imaging device 16' can have a first viewing direction 57b. The main sides 59a and 59b of the beam deflection member 18 can form a reflective property such as a mirror and / or a faceted assembly. During switching between operating states, the beam deflection member 18 can switch between center positions 61 so that the deviation between parallel planes 63a and 63b (this distance can describe the minimum dimension of the imaging device 16' along the normal direction of the planes 63a and 63b) is affected by the size of the image sensor 36, the array 38, but is not affected by the movement of the beam deflection member 18. The rotational movement 52 can be superimposed by the rotational movement 28. In short, the superposition of switching and optical image stabilization can be implemented.

[0098] The actuator of the multi-aperture imaging device can be arranged to be at least partially arranged between two planes 63a and 63b spanned (defined) by the sides of the cuboid. The sides of the cuboid can be arranged between the image sensor and the beam deflection member parallel to each other, and to the line extension direction of the array and the line extension direction of some of the optical paths of the optical channels. The volume of the cuboid is extremely small and still includes the image sensor, the array and the beam deflection member and their operation-related movements.

[0099] The thickness direction of the multi-aperture imaging device can be arranged perpendicular to the planes 63a and / or 63b. The actuator can have a dimension or extension parallel to the thickness direction. Starting from the area between the planes 63a and 63b, a portion of up to 50%, up to 30% or up to 10% of the dimension can protrude outside the planes 63a and / or 63b or outside the area. Thus, for example, the actuator protrudes out of the planes 63a and / or 63b to the least significant extent. According to an embodiment, the actuator does not protrude out of the planes 63a and / or 63b. Advantageously, the extension of the multi-aperture imaging device along the thickness direction is not increased by the actuator.

[0100] The volume of the multi-aperture imaging device may include a relatively small or extremely small installation space between planes 63a and 63b. Along the lateral sides or extension directions of planes 63a and / or 63b, the installation space of the multi-aperture imaging device may be larger or have any desired size. The volume of the virtual cuboid is affected (for example) by the arrangement of the image sensor 36, the array 38 and the beam deflection member; these components may be arranged according to the embodiments described herein so that the installation space of these components along the direction perpendicular to the planes and (therefore) the mutual distance between planes 63a and 63b becomes relatively small or extremely small. Compared with other arrangements of the components, the volume of the virtual cuboid and / or the distances of other sides may be enlarged.

[0101] Figure 6a A schematic diagram of a full field of view 60 comprising four mutually overlapping partial fields of view 64a to 64d is shown. The partial fields of view 64a to 64d are illustratively arranged in the object area along two directions H and V, which may refer to the horizontal direction and the vertical direction, for example but not in a limiting manner. Any other directional arrangement is possible. Reference Figure 5a , for example, the optical path 22-1 can be directed towards the partial field of view 64a, the optical path 22-2 can be directed towards the partial field of view 64b, the optical path 22-3 can be directed towards the partial field of view 64c, and / or the optical path 22-4 can be directed towards the partial field of view 64d. Even though the association between the optical paths 22-1 to 22-4 and the partial fields of view 64a to 64d is arbitrary, it is clear that starting from the beam deflecting member 18, the optical paths 22-1 to 22-4 are directed in mutually different directions. In the described embodiment, although the full field of view 60 is acquired by means of four optical channels that acquire the partial fields of view 64a to 64d, the full field of view 60 can also be acquired by any other number of partial fields of view greater than one (i.e., at least two, at least three, at least five, at least seven or more).

[0102] Figure 6b Shows different from Figure 6a The possible division of the full field of view 60 is, for example, that the full field of view is obtained by only two partial fields of view 64a and 64b. For example, the partial fields of view 64a and 64b can be along the direction V or as follows Figure 6c are illustrated in , arranged along direction H, and overlap each other in order to allow efficient image combination. The partial fields of view are illustrated as having different sizes only in order to distinguish them more effectively, even though this may indicate a corresponding optional implementation in this way.

[0103] In principle, the allocation of the partial fields of view 64a and 64b to the optical channels and the relative orientation of the array 14 can be arbitrary. The direction of the partial fields of view is along, for example Figure 6b V or Figure 6c The H arrangement in the embodiment can be arranged arbitrarily relative to the line extension direction 56 of the array 14. In an advantageous arrangement, the line extension direction 56 and the direction of the partial field of view are arranged perpendicular to each other within a tolerance range of ±25°, ±15° or ±5°, preferably perpendicular to each other. Figure 6b In , for example, the line extension direction 56 is arranged parallel to the direction H, which is arranged perpendicular to V. Figure 6c In the example, the line extension direction 56 is also based on the Figure 6b The arrangement of the rotated partial fields of view 64a and 64b is rotated so that the line extension direction 56 is parallel to V or perpendicular to H within a specified tolerance range. Therefore, the optical channels 42a to 42c and the image sensor areas 44a to 44c can also be arranged in Figure 6c The components overlap in the illustrated plane or may overlap within a tolerance range and are illustrated as offset for the sake of illustration.

[0104] The multi-aperture imaging device according to the embodiment may be configured to acquire the full field of view 60 through at least two partial fields of view 64a to 64b. Compared to the partial fields of view acquired in a single channel manner, such as the partial field of view 64b or according to the relative Figure 6a In the partial fields of view discussed above, at least one of the partial fields of view can be acquired by at least one first optical channel 42a and one second optical channel 42c. For example, the full field of view can be exactly divided into two partial fields of view 64a and 64b. Exactly one of the partial fields of view, for example, the partial field of view 64a, can be acquired by two optical channels 42a and 42c. The other partial fields of view can be acquired in a single channel manner.

[0105] For this purpose, the multi-aperture imaging device according to an embodiment provides for the use of exactly two optical channels in order to image the two partial fields of view 64a and 64b in the respective wavelength range or in the two wavelength ranges. In the case of this configuration, there is the possibility of overlap or occlusion effects occurring in the overlapping area, which means that instead of a double acquisition of the field of view arranged behind the object, only one viewing angle is acquired. In order to reduce or avoid such effects, some embodiments provide for the acquisition of at least one of the partial fields of view 64a and / or 64b using other optical channels 42a to 42c, so that at least this channel 42a to 42c is acquired multiple times, in particular twice. Any other number of secondary acquired partial fields of view and / or any other number of partial fields of view and / or any other number of optical channels is also possible.

[0106] As based on Figure 6b and Figure 6cAs shown, in order to acquire a partial field of view 64 several times, the optical channels 42a and 42c and / or the image sensor areas 44a and 44c can be arranged symmetrically around the optical channel 42b used to acquire other partial fields of view, at least one optical channel 42b directed to another partial field of view can be spaced apart in the array 14, and / or include a magnification distance or maximum distance toward each other within the array to allow a certain difference measure.

[0107] Figure 7a The device 70 is shown 1 , the apparatus comprises a first multi-aperture imaging device 16a and a second multi-aperture imaging device 16b and is configured to stereoscopically acquire a full field of view 60 by using the multi-aperture imaging devices. The full field of view 60 is arranged, for example, on the main side 13b facing away from the main side 13a. For example, the multi-aperture imaging devices 16a and 16b can acquire the full field of view 60 with the aid of transparent areas 14a and / or 14c; the diaphragms 24a and 24c arranged in the main side 13b are at least partially transparent. The diaphragms 24b and 24d arranged in the main side 13a can at least partially optically close the transparent areas 14b and / or 14d, so that a certain degree of stray light from the side facing the main side 13a (the stray light can modify the image acquired by the multi-aperture imaging devices 16a and / or 16b) is at least reduced. Even though the multi-aperture imaging devices 16a and 16b are depicted as being arranged in a spaced-apart manner, the multi-aperture imaging devices 16a and 16b may also be arranged in spatial proximity or in combination. For example, the single line arrays of the imaging devices 16a and 16b may be arranged adjacent to or in parallel with each other. The single line arrays may form a line with respect to each other, each of the multi-aperture imaging devices 16a and 16b comprising a single line array. The imaging devices 16a and 16b may include a common beam deflection member and / or a shared carrier 39 and / or a shared image sensor 36.

[0108] The transparent areas 14a to 14d may additionally be provided with switchable membranes 24a to 24d which cover the optical structure when it is not in use. The membranes 24a to 24d may include mechanically movable parts. Movement of the mechanically movable parts may be achieved using actuators as described, for example, for actuators 48a and 48b. Alternatively or additionally, the membrane may be electrically controllable and include an electrochromic layer or a sequence of electrochromic layers.

[0109] according to Figure 7b In the preferred embodiment, the device 70 2 Similarly implemented as device 70 1, however, it is implemented so that instead of stereoscopic acquisition, depth information is created from acquisition in one of the wavelength ranges, for example by evaluating pattern distortion in the invisible wavelength range. According to this preferred embodiment, for example, the device 70 is implemented with only a single imaging device 16 and is configured to acquire the full field of view from the perspective of that imaging device 16 and not to acquire stereoscopic acquisition of the full field of view.

[0110] However, the device 70 can also be implemented according to a preferred embodiment to provide or generate a depth map for the full field of view, for example by evaluating the pattern distortion in one of the acquired wavelength ranges, for example by means of control means 53 or specially implemented calculation means of the device 70 or the imaging device 16.

[0111] The device 70 may be implemented without an additional infrared camera to supplement or extend the imaging device 16 , since this functionality is already implemented in the imaging device 16 , possibly involving the illumination means 55 .

[0112] according to Figure 7c Another preferred embodiment described in the 1 and 70 2 Different, equipment 70 3 The imaging device 16 is configured to include only one viewing direction, so that the arrangement of corresponding viewing windows to other directions as well as the arrangement in the membrane, which arrangement is optional in any case, can be omitted.

[0113] By evaluating two wavelength ranges, the device 70 2 and 70 3 Can be configured to create a depth map of the full field of view.

[0114] Figure 8 The diagram includes an imaging system 70 that may be arranged, for example 1Schematic structure of the first multi-aperture imaging device 16a and the second multi-aperture imaging device 16b in. The multi-aperture imaging devices 16a and 16b can be formed completely or partially as a common multi-aperture imaging device. The single-line arrays 38a and 38b form a shared line. The image sensors 36a and 36b can be mounted on a shared substrate and / or a shared circuit carrier such as a shared circuit board or a shared flexure board. Alternatively, the image sensors 36a and 36b can also include substrates that are different from each other. Of course, various combinations of the alternatives are also possible, such as multi-aperture imaging devices including shared image sensors, shared arrays and / or shared beam deflection components 18, and other multi-aperture imaging devices including separate components. It is advantageous for shared image sensors, shared single-line arrays and / or shared beam deflection components that the movement of the respective components can be achieved with high precision by controlling a small number of actuators and synchronization between actuators can be reduced or avoided. In addition, a high level of thermal stability can be achieved. Alternatively or additionally, other multi-aperture imaging devices may also include shared arrays, shared image sensors and / or shared beam deflection components. By being configured as at least one other group of imaging optical channels (where any number of imaging optical channels may be implemented), the multi-aperture imaging device may be configured to acquire the full field of view at least stereoscopically.

[0115] It has been indicated above that, starting from the beam deflection member, the optical paths and / or the optical axes can be directed into mutually different directions. This can be achieved because the optical paths deviate from being parallel to each other during deflection by being directed at the beam deflection member and / or by the optics. The optical paths and / or the optical axes can deviate from being parallel before or without beam deflection. This situation will be described below by the fact that the channels can have a certain pre-divergence. Due to said pre-divergence of the optical axes, it is possible that (for example) not all facets of the beam deflection member have different inclinations from each other, but certain groups of channels include (for example) facets with the same inclination or are directed to said facets. The latter situation can then be formed to be integrally or continuously incorporated into each other to become facets, such as facets are associated with said group of adjacent channels in the direction of line extension. The divergence of the optical axes of these channels can then be derived from the divergence of these optical axes as obtained by a lateral offset between the optical center of the optics of the optical channel and the image sensor area of ​​the channel. For example, the pre-divergence can be limited to a plane. The optical axis may extend, for example, in a shared plane before or without any beam deflection, but in a divergent manner within said plane, and the facets only cause an additional divergence in another transverse plane, i.e. the facets are all inclined parallel to the line extension direction and are only mutually inclined in a manner different from the above-mentioned shared plane of the optical axis; here, too, several facets may have the same inclination and / or be associated with groups of pairwise different channels of the optical axis (e.g. already in the above-mentioned shared plane of the optical axis) before or without any beam deflection. In short, the optics may effect a (pre-)divergence of the optical path along a first (image) direction, and the beam deflection means may effect a divergence of the optical path along a second (image) direction.

[0116] By way of example, the possible prior pre-divergence mentioned above can be achieved in that the optical center of the optics is located on a straight line along the line extension direction, while the center of the image sensor area is arranged so that the center deviates from the projection of the optical center along the normal of the plane of the image sensor area to a point on a straight line located in the image sensor plane, for example, it is arranged at a point that deviates from the point on the straight line mentioned above located in the image sensor plane in a channel-specific manner along the line extension direction and / or along a direction perpendicular to both the line extension direction and the image sensor normal. Alternatively, the pre-divergence can be achieved in that the center of the image sensor is located on a straight line along the line extension direction, while the center of the optics is arranged so that the center deviates from the projection of the optical center of the image sensor along the normal of the plane of the optical center of the optics to a point on a straight line located in the plane of the optical center, for example, it is arranged at a point that deviates from the point on the straight line mentioned above located in the optical center plane in a channel-specific manner along the line extension direction and / or along a direction perpendicular to both the line extension direction and the normal of the optical center plane. Preferably, the above-mentioned channel-specific deviations from the respective protrusions occur only in the line extension direction, i.e. only the optical axes positioned in the shared plane are provided with a pre-divergence. Both the optical center and the image sensor area center will then each lie on a straight line parallel to the line extension direction, but with different intermediate gaps. A lateral offset between the lens and the image sensor in a lateral direction perpendicular to the line extension direction will therefore lead to an increase in the installation height. An in-plane offset only in the line extension direction does not change the installation height, but may lead to a reduction in the number of facets and / or to the facets being tilted only at an angle orientation, which simplifies the design. For example, adjacent optical channels in each case may comprise optical axes extending in a shared plane and being tilted relative to each other, i.e. provided with a pre-divergence. The facets may be arranged with respect to the group of optical channels so as to be tilted only in one direction and parallel to the line extension direction.

[0117] Furthermore, some optical channels associated with the same partial field of view may be provided, for example for the purpose of achieving super-resolution and / or for increasing the resolution used by said channels to sample the corresponding partial field of view. The optical channels within this group will then extend in parallel, for example before the beam deflection, and will be deflected onto the partial field of view by a facet. Advantageously, the image of a pixel of an image sensor of a channel of one group will be located midway between the image of a pixel of an image sensor of another channel of this group.

[0118] For example, even without any super-resolution purpose but only for stereoscopic purposes, an implementation is possible in which a group of directly adjacent channels fully covers the full field of view (where part of the field of view is in the direction in which the lines extend) and another group of directly adjacent channels fully covers the full field of view (for their parts).

[0119] The above embodiments can therefore be implemented as a multi-aperture imaging device and / or a device including such a multi-aperture imaging device, specifically having a single-line channel arrangement, wherein each channel transmits a partial field of view of the full field of view and wherein the partial fields of view partially overlap. Designs of several of these multi-aperture imaging devices, including stereoscopic, triple, quadruple, etc. designs for 3D imaging, are possible. In this case, most of the modules can be implemented as one adjacent line. Adjacent lines can benefit from the same actuator and a common beam deflection assembly. One or more magnifying substrates that may be present in the optical path can extend across the entire line, which can form a stereoscopic, triple, quadruple design. Super-resolution methods can be used, and several channels image the same partial image area. The optical axis can extend in a divergent manner without any beam deflection device, so that fewer facets on the beam deflection unit are required. The facet will then advantageously exhibit only one angular component. The image sensor can include only one adjacent pixel matrix or several interspersed pixel matrices in one component. The image sensor can be composed of many partial sensors, for example, arranged adjacent to each other on a printed circuit board. The autofocus drive may be arranged so that the beam deflection assembly moves or is idle in synchronism with the optics.

[0120] In principle, any number of submodules including image sensors, imaging optics and mirror arrays can be arranged. The submodules can also be configured as a system. For example, the submodule or system can be installed in a housing, such as a smart phone. The system can be arranged as one or more lines and / or rows and in any desired position. For example, two imaging devices 16 can be arranged in the housing 12 to allow stereoscopic acquisition of the field of view.

[0121] According to other embodiments, the device 70 includes other multi-aperture imaging devices 16, so that the full field of view 60 can be sampled by means of more than two multi-aperture imaging devices. This allows several partially overlapping channels for acquiring the full field of view, since the viewing direction of the channels is adapted channel by channel. In order to acquire the full field of view in a stereoscopic manner or in a manner including higher orders, at least one other arrangement of channels can be arranged according to the embodiments described herein and / or have the described channel arrangement, which is in the shape of exactly one line or a separate module. This means that a single-line array can be arranged in a multi-line manner with another line; the other line of optical channels can be associated with another multi-aperture imaging device. The optical channels of another line can also acquire respectively overlapping partial areas and together cover the full field of view. This allows obtaining a stereoscopic, triple, quadruple, etc. structure of an array camera, which is composed of channels that partially overlap within its subgroups and cover the full field of view.

[0122] In other words, a multi-aperture camera comprising a single-line channel arrangement may comprise several optical channels arranged adjacent to each other and transmitting parts of the full field of view, respectively. According to an embodiment, a mirror (beam deflecting member) may be advantageously arranged before the imaging lens, wherein the mirror may be used for beam deflection and may contribute to a reduced installation height. In combination with channel-by-channel adapted mirrors, such as faceted mirrors, for example, wherein the facets may be plane or exhibit any type of curvature or have a free-form surface, it may be advantageous to construct the imaging optics of the channels in a substantially identical manner, while the viewing direction of the channels is influenced or predefined by the individual facets of the mirror array. In combination with a plane mirror (a mirror configured as a flat surface), the imaging optics of the channels may be configured or implemented differently, so that different viewing directions will result. The deflection mirror (beam deflecting device) may be pivotable; the axis of rotation may extend perpendicularly to the optical channel (i.e. parallel to the line extension direction of the channel). The deflection mirrors on both sides may be reflective; a metal or dielectric layer or a layer sequence may be arranged to obtain the reflectivity. Rotational or translational displacement of the mirror may be similar or stable along two or several directions. Stable may be understood to mean applying a force to achieve a movement along the predicted direction; this may result in a rigidification or backward movement of the beam deflecting member when the force is reduced.

[0123] A similar rotation (rotational movement 52) ​​can be used for one-dimensional adaptation of the image position, which can be understood as optical image stabilization. For example, a movement of only a few degrees is sufficient here, for example ≤15°, ≤10° or ≤1°. The rotation of the mirror surface that is stable in two or several directions can be used to switch the viewing direction of the camera. One can switch between viewing directions in front of, adjacent to and behind the display (for example). Similar movements or positions and movements or positions that are stable in two / several directions can be combined, that is, they can overlap. For example, a solution for using a portable device (such as a smart phone) with two cameras having different viewing directions facing the front and facing the back can be replaced by the embodiment described herein, including a structure of only one imaging device. Different from the known solution, the structure can be characterized as, for example, a viewing window is arranged in the housing of a camera having a front viewing direction and a rear viewing direction at the same position, that is, arranged in an upper or lower housing cover in a relative manner. The region of the housing cover which is arranged for the beam passage can be transparent and can consist of glass and / or polymer (when using visible light) or include glass and / or polymer.

[0124] Even though the embodiments described above have been described in the sense that the device has a first and a second operating state, other operating states may be arranged according to other embodiments for acquiring other fields of view, ie at least one third field of view.

[0125] Subsequently, based on Figures 9a to 9d A particularly advantageous implementation of a multi-aperture imaging device is described, wherein the device can be implemented by itself or as a device such as device 70. 1 , 70 2 and / or 70 3 Part of the device of the present invention.

[0126] By way of example, the illustrated cross-sectional side views relate to respective facets of a faceted beam deflecting member. By way of example, the beam deflecting member may be formed as a facet array. One facet may be assigned to each optical channel, wherein each facet may deflect one or several optical channels. Each of the facets may include a corresponding first beam deflecting region and a second beam deflecting region. Figure 4c to Figure 4f As illustrated, the facets of the facet array may be formed as mirrors that are reflective on both sides. Figure 4c to Figure 4f The wedge shape described in can allow a smaller installation size, in particular when only one viewing direction is used or when a rotational movement is combined with a translational movement for switching between four positions for acquiring two viewing directions and using two wavelength ranges. For this purpose, the beam deflecting member can be moved so that, for deflection alternately with different sides, the front edge of the facet is slightly moved upwards and downwards in the case where the surface normals of the side faces 35a and 35b are not parallel to the surface normal of the image sensor.

[0127] On the other hand, a simple and / or small installation size along the line extension direction of the array can be obtained by supporting the beam deflection member to be rotated by about 90° or more, for example about 180° or even 360°. In this way, for example, the four mentioned positions can be obtained only by a rotational movement, so that additional facets and / or translational movements can be omitted. Furthermore, this allows the facets to be simply implemented as plane-parallel mirrors, for example as a single plane-parallel mirror, which adjusts the divergence of the optical path by means of an optical element, and / or as mutually inclined plane-parallel facets that fully or partially adjust the divergence.

[0128] Figure 9a A schematic cross-sectional side view of a multi-aperture imaging device 90 is shown in accordance with an embodiment, wherein opposing sides 18A and 18B are implemented to deflect optical path 22 in a manner such that filtering occurs at sides 18A and 18B with respect to reflected wavelengths. The beam deflecting member is shown in a first position wherein side 18A faces image sensor 36.

[0129] The beam deflecting member 18A comprises a first beam deflecting region, which is for example formed at the side 18A and is operable for a first wavelength range of electromagnetic radiation passing through the optical channel, for example a visible wavelength range. The beam deflecting member comprises a second beam deflecting region 18B, which is for example operable for a second wavelength range of electromagnetic radiation passing through the optical channel, for example ultraviolet (UV), infrared (IR) or near infrared (NIR), the second wavelength range being different from the first wavelength range.

[0130] The wavelength ranges may be separate, however, but may also partially overlap, as long as they are at least partially different and thus allow different image information to be obtained.

[0131] This allows obtaining acquisitions of different wavelength ranges by means of the image sensor 36 , so that for example the second acquisition can be used to create a depth map for the first acquisition, in particular in combination with the coded (N)IR pattern emitted by the device 90 .

[0132] Figure 9a The beam deflecting member 18 is shown in a first position. To obtain a first acquisition of the full field of view, the beam deflecting member may be configured to include a tilt angle α of the first beam deflecting region 18A relative to 45° of the image sensor within a tolerance range of ±10°, ±5° or ±2°. 1 By way of example, the side 18A completely provides a corresponding first beam deflecting region and the side 18B completely provides a corresponding second beam deflecting region, so that the terms are used synonymously in this context. However, the beam deflecting region may also only be a part of a side of the protective layer.

[0133] Figure 9b The beam deflecting member 18 is shown in a second position, wherein the side 18B faces the image sensor so that the side 18B is operable to, for example, deflect NIR light. For example, the beam deflecting member 18 can be rotated about 180° compared to the first position. The beam deflecting region 18A can be arranged on a first side of the beam deflecting member 18, and the second beam deflecting region 18B can be arranged on a second side arranged opposite to the first side. In its entirety or in individual beam deflecting assemblies, the beam deflecting member 18 can be configured such that for a first acquisition with a full field of view, the first side is arranged to face the image sensor, and for a second acquisition with a full field of view, the second side is arranged to face the image sensor. Rotational and / or translational movements can be used to change the side facing the image sensor.

[0134] The plane-parallel implementation of the beam deflecting member or its facets makes it possible that the facets or beam deflecting member 18 for obtaining a second acquisition of the full field of view, for example using a second wavelength range, comprises a tilt angle α of the second beam deflecting region 18B within a tolerance range of ±10°, ±5° or ±2° relative to 45° of the image sensor. 2 By way of example, the tolerance range may compensate for the fact that the beam deflection assembly comprises a tilt angle slightly different from 45°, thereby producing a tilt of different facets of the beam deflection member 18 relative to each other such that on average approximately 45° is obtained, however, the individual facets or deflection areas deviate therefrom due to their respective tilt.

[0135] The beam deflecting members 18A and 18B may be obtained by coatings implemented in different ways which are reflective or non-reflective in the first and second wavelength ranges, respectively.

[0136] An embodiment provides that corresponding coatings with one or several layers are provided on the sides of the beam deflecting member 18 in order to produce the beam deflecting regions 18A and 18B. These layers may, for example, comprise one or several dielectric layers which, with respect to their layer thickness, may be adapted to the tilt angle of the beam deflecting member.

[0137] Since, depending on the selected operating mode or the desired wavelength range for acquisition, parts of the wavelength range, in particular parts of the respective other wavelength range, can impinge on the beam deflection member 18, some embodiments include regions for absorbing certain wavelengths, such as volume absorbers or the like. The regions can be covered by a coating so that, for example, reflection of some wavelengths is first effected, while wavelength ranges that are not reflected, such as those that are transmitted, are absorbed. Thus, for example, when acquiring a first wavelength range, the corresponding wavelengths can be reflected by the coating, while other wavelengths, such as at least non-required parts of the second wavelength range, are for example transmitted by these layers, i.e. passed through. An absorption region arranged behind the coating can absorb these parts in order to avoid or at least reduce a negative impact on the imaging in the multi-aperture imaging device. A complementary member for absorbing non-required parts of the first wavelength range can be arranged on the second side, operable when the second wavelength range 18B is used for beam deflection.

[0138] Fig.9c The beam deflecting member 18 is shown in an optional third position, wherein the side 18A again faces the image sensor, however, the tilt is selected such that the optical path is deflected towards a second full field of view, e.g. Figure 9a and Figure 9b The first full field of view.

[0139] Figure 9dThe beam deflecting member is shown in an optional fourth position, in which side 18B again faces the image sensor, for example such that side 18B is operable to deflect from the second full field of view toward image sensor 36.

[0140] By means of Fig.9c and Figure 9d In the embodiment of the present invention, the first beam deflection region 18A can be used to obtain an acquisition of the second full field of view through the image sensor, so that this acquisition is based on the first wavelength range. In addition, the second full field of view can be imaged using another acquisition using the beam deflection region 18B and the image sensor, so that this acquisition is based on the second wavelength range.

[0141] The two full fields of view may be arranged along different principal directions of the multi-aperture imaging device (eg, along opposite directions, i.e., along directions that differ by approximately 180°). Figures 9a to 9d When performing a continuous rotational movement in a sequence of ...

[0142] Figures 9a to 9d The angles may be selected in any order, for example the angles are each approximately 45°.

[0143] A translational displacement of the beam deflecting member can also be implemented instead of or in combination with the described rotational displacement.

[0144] In order to obtain an image, image information or an image with information of different wavelengths, the pixels of the image sensor can be configured to be operable for two wavelength ranges, and / or units with different sensitivities can be arranged in spatial proximity so that at least the image sensor area is sensitive to two wavelength ranges.

[0145] By way of example, the image sensor area can be configured to generate an image in a first wavelength range and to generate an image in a second wavelength range. For this purpose, the CMOS pixels can, for example, be sensitive simultaneously in the visible range and in the NIR range, and the superimposed color filter array ("CFA"—in the visible range, typically, in a Bayer arrangement) can also contain "filter pixels" according to color (red, green, blue; or magenta, cyan, yellow), from which only some and only partially transmit the NIR, however, this is sufficient. Alternatively or additionally, in the cell arrangement, for example in an extended Bayer pattern, individual cells can be exchanged for cells that are only sensitive in the NIR or implemented as such.

[0146] For example, pixels of the image sensor area may be configured to generate an image in a first wavelength range and to generate an image in a second wavelength range. Thus, the present invention relates to a beam deflection member using a facetVISION architecture having different implementations of a mirrored front side and a mirrored back side, wherein facetVISION refers to the multi-aperture imaging device described herein.

[0147] The core idea is to implement the deflecting mirror so that it has different functions on its front and rear sides.

[0148] This relates in particular to the reflectivity, in particular to the spectral reflectivity (i.e. dependence on the incident wavelength), the first side in particular reflecting the visible spectral range (visible-VIS) with a desired beam deflection angle, however, not reflecting the near infrared (NIR), and the second side reflecting the NIR with a desired beam deflection, however, not deflecting the VIS, all by means of dielectric layer systems implemented in different ways on the first and second mirror sides.

[0149] This enables the following:

[0150] Can be used "simultaneously" with a VIS or NIR camera or very quickly in succession with the same camera - simply by switching the mirrors.

[0151] The mirror no longer has to have a wedge shape, but is a simple plane-parallel plate. A 180° rotation is used for mirror switching for VIS / NIR. Possible negative installation space effects in the rotation range of the mirror can be solved by a protective glass cover in the position of the opening and closing window (opening of the device).

[0152] The camera can be built with only a single viewing direction ("world" or "selfie"), the mirror switching (180°) then only serves to change the acquired spectral range. However, it can also continue to allow front and rear viewing directions. For example, in a rotation step of 90° of the mirror: world-VIS, selfie-NIR, world-NIR, selfie-VIS.

[0153] • Combinations with field of view division and image stitching (eg 2 channels) are obviously possible.

[0154] It is also possible to implement as a dual camera in order to generate a disparity based depth map for image stitching (e.g. 4 channels). However, this is not required (and is therefore channel efficient and significantly cost effective) because:

[0155] The above arrangement can now be combined with structured or coded illumination (such as with Kinect) in NIR (in a mirror position, the camera now also sees in NIR) and from it the depth map necessary for image stitching of VIS images can be generated. This is all done with only two camera channels divided by field of view, special mirrors and only with the help of NIR dot pattern projectors and without additional NIR cameras.

[0156] The goal of reducing from 4 to 2 channels can be achieved even without adding an additional NIR camera (which would be the 3rd optical channel), only an additional NIR projector is necessary.

[0157] • The advantage of reducing costs while maintaining the overall installation height, simply by generating a depth map instead, which is partially integrated into the system itself.

[0158] Fig.10 Schematic diagram showing the sensitivity E of an image sensor area of ​​an image sensor of a multi-aperture imaging device across wavelength ranges 66 and 68, such as the sensitivity of one or more of the image sensor ranges 44a to 44d. The image sensor ranges may be configured to generate an image in a first wavelength range 66 and to generate an image in a second wavelength range 68. By way of example, the first wavelength range 66 is arranged at a first lower wavelength λ. 1 With the first upper wavelength λ 2 Between, where λ 1 <λ 2 For example, the second wavelength range 68 is arranged at the second lower wavelength λ 3 With the second upper wavelength λ 4 Between, where λ 3 <λ 4 Although the description Fig.10The second wavelength range 68 includes larger wavelengths than the first wavelength range 66, but it is also possible that the second wavelength range 68 includes smaller wavelengths than the first wavelength range 66. The wavelength ranges 66 and 68 may overlap each other, however, they may also be spaced apart from each other by the intermediate region 72.

[0159] The image sensor area may be configured to generate image data at least in the wavelength ranges 66 and 68, which means that the image sensor area includes a sensitivity E at least in the wavelength ranges 66 and 68. 1 , which is relative to the sensitivity E 0 Increased, for example, where the image sensor range does not generate image data or image signals due to its insensitivity to these wavelengths.

[0160] The beam deflection can be selectively carried out for the wavelength ranges 66 and 68 so that the corresponding attenuation of wavelengths or the filtering of wavelengths is carried out outside the respective wavelength range for which the beam deflection region is currently in operation, is sufficient to suppress only the wavelengths arranged in the complementary wavelength range or to attenuate the wavelengths. This means, for example, that wavelength ranges to which the image sensor is insensitive can also be deflected by the beam deflection region 18A and / or 18B. In short, image sensor regions can also be implemented for imaging outside the wavelength ranges 66 and 68.

[0161] By way of example, the image sensor area may comprise a plurality of image points, i.e. pixels (picture elements). Each pixel may be formed by at least one, preferably several, imaging sensor cells, i.e. they are photosensitive. The imaging sensor cells may be arranged freely or according to a pattern, such as a Bayer pattern. By way of example, the sensitivity of the image sensor area for the second wavelength range 68 may be obtained by a first subset of pixels sensitive to the first wavelength range 66 and a second subset of different pixels sensitive to the second wavelength range 68. Depending on the required resolution of the first and / or second acquisition, the pixels of the first subset may be arranged staggered or alternately, i.e. 1:1 or configured in any other ratio. Alternatively or additionally, it is possible that one, several or all of the sensor cells of the pixel are sensitive to the first wavelength range 66 and the second wavelength range 68. Alternatively or additionally, it is also possible that the pattern of the sensor cells is changed for the first wavelength range 66 in a certain way so that a sensor cell sensitive to the second wavelength range 68 is added and / or the sensor cell replaces a sensor cell from the pattern. The pixels of the image sensor area may be configured to generate an image in the first wavelength range 66 or to generate an image at least partially in the second wavelength range 68 .

[0162] The embodiments described above relate to single or stereo acquisition of the full field of view. The following describes implementations of multi-aperture imaging devices that may include, for example, the same or at least comparable structural individual features, optics, combinations of optics into arrays, and / or optional use of beam deflection components relative to implementations of image sensor areas.

[0163] The embodiments described below aim to reduce the installation space and / or the number of components required to obtain a smaller camera or multi-aperture imaging device. In addition, the described embodiments aim to counteract the effect of occlusion, ie the masking of image content.

[0164] In this context, embodiments relate to a multi-aperture imaging device having an image sensor member having a plurality of image sensor areas. This refers to the fact that a single image sensor may be arranged or that several image sensors may be arranged continuously or at distributed locations. The multi-aperture imaging device comprises a plurality of optical channels 42a to 42c, wherein each optical channel comprises an optical element for imaging a partial field of view of the full field of view onto an image sensor area 44a / 44c of the image sensor member 12 associated with the optical channel. The plurality of optical channels 42a to 42c are configured to adequately image the full field of view. However, a first partial field of view of the full field of view and a second partial field of view of the full field of view are acquired by a different number of optical channels.

[0165] The different number allows a smaller number of optical channels to be provided, thereby making a smaller camera possible. At the same time, the occlusion effect can be at least partially removed by a suitable arrangement of the optical channels, and in particular the optical channels that acquire the partial field of view multiple times, thereby allowing high quality images.

[0166] Fig.11a A schematic perspective diagram of a multi-aperture imaging device 110 incorporating this implementation is shown. The multi-aperture imaging device 110 includes an image sensor 12, also referred to as an image sensor member, which includes image sensor regions 44a to 44c configured to receive images of optical channels 42a to 42c and convert them into electronic signals. An optional beam deflection member 18 can deflect the optical paths 22-1 to 22-3 of the optical channels 42a to 42c.

[0167] Fig.11b Show Fig.11a Schematic top view of a multi-aperture imaging device 110 and a schematic illustration of a full field of view 60 acquired or recorded by the multi-aperture imaging device 110. By way of example, the multi-aperture imaging device 110 includes three optical channels, wherein any higher number may be implemented, such as 4, 5, 6, 7, 8, 9, 10 or more. The principles described herein remain valid. Thus, an increase in resolution, etc. may be obtained through additional optical channels.

[0168] A plurality of optical channels are arranged adjacently in array 14. An optical channel for imaging partial field of view 64b is illustratively arranged between optical channels for imaging partial field of view 64a in array 14. Alternatively, a different implementation may be chosen.

[0169] The full field of view 60 is exemplarily divided into two partial fields of view 64 a and 64 b , wherein any other division is also possible, in particular more than two partial fields of view arranged one-dimensionally or two-dimensionally in the object area.

[0170] The partial fields of view 64a and 64b can be arranged adjacent to one another and can overlap in an overlap region 82. By way of example, the centers 74a and 74b, e.g. geometric centers, of the partial fields of view 64a and 64b, respectively, form a single line array 76 arranged transversely or perpendicularly to the line extension direction y of the array 14. However, it is also possible to position the partial fields of view 64a and 64b in a different manner. However, the arrangement of the array 76 transversely to the line extension direction y makes it possible to avoid shading particularly advantageously.

[0171] The multi-aperture imaging device 110 is implemented so that the partial field of view 64b is imaged through a single optical channel (optical channel 42b). Single can be understood to mean that only a single channel is provided to acquire the partial field of view in order to create a total image. In contrast, the partial field of view 64ba is imaged through optical channels 42a and 42c, that is, the number of partial fields of view 64b is different from that of partial fields of view 64ba. The number of optical channels is suitable for the number of times that the respective partial field of view 64a or 64b is actually imaged in this way through the multi-aperture imaging device 60, and the number of times the information obtained is used to create the full field of view. For example, this does not include additional or other acquisition of partial fields of view that are implemented in a different manner with respect to orientation and / or size and, for example, for wide-angle functions or zoom functions, as will be described later.

[0172] The same partial field of view refers to a matching portion of the object area, which may have mechanical tolerances but does not include any given deviation in the object area.

[0173] according to Fig.11a and Fig.11b In an embodiment, the partial field of view 64a is now acquired stereoscopically, while the partial field of view 64b is recorded using a different number, for example using a smaller number (ie once).

[0174] In order to join or stitch the individual images of the partial fields of view 64a and 64b, depth information is preferably used. It can be created for the partial field of view 64a by means of image evaluation means 78. The image evaluation means is directly or indirectly connected to the image sensor 12 and is configured to obtain and evaluate image information from the image sensor areas 44a to 44c.

[0175] For example, for partial field of view 64a, image information acquired from different viewing directions of optical channels 42a and 42c can be obtained from two optical channels for partial field of view 64a. Means 78 for image evaluation can be configured to combine image information of partial field of view 64a in order to obtain depth information for the corresponding partial image.

[0176] Thus, depth information can also be obtained for the overlap region 82 in which the partial fields of view 64a and 64b overlap one another. This makes it possible to implement the means 78 for image evaluation in such a way that the image information for the partial field of view 64a is aligned with the image information of the partial field of view 64b obtained by the optical channel 42b and evaluated by the means 78. That is, the image of the partial field of view 64b can be used as a reference image and the overall image of the individual objects and / or the partial field of view 64a can be aligned relative to the partial image of the partial field of view 64b.

[0177] This makes it possible to obtain a total image by means of the component 78 which is based on a different number of partial images in different total image areas, for example based on a secondary acquisition in the total image area of ​​the partial field of view 64a and on a single acquisition in the total image area of ​​the partial field of view 64b.

[0178] This makes it possible to dispense with the fourth optical channel for the secondary acquisition of the partial field of view 64b, thus allowing a smaller size of the multi-aperture imaging device 110. In addition, by means of the stereoscopic acquisition 64a, occlusions can be avoided, which is particularly effective if the optical channels for acquiring the same partial field of view are as far as possible in the array 14 and / or if the array 76 is positioned transversely / perpendicularly to the line extension direction y.

[0179] The multi-aperture imaging device may also include different arrangements of optical channels relative to the partial fields of view and / or different numbers of optical channels. Furthermore, a one-dimensional or two-dimensional arrangement of the partial fields of view in the full field of view may be implemented. Instead of acquiring two partial fields of view using three optical channels, as described, this may also produce different combinations, such as nine partial fields of view imaged using twelve optical channels.

[0180] Fig.12aA schematic perspective view of a multi-aperture imaging device 120 according to an embodiment is shown, in which the arrangement of the optical elements 41a to 41c and / or the optical channels 42a to 42c is changed compared to the multi-aperture imaging device 110. Although the viewing directions of the optical channels in the multi-aperture imaging device 100 may be the same at least in the region between the image sensor and the optical elements, i.e. the optical channels have substantially the same viewing direction, the viewing directions of the optical channels of the multi-aperture imaging device 110 may be different, for example, the viewing direction through the optical channel 42b is opposite to the viewing directions of the optical channels 42a and 42c.

[0181] Thus, for example, the optical channels form two opposing groups. For example, in contrast to the multi-aperture imaging device 110, the optical channels 42a and 42c are arranged opposite to the optical channel 42b, so that the optical element 41b for imaging the partial field of view 64b is arranged opposite to the optical elements 41a and 41c for imaging the partial field of view 64a. The multi-aperture imaging device 120 includes a beam deflecting member 18, which is implemented so as to deflect the optical paths 22-1 to 22-3. For this purpose, the beam deflecting member 18 is arranged between the optical elements 41a to 41c on the one hand and the optical element 41b on the other hand.

[0182] The beam deflection member 18 can implement a fixed deflection angle. In this case, the beam deflection member 18 can be implemented as a fixedly arranged prism or mirror, for example. It is also possible to use a mutual carrier substrate for the two deflection sides, to which the corresponding facets are then applied using a molding technique.

[0183] Alternatively, the beam deflection member 18 may be configured to change the viewing direction of the multi-aperture imaging device. In this case, the beam deflection member 18 may be implemented such that the beam deflection components 32a and 32b are supported to be rotatable about their own, possibly parallel, rotation axes. It is possible to implement the beam deflection member 18 such that the beam deflection components are configured to be reflective on both sides and to deflect the optical paths 22-1 to 22-3 with different main sides in different states, such as in combination with, for example, Figure 4a to Figure 4h Alternatively, it is also possible to use the same main side for deflection in both states.

[0184] Optical element 41b may illustratively be opposite or have a different position relative to the position of optical elements 41a and 41c. Arranging optical element 41b centered relative to optical elements 41a and 41c is advantageous because it allows a symmetrical implementation of a multi-aperture imaging device.

[0185] The beam deflection assembly 32a may be formed as a cross-facet for the optical paths 22-1 and 22-3, since it is possible to 1 With array 14 1 Optical paths extending parallel to each other in the region between are deflected towards the same partial field of view. Alternative embodiments provide individual implementations or arrangements of beam deflection components for optical channels 42a and 42c.

[0186] The arrangement of optical channels 42a, 42b and 42c is advantageous but exemplary. Therefore, it is also possible to arrange optical channel 42b together with optical channel 42a or 42c in the interconnect array 14. 1 and the remaining optical channels opposite thereto are arranged in an array 14 formed in this case by a single optical channel 2 middle.

[0187] As described in conjunction with multi-aperture imaging device 110 , different numbers of optical channels may be arranged overall.

[0188] Figure 12b A schematic top view of multi-aperture imaging device 120 is shown together with an illustration of full field of view 60. As with multi-aperture imaging device 110, the relative configuration of optical channels 42a and 42c on the one hand and optical channel 42b on the other hand makes it possible to acquire full field of view 60 symmetrically.

[0189] Although Fig.11a , Fig.11b , Fig.12a and Figure 12b An embodiment of a multi-aperture imaging device is described that includes three optical channels configured to completely image the full field of view 60 through the partial field of view 64a and the partial field of view 64b, but other embodiments are suitable for providing different numbers of optical channels and / or partial fields of view. With respect to the implementation of multi-aperture imaging devices 110 and 120, the optical channels used to image one of the partial fields of view can be arranged adjacently and spaced apart from the optical channels used to image a different partial field of view, as described for multi-aperture imaging device 110.

[0190] As an alternative thereto, it is possible to arrange optical channels for imaging different partial fields of view adjacent to and opposite one or several optical channels for imaging a partial field of view, as described in conjunction with the multi-aperture imaging device 120 .

[0191] Each of the illustrated optical channels comprises an associated image sensor region 44. These parts, optics and image sensor regions, and possibly also other components, can be combined into modules so that the multi-aperture imaging device can be provided as a combination of modules. In this case, the module can comprise one or several optical channels. A module with at least two optical channels and / or image sensor regions can be implemented so that the optics of the image sensor regions and / or optical channels comprise a mutual substrate, which is, for example, in the form of a bonded Figure 5a The form of the vector 39 described.

[0192] In combination, the multi-aperture imaging device 110 and the multi-aperture imaging device 120 are implemented so that a first group of optical channels is implemented to completely acquire the full field of view 60, that is, the partial fields of view 64a and 64b. Completely can be understood as making all necessary image information available. No additional optical channels are required or provided in order to create the total image. For example, the group can include optical channels 42a and 42b or 42c and 42w. Another group of optical channels that can also include only a single optical channel is configured to partially acquire the full field of view. This can be the other of the optical channels 42a or 42c, respectively.

[0193] Fig.13a 1 shows a schematic top view of a multi-aperture imaging device 1301, which can be implemented similarly to the multi-aperture imaging device 110. Similar to the multi-aperture imaging device 110, the matching numbers in the area of ​​the optical channels 42 show the associated partial field of view 64 in the object area. By way of example, an array 140 having optical channels 42a, 42b, and 42c 1 The arrangement is formed into an inter-module 84 1 , which for example comprises a continuous transparent carrier 39 1 Furthermore, by way of example, a continuous single image sensor 12 with corresponding image sensor areas is provided. 1 .

[0194] In addition to obtaining, which may illustratively correspond to Fig.11b Full field of view 60 Full field of view 60 1 In addition to imaging the full field of view, the multi-aperture imaging device further includes a device configured to image the full field of view 60 2 Sampling of optical channels 42d and 42e. Full field of view 60 2 Includes 60 1 Although the full field of view is 60 2 Described as full field of view 60 1 Part of the full field of view 60 1 Alternatively, the full field of view can be 60 2 of the image, which can be based on the size of the individual partial field of view.

[0195] Therefore, the optical channels 42a to 42e are still configured to asymmetrically cover the full field of view 60. 1 Imaging, that is, having different numbers of partial fields of view. Other additional optical channels 42d and 42e are associated with different partial fields of view of different full fields of view.

[0196] The partial fields of view 64c and 64d may be arranged parallel to the arrangement of the partial fields of view 64a and 64b, however, different arrangements are possible. 2 It is described as forming a full field of view of 60 1 42a and 42c.

[0197] As an example, a second or other module 84 is formed 2 However, the optical channels 42a to 42e may be formed by one or several modules in any arrangement.

[0198] The component 78 may be connected to the image sensor 12 1 and 12 2 In order to obtain image information of one, several or all partial fields of view. Component 78 can be configured to combine and / or stitch the imaging information of partial fields of view 64c and 64d, however, this is also possible without stereoscopically sampling partial fields of view 64c and 64d. This means that even if the overlapping area 82 of partial fields of view 64c and 64d 2 There is no direct stereo information outside, but the overlapping area 82 2 Orientation of the individual image areas or objects outside is possible. For this purpose, the member 78 can be configured to generate stereoscopic pairs of partial fields of view of different full fields of view, for example by generating a pair of partial fields of view 64a from the optical channels 42a and / or 42c for the partial field of view 64c and / or by forming a stereoscopic pair from the partial fields of view 64b and 64d.

[0199] The symmetrical arrangement of the partial fields of view shown is advantageous; however, it does not limit the embodiments in this respect.

[0200] Individual Module 84 1 and 84 2 may each include an optional beam deflecting member 18 1 and 18 2 Alternatively, the beam deflecting member 18 1 and / or 18 2The beam deflecting member may also be arranged outside the module or may not be provided.

[0201] Fig.13b A schematic top view of a multi-aperture imaging device 1302 is shown, wherein in contrast to the multi-aperture imaging device 1301, the optical channels 42a to 42e are formed as a mutual module, which has an image sensor 12 comprising corresponding image sensor areas for the optical channels 42a to 42e. By way of example, the optical channel 1302 is formed without the optional beam deflection member 18. 1 and 18 2 The module makes it possible to separately arrange and / or individually position the beam deflecting member 18 1 and 18 2 Alternatively, the optional beam deflecting member can also be implemented such that it comprises beam deflecting regions 32a to 32e which are operable for all optical channels.

[0202] like Fig.13a As illustrated in FIG. 1 , the optical channels 42a to 42e may be arranged in a mutually linear array of optical channels, wherein the array may be composed of two partial arrays 14 1 and 14 2 Or formed by interacting modules.

[0203] Fig.13c 13 shows a schematic top view of a multi-aperture imaging device 1303, which may be structured similarly to the multi-aperture imaging devices 1301 and 1302. Compared to these multi-aperture imaging devices, the device for acquiring a partial field of view 60 2 The optical channels 42d and 42e can be used to obtain a partial field of view 60 1 One, several or all optical channels 42a to 42c are spaced apart. In this way, the optical channels 42a to 42c can form a linear arrangement and be arranged, for example, between the optical channels 42d and 42e. Alternatively, for example, it is also conceivable to interchange the optical channels 42a and 42e and / or the optical channels 42c and 42d.

[0204] Fig.13d A schematic top view of a multi-aperture imaging device 1304 according to an embodiment is shown, wherein the multi-aperture imaging device 1304 is used to image the full field of view 60 1 The optical channels 42a to 42c for imaging and for full field of view 60 2 The imaging optical channels are not arranged in distinct linear arrays of optical channels, as Fig.13a , but several or even all optical channels 42a to 42e for acquiring different full fields of view are arranged in an interlinear array 14.

[0205] The possibly different sizes of the partial fields of view 64a and 64b on the one hand and 64c and 64d on the other hand may result in different dimensions or sizes of the optics of the optical channels. In this regard, it may be advantageous to implement the beam deflection components individually or at most group them in groups of optical channels with the same focal length, such as for example Fig.13a , Fig.13b , Fig.13c and Fig.13d As described in .

[0206] Fig.14 A schematic top view of a multi-aperture imaging device 140 according to an embodiment is shown, wherein optical channels 42a to 42e are arranged in a mutually linear array 14 1 In the embodiment, the mutual linear array is arranged to be connected to the linear array 14 including, for example, optical channels 42d and 42e. 2 Optical path towards full field of view 60 1 and 60 2 The corresponding deflection of the partial fields of view 64a and 64d can be implemented by means of beam deflection components 32a to 32e arranged in one or several beam deflection members. 1 and 60 2 The grouping of optical channels by association is chosen as an example and to describe an advantageous implementation. However, the embodiments are not limited thereto but relate to any arrangement of optical channels in different arrays.

[0207] The optical channels described herein can be arranged in the same plane, respectively, so that the size of the multi-aperture imaging device along the z direction can be kept as small as possible. For example, the arrays described herein are arranged in a single line, so that different arrays, such as array 14 1 and 14 2 , which may also be referred to as partial arrays, are all arranged in the same plane and each form a line, even if the lines extend parallel to each other and face each other.

[0208] Arrays 14 arranged oppositely 1 and 14 2 The arrays 14 may be arranged symmetrically or centrally relative to each other, so that, for example, they are opposite each other in the array and / or beam deflection region, even if different arrays 14 1 and 14 2 The optical components are displaced relative to each other, as exemplarily described in conjunction with multi-aperture imaging device 120.

[0209] Fig.15A schematic top view of an array 14 according to the invention is shown, which array may include optical channels 42a to 42c, but may also include different, in particular additional, optical channels. In an array 14 which is implemented as a linear array along a line extension direction (e.g. y), the optical channels 42a to 42c are arranged adjacently. The array may include a carrier 39, which is implemented to mechanically fix at least part of the optical elements of the optical channels 42a to 42c. Thus, for example, on all main sides of the carrier 39, optical components, such as lenses or diffraction elements, etc. 41a-2 and 41a-3 of the optical channel 42a and / or optical components 41b-2 and / or 41b-3 of the optical channel 42b and / or optical components 41c-2 and / or 41c-3 of the optical channel 42c can be arranged in a mechanically fixed manner. Alternatively or additionally, it is possible to attach other mechanical components at the carrier 39, such as a lens holder or the like, in which the optical components 41a-1, 41b-1 and / or 41c-1 of the optical channels 42a to 42c can then be arranged. This allows mutual movement of the optical parts and an approximately constant relative position of the optical parts with respect to each other. The optical channels 42a to 42c can extend through the carrier 39, and the carrier 39 can be implemented in a transparent manner, for example by using a glass material or a polymer material. Alternatively, the carrier 39 can include at least a transparent area through which the optical channels 42a to 42c extend, transparency referring to a wavelength range determined for the optical channels 42a to 42c.

[0210] The described multi-aperture imaging devices 110, 120, 1301 to 1304 and 140 are independent of each other and can be easily combined with the described embodiments of optical image stabilization and / or focusing alone. The embodiments are implemented so that the actuators of the image stabilizer and / or focusing means are at least partially positioned between the planes 63a and 63b, as in combination with Figure 5c described.

[0211] In other words, a multi-aperture camera can be implemented according to the principle of channel-by-channel division of the full field of view, and can include the advantage of reducing the installation height (in the z direction) compared to known cameras. For this purpose, several imaging channels arranged adjacently can be provided. A higher number of components and a larger installation effort for realizing the channels increase the price and size of the structure. This means that the space requirement increases in the x / y direction. In the embodiments described herein, the arrangements in which the full field of view is completely acquired by two groups of channels are each different, and four channels are used for two partial fields of view for this purpose, resulting in the full field of view being completely imaged and information about the depth arrangement of the object space is available for the entire field of view, so that the number of optical channels is reduced. In order to reduce the installation space and use a smaller number of components, in the described embodiments, one group of channels captures the full field of view completely; however, the other group only acquires part of it. Therefore, the groups have different numbers of channels and can be implemented so that the optical channels are guided to the matching partial fields of view. In an advantageous simple implementation, the first group has only two channels (e.g., on the top and bottom sides, or on the right and left sides), and the second group has only one channel (only on the top side or only on the bottom side / only on the right side or left side). The image data can be fully used for the entire field of view. Depth information is only available for the portion seen or imaged by both channels.

[0212] An arrangement of the order top / bottom / top or bottom / top / bottom or equivalently right / left is relevant so that the resulting stereo pairing encloses or includes channels that sample only part of the field of view once. Alternatively, other arrangements are possible, such as bottom / bottom / top, etc.

[0213] Additional depth sensors, such as time-of-flight / structured light or additional stereo data, can be used to provide depth information over the entire field of view.

[0214] Embodiments make it possible to avoid occlusion effects together with configuration for smaller cameras. The single channel image is not affected by parallax and can be used as a reference image. The dual channel image is parallax free only at infinite distance in the object area. If the distance is finite or short, parallax will occur, preventing stitching. This can be obtained by sampling the additional object area to be stitched twice.

[0215] The centrally arranged unprocessed image may be supplemented by an external image showing parallax in the optical channel, but together may compensate or fill in occlusions.

[0216] In another aspect of the embodiments described herein, a third group of optical channels, preferably two channels, is provided which, in addition to the first group (preferably two channels) with the complete field of view and the second group (preferably only one channel) with only a partial field of view, also covers a further full field of view by partially acquiring an overlapping partial field of view. The further full field of view may at least partially overlap with the first full field of view, wherein a complete overlap of one full field of view with the other preferably occurs, i.e. one full field of view is a part of the other full field of view. This may mean a complete overlap in which the full fields of view have different sizes. This may, for example, be a scaling structure of an additional channel, such as Fig.14 However, it can also be a wide-angle structure. In this case, the channels of the third group surround the first and second groups.

[0217] These embodiments can be combined optionally and individually with the orthogonality of the line vector of the array to the vector of the partial image field of the first group. In addition, the implementation of a continuous substrate for all channels or individual modules of the array can be implemented. A tilting of the beam transformation member / beam deflection member to change the viewing direction, a double-sided mirror and / or a wedge-shaped design can be provided. Image stabilization by means of a translation of the array relative to the image sensor combined with a rotation of the beam deflection member can also be provided. A drive for focusing members / stabilization in the z direction can be provided and preferably implemented so that it is not greater than the extension of the multi-aperture imaging device specified by the optical parts in the z direction, which involves a virtual cuboid description of the relevant planes 63a and 63b. The channel-individual adaptation of the image, in particular the focus position, can be implemented by an adaptive lens. This means that the optics of at least one optical channel include an adaptive lens, and the multi-aperture imaging device includes a lens control member configured to adjust the optical properties of the adaptive lens. This includes, for example, the focal length, the wavelength range of the wavelengths transmitted or filtered, the refractive index, etc.

[0218] Embodiments make it possible to reduce the number of channels, resulting in low manufacturing costs and smaller installation space requirements for the footprint in the x / y direction. In addition, high quality imaging is possible.

[0219] In particular, embodiments can be used in the area of ​​multi-aperture imaging systems in mobile components of smartphones, and also in the automotive area or in machine imaging (machine partitioning).

[0220] Even if some aspects have been described in the context of a device, it should be understood that the aspects also represent a description of the corresponding method, so that the blocks or structural components of the device are also understood as corresponding method steps or features of method steps. Similarly, aspects described in conjunction with or as method steps also represent descriptions of corresponding blocks or details or features of corresponding devices.

[0221] The embodiments described above represent only illustrations of the principles of the present invention. It should be understood that other persons skilled in the art will appreciate any modifications and variations of the arrangements and details described herein. This is why it is intended that the present invention be limited only by the scope of the following claims and not by the specific details presented herein by way of the description and discussion of the embodiments.

Claims

1. A multi-aperture imaging device, comprising: An image sensor component (12) having a plurality of image sensor regions (44); a plurality of optical channels (42), wherein each optical channel (42) comprises an optical element (41) for imaging a partial field of view (64) of a full field of view (60) onto an image sensor region (44) of the image sensor member (12) associated with the optical channel (42); wherein the partial field of view corresponds to the portion of the full field of view transmitted using the optical channel (42); wherein the plurality of optical channels (42) are configured to completely image the full field of view (60); and wherein a first partial field of view (64a) of the full field of view (60) is acquired through a first number of optical channels (42), and a second partial field of view (64b) of the full field of view is acquired through a second number of optical channels (42), wherein the first number is different from the second number; The multi-aperture imaging device comprises exactly three optical channels (42a-c), and the three optical channels (42a-c) are configured to completely image the full field of view (60) by means of the second-acquired first partial field of view (64a) and the separately acquired second partial field of view (64b).

2. The multi-aperture imaging device according to claim 1, further comprising: A component (78) for image evaluation is configured to obtain image information from the plurality of image sensor areas (44) based on images of a plurality of partial fields of view (64), and to combine the corresponding plurality of partial images in order to obtain a total image of the full field of view (60), such that the total image is based on different numbers of partial images in different total image areas.

3. A multi-aperture imaging device according to claim 2, wherein the component (78) for image evaluation is configured to combine first image information based on a combination of a first image of the first partial field of view (64a) and a second image of the first partial field of view (64a) so as to obtain depth information for the first partial field of view (64a), and to obtain the total image based on aligning the first image information relative to second image information, wherein the second image information is obtained by means of a separate optical channel.

4. A multi-aperture imaging device according to claim 1, wherein the first partial field of view (64a) is imaged through exactly two optical channels (42a, 42c), and the second partial field of view (64b) is imaged through a single optical channel (42b), so that the full field of view is acquired as two partial fields of view with three optical channels, wherein the exactly two optical channels acquire the same portion of the object area as the first partial field of view (64a), and the single optical channel (42b) acquires a different portion of the object area as the second partial field of view (64b).

5. A multi-aperture imaging device according to claim 1, wherein the plurality of optical channels are arranged adjacently in an array (14) of optical channels (42), and an optical channel (42b) for imaging the second partial field of view (64b) is arranged between two optical channels (42a, 42c) in the array (14) for imaging the first partial field of view (64a).

6. The multi-aperture imaging device according to claim 1, wherein the first optical element (41b) of the first optical channel (42b) for imaging the second partial field of view (64b) is arranged opposite to the second optical element (41a) of the second optical channel (42a) for imaging the first partial field of view (64a) and the third optical element (41c) of the third optical channel (42c); The multi-aperture imaging device comprises a beam deflecting member (18) for deflecting the optical paths (22) of the first, second and third optical channels (42), the member being arranged between the first optical element on the one hand and the second and third optical elements on the other hand.

7. The multi-aperture imaging device of claim 1, wherein an optical channel for imaging the first partial field of view (64a) is arranged adjacent to and spaced apart from an optical channel (42b) for imaging the second partial field of view (64b).

8. The multi-aperture imaging device of claim 1, wherein the optical channel (42) for imaging the first partial field of view (64a) is arranged adjacent to and opposite to the optical channel (42b) for imaging the second partial field of view (64b).

9. A multi-aperture imaging device according to claim 1, wherein the full field of view (60) is a first full field of view (601); and wherein the plurality of optical channels include at least one optical channel (42d) for imaging a third partial field of view (64c) of a second full field of view (602) and one optical channel (42e) for imaging a fourth partial field of view (64d) of the second full field of view (602), wherein the second full field of view (602) includes an overlap with the first full field of view (601).

10. The multi-aperture imaging device according to claim 9, wherein the second full field of view (602) is a part of the first full field of view (601); or wherein the first full field of view (601) is a part of the second full field of view (602).

11. A multi-aperture imaging device according to claim 9, wherein the component (78) for image evaluation is configured to obtain image information from the multiple image sensor areas (44) based on the images of the multiple partial fields of view (64), and to create a total image of the second full field of view (602) using image information obtained by the image sensor areas (44) associated with the optical channels used to image the first full field of view (601).

12. The multi-aperture imaging device of claim 9, wherein the optical channels for imaging the first full field of view (601) and the optical channels for imaging the second full field of view (602) are arranged in a mutually linear array (14) of optical channels.

13. The multi-aperture imaging device according to claim 12, wherein an optical channel for acquiring the second full field of view (602) is separated from at least one optical channel for acquiring the first full field of view (601).

14. A multi-aperture imaging device according to claim 9, wherein optical channels for imaging the first full field of view (601) are arranged in a first linear array (141) of optical channels, and wherein optical channels for imaging the second full field of view (602) are arranged in a second linear array (142) of optical channels, wherein the first linear array (141) and the second linear array (142) are arranged opposite to each other.

15. The multi-aperture imaging device of claim 1, wherein at least a first optical channel and a second optical channel of the plurality of optical channels are adjacently arranged in a mutual array (14) of optical channels.

16. A multi-aperture imaging device according to claim 15, wherein the mutual array comprises a mutual carrier (39), at least a portion of the optical elements (41) of the first optical channel and the second optical channel are mechanically fixed to the mutual carrier (39), and wherein the optical channels extend through the carrier (39).

17. The multi-aperture imaging device of claim 1, wherein the first partial field of view (64a) and the second partial field of view (64b) are arranged adjacent to each other in the full field of view (60) and partially overlap each other.

18. The multi-aperture imaging device of claim 1, wherein the plurality of optical channels are arranged in a common plane in at least one line extending along a first direction (y); And the centers of the multiple partial fields of view are adjacent in the second direction to form a one-dimensional array, and are arranged perpendicular to the first direction.

19. The multi-aperture imaging device of claim 1, comprising a beam deflecting member (18) for deflecting the optical paths (22) of the plurality of optical channels (42).

20. A multi-aperture imaging device according to claim 19, wherein the beam deflecting member (18) is formed as an array of facets, wherein one facet is associated with each optical channel (42), and wherein each of the facets includes a first beam deflecting region and a second beam deflecting region, wherein the facets are formed as mirrors having reflectivity on both sides.

21. The multi-aperture imaging device of claim 20, configured to deflect the plurality of optical channels into a first direction using the first major side in a first state; and deflecting the plurality of optical channels into a second direction using the second major side in a second state; wherein the beam deflecting member (18) is rotationally movable between the first state and the second state.

22. The multi-aperture imaging device of claim 1, wherein at least one optical channel is part of an imaging module comprising a combined component including the optics (41) and an associated image sensor area (44) of the optical channel.

23. The multi-aperture imaging device according to claim 22, wherein one module comprises at least two optical channels, wherein the image sensor regions (44) and / or the optics (41) of the optical channels comprise a mutual substrate.

24. A multi-aperture imaging device according to claim 1, wherein the plurality of optical channels includes a first group of optical channels; and includes a second group having at least one optical channel, wherein the first group is configured to completely acquire the full field of view (60), and wherein the second group is configured to incompletely acquire the full field of view (60).

25. The multi-aperture imaging device of claim 1, comprising: A beam deflecting member (18) for deflecting an optical path (22) of the optical channel (42); An optical image stabilizer is configured to generate a relative movement between the image sensor member (12), the optical member (41) of the optical channel and the beam deflection member based on a translational movement between the image sensor member and the optical member parallel or antiparallel to a line extension direction (y) along which the optical member is arranged, and / or based on a rotation of the beam deflection member (18) around a rotation axis, so as to allow optical image stabilization.

26. A multi-aperture imaging device according to claim 25, wherein the image stabilizer includes at least one actuator and is arranged so that it is at least partially arranged between two planes (63a, 63b) spanned by side surfaces of a rectangular parallelepiped, wherein the side surfaces of the rectangular parallelepiped are aligned parallel to each other and to a line extension direction (y) of a portion of the array of optical channels and the optical paths of the optical channels between the image sensor member and the beam deflection member (18), and the volume of the rectangular parallelepiped is as small as possible while still including the image sensor member, the array and the beam deflection member.

27. A multi-aperture imaging apparatus according to claim 1, comprising a focusing member comprising an actuator for providing relative movement between an optic (41) of one of the optical channels and the image sensor member (12).

28. The multi-aperture imaging device according to claim 27, comprising a beam deflecting member (18) for deflecting the optical path (22) of the optical channel (42); The focusing member comprises at least one actuator for adjusting the focus of the multi-aperture imaging device, wherein the focusing member is arranged so that it is at least partially arranged between two planes (63a, 63b) spanned by side surfaces of a rectangular parallelepiped, wherein the side surfaces of the rectangular parallelepiped are aligned parallel to each other and to a line extension direction (y) of a portion of the array of optical channels (42) and the optical path (22) of the optical channels between the image sensor member (12) and the beam deflection member (18), and the volume of the rectangular parallelepiped is as small as possible while still comprising the image sensor member, the array and the beam deflection member (18).

29. The multi-aperture imaging device of claim 1, wherein the optical element (41) of at least one optical channel comprises an adaptive lens; wherein the multi-aperture imaging device comprises a lens control member configured to adjust optical properties of the adaptive lens.

Images