Multi-aperture imaging device, imaging system and method for providing a multi-aperture imaging device

Abstract

A multi-aperture imaging device comprises an array of image sensors and optical channels, wherein each optical channel comprises an optical device for imaging at least a portion of a total field of view onto an image sensor area of ​​the image sensor. The multi-aperture imaging device comprises a beam deflection device, the beam deflection device comprising: at least one beam deflection element for deflecting an optical path of the optical channel, wherein each optical channel is assigned a beam deflection element. The beam deflection element is configured to include a transparent state of a controllable surface based on a first electrical control, and to include a reflective state of the controllable surface based on a second electrical control, so as to deflect the optical path.

Description

[0001] This application is a divisional application of the Chinese invention patent application "Multi-aperture imaging device, imaging system and method for providing a multi-aperture imaging device" with an application date of May 17, 2018 and application number 201880034071.X. Technical Field

[0002] The present invention relates to a multi-aperture imaging device, an imaging system and a method for providing a multi-aperture imaging device. The present invention also relates to viewing direction switching in an array line camera by means of an electrically switchable mirror such as a liquid crystal mirror, and more particularly to viewing direction switching without mechanically moving parts. Background Art

[0003] Conventional cameras have imaging channels that image the entire object field. Multi-aperture imaging devices can image the object field with the aid of several partial fields of view. There is the idea that by using a beam deflection system such as a mirror, the viewing direction of the camera channel can be deflected from the device plane to another direction of the entire system, for example, approximately perpendicular thereto. For example, in the case of a mobile phone application, this vertical deflection can take place in the direction of the user's face or in the direction of the surrounding area in front of the user and can take place essentially with the aid of a switchable folding mirror.

[0004] There would be a need for multi-aperture imaging devices, imaging systems, and methods for providing multi-aperture imaging devices that enable mechanically robust concepts. Summary of the invention

[0005] It is therefore an object of the present invention to provide a multi-aperture imaging device, an imaging system and a method for providing a multi-aperture imaging device, which enable a compact and at the same time mechanically robust design of the multi-aperture imaging device.

[0006] This object is achieved by the subject-matter of the independent claims.

[0007] One finding of the invention is that it has been recognized that the above objects can be achieved by switching the viewing direction with the aid of a beam deflection element which is electrically controllable and can alternately have a transparent state and a reflective state, so that the deflection of the viewing direction can be achieved by electrical control. This makes it possible to replace mechanically moved beam deflection mirrors, thereby achieving high mechanical robustness, while maintaining a compact design.

[0008] According to an embodiment, a multi-aperture imaging device includes an array of image sensors and optical channels, wherein each optical channel includes an optical device for imaging at least a portion of a total field of view onto an image sensor area of ​​the image sensor. The multi-aperture imaging device also includes a beam deflection device, which includes at least one beam deflection element having a controllable surface for deflecting an optical path of the optical channel, wherein each optical channel is assigned a beam deflection element. The beam deflection element is configured to include a transparent state of the controllable surface based on a first electrical control, and include a reflective state of the controllable surface based on a second electrical control to deflect the optical path.

[0009] According to another embodiment, the beam deflection device comprises at least one mirror element, wherein each optical channel is assigned a mirror element, the mirror element being arranged such that in the transparent state of the controllable surface, the beam deflection device deflects the optical path by means of the mirror element. For example, this may be an optical path which in the transparent state passes through the electrically controllable beam deflection element and subsequently travels to the mirror element. This enables deflection in two directions arbitrarily towards each other (e.g. 180°) by using only one controllable beam deflection element.

[0010] According to another embodiment, the beam deflection element is a first beam deflection element, wherein each optical channel is assigned a second beam deflection element of the beam deflection device, the second beam deflection element being arranged such that in the transparent state of the first beam deflection element the optical path of the optical channel runs to the second beam deflection element. This means that two beam deflection elements can be arranged in series one after the other along the optical path. This enables beam deflection in two directions while avoiding classical mirrors and / or enables beam deflection in three directions, for example, in case both beam deflection elements simultaneously comprise a transparent state.

[0011] According to another embodiment, the beam deflecting element comprises a first actively controllable surface and a second actively controllable surface controllable to a transparent state and a reflective state. The first controllable surface and the second controllable surface are arranged at an angle of at least 10° and at most 170° towards each other. This enables the two beam deflecting elements to be combined in a single beam deflecting element and enables the directional deflection in the beam deflecting element to be adjusted.

[0012] According to another embodiment, the first controllable surface is arranged in a first diagonal surface of a beam deflecting element body (e.g. a cube, etc.), and the second controllable surface is arranged in a second diagonal surface of the beam deflecting element body. This enables the beam deflecting element to be assembled from separate components whose outer edges form the diagonal surfaces of the entire body.

[0013] According to an embodiment, the first controllable surface and the second controllable surface are arranged in a tilted manner towards each other around an axis arranged parallel to the line extension direction of the array. By means of the tilting of the controllable surfaces towards each other, a difference in viewing direction can be set by switching the beam deflecting element.

[0014] According to an embodiment, the angle comprises 90° within a tolerance range of 10%.This enables switching between different viewing directions at an angle of approximately 180°.

[0015] According to an embodiment, the beam deflection element comprises a first prism, a second prism, a third prism and a fourth prism having a triangular base shape, wherein the first controllable surface is formed to include a first surface element and a second surface element, wherein the second controllable surface is formed to include a third surface element and a fourth surface element. Each of the first to fourth surface elements is arranged at a prism surface of one of the first to fourth prisms. The prisms are arranged so that the first surface element and the second surface element form a first controllable surface, and the third surface element and the fourth surface element form a second controllable surface. This makes it possible to obtain a prismatic body whose diagonal surfaces are formed by the controllable surfaces of the beam deflection element. This makes it possible to obtain a beam deflection element with high optical quality.

[0016] According to an embodiment, the first surface element comprises a first layer stack, which provides switching between a transparent state and a reflective state. The order of the layers in the first layer stack is complementary to the order of the layers in the second layer stack of the second controllable surface element. This achieves a homogeneous and uniform layer order in the first controllable surface, for example in the case where the layers have mutually different orientations (e.g. twisted 180°) due to the bonding prisms.

[0017] According to an embodiment, the beam deflection element comprises a controllable surface which can be controlled to a reflective state and a transparent state. The beam deflection device comprises a plurality of beam deflection elements arranged along the line extension direction of the array. The controllable surfaces of the plurality of beam deflection elements are arranged in the beam deflection device in a manner inclined towards each other, so that the optical channels are deflected in different partial fields of view of the mutual total field of view. This enables the capture of a large area in the form of a total field of view and at the same time achieves a substantially parallel orientation of the optical path between the image sensor and the beam deflection device, enabling simple and highly precise production.

[0018] According to an embodiment, the beam deflection device comprises a plurality of identically formed beam deflection elements along a line extension direction along which the optical channels are arranged in an array. The plurality of beam deflection elements are arranged along the line extension direction in a manner rotated toward each other. This enables the direction of the optical channel deflection to be determined by determining the rotation angle, which is easy to implement.

[0019] According to another embodiment, the multi-aperture imaging device comprises a focusing device comprising at least one actuator for setting the focus of the multi-aperture imaging device. The actuator is configured to provide a relative movement between at least one of the optical devices and the image sensor. This enables a high-quality picture to be obtained by means of a variable focus.

[0020] According to an embodiment, the first optics of the first optical channel comprises a first focal length and the second optics of the second optical channel comprises a second focal length. The first focal length deviates from the second focal length by at least 10%. This enables different opening angles in the partial field of view or the total field of view of the imaging.

[0021] According to an embodiment, a first group having at least one optical channel including an optic with a first focal length is configured to image a first total field of view. A second group having at least one optical channel including an optic with a second focal length is configured to image a second total field of view. Due to the interaction between the different focal lengths, different total fields of view can be imaged.

[0022] According to an embodiment, a multi-aperture imaging device comprises: an optical image stabilizer interacting with two, more than one or all optical paths of an optical channel for achieving optical image stabilization along a first image axis and a second image axis by generating a translational relative movement between the image sensor and the array. The translational relative movement proceeds parallel to the first image axis and the second image axis of an image captured by the multi-aperture imaging device. This enables obtaining an image with high quality by using optical image stabilization.

[0023] According to an embodiment, a multi-aperture imaging device includes: an electronic image stabilizer that acts on two, multiple or all optical paths of an optical channel to achieve electronic image stabilization along a first image axis and a second image axis. The electronic image stabilizer is arranged alternatively or additionally to the optical image stabilizer. For example, the focal length of the optical device may be intentionally or unintentionally different, so that the optical image stabilization works differently in different optical channels. By additionally applying an electronic image stabilizer, such different effects can be reduced or compensated. Alternatively, the application of the electronic image stabilizer enables channel-individual image stabilization, so the use of the optical image stabilizer can be omitted.

[0024] According to an embodiment, the electronic image stabilizer is configured to perform channel-individual electronic image stabilization in each channel according to a set functional dependency that depends on the relative movement between the image sensor and the array obtained by optical image stabilization and / or focusing. If the optical properties and / or the performed relative movement are known, the effect in the image of the optical channel can be known in advance, which can be compensated by the electronic image stabilizer so that a high-quality image can be obtained.

[0025] According to an embodiment, a multi-aperture imaging device comprises: a control device for alternately controlling a beam deflecting element to be in a transparent state and a reflective state based on a user input.

[0026] According to another embodiment, an imaging system includes first and second multi-aperture imaging devices configured to capture a total field of view, at least partially, stereoscopically.

[0027] According to another embodiment, a method for providing a multi-aperture imaging device includes: providing an image sensor; providing an array of optical channels, such that each optical channel includes an optical device for imaging at least a portion of a total field of view onto an image sensor area of ​​the image sensor. The method includes arranging a beam deflection device, the device including: at least one beam deflection element having a controllable surface, for deflecting an optical path of the optical channel, such that each optical channel is assigned a beam deflection element. The method is performed so that the beam deflection element is configured to include a transparent state based on a first electrically controlled controllable surface, and to include a reflective state based on a second electrically controlled controllable surface to deflect the optical path.

[0028] Further preferred embodiments are the subject matter of the dependent claims. BRIEF DESCRIPTION OF THE DRAWINGS

[0029] Preferred embodiments of the present invention will now be described with reference to the accompanying drawings, in which:

[0030] Figure 1a shows a schematic perspective view of a multi-aperture imaging device according to an embodiment;

[0031] Figure 1b It is shown that according to an embodiment, Figure 1a Schematic diagram of the total field of view captured by the multi-aperture imaging device;

[0032] Figure 1c Shows Figure 1b Schematic diagram of a total field of view that is completely imaged by two partial fields of view and captured stereoscopically by four optical channels;

[0033] Figure 2 shows a schematic side cross-sectional view of an optical channel of a multi-aperture imaging device including a mirror element according to an embodiment;

[0034] Figure 3 shows a schematic top view of an optical channel of a multi-aperture imaging device according to another embodiment, wherein two beam deflecting elements are assigned to the optical channel;

[0035] Figure 4shows a schematic top view of an optical channel of a multi-aperture imaging device according to another embodiment, wherein the beam deflecting element comprises two actively controllable surfaces tilted towards each other;

[0036] Figure 5 It shows that according to the embodiment Figure 4 Schematic side cross-sectional view of a possible embodiment of a beam deflecting element;

[0037] Figure 6a shows a schematic side cross-sectional view of a layer stack according to an embodiment comprising four layers, which at least partially form a surface element of a controllable surface;

[0038] Figure 6b It shows that according to the embodiment Figure 6a Assembly of stacked layers;

[0039] Figure 7 shows a schematic side cross-sectional view of a beam deflecting device according to an embodiment, the beam deflecting device comprising two beam deflecting elements;

[0040] Figure 8 shows a schematic perspective view of a multi-aperture imaging device according to an embodiment, wherein the optical channel array includes three optical channels;

[0041] Fig. 9 shows a schematic diagram of two total fields of view that may be captured with a multi-aperture imaging device according to embodiments described herein;

[0042] Fig.10 is a schematic perspective view of an imaging system according to an embodiment; and

[0043] Fig.11 A schematic flow chart of a method for providing a multi-aperture imaging device according to an embodiment is shown. DETAILED DESCRIPTION

[0044] Before subsequently describing in detail embodiments of the present invention with reference to the accompanying drawings, it should be noted that identical, functionally identical, and operationally identical elements, objects, and / or structures are provided with the same figure markings in different drawings, so that the descriptions of these elements in different embodiments are interchangeable and / or mutually applicable.

[0045] Figure 1a 1 is a schematic perspective view of a multi-aperture imaging device 10 according to an embodiment. The multi-aperture imaging device 10 includes an image sensor 12, an array 14 of optical channels 16a to 16d, and a beam deflection device 18. Each optical channel 16a to 16d includes an optical device 64a, 64b, 64c and 64d, respectively, for imaging at least a portion of the total field of view to an image sensor region 24a, 24b, 24c and 24d of the image sensor 12, respectively.

[0046] The beam deflection device 18 includes a plurality of beam deflection elements 46a to 46d. Each optical channel can be assigned a beam deflection element 46a to 46d, which means that one or more optical channels can be deflected by the beam deflection elements 46a to 46d. The beam deflection elements 46a to 46d are configured to include optical states that can be changed based on the electrical control 23. To this end, each beam deflection element can include: a controllable surface 29a-29d, including a transparent state and / or a reflective state based on electrical control. The first state can be a substantially transparent state at least in a wavelength range (e.g., visible light) associated with a multi-aperture imaging device. For example, the transparent state can include a photon transmittance of at least 50%, at least 70%, or at least 80% at least in a relevant viewing angle range (e.g., 0° to 70°, 0° to 60°, or 0° to 50°). In the second state, the beam deflection element can be substantially formed to be reflective. This means that the light is reflected to a degree of at least 50%, at least 70%, or at least 80% within the relevant wavelength range and within the relevant viewing angle range. An example of an element comprising such functionality is a mirror using a liquid crystal substrate, such as sold by KENTOPTRONICS.

[0047] Now, the controllability in the reflective or transmissive state enables that in the reflective state the optical paths 26a to 26d of the optical channels 16a to 16d can be deflected by the beam deflecting elements 46a to 46d, as shown by the optical paths 26'a to 26'd. In the transparent state, the optical paths 26a to 26d can pass through the beam deflecting elements 46a to 46d essentially unimpeded, wherein low deflection or scattering is possible due to the surface effects of the beam deflecting elements 46a to 46d.

[0048] The multi-aperture imaging device 10 enables switching between two viewing directions along the optical paths 26a to 26d and 26'a to 26'd based on the electrical control 23. The electrical control 23 can occur such that each beam deflection element 46a to 46d is individually controllable, which means that some optical channels 16a to 16d can be deflected while other optical channels can remain undeflected. The multi-aperture imaging device 10 can be implemented such that the beam deflection elements 46a to 46d can be controllable and / or can be controlled in a mutual manner during a desired change from one operating state to another operating state, i.e. tuned relative to each other. For example, this means that all optical paths are deflected (26'a to 26'd) or undeflected (26a to 26d) at the same time.

[0049] Although the multi-aperture imaging device 10 is shown as including four optical channels, imaging the total field of view onto four image sensor areas 24a to 24d by imaging partial fields of view, and for this purpose including a beam deflection device having four beam deflection elements 46a to 46d, the multi-aperture imaging device may include any other number of optical channels, for example, at least two, at least three, at least four, at least ten or at least 20. The beam deflection device 18 may include a corresponding or smaller number of beam deflection elements for deflecting in the direction of the optical paths 26'a to 26'd. Alternatively, two or more optical channels may include mutual beam deflection elements, so that a smaller number of beam deflection elements 46a to 46d may be sufficient.

[0050] Although the array 14 is shown to include one line along the line extension direction 65, the array 14 may also include a greater number of lines, such as at least two, at least three, or more.

[0051] Figure 1b A schematic diagram of a total field of view 70 that can be captured by a multi-aperture imaging device 10, for example, is shown. Each of the optical channels 16a to 16d can be configured to capture a partial field of view 72a, 72b, 72c or 72d of the total field of view 70, wherein the partial fields of view 72a to 72d can overlap each other. The arrangement of the partial fields of view 72a to 72d should only be understood as an example and can be changed at will. Different numbers of optical channels 16a to 16d in the multi-aperture imaging device 10 can cause different numbers of partial fields of view 72a to 72d in the total field of view 70. Alternatively or additionally, it is also possible that the optical channels included in the multi-aperture imaging device 10 image the partial fields of view 72a to 72d twice (i.e. at least stereoscopically) or even more times. For example, a plurality of four optical channels 16a to 16d can be implemented so that two partial fields of view are each captured twice to obtain stereo information.

[0052] Figure 1c A schematic diagram of a total field of view 70 is shown, which is completely imaged by two partial fields of view (e.g., 72a and 72c, 72a and 72d, 72b and 72c, or 72b and 72d), wherein two or more optical channels are configured to capture substantially the same partial fields of view 72a / 72b or 72c / 72d, respectively. In this case, substantially the same means that the partial fields of view overlap by at least 80%, at least 90%, or at least 95%, such as 99%, while deviations from each other may occur, for example, due to parallax. The assignment of the optical channels 16a to 16d of the multi-aperture imaging device 10 to the partial fields of view 72a to 72d can be arbitrary. For example, the optical channels 16a and 16c and the optical channels 16b and 16d can each capture the same partial field of view, which enables an equal substrate distance between the two optical channels to capture the same partial field of view.

[0053] Figure 2 A schematic side cross-sectional view of a portion of the multi-aperture imaging device 20 is shown, in particular, a schematic side cross-sectional view of the route of the optical path 26 of the optical channel 16 is shown. As described in conjunction with the multi-aperture imaging device 10, the multi-aperture imaging device 20 is configured to deflect the optical path 26 to the direction 25a in the reflective state of the beam deflecting element 46. To this end, Figure 2 Solid lines representing the main beams at the edge of the field of view (FOV) and the central viewing direction are shown. The dotted line represents the deflected optical path 26', which is deflected to the direction 25a relative to the edge and also relative to the average viewing direction. In the transparent state of the beam deflecting element 46, the optical path 26 runs through or passes through the beam deflecting element 46. In the process from the image sensor area 24 via the optical element 64 and the beam deflection element 46, the mirror element 27 is arranged behind the beam deflection element 46 (for example, an electro-passive and / or mechanical mirror) and is configured to deflect the optical path 26 to the direction 25b so as to obtain the main beam through the double-dotted line shape as the deflected optical path 26 at the edge of the field of view and the average viewing direction. "For example, the mirror element 27 can be fixed, that is, it is arranged rigidly relative to the substrate or base of the optical channel 16. Although some elements (such as the optical device 64 and / or the image sensor 12) can be movable based on the focusing device and / or optical image stabilization described below to affect the imaging of various parts of the field of view or the entire field of view, the mirror element 27 can be fixedly arranged.

[0054] Figure 2 Only one optical channel 16 is shown, wherein a plurality or several optical channels may be arranged as described in conjunction with the multi-aperture imaging device 10. The directions 25a and 25b may have any orientation towards each other, for example in opposite directions (e.g. 180°), depending on the orientation of the beam deflection element 46 and / or the mirror element 27. Each optical channel may be assigned a mirror element 27, wherein two or several optical channels may also be deflected by means of the mirror element 27.

[0055] In other words, different channels may have different deflection angles of the mirrors and / or beam deflecting elements 46 in order to direct the optical paths into different partial fields of view of the total field of view. Figure 2 A combination of a controllable or switchable mirror and a classical mirror for beam deflection, for example along the facing or world side of a mobile phone device, is shown. This arrangement may be simple but may require more installation space than the multi-aperture imaging device 10 .

[0056] Figure 3A schematic top view of a portion of a multi-aperture imaging device 30 according to another embodiment is shown, in which two beam deflection elements 46a and 46e are assigned to the optical channel 16. Compared to the multi-aperture imaging device 20, the mirror element 27 can be implemented or replaced by another controllable beam deflection element 46e. Therefore, two or several beam deflection elements 46a and 46e can be arranged in the course of the optical path. Controlling the beam deflection element 46a to a reflective state enables the optical path 26 to be deflected to the viewing direction 25a. Controlling the beam deflection element 46a to a transparent state enables the optical path 26 to travel to the beam deflection element 46e by controlling the beam deflection element 46e to a reflective state, and also optionally deflects the optical path 26 into the viewing direction 25b. This arrangement of the beam deflection elements 46a and 46e and possible other beam deflection elements enables the optical path to be deflected to the direction 25b by switching the beam deflection element 46a to a transparent state and switching the beam deflection element 46e to a reflective state. Furthermore, the multi-aperture imaging device 30 includes a third viewing direction 25c (e.g., an unchanged viewing direction between the optics 64 and the image sensor area 24), which can be obtained if both the beam deflecting elements 46a and 46e are switched to a reflective state. Thus, three locally different total fields of view can be captured. Figure 3 Only a schematic diagram of one optical channel 16 is shown, wherein a plurality or a large number of optical channels 16 are arranged as described in conjunction with the multi-aperture imaging device 10. Therefore, a greater number of viewing directions of the multi-aperture imaging device 30 can be obtained compared to the multi-aperture imaging device 20. The beam deflecting elements 46a and 46e can be arranged in series one after another, so that controlling the beam deflecting element 46a to be in a transparent state enables the optical path to be deflected or not deflected by the beam deflecting element 46e.

[0057] Figure 4 A schematic top view of a cross section of a multi-aperture imaging device 40 according to another embodiment is shown, wherein the beam deflection element 46' comprises two actively controllable surfaces 29a and 29b that are tilted towards each other compared to the beam deflection element 46. Each controllable surface 29a and 29b is configured to be controllable to a transparent state and a reflective state. Control can occur independently of each other controllable surface 29a and 29b.

[0058] The controllable surfaces 29a and 29b may be arranged in an inclined manner towards each other around an axis 31 having an angle α. The axis 31 may be arranged parallel to a line extension direction 65 of the multi-aperture imaging device 10 along which the optics of the optical channels 16a to 16d are arranged, for example relative to a line arrangement in the array 14 of the multi-aperture imaging device 10. The angle α may have any value and may include, for example, at least 10° and at most 170°, at least 30° and at most 150°, or at least 50° and at most 140°, for example 90°. For example, the angle α may be 90° with a tolerance range of 10%, 8% or 5%. The beam deflection element 46' with two controllable surfaces 29a and 29b may also be understood as two controllable beam deflection elements at the same position according to the multi-aperture imaging device 30, which means that instead of being connected in series, the deflection may also occur at a mutual position in the direction 25a or 25b, or may be maintained in the direction 25c.

[0059] For example, the control device may be configured to control one of the controllable surfaces 29a or 29b to a transparent state and the other controllable surface to a reflective state, respectively.

[0060] As shown in dashed outline, the beam deflecting element 46' may include a beam deflecting body 33 in which the controllable surface 29a and the further controllable surface 29e are arranged. For example, the controllable surfaces 29a and 29e may be diagonal surfaces of the beam deflecting body 33. For example, the beam deflecting body 33 may include a rectangular shape (e.g. a square, or include such a shape).

[0061] In order to reduce or avoid reflection losses and / or transmission losses where possible, the controllable surfaces 29a and 29e can be formed so that they are independent of polarization, which preferably refers to two operating states, namely a reflective state and a transparent state. In addition, it is also possible that the controllable surface includes a plurality of pixels that can be individually controllable, so that all pixels can include a reflective state or a transparent state, or alternatively, some pixels can include a transparent state and some pixels can include a reflective state at the same time.

[0062] Such a beam deflection element 46' may also be referred to as an X-cube, since the controllable surfaces may be arranged in the form of an X relative to each other. This may also be understood as a one-dimensional cross mirror in order to deflect the beam path to a corresponding direction. Compared to the multi-aperture imaging device 20, this may involve increased production costs and / or increased complexity, but allows for smaller installation space requirements.

[0063] Figure 5 Shows Figure 4 Schematic side cross-sectional view of a possible implementation of a beam deflecting element 46'. Figure 4The controllable surfaces 29a and 29e of the embodiment may be, for example, divided into two or more surface elements 29a1 and 29a2 and 29e1 and 29e2, i.e. comprise or be formed of surface elements. The beam deflecting element 46' may include a plurality of (eg, four) prisms 35a to 35d, which may be joined to form Figure 4 The beam deflector 33 of the embodiment of the present invention. For example, the prisms 35a to 35d may include a triangular base shape. Alternatively, another shape is possible, for example, if the beam deflector 33 includes a greater number of polygonal shapes, such as a hexagon (where a square can still be drawn and corresponds to the above discussion). Each of the surface elements 29a1, 29a2, 29e1 and 29e2 can be arranged at the side of one of the prisms 35a to 35d. Although Figure 5 It is shown that each prism comprises exactly one surface element 29a1 to 29e2, but several surface elements 29a1 to 29e2 can be arranged at the prism. For example, it is conceivable to arrange the surface element 29e1 at the prism 35a, so that the surface element 29a1 is arranged at the side shown and the surface element 29b1 is arranged at the adjacent tangential surface. For example, the prism 35c can be embodied so that it is formed without an active surface and, for example, serves as a filler and / or matrix for other surfaces.

[0064] Electrical connections 37a and 37b can connect the surface elements 29a1 and 29a2 of the controllable surfaces 29a and 29b, respectively, and 29e1 and 29e2, so that the surface elements of the controllable surfaces can control each other. By temporarily or permanently joining the prisms 35a to 35d along the arrows 39a to 39d shown, the beam deflection body 33 can be obtained. Immersion gluing of the prisms can be used to facilitate the joining of the prisms so that as small a number or preferably no air gaps remain inside the beam deflection body 33, but a single-body action body is obtained.

[0065] In other words, the X-cube can be a joined connection of glass prisms with a 90° angle, comprising a suitable electrical connection and lead-in arrangement of the active surface of the switchable liquid crystal mirror. Thus, the assignment of the beam deflection can be obtained purely by electrical control. The prism is shown in a side cross-sectional view. The top view can show a polygonal view such as a square view, for example. The prisms can or should be arranged towards each other in a high-precision manner so as to reduce or avoid transition effects between surface elements.

[0066] Figure 6aA schematic side cross-sectional view of a layer stack 51a comprising layers S1 to S4 (e.g. at least partially forming a surface element 29a1) is shown. In addition, a layer stack 51b is shown, which also comprises layers S1 to S4 and can at least partially form a surface element 29a2. The order of layers S1, S2, S3 and S4 can be mutually complementary between layer stacks 51a and 51b, wherein this can particularly refer to the materials of layers S1 to S4. Thus, for example, due to the materials used for active surfaces 29a and 29e or their order, the transparent state of the main surfaces 29a and 29e can be substantially transparent in both directions, however, it can be slightly different along different viewing directions.

[0067] Figure 6b It is shown that, for example, Figure 5 The arrows 39a to 39d in FIG. 39a show the bonded connection of the layer stacks 51a and 51b obtained by bonding the prisms 35a to 35d. Figure 5 , it can be seen that depositing the same sequence of layers on the substrate bodies 36a to 36d of the prisms 35a and 35b (for example comprising a transparent material such as transparent plastic or glass) can result in the fact that, due to the orientation of the prisms 35a and 35b towards each other, after bonding the prisms 35a and 35b, Figure 6a and Figure 6b The layer sequence shown in FIG. 1 is not uniform during the layer process. Although it is within the scope of the embodiments described herein, Figure 6a The possibility of obtaining uniform characteristics along the layer is shown.

[0068] Figure 6b The layer stacks 51a and 52b are shown in an orientation after being arranged at the prisms 35a and 35b and according to Figure 5 2. The LC mirror is assembled by a process of performing a plurality of processes. The substrate bodies 36a and 36b may be joined so that the layers S1 to S4 and the substrate bodies 36a and 36b have few or no inclusions or defects. It is shown that the layers within the active surface 29 may be uniform over the surface elements 29a1 and 29a2. This allows uniform optical properties to be obtained over the entire surface. In other words, the layer system of the LC mirror may be adapted to avoid that the beam deflecting element comprises the substrate body only on one side and operates on air on the other side. Adjustment is made so that both sides of the beam deflecting element have a high refractive index.

[0069] although Figure 6a and Figure 6b The bonding connection of surface elements 29a1 and 29a2 is described, but surface elements 29e1 and 29e2 may also be bonded without limitation. Although layer stacks 51a and 51b are described as comprising four layers S1 to S4, the layer stacks may also comprise a different number of layers, such as 2, 3, 5 or more layers.

[0070] Figure 7 1 shows a schematic side cross-sectional view of the beam deflection device 18, including beam deflection elements 46'a and 46'b. Figure 4 and / or Figure 5 and / or Figure 6a and Figure 6b As discussed above, beam deflection elements 46'a and 46'b can be formed separately. The same controllable surfaces 29a and 29'a and 29e and 29'e of different beam deflection elements 46'a and 46'b can be arranged in the beam deflection device 18 in a manner tilted toward each other. Different tilts make it possible to deflect the optical channel to different directions and to different partial fields of view. Although different tilts are described as being perpendicular to the axis 31 and therefore perpendicular to the line extension direction 65, it is also possible that the respective same surfaces 29a and 29'a and 29e and 29'e can also be tilted toward each other along the axis 31, so that two-dimensional different deflections are obtained by the beam deflection device 18. As shown by the dotted lines, the beam deflection elements 46'a and 46'b can be arranged to rotate toward each other around the axis 31 in order to obtain the tilt of the controllable surfaces 29a and 29'a, 29e and 29'e.

[0071] In other words, different optical channels include slightly different orientations and / or rotations of the beam deflector 33 in order to direct the optical path to a desired portion of the total field of view.

[0072] In the following, some advantageous embodiments of the multi-aperture imaging device described herein are explained. Specifically, reference is made to a focusing device, optical image stabilization, and electronic image stabilization for focusing an image. Although these three embodiments are described in conjunction with the multi-aperture imaging device 80, it is further noted that the focusing device, optical image stabilizer, and electronic image stabilizer may be implemented individually or in any combination with each other, as each of the described devices may be implemented individually in order to obtain the inherent advantages of the corresponding module.

[0073] The above-mentioned elements for beam deflection 27 and / or 46 and / or 46' can be optically connected in series with each other in any combination, which means that, for example, at least one beam deflection element 46 and / or 46' can be combined with a mirror element and / or beam deflection element 46 at one or several positions.

[0074] Figure 8A schematic perspective view of a multi-aperture imaging device 80 is shown, wherein the array 14 comprises three optical channels 16a, 16b and 16c (as an example and without any limiting effect). The multi-aperture imaging device 80 comprises a focusing device 87, which may comprise one or several actuators 89a, 89b and / or 89c. The first actuators 89a to 89c may be mechanically connected to the array 14 or to at least one of its optical devices, the image sensor 12 and / or the beam deflection device 18 in order to change the relative movement between the individual components along the course of the optical path between the image sensor 12 and the beam deflection device 18. The focusing device 87 is advantageously configured to perform a relative movement between the image sensor 12 and the array 14 along the extension direction of the optical paths 26a to 26c described with x, so that the beam deflection device 18 can remain stationary. By changing the distance between the array 14 or at least one of its optical devices and the image sensor 12, the focus of the multi-aperture imaging device 80 can be set. This means that, although the optical devices 64a, 64b and 64c are shown such that they are arranged on a mutual carrier so as to be movable together with the array 14, at least one of the optical devices 64a-64c (alternatively or additionally, at least one image sensor area 24a-24c and / or at least one beam deflection area 46a-46c) can be individually moved by the focusing device 97 in order to set the focus for the individual optical channels, thereby also enabling channel-individual focusing. This can be particularly advantageous if the beam deflection areas 46a-46c include refractive power or so-called "optical power", i.e. include a slight focusing function, for example due to a slightly curved outer surface or a connected lens. Optical power can also be understood as refractive power, refractive power, focusing power or converging power and describes the degree to which a lens, mirror or other optical system converges or diverges light.

[0075] Alternatively or additionally, it is possible that the total fields of view and / or partial fields of view arranged along different viewing directions (e.g. transparent beam deflection elements 46a-46c for a first viewing direction and reflective beam deflection elements 46a-46c for a second viewing direction) are different. Thus, partial fields of view of different sizes, different aspect ratios between the extension along the first image direction and the extension along the second viewing direction and / or altered relative positions in the respective total fields of view may be implemented. For example, optical elements such as lenses or filters may be arranged.

[0076] Optical elements (e.g., optics 64a-64c) arranged between the image sensor and the beam deflection element (e.g., "in front" of the beam deflection) can work together for several viewing directions. The multi-aperture imaging device 80 or another multi-aperture imaging device described herein may include one or several optical elements 67a-67c, which are arranged "behind" the beam deflection element 46a, 46b or 46c, so that in the optical path 26a-26c or 26'a-26'c, each beam deflection element 46a-46c is arranged between the optical element 67a-67c and the image sensor 12. Although the optical elements 67a-67c are shown as channel-separate optical elements, where each optical channel 16a-16c is assigned one of the elements 67a-67c, at least one optical element can also be used for several optical channels. Alternatively or additionally, different optical properties or multiple optical elements 67a-67c can be implemented for different optical channels. Although the optical elements are shown as being arranged along the undeflected optical paths 26a-26c, alternatively or additionally, the optical elements may also be arranged along at least one of the undeflected optical paths 26'a, 26'b, and / or 26'c. With respect to the optical elements 67a-67c, the optical paths 26a-26c may be affected by the optical elements 67a-67c along a first viewing direction of the multi-aperture imaging device 80, and may not be affected by the optical elements 67a-67c along a second viewing direction. For example, the optical elements 67a-67c may preferably be lightweight diffractive lenses for magnifying the field of view in various portions of the optical paths, such that the partial fields of view, and thus the total field of view, may include different sizes along different viewing directions.

[0077] As an alternative or in addition to the optical elements 67a-67c, the optical elements 67a-67c may be any other optical elements suitable for capturing, such as filters, etc. The autofocus mechanism that can be implemented may be adapted to the different optical characteristics of each viewing direction and may update or adjust the functionality accordingly.

[0078] As an alternative or in addition to the previous possibilities for adjusting the total field of view, it is also possible to implement an adjustment of the refractive power within the active surface of one or several beam deflection elements 46a-46c. This means that the adjustment can be performed by utilizing a viewing direction deflection of the beam deflection elements. At least one of the beam deflection elements 46a-46c can be configured to perform mutually different optical adjustments of the deflected or undeflected optical channels 16a-16c in the transparent state and in the reflecting state. For example, the controllable surface of the beam deflection element can provide mutually different focusing or defocusing or another optical function of the optical channels 16a-16c in the reflecting state and in the transmitting state. This can be used, for example, in combination with Figure 6a and Figure 6bThe controllable surface explained is implemented in the layers S1-S4 or in the substrate thereof. Alternatively or additionally, the controllable surface may include a curvature for focusing or defocusing. When a beam deflecting element 46' is used, the following is within an embodiment of the present invention: different active surfaces 29a and 29e are adjusted differently in the optical channel, which means that the controllable surfaces 29a and 29e can be different. By adjusting along the viewing direction and / or adjusting differently along different viewing directions, fields of view of different sizes can be obtained on the world side (the viewing direction of the device pointing away from the user) and on the user side (the opposite viewing direction). This can be achieved to a certain extent by different optical capabilities, i.e. the refractive power in the optical channel or the mirror. In each of these directions in or in front of the mirror or the deflecting element, element updating along the optical axis can be implemented for refocusing.

[0079] Based on manufacturing inaccuracies and / or based on different embodiments of the optical devices 64a to 64c, the optical devices 64a to 64c may include different focal lengths f1, f2 and / or f3. These different focal lengths may give rise to the fact that, in particular, upon mutual movement of the optical devices, for example during focusing, the adjustment of the images of the image sensor areas 24a to 24c may have different effects. This effect may also occur in the case where the beam deflection device 18 moves relative to the array 14 and / or the image sensor 12 while focusing. The multi-aperture imaging device 80 may include an optical image stabilizer 22 and / or an electronic image stabilizer 41 in order to compensate for different image scaling in the image channels and jitters of the multi-aperture imaging device 80 relative to the scene. For example, the optical image stabilizer 22 can be configured to act on a single optical channel, for at least two optical channels, for a plurality of optical channels and for all optical channels 16a to 16c and thus on their optical paths, for example by moving the individual image sensor areas 24a to 24c, the individual optical devices 64a to 64c and / or the individual beam deflection areas 46a to 46c relative to each other. Groups of image sensor areas 24, optical devices 64 and / or beam deflection areas 46 can also be moved, for example by mechanical connections to a mutual carrier. In this way, all components of the individual elements can also be moved, which means that the image sensor 12 can be moved in order to move all image sensor areas, the array 14 can be moved in order to move all optical devices 64, and / or the beam deflection device 18 can be moved in order to move all beam deflection areas 46. Optical image stabilization may be obtained by generating a translational relative movement between the image sensor 12, the array 14 and the beam deflection device 18 along the first image direction 28 and the second image direction 32, for example a movement along the main extension direction of the image sensors 24a to 24c. Preferably, the optical image stabilizer 22 is configured to move the image sensor 12 and the array 14 relative to each other along the image directions 28 and 32. A simple possibility for implementation is to bring the optical image stabilizer 22 into contact with the array 14, so that only the electro-passive elements are moved, while the electrical connections in the image sensor 12 may remain unmoved. The movement of the array 14 may take place in the y / z plane, for example, to avoid a rotation of the beam deflection device 18, which is possible for image stabilization in y, which is sometimes avoided due to the design and size or mass of the beam deflection device 18 and / or the multi-aperture imaging device 80.

[0080] The electronic image stabilizer 41 can be connected to the image sensor 12 and can be configured to obtain image information from the image sensor areas 24a to 24c. The electronic image stabilizer can be configured to act on one, two, multiple or all optical paths 26a to 26c of the optical channels 16a to 16c by manipulating the image information in the image sensor areas 24a to 24c. Electronic image stabilization can also be performed along the image axes 28 and 32. When the electronic image stabilizer 41 is configured so that it acts on two or more optical paths 26a to 26c, the electronic image stabilizer 41 can be configured to perform electronic image stabilization in a channel-by-channel manner for each optical channel. The electronic image stabilizer 41 can be configured to perform channel-by-channel electronic image stabilization by evaluating each individual image in the image sensor areas 24a to 24c, or to provide electronic image stabilization so that alignment with another optical channel or another image is performed. In this way, for example, by means of the optical image stabilizer 22, a global effect can be obtained, i.e. an optical image stabilization acting on two, several or all optical channels 16a to 16c, which however acts differently due to the different focal lengths f1 to f3 in each optical channel, so that an ideal and maximum possible optical image stabilization can be obtained individually in one of the optical channels 16a to 16c, while in the other optical channels deviations from the ideal value may be obtained due to the focal length differences. The electronic image stabilizer 41 can be configured to electronically stabilize in a reference manner the other optical channels which have deviations from the optical channel with high-quality optical image stabilization. Thus, the optical channel with high-quality optical image stabilization can be used as a reference channel. This means that electronic image stabilization can also be omitted in the reference channel.

[0081] Electronic image stabilization in an optical channel different from a reference channel may be performed based on a set functional correlation. The focal lengths f1 to f3 and the effects in the multi-aperture imaging device 80 produced by the optical image stabilizer 22 and / or other movements may be constant, such that the functionally-dependent effects are known in advance due to the geometrical arrangement in the multi-aperture imaging device 80 based on the movements between the image sensor 12, the array 14 and the beam deflection device 18 obtained, for example, via the optical image stabilizer 22 or the focusing device 87. The electronic image stabilizer 41 may be configured to perform channel-individual electronic image stabilization in each channel based on the set functional correlation.

[0082] According to an embodiment, the multi-aperture imaging device 80 includes a focusing device for channel-individually setting the focus of the multi-aperture imaging device. For example, the actuator 89a is configured to provide channel-individual relative movement between the optical devices 64a to 64c and the image sensor 12. The electronic image stabilizer 41 is configured to act on one, two, multiple or all optical paths 26a-26c of the optical channels 16a-16c and provide image stabilization along the image axes 28 and 32.

[0083] The multi-aperture imaging device 80 may further comprise a control device 53 configured to control the beam deflecting elements 46a to 46c individually or mutually to a transparent or reflective state. To this end, the control device 53 may obtain a user input 55, such as a command for a viewing direction change.

[0084] With respect to the multi-aperture imaging device 80, it has been explained that the focal lengths of the optical devices may differ from each other based on manufacturing deviations. Alternatively, the multi-aperture imaging device may also include optical devices that include a desired deviation of the focal lengths relative to each other. The desired deviation may be understood as a deviation of a first focal length of a first optical device from a second focal length of a second optical device that differs by at least 10%, at least 20%, or at least 30%.

[0085] Fig. 9 A schematic diagram of two total fields of view 70a and 70b that can be captured with a multi-aperture imaging device according to embodiments described herein is shown. For example, such a multi-aperture imaging device includes five optical channels, four of which are formed in substantially the same manner. Such an optical channel may include an opening angle η3, wherein the individual images captured in this manner may be combined to a total field of view 70a that generally includes an opening angle η1. Now, the fifth optical device may include the above-mentioned focal length difference and may be formed to include, for example, an opening angle η2 that is greater than the opening angle η3 and / or may be less than the opening angle η1. For example, an optical channel including an opening angle η2 may be configured to completely cover the full field of view 70b. Optical channels including optics with opening angles η2 and / or η3 may be combined into an optical channel group, wherein the group includes at least one optical channel. Although the total field of view 70b is described such that it is captured by a single optical channel, according to other embodiments, the total field of view 70b may also be captured by a group consisting of at least two optical channels.

[0086] The total field of view 70b may overlap the total field of view 70a at least partially or completely. Alternatively, the total fields of view 70a and 70b may also be at least partially different from each other, for example if the optical paths are deflected to different directions. The total field of view 70b may be a portion of the total field of view 70a, i.e. an incomplete portion thereof. The total field of view 70b preferably comprises a smaller opening angle than the total field of view 70a, which may cause the imaged portion of the object area in the total field of view 70b to be smaller than the total field of view 70a. In the case of the same sensor area, this means that a larger portion of the object area is imaged onto an image sensor of the same size compared to the partial fields of view 72a to 72d. This means that the opening angle η1 of the total field of view 70a may be greater than the opening angle η2 of the total field of view 70b, wherein these angles may be directly related to the focal length of the optical device. The optical device for capturing the total field of view 70b may be a tele-objective or a zoom objective, or at least provide a corresponding functionality, compared to the combination of optical devices for capturing the total field of view 70a, and conversely, the combination of optical devices for capturing the total field of view 70a may be a wide-angle objective, or at least provide a corresponding functionality, compared to the combination of optical devices for capturing the total field of view 70b.

[0087] Fig.10 A schematic perspective view of an imaging system 100 is shown, which includes: a first multi-aperture imaging device 10a and a second multi-aperture imaging device 10b, which are configured together to capture a total field of view 70 in a stereoscopic manner. The capture areas of the multi-aperture imaging devices 10a and 10b can completely overlap with each other, so that the total field of view 70 is completely captured in a stereoscopic manner. Alternatively, the capture areas may only partially overlap, so that stereoscopic capture is performed only in the overlapping area. Alternatively, another multi-aperture imaging device described above, such as the multi-aperture imaging devices 20, 30 and / or 40, can be arranged instead of the multi-aperture imaging device 10a or 10b. Although the imaging device 100 is described such that it includes two multi-aperture imaging devices 10a and 10b, any other number (for example, three, four, five or more) of multi-aperture imaging devices may alternatively be arranged.

[0088] For example, the imaging system 10 can be a mobile device, such as a tablet computer or a mobile phone (e.g., a smart phone). Specifically, in mobile devices or devices such as phones, movable parts may be undesirable due to system stability, service life, mechanical shock sensitivity, wear, etc. The embodiments described herein enable the use of mechanical movable parts to be minimized at least at positions that can be replaced by immovable parts. Depending on the considerations, this can even occur by compromising other parameters (e.g., complexity or cost), meaning that it is acceptable to obtain a slightly more complex system if movable parts can be avoided. The embodiments described herein describe an arrangement in which the articulated mirror is replaced by an arrangement of electrically switchable mirrors (e.g., in the form of an array). In the array, each individual switchable mirror can be placed to rotate relative to each other so as to obtain a subdivision of the field of view. A combination of a switchable liquid crystal mirror with a normal (static) mirror and an arrangement of two switchable liquid crystal mirrors can be implemented. For example, two switchable liquid crystal mirrors can be arranged on a 90° prism, and their combination can occur in the following manner: two crossed complementary switchable mirror surfaces are arranged at 90° to each other and cross each other along a line, which can also be referred to as an X cube.

[0089] Fig.11 A schematic flow chart of a method 1100 for providing a multi-aperture imaging device according to an embodiment is shown. Step 1110 includes providing an image sensor. Step 1120 includes providing an array of optical channels, such that each optical channel includes an optical device for imaging at least a portion of a total field of view onto an image sensor area of ​​the image sensor. Step 1130 includes arranging a beam deflection device, the beam deflection device including: at least one beam deflection element for deflecting an optical path of the optical channel, such that each optical channel is assigned a beam deflection element, whereby the beam deflection element is configured to include a transparent state based on a first electrical control and a reflective state based on a second electrical control to deflect the optical path.

[0090] The invention can be further implemented by the following embodiments, which can be combined with any of the examples and embodiments described and claimed herein:

[0091] 1. An embodiment of a multi-aperture imaging device, comprising:

[0092] Image sensor embodiments;

[0093] An array embodiment of an optical channel embodiment, wherein each optical channel embodiment comprises: an optics embodiment for imaging at least a portion of an embodiment of a total field of view embodiment onto an image sensor area embodiment of said image sensor embodiment;

[0094] A beam deflecting device embodiment, comprising: at least one beam deflecting element embodiment having a controllable surface embodiment for deflecting an optical path embodiment of an optical channel embodiment, wherein each optical channel embodiment is assigned a beam deflecting element embodiment;

[0095] Wherein the beam deflecting element embodiment is configured to include a transparent state of the controllable surface embodiment based on a first electrical control embodiment and include a reflective state of the controllable surface embodiment based on a second electrical control embodiment to deflect the optical path embodiment.

[0096] 2. A multi-aperture imaging device according to embodiment 1, wherein the beam deflecting device embodiment includes at least one mirror element embodiment, wherein each optical channel embodiment is assigned a mirror element embodiment, and the mirror element is arranged so that in the transparent state of the controllable surface embodiment, the beam deflecting device embodiment utilizes the mirror element embodiment to deflect the optical path embodiment.

[0097] 3. A multi-aperture imaging device according to embodiment 1, wherein the beam deflection element embodiment is a first beam deflection element, and wherein each optical channel embodiment is assigned a second beam deflection element embodiment of the beam deflection device embodiment, and the second beam deflection element is arranged so that in the transparent state of the controllable surface embodiment of the first beam deflection element embodiment, the optical path embodiment of the optical channel travels to the second beam deflection element embodiment.

[0098] 4. A multi-aperture imaging device according to embodiment 1, wherein the controllable surface embodiment is a first controllable surface embodiment, wherein the beam deflecting element includes a second controllable surface embodiment, the second controllable surface can be controlled to be the transparent state and the reflective state, and wherein the first controllable surface and the second controllable surface embodiment are arranged toward each other at an angle of at least 10° and at most 170°.

[0099] 5. A multi-aperture imaging device according to embodiment 4, wherein the first controllable surface embodiment is arranged in a first diagonal surface of a beam deflecting element body embodiment, and wherein the second controllable surface embodiment is arranged in a second diagonal surface of the beam deflecting element body embodiment.

[0100] 6. The multi-aperture imaging device of embodiment 5, wherein the first controllable surface embodiment and the second controllable surface embodiment are arranged in a tilted manner toward each other around an axis embodiment parallel to a line extension direction embodiment of the array embodiment.

[0101] 7. The multi-aperture imaging device of embodiment 4, wherein the angle embodiment comprises a value of 90° within a tolerance range of 10%.

[0102] 8. A multi-aperture imaging device according to embodiment 4, wherein the beam deflecting element embodiment includes a first prism, a second prism, a third prism and a fourth prism embodiment having a triangular base shape, wherein the first controllable surface embodiment is formed to include a first surface element embodiment and a second surface element embodiment, wherein the second controllable surface embodiment is formed to include a third surface element embodiment and a fourth surface element embodiment, wherein each of the first to fourth surface element embodiments is arranged at a prism surface of one of the first to fourth prism embodiments, and the prism embodiments are arranged so that the first surface element and the second surface element embodiment form the first controllable surface embodiment, and the third surface element and the fourth surface element embodiment form the second controllable surface embodiment.

[0103] 9. A multi-aperture imaging device according to embodiment 8, wherein the first surface element embodiment includes a first layer stack embodiment, the first layer stack provides switching between the transparent state and the reflective state, and the order of the layer embodiments in the first layer stack embodiment is complementary to the order of the layer embodiments in the second layer stack embodiment of the second controllable surface element embodiment.

[0104] 10. A multi-aperture imaging device according to embodiment 1, wherein the beam deflecting device embodiment includes a plurality of beam deflecting element embodiments arranged along a line extension direction embodiment of the array, wherein the controllable surface embodiments of the plurality of beam deflecting element embodiments are arranged in the beam deflecting device embodiment in a manner inclined toward each other, so that the optical channel embodiments are deflected to different partial field of view embodiments of the mutual total field of view embodiments.

[0105] 11. A multi-aperture imaging device according to embodiment 1, wherein the beam deflection device embodiment includes a plurality of identically formed beam deflection element embodiments along a line extension direction embodiment, the optical channel embodiment is arranged in the array embodiment along the line extension direction, and the plurality of beam deflection element embodiments are arranged along the line extension direction embodiment in a manner rotated toward each other.

[0106] 12. The multi-aperture imaging device according to embodiment 1 further includes a focusing device embodiment, wherein the focusing device includes at least one actuator embodiment for setting the focus of the multi-aperture imaging device, wherein the actuator embodiment is configured to provide relative movement between at least one of the optical device embodiments and the image sensor.

[0107] 13. A multi-aperture imaging device according to embodiment 1, wherein the first optical device embodiment of the first optical channel embodiment includes a first focal length embodiment, and wherein the second optical device embodiment of the second optical channel embodiment includes a second focal length embodiment, wherein the first focal length deviates from the second focal length by at least 10%.

[0108] 14. A multi-aperture imaging device according to embodiment 13, wherein the first group has at least one optical channel embodiment and the optical channel includes an optical device embodiment with the first focal length embodiment, the first group is configured to image a first total field of view embodiment, and wherein the second group has at least one optical channel embodiment and the optical channel includes an optical device with the second focal length embodiment, the second group is configured to image a second total field of view embodiment.

[0109] 15. The multi-aperture imaging device of embodiment 1, wherein the beam deflecting element embodiment is configured to perform different optical adjustments to the optical channel embodiment in the transparent state and the reflective state.

[0110] 16. A multi-aperture imaging device according to embodiment 15, wherein the beam deflecting element embodiment includes a controllable surface embodiment that can be controlled to be the transparent state and the reflective state, wherein the controllable surface embodiment provides different focusing or defocusing of the optical channel embodiment in the reflective state and the transparent state.

[0111] 17. A multi-aperture imaging device according to embodiment 1, wherein the beam deflection element embodiment is arranged between the image sensor and the optical element embodiment, so that the optical path embodiment is affected by the optical element embodiment along a first viewing direction of the multi-aperture imaging device and is not affected by the optical element embodiment along a second viewing direction.

[0112] 18. The multi-aperture imaging device according to embodiment 1 further includes: an optical image stabilizer embodiment, which acts together on one, two, more than one or all optical path embodiments of the optical channel embodiment to perform optical image stabilization along the first image axis embodiment and the second image axis embodiment by generating a translational relative movement between the image sensor embodiment and the array embodiment, wherein the translational relative movement is performed parallel to the first image axis embodiment and the second image axis embodiment of the image captured by the multi-aperture imaging device.

[0113] 19. The multi-aperture imaging device according to embodiment 1 also includes: an electronic image stabilizer embodiment, which acts on one, two, more than one or all optical path embodiments of the optical channel embodiment to perform electronic image stabilization along the first image axis embodiment and the second image axis embodiment.

[0114] 20. The multi-aperture imaging device of embodiment 19, wherein the electronic image stabilizer embodiment is configured to perform image stabilization in a channel-by-channel manner for each optical channel embodiment.

[0115] 21. The multi-aperture imaging device of embodiment 20, wherein the electronic image stabilizer embodiment is configured to stabilize an image of an optical channel embodiment relative to an optically stabilized reference image in another optical channel embodiment.

[0116] 22. A multi-aperture imaging device according to embodiment 18, wherein the electronic image stabilizer embodiment is configured to: perform channel-independent electronic image stabilization in each channel embodiment according to a set functional correlation, wherein the set functional correlation depends on the relative movement between the image sensor embodiment, the array embodiment and the beam deflection device embodiment.

[0117] 23. The multi-aperture imaging device according to embodiment 1, further comprising:

[0118] A focusing apparatus embodiment, comprising: at least one actuator embodiment for setting the focus of a multi-aperture imaging device in a channel-independent manner, wherein the actuator embodiment is configured to provide channel-independent relative movement between the optics embodiment and the image sensor embodiment;

[0119] An electronic image stabilizer embodiment operates on one, two, more than one or all optical path embodiments of the optical channel embodiment to perform image stabilization along a first image axis embodiment and a second image axis embodiment.

[0120] 24. The multi-aperture imaging device according to embodiment 1 further comprises: a control device embodiment for alternately controlling the beam deflecting element embodiment to the transparent state and the reflective state based on a user input embodiment.

[0121] 25. The multi-aperture imaging device embodiment of embodiment 1, configured to detect the total field of view embodiment at least in part in a stereoscopic manner.

[0122] 26. An embodiment of a multi-aperture imaging device, comprising:

[0123] Image sensor embodiments;

[0124] An array embodiment of an optical channel embodiment, wherein each optical channel embodiment comprises: an optics embodiment for imaging at least a portion of an embodiment of a total field of view embodiment onto an image sensor area embodiment of said image sensor embodiment;

[0125] A beam deflecting device embodiment, comprising: at least one beam deflecting element embodiment having a controllable surface embodiment for deflecting an optical path embodiment of an optical channel embodiment, wherein each optical channel embodiment is assigned a beam deflecting element embodiment;

[0126] wherein the beam deflecting element embodiment is configured to include a transparent state of the controllable surface embodiment based on a first electrical control embodiment and to include a reflective state of the controllable surface embodiment based on a second electrical control embodiment to deflect the optical path embodiment,

[0127] wherein the controllable surface embodiment is a first controllable surface embodiment, wherein the beam deflecting element comprises a second controllable surface embodiment, the second controllable surface being controllable to the transparent state and the reflective state, wherein the first controllable surface and the second controllable surface embodiment are arranged at an angle of at least 10° and at most 170° towards each other; and

[0128] wherein the beam deflecting element embodiment comprises a first prism, a second prism, a third prism and a fourth prism embodiment having a triangular base shape, wherein the first controllable surface embodiment is formed to include a first surface element embodiment and a second surface element embodiment, wherein the second controllable surface embodiment is formed to include a third surface element embodiment and a fourth surface element embodiment, wherein each of the first to fourth surface element embodiments is arranged at a prism surface of one of the first to fourth prism embodiments, and the prism embodiments are arranged so that the first surface element and the second surface element embodiment form the first controllable surface embodiment, and the third surface element and the fourth surface element embodiment form the second controllable surface embodiment.

[0129] 27. An embodiment of a method for providing a multi-aperture imaging device, comprising:

[0130] Provide an embodiment image sensor;

[0131] providing an array of embodiment optical channels such that each optical channel includes optics for imaging at least a portion of a total field of view onto an image sensor area of ​​the image sensor;

[0132] Arrangement of an embodiment beam deflection device, the beam deflection device comprising: at least one beam deflection element having a controllable surface for deflecting an optical path of an optical channel such that each optical channel is assigned a beam deflection element;

[0133] The beam deflecting element is configured to include a transparent state of the controllable surface based on a first electrical control, and a reflective state of the controllable surface based on a second electrical control, so as to deflect the optical path.

[0134] 28. An embodiment of a method for providing a multi-aperture imaging device, comprising:

[0135] Provide an embodiment image sensor;

[0136] providing an array of embodiment optical channels such that each optical channel includes optics for imaging at least a portion of a total field of view onto an image sensor area of ​​the image sensor;

[0137] Arrangement of an embodiment beam deflection device, the beam deflection device comprising: at least one beam deflection element having a controllable surface for deflecting an optical path of an optical channel such that each optical channel is assigned a beam deflection element;

[0138] Such that the beam deflecting element is configured to include a transparent state of the controllable surface based on a first electrical control and a reflective state of the controllable surface based on a second electrical control to deflect the optical path;

[0139] Such that the controllable surface embodiment is a first controllable surface embodiment, wherein the beam deflecting element comprises a second controllable surface embodiment, the second controllable surface being controllable to the transparent state and the reflective state, wherein the first controllable surface and the second controllable surface embodiment are arranged at an angle of at least 10° and at most 170° towards each other; and

[0140] The beam deflecting element embodiment includes a first prism, a second prism, a third prism and a fourth prism embodiment having a triangular base shape, wherein the first controllable surface embodiment is formed to include a first surface element embodiment and a second surface element embodiment, wherein the second controllable surface embodiment is formed to include a third surface element embodiment and a fourth surface element embodiment, wherein each of the first to fourth surface element embodiments is arranged at a prism surface of one of the first to fourth prism embodiments, and the prism embodiments are arranged so that the first surface element and the second surface element embodiment form the first controllable surface embodiment, and the third surface element and the fourth surface element embodiment form the second controllable surface embodiment.

[0141] An advantage of the embodiments described herein is that no additional mechanically moving parts are required in the imaging optical path to switch the viewing direction of the camera array between the facing side and the world side of the mobile device. A multi-aperture imaging system or multi-aperture imaging device according to the embodiments described herein may include a linear channel arrangement and a small installation size without including a mechanically movable deflection mirror for switching the viewing direction between the facing side and the world side. Even if some aspects have been described in the context of a device, it should be understood that the aspects also represent a description of the corresponding method, so that blocks or structural components of the device are also understood to be corresponding method steps or characteristics of method steps. Similarly, aspects described or described as method steps within the context of method steps also represent a description of corresponding blocks or details or features of the corresponding device.

[0142] The above embodiments are merely illustrative of the principles of the present invention. It should be understood that other persons skilled in the art will appreciate modifications and variations to the arrangements and details described herein. Therefore, the present invention is intended to be limited only by the scope of the appended claims, and not by the specific details presented herein through the description and discussion of the embodiments.

Claims

1. A multi-aperture imaging device, comprising: Image sensor; An array of optical channels, wherein each optical channel comprises: optics for imaging at least a portion of a total field of view onto an image sensor area of ​​the same image sensor; A beam deflecting device comprising: at least one beam deflecting element having a controllable surface for deflecting an optical path of an optical channel, wherein each optical channel is assigned a beam deflecting element; wherein the beam deflecting element is configured to include a transparent state of the controllable surface based on a first electrical control, and to include a reflective state of the controllable surface based on a second electrical control, to deflect the optical path; wherein the first optics of the first optical channel comprises optical properties of the first optics as a first focal length for capturing a first total field of view, and wherein the second optics of the second optical channel comprises optical properties of the second optics as a second focal length for capturing a second total field of view, wherein the first focal length of the first optics deviates from the second focal length of the second optics by at least 10%, and wherein the first total field of view overlaps with the second total field of view.

2. A multi-aperture imaging device according to claim 1, wherein the beam deflecting device includes at least one mirror element, wherein each optical channel is assigned a mirror element, and the mirror element is arranged so that in the transparent state of the controllable surface, the beam deflecting device utilizes the mirror element to deflect the optical path.

3. A multi-aperture imaging device according to claim 1, wherein the beam deflection element is a first beam deflection element, and wherein each optical channel is assigned a second beam deflection element of the beam deflection device, and the second beam deflection element is arranged so that in the transparent state of the controllable surface of the first beam deflection element, the optical path of the optical channel proceeds to the second beam deflection element.

4. A multi-aperture imaging device according to claim 1, wherein the controllable surface is a first controllable surface, wherein the beam deflecting element includes a second controllable surface, the second controllable surface can be controlled to be the transparent state and the reflective state, wherein the first controllable surface and the second controllable surface are arranged at an angle (α) of at least 10° and at most 170° toward each other.

5. A multi-aperture imaging device according to claim 4, wherein the first controllable surface is arranged in a first diagonal surface of a beam deflecting element body, and wherein the second controllable surface is arranged in a second diagonal surface of the beam deflecting element body.

6. The multi-aperture imaging device of claim 5, wherein the first controllable surface and the second controllable surface are arranged in a manner inclined toward each other around an axis parallel to the line extension direction of the array. 7 . The multi-aperture imaging device according to claim 4 , wherein the angle (α) comprises a value of 90° within a tolerance range of 10%.

8. A multi-aperture imaging device according to one of claims 4 to 6, wherein the beam deflecting element includes a first prism, a second prism, a third prism and a fourth prism having a triangular base shape, wherein the first controllable surface is formed to include a first surface element and a second surface element, wherein the second controllable surface is formed to include a third surface element and a fourth surface element, wherein each of the first surface element to the fourth surface element is arranged at a prism surface of one of the first prism to the fourth prism, and the prisms are arranged so that the first surface element and the second surface element form the first controllable surface, and the third surface element and the fourth surface element form the second controllable surface.

9. A multi-aperture imaging device according to claim 8, wherein the first surface element includes a first layer stack, the first layer stack provides switching between the transparent state and the reflective state, and the order of the layers in the first layer stack is complementary to the order of the layers in the second layer stack of the second surface element.

10. A multi-aperture imaging device according to claim 1, wherein the beam deflection device comprises a plurality of beam deflection elements arranged along a line extension direction of the array, wherein the controllable surfaces of the plurality of beam deflection elements are arranged in the beam deflection device in a manner inclined toward each other, so that the optical channel is deflected to different partial fields of view of a common total field of view.

11. A multi-aperture imaging device according to claim 1, wherein the beam deflection device includes a plurality of identically formed beam deflection elements along a line extension direction, the optical channel is arranged in the array along the line extension direction, and wherein the plurality of beam deflection elements are arranged along the line extension direction in a manner rotated toward each other.

12. The multi-aperture imaging device according to claim 1 further comprises a focusing device comprising at least one actuator for setting a focus of the multi-aperture imaging device, wherein the actuator is configured to provide relative movement between at least one of the optical devices and the image sensor.

13. A multi-aperture imaging device according to claim 1, wherein a first group has at least one optical channel and the optical channel includes an optical device with the first focal length, and the first group is configured to image a first total field of view, and wherein a second group has at least one optical channel and the optical channel includes an optical device with the second focal length, and the second group is configured to image a second total field of view.

14. The multi-aperture imaging device of claim 1, wherein the beam deflecting element is configured to perform different optical adjustments on the optical channel in the transparent state and the reflective state.

15. A multi-aperture imaging device according to claim 14, wherein the beam deflecting element comprises a controllable surface capable of being controlled to the transparent state and the reflective state, wherein the controllable surface provides different focusing or defocusing of the optical channel in the reflective state and the transparent state.

16. A multi-aperture imaging device according to claim 1, wherein the beam deflecting element is arranged between the image sensor and the optical element, so that the optical path is affected by the optical element along a first viewing direction of the multi-aperture imaging device and is not affected by the optical element along a second viewing direction.

17. The multi-aperture imaging device according to claim 1, further comprising: an optical image stabilizer that acts in concert with one, two, more than one or all of the optical paths of the optical channels to perform optical image stabilization along first and second image axes by producing a translational relative movement between the image sensor and the array, wherein the translational relative movement is performed parallel to the first and second image axes of an image captured by the multi-aperture imaging device.

18. The multi-aperture imaging device according to claim 1, further comprising: An electronic image stabilizer acts on one, two, more than one or all optical paths of the optical channel to perform electronic image stabilization along a first image axis and a second image axis.

19. The multi-aperture imaging device of claim 18, wherein the electronic image stabilizer is configured to perform image stabilization in a channel-individual manner for each optical channel.

20. The multi-aperture imaging device of claim 19, wherein the electronic image stabilizer is configured to stabilize an image in an optical channel relative to an optically stabilized reference image in another optical channel.

21. A multi-aperture imaging device according to claim 18, wherein the electronic image stabilizer is configured to: perform channel-individual electronic image stabilization in each channel according to a set functional correlation, wherein the set functional correlation depends on the relative movement between the image sensor, the array and the beam deflection device.

22. The multi-aperture imaging device according to claim 1, further comprising: A focusing arrangement comprising: at least one actuator for setting the focus of the multi-aperture imaging device in a channel-independent manner, wherein the actuator is configured to provide a channel-independent relative movement between the optics and the image sensor; An electronic image stabilizer acts on one, two, more than one or all optical paths of the optical channel to perform image stabilization along a first image axis and a second image axis.

23. The multi-aperture imaging device of claim 1, further comprising: A control device is used to control the beam deflecting element to be in the transparent state and the reflective state alternately based on user input.

24. The multi-aperture imaging device of claim 1, configured to detect the total field of view at least in part stereoscopically.

25. A method for providing a multi-aperture imaging device, comprising: Providing image sensors; providing an array of optical channels such that each optical channel includes optics for imaging at least a portion of a total field of view onto an image sensor area of ​​the same image sensor; arranging a beam deflection device, the beam deflection device comprising: at least one beam deflection element having a controllable surface for deflecting the optical paths of the optical channels, such that each optical channel is assigned a beam deflection element; Such that the beam deflecting element is configured to include a transparent state of the controllable surface based on a first electrical control and a reflective state of the controllable surface based on a second electrical control to deflect the optical path; The first optics of a first optical channel include optical properties of the first optics as a first focal length for capturing a first total field of view, and the second optics of a second optical channel include optical properties of the second optics as a second focal length for capturing a second total field of view, wherein the first focal length of the first optics deviates from the second focal length of the second optics by at least 10%, and wherein the first total field of view overlaps with the second total field of view.

Images