camera system

Abstract

A camera system (1) comprising a plurality of photodetectors (2) and a plurality of optical channels (3) is specified, wherein - the photodetectors (2) are arranged apart from each other in a detection plane (20), - each of the plurality of photodetectors (2) is assigned one of the optical channels (3), - each of the optical channels (3) has a principal viewing direction (30), and - the optical channels (3) include several different principal viewing directions (30). The camera system (1) is, for example, integrated into a display that uses micro-LEDs as light-emitting pixels.

Description

[0001] The present application concerns a camera system.

[0002] Many electronic devices, such as smartphones, are equipped with a user-facing camera, for example, for video calls or user identification. Typically, the camera is positioned to the side of the device's display. This reduces the space available for the device's display and also results in parallax between the camera and the center of the screen (for example, the image of a person during a video call).

[0003] One problem to be solved is to provide a camera system that is flat and can be integrated into or placed behind a disc, for example a screen.

[0004] This purpose is achieved, among other things, by a camera system according to claim 1. Further embodiments and advantages are the subject of the dependent claims.

[0005] A camera system with multiple photodetectors and multiple optical channels is described. The photodetectors are specifically designed to be sensitive to radiation emitted by an object being imaged by the camera system. This radiation could be, for example, electromagnetic radiation in the visible and / or infrared spectral ranges.

[0006] According to at least one embodiment of the camera system, the photodetectors are spaced apart from one another in a detection plane. The photodetectors are, for example, individual components arranged on a common substrate, such as a printed circuit board or a display backplane. Each photodetector can comprise one or more light-sensitive areas. The photodetectors distributed across the detection plane together form the pixels of the camera system. In contrast, in a conventional camera, all light-sensitive areas are integrated into a single, contiguous photodetector device.

[0007] According to at least one embodiment of the camera system, each of the optical channels has a principal viewing direction. The principal viewing direction comprises, for example, an angle to a perpendicular to the detection plane in a range of 0° to 30°. The optical channels are configured, for example, to converge the radiation from an object to be imaged onto the associated photodetector with one or more light-sensitive areas.

[0008] Each optical channel can contain one or more micro-optical elements. A beam path from an object to be imaged to one of the photodetectors thus passes through one or more micro-optical elements. These micro-optical elements are, for example, microlenses or optical elements based on metalenses or metamaterials. Particularly with metalenses or metamaterials, a single micro-optical element may suffice. For example, at least one optical channel, or all optical channels, can comprise at least two micro-optical elements arranged at different distances from the detection plane.

[0009] A micro-optical element, for example, has a lateral extent of at least 1 µm, or at least 5 µm, or at least 10 µm and / or at most 1 mm, or at most 500 µm, or at most 100 µm. In particular, the lateral extent of the micro-optical element refers to its optically effective area. Two or more of the micro-optical elements, in particular all of the micro-optical elements, can be formed in a common optical element or substrate, wherein the optically effective areas of adjacent micro-optical elements are laterally spaced apart.

[0010] According to at least one embodiment of the camera system, each of the multiple photodetectors is assigned one of the optical channels. In particular, each photodetector is illuminated only by radiation passing through exactly one of the optical channels. Thus, each photodetector is sensitive to radiation striking the camera system from a specific direction. For example, there is a 1:1 relationship between the optical channels and the photodetectors.

[0011] In at least one embodiment of the camera system, the camera system comprises a plurality of photodetectors and a plurality of optical channels, wherein the photodetectors are arranged spaced apart from one another in a detection plane. Each of the plurality of photodetectors is assigned one of the optical channels. Each of the optical channels has a principal viewing direction, wherein the optical channels comprise a plurality of different principal viewing directions.

[0012] Taken together, the optical channels can function similarly to the compound eyes of insects. The present camera system is based on the idea that the principle of a compound eye or a compound eye camera also works when the individual optical channels are distributed non-contiguously over a comparatively large area. Accordingly, the photodetectors that receive the radiation from the optical channels can be distributed over a large detection area within the detection plane. Thus, high spatial resolution can be achieved, even if the individual photodetectors do not offer spatial resolution.

[0013] Furthermore, the described camera system, which is based on multiple optical channels, can offer the functionality of a light field camera. Unlike a conventional, state-of-the-art light field camera, however, no main lens is required. Instead, both spatial and angular resolution are achieved via the optical channels with different principal viewing directions. Thus, the photodetectors assigned to the optical channels are sensitive to light incident from different directions.

[0014] The signals from the photodetectors combined can be used to reconstruct an image with depth or 3D information.

[0015] In other words, the optical parameters of the optical channels can be designed so that the optical channels, together with the spatially distributed photodetectors, form a camera based on the light field principle.

[0016] The distributed arrangement of the photodetectors with the associated optical channels can be integrated into a disk, for example a glass disk, or placed behind it, for example if the disk is part of a display or a projector.

[0017] The photodetectors can be arranged within a comparatively large detection area in the detection plane. Due to the large area over which the photodetectors and their associated optical channels are distributed, high resolutions can be achieved more easily than with conventional light field cameras.

[0018] For example, the lateral extent of the detection area is at least 2 cm, or at least 5 cm, or at least 10 cm. This allows for the use of a large number of photodetectors to achieve high spatial and angular resolution. For example, the camera system comprises at least 10,000 photodetectors, or at least 100,000 photodetectors, or at least 1,000,000 photodetectors, or at least 10,000,000 photodetectors.

[0019] According to at least one embodiment of the camera system, light emitters are arranged at least in some spaces between two adjacent photodetectors in a top view of the camera system. A top view is a view along the normal to the detection plane.

[0020] The light emitters are, for example, the pixels of a display or a projector. In other words, the camera system can be integrated into a display or a projector. For example, a screen cover can also form at least part of the optical channels. This allows the light emitted by the screen pixels to pass through the same screen as the light from the object being detected, which strikes the photodetectors that make up the pixels of the camera system, but at different, intertwined positions.

[0021] For example, a micro-optical element of the optical channel has a lateral extent that is less than or equal to the center-to-center spacing of adjacent light emitters, in particular less than or equal to the edge-to-edge distance between adjacent light emitters. Thus, a micro-optical element that converges the radiation onto the associated photodetector can be positioned between adjacent light emitters of the display in the top view of the camera system. The light emitters can form the pixels of the display, so that the center-to-center spacing of the adjacent light emitters can also be referred to as the pixel pitch of the display.

[0022] According to at least one embodiment of the camera system, the light emitters are micro-LEDs. Alternatively or additionally, one or more of the light emitters, or even all of them, can be lasers, for example, surface-emitting lasers such as vertical cavity surface-emitting lasers (VCSELs).

[0023] In the broadest sense, a micro-LED can be considered any light-emitting diode (LED) – generally not a laser – of particularly small size. Specifically, the micro-LED, for example its active region which emits radiation during operation, can be made of organic or inorganic materials.

[0024] As a rule - and this is a very important criterion besides size - a growth substrate is removed in micro-LEDs, so that typical heights of such micro-LEDs are, for example, in the range of 1.5 µm to 10 µm.

[0025] A micro-LED does not necessarily have to have a rectangular emission surface. For example, an LED could have an emission surface where, when viewed from above, each lateral dimension of the emission surface is less than or equal to 100 µm or less than or equal to 70 µm.

[0026] For example, for rectangular micro-LEDs, an edge length of less than or equal to 70 µm or less than or equal to 50 µm is often cited as a criterion – especially when viewed from above the layers of the layer stack. In particular, the edge length can also be less than 20 µm or less than 10 µm.

[0027] Most often, such micro-LEDs are provided on wafers with removable mounting structures that are non-destructive to the micro-LED.

[0028] Micro-LEDs are particularly suitable for displays. The micro-LEDs form pixels or subpixels and emit light of a specific color.

[0029] In the technical literature, various spellings for micro-LEDs can be found, for example µLED, µ-LED, uLED, u-LED or micro-light emitting diode.

[0030] The fill factor in a display that uses micro-LEDs as light-emitting pixels can be relatively small. For example, the distance between adjacent micro-LEDs can be greater than the edge length of a single micro-LED, for example by a factor of at least 1.5, 2, 3, or 10. This provides sufficient space between adjacent micro-LEDs for arranging one or more optical channels between two adjacent micro-LEDs.

[0031] According to at least one embodiment of the camera system, at least some of the light emitters are arranged in the detection plane. Consequently, during the manufacture of the camera system, the light emitters and the photodetectors can be placed on a common substrate such as a printed circuit board or a display backplane using similar or identical manufacturing processes.

[0032] For example, at least 10% or at least 50% or all light emitters are located in the detection plane.

[0033] According to at least one embodiment of the camera system, at least some of the light emitters are arranged on a substrate that is spaced away from the detection plane. The substrate is, for example, transparent to radiation in the visible and / or infrared spectral range.

[0034] According to at least one embodiment of the camera system, at least some of the light emitters are arranged at a greater distance from the detection plane than at least one optical element of one of the optical channels. In particular, at least 10% or at least 50% or all light emitters can be arranged at a greater distance from the detection plane than at least one optical element of one of the optical channels.

[0035] According to at least one embodiment, the camera system comprises a radiation source configured to illuminate an object to be imaged. The radiation source can emit radiation in the visible and / or infrared spectral range. The radiation is emitted, for example, in the form of a cone or a radiation pattern. The radiation can be used, for example, for structured illumination, such as facial recognition or biometric identification, particularly independently of ambient light. The camera system can include additional photodetectors specifically tuned to the radiation emitted by the radiation source, for example, infrared radiation. Thus, the radiation source, together with the additional photodetectors, can form an emission detection system invisible to the human eye.

[0036] According to at least one embodiment of the camera system, the light from the light source is directed onto the object to be imaged via a further optical channel associated with the light source. This further optical channel can be configured essentially in the same way as the optical channels for illuminating the photodetectors.

[0037] For example, the optical channel can include a diffractive optical element. The diffractive optical element can, for instance, be used to generate a radiation pattern from the radiation emitted by the radiation source.

[0038] According to at least one embodiment of the camera system, the camera system is designed for stereo vision.

[0039] The photodetectors and their associated optical channels are arranged in such a way that together they fulfill the function of two cameras that image the object to be imaged from two different directions.

[0040] According to at least one embodiment of the camera system, the majority of the different principal viewing directions include a first principal viewing direction and a second principal viewing direction. These two principal viewing directions are used, for example, for stereoscopic vision.

[0041] According to at least one embodiment of the camera system, the optical channels with the first principal viewing direction are arranged in a first region of the camera system, and the optical channels with the second principal viewing direction are arranged in a second region of the camera system, which is located laterally adjacent to the first region. The first region corresponds, for example, to the first half of a detection area, and the second region corresponds to the other half of the detection area. This arrangement maximizes the distance between the photodetectors used to capture an image in the first principal viewing direction and the photodetectors used to capture an image in the second principal viewing direction. Since the photodetectors can be distributed over a comparatively large detection area, a comparatively large stereo base can be achieved, resulting in high-quality 3D imaging.

[0042] According to at least one embodiment of the camera system, in a top view of the camera system, at least one of the optical channels with the second principal viewing direction is arranged between two of the optical channels with the first principal viewing direction. Since, in the present approach to the camera system, the arrangement of the imaging channels and the photodetectors need not be contiguous, the optical channels with the first principal viewing direction and the optical channels with the second principal viewing direction can also be mixed or nested.

[0043] This mixing could, for example, only be done for certain areas of the camera system, in order to enable stereo vision only for certain areas of the entire field of view of the camera system, or to increase the depth resolution in certain areas.

[0044] According to at least one embodiment of the camera system, at least one of the photodetectors comprises at least one photodiode, one pin photodiode, one avalanche photodiode (APD) and one single-photon avalanche diode (SPAD).

[0045] Unlike an avalanche photodiode, a SPAD is biased with a voltage higher than the reverse breakdown voltage of a pn junction. This allows for particularly high sensitivity, as the electric field is so strong that even a single charge carrier injected into the depletion layer can trigger a self-sustaining avalanche.

[0046] According to at least one embodiment of the camera system, at least one of the photodetectors comprises a plurality of light-sensitive areas. For example, multiple light-sensitive areas can be used to increase the spatial resolution and / or the angular resolution. Additionally or alternatively, multiple light-sensitive areas can be used to enable parallel readout and thus avoid dead times after detection, for example when using a SPAD.

[0047] According to at least one embodiment of the camera system, the camera system comprises a data processing system configured to extract an image from the signals received by the plurality of photodetectors. The data processing system includes, for example, an image processing system connected to the plurality of photodetectors, for example, via readout electronics. If the camera system also includes a display, the data processing system may also be configured to control the display, for example, via display control electronics.

[0048] According to at least one embodiment of the data processing system, the data processing system is configured to extract depth information from the image. In this way, the camera system can offer features of a conventional light field camera, such as the ability to change the focus distance or depth of field after the image has been captured.

[0049] According to at least one embodiment of the camera system, the data processing system is configured to extract depth information from the image. This depth information can be used, for example, to create a stereo or three-dimensional image or a three-dimensional model of the scene depicted. The depth of field can be adjusted, for instance, in portrait photography.

[0050] The described camera system can be used, for example, for access control, especially in combination with biometric identification options through an integrated radiation source.

[0051] The additional depth information can, for example, be registered and used for algorithmic refocusing or changing the depth of field, or for generating 3D information.

[0052] The camera system can be used in a smartphone, in a vehicle, in aerospace or in another electronic device, especially in combination with a display of the electronic device.

[0053] Since the photodetectors can be distributed across the display area, it is not necessary to place the camera to the side of the display.

[0054] In particular, the detection area of ​​the camera system can be large compared to conventional cameras positioned to the side of the display. Because the camera system is integrated with the display, the detection area can even be the same size as the electronic device's display without negatively impacting its design or functionality.

[0055] Furthermore, a user looking at the display is simultaneously looking into the camera system, so that during a video conference, the impression of direct eye contact between the participants can be created. In addition, the virtual origin of the camera system can be algorithmically shifted according to the position of the participant on the screen, so that the impression of direct eye contact is maintained even if the participant moves.

[0056] The features described above in connection with at least one embodiment of the camera system can be combined with other features described in connection with at least one embodiment of the camera system, provided they do not contradict each other.

[0057] Further features and advantages will become apparent from the following description of the exemplary embodiments in conjunction with the figures.

[0058] In the exemplary embodiments and figures, identical or similarly functioning components are designated with the same reference numerals. Generally, only the differences between the individual embodiments are described. Unless otherwise stated, the description of a part or aspect in one embodiment also applies to a corresponding part or aspect in another embodiment.

[0059] They show: Fig. 1A an embodiment of a camera system in a schematic sectional view; The Fig. 1B and Fig. 1C Schematic diagrams that explain the operating principle of the camera system; Fig. 2 an embodiment of a camera system in a schematic sectional view; Fig. 3 an embodiment of a camera system in a schematic sectional view; Fig. 4 an embodiment of a camera system in a schematic sectional view; Fig. 5 an embodiment of a camera system in a schematic sectional view; Fig. 6A an embodiment of a camera system in a schematic sectional view; Fig. 6B an embodiment of a camera system in a schematic sectional view; Fig. 7 an embodiment of a camera system in a schematic sectional view; and Fig. 8 an embodiment of a conceptual design of the camera system.

[0060] The elements depicted in the figures and their relative sizes are not necessarily to scale. Rather, individual elements or layer thicknesses may be oversized for the sake of clarity and / or better understanding.

[0061] In the Fig. In the embodiment shown in Figure 1A, a camera system 1 comprises a plurality of photodetectors 2 and a plurality of optical channels 3, wherein the photodetectors 2 are arranged spaced apart from one another in a detection plane 20 within a detection surface. Each of the plurality of photodetectors 2 is assigned one of the optical channels 3. Each of the optical channels 3 has a principal viewing direction 30. The optical channels 3 comprise a plurality of different principal viewing directions 30.

[0062] For the sake of simplicity, in Fig. Figure 1A shows only three photodetectors 2 with their associated optical channels 3. In the illustrated embodiment, all principal viewing directions 30 are arranged at an angle α to a normal 21 to the detection plane 20.

[0063] For example, the main viewing direction 30 can be set at an angle α to the normal 21 other than 0° by offsetting the centers of the micro-optical elements 35 of the optical channels 3 to each other and / or to the center of the light-sensitive area of ​​the associated photodetector 2.

[0064] The operating principle of camera system 1 is described in the Fig. 1B and Fig. 1C is shown.

[0065] As in Fig. As shown in Figure 1B, an object 9 to be imaged, which is represented as an arrow extending between points A and B, is imaged by the camera system 1.

[0066] Three light beams emanating from point A and designated ra1, ra2 and ra3 are detected by the photodetectors 2A1, 2A2 and 2A3 respectively, which is due to the principal viewing directions of the associated optical channels 3.

[0067] Likewise, three beams rb1, rb2, rb3, emanating from point B, are detected by three different photodetectors 2B1, 2B2 and 2B3 respectively.

[0068] Consequently, different photodetectors 2 of the camera system 1 are able to detect rays emanating from the same point on the object but directed in different directions towards the camera system 1. In this way, the camera system 1 can provide information about the object with both spatial and angular resolution.

[0069] By combining optical channels 3 and associated photodetectors 2, the functionality of a conventional light field camera can be achieved. In contrast to a conventional light field camera, however, the camera system 1 does not require a main lens that covers all light-sensitive areas and images the object 9 to be imaged.

[0070] Consequently, the camera system 1 can be extremely flat compared to a conventional light field camera.

[0071] In Fig. Figure 1C is an example shown in its simplest form, where a single microlens is used as optical channel 3. As shown in Fig. As shown in 1A, more than one micro-optical element can also be used instead.

[0072] As in Fig. Figure 1B shows light rays emanating from points A and B of object 9. Three enlarged representations (1) to (3) in Fig. Figure 1C illustrates how points A and B of object 9 are mapped onto the photodetectors 2.

[0073] In this simplified example, there are two separate photodetectors 2 that image the same point of the object using different rays: photodetector 2A1, which detects ray ra1, and photodetector 2A2, which detects ray ra2 emanating from point A. This concept can be extrapolated to a larger set of separate distributed optical channels with associated photodetectors, where all optical channels 3 image the same object but use different angular directions. Another set of separate distributed optical channels 3 can image a different point of the object 9 using a plurality of rays, as shown in the enlarged figure (3).

[0074] Here, the photodetector 2B3 detects, as an example, the beam rb3 emanating from point B.

[0075] The entirety of the optical channels 3 with the associated photodetectors 2 is able to image the object 9 with spatial and angular resolution and to function as a light field camera.

[0076] In its simplest form, as in Fig. As shown in Figure 1C, the photodetectors can be photodetectors with exactly one light-sensitive area. However, a photodetector 2 can also have two or more light-sensitive areas in order to image, for example, two or more different points of the object with two or more different beams.

[0077] As in Fig. As shown in Figure 1A, the optical channels 3 can each comprise a plurality of micro-optical elements 35. The micro-optical elements 35 are, for example, microlenses or metalenses, or micro-optical elements based on a metamaterial.

[0078] In the embodiment of Fig. In 1A, the micro-optical elements 35 of the optical channels 3 are formed using a substrate 36 and another substrate 37 that extends over the detection area of ​​the camera system 1. The micro-optical elements 35 can, for example, be formed on one side or on both sides of the substrates 36, 37. The optical channels 3 can also be formed as spaced-apart optical elements.

[0079] The number of micro-optical elements 35 and substrates 36, 37 can be varied within wide limits. For example, the number of micro-optical elements 35 for an optical channel 3 can range from 1 to 10. The substrate 36 and / or the additional substrate 37 can be made, for example, of glass or a plastic that is transparent in the visible spectral range. The micro-optical elements 35 can be molded into or applied to the material of the substrates 36, 37.

[0080] The photodetectors 2 are individual components arranged on a substrate 15, for example a printed circuit board. The photodetectors 2 are, for example, photodiodes, pin photodiodes, avalanche photodiodes or single-photon avalanche photodiodes.

[0081] Optionally, one or more of the photodetectors 2 can be designated for a specific wavelength range and / or polarization direction. For this purpose, optical filters such as optical bandpass filters or polarization-sensitive elements can be arranged in the beam path to the associated photodetector 2.

[0082] For example, polarization-sensitive elements can be arranged in the beam path to one or more photodetectors 2 to measure polarization-dependent illumination situations, for example when detecting light that is polarized by reflection from a reflective surface.

[0083] Alternatively or additionally, the optical channels 3 can be specifically adapted to the spectral range that is to be detected by the associated photodetector 2. Compared to conventional camera systems with large optics, chromatic aberrations can be avoided more easily in this way.

[0084] Alternatively or additionally, optical channels can have pulsed or otherwise amplitude- or frequency-modulated light sources to realize distance measurements, for example according to the Time-of-Flight (ToF) principle and / or the principle of self-mixing interferometry (SMI).

[0085] The camera system 1 can be integrated into a disk, for example a glass disk, or arranged behind it, since the camera system 1 does not require any imaging optical elements, such as a common main lens, in addition to the micro-optical elements of the optical channels 3.

[0086] Although the optical channels 3 are laterally spaced apart, they can perform the same function as a compound eye camera. Furthermore, the optical channels 3 together can implement the light field principle without a main lens. This is achieved by providing both spatial and angular resolution in the optical channels 3 in combination with the associated photodetectors 2, so that a plurality of pixels are sensitive to light incident from different directions.

[0087] The camera system 1 can also include additional elements such as protective layers or optical layers. For example, absorbing material can be provided between adjacent optical channels 3 and / or photodetectors 2 to reduce or prevent optical crosstalk.

[0088] The in Fig. The embodiment shown in 2 essentially corresponds to that shown in conjunction with Fig. 1A described embodiment.

[0089] In the embodiment of Fig. 2 The light emitters 4 are arranged in the spaces 29 between adjacent photodetectors 2.

[0090] The light emitters 4 can be part of a display or a projector. Consequently, the camera system 1 can be integrated into a display or projection system. In particular, the micro-optical elements 35 of the optical channels 3 can be formed, at least partially, in one or more substrates 36, 37 of the display or projector.

[0091] For example, a micro-optical element 35 of the optical channel 3 has a lateral extent that is less than or equal to the center-to-center distance of the light emitters 4 and / or less than the center-to-center distance of the pixels of the display.

[0092] In particular, the lateral extent of the micro-optical element 35 can be less than or equal to the edge-to-edge distance between the light emitters 4 that form adjacent pixels of the display in a top view of the camera system 1.

[0093] The light emitters 4 can be micro-LEDs, where the term “micro-LEDs” includes both inorganic LEDs and organic LEDs (OLEDs).

[0094] Since displays that use micro-LEDs as pixels only require a comparatively small fill factor, there is sufficient space between adjacent micro-LEDs to arrange one or more optical channels 3 and associated photodetectors 2 in between.

[0095] Since the camera system 1 can be integrated into the display, for example in a smartphone, it is unnecessary to have a camera placed to the side of the display - or even an additional camera for other functions such as facial recognition.

[0096] This would allow a large part or even the entire display area to be used for the camera system without negatively affecting the functionality and / or design of the device with the display.

[0097] Furthermore, when a user of the device looks into camera system 1, they are looking at the display. This allows a participant in a video conference to have the impression of direct eye contact.

[0098] At the in Fig. In the embodiment shown in Figure 2, the light emitters 4 are arranged in the detection plane 20. Consequently, the light emitters 4 and the photodetectors 2 can be arranged on the same substrate 15 and electrically connected to it during manufacturing. This can even be done in a single production step.

[0099] Alternatively, at least some or even all of the light emitters 4 can be spaced away from the detection plane 20.

[0100] Fig. Figure 3 shows, for example, an embodiment in which the light emitters 4 and the conductors 41, which electrically connect the light emitters 4, are arranged on a substrate 36. At least one or even all of the micro-optical elements 35 of the optical channels 3 can be arranged at a smaller distance from the detection plane 20 than the light emitters 4. Arranging the light emitters 4 at a greater distance from the detection plane 20 can help to reduce unintended optical crosstalk between the light emitters 4 and the photodetectors 2, which is caused, for example, by reflections from the substrate 37 arranged between the detection plane 20 and the light emitters 4.

[0101] The exemplary embodiment of the Fig. 4 essentially corresponds to the one in connection with Fig. 3 described embodiment. In contrast, the photodetectors 2 each have a plurality of light-sensitive areas 25. In this case, the edge distance between two adjacent photodetectors 2 is greater than the distance between two adjacent light-sensitive areas 25 of a photodetector 2, for example by a factor of at least 1.5, at least 2, at least 5, or at least 10. Such photodetectors 2 can also be used for the other embodiments.

[0102] In the embodiment of Fig. In the focal plane of each of the optical channels 3, a further micro-optical element 35A is arranged. This corresponds to the arrangement in a conventional light field camera. These additional micro-optical elements 35A help to prevent rays emanating from other parts of the object being imaged from striking the photodetector 2 associated with the optical channel 3. An aperture can also be used instead of a micro-optical element.

[0103] Due to the plurality of light-sensitive areas 25 in a photodetector 2, the number of optical channels 3 can be reduced to achieve the same level of spatial and / or angular resolution.

[0104] In the embodiment of Fig. In 5, the photodetectors 2 with a plurality of light-sensitive areas 25 are arranged in the focal plane of the optical channels 3. The light-sensitive areas 25 can be used, for example, for parallel readout to avoid dead times after the detection of a photon, if, for example, a single-photon avalanche photodiode is used for the photodetector 2 or one of its light-sensitive areas 25.

[0105] In the exemplary embodiments of the Fig. 6A and Fig. Camera system 1 is set up for stereo vision in 6B. The several different principal viewing directions 30 include a first principal viewing direction 31 and a second principal viewing direction 32.

[0106] As in Fig. As shown in Figure 6A, at least one of the optical channels 3 with the second principal viewing direction 32 is arranged between two of the optical channels 3 with the first principal viewing direction 31. In this way, photodetectors 2, which function as pixels for a "left" camera, and photodetectors 2, which function as pixels for a "right" camera, are mixed together in the detection plane 20. Such an arrangement can be used, for example, to enable stereo vision only for certain areas of the total field of view of the camera system 1 or to increase the depth resolution in certain areas.

[0107] In contrast, the optical channels 3 with the first principal viewing direction can be arranged in a first area 11 of the detection surface 200 of the camera system 1, and the optical channels with the second principal viewing direction can be arranged in a second area 12 of the detection surface 200 of the camera system 1, which is arranged laterally next to the first area 11. This is shown in Fig. 6B is shown.

[0108] For simplicity, only one photodetector 2 is shown for each of the regions 11 and 12. The distance d between these two photodetectors 2 represents the stereo baseline. The photodetectors 2 in the first region 11 act as pixels of a "left" camera, and the photodetectors 2 in the second region 12 act as pixels of a "right" camera, or vice versa.

[0109] In the embodiment of Fig. In section 7, the camera system 1 additionally includes a radiation source 5, which is configured to illuminate an object to be viewed. The radiation source 5 emits, for example, radiation in the visible or infrared spectral range.

[0110] The radiation source 5 is associated with a further optical channel 34, which is configured to direct the radiation from the radiation source 5 onto the object under observation. The further optical channel 34 can be configured in essentially the same way as the optical channels 3, which serve to illuminate the photodetectors 2.

[0111] Optionally, a diffractive optical element 38 is arranged in the beam path of the further optical channel 34. The diffractive optical element 38 can, for example, be used to generate a radiation pattern on the user's face for facial recognition or other biometric applications. Such a radiation source 5 can also be used in the further embodiments described above.

[0112] The camera system optionally includes one or more additional photodetectors 23 with a spectral sensitivity specifically adapted to the wavelength range of the radiation emitted by the radiation source 5, for example infrared radiation.

[0113] An exemplary embodiment of a conceptual setup of the camera system 1 is shown in Fig. Figure 8 shows a data processing system 8 configured to extract an image from the signals received from the multiple photodetectors 2. The data processing system 8 includes, for example, an image processing system 81, which is electrically connected to an array 84 of photodetectors 2 via readout electronics 82. Optionally, the readout electronics can include means for preprocessing the signals or data from the photodetectors 2, for example, for combining the signals or data from two or more of the photodetectors 2. This can be done, for example, using standard logic or architectures similar to neural networks.

[0114] The data processing system 8 is further configured to control the display 85 via a display control electronics 83. If the camera system 1 is not integrated into a display (see below) Fig.1A and its description), the display control electronics 83 and the display 85 can be omitted. Control software 86 can be used to reconstruct the image based on the data from the array 84 of photodetectors 2, whereby the data from the array 84 can be provided to the data processing system 8 in raw and / or preprocessed form. Additional depth information can be acquired and recorded in order to algorithmically perform refocusing, change the depth of field, or generate 3D information about the object being viewed.

[0115] This patent application claims priority over German patent application 10 2023 116 560.7, the disclosure content of which is hereby incorporated by reference.

[0116] The invention described herein is not limited by the description with reference to the exemplary embodiments. Rather, the invention encompasses every novel feature and every combination of features, in particular every combination of features from the claims, even if that feature or combination is not explicitly stated in the claims or exemplary embodiments. References 1 camera system 11 first area 12 second area 15 carriers 2 Photodetector 2A1, 2A2, P2A3 photodetector 2B1, 2B2, 2B3 Photodetector 20 Detection level 200 detection area 21 Normal 23 additional photodetectors 25 light-sensitive areas 29 space 3 optical channels 30 Main viewing direction 31 first main direction of view 32 second main direction of view 34 additional optical channels 35 micro-optical element 35A further micro-optical element 36 Substrat 37 additional substrate 38 diffracting optical element 4 light emitters 41 leaders 5 Radiation source 8 Data processing system 81 Image processing system 82 Readout electronics 83 Display control electronics 84 photodetector array 85 Display 86 Control software 9 objects α angle d distance ra1, ra2, ra3 beam rb1, rb2, rb3 beam QUOTES INCLUDED IN THE DESCRIPTION

[0000] This list of documents cited by the applicant was automatically generated and is included solely for the reader's convenience. The list is not part of the German patent or utility model application. The DPMA accepts no liability for any errors or omissions. Cited patent literature

[0000] DE 10 2023 116 560.7

[0115]

Claims

[1] Camera system (1) with a plurality of photodetectors (2) and a plurality of optical channels (3), wherein - the photodetectors (2) are arranged apart from each other in a detection plane (20), - each of the plurality of photodetectors (2) is assigned one of the optical channels (3), - each of the optical channels (3) has a principal viewing direction (30), and - the optical channels (3) comprise a plurality of different principal viewing directions (30). [2] Camera system according to claim 1, wherein in a top view of the camera system (1) light emitters (4) are arranged at least in some spaces (29) between two adjacent photodetectors (2). [3] Camera system according to claim 2, wherein the light emitters (4) are micro-LEDs. [4] Camera system according to claim 2 or 3, wherein at least some of the light emitters (4) are arranged in the detection plane (20). [5] Camera system according to one of claims 2 to 4, wherein at least some of the light emitters (4) are arranged on a substrate (36) spaced apart from the detection plane (20). [6] Camera system according to claim 5, wherein at least some of the light emitters (4) are arranged at a greater distance from the detection plane than at least one micro-optical element (35) of one of the optical channels (3). [7] Camera system according to one of the preceding claims, wherein the camera system (1) comprises a radiation source (5) which is configured to illuminate an object (9) to be imaged. [8] Camera system according to claim 7, wherein radiation from the radiation source (5) is directed onto the object to be imaged via a further optical channel (34) associated with the radiation source (5). [9] Camera system according to one of the preceding claims, wherein the camera system (1) is designed for stereo vision. [10] Camera system according to one of the preceding claims, wherein the plurality of different principal viewing directions (30) comprises a first principal viewing direction (31) and a second principal viewing direction (32), wherein in a top view of the camera system (1) the optical channels (3) with the first principal viewing direction (31) are arranged in a first region (11) of the camera system (1) and the optical channels (3) with the second principal viewing direction (12) are arranged in a second region (12) of the camera system (1), which is arranged laterally next to the first region (11). [11] Camera system according to one of claims 1 to 9, wherein the plurality of different principal viewing directions (30) comprises a first principal viewing direction (31) and a second principal viewing direction (32), wherein in a top view of the camera system (1) at least one of the optical channels (3) with the second principal viewing direction (32) is arranged between two of the optical channels (3) with the first principal viewing direction (31). [12] Camera system according to one of the preceding claims, wherein at least one of the photodetectors (2) comprises at least one photodiode, a pin photodiode, an avalanche photodiode (APD) or a single-photon avalanche diode (SPAD). [13] Camera system according to one of the preceding claims, wherein at least one of the photodetectors (2) has a plurality of light-sensitive areas (25). [14] Camera system according to one of the preceding claims, wherein the camera system comprises a data processing system (8) configured to extract an image from signals received from the plurality of photodetectors (2). [15] Camera system according to claim 14, wherein the data processing system (8) is configured to extract depth information from the image.

Images