Planar holographic camera

Abstract

A camera system is described comprising: a detector array containing multiple photosensitive pixels; an encoder mask having an array of multiple encoders, each of which comprises an array of multiple similar unit cells; and a lens array having multiple optical lenses aligned with the array of encoders and positioned to image input light onto the encoders. The camera system is configured such that each lens collects light within its respective angular range, thereby deflecting the collected light component from the scene with its respective angular shift for each of the multiple optical lenses.

Description

Technical Field

[0001] The present disclosure relates to a planar camera configuration, and more particularly, to a planar holographic camera device including a plurality of camera units.

Background Art

[0002] Optical imaging is a powerful tool for measurement, inspection, and imaging. Current optical measurement and imaging techniques can provide high-resolution data regarding the intensity of an input optical field. However, in typical conventional imaging techniques that measure only the intensity of the field, most of the information carried by the optical field is lost.

[0003] A planar camera is a versatile type of camera that can be used for various purposes. Planar cameras are designed to fit into a relatively compact case or to provide a compact form factor. Such planar cameras are often used in portable electronic devices. They are ideal for taking snapshots, travel photos, and event photos. Planar cameras are also a suitable choice for blogs and filmmaking.

[0004] Among various techniques utilizing a holographic camera, there is U.S. Patent No. 11,293,806 assigned to the assignee of the present application, which describes an optical detection system for detecting data regarding the optical mutual coherence function of an input field. The system includes an encoder having similar unit cells and an array of sensor cells located downstream of the unit cells at a distance with respect to the overall propagation direction of the input light. The array defines a plurality of subarray unit cells, each subarray corresponding to a unit cell of the encoder, and each subarray includes a predetermined number M of sensor elements. The encoder applies a predetermined modulation to the input light collected by the system such that each unit cell of the encoder guides a portion of the input light incident thereon to the corresponding subarray unit cell and one or more neighboring subarray unit cells within a predetermined proximity region. The number M is determined according to a predetermined number of subarray unit cells within the proximity region.

[0005] U.S. Patent Application Publication No. 2023 / 029,930, assigned to the assignee of this application, provides systems and methods for imaging, measuring, and characterizing objects. An optical speckle-based imaging system may comprise an illumination unit including at least one coherent light source for illuminating a sample; an acquisition unit for collecting input light from the sample, comprising an imaging optical system and a wavefront imaging sensor; and a control unit coupled to the illumination unit and the acquisition unit to analyze the input light and generate a speckle wavefront image, wherein at least one coherent light source generates primary speckles in or on the sample, and the imaging optical system captures secondary speckle patterns caused by the illumination unit in or on the sample.

[0006] International Publication No. 2021 / 229,575, assigned to the assignee of this application, provides a system and method for digital optical aberration correction and spectral imaging. The optical system may comprise an optical imaging unit for forming an optical image near the image plane of the optical system; a wavefront imaging sensor unit disposed near the image plane, which provides raw digital data relating to the optical field near the image plane and the image output; and a control unit for processing the raw digital data and the image output to provide a deblurred image output. The control unit comprises a storage unit for storing commands and a processing unit that receives the image input and raw digital data of the optical field colliding with the wavefront imaging sensor, and executes commands to generate a deblurred image based on an analysis of the optical mutual coherence function at the imaging plane. [Overview of the project]

[0007] A camera configuration is needed that enables holographic imaging to obtain data on the coherence of input light while maintaining a flat configuration suitable for use in typical electronic devices. This disclosure provides a camera system formed of multiple holographic camera units configured to provide output data showing the intensity and phase or coherence pattern of the collected light. The camera system is configured such that the multiple camera units collect multiple image portions that together cover the entire field of view of the camera system.

[0008] The camera system may consist of a layered structure having a detector array, an encoder mask, and an array of imaging lenses. The encoder mask is formed from multiple encoders, each encoder holding a periodic pattern of multiple unit cells having an optical modulation pattern. The optical modulation patterns are similar among the unit cells of the encoders. On the other hand, the different encoders in the encoder mask may be similar or different among them.

[0009] A camera system is generally configured such that each camera unit collects light from a different angular portion of the entire field of view of the camera system. The angular portions of different camera units may partially overlap or be distinct. For this purpose, the camera system may include optical deflectors configured to direct the light components of different angular portions of the field of view to different camera units of the system. Optical deflectors may be refractive, diffractory, or utilize metasurfaces. Alternatively, or in addition, different camera units may be configured to have preferred effective optical axes oriented at different angular directions with respect to the overall optical axis of the camera system. For example, in some embodiments, an array of lenses may be configured such that each lens in the array has a slightly different optical axis. In such examples, the lens at the center of the array may have an optical axis parallel to the overall optical axis of the system, and for each row or column, the optical axes of the lenses are shifted toward the periphery of the field of view. In some other examples, the optical deflectors may be metasurfaces, refractive or diffractory elements configured to operate to change the focusing angle range and to provide imaging conditions to each of the camera units.

[0010] The camera system of this disclosure can be used in a variety of electronic devices and may be configured to provide image data that, in addition to providing imaging of a field of view (i.e., conventional imaging), exhibits at least one of phase, coherence, and depth data. Such output data may be used to determine the wavelength components of the collected light and to determine chromatic and / or hyperchromatic image data in accordance with the phase changes of the collected light components.

[0011] Furthermore, the use of a holographic camera unit allows for the reconstruction of the collected image data for correction of optical aberrations. This may include correction of optical aberrations generated due to light deflection by light deflection optical elements. Phase and / or coherence data can also be used to determine depth information of the collected image data and to utilize the output image data for performing various post-processing tasks such as face recognition, detection of biometric parameters, and distinction between physical objects and their two-dimensional representations.

[0012] Accordingly, in a broader embodiment, the present disclosure provides a camera system comprising: a detector array including a plurality of photosensitive pixels; an encoder mask comprising an array of a plurality of encoders, each of which comprises an array of a plurality of similar unit cells; and a lens array comprising a plurality of optical lenses aligned with the array of encoders and positioned to image input light onto the plurality of encoders, wherein the camera system is configured to deflect the collected light component from the scene with a respective angular shift for each of the plurality of optical lenses, such that each lens collects light in its respective angular range. For example, each lens may collect light arriving from its respective angular range in the scene. In some embodiments, different lenses collect light from different angular ranges of the scene, which may partially overlap.

[0013] According to some embodiments, the camera system is configured to define an array of camera units, each camera unit being defined by an imaging lens, its respective encoder, and a sub-arrangement of photosensitive pixels.

[0014] According to some embodiments, the multiple photosensitive pixels comprise an arrangement of subarray unit cells, each subarray unit cell being associated with a unit cell of its respective encoder and comprising a selected number of pixels.

[0015] According to some embodiments, a selected number of pixels in a subarray unit cell are selected according to the number of subarray unit cells in a predetermined proximity region.

[0016] According to some embodiments, a plurality of similar unit cells of a plurality of encoders hold an optical modulation pattern, which is selected to amplify a portion of the light that strikes the optical modulation pattern onto a predetermined proximity region, the proximity region comprising each subarray unit cell of the detector array, and one or more subarray unit cells are associated with one or more adjacent unit cells of the encoder.

[0017] According to some embodiments, multiple encoders are configured with similar optical modulation patterns within each of the multiple unit cells.

[0018] According to some embodiments, the optical modulation patterns of multiple unit cells vary among multiple encoders.

[0019] According to some embodiments, the camera system may further comprise one or more field aperture apertures located between the lens array and the holographic encoder mask, the one or more field aperture apertures being positioned to prevent light collected by one imaging lens from colliding with an encoder associated with another imaging lens.

[0020] According to some embodiments, the optical lenses of the lens array include imaging lenses having inclined optical axes, such that each lens in the lens array collects light from different angular ranges.

[0021] According to some embodiments, the camera system may include a light-shifting optical element positioned upstream of the lens array and configured to guide the collected light component from the scene with a corresponding angular shift for each of the multiple optical lenses, such that each lens collects light within its respective angular range.

[0022] According to some embodiments, the optical element comprises a refractive aspherical lens unit adapted to deflect light components such that each lens in the lens array collects light from different angular ranges.

[0023] According to some embodiments, each lens in a lens array collects light from different angular ranges, and the optical deflection optical element comprises a diffraction optical system adapted to deflect the optical components.

[0024] According to some embodiments, each lens in a lens array collects light from different angular ranges, and the optical element comprises a Fresnel lens adapted to deflect the light component.

[0025] According to some embodiments, each lens in a lens array collects light from different angular ranges, and the optical element comprises one or more prisms adapted to deflect the light components.

[0026] According to some embodiments, the optical deflection element comprises a metasurface unit holding a plurality of nanostructures arranged in a selected pattern to provide a selected optical deflection pattern for deflecting optical components such that each lens in the lens array collects light from different respective angular ranges.

[0027] According to some embodiments, in order to provide imaging conditions and to guide the light components collected from each angular portion of the field of view along the optical axis of the camera system toward different encoders of the encoder mask, the lens array is formed from metasurface elements having a microscopic surface pattern, the microscopic surface pattern being selected to influence the propagation of light components passing through the microscopic surface pattern.

[0028] According to some embodiments, the camera system may further comprise a control unit, the control unit being adapted to receive detection data from the detector array and process the detection data to determine a plurality of coherence image data pieces respectively associated with the light portions collected by different lenses of the lens array.

[0029] According to some embodiments, the plurality of coherence image data pieces include the collected image data and the coherence matrix data of the collected light.

[0030] According to some embodiments, the control unit is further adapted to process the plurality of coherence image data pieces to determine a coherence image indicative of the field of view of the camera system.

[0031] According to some embodiments, processing the plurality of coherence image data pieces to determine a coherence image indicative of the field of view of the camera system includes determining a coherence matrix in an overlapping image region associated with the overlap of the light collection angle ranges of the lens array.

[0032] In another broad aspect, the present disclosure provides a camera system comprising an array of camera units, (a) the array of camera units comprising two or more holographic camera units, each holographic camera unit comprising an encoder formed by an array of a plurality of similar unit cells and a respective detector array, (b) two or more holographic camera units being adapted to collect light from a portion of the entire field of view of the camera system such that a plurality of the two or more holographic camera units cover the entire field of view of the camera system.

[0033] According to some embodiments, two or more holographic camera units are respectively associated with imaging lenses that collect light components associated with respective angular ranges of the field of view of the camera system.

[0034] According to some embodiments, the camera system further comprises two or more holographic camera units, each of which is a light-shifting optical element adapted to shift the light component so as to collect light within its respective angular range.

[0035] According to some embodiments, the optical element comprises at least one of an aspherical lens unit, a diffraction grating, a Fresnel lens, and a metasurface optical element.

[0036] In general, a camera system may be configured according to the following description, using a combination of features shown as part of the various embodiments described herein. [Brief explanation of the drawing]

[0037] Embodiments are described herein, as non-limiting examples, with reference to the accompanying drawings, in order to better understand the subject matter disclosed herein and to illustrate how it can actually be carried out. [Figure 1] Camera systems according to several embodiments of this disclosure are schematically shown. [Figure 2] This disclosure illustrates several embodiments of camera systems having a layered arrangement. [Figure 3] This disclosure shows several embodiments of holographic camera units. [Figure 4] Examples of multiple image portions collected by a camera system according to some embodiments of this disclosure are provided. [Figure 5] This disclosure describes several embodiments of camera systems utilizing aspherical lenses. [Figure 6] This disclosure describes several embodiments of camera systems utilizing Fresnel lenses. [Figure 7] Examples of metasurfaces suitable for use in camera systems are illustrated by several embodiments of this disclosure. [Figure 8]This disclosure illustrates several embodiments of camera systems that utilize aspherical lenses. [Figure 9] The following are examples of optical component paths in a camera system according to several embodiments of this disclosure. [Figure 10A] The imaging lens shown is an embodiment of the present disclosure. [Figure 10B] The optical modulation patterns of a unit cell of an encoder according to some embodiments of the present disclosure are shown. [Figure 10C] The optical modulation patterns of a unit cell of an encoder according to some embodiments of the present disclosure are shown. [Figure 10D] The optical modulation patterns of a unit cell of an encoder according to some embodiments of the present disclosure are shown. [Figure 11] Several embodiments of the present invention illustrate camera systems, particularly illustrating the operation of light-shifting optical elements and aspherical lenses. [Modes for carrying out the invention]

[0038] As described above, the disclosure provides a planar camera system formed of a plurality of camera units, preferably holographic camera units, arranged in a selected array, and each of the plurality of camera units is configured to collect input light such that it collects light associated with a portion of the entire field of view of the camera system.

[0039] Refer to Figure 1, which schematically illustrates a camera system 100 according to some embodiments of the present disclosure. The camera system 100 is formed of a plurality of camera units arranged in an array, each of which is configured to provide light collection from a scene such that it collects light from a portion of the entire field of view (FOV) with some overlap in the FOV portions of different camera units, typically marked generally as 102.

[0040] As shown in Figure 1, the system 100 includes a detector array 110, a holographic encoder mask 120, and an array of imaging lenses 130. The detector array 110 includes a plurality of photosensitive pixels, which are arranged generally in an array and configured to generate an output electrical signal indicating the aggregated light intensity of a selected wavelength range that collides on the photosensitive pixels. The holographic encoder mask 120 includes an array of holographic encoders, each of which is similar to the unit cells of the same encoder, if each holographic encoder is formed from an array of unit cells having a selected light modulation pattern. The lens array 130 includes a plurality of imaging lenses, each imaging lens aligned with the respective holographic encoder of the encoder mask 120 and the respective area of ​​the detector array 110. This configuration defines a plurality of camera units 102, each formed by the arrangement of imaging lenses, a holographic mask, and an array of photosensitive pixels.

[0041] Furthermore, according to this disclosure, the camera system is configured to provide a focusing pattern such that each of the multiple camera units 102 collects light arriving from a portion of the entire field of view. This is exemplified by an optical element 140 configured to bend portions of light that strike different regions of the optical element 140 such that the light input to each of the camera units 102 corresponds to different, generally partially overlapping, angular regions of the field of view. The light-shifting optical element 140 may be implemented by selective shaping of the lenses of the lens array 130, as will be described in more detail below, or it may be a separate optical element utilizing refraction, diffraction, and / or surface treatment.

[0042] Therefore, as illustrated in Figure 1, the camera system 100 is formed from a plurality of camera units 102 and a light-shifting optical element 140 such that different camera units 102 collect light from different angular sections of the field of view. Thus, an object Obj located at a specific location in the field of view will generate images in multiple camera units depending on the position of the camera units in the array, while other camera units in the array may collect light from other angular sections of the field of view.

[0043] Figure 2 shows additional exemplary configurations of a planar camera system 100 according to some embodiments of the present disclosure. As shown, the camera system 100 may be formed in a layered configuration including a detector array layer 110, an encoder mask 120, a lens array 130, and a light-shifting optical element 140 (which may or may not be part of the lens array 130). The camera system 100 may also generally include one or more aperture arrays, which act as field diaphragms for different camera units (102 in Figure 1) and are positioned to direct the light collected by the imaging lenses of the lens array 130 through their respective holographic encoders to their respective regions of the detector 140, while preventing crosstalk between the camera units.

[0044] Although not specifically shown in Figure 1 or Figure 2, it should be noted that the camera system 100 may generally be associated with a control unit. The control unit may include one or more processor and memory circuits (PMCs), as well as their respective input / output modules. The PMCs are generally operably connected to at least the detector array 110 for determining the collection and readout of light, for receiving output data from the detector array 110, and for processing the output data as will be described in more detail below.

[0045] The camera system 100 of this disclosure utilizes an encoder mask 120 located on the image plane relative to the imaging lens of the lens array 130. In this regard, Figure 3 illustrates exemplary configurations and general operation of a camera unit 102 according to some embodiments of this disclosure. The camera unit 102 includes an imaging lens 130a, a holographic encoder 120a, and a detector array 110a, which are operable to detect phase, coherence, and intensity data of the light field.

[0046] The holographic encoder 120a holds an array of multiple similarly patterned unit cells, each unit cell having a light modulation pattern configured to amplify at least a portion of the light passing through it. The detector array 110a is positioned downstream of the encoder 120a at a predetermined distance L with respect to the overall direction of radiation propagation. The imaging lens 130a is positioned to form an image Img of an object Obj on the surface of the encoder 120a, and the encoder modulates the collected light propagating to the detector array 110a.

[0047] The detector array 110a generally includes multiple photosensitive detectors (pixels) that form multiple sub-array unit cells, each sub-array unit cell associated with each unit cell of the encoder 120a. Furthermore, the optical modulation pattern of each unit cell of the encoder 120a modulates the optical component passing through it, amplifying at least a portion of the optical component to collide with a detector array in a predetermined proximity region, which typically includes one or more adjacent sub-array unit cells in addition to the sub-array unit cells associated with the encoder's unit cell. Such optical modulation causes crosstalk between optical components associated with different unit cells of the encoder, enabling processing of the output data collected by the detector to determine data on light intensity, as well as coherence matrix and / or phase data of the collected light.

[0048] Each camera unit 102, and / or the entire camera system 100, may be connected to or associated with a control unit 500. As described above, the control unit may include at least one processor 550 and memory 600, as well as associated input / output modules. At least one processor 550 is configured and operable to receive output data from the detector 110a and to process the output data according to pre-stored data relating to the modulation pattern of the encoder 120a. Generally, the processor may operate to determine a set of coefficients associated with different coherence basis functions, and their respective intensity basis functions as collected by the detector. The processor may utilize the respective coefficients to determine a linear sum of intensity basis functions that fits the output data collected by the detector, and to determine coherence data relating to the collected wavefront, which is a sum of coherence basis functions.

[0049] The configuration of the holographic encoder and the process that enables the determination of at least the coherence matrix of the collected light are described in U.S. Patent No. 11,293,806, which is transferred to the assignees of this disclosure and incorporated herein by reference.

[0050] It should be noted that in some embodiments of the present invention, the encoder 120 may be a separate unit from the detector array 140, while in other embodiments, the encoder 120 may be monolithically integrated with the detector array 140 and may be part of a process stack used to manufacture the sensor array, using, for example, a metallization process step and / or a process step similar to that used to manufacture microlens arrays typically used to improve the pixel fill factor of the sensor array. In addition, as described above, the optically shifting elements 140 may be embodied by a suitable design of the lenses of the lens array 130 such that each lens collects light from the respective angular section of the field of view of the system 100. Alternatively, separate optically shifting elements may be used, as will be described in more detail below.

[0051] An exemplary image collected by the camera system 100 of this disclosure is shown in Figure 4. Figure 4 shows an array of 7 × 11 image portions, each collected by a camera unit 102 of the planar camera system 100 configured as described above. The image portions shown herein are shown as simple image portions, and coherence and / or phase data are not specifically shown. However, the array of image portions shows the change in field of view between the camera units 102 of the camera system, with each camera unit collecting light from an angular portion of the entire field of view. As shown, the angular portions of adjacent camera units may partially overlap. More specifically, in some embodiments, the angular portions of the fields of view of different camera units 102 may partially overlap. In some other embodiments, the angular portions of the fields of view of some of the camera units may partially overlap, while some other camera units have separate fields of view. Such separate fields of view may be adjacent or spaced apart. In some embodiments, the fields of view of different camera units may not overlap.

[0052] In general, the use of the wavefront camera unit 102 as described herein provides additional data regarding the phase and coherence of light collected across the intensity images shown in Figure 4. The additional phase and / or coherence data can be used to reconstruct an array of image portions into a complete image of the field of view, and to use the phase and / or coherence changes for identifying depth relationships, generating three-dimensional amplitudes of the scene, identifying selected materials, and for other details. This enables the performance of various analytical operations, including face recognition and distinguishing between physical objects and their two-dimensional images.

[0053] In general, collecting light components from different angular portions of a field of view can cause various optical aberrations due to changes in the optical axis. The camera system of this disclosure utilizes a holographic camera unit configured to provide coherence and / or phase data that enables correction of various aberrations using post-processing operations.

[0054] Figures 5 and 6 further illustrate two examples of camera systems 100 according to some embodiments of the present disclosure, utilizing an aspherical lens (Figure 5) or a Fresnel lens (Figure 6) acting as an optical deflection element 140. The illustrated camera system 100 is broadly similar to that illustrated in Figure 1 and uses an imaging lens array 130, an encoder mask 120 formed by an array of holographic encoders, and a detector array 110. The aspherical lens unit 140 shown in Figure 5 is shaped to provide optical deflection, directing the light components to each camera unit within an angular range determined based on the location of the camera units 102 in the array.

[0055] The example in Figure 6 utilizes a Fresnel lens as the light deflecting optical element 140. A Fresnel lens is a compact composite lens that uses a combination of diffraction and refraction to appropriately shape the light passing through it. According to this disclosure, the camera system 100 can use the shape of the Fresnel lens to guide light according to its lateral position on the lens. More specifically, the Fresnel lens is configured to align light components of different angular ranges with the optical axis of the camera system, the angular range being determined by the lateral position on the surface of the lens, thereby transmitting each angular portion to different camera units 102.

[0056] In some additional embodiments, the optical element 140 may be a diffraction grating having a selected lattice change to provide desired optical deflection. In addition or alternatively, the optical element may be formed by one or more metasurfaces having a selected micropattern chosen to apply diffraction and / or refractive properties to light passing through the element 140. An example of a metasurface configuration is shown in Figure 7. Figure 7 is a scanning electron microscope image of a metasurface described by Lisa W. Li et al. in “Evaluation and characterization of imaging polarimetry through metasurface polarization gratings,” Applied Optics Vol. 62, No. 7 / 1, March 2023. Generally, a metasurface is a physical element including an optical element having a surface pattern formed from a plurality of microstructures and / or nanostructures arranged in a selected configuration, and having a size and shape selected to influence the optical components interacting with the metasurface.

[0057] Some non-limiting examples of camera systems according to several embodiments of the present disclosure are shown in Figure 8. Figure 8 shows a camera system utilizing an aspherical lens as an optical deflection element 140, but it should be understood that the optical deflection element may be a diffracting element, a Fresnel lens, a metasurface element, or other suitable elements as described above.

[0058] Figure 8 shows a camera system 100 according to several embodiments of the present disclosure. As described above, the system includes a light-shifting optical element 140, an array of imaging lenses 120, an encoder mask 120, and a detector array not specifically shown in Figure 8. Additional elements shown in Figure 8 are a light-blocking region 136 positioned between the imaging lenses of the array 130, and a plurality of field-of-view aperture arrays 132 and 134 positioned between the array of lenses 130 and the encoder mask 120. The apertures 132 and 134, as well as the light-blocking region 136, are positioned and configured to block the propagation of light components between the camera units 102 of the system, and thus prevent crosstalk between the camera units 102. This is in contrast to crosstalk between unit cells of the holographic encoder 102a used in each of the camera units 120, such crosstalk is utilized to acquire phase and / or coherence data of the collected light.

[0059] In general, in some embodiments, the distance between the encoder mask 120 defining the image plane and the array of lenses 130 can be 0.1 to 5 millimeters, for example, the distance may be 2.9 millimeters. Generally, the distance between the lens 130 and the encoder mask 120 is determined according to the refractive power of the imaging lens 130 and the desired imaging conditions of the camera system 100. In some embodiments, one or more optical elements may be shiftable to change their focal length according to different imaging conditions. However, it should be noted that the use of a holographic camera unit, which can determine the phase and / or coherence matrix of the collected light in addition to the intensity mapping of the collected light, allows for processing of the collected image and can correct for focus shifts or other optical aberrations that occur under various imaging conditions. Furthermore, as shown in the figure, the use of an aspherical lens 140 may result in a relatively thick camera system due to the relatively high thickness of the aspherical lens. Therefore, the use of diffraction gratings, Fresnel lenses, and / or metasurfaces may be preferred, as this allows for a thinner camera system.

[0060] Refer to Figure 9, which shows additional exemplary configurations of the camera system 100 according to some embodiments of the present disclosure. As shown, in this configuration, the spatial arrangement of the imaging lenses of the lens array 130 provides variations in the optical axes between the camera units. More specifically, the central camera unit of the array has an optical axis OA0 aligned with the overall optical axis of the camera system 100. Each of the other camera units has an optical axis tilted from the overall optical axis to a degree determined based on the distance and orientation of each camera unit from the center of the array. As shown, optical axis OA1 is tilted slightly upward, optical axis OA2 is tilted a little more upward, and optical axis OA3 is tilted further upward. Similar tilts are given to optical axes OA-1, OA-2, and OA-3. This provides an effective configuration of optical axes similar to the spears or porcupines in a Roman phalanx.

[0061] Such a configuration can be achieved by determining the increasing dimensions of the elements extending from the detector array 110 toward the lens array 130, such that the encoder mask 120 is larger than the detector array 110 and the lens array 130 occupies an even larger lateral area. Alternatively, or in addition, the imaging lenses of array 130 may be shaped to provide optical axis variation in a configuration similar to a dense square or porcupine.

[0062] As described above, the camera system 100 of this disclosure is formed using an array of lenses 130 and an array of holographic encoders 120. Furthermore, an encoder mask is formed by an array of holographic encoders, each of which is an array of similar unit cells that hold a light modulation pattern. Exemplary configurations of the imaging lens 130a and the unit cells of the holographic encoders are shown in Figures 10A to 10D.

[0063] Figure 10A illustrates an imaging lens 130a. The imaging lens may have a diameter of 0.1 to 1 millimeter, or any other diameter to provide appropriate dimensions for the camera system. Furthermore, the imaging lens 130a may have a focal length selected based on the dimensions of the camera system, the distance between the lens array 130 and the encoder mask 120, the desired focal length, and general optical requirements. For example, the focal length of the imaging lens 130a may be 0.1 to 10 millimeters. The imaging lens 130a may occupy the entire or a portion of the space of a unit cell of the lens array 130, according to the appropriate optical design of the camera system.

[0064] Figures 10B to 10D show three examples of optical modulation patterns of a unit cell in a holographic encoder according to several embodiments of the present disclosure. A typical unit cell has dimensions of 1 to 10 micrometers, and the optical modulation pattern can be formed by multiple regions with different optical paths for light passing through it, i.e., regions where the phase is affected. Each holographic encoder 120a includes multiple similar unit cells arranged in an array. The encoder mask includes an array of holographic encoders, and each holographic encoder is aligned to adjust the phase of each imaging lens in the lens array. Different holographic encoders may have similar or different holographic masks having pre-selected known optical modulation patterns.

[0065] Figure 11 shows a camera system according to several embodiments of the present invention, specifically illustrating the operation of an optical deflection element 140, and specifically illustrating an aspherical lens. As shown in the figure, the optical deflection element is configured to direct optical components to different camera units 102, defined by different imaging lenses of the lens array 130, according to the field of view portion. Thus, optical components propagating parallel to the optical axis of the camera system are focused and transmitted to the imaging lens located at the center of the array. In contrast, optical components propagating at an angle to the optical axis of the system are collected around the optical deflection element and aligned with the optical axis of the imaging lens at the periphery of the lens array 130. This configuration ensures that each camera unit collects light associated with a portion of the field of view of the camera system. Note that Figure 11 illustrates one configuration of an optical deflection element that inverts the collected light in a cross-section. Alternatively, Figure 9 illustrates another configuration in which the collected light maintains its lateral orientation when collected by an optical divergence element. It should be noted that this is a function of the specific optical element used and can be corrected by the orientation of the collected image data.

[0066] As described above, the camera system of this disclosure may be manufactured in a layered configuration. More specifically, the first detector array layer may be placed on a support, followed by an encoder mask layer. To prevent light leakage between the camera units of the system, one or more arrays of field diaphragm apertures may be placed above the encoder mask, followed by a lens array and optical elements. The different elements are preferably aligned to provide a suitable optical axis for each of the camera units of the system.

[0067] Accordingly, the present disclosure provides a camera system formed of a plurality of camera units, each comprising one or more holographic camera units configured to determine intensity and phase and / or coherence data relating to the collected light. The camera system is configured such that the plurality of camera units collect light from each of a plurality of angular sections of a field of view. Thus, the camera units collect light from a plurality of fields of view that may partially overlap.

[0068] It should be noted that the various features described in the various embodiments can be combined according to all possible technical combinations.

[0069] It should be understood that the present invention is not limited in its application to the details illustrated in the description or drawings contained herein. Other embodiments of the present invention are possible and can be carried out and implemented in various ways. Therefore, it should be understood that the expressions and terms used herein are for illustrative purposes only and should not be considered limiting. Accordingly, those skilled in the art will understand that the concepts underlying this disclosure can be readily used as a basis for designing other structures, methods, and systems to accomplish some of the objectives of the subject matter of this disclosure.

[0070] Those skilled in the art will readily understand that various modifications and changes can be applied to embodiments of the present invention as described above in the specification, without departing from the scope of the appended claims and as defined herein.

Claims

1. It is a camera system, (a) A detector array including multiple photosensitive pixels, (b) An encoder mask comprising an array of a plurality of encoders, wherein each of the plurality of encoders comprises an array of a plurality of similar unit cells, (c) A lens array comprising a plurality of optical lenses aligned in the array of the plurality of encoders and positioned to image input light onto the plurality of encoders, A camera system configured such that each of the plurality of optical lenses modulates the collected light component from the scene with a corresponding angular shift, so that each lens collects light within its respective angular range.

2. The camera system according to claim 1, wherein an array of camera units is defined, and each camera unit is defined by an imaging lens, its respective encoder, and a sub-arrangement of photosensitive pixels.

3. The camera system according to claim 1 or 2, wherein the plurality of photosensitive pixels comprise an arrangement of subarray unit cells, each subarray unit cell being associated with a unit cell of the respective encoder and comprising a selected number of pixels.

4. The camera system according to claim 3, wherein the selected number of pixels of the subarray unit cell are selected according to the number of subarray unit cells in a predetermined proximity region.

5. The camera system according to any one of claims 1 to 4, wherein the plurality of similar unit cells of the plurality of encoders hold a light modulation pattern selected to amplify a portion of light that has collided with the light modulation pattern onto a predetermined proximity region, and the proximity region comprises each of the subarray unit cells of the detector array and is associated with one or more adjacent unit cells of the encoder by one or more subarray unit cells.

6. The camera system according to any one of claims 1 to 5, wherein the plurality of encoders are configured with similar light modulation patterns within each of the plurality of unit cells.

7. The camera system according to any one of claims 1 to 5, wherein the optical modulation patterns of the plurality of unit cells are varied among the plurality of encoders.

8. The camera system according to any one of claims 1 to 7, further comprising one or more field aperture apertures located between the lens array and the holographic encoder mask, wherein the one or more field aperture apertures are positioned to prevent light collected by one imaging lens from colliding with an encoder associated with another imaging lens.

9. The camera system according to any one of claims 1 to 8, wherein the plurality of optical lenses in the lens array include an imaging lens having an inclined optical axis such that each lens in the lens array collects light from different angular ranges.

10. The camera system according to any one of claims 1 to 8, comprising a light-shifting optical element positioned upstream of the lens array such that each lens collects light within its respective angular range, and configured to guide the collected light component from the scene with its respective angular shift relative to each of the plurality of optical lenses.

11. The camera system according to claim 10, wherein the optical deflection element comprises a refractive aspherical lens unit adapted to deflect light components such that each lens in the lens array collects light from different angular ranges.

12. The camera system according to claim 10 or 11, wherein the light deflecting optical element comprises a diffractive optical system adapted to deflect light components such that each lens in the lens array collects light from different angular ranges.

13. The camera system according to any one of claims 10 to 12, wherein the light deflecting optical element comprises a Fresnel lens adapted to deflect light components such that each lens in the lens array collects light from different angular ranges.

14. The camera system according to any one of claims 10 to 13, wherein the light deflecting optical element comprises one or more prisms adapted to deflect light components such that each lens of the lens array collects light from different angular ranges.

15. The camera system according to any one of claims 10 to 14, wherein the optical deflection element comprises a metasurface unit holding a plurality of nanostructures arranged in a selected pattern to provide a selected optical deflection pattern for deflecting optical components such that each lens of the lens array collects light from different angular ranges.

16. The camera system according to claim 1, wherein the lens array is formed from metasurface elements having a microscopic surface pattern, and the microscopic surface pattern is selected to affect the propagation of light components passing through the microscopic surface pattern, in order to provide imaging conditions and to guide light components collected from each angular portion of the field of view along the optical axis of the camera system toward different encoders of the encoder mask.

17. The camera system according to any one of claims 1 to 16, further comprising a control unit, the control unit being adapted to receive detection data from the detector array, process the detection data, and determine a plurality of coherence image data fragments associated with, respectively, the light portions collected by different lenses of the lens array.

18. The camera system according to claim 17, wherein the plurality of coherence image data fragments include collected image data and collected light coherence matrix data.

19. The camera system according to claim 17 or 18, wherein the control unit is further adapted to process the plurality of coherence image data fragments to determine a coherence image representing the field of view of the camera system.

20. The system according to claim 19, wherein processing the plurality of coherence image data fragments to determine a coherence image representing the field of view of the camera system includes determining a coherence matrix in overlapping image regions associated with the overlap of the focusing angle ranges of the lens array.

21. A camera system comprising an array of camera units, (a) The array of camera units comprises two or more holographic camera units, each of which comprises an encoder formed by an array of multiple similar unit cells, and its respective detector array, (b) A camera system in which the two or more holographic camera units are adapted to collect light from a portion of the entire field of view of the camera system such that some of the two or more holographic camera units cover the entire field of view of the camera system.

22. The camera system according to claim 21, wherein the two or more holographic camera units are each associated with an imaging lens that collects light components associated with each angular range of the field of view of the camera system.

23. The camera system according to claim 21 or 22, wherein each of the two or more holographic camera units further comprises an optical element adapted to shift the light component so as to collect light in each respective angular range.

24. The camera system according to claim 23, wherein the light deflection optical element comprises at least one of an aspherical lens unit, a diffraction grating, a Fresnel lens, and a metasurface optical element.

Images