Highly efficient active illumination imaging system and method

Abstract

Sensor methods and systems incorporating an integrated illumination source or light source are provided. The sensor may have a plurality of pixels and an integrated light source. The sensor may further include or be associated with imaging optics. The light source operates to generate illumination light. The illumination light travels through the imaging optics toward a scene within a field of view of the sensor system. Objects within the field of view reflect the light collected by the imaging optics onto at least some of the pixels. In at least some configurations, an output of the light source is located adjacent to the pixel and provides the illumination light to the imaging optics by reflecting the illumination light from at least some of the pixels. In other configurations, the light source excites pixel elements, thereby generating the illumination light provided to the imaging optics.

Description

Identification of related applications

[0001] This application claims priority to U.S. Patent Application No. 17 / 994,814, filed November 28, 2022, the contents of which are incorporated herein by reference. [Technical Field]

[0002] The present disclosure relates to an image sensor device having an integrated active illumination system. [Background technology]

[0003] Image sensors, including digital image sensors, are commonly used to detect light in a variety of devices, such as scientific instruments, handheld cameras, security systems, phones, computers, and tablets. In a typical arrangement, light-sensitive areas, or pixels, are arranged in a two-dimensional array having multiple rows and columns of pixels and operate to capture an image. Each pixel generates an electrical charge in response to receiving photons as a result of exposure to incident light. For example, each pixel may include a photodiode. The photodiode generates an amount of electrical charge that is roughly proportional to the amount of light (i.e., the number of photons) that strikes the pixel during an exposure period. Summary of the Invention [Problem to be solved by the invention]

[0004] The imaging capabilities of image sensors are limited in low-light environments. One approach to enabling image capture in low-light conditions is to extend the exposure period. However, even a long exposure period may be insufficient in extremely low-light conditions. Furthermore, a long exposure period is not suitable for capturing images of moving objects.

[0005] Another approach to enabling image capture in low-light conditions is to provide active illumination of a scene or objects within the scene. For example, a flash or floodlight may be attached to or adjacent to a camera incorporating an image sensor, and the flash or floodlight may be operated in coordination with the exposure period of the image sensor to obtain the image. However, such an arrangement is relatively inefficient in that the illumination period and coverage area of ​​the illumination light are wider than typically required. In addition, such auxiliary lighting systems are typically relatively bulky and are often provided as a separate device from the imaging system itself.

[0006] In addition to collecting images from a scene, light-based sensors are also used for other purposes. For example, light detection and ranging (lidar) systems can determine the distance to an object by determining the length of time required for a pulse of light to travel through the system, reflect off the object, and return to the sensor. However, while some of these systems transmit light through a telescope or other optical structure that is also used to transmit the collected light to the sensor, the illumination source, often in the form of a laser, is located remotely from the image sensor. Also, additional optical elements are required to position the illumination light on a path that can be used by the telescope. These additional elements reduce the efficiency of the illumination light transmission.

[0007] It is therefore desirable to provide an illumination source for an image sensor that operates with greater efficiency than conventional devices. [Means for solving the problem]

[0008] Embodiments of the present disclosure provide image sensors and image sensing methods that include an integrated illumination source for providing active illumination of a scene. More specifically, the illumination source is positioned near an image plane of the image sensor. Image sensors according to embodiments of the present disclosure may include a plurality of photosensitive pixels arranged in an array. The illumination source may be positioned adjacent to the image sensor. Additionally, the illumination source utilizes the same optical elements that operate to collect light from within a scene and transmit light from within the scene to the image sensor. According to at least some embodiments of the present disclosure, light from the illumination source is directed toward one or more pixels of the image sensor and then reflected toward the imaging optics for transmission to the scene. Light reflected from objects in the scene is then received through the imaging optics. The illumination light may be reflected from selected pixel areas, directed toward the scene by the imaging optics, reflected by objects in the scene, returned through the imaging optics, and incident on the selected pixel areas due to the conjugate nature of the imaging optics.

[0009] According to at least some embodiments of the present disclosure, the image sensor includes pixels that operate to generate electrical charge in response to receiving photons collected through the imaging optics. By way of example, the pixels may be configured as an array of photodiodes or organic photovoltaic devices arranged within an imaging surface. Each of the pixels may also be associated with a microlens. Additionally, some or all of the pixels may be associated with a color filter or polarization-selective surface to enable selection of the color and / or polarization of light collected from a scene.

[0010] The illumination source may be configured as a light source disposed adjacent to or near the imaging surface of the image sensor. For example, the illumination source may be disposed behind a cover glass element extending over the pixel array. The light source may itself be provided as a light emitting diode, laser, or other photon source disposed adjacent to the pixel array. Alternatively or additionally, the light source may include an optical fiber, an aperture, a lens, or other optical structure that allows photons generated by the light emitting diode, laser, or other photon source not disposed directly adjacent to the image sensor to be transmitted to some or all of the pixels of the pixel array. According to at least some embodiments of the present disclosure, illumination light emitted by the light source is reflected toward the scene by one or more of the image sensor pixels. According to other embodiments of the present disclosure, the light source operates to direct the emission of illumination light from the pixel itself. According to still other embodiments of the present disclosure, pixels in the pixel array operate to generate illumination light. For example, an image sensor may include pixels that operate in a first mode to illuminate a scene and then in a second mode to detect light collected from the scene. In all of the various configurations, the illumination light passes through the same imaging lens that is used to collect light from the scene.

[0011] An image sensing method according to an embodiment of the present disclosure includes generating illumination light near an image sensor pixel array. According to an embodiment of the present disclosure, the illumination light is reflected off some or all of the pixels in the pixel array of the image sensor, passes through imaging optics, and illuminates a scene. According to other embodiments of the present disclosure, the illumination light may be provided by directing excitation light received from an illumination source onto pixels included in the pixel array. The pixel array absorbs and re-emits the illumination light. According to yet other embodiments of the present disclosure, providing the illumination light includes operating pixels capable of emitting light in an emission mode and then detecting light collected from the scene, including the illumination light reflected off objects in the scene, by operating the pixels in a light detection mode.

[0012] Further features and advantages of the embodiments of the present disclosure will become more readily apparent from the following description, particularly when considered in conjunction with the accompanying drawings. [Brief explanation of the drawings]

[0013] [Figure 1] FIG. 1 represents a scene in which active illumination is used for image acquisition according to the prior art. [Figure 2] FIG. 2 is a schematic diagram of a prior art imaging system and prior art active illumination. [Figure 3A] FIG. 3A depicts a scene in which active illumination is used in connection with obtaining an image according to an embodiment of the present disclosure. [Figure 3B] FIG. 3B illustrates a scene in which active illumination is used in connection with obtaining an image according to an embodiment of the present disclosure. [Figure 4] FIG. 4 is a schematic diagram of portions of an imaging system with integrated active illumination according to an embodiment of the present disclosure. [Figure 5] FIG. 5 is a schematic diagram of portions of an imaging system with integrated active illumination according to another embodiment of the present disclosure. [Figure 6] FIG. 6 is a schematic diagram of portions of an imaging system with integrated active illumination according to another embodiment of the present disclosure. [Figure 7A] FIG. 7A is a schematic diagram of portions of an imaging system with integrated active illumination according to another embodiment of the present disclosure. [Figure 7B] FIG. 7B is a plan view of an image sensor included in an imaging system according to an embodiment of the present disclosure. [Figure 8] FIG. 8 is a schematic diagram of portions of an imaging system with integrated active illumination according to another embodiment of the present disclosure. [Figure 9A]FIG. 9A is a cross-sectional view of a pixel incorporating a reflector structure according to an embodiment of the present disclosure. [Figure 9B] FIG. 9B is a cross-sectional view of a pixel incorporating a reflector structure according to an embodiment of the present disclosure. [Figure 10A] FIG. 10A is a cross-sectional view of a pixel incorporating fluorescent material according to an embodiment of the present disclosure. [Figure 10B] FIG. 10B is a cross-sectional view of a pixel incorporating fluorescent material according to an embodiment of the present disclosure. [Figure 11A] FIG. 11A is a cross-sectional view of a pixel incorporating quantum dot material according to another embodiment of the present disclosure. [Figure 11B] FIG. 11B is a cross-sectional view of a pixel incorporating quantum dot material according to another embodiment of the present disclosure. [Figure 12A] FIG. 12A shows the output of a light source according to an embodiment of the present disclosure. [Figure 12B] FIG. 12B shows the output of a light source according to an embodiment of the present disclosure. [Figure 13] FIG. 13 is a diagram illustrating elements of an image sensor included in an imaging system according to an embodiment of the present disclosure. [Figure 14] FIG. 14 illustrates an example process for lighting a scene according to an embodiment of the present disclosure. [Figure 15] FIG. 15 is a block diagram illustrating a schematic configuration example of a camera, which is an example of a device including an image sensor according to an embodiment of the present disclosure. DETAILED DESCRIPTION OF THE INVENTION

[0014] FIG. 1 illustrates a scene 100 in which active illumination is used for image capture according to the prior art. More specifically, in this example, an imaging system 104, such as a camera incorporating an image sensor, is shown positioned to obtain an image of the scene 100 including an object or area of ​​interest 108. The imaging system 104 operates in conjunction with a light source 112, in this example, an off-board flash unit. The operation of the imaging system 104 and the light source 112 is coordinated so that the light source 112 generates illumination light 116 during an exposure period of the imaging system 104. As shown in the figure, the illumination light 116 is dispersed over a relatively large area 120, decreasing with distance from the light source 112. Additionally, the area 120 to which the illumination light 116 is provided is larger than a field of view 124 of the imaging system 104. The field of view 124 of the camera 104 is also larger than the area of ​​the scene 100 occupied by the object or area of ​​interest 108 from which light 128 is reflected. Thus, this prior art arrangement suffers from several inefficiencies in illuminating the object 108 in the scene 100 using a light source 112 external to the imaging system 104.

[0015] Referring now to FIG. 2 , portions of a prior art imaging system 104 and associated external light source 112 are depicted relative to an object 108 in a scene 100. As shown, and as would be understood by one of ordinary skill in the art, the imaging system 104 includes an image sensor 202. The image sensor 202 includes a plurality of pixels 204 disposed within a sensor substrate 208 and arranged in a two-dimensional array 212. Each pixel 204 may be associated with a microlens 216 and a color filter 220. Light 128 from within the scene 100 is collected by a filter 224 and directed toward the pixels 204 in the array 212. As shown, light 128 reflected from an object point or selected area 228 associated with the object 108 is incident on a subset of the pixels 204 in the array 212.

[0016] 3A and 3B depict examples of active illumination of a scene 100 using systems and methods according to embodiments of the present disclosure. In both of these examples, an imaging system 304 as a camera incorporating an image sensor is shown in a position to obtain an image of the scene 100 including the objects or area of ​​interest 108 by collecting light 328 reflected from one or more objects 108 within the scene 100. Also, in both of these examples, the imaging system 304 operates in conjunction with a light source 428 (see FIG. 4 ) that is integral with the imaging system 304. While shown as a camera in various examples, it should be appreciated that the imaging system 304 according to embodiments of the present disclosure is not limited to such a configuration. Instead, the imaging system 304 described herein may be incorporated into any system, apparatus, or method in which efficient illumination of objects external to the imaging system is necessary or desirable.

[0017] 3A , illumination light 316 generated by light source 428 passes through imaging optics 424 provided as part of imaging system 304 and is transmitted to an area of ​​scene 100 coextensive with field of view 324 of imaging system 304. It can therefore be seen that embodiments of the present disclosure enable illumination light to be transmitted within an area that is the same as or similar (e.g., ±5%) to the area encompassed by field of view 324 of imaging system 304. Accordingly, embodiments of the present disclosure enable illumination light to be utilized more efficiently than systems that utilize light sources that are not integral to the imaging system.

[0018] 3B, the illumination light 316 generated by the light source 428 again passes through imaging optics 424 provided as part of the imaging system 304. However, in this example, the illumination light is transmitted within a portion, or sub-area, of the total area encompassed by the field of view 324 of the imaging system 304. Thus, embodiments of the present disclosure allow the illumination light to be concentrated within a selected area within the scene 100, such as the area corresponding to the object 108, thereby allowing for even more efficient use of the illumination light.

[0019] Referring now to FIG. 4 , portions of an imaging system 304 with an integrated light source 428 according to an embodiment of the present disclosure are depicted relative to an object 108 in a scene 100. In this embodiment, the imaging system 304 may include an image sensor 402 having a plurality of pixels 404. The plurality of pixels 404 are arranged in a two-dimensional pixel array 412 formed in a sensor substrate 408 and located at an image plane 414 of the system. Each pixel 404 may be associated with a microlens 416 and a color filter 420. Accordingly, at least some embodiments of the image sensor 402 included in embodiments of the present disclosure may be the same as or similar to the image sensor 202 of a conventional imaging system 104. According to embodiments of the present disclosure, as shown in FIG. 4 , the microlens 416 may be provided as a refractive element. According to other embodiments of the present disclosure, the microlens 416 may be provided as a diffractive element.

[0020] Additionally, the imaging system 304 according to an embodiment of the present disclosure includes an integrated light source 428 having at least an output or output surface 432. The output or output surface 432 is located adjacent to the pixel array 412. The light source 428 may include any photon source, such as, but not limited to, a light emitting diode source, a laser source, a quantum dot material source, a fluorescent source, or an incandescent light source. In the example of FIG. 4 , the light source 428 as well as the output 432 are located adjacent to the pixel array 412, for example, within an enclosing imaging system package 436. The imaging system package 436 serves as a structure interconnecting various components of the imaging system 304, such as, but not limited to, an image sensor 402, an illumination source 428, and imaging optics 424. The imaging package 436, the image sensor 402, and the imaging optics 424 together define an imaging volume 440. The imaging system 304 may also include a cover glass 444 disposed between the image sensor 402 and the imaging optics 424. With the cover glass 444, an imaging volume 440 is defined by the imaging package 436, the image sensor 402, and the cover glass 444. Also, in this example, the light source 428 and associated output 432 are located within the imaging volume 440. As discussed in more detail elsewhere herein, some or all of the pixels 404 may include a reflector or an emitter, for example, as a fluorescent layer or a quantum dot layer. The reflector is for reflecting light from the light source. The emitter is for emitting light in response to excitation light received from the light source 428.

[0021] According to at least some embodiments of the present disclosure, pixel array 412 may include pixels 404 configured as optical black pixels. According to further embodiments of the present disclosure, the optical black pixels may be located laterally adjacent to or behind the imaging pixels 404. As will be appreciated by those skilled in the art, optical black pixels are generally configured similarly to imaging pixels, except that they are blocked from receiving light. According to embodiments of the present disclosure, the inclusion of optical black pixels in pixel array 412 allows for the detection of parasitic signals that may be present in the imaging pixels as a result of exposure to illumination light 316 and for the parasitic signals to be subtracted from the signals generated by the imaging pixels 404 during imaging operations.

[0022] As will be appreciated by those skilled in the art, optical systems have a conjugate property, in which image points (i.e., points on an image plane, such as formed by pixel array 412) have a one-to-one correspondence with object points (i.e., points in a scene). Embodiments of the present disclosure utilize this property to efficiently generate active illumination of a scene or multiple areas within a scene by introducing illumination light 316 to the image sensor 402 side of the imaging optics 424. According to at least some embodiments of the present disclosure, illumination light 316 generated by light source 428 is transmitted to the imaging optics 424 by first reflecting off pixels 404 located in the image plane 414. During operation, light source 428 may operate to generate illumination light 316 that is directed toward the scene 100 to illuminate objects 108 within the scene 100. More specifically, the illumination light 316 generated by the light source 428 travels from the output surface 432 along a first segment of illumination light 316a toward at least some of the pixels 404 included in the pixel array 412. For example, the output 432 may distribute the illumination light in the first segment 316a across all of the pixels 404 in the array 412. As another example, the output 432 may distribute the illumination light in the first segment 316a across the pixels 404 in one or more selected areas of the array 412 to direct the illumination light 316 toward a corresponding area or areas of the scene 100. The pixels 404 reflect the received light along the second segment 316b, through the cover glass 444, and toward the imaging optics 424. For example, as discussed in more detail elsewhere herein, the pixels 404 may include a reflector structure to direct the received illumination light 316 toward the imaging optics. The imaging optics 424 direct the received light along the third segment of the illumination light 316c. Thus, the illumination light is directed by the imaging optics 424 to an area within the field of view 324 of the imaging system 104. Light 328 reflected from within the field of view 324 of the imaging system 304 is collected by the imaging optics 324 and directed to the pixel array 412.The signals generated by the pixels 404 in the pixel array 412 in response to receiving the reflected light 328 may then be processed and used to identify information from the scene, including but not limited to forming an image of the scene 100.

[0023] According to other embodiments of the present disclosure, the illumination light 316 directed toward the scene 100 by the imaging optics 424 is the result of emission from some or all of the pixels 404 stimulated by light received from the light source 428. Accordingly, as discussed in more detail elsewhere herein, the pixels 404 may include a light emitter such as a fluorescent layer or quantum dot structures. More specifically, the light source 428 may operate to generate illumination light 316a that is directed toward some or all of the pixels 404. In response to receiving illumination light 316a at a first wavelength, pixels 404 incorporating a fluorescent layer re-emit light at a second wavelength. If the pixels 404 incorporate photoluminescent quantum dot structures, they may be stimulated to emit light by exposing them to the illumination light 316a received from the light source 428. The re-emitted or emitted light from the pixels 404 travels to the imaging optics 424 as illumination light 316b. As in other embodiments, the pixels 404 that emit the illumination light 316 that travels to the imaging optics 424 may be selected so that the illumination light 316 is directed only to selected areas of the scene 100 .

[0024] 5, portions of an imaging system 304 having an integrated light source 428 according to another embodiment of the present disclosure are depicted relative to an object 108 in a scene 100. In this embodiment, the imaging system 304 is configured the same as or similar to the embodiment shown in FIG. 4, except that in this example, the light source 428 is located outside the imaging volume 440. However, the output 432 of the light source 428 is disposed within the imaging volume 440, and illumination light generated by the light source 428 is introduced through an illumination light conduit 504 that extends into the imaging volume 440. By way of example, and not limitation, the illumination light conduit 504 may be implemented as an optical fiber. The optical fiber has a first or input end at or adjacent to the light source 428 and a second end within the imaging volume 440. As another example, the illumination light conduit 504 may be configured as an aperture in the imaging package 436. According to at least some embodiments, output 432 is associated with an optical element such as a lens, mirror, diffraction grating, or is itself configured as an optical element.

[0025] In this additional embodiment, the imaging system 304 directs illumination light generated by the light source 428 into the imaging volume 440 by directing the generated light into an illumination light conduit 504. The illumination light conduit 504 then transmits the illumination light from an associated output 432 into the imaging volume 440, specifically into the first illumination light segment 316a. The illumination light of the first illumination light segment 316a is directed toward at least some of the pixels 404 included in the pixel array 412. The pixels 404 upon which the illumination light 316 is incident reflect the light through a cover glass 444 toward the imaging optics 424 and into the second illumination light segment 316b. The light is then directed along a third illumination light segment 316c into an area of ​​the scene 100 within the field of view 324 of the imaging system 304. The light reflected within the field of view 324 of the imaging system 304 is collected by the imaging optics 324 and directed toward the pixel array 412. The signals generated by the pixels 404 in the pixel array 412 in response to receiving the reflected light 328 may then be processed and used to discern information from the scene, including, but not limited to, forming an image of the scene 100. Alternatively, the pixels may include a fluorescent or quantum dot layer that re-emits or emits light in response to receiving stimulating light from the light source 428.

[0026] FIG. 6 illustrates portions of an imaging system 304 with an integrated light source 428 relative to an object 108 in a scene 100 according to yet another embodiment of the present disclosure. In this embodiment, some or all of the pixels of an image sensor 402 incorporate an emitter-detector pixel array 412, where the pixels 404 include quantum dot pixels configured as electroluminescent dual-purpose pixels. Thus, the light source 428 is part of the pixel array 412. In other respects, the imaging system 304 of this embodiment may be the same as or similar to other embodiments. For example, the pixels 404 may each be associated with a microlens 416 (represented as a set of diffractive elements in this example, but as in other embodiments, the microlenses 416 may be provided as refractive or diffractive elements). Additionally, some or all of the pixels may be associated with a color filter 420.

[0027] In a variation of this embodiment including quantum dot pixels 404, in a first mode, the pixels 404 operate to emit illumination light 316, and in a second mode, the pixels 404 operate to sense received light. Thus, no light source external to the pixel array 412 is required. Instead, while operating in the first mode, illumination light 316 generated by the pixels 404 themselves travels to the imaging optics 424 for transmission to the scene 100. The pixels 404 then operate in the second mode to detect reflected light 328 that is collected by the imaging optics 424 and returned to the pixels 404. According to embodiments of the present disclosure, all or a portion of the pixels 404 may operate to generate illumination light 316. For example, if maximum illumination is desired across the field of view 324 of the imaging system 304, all of the pixels 404 may operate to generate illumination light 316. As another example, if less than maximum illumination is desired across the field of view 324 of the imaging system 304, then a set of fewer than all of the pixels 404 may be activated, distributed evenly across the pixel array 412. As yet another example, if only selected areas of the scene 100 are of interest, then pixels 404 in one or more selected areas of the pixel array 412 that correspond to the selected area or areas within the scene 100 may be activated.

[0028] Referring now to FIG. 7A , portions of an imaging system 304 having an integrated light source 428 according to yet another embodiment of the present disclosure are depicted relative to an object 108 in a scene 100. In this embodiment, the imaging system 304 may include an image sensor 402 having a plurality of sensor pixels 404 a and a plurality of light emitting pixels or light emitting elements 404 b that function as the light source 428. FIG. 7B illustrates a plan view of a pixel array incorporating light emitting elements 404 b in addition to sensor pixels 404 a, although as shown in FIG. 7 , the light emitting elements 404 b may be intermittently positioned between the sensor pixels 404 a in the pixel array 412. In the illustrated example, the light emitting elements 404 b are regularly spaced within the pixel array 412. However, other arrangements are possible. For example, the light emitting elements 404 b may be more densely spaced toward the center of the pixel array 412 and more sparsely spaced toward the periphery of the pixel array 412. In such an embodiment, the light source 428 need not be located outside the pixel array 412. Instead, illumination light 316 generated by light emitting elements 404b disposed within pixel array 412 and collectively operating as light sources 428 proceeds to imaging optics 424 for transmission to scene 100. Light 328 reflected from objects 108 in the scene and collected by imaging optics 424 is then returned to pixel array 412 where it is sensed by sensor pixels 404a. As would be understood by one of ordinary skill in the art after considering this disclosure, all or less than all of the light emitting elements 404b may be operated to generate illumination light 316. For example, whether to operate selected light emitting elements 404b may be determined based on a desired illumination level or an area in scene 100 where illumination is desired.

[0029] Referring now to FIG. 8 , portions of an imaging system 304 with an integrated light source 428 according to yet another embodiment of the present disclosure are depicted relative to an object 108 in a scene 100. In this embodiment, the imaging system 304 may include an image sensor 402 having a plurality of sensor pixels 404 a and a plurality of light-emitting pixels or light-emitting elements 404 b. The plurality of sensor pixels 404 a are arranged in a first pixel array 412 a. The plurality of light-emitting pixels or light-emitting elements 404 b are arranged in a second pixel array or element array 412 b positioned directly behind the first array 412 a. The first array 412 a collectively provides the light source 428. In other respects, the imaging system 304 of this embodiment may be the same or similar to other embodiments. For example, each pixel 404 may be associated with a microlens 416 (shown as a set of refractive elements in this example, but as in other embodiments, the microlenses 416 may be provided as refractive or diffractive elements). In addition, some or all of the pixels may be associated with a color filter 420 .

[0030] In the embodiment depicted in FIG. 8 , some or all of the light emitting elements 404b arranged in the second array 412b may be operated to generate illumination light 316, thereby operating as light sources 428. More specifically, light generated by the light emitting elements 404b travels through corresponding sensor pixels 404a to the imaging optics 424 for transmission to the scene 100. Light 328 reflected from objects 108 in the scene and collected by the imaging optics 424 is then returned to the sensor pixels 404a in the first array 412a. If maximum illumination is desired across the field of view 324 of the imaging system 304, all of the light emitting elements 404b may be operated to generate illumination light. As another example, if less than maximum illumination is desired across the field of view 324 of the imaging system 304, a set of fewer than all of the light emitting elements 404b distributed evenly across the second array 412b may be operated. As yet another example, if only selected areas of the scene 100 are of interest, light-emitting elements 404b may be activated in one or more selected areas of the second array 412b that correspond to the selected area or areas in the scene 100.

[0031] 9A and 9B, cross-sectional views of an embodiment of a pixel 404 incorporating a reflector structure 908 and operable in conjunction with embodiments of the present disclosure incorporating an integrated light source 428 having an output 432 adjacent to a pixel array 412 are shown. By way of example, and not limitation, a pixel 404 such as that shown in FIGS. 9A and 9B may be applied in conjunction with various embodiments of the present disclosure, including those shown in FIGS. 4 and 5. As shown, the illustrated variations are the same except that the pixel shown in FIG. 9A includes a refractive microlens 416 and the pixel shown in FIG. 9B includes a diffractive microlens 416. Otherwise, the elements of the illustrated pixel 404 are the same or similar, and therefore the following description applies to both unless otherwise indicated. The pixel 404 generally includes a photoelectric conversion structure 904 formed in a sensor substrate 408 that emits electrons in response to exposure to light. In the illustrated example, the photoelectric conversion structure 904 is represented as a photodiode. However, different pixel configurations are possible, as would be understood by one of ordinary skill in the art after considering this disclosure. For example, the photoelectric conversion structure 904 of pixel 404 may comprise a photodiode in combination with an organic photosensor, an organic photosensor, or any other structure capable of generating charge in response to exposure to light.

[0032] The reflector structure 908 is disposed at or near the light-receiving surface of the photoelectric conversion structure 904. The reflector structure 908 may be configured as a partially reflective mirror. According to at least some embodiments of the present disclosure, the reflector structure 908 is formed by disposing one or more layers of material on the sensor substrate 408. For example, if the sensor substrate 408 is formed of silicon, a layer of silicon dioxide may be disposed on the light-receiving surface of the sensor substrate 408 to form a partial reflector, thereby forming the reflector structure 908. As another example, the reflector structure 908 may be provided as a polarization-sensitive reflector. As will be understood by those skilled in the art after considering the present disclosure, polarization-sensitive reflectors transmit different amounts of light depending on the shape of the object 108 that reflects the light 328 back to the pixel 404. By way of example, and not limitation, the reflector structure 908 according to embodiments of the present disclosure may be capable of reflecting 30% to 70% of the light incident on the pixel 404.

[0033] The pixel 404 may further include an aperture structure 912. According to embodiments of the present disclosure, the aperture structure 912 may be disposed adjacent to the light-receiving surface of the sensor substrate 408. The aperture structure 912 may define an aperture 916 that operates to limit the range of angles at which light 316a or 328 incident on the pixel 404 is received. Alternatively, the aperture structure 912 may define an aperture 916 that operates to limit the range of angles at which illumination light 316b reflected by the reflector structure 908 is provided to the imaging optics 424 through the aperture 916. The reflector structure 908 may be disposed within the aperture 916. According to other embodiments of the present disclosure, the reflector structure 908 may be disposed between the aperture structure 912 and the light-incident surface of the sensor substrate 408. By way of example and not limitation, the aperture structure 912 may be formed from a metal layer or a layer of a low-refractive-index material disposed on the light-incident side of the sensor substrate 408.

[0034] The microlenses 416 may be positioned over the light entrance surface of the aperture structure 912. Additionally, the position of the microlenses 416 may be offset relative to the centerline of the pixel 404, and / or the shape of the microlenses 416 may be modified depending on the specific location of the pixel 404 within the pixel array 412 to accommodate a particular chief ray angle (e.g., in plan view, the refractive microlenses 416 may be elliptical rather than circular, while the structure of the diffractive microlenses 416 may be modified compared to the microlenses 416 associated with pixels 404 at different locations in the pixel array 412). More specifically, the configuration of the microlenses 416 and aperture 916 may be selected to ensure that the illumination light 316 reflected by the reflector structure 908 is delivered to the imaging optics 424 within a selected cone or area. Additionally, as can be understood by one of ordinary skill in the art after considering the present disclosure, the system 104 according to embodiments of the present disclosure enables a 1:1 correspondence between image points (points in the pixel array 412 or pixels 404) and object points 228. Thus, in embodiments in which the illumination light 316 is reflected from the selected pixel 404, such as embodiments in which the selected pixel 404 includes a reflector structure 908, the illumination light 316 is reflected to the imaging optics 424, passes through the imaging optics 424 to the object point 228, and is returned by the imaging optics 424 as reflected light 328 to be received at the selected pixel 404.

[0035] 10A and 10B, cross-sectional views of an embodiment of a pixel 404 incorporating a fluorescent layer 1004 operable in conjunction with an embodiment of the present disclosure incorporating an integrated light source 428 having an output 432 adjacent to a pixel array 412 are shown. As shown in the figures, the illustrated variations are the same, except that the pixel shown in FIG. 10A includes a refractive microlens 416, while the pixel shown in FIG. 10B includes a diffractive microlens 416. Otherwise, the elements of the illustrated pixel 404 are the same or similar, and therefore the following description applies to both unless otherwise indicated. The pixel 404 generally includes a photoelectric conversion structure 904 formed in a sensor substrate 408 that emits electrons in response to exposure to light.

[0036] The fluorescent layer 1004 is disposed on or near the light-receiving surface of the photoelectric conversion structure 904 formed on the sensor substrate 408. Generally, the fluorescent layer 1004 includes a material that re-emits illumination light 316b in response to receiving illumination or excitation light 316a from the light source 428. The illumination light 316b is provided to the imaging optics 324 and then directed toward the scene 100 as illumination light 316c.

[0037] The pixel 404 may further include an aperture structure 912 disposed adjacent the light-receiving surface of the sensor substrate 408. The aperture structure 912 may define an aperture 916 that operates to limit the range of angles at which light 316 or 328 incident on the pixel 404 is received. The aperture 916 may further define the range of angles at which the illumination light 316 re-emitted by the fluorescent layer 1004 is provided to the imaging optics 424. According to at least some embodiments of the present disclosure, the fluorescent layer 1004 is disposed within the aperture 916. According to other embodiments of the present disclosure, the fluorescent layer 1004 may be disposed between the aperture structure 912 and the light-incident surface of the sensor substrate 408. As in other embodiments, the aperture structure 912 may be formed from a metal layer or may be formed from a layer of a low-index material disposed on the light-incident side of the sensor substrate 408.

[0038] As in at least some other embodiments, the microlenses 416 may be positioned over the light entrance surface of the aperture structure 912. Additionally, the location of the microlenses 416 may be offset relative to the centerline of the pixel 404, and / or the shape of the microlenses 416 may be varied depending on the specific location of the pixel 404 within the pixel array 412 to accommodate a particular chief ray angle (e.g., in an elevation view, the microlenses 416 may have a different thickness and curvature than microlenses 416 associated with pixels 404 at different locations in the pixel array 412). More specifically, the configuration of the microlenses 416 and aperture 916 may be selected to ensure that the illumination light 316 emitted by the fluorescent layer 1004 is delivered to the imaging optics 424 within a selected cone or area. Additionally, as will be understood by those skilled in the art after considering the present disclosure, the system 104 according to embodiments of the present disclosure enables a 1:1 correspondence between image points (points in the pixel array 412 or pixels 404) and object points 228. Thus, in embodiments in which illumination light 316 is emitted from a selected pixel 404, such as an embodiment in which the selected pixel 404 includes a fluorescent layer 1004, the illumination light 316 is provided to the imaging optics 424, passes through the imaging optics 424 to the object point 228, and is returned by the imaging optics 424 as reflected light 328 to be received at the selected pixel 404.

[0039] 11A and 11B, cross-sectional views of an embodiment of a pixel 404 incorporating an electroluminescent quantum dot material 1104 are shown. The pixel 404 incorporating the electroluminescent quantum dot material 1104 may operate in a first mode, i.e., a light-emitting mode, and a second mode, i.e., a light-detecting mode. Pixels incorporating the electroluminescent quantum dot material 1104 are applicable in connection with various embodiments of the present disclosure in which illumination light 316 is generated in a pixel array 412, including those illustrated in connection with FIG. 6. Accordingly, in such embodiments, a light source 428 is provided as part of the pixel array 412. As shown in the figures, the illustrated variations are the same except that the pixel illustrated in FIG. 11A includes a refractive microlens 416, and the pixel illustrated in FIG. 11B includes a diffractive microlens 416. Otherwise, the elements of the illustrated pixel 404 are the same or similar, and therefore the following description applies to both unless otherwise indicated.

[0040] The quantum dot material 1104 is disposed on or near the light-receiving surface of the sensor substrate 408. As can be appreciated by those skilled in the art, the quantum dot material 1104 may be disposed between various layers and electrodes to operate the associated pixel 404 in either an emission mode or a detection mode. In the emission mode, a forward bias is applied to the quantum dot material 1104. In the detection mode, a reverse bias is applied to the quantum dot material 1104.

[0041] The pixel 404 may further include an aperture structure 912 disposed adjacent the light-receiving surface of the sensor substrate 408. The aperture structure 912 may define an aperture 916 that operates to limit the range of angles at which light 316 or 328 incident on the pixel 404 is received. The aperture 916 may further define the range of angles at which the illumination light 316 re-emitted by the fluorescent layer 1004 is provided to the imaging optics 424. According to at least some embodiments of the present disclosure, the quantum dot layer 1104 is disposed within the aperture 916. According to other embodiments of the present disclosure, the quantum dot layer 1104 may be disposed between the aperture structure 912 and the light-incident surface of the sensor substrate 408. As in other embodiments, the aperture structure 912 may be formed from a metal layer or may be formed from a layer of a low-index material disposed on the light-incident side of the sensor substrate 408.

[0042] Similar to or similar to at least some other embodiments of the present disclosure, the microlenses 416 may be positioned over the light entrance surface of the aperture structure 912. Additionally, the position of the microlenses 416 may be offset relative to the centerline of the pixel 404, and / or the shape of the microlenses 416 may be varied depending on the particular location of the pixel 404 within the pixel array 412 to accommodate a particular chief ray angle. More specifically, the configuration of the microlenses 416 and apertures 916 may be selected to ensure that the illumination light 316 emitted by the reflector structure 908 is delivered to the imaging optics 424 within a selected cone or area. Additionally, as can be understood by one of ordinary skill in the art after considering the present disclosure, the system 104 according to embodiments of the present disclosure enables a 1:1 correspondence between image points (points or pixels 404 within the pixel array 412) and object points 228. Thus, in embodiments in which illumination light 316 is emitted by the selected pixel 404, such as embodiments in which the selected pixel 404 includes quantum dot material 1104, the illumination light 316 is reflected to the imaging optics 424, passes through the imaging optics 424 to the object point 228, and is returned by the imaging optics 424 as reflected light 328 to be received at the selected pixel 404.

[0043] 12A and 12B, embodiments of the output 432 of the light source 428 are depicted, in accordance with embodiments of the present disclosure. As discussed elsewhere herein, the output 432 of the light source 428 may be part of or coupled to the light source 428 itself. Alternatively, the output 432 of the light source 428 may be part of or coupled to an aperture, one or more fiber optic elements, or other conduit extending between the light source 428 and the imaging volume 440 of the imaging system 304. As shown in FIG. 12A, at least some embodiments of the output 432 may include a dispersive lens element 1204. The dispersive lens element 1204 may be capable of distributing the illumination light 316a from the light source 328 evenly across all or a majority of the pixels 404 of the pixel array 412. As shown in FIG. 12B, other embodiments of the output 432 may include a diffractive lens element 1208. As shown, the diffractive lens element 1208 may include a two-dimensional grating. The two-dimensional grating provides illumination light 316a as structured light comprising beam spots that are delivered to specific pixels 404 in the pixel array 412. According to yet another embodiment of the present disclosure, the output 432 may simply be the output of an optical fiber or set of optical fibers with a large numerical aperture (small f-number) to transmit a large cone of light across the pixels 404 of the pixel array 412.

[0044] 13 is a diagram illustrating elements of an image sensor or device 402 that may be included in an imaging system 304 according to an embodiment of the present disclosure. Generally, the image sensor 402 includes a plurality of pixels 404 arranged in an array 412. More specifically, the pixels 404 may be arranged in the array 412 having a plurality of rows and columns of pixels 404. The pixels 404 are also disposed on a sensor substrate 408. Additionally, one or more peripheral or other circuits may be disposed in association with the sensor substrate 408. Such circuits may include, for example, vertical drive circuitry 1316, column signal processing circuitry 1320, horizontal drive circuitry 1324, output circuitry 1328, and control circuitry 1332.

[0045] The control circuit 1332 can receive data indicating an input clock, an operating mode, and the like, and can output data such as internal information related to the image sensor 402. This allows the control circuit 1332 to generate clock signals that serve as a reference for the operations of the vertical drive circuit 1316, the column signal processing circuit 1320, and the horizontal drive circuit 1324, as well as vertical synchronization signals, horizontal synchronization signals, and control signals based on the master clock. The control circuit 1332 outputs the generated clock signals as control signals to various other circuits and components.

[0046] The vertical drive circuit 1316 may be implemented, for example, by a shift register. The vertical drive circuit 1316 is operable to select pixel drive lines 1336 and to provide pulses for driving the pixels 404 row by row via the selected drive lines 1336. The vertical drive circuit 1316 is also operable to selectively and sequentially scan the elements of the array 412 row by row in the vertical direction and to provide signals generated in the pixels 404 in response to the amount of light received to the column signal processing circuit 1320 via vertical signal lines 1340.

[0047] The column signal processing circuit 1320 may operate to perform signal processing such as noise removal on the signals output from the pixels 404. For example, the column signal processing circuit 1320 may perform signal processing such as correlated double sampling (CDS) to remove specific fixed pattern noise of selected pixels 404, or analog-to-digital (A / D) conversion of the signals.

[0048] The horizontal drive circuit 1324 may include a shift register. The horizontal drive circuit 1324 may sequentially output horizontal scanning pulses to cause each column signal processing circuit 1322 to output a pixel signal to a horizontal signal line 1344, thereby selecting each column signal processing circuit 1320 in turn.

[0049] The output circuit 1328 may perform predetermined signal processing on the signals sequentially supplied from each column signal processing circuit 1320 via the horizontal signal line 1344. For example, the output circuit 1328 may perform buffering, black level adjustment, column variation correction, various digital signal processing, and other signal processing procedures. The input / output terminal 148 exchanges signals between the image sensor 402 and external components or systems.

[0050] Thus, at least a portion of the color-sensing image sensor 402 according to at least some embodiments of the present disclosure may be configured as a column A / D type CMOS image sensor in which column signal processing is performed.

[0051] 14 depicts an embodiment of a process for illuminating a scene 100, according to an embodiment of the present disclosure. Initially, in step 1404, an imaging system 304 with an integrated light source 428 is positioned such that the field of view 324 of the imaging system 304 encompasses a selected area of ​​the scene 100. A determination may then be made as to whether illumination light 316 is necessary or desirable in connection with obtaining an image of the scene 100 (step 1408). If illumination light 316 is necessary or desirable, the light source 428 is activated to generate the illumination light 316 (step 1412). The details of how the light source 428 generates the illumination light 316 depend on the particular embodiment of the imaging system 304. For example, in connection with an imaging system 304 incorporating an image sensor 402 having pixels 404 including reflector structures 908, the light source 428 may operate to generate illumination light 316a that is provided across some or all of the pixels 404 in the pixel array 412 (e.g., through a dispersive lens at output 432 of the light source 428), or may operate to generate illumination light 316a that is directed (as structured light 316a) toward some or all of the pixel array 412 and pixels 404. As another example, in connection with an imaging system 304 incorporating an image sensor 402 having pixels 404 that include a fluorescent layer 1004 or photoluminescent quantum dot material, the light source 428 may operate to generate excitation light 316a that is provided to the pixels 404 in the pixel array 412, in response to which the pixels 404 re-emit or emit illumination light 316b. As yet another example, for an imaging system 304 incorporating an image sensor 402 having pixels 404 that are themselves operable to generate illumination light 316, thereby incorporating light sources 428 into the pixel array 412, such as light emitting diode pixels or pixels incorporating electroluminescent quantum dot material, some or all of such pixels 404 may be operated to emit illumination light 316b.According to embodiments of the present disclosure, illumination light 316 may be provided to the entire field of view 324 of the imaging system 304 by generating light from all of the pixels 404 in the pixel array 412 or by reflecting light from all of the pixels in the pixel array 412. According to other embodiments of the present disclosure, pixels 404 at selected points may be within selected areas of the pixel array 412 and used to reflect or generate illumination light 316. Additionally, due to the one-to-one correspondence between image points (corresponding to individual pixels 404 in the pixel array 412) and object points 228 in the scene 100 provided by at least some embodiments of the present disclosure, light reflected or emitted from the selected pixel 404 and reflected from the object point 228 is received back at the original pixel 404. Due to this connectivity, the selected pixel 404 or group of pixels 404 may operate to illuminate a selected object 108 or area in the scene 100.

[0052] In step 1416, illumination light 316 is directed toward the scene 100. More specifically, light reflected from or generated by pixels 404 travels to imaging optics 424 and reaches at least some portion of the scene 100 encompassed by the field of view 324 of the imaging system 304. After the illumination light 316 is reflected from or emitted by the pixels 404, the pixels 404 in the sensor array 412 are placed in sensing mode (step 1420). Light 328 reflected from objects 108 in the scene 100 is then collected by the imaging optics 424 and directed back to the pixel array 412 (step 1424). More specifically, as mentioned elsewhere herein, due to the conjugate nature of the imaging system 304 according to embodiments of the present disclosure, illumination light 316 reflected from or emitted by selected pixels 404 is reflected from objects 108 in the scene 100, received as reflected light in the imaging system 304, and incident on the selected pixels 404. The image information collected by the pixels may then be processed and applied to generate an output (step 1428). The process may then end.

[0053] 15 is a block diagram illustrating a schematic configuration of a camera 1500 as an example of an embodiment of an imaging system 304 incorporating an integrated illumination light source 428 according to an embodiment of the present disclosure. As shown in the figure, the camera 1500 includes the light source 428, an imaging optical system 424, an image sensor 402, an imaging control unit 1503, a lens driving unit 1504, an image processing unit 1505, an operation input unit 1506, a frame memory 1507, a display unit 1508, and a recording unit 1509.

[0054] The imaging optics 424 include a camera objective lens. According to an embodiment of the present disclosure, the imaging optics 424 operates to project illumination light generated by the light source 428 onto an area encompassing some or all of the field of view 324 of the imaging system 304. In addition, the imaging optics 424 collects light from within the field of view 324 of the camera 1500, which may encompass the scene 100 including the object 108. As will be understood by one of ordinary skill in the art after considering the present disclosure, the field of view 324 is determined by various parameters, including the focal length of the lens, the size of the active area of ​​the image sensor 402, and the distance of the image sensor 402 from the lens. In addition to the lens, the imaging optics 424 may include other components, such as a variable aperture and a mechanical shutter. The imaging optics 424 directs the collected light toward the image sensor 402 to form an image of the object 108 on the light incident surface of the image sensor 402. The collected light may include light that was originally provided to the scene 100 as illumination light 316 and that is reflected from objects 108 within the scene 100 .

[0055] As discussed elsewhere herein, the image sensor 402 includes a plurality of pixels 404 arranged in an array 412. The image sensor 402 may also include a semiconductor device or semiconductor substrate 408. The semiconductor substrate 408 includes the pixels 404 as light-sensitive areas or photodiodes within the substrate 112. According to other embodiments, the image sensor 402 may include light-sensitive pixels 404a and light-emitting pixels 404b. According to still other embodiments of the present disclosure, the image sensor 402 may include pixels 404 incorporating quantum dot material operable to emit or sense light. When the imaging system 304 operates to generate illumination light 316, the included pixels 404 may be used to reflect or emit the illumination light 316. When the imaging system 304 operates to collect image information, the included pixels 404 operate to generate an electrical charge in response to received light, and more particularly, to generate an analog signal proportional to the amount of light incident thereon. These analog signals may be converted to digital signals in a circuit such as the column signal processing circuit 1320 included as part of the image sensor 402, or in a separate circuit or processor. The digital signals may then be output.

[0056] The imaging control unit 1503 controls the imaging operation of the image sensor 402 by generating a control signal and outputting it to the light source 428 and the image sensor 402. Furthermore, the imaging control unit 1503 may perform autofocusing in the camera 1500, or may perform autofocusing by adjusting the position of the lens via the lens driving unit 1504 based on the detected focus position. Note that the imaging control unit 1503 may include, for example, a DSP (Digital Signal Processor) equipped with firmware.

[0057] The lens driving unit 1504 drives the imaging optical system 424 under the control of the imaging control unit 1503. The lens driving unit 1504 may drive the imaging optical system 424 by changing the position of the lens elements included therein using a built-in motor.

[0058] Image processor 1505 processes the image signals generated by image sensor 402. This processing may include, for example, determining the amplitude of the signal intensity of pixels 404. Image processor 1505 may include, for example, a microcomputer with firmware and / or a processor running application programming to perform the processes described herein for identifying color information in the collected image information.

[0059] The operation input unit 1506 accepts operation input from a user of the camera. For example, a push button or a touch panel may be used as the operation input unit 1506. The operation input accepted by the operation input unit 1506 is transmitted to the imaging control unit 1503 and the image processing unit 1505. Thereafter, processing according to the operation input, such as light collection and object imaging, is started.

[0060] The frame memory 1507 is a memory capable of storing frames, which are image signals for one screen or one frame of image data. The frame memory 1507 is controlled by the image processing unit 1505 and stores frames during the image processing process.

[0061] The display unit 1508 can display information processed by the image processing unit 1505. For example, the display unit 1508 may be a liquid crystal panel.

[0062] The recording unit 1509 records the image data processed by the image processing unit 1505. As the recording unit 1509, for example, a memory card or a hard disk is used.

[0063] Although a camera is described as an example of an imaging system 304 incorporating an image sensor 402 and integrated light source 428, as well as other components, the processor, memory, and the like may be incorporated into other types of devices, such as those for executing programs or instructions and storing the calibration information described herein. Such devices include, but are not limited to, surveillance systems, automotive sensors, scientific instruments, medical instruments, ranging systems, and the like.

[0064] As will be understood by one of ordinary skill in the art after considering the present disclosure, the image sensor 402 disclosed herein includes an integrated illumination source, or light source 428. Illumination light generated by or in association with the light source 428 passes through imaging optics to two areas of a scene within the field of view of the imaging system 304. Light reflected from objects 108 in the scene 100 is collected by the imaging optics and sensed by pixels disposed within the pixel array 412. Therefore, by confining the illumination light 316 within the field of view 324 of the imaging system 304, the illumination light may be used more efficiently compared to various prior art systems. Additionally, the conjugate nature of the imaging optics 424 achieves a one-to-one correspondence between image points corresponding to pixels 404 in the pixel array 412 and points or areas 128 of the object 108.

[0065] While various embodiments discussed herein include an image sensor 402 having an array of pixels 412 that operate to acquire image information, embodiments of the present disclosure are not limited thereto. For example, an image sensor 402 with an integrated light source 428 as discussed herein may have a single pixel 404 or a relatively small number of pixels, for use in connection with, for example, a light-based ranging system. As another example, embodiments of the present disclosure may be provided as part of a three-dimensional imaging system or a light detection and ranging system. According to still other embodiments, the image sensor 402 may include a pixel array 412 having a large number of pixels that operate in modes other than traditional imaging modes, such as, for example, in certain scientific instrumentation and machine vision applications.

[0066] The present disclosure may have the following configuration. (1) outputting illumination light toward or from at least a portion of the pixels of the image sensor; directing the illumination light from the pixels through imaging optics towards an object; reflecting a portion of the generated light from the object as reflected light; directing at least a portion of the reflected light through the imaging optics to the image sensor; A method comprising: (2) The method of (1), wherein the illumination light is generated by a light source adjacent to the pixels of the image sensor, and the illumination light is reflected by a plurality of the pixels of the image sensor and travels through the imaging optical system toward the object. (3) The method of (2), wherein the light source is positioned within the imaging volume of the image sensor. (4) The method of (1), wherein the illumination light is directed to at least some of the pixels of the image sensor by at least a first optical fiber, and the illumination light is reflected by a plurality of the pixels of the image sensor. (5) The method of (4), wherein the output end of the at least first optical fiber is positioned within the imaging volume of the image sensor, and the input end of the at least first optical fiber receives the illumination light from a light source located outside the imaging volume of the image sensor. (6) The method of (1), wherein the illumination light is provided to fewer than all of the pixels of the image sensor. (7) The method of (1), wherein the pixels are arranged in an array and the illumination light is generated by elements in the array. (8) determining a distance to an object by determining an amount of time that elapses between generating the illumination light and receiving the reflected light at the pixel; The method of (1), further comprising: (9) generating an electric charge in response to the reflected light; forming an image from the generated charges; The method of (1), further comprising: (10) A sensor substrate; a plurality of pixels arranged in an array on the sensor substrate; a light source having an output located adjacent to or within said array of pixels; an imaging optical system that passes light from the light source; A sensor having A sensor system comprising: (11) The output of the light source is located within the imaging volume. (12) The image sensor system of (11) further comprising a cover glass, the cover glass being positioned between the imaging optical system and the plurality of pixels. (13) An image sensor system (12) further comprising an image sensor package, wherein the sensor is an image sensor, the image sensor package, the cover glass, and the sensor substrate define an imaging volume, and the light source is located within the imaging volume. (14) The image sensor system of (11), wherein the output of the light source is directed to at least some of the pixels included in the plurality of pixels. (15) The image sensor system of (14), wherein the output of the light source includes a diffractive lens element. (16) 15. The image sensor system of claim 14, wherein the at least some of the pixels include a reflector capable of reflecting light received from the output of the light source to the imaging optical system. (17) The image sensor system of (15), wherein at least some of the pixels include electroluminescent, photoluminescent, or both electroluminescent and photoluminescent materials. (18) The image sensor system of (11), wherein the light source is located outside the sensor substrate package, the light source is operatively connected to a first end of an optical fiber, and the output of the light source is at a second end of the optical fiber. (19) The image sensor system of (10), wherein the light source has a pixel included in the plurality of pixels and capable of outputting illumination light. (20) A sensor substrate; a plurality of pixels provided on the sensor substrate; an image sensor package; A cover glass and Light source and wherein the output of the light source is disposed within an imaging volume defined by the sensor substrate, the image sensor package, and the cover glass. Image sensor.

[0067] The foregoing has been presented for purposes of illustration and description. Moreover, the above description is not intended to limit the disclosed system and method to the form disclosed herein. Accordingly, variations and modifications commensurate with the above teachings, within the skill or knowledge of the relevant art, are within the scope of the present disclosure. The above embodiments herein further describe the best currently known modes of practicing the disclosed system and method and are intended to enable others skilled in the art to utilize the disclosed system and technique in such or other embodiments, and with various modifications dictated by a particular application or use. It is intended that the appended claims be construed to include alternative embodiments to the extent permitted by the prior art. [Explanation of symbols]

[0068] 100 scenes 104 Imaging System 108 Object 112 Light source 116 Illumination 120 Area 124 Field of View 128 light 148 Input / output terminal 202 Image Sensor 204 pixels 212 Array 216 Microlens 220 Color Filter 224 Imaging Optical Systems 228 object points or selected areas 304 Imaging System 316 Illumination 316a illumination light, first segment, first illumination light segment 316b illumination light, second segment, second illumination light segment 316c Illumination 324 Field of View 328 light 402 Image Sensor 404 pixels 404a Sensor pixel 404b Light-emitting pixel or element 408 Sensor Board 412 pixel array 412a First pixel array 412b Second Array 414 Image plane 416 Microlens Color Filter 420 424 Imaging Optical System 428 Light source 432 Output 436 Imaging Package 440 imaging volumes 444 Coverslip 504 Lighting light guide tube 904 Photoelectric conversion structure 908 Reflector Structure 912 Opening structure 916 Aperture 1004 Fluorescent layer 1104 Electroluminescent Quantum Dot Materials 1204 Dispersive Lens Element 1208 Diffractive lens element 1316 Vertical drive circuit 1320 Column signal processing circuit 1322 Column signal processing circuit 1324 horizontal drive circuit 1328 Output Circuit 1332 control circuit 1336 Pixel drive wiring 1340 vertical signal line 1344 horizontal signal line 1500 Camera 1503 Imaging control unit 1504 Lens drive unit 1505 Image processing unit 1506 Operation input section 1507 Frame Memory 1508 Display section 1509 Recording Department

Claims

1. outputting illumination light toward or from at least a portion of the pixels of the image sensor; directing the illumination light from the pixels through imaging optics towards an object; reflecting a portion of the generated light from the object as reflected light; directing at least a portion of the reflected light through the imaging optics to the image sensor; A method comprising:

2. 2. The method of claim 1, wherein the illumination light is generated by a light source adjacent to the pixels of the image sensor, and the illumination light is reflected off a plurality of the pixels of the image sensor and travels through the imaging optics toward the object.

3. The method of claim 2 , wherein the light source is disposed within an imaging volume of the image sensor.

4. The method of claim 1 , wherein the illumination light is directed by at least a first optical fiber to at least some of the pixels of the image sensor, and the illumination light is reflected off a plurality of the pixels of the image sensor.

5. 5. The method of claim 4, wherein an output end of the at least first optical fiber is positioned within an imaging volume of the image sensor, and an input end of the at least first optical fiber receives the illumination light from a light source located outside the imaging volume of the image sensor.

6. The method of claim 1 , wherein the illumination light is provided to fewer than all of the pixels of the image sensor.

7. The method of claim 1 , wherein the pixels are arranged in an array, and the illumination light is generated by elements in the array.

8. determining a distance to an object by determining an amount of time that elapses between generating the illumination light and receiving the reflected light at the pixel; The method of claim 1 further comprising:

9. generating an electric charge in response to the reflected light; forming an image from the generated charges; The method of claim 1 further comprising:

10. A sensor substrate; a plurality of pixels arranged in an array on the sensor substrate; a light source having an output located adjacent to or within said array of pixels; an imaging optical system that passes light from the light source; A sensor having A sensor system comprising:

11. The image sensor system of claim 10 , wherein the output of the light source is located within an imaging volume.

12. The image sensor system of claim 11 , further comprising a cover glass, the cover glass being positioned between the imaging optics and the plurality of pixels.

13. 13. The image sensor system of claim 12, further comprising an image sensor package, wherein the sensor is an image sensor, the image sensor package, the cover glass, and the sensor substrate define an imaging volume, and the light source is located within the imaging volume.

14. The image sensor system of claim 11 , wherein the output of the light source is directed toward at least a portion of the pixels included in the plurality of pixels.

15. The image sensor system of claim 14 , wherein the light source output includes a diffractive lens element.

16. The image sensor system of claim 14 , wherein the at least some of the pixels include a reflector capable of reflecting light received from the output of the light source toward the imaging optics.

17. 16. The image sensor system of claim 15, wherein at least some of the pixels include electroluminescent, photoluminescent material, or both electroluminescent and photoluminescent material.

18. 12. The image sensor system of claim 11 , wherein the light source is located outside the sensor substrate package, the light source is operatively connected to a first end of an optical fiber, and the output of the light source is at a second end of the optical fiber.

19. The image sensor system of claim 10 , wherein the light source comprises a pixel included in the plurality of pixels and capable of outputting illumination light.

20. A sensor substrate; a plurality of pixels provided on the sensor substrate; an image sensor package; A cover glass and Light source and wherein the output of the light source is disposed within an imaging volume defined by the sensor substrate, the image sensor package, and the cover glass. Image sensor.

Images