Multispectral sensor and method for multispectral light sensing

By introducing compensating pixels and mathematical operations into the multispectral sensor, the problem of unevenness of target radiation distribution in contactless spectral measurement is solved, and the accurate calibration and compensation of the spectral signal is achieved, which improves the measurement accuracy.

CN112469977BActive Publication Date: 2024-12-06AMS SENSORS GERMANY GMBH
View PDF 4 Cites 0 Cited by

Patent Information

Application Number
CN201980021223.7
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Priority Date
2018-03-29
Filing Date
2019-03-26
Publication Date
2024-12-06
Estimated Expiration
2039-03-26

AI Technical Summary

Technical Problem

Existing multispectral sensors are difficult to effectively compensate for the non-uniform distribution of target radiation in non-contact spectral measurements, resulting in signal response deformation and affecting the accuracy of spectral reconstruction.

Method used

A multi-spectral sensor is designed, using an opaque shell, a light emitter, an optical sensor and a control unit. It uses additional compensation pixels to generate multi-spectral and compensation signals using pixels with different transmission characteristics, and performs mathematical operation combinations. By calibrating the radiation distribution signal, compensation for non-uniform target radiation distribution is achieved.

Benefits of technology

Effective compensation for non-uniform target radiation distribution is achieved, the accuracy and reliability of spectral measurements are improved, especially in non-contact spectral measurements, which can recalculate and compensate for geometric effects, which improves the accuracy of measurement results.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN112469977B_ABST
    Figure CN112469977B_ABST
Patent Text Reader

Abstract

A multispectral sensor comprises an opaque housing (OH) having a first chamber (CH1) with a first aperture (AP1) and a separated second chamber (CH2) with a second aperture (AP2). A light emitter (OE) is disposed in the first chamber (CH1) and is configured to emit light of a specified wavelength or a specified wavelength range through the first aperture (AP1). An optical sensor (OS) is disposed in the second chamber (CH2) and is configured to detect received photons through the second aperture (AP2). A control unit (CU) is configured to initiate emission of light by the light emitter (OE), and a measuring unit (MU) is configured to provide a sensor signal generated by the optical sensor (OS). The optical sensor (OS) comprises an array of sensor pixels of a first type (Spx) and pixels of a second type (Cpx). The pixels of the first type (Spx) each have different transmission characteristics and each generate a multispectral sensor signal (MS). The pixels of the second type (Cpx) have the same transmission characteristics and each generate a compensated sensor signal (CS).
Need to check novelty before this filing date? Find Prior Art

Description

[0001] The present invention relates to a multispectral sensor and a method for multispectral light sensing.

[0002] Color and spectral light sensing at the chip level has various applications in color recognition, data authentication, spectroscopy, and other industrial and consumer-level optical inspection applications. Common multispectral sensors are usually based on pixel arrays and on-pixel filters for each pixel. For spectral applications, filters with linearly independent filter characteristics can be selected. In order to achieve accurate spectral measurement of a given target, the radiation of each pixel, such as fluorescence emission after excitation, should be the same, or the distribution of the radiation should be known in order to compensate for the different responses of the individual pixels. In this way, the amplitude of the spectral signal of the pixel can be used to calculate the spectral reconstruction of the target under investigation.

[0003] However, a uniform distribution of the target radiation over the pixel array is an ideal condition. In many cases, the detector array is not uniformly illuminated, depending on the measurement geometry, the surface, shape and angle of the measurement sample, the geometric angular distribution of gloss and re-emission, and the radiant distribution of the radiation source. In turn, the target radiation may also deviate from the ideal condition. It is usually necessary to compensate for these influences.

[0004] Different measurement systems have been proposed. These systems are based on powerful optical structures or strictly defined measurement geometries, for example measuring at defined angles such as 45° / 0° or 22.5° / 22.5° or using an integrating sphere. Such systems are usually used for color measurements with strictly faded gloss and constant measuring distances. In order to compensate for the uneven radiation distribution by means of optics, a mixture of diffusers and optical lenses is one possibility. However, the field of view FOV and size ratios are usually not practical. Other solutions employ image analysis using image cameras, which may help to obtain additional information about the characteristics of the measured surface. In low-cost systems, additional spacers for contacting the surface are often used. But the market demand for non-contact measurements is increasing.

[0005] It is an object of the present invention to provide a multispectral sensor and a method for multispectral light sensing with improved compensation of target radiation distribution.

[0006] These objects are achieved by the subject-matter of the independent claims. Further developments and embodiments are described in the dependent claims.

[0007] It should be understood that, unless explicitly described as an alternative, any feature described below with respect to any embodiment may be used alone or in combination with other features described below, and may also be used in combination with one or more features of any other embodiment, or any combination of any other embodiment. In addition, equivalents and modifications not described below may also be employed without departing from the scope of the multispectral sensor and method for multispectral light sensing as defined in the appended claims.

[0008] The following relates to an improved concept in the field of multispectral light sensing. The improved concept provides a multispectral sensor and a method for multispectral light sensing, which proposes to implement additional detection of radiation distributions and / or gradients in spectral measurements that may affect the signal response of pixels in the sensor array and may distort the spectral reconstruction at an unknown rate. Additional compensation pixels are arranged in the sensor array and provide compensation signals that can be used, for example, to recalculate and compensate for geometric effects of the target in non-contact spectral measurements.

[0009] In at least one embodiment, the multispectral sensor includes an opaque housing, a light emitter, an optical sensor, a control unit, and a measuring unit. The opaque housing has a first chamber with a first hole and a separated second chamber with a second hole. In a sense, the chambers are separated, preventing light emitted directly from the light emitter, for example, from reaching the optical sensor.

[0010] The term "optical" refers to electromagnetic radiation that can be described by geometric (or ray) optics and physical (or wave) optics. This relates to, for example, UV, VIS or IR radiation. In particular, multispectral sensors can operate based on the generation, detection and / or processing of such electromagnetic radiation.

[0011] For example, the housing comprises a mold material or other optically opaque material. The term "optically opaque" refers to opacity to electromagnetic radiation, such as light having a specified wavelength within the emission wavelength range of a light emitter. For example, "opaque" may also include opacity to infrared, visible and / or ultraviolet radiation. Generally, if not otherwise specified, the expression "light" hereinafter refers to electromagnetic radiation in the visible light VIS, infrared IR and ultraviolet UV spectra. For example, the material of the housing may be opaque with respect to the emission of the light emitter and the emission from the fluorescent probe.

[0012] The light emitter is disposed in the first chamber and is configured to emit light of a specified wavelength or a specified wavelength range through the first hole. For example, the light emitter can be configured to emit pulses of light at a single or multiple specified wavelengths, i.e., narrowband emission. In addition, the light emitter can be configured to emit light at a specified wavelength range, such as pulses of light, i.e., broadband emission. The specified wavelength can be set to optically excite a fluorescent probe that can be positioned in the field of view FOV of the optical sensor.

[0013] The term "specified wavelength" refers to a known excitation wavelength used during a fluorescence experiment. For example, a light emitter may have one or more emission lines. The specific wavelength used to excite the probe is then denoted as the "specified wavelength". Similarly, in the case where the light emitter is tunable over a continuous or discrete wavelength range, the wavelength used to excite the fluorescent probe is also denoted as the "specified wavelength". Thus, both narrowband emission and broadband emission are contemplated. Examples of light emitters include semiconductor diodes, laser diodes, and surface emitting lasers, such as vertical cavity surface emitting lasers VCSELs, superluminescent diodes SLEDs, and the like.

[0014] The optical sensor is disposed in the second chamber and is configured to detect received photons passing through the second hole. For example, the optical sensor is configured to detect photons emitted by the fluorescent probe. In other words, the optical sensor is sensitive to fluorescent emission from the fluorescent probe after the fluorescent probe has been excited by the light emitter.

[0015] In addition, the optical sensor includes an array of sensor pixels of a first type and pixels of a second type. The pixels of the first type each have different transmission characteristics. Therefore, each pixel of the first type is respectively configured to generate a multi-spectral sensor signal. The pixels of the second type have the same transmission characteristics. Therefore, these pixels are each configured to generate a compensated sensor signal. For example, the pixel or pixel array can be a separate photodiode, rather than a continuous component such as an image sensor, a charge coupled device or a CMOS light sensor.

[0016] The control unit is configured to initiate emission of light by the light emitter. For example, the emission of the light emitter can be modulated, such as pulsed or modulated by continuous wave pulses. In operation, the light emitter emits light of a specified wavelength, for example, which illuminates a target outside the optical sensor.

[0017] The measuring unit is configured to provide a sensor signal generated by the optical sensor. In case the target comprises a fluorescent probe, the molecule can be optically excited and thereby emit photons which eventually return to the multispectral sensor and are detected there by the optical sensor. Thus, fluorescence can be excited by pulses, for example repeatedly by short laser pulses.

[0018] The control unit and the measuring unit are arranged in the same housing or package. These components can be implemented as control logic, state machines, microprocessors, etc. They can also include additional components such as analog-to-digital converters and amplifiers located in the same substrate. The substrate can have a printed circuit board that provides electrical connections and communication to the individual components of the optical sensor.

[0019] In operation, two different types of sensor pixels cause two different sets of sensor signals, namely a multispectral sensor signal and a compensation sensor signal. The multispectral sensor signal can be combined in a spectrum. The sensor pixels of the first type each have different spectral transmission characteristics. The transmission characteristic or transmission curve can be considered as a mathematical function or graph that describes the transmission fraction of a pixel as a function of frequency or wavelength. The multispectral sensor signal is combined as a function of frequency or wavelength to resemble a spectral distribution signal, or simply a spectrum. For example, as described above, a fluorescent probe can be placed in the field of view of an optical sensor to be optically excited by means of light emitted by a light emitter. The emitted fluorescence can then be detected by one or more of the pixels of the first type, and the corresponding multispectral sensor signal is collected and evaluated, for example, as a spectrum.

[0020] A spectrum may simply be a single signal or a group of signals. However, depending on the type of optical sensor and optics, a spectrum may also resemble a spectral image of the probe. The first type of pixel may also represent a spectral pixel.

[0021] The pixels of the second type each generate a compensated sensor signal. The pixels of the second type have the same transmission characteristics. Different compensated sensor signals can indicate a non-uniform target radiation distribution. For example, if the fluorescent probe is tilted relative to the optical sensor, the fluorescent emission can be different depending on the tilt angle. In other words, the compensated sensor signal can map a non-uniform target radiation distribution. The pixels of the second type can also represent compensated pixels.

[0022] The proposed multispectral sensor implements spectral measurements by means of spectral pixels and implements additional detection of radiation distributions and / or gradients that may affect the multispectral sensor signals generated by the spectral pixels. Additional compensation pixels generate compensation sensor signals that can retain information that enables compensation spectra and, for example, establish spectral reconstructions at otherwise unknown ratios. For example, such compensation can be used to recalculate or compensate for geometric effects in non-contact spectral measurements.

[0023] In at least one embodiment, the different transmission characteristics of the pixels of the first type are linearly independent. The pixels can be considered as channels of a multispectral sensor. With linearly independent transmission characteristics, only light of a limited wavelength is attributed to a certain channel or spectral pixel. For example, the transmission characteristic can be represented by a single line width or by a discrete set of line widths, for example, a few nm (FWHM) such as 1 nm to 5 nm. In terms of wavelength, the transmission characteristics of the spectral pixels are spaced apart so that there is no or only a small spectral overlap, for example, less than 1%. In other words, with the linearly independent transmission characteristics of the pixels of the first type, the detected photons can be clearly attributed to the corresponding pixels or channels. This helps to create a spectrum from the multispectral sensor signal.

[0024] In at least one embodiment, at least pixels of the first type each include a photodiode and a filter. The filter determines the transmission characteristics of the sensor pixels, respectively.

[0025] In at least one embodiment, the filter is at least one of an interference filter, a dielectric filter, a Fabry-Perot filter and / or a polymer filter,

[0026] In at least one embodiment, the pixels of the second type are symmetrically distributed in the array of sensor pixels. For example, the pixels can be distributed relative to the center of the array of sensor pixels and can have the same distance relative to the center. The pixels can also be distributed according to several subsets, where each pixel from a given subset has the same distance to the center.

[0027] In at least one embodiment, pixels of the second type are located in corners of the array of sensor pixels.

[0028] In at least one embodiment, the additional pixel of the second type is located outside the array of sensor pixels.For example, the additional pixel may be a single photodiode operably connected to the array of sensor pixels.

[0029] In at least one embodiment, the pixels of the second type each comprise a photodiode and a filter, wherein the filter respectively determines a transmission characteristic of the sensor pixel.Alternatively, the pixels of the second type may comprise only a photodiode, ie without a filter provided with a diode.

[0030] In at least one embodiment, the multi-spectral sensor includes a processing unit configured to determine a radiation distribution signal based on the compensated sensor signal. In addition, the processing unit is further configured to determine a spectrum distribution signal based on the radiation distribution signal. For example, the processing unit can combine the multi-spectral sensor signal as a function of frequency or wavelength to resemble a spectrum distribution signal, or simply spectrum. The radiation distribution signal can then be used to compensate the spectrum.

[0031] In at least one embodiment, the multispectral sensor includes an output terminal that provides the compensated sensor signal and / or the multispectral sensor signal for further processing. For example, instead of a dedicated processing unit disposed in the same housing of the multispectral sensor, the compensated sensor signal and / or the multispectral sensor signal can be provided to an external component, such as another processing unit, control logic, a state machine, a microprocessor, or an application specific integrated circuit (ASIC).

[0032] In at least one embodiment, the optical lens array is coupled to the array of sensor pixels. Additionally, or alternatively, the optical lens is coupled to the first aperture of the opaque housing.

[0033] In at least one embodiment, a method for multispectral light sensing employs a multispectral sensor comprising an opaque housing having a first chamber with a first hole and a separated second chamber with a second hole. The method comprises the steps of emitting light of a specified wavelength through the first hole by means of a light emitter. The light emitter is disposed in the first chamber. Received photons passing through the second hole are detected by means of an optical sensor, the optical sensor being disposed in the second chamber. The optical sensor comprises an array of sensor pixels of a first type and pixels of a second type.

[0034] For each pixel of the first type, a multispectral sensor signal is generated, wherein the pixels of the first type each have different transmission characteristics. For each pixel of the second type, a compensated sensor signal is generated, wherein the pixels of the second type have the same transmission characteristics. Then, a radiation distribution signal is determined based on the compensated sensor signal. Finally, a spectral distribution signal or spectrum is determined based on the radiation distribution signal.

[0035] In at least one embodiment, the radiation distribution signal is combined with the multispectral sensor signal by a mathematical operation. The mathematical operation may include addition, subtraction, multiplication or division, or more complex operations. For example, the complex operation may be compared with a flat field correction, which may involve combining the compensation sensor signal alone or as a radiation distribution signal.

[0036] In at least one embodiment, the radiation distribution signal is determined by a radiation distribution function. For example, the compensated sensor signal can be input into a model defined by the radiation distribution function. Typically, the radiation distribution signal is expected to be a function. For example, the function can represent a plane or a hyperbolic function. The measured compensated sensor signal can be considered as a parameter that helps determine the radiation distribution function to obtain the radiation distribution signal. This process can be considered as a fitting operation to determine the radiation distribution function. The resulting radiation distribution signal can be used to calibrate the spectrum. In addition, the radiation distribution signal can be used to extract additional information, such as the inclination of the target being measured, the shape of the target being measured, the ratio of gloss to re-emission, and the distance to the target object, for example, by understanding the radiation distribution of the light emitter.

[0037] In at least one embodiment, the steps of determining the radiation distribution signal and / or determining the spectral distribution signal are performed externally to the optical sensor or, alternatively, by a processing unit comprised by the multispectral sensor.

[0038] Further embodiments of the method for multispectral light sensing readily derive from the various embodiments and examples of the multispectral sensor, and vice versa.

[0039] In the following, the above-presented principles are described in further detail with respect to the accompanying drawings, in which exemplary embodiments are presented.

[0040] In the following exemplary embodiments and drawings, similar or identical elements may be provided with the same reference numerals, respectively. However, the elements shown in the drawings and their dimensional relationships to each other should not be considered as true proportions. Instead, individual elements such as layers, components, and regions may be enlarged to better illustrate or improve understanding.

[0041] Figure 1 An embodiment of a multispectral sensor is shown,

[0042] Figure 2 An embodiment of an optical sensor of a multispectral sensor is shown,

[0043] Figure 3 An example detection scheme of a compensation pixel of an optical sensor using a multispectral sensor is shown, and

[0044] Figure 4 An example of the spectral sensitivity of a pixel of a multispectral sensor is shown, and

[0045] Figure 5 Example transmission characteristics of sensor pixels of a multispectral sensor are shown.

[0046] The multispectral sensor comprises an opaque housing OH having two chambers: a first chamber CH1 and a second chamber CH2. The opaque housing OH is arranged on a carrier CA and comprises a light barrier LB which divides the housing into a first chamber CH1 and a second chamber CH2. The first chamber CH1 and the second chamber CH2 are further laterally limited by a frame body FB arranged in the housing. A cover part CS is located opposite to the carrier CA so as to cover the chambers CH1, CH2. The cover part CS, the frame body FB and the light barrier LB are manufactured, for example, from a continuous piece of material, for example a mold material.

[0047] The carrier CA provides mechanical support and electrical connection for the electronic components integrated in the multispectral sensor. For example, the carrier CA includes a printed circuit board PCB (not shown). However, in other embodiments (not shown), the carrier CA can also be part of the housing, and the electronic components are embedded in the housing, for example, by molding.

[0048] The light emitter is located inside the first chamber CH1. The light emitter OE is arranged on the carrier CA and is electrically connected to the carrier CA, for example to the PCB. The light emitter OE is a laser diode, such as a VCSEL or a VECSEL. These types of lasers are configured to emit light at a specified wavelength, such as in the UV, visible light or infrared part of the electromagnetic spectrum. In some embodiments, the light emitter OE is tuned to be able to emit within a specified wavelength range. The specified emission wavelength or emission spectrum is in the IR or UV / Vis. The emission can be narrowband or broadband. For example, a vertical cavity surface emitting laser VCSEL or a vertical external cavity surface emitting laser VECSEL mainly emits in the IR, for example at 940nm.

[0049] The optical sensor OS is disposed in the second chamber CH2 and is located on the carrier CA. In this particular embodiment, the optical sensor is integrated into a single semiconductor die SD together with other electronic devices discussed further below. The optical sensor includes a pixel array that will be discussed in further detail below. For example, the pixel can be implemented as a photodiode. The optical sensor OS includes an array of sensor pixels Spx of a first type and pixels Cpx of a second type. The pixels Spx of the first type each have different transmission characteristics, while the pixels of the second type have the same transmission characteristics.

[0050] The optical filter array OF is arranged in a second chamber above the optical sensor OS. The optical filter array OF is attached to the optical sensor OS. The pixels Spx of the first type are each associated with an optical filter having a different transmission characteristic. However, the pixels of the second type are either associated with an optical filter having the same transmission characteristic or are not associated with an optical filter. In the latter case, the properties of the pixel itself determine its transmission characteristic.

[0051] The optical filters in the optical filter array OF have transmission characteristics that block or at least attenuate the light emitters at a specified wavelength. The optical filters may be interference filters, such as optical cut-off filters, band-pass, long-pass or short-pass filters, dielectric filters, Fabry-Perot filters and / or polymer filters. Typically, the passband is selected relative to the fluorescent probe to be investigated, and the optical filter passes light having a wavelength corresponding to the fluorescent emission of the probe.

[0052] A first hole AP1 and a second hole AP2 are provided in the cover part CS. The first hole AP1 and the second hole AP2 are positioned above the light emitter OM and the optical sensor OS, respectively. In practice, the holes AP1, AP2 are located within the emission cone of the light emitter OE and within the field of view of the optical sensor OS, respectively. For example, for a fixed emitter position and orientation, the emission cone includes all points in space that can be illuminated by the light emitter OE, at least in theory. Similarly, for example, for a fixed detector position and orientation, the field of view of the optical sensor OS includes all points in space that, at least in theory, travel towards the optical sensor OS after being reflected at the external target TG. Typically, the multispectral sensor is placed at a distance of 5 mm to 10 mm relative to the external target TG, such as a fluorescent probe.

[0053] Optionally, the optical system can be arranged in the first chamber CH1 and the second chamber CH2, respectively. For example, the first optical stack OS1 includes a lens or a lens system and is attached to the light emitter in the first chamber CH1. The first optical stack can be configured to guide and focus the light emitted from the light emitter to a target TG, which can be positioned in the FOV of the optical stack, for example, at a characteristic distance. In addition, the optical stack OS1 can have, for example, an optical filter or a protective glass layer or window. The first chamber CH1 and the second chamber CH2 can be sealed with optical windows OW, respectively.

[0054] In addition, the second optical stack OS2 includes a lens or a lens system and is attached to the optical sensor OS within the second chamber CH2. For example, the second optical stack OS2 includes a microlens array AM, wherein individual microlenses are associated with corresponding pixels of the optical sensor (see below). The microlens array AM may have an additional black hole layer and determine the FOV of the optical sensor OS. The optical properties of the microlenses (focal length, lens diameter, distance between lens and pixel, etc.) can be adjusted so that each associated pixel of the optical sensor OS detects light only from a defined area of ​​the target TG. The optical properties of the microlenses can be adjusted so that the defined areas of the target TG do not overlap. In addition, for example, the second optical stack OS2 may have additional optical layers, such as optical filters, angular filters, or protective glass layers or windows. In addition, the second optical stack may also have additional lenses to narrow the FOV of the optical sensor to, for example, 10 degrees or less.

[0055] The optical filters OF in the filter array can be aligned relative to the microlenses of the microlens array AM. In this way, each pixel of the optical sensor OS can be associated with a separate filter and / or microlens. However, as will be discussed in further detail below, not all pixels of the optical sensor OS can be associated with a separate filter and / or microlens.

[0056] The control unit CU and the measuring unit MU are integrated into the semiconductor die SD together with the optical sensor OS. The control unit CU includes a driver for the optical emitter OE. For example, the control unit CU initiates the emission of light performed by the optical emitter OE. The emission of the optical emitter can be modulated, such as pulse modulation or by continuous wave modulation. In operation, the optical emitter OE emits light of a specified wavelength, for example, the light illuminates the target TG outside the multi-spectral sensor. The measuring unit MU can be considered as a control unit for the optical sensor. For example, it provides a sensor signal generated by the optical sensor. The control unit and the measuring unit can be implemented as control logic, a state machine, a microprocessor, etc. They can also include additional components, such as analog-to-digital converters, time-to-digital converters, amplifiers, etc., which are also located in the semiconductor die SD. The semiconductor die SD can have a printed circuit board PCB that provides electrical communication with the individual components of the multi-spectral sensor.

[0057] In operation, an external target, such as a fluorescent probe in the following, is positioned in the FOV of the multispectral sensor. For example, the target is positioned at a distance of 5 mm to 10 mm relative to the sensor. The control unit CU initiates a pulse emission of light through the first aperture AP1 and towards the external target by means of the light emitter OE. The emitted light has a specified wavelength. After excitation, the external target TG, such as a fluorescent probe, will eventually emit light at a longer, red-shifted wavelength than the excitation light. The transmission of the filter is set to pass light that is red-shifted relative to the specified emission wavelength of the light emitter OE. Therefore, the emitted fluorescence is filtered out by the optical filter to filter out scattered excitation light or background light.

[0058] Fluorescence photons can be detected by the optical sensor OS via the second aperture AP2. Pixels of the first type, denoted hereinafter as sensor pixels, respectively generate a multispectral sensor signal MS. Pixels of the second type, denoted hereinafter as compensation pixels, respectively generate a compensated sensor signal Cpx. The measuring unit MU provides a set of multispectral sensor signals and a set of compensated sensor signals. These signals can be processed to determine a radiation distribution signal RDS, which can represent how the radiation of the fluorescence emission after excitation is distributed over the target TG.

[0059] Typically, the optical sensor OS is not uniformly illuminated, depending on the measurement geometry, the surface, shape and angle of the target, the geometric angular distribution of the gloss and re-emission and the radiation distribution of the light emitter OE. In turn, the fluorescence detected by the multispectral sensor signal is also not uniform and compensation for these influences may be required. A radiation distribution signal RDS comprising or consisting of a compensated sensor signal enables the spectral distribution signal to be determined as a result of signal processing. Such processing can be performed on-chip, for example by a dedicated processing unit PU integrated into a semiconductor die SD of the multispectral sensor (not shown), or by an external computing unit. The details will be discussed below.

[0060] Figure 2 An embodiment of an optical sensor of a multispectral sensor is shown. The accompanying figure shows a top view of a pixel array arranged in an 8×8 structure. Four compensation pixels Cpx are symmetrically distributed and located in the corners of the pixel array. The remaining pixels are sensor pixels Spx. The microlenses ML and the optical filter array OF are not shown in this representation, but are aligned with the pixels in the pixel array. For example, the optical filter is implemented as a Fabry-Perot filter.

[0061] Figure 3 An example detection scheme of a compensation pixel of an optical sensor using a multi-spectral sensor is shown. Figure 1 and 2The multispectral sensor discussed comprises an opaque housing OH having a first chamber CH1 and a second chamber CH2. The disk in the figure represents the field of view of the multispectral sensor. The optical sensor OS is depicted as having a microlens array AM.

[0062] Four emission cones EC1 to EC4 are shown. These emission cones are due to Figure 2 The four compensation pixels Cpx discussed in the figure are arranged in the corners of the pixel array. In practice, the compensation pixels Cpx are located within corresponding emission cones EC1 to EC4 determined by the fluorescent emission from the target TG and intersect the field of view of the optical sensor OS (represented by a disk in the figure). In the present example, the emission cones intersect at the position of the target and are used to construct the radiation distribution signal RDS from the four compensated sensor signals CS generated by the four compensation pixels Cpx. However, any number of compensation pixels can be used.

[0063] Figure 4 An example of a radiation distribution function of a multispectral sensor is shown. The radiation distribution signal RDS or the compensated sensor signal can be used to determine the target radiation distribution as a function of the coordinates x, y, z, such as the power distribution of the emission of each area on the target. The compensation pixels Cpx can be assumed to have the same spectral response, or can be calibrated to have the same spectral response. In other words, the intensity of the incident light defined generates the compensation signal of the same value. Therefore, the difference in the compensation signal between the compensation pixels can be attributed to the difference in the target radiation distribution.

[0064] Typically, it is expected that the radiation distribution signal resembles a certain mathematical function. For example, this function can represent a plane function, a circular area function, or a hyperbolic function. The measured compensated sensor signal can be considered as a parameter that helps determine the radiation distribution function. For example, the compensated sensor signal determines the radiation distribution function at the compensation pixel Cpx. The value of the radiation distribution function at the sensor pixel can be determined based on the function by, for example, fitting, extrapolation, etc. Therefore, the radiation distribution function is determined for all pixels, and the radiation distribution signal can be generated to compensate all pixels in the array.

[0065] This process can be considered as a fitting operation to determine the radiation distribution function. The resulting radiation distribution signal can be used to calibrate the spectrum. In addition, the radiation distribution signal can be used to extract additional information, such as the inclination of the target, the shape of the target, the ratio of gloss to re-emission, and the distance to the target, for example, by understanding the radiation distribution of the light emitter.

[0066] Figure 5Example transmission characteristics of sensor pixels of a multispectral sensor are shown. The figure shows 61 sensor pixels. The figure shows the spectral sensitivity IS (in arbitrary units) of the sensor pixel as a function of the wavelength λ (in nm), which is the superposition of the sensitivity of the sensor pixel and the corresponding transmission characteristic of the optical filter array OF.

[0067] The transmission characteristics of the sensor pixels Spx are linearly independent and can be considered as channels of the multispectral sensor. With linearly independent transmission characteristics, only light of a defined wavelength is attributed to a certain channel or spectral pixel. For example, the transmission characteristics can be represented by a single line width or by a discrete set of line widths, for example, a line width of a few nm (FWHM) such as 1 nm to 5 nm. In terms of wavelength, the transmission characteristics of the spectral pixels are spaced apart so that there is no or only a small spectral overlap, for example less than 1%. With the linearly independent transmission characteristics of the sensor pixels Spx, detected photons can be unambiguously attributed to the corresponding pixels or channels. This facilitates the creation of spectra from the multispectral sensor signals.

[0068] The spectral sensitivity for spectral analysis can be achieved, for example, based on the Fabry-Perot effect by the optical filter array OF introduced above. The filter can be arranged so that each sensor pixel has its own narrow spectral sensitivity. By combining the channels, a spectral response distribution (or spectrum) of the characteristics of the measured sample can be created. This can be analyzed by algorithmic reconstruction methods.

[0069] The concepts discussed above can be implemented as a multispectral sensor based on an array of sensor pixels. Each pixel has a known spectral characteristic. All sensor pixels are linearly independent, for example, each sensor pixel is sensitive to a narrowband of light. The narrowband light can be UV, VIS, NIR and / or IR. The spectral information characteristics of the target can be reconstructed. The optical sensor can be supplemented with an optical device to determine the field of view (FOV) of the multispectral sensor, for example, to limit the observation area on the target. The optical device can be a microlens array arranged near the sensor array and / or a separate lens for optically imaging the target area on the optical sensor. In fact, the position of the sensor pixels can be set to detect only from certain ranges on the target.

[0070] The compensation pixels can be distributed on the optical sensor, for example in the corners of the array, and can define the range of the observed target area. The compensation signal generated from these pixels can be used to estimate the impact of non-uniform radiation. In order to recalculate the information of the target characteristics or the radiation distribution of the radiation source, it is necessary that the compensation pixels have the same spectral sensitivity so that spectral differences will not be interpreted. The compensation pixels can be configured to improve independence without filters or with the same filters. The filter of the compensation pixel can also be part of the spectral measurement.

[0071] The compensation signal and its deviation can be used as parameters for describing the inhomogeneous radiation incident on the optical sensor. By knowing the parts of other optical effects, a model of the radiation gradient can be generated to compensate its signal amplitude by the position of each sensor pixel. The result of this compensation can enable a more robust reconstruction of the spectral target characteristics.

[0072] Reference numerals

[0073] AM Microlens Array

[0074] AP1 first hole

[0075] AP2 Second hole

[0076] CA bearing

[0077] CS cover part

[0078] CH1 First Chamber

[0079] CH2 Second Chamber

[0080] Cpx Compensation Pixels

[0081] CU Control Unit

[0082] EC1 to EC4 emission cone

[0083] FB framework body

[0084] IS spectral sensitivity

[0085] λ Wavelength

[0086] LB Light Barrier

[0087] MU Measurement Unit

[0088] PU Processing Circuit

[0089] OE Optical Transmitters

[0090] OF Optical Filter Array

[0091] OH opaque shell

[0092] OS Optical Sensor

[0093] OS1 First Optical Stack

[0094] OS2 Second Optical Stack

[0095] OW Optical Window

[0096] SD Semiconductor Die

[0097] Spx sensor pixels

[0098] TG Target

[0099] x, y, z coordinates.

Claims

1. A multispectral sensor, comprising: - an opaque housing (OH) having a first chamber (CH1) with a first aperture (AP1) and a separated second chamber (CH2) with a second aperture (AP2), - an optical emitter (OE) arranged in said first chamber (CH1) and arranged to emit light of a specified wavelength or a specified wavelength range through said first aperture (AP1), - an optical sensor (OS) disposed in said second chamber (CH2) and arranged to detect received photons passing through said second aperture (AP2), - a control unit (CU) configured to initiate the emission of light by said light emitter (OE), and - a measuring unit (MU) configured to provide a sensor signal generated by said optical sensor (OS); in: - said optical sensor (OS) comprises an array of sensor pixels of a first type (Spx) and pixels of a second type (Cpx), - the pixels of the first type (Spx) each have a different transmission characteristic, each generating a multispectral sensor signal (MS), and - pixels of said second type (Cpx) have the same transmission characteristics, each generating a compensated sensor signal (CS), - wherein the pixels of the second type (Cpx) are symmetrically distributed in the array of sensor pixels, the pixels of the second type (Cpx) are distributed relative to the center of the array of sensor pixels and have the same distance relative to the center, the pixels of the second type (Cpx) include four pixels located in the four corners of the array of sensor pixels, and - wherein different compensated sensor signals are indicative of a non-uniform target radiation distribution over the array of sensor pixels.

2. A multispectral sensor, comprising: - an opaque housing (OH) having a first chamber (CH1) with a first aperture (AP1) and a separated second chamber (CH2) with a second aperture (AP2), - an optical emitter (OE) arranged in said first chamber (CH1) and arranged to emit light of a specified wavelength or a specified wavelength range through said first aperture (AP1), - an optical sensor (OS) disposed in said second chamber (CH2) and arranged to detect received photons passing through said second aperture (AP2), - a control unit (CU) configured to initiate the emission of light by said light emitter (OE), and - a measuring unit (MU) configured to provide a sensor signal generated by said optical sensor (OS); in: - said optical sensor (OS) comprises an array of sensor pixels of a first type (Spx) and pixels of a second type (Cpx), - the pixels of the first type (Spx) each have a different transmission characteristic, each generating a multispectral sensor signal (MS), and - the pixels of said second type (Cpx) have the same transmission characteristics, each generating a compensated sensor signal (CS), Also included is a processing unit (PU) configured to: - determining a radiation distribution signal from said compensated sensor signal (CS), and - determining a spectral distribution signal based on the radiation distribution signal, - wherein the pixels of the second type (Cpx) are symmetrically distributed in the array of sensor pixels, the pixels of the second type (Cpx) are distributed relative to the center of the array of sensor pixels and have the same distance relative to the center, the pixels of the second type (Cpx) include four pixels located in the four corners of the array of sensor pixels, and - wherein different compensated sensor signals are indicative of a non-uniform target radiation distribution over the array of sensor pixels.

3. The multispectral sensor according to claim 1 or 2, wherein: The optical sensor (OS) is integrated in a single semiconductor die (SD).

4. The multispectral sensor according to claim 1 or 2, wherein: The different transmission characteristics of the first type of pixels (Spx) are linearly independent.

5. The multispectral sensor according to claim 1 or 2, wherein: At least the pixels of the first type (Spx) each comprise a photodiode and a filter, wherein the filter respectively determines a transmission characteristic of the sensor pixel.

6. The multispectral sensor according to claim 5, wherein: The filter is an interference filter, a dielectric filter, a Fabry-Perot filter and / or a polymer filter.

7. The multispectral sensor according to claim 1 or 2, wherein: The additional pixels of the second type (Cpx) are located outside the array of sensor pixels.

8. The multispectral sensor according to claim 5, wherein: The second type of pixel (Cpx) - each comprising a photodiode and a filter, wherein the filter respectively determines the transmission characteristics of the sensor pixel, or - each comprising a photodiode.

9. The multispectral sensor according to claim 1 or 2, further comprising a processing unit (PU), wherein the processing unit is configured to: - determining a radiation distribution signal from said compensated sensor signal (CS), and - determining a spectral distribution signal based on the radiation distribution signal.

10. The multi-spectral sensor according to claim 1 or 2, further comprising an output terminal providing the compensated sensor signal (CS) and / or the multi-spectral sensor signal (MS) for further processing.

11. The multispectral sensor according to claim 1 or 2, further comprising: - an optical lens array coupled to said array of sensor pixels, and / or - an optical lens coupled to the first aperture of the housing.

12. A method for multi-spectral light sensing, wherein: The multispectral sensor comprises an opaque housing (OH) having a first chamber (CH1) with a first aperture (AP1) and a separated second chamber (CH2) with a second aperture (AP2), the method comprising the following steps: - emitting light of a specified wavelength or a specified wavelength range through said first aperture (AP1) by means of an optical emitter (OE) arranged in said first chamber (CH1), - detecting the received photons through the second aperture (AP2) by means of an optical sensor (OS) arranged in the second chamber (CH2), wherein the optical sensor (OS) an array comprising sensor pixels of a first type (Spx) and pixels of a second type (Cpx), - generating a multispectral sensor signal (MS) for each pixel of said first type, wherein The pixels of the first type (Spx) each have a different transmission characteristic, - generating a compensated sensor signal (CS) for each pixel (Cpx) of said second type, wherein the pixels of the second type have the same transmission characteristics, - determining a radiation distribution signal from said compensated sensor signal (CS), and - determining a spectral distribution signal based on the radiation distribution signal, - wherein the pixels of the second type (Cpx) are symmetrically distributed in the array of sensor pixels, the pixels of the second type (Cpx) are distributed relative to the center of the array of sensor pixels and have the same distance relative to the center, the pixels of the second type (Cpx) include four pixels located in the four corners of the array of sensor pixels, and - wherein different compensated sensor signals are indicative of a non-uniform target radiation distribution over the array of sensor pixels.

13. The method according to claim 12, wherein: The radiation distribution signal is combined with the multi-spectral sensor signal (MS) by mathematical operation.

14. The method according to claim 12 or 13, wherein: The radiation distribution signal is determined by a radiation distribution function.

15. The method according to claim 12 or 13, wherein: Determining the radiation distribution signal and / or determining the spectral distribution signal is performed externally to the optical sensor or by means of a processing unit comprised by the optical sensor.

Citation Information

Patent Citations

  • Optical sensor and method utilizing the optical sensor

    CN104515593A

  • Spectroscopic sensor device and method for operating a spectroscopic sensor device

    US20170052113A1

  • Stray radiation compensation

    US5128549A

  • Spectrometry system applications

    WO2016125164A2