Infrared cut-off filtering method and filter for color night vision imaging
By calculating the pixel quantization value and ambient light ratio of infrared cutoff and adjusting the signal-to-noise ratio, the problem of signal-to-noise ratio attenuation in color night vision imaging is solved, and the night vision imaging effect is improved.
Patent Information
- Application Number
- CN202411114050.2
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-08-14
- Publication Date
- 2024-11-12
AI Technical Summary
Existing infrared cutoff filters lead to bandpass signal-to-noise ratio attenuation in color night vision imaging, affecting the camera lens imaging effect in night vision environments.
By calculating the pixel quantization value at infrared cutoff, the ratio of the infrared part in the ambient light relative to the entire photosensitive part is obtained, and the pixel quantization value output by the image sensor is multiplied by this ratio, and the signal-to-noise ratio is adjusted to adapt to the night vision environment.
The infrared cutoff filtering effect is achieved that maintains the signal-to-noise ratio without attenuation in color night vision imaging, and improves the quality of night vision imaging.
Smart Images

Figure CN118945444A_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to a night vision imaging filtering method, and more specifically, the present invention mainly relates to an infrared cutoff filtering method and a filter for color night vision imaging. Background Art
[0002] Infrared cut-off filter is a filter used to filter infrared bands. Its main function is to block unnecessary infrared spectrum from entering the lens and causing image distortion. There are many ways to classify infrared cut-off filters. In terms of materials, there are optical glass coated, colored glass, and plastic infrared cut-off filters. In terms of optical properties, there are long-wave pass type (IR long pass filter) and bandpass type (IR bandpass filter). Long-wave pass type infrared cut-off filters include: 1. Made of colored glass, usually black, it absorbs visible light and allows infrared light to pass through; 2. Made by vacuum coating on optical white glass, this type is also called an optical cold mirror, it reflects visible light and allows infrared light to pass through, and looks silver in appearance; 3. Infrared plastic filters made of special plastics, black in appearance. Bandpass type infrared cut-off filters are all made of vacuum coating.
[0003] The infrared cut-off filter on the market today generally passes through a wavelength range of 400-700nm, and the pass rate is less than 90%. It is worth noting that the aforementioned pass rate refers to the transmittance of light with an incident angle of 90 degrees, while the incident light of the actual camera lens is conical, which is an angle range, so the actual transmittance cannot reach the theoretical value, and the comprehensive actual pass rate is usually 70%-80%. This pass rate has no effect on conventional daytime imaging, but it has a more obvious effect on color night vision imaging, because the incident light itself in the night vision environment is very weak. Since the existing infrared cut-off filter only attenuates the incident light, and the incident light is the signal, the signal-to-noise ratio in the passband becomes 70%-80% of the original, and the signal-to-noise ratio is significantly attenuated, affecting the final imaging of the camera lens in the night vision environment. Therefore, it is necessary to study and improve the existing infrared cut-off filtering technology. Summary of the invention
[0004] One of the purposes of the present invention is to address the above-mentioned shortcomings and provide an infrared cutoff filtering method and filter for color night vision imaging, in order to solve the technical problems in the prior art that similar infrared cutoff filters are prone to attenuation of the signal-to-noise ratio in the passband, affecting the final imaging of the camera lens in a night vision environment.
[0005] In order to solve the above technical problems, the present invention adopts the following technical solutions:
[0006] On one hand, the present invention provides an infrared cutoff filtering method for color night vision imaging, wherein the method calculates the infrared cutoff pixel quantization value n'(i, j) by formula (1);
[0007]
[0008] In formula (1), n(i, j) is the pixel quantization value output by the image sensor, U1 is the voltage value collected by ADC1, U2 is the voltage value collected by ADC2, i is the number of image rows, and j is the number of image columns;
[0009] The α is calculated by formula (2):
[0010]
[0011] In formula (2), S 12 It is the area enclosed by the vertical line of the vertical axis at the lower cut-off wavelength of the tricolor filter, the bandpass curve of the part greater than the lower cut-off wavelength, and the horizontal axis. Q1 is the correction coefficient, S 22 is the area enclosed by the vertical line of the vertical axis at the lower cut-off wavelength of the second photosensitive element, the bandpass curve of the part greater than the lower cut-off wavelength, and the horizontal axis, G2 is the amplification factor of the second conversion amplifier, and A2 is the conversion rate of the second photosensitive element from light to electricity;
[0012] The β is calculated by the following formula:
[0013]
[0014] In formula (3), S2 is the area enclosed by the vertical line at the cut-off wavelength on the first photosensitive element and the bandpass curve of the portion greater than the upper cut-off wavelength and the horizontal axis, Q2 is the correction coefficient, S1 is the area enclosed by the vertical line at the cut-off wavelength on the three-color filter and the bandpass curve of the portion greater than the upper cut-off wavelength and the horizontal axis, G1 is the amplification factor of the first conversion amplifier, and A1 is the conversion rate from light to electricity of the first photosensitive element.
[0015] As a preferred embodiment, a further technical solution is: 12 It is the area enclosed by the vertical line at the lower cutoff wavelength of any one of the three-color filters, the bandpass curve of the part greater than the lower cutoff wavelength, and the horizontal axis.
[0016] On the other hand, the present invention provides an infrared cutoff filter for color night vision imaging, the infrared cutoff filter comprises a first photosensitive element and a second photosensitive element, the first photosensitive element is connected to ADC1 through a first conversion amplifier, the second photosensitive element is connected to ADC2 through a second conversion amplifier, and both ADC1 and ADC2 are connected to a processor; a second filter is provided at the collection end of the second photosensitive element; the second filter is used to filter the light band that needs to pass through the preset ambient light; the first photosensitive element and the second photosensitive element are used to respectively collect imaging targets and perform photoelectric conversion, and then obtain voltage values U1 and U2 after passing through the first conversion amplifier and the second conversion amplifier respectively, and then the voltage values U1 and U2 are collected by ADC1 and ADC2 respectively, and converted into digital signals and transmitted to the processor; the processor is used to execute the above-mentioned infrared cutoff filtering method, calculate the pixel quantization value of infrared cutoff, and multiply the pixel quantization value output by the image sensor by the ratio of the useful light part in the ambient light to the entire photosensitive part; the sum of the ratio of the useful light part in the ambient light to the entire photosensitive part and the ratio of the infrared part in the ambient light to the entire photosensitive part is 100%.
[0017] Preferably, a further technical solution is that: the first photosensitive element and the second photosensitive element each have their own lens.
[0018] A further technical solution is: the collection end of the first photosensitive element is also provided with a first filter, and the first filter is used to transmit the visible light band and the near-infrared band in the ambient light.
[0019] Compared with the prior art, one of the beneficial effects of the present invention is that: by calculating the pixel quantization value of the infrared cutoff, the ratio of the infrared part in the ambient light to the entire photosensitive part is obtained, and the ratio of the useful light part in the ambient light to the entire photosensitive part is further obtained, and then the pixel quantization value output by the image sensor is multiplied by the ratio, so that the signal-to-noise ratio is no longer attenuated due to the light transmittance and the attenuation of the incident light, thereby achieving the imaging effect of the infrared cutoff filter (IRCUT) without reducing the signal-to-noise ratio. It is more suitable for use as an infrared cutoff filter on a color night vision imaging lens. BRIEF DESCRIPTION OF THE DRAWINGS
[0020] Figure 1 The figure is a schematic block diagram of the structure of an infrared cutoff filter for illustrating an embodiment of the present invention.
[0021] Figure 2 This is the wavelength bandpass curve of the three-color filter. DETAILED DESCRIPTION
[0022] The present invention will be further described below in conjunction with the accompanying drawings.
[0023] Figure 1The present invention is a schematic block diagram of an infrared cutoff filter structure of a preferred embodiment of the present invention, which includes a first photosensitive element and a second photosensitive element, wherein the first photosensitive element is connected to an analog-to-digital converter, i.e., ADC1, through a first conversion amplifier, and the second photosensitive element is connected to ADC2 through a second conversion amplifier, and both ADC1 and ADC2 are connected to a processor; at the same time, a second filter is provided at the collection end of the second photosensitive element, and the second filter is used to filter the light band that needs to pass through the preset ambient light; the first photosensitive element and the second photosensitive element are used to respectively collect imaging targets and perform photoelectric conversion, and then obtain voltage values U1 and U2 after passing through the first conversion amplifier and the second conversion amplifier respectively, and then the voltage values U1 and U2 are collected by ADC1 and ADC2 respectively, and converted into digital signals and transmitted to the processor; the processor calculates the pixel quantization value of the infrared cutoff, and the pixel quantization value output by the image sensor is multiplied by the ratio of the useful light part in the ambient light to the entire photosensitive part; the sum of the ratio of the useful light part in the ambient light to the entire photosensitive part and the ratio of the infrared part in the ambient light to the entire photosensitive part is 100%.
[0024] The function of the above-mentioned second filter is to filter the light band that needs to pass through the preset ambient light; preferably, the first filter can also be set at the collection end of the first photosensitive element. The function of the first filter is to pass the visible light band and the near-infrared band in the ambient light. Since the same semiconductor substrate as the image sensor is used, its wavelength range is the same as the sensitive wavelength range of the color night vision image sensor. Therefore, if the image sensor removes the filter on the element itself (generally an RGB filter) and its wavelength range is similar to or the same as the first photosensitive element itself, the first filter can be omitted.
[0025] Taking the structure of the infrared cutoff filter in this embodiment as an example, the color night vision imaging of the color image sensor is a monochrome image sensor with a three-color filter, generally an RGB filter. The traditional infrared cutoff filter uses the range of 400nm-700nm, that is, it filters out the wavelengths below 400nm and above 700nm in the passband, and 400nm is called the upper cutoff frequency, and 700nm is called the lower cutoff wavelength. Of course, in practice, it can also be 380nm, 750nm, 780nm, etc. The upper and lower cutoff wavelengths can also be customized according to the actual situation. Figure 2 (Different three-color filters have different curves) It can be seen that for any one of the three-color filters, the area enclosed by the vertical line at the lower cutoff wavelength and the bandpass curve of the part greater than the lower cutoff wavelength and the horizontal axis is set as S 12, the area enclosed by the vertical line at the upper cut-off wavelength, the bandpass curve of the part greater than the upper cut-off wavelength, and the horizontal axis is set as S1; for the second photosensitive element, the area enclosed by the vertical line at the lower cut-off wavelength, the bandpass curve of the part greater than the lower cut-off wavelength, and the horizontal axis is set as S 22 For the first photosensitive element, the area enclosed by the vertical line of the vertical axis at the upper cut-off wavelength, the bandpass curve of the portion greater than the upper cut-off wavelength, and the horizontal axis is set to S2.
[0026] Assume that the conversion gain of the first conversion amplifier is G1, the conversion gain of the second conversion amplifier is G2, the conversion rate of the first photosensitive element from light to electricity is A1, the conversion rate of the second photosensitive element from light to electricity is A2, the voltage collected by ADC1 is U1, and the voltage collected by ADC2 is U2. For the image sensor to form a color image, three filters of different wavelengths need to appear alternately, generally the RGB (red, green, and blue) filters mentioned above, but color night vision does not necessarily use RGB filtering.
[0027] Figure 1 The imaging target shown is the target that needs to be imaged and displayed for color night vision, and the target contains a near-infrared band. Lenses 1 and 2 image the target light onto the first photosensitive element and the second photosensitive element. Some photosensitive elements have their own lenses, so lenses 1 and 2 can be omitted. At this time, the three-color filter is the first to receive the incident light of the imaging target on the outside. The three-color filter transmits the visible light band and the near-infrared band in the ambient light. Since it uses the same semiconductor substrate as the image sensor, its wavelength range is the same as the photosensitive wavelength range of the color night vision image sensor. In general, if the image sensor has a wavelength range that is similar to or the same as the wavelength range of the first photosensitive element component itself after removing the filter on the component itself (usually an RGB filter), the first filter can be omitted. At this time, the second filter 2 only passes the light band that needs to be filtered out, and the conversion amplifier converts the current signal output by the photosensitive element into a voltage signal and amplifies it. If the photosensitive element outputs a voltage signal, there is no need to convert it, and it can be directly amplified. Finally, it is converted into a digital signal through ADC1 and ADC2 and enters the processor. Together with the pixel quantization value n(i, j) output by the collected image sensor, the pixel quantization value of the infrared cutoff is calculated together with n'(i, j).
[0028] Assume that the quantized value of any pixel in the image collected from the image sensor is n(i,j), and the quantized value of any pixel in the image to be calculated is n'(i,j), where i is the number of image rows and j is the number of image columns. Q1 and Q2 are correction coefficients. In actual debugging, the deviation between the calculated value and the actual value can be corrected by Q1 and Q2. The specific value can be selected by trial and error. According to experience, a value in the range of 0 to 10 is selected. The value is the best when the image color is the best.
[0029] The specific calculation method is:
[0030]
[0031] Where n(i,j) is the pixel quantization value output by the image sensor, U1 is the voltage value collected by ADC1, U2 is the voltage value collected by ADC2, i is the number of image rows, and j is the number of image columns;
[0032] The α in the above formula is calculated by the following formula:
[0033]
[0034] As mentioned above, in the above formula, S 12 It is the area enclosed by the vertical line of the vertical axis at the lower cut-off wavelength of the tricolor filter, the bandpass curve of the part greater than the lower cut-off wavelength, and the horizontal axis. Q1 is the correction coefficient, S 22 is the area enclosed by the vertical line of the vertical axis at the lower cut-off wavelength of the second photosensitive element, the bandpass curve of the part greater than the lower cut-off wavelength, and the horizontal axis, G2 is the amplification factor of the second conversion amplifier, and A2 is the conversion rate of the second photosensitive element from light to electricity;
[0035] The β in the above formula is calculated by the following formula:
[0036]
[0037] As mentioned above, in the above formula, S2 is the area enclosed by the vertical line at the cut-off wavelength on the first photosensitive element and the bandpass curve of the part greater than the upper cut-off wavelength and the horizontal axis, Q2 is the correction coefficient, S1 is the area enclosed by the vertical line at the cut-off wavelength on the three-color filter and the bandpass curve of the part greater than the upper cut-off wavelength and the horizontal axis, G1 is the amplification factor of the first conversion amplifier, and A1 is the conversion rate from light to electricity of the first photosensitive element.
[0038] In the above embodiment of the present invention, the pixel quantization value of the infrared cutoff is obtained by calculation, so as to obtain the ratio of the infrared part in the ambient light to the entire photosensitive part, and further obtain the ratio of the useful light part in the ambient light to the entire photosensitive part. Here, the entire photosensitive part of the ambient light is equal to the sum of the infrared part and the useful light part. Then, the pixel quantization value n(i, j) output by the above image sensor is multiplied by the ratio. Since the pixel quantization value output by the image sensor contains useful signals and noise, it is equivalent to multiplying both by the above ratio at the same time, and both are reduced by the same ratio, so that the signal-to-noise ratio is no longer attenuated due to the light transmittance and the attenuation of the incident light, thereby achieving the imaging effect of the infrared cutoff filter (IRCUT) without reducing the signal-to-noise ratio. It is more suitable for use as an infrared cutoff filter on a color night vision imaging lens to improve the imaging effect of the infrared cutoff filter in a color night vision environment.
[0039] In addition to the above, it should be noted that "one embodiment", "another embodiment", "embodiment", etc. mentioned in this specification refer to the specific features, structures or characteristics described in conjunction with the embodiment included in at least one embodiment generally described in this application. The same expression appearing in multiple places in the specification does not necessarily refer to the same embodiment. Further, when describing a specific feature, structure or characteristic in conjunction with any embodiment, it is claimed that the realization of such feature, structure or characteristic in conjunction with other embodiments also falls within the scope of the present invention.
[0040] Although the present invention is described herein with reference to a number of illustrative embodiments of the present invention, it will be appreciated that those skilled in the art may devise many other modifications and implementations that fall within the scope and spirit of the principles disclosed herein. More specifically, within the scope of the present disclosure, drawings, and claims, a variety of variations and improvements may be made to the components and / or layout of the subject combination layout. In addition to variations and improvements made to the components and / or layout, other uses will also be apparent to those skilled in the art.
Claims
1. An infrared cutoff filtering method for color night vision imaging, characterized in that The method described herein calculates the pixel quantization value n'(i, j) of the infrared cutoff by the following formula; Where n(i,j) is the pixel quantization value output by the image sensor, U1 is the voltage value collected by ADC1, U2 is the voltage value collected by ADC2, i is the number of image rows, and j is the number of image columns; The α is calculated by the following formula: In the formula, S 12 It is the area enclosed by the vertical line of the vertical axis at the lower cut-off wavelength of the tricolor filter, the bandpass curve of the part greater than the lower cut-off wavelength, and the horizontal axis. Q1 is the correction coefficient, S 22 is the area enclosed by the vertical line of the vertical axis at the lower cut-off wavelength of the second photosensitive element, the bandpass curve of the part greater than the lower cut-off wavelength, and the horizontal axis, G2 is the amplification factor of the second conversion amplifier, and A2 is the conversion rate of the second photosensitive element from light to electricity; The β is calculated by the following formula: In the formula, S2 is the area enclosed by the vertical line at the cut-off wavelength on the first photosensitive element and the bandpass curve of the part greater than the upper cut-off wavelength and the horizontal axis, Q2 is the correction coefficient, S1 is the area enclosed by the vertical line at the cut-off wavelength on the three-color filter and the bandpass curve of the part greater than the upper cut-off wavelength and the horizontal axis, G1 is the amplification factor of the first conversion amplifier, and A1 is the conversion rate from light to electricity of the first photosensitive element.
2. The infrared cutoff filtering method for color night vision imaging according to claim 1, characterized in that: The S 12 It is the area enclosed by the vertical line at the lower cutoff wavelength of any one of the three-color filters, the bandpass curve of the part greater than the lower cutoff wavelength, and the horizontal axis.
3. An infrared cutoff filter for color night vision imaging, characterized in that The infrared cutoff filter comprises a first photosensitive element and a second photosensitive element, wherein the first photosensitive element is connected to a first conversion amplifier and connected to ADC1, and the second photosensitive element is connected to ADC2 through a second conversion amplifier, and both ADC1 and ADC2 are connected to a processor; a second filter is provided at the collection end of the second photosensitive element; the second filter is used to filter the light band that needs to pass through the preset ambient light; The first photosensitive element and the second photosensitive element are used to respectively collect imaging targets and perform photoelectric conversion, and then obtain voltage values U1 and U2 after passing through the first conversion amplifier and the second conversion amplifier, and then the voltage values U1 and U2 are collected by ADC1 and ADC2 respectively, and converted into digital signals and transmitted to the processor; The processor is used to execute the infrared cutoff filtering method described in claim 1 or 2, calculate the pixel quantization value of the infrared cutoff, and multiply the pixel quantization value output by the image sensor by the ratio of the useful light part in the ambient light to the entire photosensitive part; the sum of the ratio of the useful light part in the ambient light to the entire photosensitive part and the ratio of the infrared part in the ambient light to the entire photosensitive part is 100%.
4. The infrared cutoff filter for color night vision imaging according to claim 3, characterized in that: The first photosensitive element and the second photosensitive element each have a lens.
5. The infrared cutoff filter for color night vision imaging according to claim 3, characterized in that: The collecting end of the first photosensitive element is also provided with a first filter, and the first filter is used to transmit the visible light band and the near infrared band in the ambient light.
