Mosaic filter and sensor chip coupling method, system and storage medium

Abstract

The present invention is applicable to the field of spectral imaging technology, and particularly relates to a method, system, and storage medium for coupling a mosaic filter to a sensor chip. The method comprises the following steps: securing the mosaic filter to the sensor chip; obtaining calibration data for the mosaic filter and calculating a reference grayscale value distribution map based on the calibration data; obtaining a sensor image and segmenting the sensor image into multiple sub-sensor images at preset intervals; performing registration based on the reference grayscale value distribution map and the multiple sub-sensor images to obtain an offset histogram; and adjusting the position of the mosaic filter using a fixture based on the offset histogram to achieve coupling between the mosaic filter and the sensor chip. Compared to the prior art, the present invention can achieve precise active coupling between the mosaic filter and the sensor, resolving the problem of prior art sacrificing sensor pixels and resulting in a significant decrease in spatial resolution.

Description

Technical Field

[0001] The present invention is applicable to the field of spectral imaging technology, and in particular relates to a method, system and storage medium for coupling a mosaic filter and a sensor chip. Background Art

[0002] Spectral imaging is the process of imaging an object in space while simultaneously acquiring its spectral information. Traditional spectral imaging methods generally use spectroscopic elements such as prisms and gratings to perform point or line imaging, and then form surface imaging through push-scanning and multiple acquisitions. Therefore, traditional spectral imaging methods have disadvantages such as large optical path volume and slow imaging speed, which limits their application. Snapshot spectral imaging uses filters to modulate the incident light. After modulation, the incident light directly enters the sensor, and the actual spectrum is then deciphered by an algorithm. It has the advantages of small size and fast imaging speed, which makes it important for applications in miniaturization and high real-time requirements.

[0003] A variety of system architectures exist in the field of snapshot spectral imaging. For example, some systems utilize multiple fixed filters in conjunction with a multi-sensor simultaneous imaging mode. This architecture synchronizes the acquisition of different spectral information by assigning filters to each sensor with specific wavelengths. However, this approach has significant drawbacks: the parallel use of multiple sensors significantly increases the device's footprint, resulting in a bulky system. Furthermore, the increased number of sensors and associated filters directly drives up hardware costs, making it difficult to meet the miniaturization and cost-effectiveness requirements of modern applications.

[0004] Another common architecture uses a liquid crystal tunable filter (LCTF) with a single sensor for multiple imaging. LCTFs can dynamically adjust the transmittance wavelength through electrical control, allowing a single sensor to collect spectral information from different wavelengths at different times. Similarly, a filter wheel composed of multiple filters is used with a single sensor. Mechanically rotating the filter wheel switches between filters, enabling sequential spectral acquisition. While both approaches avoid the space and cost challenges associated with multiple sensors, they both suffer from the inherent drawback of long imaging times. The need to collect data in different wavelengths multiple times significantly increases the overall imaging process, making it difficult to adapt to the spectral imaging needs of fast-moving scenes.

[0005] In order to ensure the accuracy of spectral restoration, the mosaic filter must be precisely coupled to the sensor pixels. The precise coupling of the filter and the sensor pixel requires that each filter corresponds to a pixel one-to-one, and multiple filters cannot correspond to the same pixel, otherwise crosstalk will be formed, affecting the accuracy of spectral restoration. In the prior art, quasi-pixel-level mosaic filters that are an integer multiple of the pixel size are often used, and are bonded within a certain rotation angle error. At this time, it can be guaranteed that at least one pixel in each filter is precisely coupled. However, this method uses the filter wafer and sensor wafer in the production process for bonding, which has high requirements for the process and production line. More importantly, this method sacrifices most of the sensor pixels, resulting in a significant decrease in the spatial resolution of the imaging.

[0006] Therefore, there is an urgent need for a new coupling method, system and storage medium for mosaic filters and sensor chips to solve the above technical problems. Summary of the Invention

[0007] The present invention provides a method, system and storage medium for coupling a mosaic filter and a sensor chip, aiming to solve the problem in the prior art of sacrificing sensor pixels, resulting in a significant decrease in spatial resolution.

[0008] In a first aspect, the present invention provides a method for coupling a mosaic filter to a sensor chip, comprising the following steps:

[0009] S1. Fix the mosaic filter and the sensor chip;

[0010] S2. Obtaining calibration data of the mosaic filter, and calculating a reference grayscale value distribution map based on the calibration data;

[0011] S3, acquiring a sensor image, and dividing the sensor image into a plurality of sub-sensor images at preset intervals;

[0012] S4. performing registration based on the reference grayscale value distribution map and the plurality of sub-sensor images to obtain an offset histogram; wherein the offset histogram includes a horizontal histogram and a vertical histogram;

[0013] S5. Adjusting the position of the mosaic filter according to the offset histogram using a fixture to achieve coupling between the mosaic filter and the sensor chip.

[0014] Preferably, the calibration data includes light source spectrum data, transmittance corresponding to each channel of the mosaic filter, narrowband filter transmittance, sensor quantum efficiency and cutoff band range.

[0015] Preferably, step S2 includes the following sub-steps:

[0016] S21, combining the calibration data and calculating the grayscale value of each channel of the mosaic filter according to preset conditions to obtain grayscale value data of multiple channels;

[0017] S22 , arranging the plurality of channel grayscale value data according to the arrangement order of the channels of the mosaic filter to obtain the reference grayscale value distribution diagram.

[0018] Preferably, the channel grayscale value data is calculated according to the following preset conditions:

[0019] ;

[0020] in, Indicates the mosaic filter i Channel grayscale value data of each channel, Indicates the minimum cutoff band range, Indicates the maximum cutoff band range, represents the light source spectrum data, represents the transmittance of the narrowband filter, Indicates the mosaic filter i The transmittance of each channel, represents the sensor quantum efficiency.

[0021] Preferably, step S4 includes the following sub-steps:

[0022] S41, calculating the offsets in the horizontal and vertical directions between the grayscale value distribution of the sub-sensor image and the reference grayscale value distribution map using an image registration algorithm to obtain offset distribution data;

[0023] S42 . Calculate the offset distribution data based on the coordinates of each region in the sub-sensor image to obtain the offset histogram.

[0024] In a second aspect, the present invention further provides a coupling system of a mosaic filter and a sensor chip, comprising:

[0025] An installation module is used to fix the mosaic filter and the sensor chip;

[0026] A calibration module, configured to obtain calibration data of the mosaic filter and calculate a reference grayscale value distribution map based on the calibration data;

[0027] a segmentation module, configured to acquire a sensor image and segment the sensor image into a plurality of sub-sensor images at preset intervals;

[0028] a registration module, configured to perform registration based on the reference grayscale value distribution map and the plurality of sub-sensor images to obtain an offset histogram; wherein the offset histogram includes a horizontal histogram and a vertical histogram;

[0029] An adjustment module is used to adjust the position of the mosaic filter according to the offset histogram through a fixture to achieve coupling between the mosaic filter and the sensor chip.

[0030] Preferably, the calibration module includes the following units:

[0031] a channel grayscale value calculation unit, configured to calculate the grayscale value of each channel of the mosaic filter according to preset conditions in combination with the calibration data, to obtain a plurality of channel grayscale value data;

[0032] An arranging unit is used to arrange the plurality of channel grayscale value data according to the arrangement order of the channels of the mosaic filter to obtain the reference grayscale value distribution map.

[0033] Preferably, the registration module includes the following units:

[0034] an offset distribution module, configured to calculate the offsets between the grayscale value distribution of the sub-sensor image and the reference grayscale value distribution map in the horizontal and vertical directions by using an image registration algorithm to obtain offset distribution data;

[0035] The coordinate calculation module is configured to calculate the offset distribution data based on the coordinates of each region in the sub-sensor image to obtain the offset histogram.

[0036] In a third aspect, the present invention also provides a computer device comprising: a memory, a processor, and a mosaic filter and sensor chip coupling program stored in the memory and runnable on the processor, wherein the processor implements the steps of the mosaic filter and sensor chip coupling method as described in any one of the above embodiments when executing the mosaic filter and sensor chip coupling program.

[0037] In a fourth aspect, the present invention also provides a computer-readable storage medium, on which a coupling program for a mosaic filter and a sensor chip is stored. When the coupling program for a mosaic filter and a sensor chip is executed by a processor, the steps in the coupling method for a mosaic filter and a sensor chip as described in any one of the above embodiments are implemented.

[0038] Compared with the prior art, the present invention can calculate the offset based on the reference grayscale value distribution map and multiple sub-sensor images for registration, thereby coupling the mosaic filter at the pixel level rather than the quasi-pixel level, without sacrificing the spatial resolution of the image and without wasting the pixels of the sensor chip. The present invention uses an external patch method to couple the mosaic filter with the sensor chip, which has lower requirements for the process and sensor chip, and can adapt to different production lines. The coupling effect is judged by real-time monitoring of the sensor output to ensure that what you see is what you get, and the coupling effect is the effect of actually using the sensor. Compared to using a microscope for region-by-region calibration, the present invention can detect the coupling effect of the entire sensor format in real time and give feedback, and realize the precise coupling of the entire mosaic filter with the full sensor format through a fixture, with a coupling error of no more than one tenth of a pixel. BRIEF DESCRIPTION OF THE DRAWINGS

[0039] The present invention will be described in detail below with reference to the accompanying drawings. The above and other aspects of the present invention will become clearer and easier to understand through the detailed description made with reference to the following drawings. In the accompanying drawings:

[0040] Figure 1 This is a flowchart of a method for coupling a mosaic filter and a sensor chip provided by an embodiment of the present invention;

[0041] Figure 2 2 is a schematic structural diagram of a fixture for a method of coupling a mosaic filter and a sensor chip provided by an embodiment of the present invention;

[0042] Figure 3 2 is a schematic structural diagram of a fixture from another perspective of a method for coupling a mosaic filter and a sensor chip provided by an embodiment of the present invention;

[0043] Figure 4 This is a distribution diagram of the offset when the mosaic filter and the sensor chip are rotated in the coupling method of the mosaic filter and the sensor chip provided by an embodiment of the present invention;

[0044] Figure 5 is a histogram of the offset between the mosaic filter and the sensor chip when they are rotated in the coupling method between the mosaic filter and the sensor chip provided by an embodiment of the present invention;

[0045] Figure 6 This is a distribution diagram of the offset when the mosaic filter and the sensor chip are translated in the coupling method of the mosaic filter and the sensor chip provided by an embodiment of the present invention;

[0046] Figure 7 is a histogram of the offset between the mosaic filter and the sensor chip during translation in the method for coupling the mosaic filter and the sensor chip provided by an embodiment of the present invention;

[0047] Figure 8 Schematic diagram of the mosaic filter being adjusted by the fixture of the coupling method between the mosaic filter and the sensor chip provided by the embodiment of the present invention Figure 1 ;

[0048] Figure 9 Schematic diagram of the mosaic filter being adjusted by the fixture of the coupling method between the mosaic filter and the sensor chip provided by the embodiment of the present invention Figure 2 ;

[0049] Figure 10 Schematic diagram of the mosaic filter being adjusted by the fixture of the coupling method between the mosaic filter and the sensor chip provided by the embodiment of the present invention Figure 3 ;

[0050] Figure 11 Schematic diagram of the structure of the coupling system of the mosaic filter and the sensor chip provided by an embodiment of the present invention;

[0051] Figure 12 The figure is a schematic diagram of the structure of a computer device provided by an embodiment of the present invention.

[0052] In the figure, 1. Mosaic filter, 2. Sensor chip, 3. Fixture, 31. Precision stud, 32. Fixture frame, 4. Microbeads. DETAILED DESCRIPTION

[0053] In order to make the purpose, technical solutions and advantages of the present invention more clearly understood, the present invention will be further described in detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present invention and are not intended to limit the present invention.

[0054] Example 1

[0055] Please refer to Figure 1 The present invention provides a method for coupling a mosaic filter and a sensor chip, comprising the following steps:

[0056] S1. Fix the mosaic filter and the sensor chip.

[0057] In this embodiment of the present invention, the mosaic filter 1, with UV glue (ultraviolet curing glue) containing micron-sized glass beads 4 at its four corners, is placed on the sensor chip 2 and secured by a fixture 3 comprising precision studs 31 and a fixture frame 32. This invention utilizes the fixture 3 to implement an external patch method, coupling the mosaic filter 1 to the sensor chip 2. This reduces the requirements for both the process and the sensor chip 2, making it adaptable to different production lines.

[0058] Please refer to Figure 2 and Figure 3 , Figure 2 : is a structural diagram of a fixture for a method of coupling a mosaic filter and a sensor chip provided by an embodiment of the present invention, Figure 3 This figure illustrates the structure of the fixture for coupling a mosaic filter to a sensor chip, from another perspective, according to an embodiment of the present invention. The fixture 3 is used to adjust the position of the mosaic filter 1. Eight precision studs 31 secure the mosaic filter 1 above the sensor chip 2. Adjusting the advance of the precision studs 31 pushes the mosaic filter 1 to adjust its position. The drive mechanism for the fixture 3 is not shown; it can be manually driven using a micrometer or connected to a servo motor.

[0059] S2, obtaining calibration data of the mosaic filter 1, and calculating a reference grayscale value distribution map according to the calibration data;

[0060] In an embodiment of the present invention, the reference gray value distribution map It refers to the grayscale value distribution diagram when the mosaic filter 1 is successfully coupled with the sensor chip 2.

[0061] The calibration data includes light source spectrum data (collected by the spectrometer), Transmittance of each channel of the mosaic filter 1 (calculated by spectrometer), narrowband filter transmittance (calculated from spectrometer data), sensor quantum efficiency (given by the sensor manufacturer) and the cutoff band range .

[0062] In this embodiment of the present invention, step S2 includes the following sub-steps:

[0063] S21, calculating the grayscale value of each channel of the mosaic filter 1 to obtain grayscale value data of multiple channels;

[0064] S22, arranging the plurality of channel grayscale value data according to the arrangement order of the channels of the mosaic filter 1 to obtain the reference grayscale value distribution map .

[0065] In an embodiment of the present invention, the channel grayscale value data is calculated according to the following preset conditions:

[0066] ;

[0067] in, Indicates the mosaic filter 1 i Channel grayscale value data of each channel, Indicates the minimum cutoff band range, Indicates the maximum cutoff band range, represents the light source spectrum data, represents the transmittance of the narrowband filter, Indicates the mosaic filter 1 i The transmittance of each channel, represents the sensor quantum efficiency.

[0068] S3. Acquire a sensor image, and divide the sensor image into a plurality of sub-sensor images at preset intervals.

[0069] In the embodiment of the present invention, the sensor image is divided into a plurality of sub-sensor images according to preset intervals along the width and height directions. .

[0070] S4. performing registration based on the reference grayscale value distribution map and the plurality of sub-sensor images to obtain an offset histogram; wherein the offset histogram includes a horizontal histogram and a vertical histogram;

[0071] In the embodiment of the present invention, the number of pixels on the longest side of the sub-sensor image is defined as , when the rotation angle between the mosaic filter 1 and the sensor chip 2 is less than In the case of , it can be considered that the gray value distribution of the sub-sensor image in the local Gray value distribution relative to the reference There is only horizontal and vertical offset .

[0072] Step S4 includes the following sub-steps:

[0073] S41. Calculate horizontal and vertical offsets between the grayscale value distribution of the sub-sensor image and the reference grayscale value distribution map using an image registration algorithm to obtain offset distribution data. Specifically, the image registration algorithm may be an optical flow method, a phase cross-correlation method, or other registration algorithm.

[0074] S42, calculate the offset histogram based on the coordinates of each area in the sub-sensor image and the offset distribution data. Specifically, the offset distribution diagram and the offset histogram when the mosaic filter 1 and the sensor chip 2 rotate are as follows: Figure 4-Figure 5As shown in FIG, the larger distribution range of the offset distribution in a certain dimension reflects the rotation between the mosaic filter 1 and the sensor chip 2, which can be corrected by pushing a precision stud 31 on one side of the fixture 3. The offset distribution diagram and offset histogram when the mosaic filter 1 and the sensor chip 2 are translated are shown in FIG. Figure 6-Figure 7 As shown, when the offset distribution of a certain dimension is concentrated but the mean is not 0, it reflects that the mosaic filter 1 has a translation in this dimension, which can be corrected by simultaneously pushing the two precision studs 31 on one side of the fixture 3 in the direction of this dimension.

[0075] S5 . Adjust the position of the mosaic filter 1 according to the offset histogram using the fixture 3 to achieve coupling between the mosaic filter 1 and the sensor chip 2 .

[0076] In the embodiment of the present invention, the position of the mosaic filter 1 can be fine-tuned multiple times by the fixture 3 according to the offset histogram until a preset effect is achieved, thereby realizing coupling between the mosaic filter 1 and the sensor chip 2 .

[0077] Specifically, the operation of coupling the position of the mosaic filter 1 according to the offset histogram by the fixture 3 is as follows:

[0078] Please refer to Figure 8 , take the center of the image as the origin, and establish a two-dimensional coordinate system along the width and height directions. Note that the coordinate system satisfies The area formed by the coordinates of ,satisfy The area is , The same applies to the axis.

[0079] Define the offset vector field In image coordinates The offset vector at .remember For all offset vectors The average value of the component, for All offset vectors of the region The average value of the component.

[0080] There are 8 precision studs 31 arranged along 4 straight lines on the fixture 3. The precision studs 31 on each straight line form a pair, which can be arranged along Direction adjustment flat Quantity, flat Quantity, flat Quantity, flat Quantity.

[0081] Please refer to Figure 9 , when the mosaic filter 1 is translated relative to the sensor chip 2, Are not 0, then the two pairs Component precision stud 31 along Push in both directions simultaneously, two pairs Component precision stud 31 along direction at the same time. Figure 9 Put two pairs Component precision stud 31 along Push in the same direction.

[0082] Please refer to Figure 10 , when the mosaic filter 1 rotates relative to the sensor chip 2, as well as Are not 0, then flat Component precision stud 31 along Direction push, flat Component precision stud 31 along Direction push, flat Component precision stud 31 along Direction push, flat Component precision stud 31 along Direction push. Figure 10 In, according to Push in the direction of Two pairs of precision studs 31 of component.

[0083] Based on the observed offset vector distribution, the above logic is repeated until the offset meets the expected value. When the desired coupling between the mosaic filter 1 and the sensor chip 2 is achieved, the UV adhesive is cured with an ultraviolet lamp, and the sensor chip 2 is removed from the fixture 3. This invention enables real-time monitoring and feedback of the coupling effect across the entire sensor format. Furthermore, through the fixture 3, precise coupling of the entire mosaic filter 1 to the entire sensor format is achieved, with a coupling error of no more than one tenth of a pixel.

[0084] Compared with the prior art, the present invention can calculate the offset based on the reference grayscale value distribution map and multiple sub-sensor images for registration, thereby coupling the mosaic filter at the pixel level rather than the quasi-pixel level, without sacrificing the spatial resolution of the image and without wasting the pixels of the sensor chip. The present invention uses an external patch method to couple the mosaic filter with the sensor chip, which has lower requirements for the process and sensor chip, and can adapt to different production lines. The coupling effect is judged by real-time monitoring of the sensor output to ensure that what you see is what you get, and the coupling effect is the effect of actually using the sensor. Compared to using a microscope for region-by-region calibration, the present invention can detect the coupling effect of the entire sensor format in real time and give feedback, and realize the precise coupling of the entire mosaic filter with the full sensor format through a fixture, with a coupling error of no more than one tenth of a pixel.

[0085] Example 2

[0086] The embodiment of the present invention also provides a coupling system of mosaic filter and sensor chip, please refer to Figure 11 , Figure 11 2 is a schematic structural diagram of a mosaic filter and sensor chip coupling system 200 provided in an embodiment of the present invention, which includes:

[0087] 201. An installation module for fixing the mosaic filter and the sensor chip;

[0088] 202. A calibration module, configured to obtain calibration data of the mosaic filter and calculate a reference grayscale value distribution map based on the calibration data;

[0089] In this embodiment of the present invention, the calibration module 202 includes the following units:

[0090] 2021. A channel grayscale value calculation unit, configured to calculate the grayscale value of each channel of the mosaic filter according to preset conditions in combination with the calibration data to obtain a plurality of channel grayscale value data;

[0091] 2022. An arranging unit, configured to arrange the plurality of channel grayscale value data according to the arrangement order of the channels of the mosaic filter to obtain the reference grayscale value distribution map.

[0092] 203. A segmentation module, configured to acquire a sensor image and segment the sensor image into a plurality of sub-sensor images at preset intervals;

[0093] 204. A registration module, configured to perform registration based on the reference grayscale value distribution map and the plurality of sub-sensor images to obtain an offset histogram; wherein the offset histogram includes a horizontal histogram and a vertical histogram;

[0094] In this embodiment of the present invention, the registration module 204 includes the following units:

[0095] 2041. An offset distribution module, configured to calculate offsets between the grayscale value distribution of the sub-sensor image and the reference grayscale value distribution map in the horizontal and vertical directions using an image registration algorithm to obtain offset distribution data.

[0096] 2042. A coordinate calculation module, configured to calculate the offset histogram based on the coordinates of each region in the sub-sensor image and the offset distribution data.

[0097] 205. An adjustment module, configured to adjust the position of the mosaic filter according to the offset histogram through a fixture to achieve coupling between the mosaic filter and the sensor chip.

[0098] The mosaic filter and sensor chip coupling system 200 can implement the steps in the mosaic filter and sensor chip coupling method in the above embodiment, and can achieve the same technical effects. Please refer to the description in the above embodiment and will not be repeated here.

[0099] Example 3

[0100] The embodiment of the present invention also provides a computer device, please refer to Figure 12 , Figure 12 3 is a structural diagram of a computer device provided in an embodiment of the present invention. The computer device 300 includes: a memory 302, a processor 301, and a coupling program for a mosaic filter and a sensor chip stored in the memory 302 and executable on the processor 301.

[0101] The processor 301 calls the mosaic filter and sensor chip coupling program stored in the memory 302 and executes the steps of the mosaic filter and sensor chip coupling method provided in the embodiment of the present invention. Figure 1 , specifically including the following steps:

[0102] S1. Fix the mosaic filter and the sensor chip.

[0103] In this embodiment of the present invention, the mosaic filter 1, with UV glue (ultraviolet curing glue) containing micron-sized glass beads 4 at its four corners, is placed on the sensor chip 2 and secured by a fixture 3 comprising precision studs 31 and a fixture frame 32. This invention utilizes the fixture 3 to implement an external patch method, coupling the mosaic filter 1 to the sensor chip 2. This reduces the requirements for both the process and the sensor chip 2, making it adaptable to different production lines.

[0104] The fixture 3 is used to adjust the position of the mosaic filter 1. It clamps the mosaic filter 1 above the sensor chip 2 with eight precision studs 31. Adjusting the advance of the precision studs 31 pushes the mosaic filter 1 to adjust its position. The drive mechanism for the fixture 3 is not shown; it can be manually driven using a micrometer or connected to a servo motor.

[0105] S2, obtaining calibration data of the mosaic filter 1, and calculating a reference grayscale value distribution map according to the calibration data;

[0106] In an embodiment of the present invention, the reference gray value distribution map It refers to the grayscale value distribution diagram when the mosaic filter 1 is successfully coupled with the sensor chip 2.

[0107] The calibration data includes light source spectrum data (collected by the spectrometer), Transmittance of each channel of the mosaic filter 1 (calculated by spectrometer), narrowband filter transmittance (calculated from spectrometer data), sensor quantum efficiency (given by the sensor manufacturer) and the cutoff band range .

[0108] In this embodiment of the present invention, step S2 includes the following sub-steps:

[0109] S21, calculating the grayscale value of each channel of the mosaic filter 1 to obtain grayscale value data of multiple channels;

[0110] S22, arranging the plurality of channel grayscale value data according to the arrangement order of the channels of the mosaic filter 1 to obtain the reference grayscale value distribution map .

[0111] In an embodiment of the present invention, the channel grayscale value data is calculated according to the following preset conditions:

[0112] ;

[0113] in, Indicates the mosaic filter 1 i Channel grayscale value data of each channel, Indicates the minimum cutoff band range, Indicates the maximum cutoff band range, represents the light source spectrum data, represents the transmittance of the narrowband filter, Indicates the mosaic filter 1i The transmittance of each channel, represents the sensor quantum efficiency.

[0114] S3. Acquire a sensor image, and divide the sensor image into a plurality of sub-sensor images at preset intervals.

[0115] In the embodiment of the present invention, the sensor image is divided into a plurality of sub-sensor images according to preset intervals along the width and height directions. .

[0116] S4. performing registration based on the reference grayscale value distribution map and the plurality of sub-sensor images to obtain an offset histogram; wherein the offset histogram includes a horizontal histogram and a vertical histogram;

[0117] In the embodiment of the present invention, the number of pixels on the longest side of the sub-sensor image is defined as , when the rotation angle between the mosaic filter 1 and the sensor chip 2 is less than In the case of , it can be considered that the gray value distribution of the sub-sensor image in the local Gray value distribution relative to the reference There is only horizontal and vertical offset .

[0118] Step S4 includes the following sub-steps:

[0119] S41. Calculate horizontal and vertical offsets between the grayscale value distribution of the sub-sensor image and the reference grayscale value distribution map using an image registration algorithm to obtain offset distribution data. Specifically, the image registration algorithm may be an optical flow method, a phase cross-correlation method, or other registration algorithm.

[0120] S42. Calculate the offset histogram based on the coordinates of each region in the sub-sensor image and the offset distribution data. Specifically, if the offset distribution in a particular dimension is large, indicating rotation between the mosaic filter 1 and the sensor chip 2, correction can be made by pushing a precision stud 31 on one side of the fixture 3. If the offset distribution in a particular dimension is concentrated but the mean is not zero, indicating translation of the mosaic filter 1 in that dimension, correction can be made by simultaneously pushing two precision studs 31 on one side of the fixture 3 in that dimension.

[0121] S5 . Adjust the position of the mosaic filter 1 according to the offset histogram using the fixture 3 to achieve coupling between the mosaic filter 1 and the sensor chip 2 .

[0122] In the embodiment of the present invention, the position of the mosaic filter 1 can be fine-tuned multiple times by the fixture 3 according to the offset histogram until a preset effect is achieved, thereby realizing coupling between the mosaic filter 1 and the sensor chip 2 .

[0123] Based on the observed offset vector distribution, the above logic is repeated until the offset meets the expected value. When the desired coupling between the mosaic filter 1 and the sensor chip 2 is achieved, the UV adhesive is cured with an ultraviolet lamp, and the sensor chip 2 is removed from the fixture 3. This invention enables real-time monitoring and feedback of the coupling effect across the entire sensor format. Furthermore, through the fixture 3, precise coupling of the entire mosaic filter 1 to the entire sensor format is achieved, with a coupling error of no more than one tenth of a pixel.

[0124] The computer device 300 provided in the embodiment of the present invention can implement the steps in the method for coupling the mosaic filter and the sensor chip in the above embodiment, and can achieve the same technical effects. Please refer to the description in the above embodiment and will not be repeated here.

[0125] Example 4

[0126] An embodiment of the present invention also provides a computer-readable storage medium, on which a coupling program for a mosaic filter and a sensor chip is stored. When the coupling program for a mosaic filter and a sensor chip is executed by a processor, the various processes and steps in the coupling method for a mosaic filter and a sensor chip provided in an embodiment of the present invention are implemented, and the same technical effects can be achieved. To avoid repetition, they will not be described here.

[0127] Those skilled in the art will appreciate that all or part of the processes in the above-described method embodiments can be implemented by instructing the relevant hardware through a computer program. The program can be stored in a computer-readable storage medium, and when executed, the program can include the processes in the above-described method embodiments. The storage medium can be a magnetic disk, an optical disk, a read-only memory (ROM), or a random access memory (RAM).

[0128] It should be noted that, in this document, the terms "comprises," "includes," or any other variations thereof are intended to encompass non-exclusive inclusion, such that a process, method, article, or apparatus comprising a series of elements includes not only those elements but also other elements not explicitly listed, or elements inherent to such process, method, article, or apparatus. In the absence of further limitations, an element defined by the phrase "comprising a ..." does not exclude the presence of other identical elements in the process, method, article, or apparatus comprising the element.

[0129] Through the above description of the embodiments, those skilled in the art will clearly understand that the methods of the above embodiments can be implemented using software plus the necessary general-purpose hardware platform. Of course, hardware can also be used, but in many cases the former is the more preferred implementation method. Based on this understanding, the technical solution of the present invention, or the portion that contributes to the prior art, can be embodied in the form of a software product. This computer software product is stored in a storage medium (such as ROM / RAM, magnetic disk, or optical disk) and includes a number of instructions for enabling a terminal (such as a mobile phone, computer, server, air conditioner, or network device) to execute the methods described in the various embodiments of the present invention.

[0130] The embodiments of the present invention are described above in conjunction with the accompanying drawings. What is disclosed is only a preferred embodiment of the present invention. However, the present invention is not limited to the above-mentioned specific implementation methods. The above-mentioned specific implementation methods are merely illustrative and not restrictive. Under the guidance of the present invention, ordinary technicians in this field can also make many forms and equivalent changes without departing from the scope of protection of the purpose of the present invention and the claims, which are all within the protection of the present invention.

Claims

1. A method for coupling a mosaic filter and a sensor chip, characterized in that: The following steps are involved: S1. Fix the mosaic filter and the sensor chip; S2. Obtaining calibration data of the mosaic filter, and calculating a reference grayscale value distribution map based on the calibration data; S3, acquiring a sensor image, and dividing the sensor image into a plurality of sub-sensor images at preset intervals; S4. performing registration based on the reference grayscale value distribution map and the plurality of sub-sensor images to obtain an offset histogram; wherein the offset histogram includes a horizontal histogram and a vertical histogram; S5. Adjusting the position of the mosaic filter according to the offset histogram using a fixture to achieve coupling between the mosaic filter and the sensor chip; The calibration data includes light source spectrum data, transmittance corresponding to each channel of the mosaic filter, narrowband filter transmittance, sensor quantum efficiency and cutoff band range.

2. The method for coupling a mosaic filter to a sensor chip according to claim 1, wherein: Step S2 includes the following sub-steps: S21, combining the calibration data and calculating the grayscale value of each channel of the mosaic filter according to preset conditions to obtain grayscale value data of multiple channels; S22 , arranging the plurality of channel grayscale value data according to the arrangement order of the channels of the mosaic filter to obtain the reference grayscale value distribution diagram.

3. The method for coupling a mosaic filter to a sensor chip according to claim 2, wherein: The channel grayscale value data is calculated according to the following preset conditions: ； in, Indicates the mosaic filter i Channel grayscale value data of each channel, Indicates the minimum cutoff band range, Indicates the maximum cutoff band range, represents the light source spectrum data, represents the transmittance of the narrowband filter, Indicates the mosaic filter i The transmittance of each channel, represents the sensor quantum efficiency.

4. The method for coupling a mosaic filter to a sensor chip according to claim 1, wherein: Step S4 includes the following sub-steps: S41, calculating the offsets in the horizontal and vertical directions between the grayscale value distribution of the sub-sensor image and the reference grayscale value distribution map using an image registration algorithm to obtain offset distribution data; S42 . Calculate the offset distribution data based on the coordinates of each region in the sub-sensor image to obtain the offset histogram.

5. A coupling system of a mosaic filter and a sensor chip, characterized in that: include: An installation module is used to fix the mosaic filter and the sensor chip; A calibration module is used to obtain calibration data of the mosaic filter and calculate a reference grayscale value distribution diagram based on the calibration data; the calibration data includes light source spectrum data, transmittance corresponding to each channel of the mosaic filter, narrowband filter transmittance, sensor quantum efficiency, and cutoff band range; a segmentation module, configured to acquire a sensor image and segment the sensor image into a plurality of sub-sensor images at preset intervals; a registration module, configured to perform registration based on the reference grayscale value distribution map and the plurality of sub-sensor images to obtain an offset histogram; wherein the offset histogram includes a horizontal histogram and a vertical histogram; An adjustment module is used to adjust the position of the mosaic filter according to the offset histogram through a fixture to achieve coupling between the mosaic filter and the sensor chip.

6. The mosaic filter and sensor chip coupling system according to claim 5, characterized in that: The calibration module includes the following units: a channel grayscale value calculation unit, configured to calculate the grayscale value of each channel of the mosaic filter according to preset conditions in combination with the calibration data, to obtain a plurality of channel grayscale value data; An arranging unit is used to arrange the plurality of channel grayscale value data according to the arrangement order of the channels of the mosaic filter to obtain the reference grayscale value distribution map.

7. The mosaic filter and sensor chip coupling system according to claim 5, wherein: The registration module includes the following units: an offset distribution module, configured to calculate the offsets between the grayscale value distribution of the sub-sensor image and the reference grayscale value distribution map in the horizontal and vertical directions by using an image registration algorithm to obtain offset distribution data; The coordinate calculation module is configured to calculate the offset distribution data based on the coordinates of each region in the sub-sensor image to obtain the offset histogram.

8. A computer device, characterized in that: include: A memory, a processor, and a mosaic filter and sensor chip coupling program stored in the memory and executable on the processor, wherein the processor implements the steps of the mosaic filter and sensor chip coupling method as described in any one of claims 1 to 4 when executing the mosaic filter and sensor chip coupling program.

9. A computer-readable storage medium, characterized in that The computer-readable storage medium stores a coupling program for a mosaic filter and a sensor chip. When the coupling program for a mosaic filter and a sensor chip is executed by a processor, the steps of the coupling method for a mosaic filter and a sensor chip as described in any one of claims 1 to 4 are implemented.

Images