Coupling method and system of mosaic filter and sensor chip, and storage medium

Abstract

The invention is suitable for the technical field of spectral imaging, and particularly relates to a mosaic filter and sensor chip coupling method and system and a storage medium. The method comprises the following steps: fixing a mosaic filter and a sensor chip; obtaining calibration data of the mosaic filter, and calculating a reference gray value distribution diagram according to the calibration data; acquiring a sensor image, and segmenting the sensor image into a plurality of sub-sensor images according to a preset interval; performing registration according to the reference gray value distribution diagram and the plurality of sub-sensor images to obtain an offset histogram; and adjusting the position of the mosaic filter through the clamp according to the offset histogram, so as to realize the coupling between the mosaic filter and the sensor chip. Compared with the prior art, accurate active coupling between the mosaic filter and the sensor can be achieved, and the problem that in the prior art, sensor pixels are sacrificed, and consequently the spatial resolution is greatly reduced is solved.

Description

Technical Field

[0001] The present invention is applicable to the field of spectral imaging technology, and particularly relates to a coupling method, system and storage medium for a mosaic filter and a sensor chip. Background Art

[0002] Spectral imaging is to obtain the spectral information of an object while imaging the object in space. Traditional spectral imaging methods generally use spectroscopic elements such as prisms, gratings, etc. for point or line imaging, and then form a surface image through methods such as push brooming and multiple acquisitions. Therefore, traditional spectral imaging methods have disadvantages such as large optical path volume and slow imaging speed, resulting in limited applications. Snapshot spectral imaging uses a filter to modulate the incident light. After modulation, the incident light directly enters the sensor, and then the actual spectrum is solved by an algorithm. It has advantages such as small volume and fast imaging speed, which makes it have important applications in scenarios with high requirements for miniaturization and real-time performance.

[0003] There are various system architectures in the existing snapshot spectral imaging field. For example, some systems adopt a simultaneous imaging mode with multiple fixed filters and multiple sensors. This architecture realizes the synchronous acquisition of different spectral information by configuring filters with specific wavelengths for each sensor. However, this solution has significant defects: the parallel use of multiple sensors will greatly increase the space occupied by the device, resulting in a large system volume; at the same time, the increase in the number of sensors and supporting filters directly raises the hardware cost, making it difficult to meet the requirements of modern applications in terms of miniaturization and economy.

[0004] Another common architecture is a multiple imaging method with a liquid crystal tunable filter and a single sensor. The liquid crystal tunable filter can dynamically adjust the light transmission wavelength by an electric control method, so that the single sensor can collect spectral information of different bands at different times. Similarly, there is also a solution with a filter wheel composed of multiple filters and a single sensor. By mechanically rotating the filter wheel to switch different filters, sequential spectral acquisition is realized. Although these two methods avoid the space and cost problems brought by multiple sensors, they both have the inherent defect of long imaging time. Since it is necessary to collect data of different bands in multiple times, the time of the entire imaging process is significantly increased, making it difficult to meet the spectral imaging requirements of fast dynamic scenes.

[0005] To ensure the accuracy of spectral restoration, the mosaic filter must be precisely coupled with the sensor pixels. The precise coupling of the filter with the sensor pixels requires that each filter corresponds one-to-one with a pixel, and there should be no situation where multiple filters correspond to the same pixel, otherwise crosstalk will occur and affect the accuracy of spectral restoration. In the prior art, a quasi-pixel-level mosaic filter larger than an integer multiple of the pixel size is often used and bonded within a certain rotation angle error. At this time, it can be ensured that at least one pixel in each filter is precisely coupled. However, this method uses the filter wafer and the sensor wafer in the production process for bonding, which has high requirements for the process and production line. More importantly, this method sacrifices most of the sensor pixels, resulting in a significant decrease in the imaging spatial resolution.

[0006] Therefore, there is an urgent need for a new coupling method, system and storage medium for the mosaic filter and the sensor chip to solve the above technical problems. Summary of the Invention

[0007] The present invention provides a coupling method, system and storage medium for a mosaic filter and a sensor chip, aiming to solve the problem in the prior art that sacrificing sensor pixels leads to a significant decrease in spatial resolution.

[0008] In a first aspect, the present invention provides a coupling method for a mosaic filter and a sensor chip, including the following steps: S1. Fix the mosaic filter and the sensor chip; S2. Obtain the calibration data of the mosaic filter, and calculate the reference gray value distribution map according to the calibration data; S3. Obtain the sensor image, and divide the sensor image into multiple sub-sensor images at a preset interval; S4. Register according to the reference gray value distribution map and the multiple sub-sensor images to obtain an offset histogram; wherein, the offset histogram includes a horizontal histogram and a vertical histogram; S5. Adjust the position of the mosaic filter according to the offset histogram by a fixture to achieve the coupling between the mosaic filter and the sensor chip.

[0009] Preferably, the calibration data includes light source spectral data, transmittance corresponding to each channel of the mosaic filter, transmittance of the narrowband filter, sensor quantum efficiency, and cut-off wavelength range of the cut-off filter.

[0010] Preferably, in step S2, it includes the following sub-steps: S21. Combine the calibration data and calculate the gray value of each channel of the mosaic filter according to preset conditions to obtain multiple channel gray value data; S22. Arrange the channel gray value data of multiple channels according to the arrangement order of each channel of the mosaic filter to obtain the reference gray value distribution map.

[0011] Preferably, the channel gray value data is calculated according to the following preset conditions: ; where represents the channel gray value data of the i th channel of the mosaic filter, represents the minimum cut-off filter band range, represents the maximum cut-off filter band range, represents the light source spectrum data, represents the transmittance of the narrowband filter, represents the i th channel transmittance of the mosaic filter, represents the sensor quantum efficiency.

[0012] Preferably, in step S4, the following sub-steps are included: S41. Calculate the offset of the gray value distribution of the sub-sensor image and the reference gray value distribution map in the horizontal and vertical directions through an image registration algorithm to obtain offset distribution data; S42. Calculate according to the coordinates of each region in the sub-sensor image and the offset distribution data to obtain the offset histogram.

[0013] In a second aspect, the present invention also provides a coupling system of a mosaic filter and a sensor chip, including: An installation module for fixing the mosaic filter and the sensor chip; A calibration module for obtaining calibration data of the mosaic filter and calculating a reference gray value distribution map according to the calibration data; A segmentation module for obtaining a sensor image and segmenting the sensor image into multiple sub-sensor images at a preset interval; A registration module for registering according to the reference gray value distribution map and multiple sub-sensor images to obtain an offset histogram; wherein, the offset histogram includes a horizontal histogram and a vertical histogram; An adjustment module for adjusting the position of the mosaic filter according to the offset histogram through a fixture to realize the coupling between the mosaic filter and the sensor chip.

[0014] Preferably, the calibration module includes the following units: A channel grayscale value calculation unit, configured to calculate the grayscale value of each channel of the mosaic filter according to a preset condition in combination with the calibration data, so as to obtain a plurality of channel grayscale value data; An arrangement unit, configured to arrange the plurality of channel grayscale value data according to the arrangement order of the respective channels of the mosaic filter, so as to obtain the reference grayscale value distribution map.

[0015] Preferably, the registration module includes the following units: An offset distribution module, configured to calculate the offset amounts of the grayscale value distribution of the sub-sensor image and the reference grayscale value distribution map in the horizontal and vertical directions through an image registration algorithm, so as to obtain offset distribution data; A coordinate calculation module, configured to calculate according to the coordinates of each region in the sub-sensor image and the offset distribution data to obtain the offset histogram.

[0016] In a third aspect, the present invention further provides a computer device, including: a memory, a processor, and a coupling program of the mosaic filter and the sensor chip stored on the memory and executable on the processor. When the processor executes the coupling program of the mosaic filter and the sensor chip, the steps in the coupling method of the mosaic filter and the sensor chip as described in any one of the above embodiments are implemented.

[0017] In a fourth aspect, the present invention further provides a computer-readable storage medium, on which a coupling program of the mosaic filter and the sensor chip is stored. When the coupling program of the mosaic filter and the sensor chip is executed by a processor, the steps in the coupling method of the mosaic filter and the sensor chip as described in any one of the above embodiments are implemented.

[0018] Compared with the prior art, the present invention can calculate the offset amount through registration according to the reference grayscale value distribution map and a plurality of sub-sensor images, so as to couple the mosaic filter at the pixel level rather than the quasi-pixel level, without sacrificing the spatial resolution of the image and without wasting the pixels of the sensor chip. The present invention couples the mosaic filter and the sensor chip by using an external patch method, which has lower requirements for the process and the sensor chip and can adapt to different production lines. By using the method of real-time monitoring of the sensor output to judge the coupling effect, it can ensure what you see is what you get, and the coupling effect is the effect of the actual use of the sensor. Compared with using a microscope for area-by-area calibration, the present invention can perform real-time detection and give feedback on the coupling effect of the entire sensor full frame, and realize the precise coupling of the entire mosaic filter and the full sensor frame through a fixture, and the coupling error does not exceed one-tenth of a pixel. Description of the Drawings

[0019] The present invention will be described in detail below with reference to the accompanying drawings. Through the detailed description in combination with the following drawings, the above or other aspects of the present invention will become clearer and easier to understand. In the drawings: Figure 1 is a flowchart of a method for coupling a mosaic filter sheet and a sensor chip provided by an embodiment of the present invention; Figure 2 is a schematic structural diagram of a fixture for a method for coupling a mosaic filter sheet and a sensor chip provided by an embodiment of the present invention; Figure 3 is a schematic structural diagram of the fixture from another perspective for a method for coupling a mosaic filter sheet and a sensor chip provided by an embodiment of the present invention; Figure 4 is a deviation distribution diagram when the mosaic filter sheet and the sensor chip rotate in a method for coupling a mosaic filter sheet and a sensor chip provided by an embodiment of the present invention; Figure 5 is a deviation histogram when the mosaic filter sheet and the sensor chip rotate in a method for coupling a mosaic filter sheet and a sensor chip provided by an embodiment of the present invention; Figure 6 is a deviation distribution diagram when the mosaic filter sheet and the sensor chip translate in a method for coupling a mosaic filter sheet and a sensor chip provided by an embodiment of the present invention; Figure 7 is a deviation histogram when the mosaic filter sheet and the sensor chip translate in a method for coupling a mosaic filter sheet and a sensor chip provided by an embodiment of the present invention; Figure 8 is a schematic diagram when the fixture adjusts the mosaic filter sheet in a method for coupling a mosaic filter sheet and a sensor chip provided by an embodiment of the present invention Figure 1 ; Figure 9 is a schematic diagram when the fixture adjusts the mosaic filter sheet in a method for coupling a mosaic filter sheet and a sensor chip provided by an embodiment of the present invention Figure 2 ; Figure 10 is a schematic diagram when the fixture adjusts the mosaic filter sheet in a method for coupling a mosaic filter sheet and a sensor chip provided by an embodiment of the present invention Figure 3 ; Figure 11 is a schematic structural diagram of a coupling system for a mosaic filter sheet and a sensor chip provided by an embodiment of the present invention; Figure 12 is a schematic structural diagram of a computer device provided by an embodiment of the present invention.

[0020] In the figure, 1, mosaic filter sheet; 2, sensor chip; 3, fixture; 31, precision stud; 32, fixture outer frame; 4, microbead. Detailed implementation manners

[0021] In order to make the objectives, technical solutions and advantages of the present invention clearer and more understandable, the present invention will be further described in detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present invention and are not used to limit the present invention.

[0022] Embodiment 1 Please refer to Figure 1 , the present invention provides a coupling method for a mosaic filter and a sensor chip, including the following steps: S1. Fix the mosaic filter and the sensor chip.

[0023] In the embodiment of the present invention, the four corners of the mosaic filter 1 contain UV glue (ultraviolet curable glue) with glass microbeads 4 of several micrometers in size, which is placed on the sensor chip 2 and fixed by a fixture 3. The fixture 3 includes a precision stud 31 and a fixture outer frame 32. The present invention realizes an external patch method by using the fixture 3, thereby coupling the mosaic filter 1 and the sensor chip 2, with lower requirements for the process and the sensor chip 2, and can adapt to different production lines.

[0024] Please refer to Figure 2 and Figure 3 , Figure 2 is a schematic structural diagram of the fixture for the coupling method of the mosaic filter and the sensor chip provided by the embodiment of the present invention, Figure 3 is a schematic structural diagram of the fixture from another perspective for the coupling method of the mosaic filter and the sensor chip provided by the embodiment of the present invention. The fixture 3 is used to adjust the position of the mosaic filter 1. The fixture 3 clamps the mosaic filter 1 above the sensor chip 2 through eight precision studs 31, and the position of the mosaic filter 1 can be adjusted by changing the advance amount of the precision studs 31. The driving device of the fixture 3 is not shown, and a micrometer head can be used for manual driving or a servo motor can be connected for driving.

[0025] S2. Obtain the calibration data of the mosaic filter 1, and calculate the reference gray value distribution map according to the calibration data; In the embodiment of the present invention, the reference gray value distribution map refers to the gray value distribution map when the mosaic filter 1 and the sensor chip 2 are successfully coupled.

[0026] The calibration data includes light source spectral data (collected by a spectrometer), the transmittance of each channel of the mosaic filter 1 of the channel (calculated by collection and calculation by a spectrometer), the transmittance of the narrowband filter (Calculated from the data collected by the spectrometer), sensor quantum efficiency (Given by the sensor manufacturer) and the band range of the cutoff filter .

[0027] In the embodiment of the present invention, in step S2, the following sub-steps are included: S21. Calculate the gray value of each channel of the mosaic filter 1 to obtain a plurality of channel gray value data; S22. Arrange the plurality of channel gray value data according to the arrangement order of each channel of the mosaic filter 1 to obtain the reference gray value distribution diagram .

[0028] In the embodiment of the present invention, the channel gray value data is calculated according to the following preset conditions: ; Wherein, represents the channel gray value data of the i th channel of the mosaic filter 1, represents the minimum cutoff filter band range, represents the maximum cutoff filter band range, represents the light source spectrum data, represents the transmittance of the narrowband filter, represents the i th channel transmittance of the mosaic filter 1, represents the sensor quantum efficiency.

[0029] S3. Obtain a sensor image and divide the sensor image into a plurality of sub-sensor images at a preset interval.

[0030] In the embodiment of the present invention, the sensor image is divided into a plurality of sub-sensor images along the width and height directions at a preset interval .

[0031] S4. Perform registration according to the reference gray value distribution diagram and the plurality of sub-sensor images to obtain an offset histogram; wherein, the offset histogram includes a horizontal histogram and a vertical histogram; In the embodiment of the present invention, it is defined that the number of pixels of the longest side of the sub-sensor image is , when the rotation angle between the mosaic filter 1 and the sensor chip 2 is less than , it can be considered that the local gray value distribution of the sub-sensor image relative to the reference gray value distribution diagram only has offsets in the horizontal and vertical directions .

[0032] In step S4, the following sub-steps are included: S41. Calculate the offsets of the grayscale value distribution of the sub-sensor image in the horizontal and vertical directions from the reference grayscale value distribution map through an image registration algorithm to obtain offset distribution data. Specifically, the image registration algorithm can be a registration algorithm such as Optical Flow or Phase Cross-Correlation.

[0033] S42. Calculate according to the coordinates of each region in the sub-sensor image and the offset distribution data to obtain the offset histogram. Specifically, the offset distribution map and offset histogram when rotation occurs between the mosaic filter 1 and the sensor chip 2 are as Figures 4 - 5 shown. A larger distribution range of the offset distribution in a certain dimension reflects that there is rotation between the mosaic filter 1 and the sensor chip 2, which can be corrected by pushing a precision stud 31 on one side of the fixture 3. The offset distribution map and offset histogram when translation occurs between the mosaic filter 1 and the sensor chip 2 are as Figures 6 - 7 shown. When the offset distribution in a certain dimension is concentrated but the mean value is not 0, it reflects that there is translation of the mosaic filter 1 in this dimension, which can be corrected by simultaneously pushing two precision studs 31 on one side of the fixture 3 in the direction of this dimension.

[0034] S5. Adjust the position of the mosaic filter 1 by the fixture 3 according to the offset histogram to achieve the coupling between the mosaic filter 1 and the sensor chip 2.

[0035] In the embodiment of the present invention, the position of the mosaic filter 1 can be finely adjusted multiple times by the fixture 3 according to the offset histogram until a preset effect is achieved to realize the coupling between the mosaic filter 1 and the sensor chip 2.

[0036] Specifically, the operation of coupling the position of the mosaic filter 1 by the fixture 3 according to the offset histogram is as follows: Please refer to Figure 8 , taking the image center as the origin, establish a two-dimensional coordinate system along the width and height directions. Denote the region composed of the coordinates satisfying as , the region satisfying as , and the same for the

[0037] Define the offset vector field The offset vector at the image coordinate is . Denote is the average value of the components of all offset vectors, and is the average value of the components of all offset vectors in the

[0038] Eight precision studs 31 are arranged along four straight lines on the fixture 3. Each pair of precision studs 31 on the same straight line can be adjusted along the direction in the plane component, plane component, plane component, plane component.

[0039] Please refer to Figure 9 . When the mosaic filter 1 has a translation relative to the sensor chip 2, are all not zero. At this time, the two pairs of precision studs 31 of the components are simultaneously pushed along the direction, and the two pairs of precision studs 31 of the components are simultaneously pushed along the direction. For example, in Figure 9 , the two pairs of precision studs 31 of the components are simultaneously pushed along the direction.

[0040] Please refer to Figure 10 . When the mosaic filter 1 has a rotation relative to the sensor chip 2, and are all not zero. At this time, the precision studs 31 of the plane components are pushed along the direction, the precision studs 31 of the plane components are pushed along the direction, the precision studs 31 of the plane components are pushed along the direction, and the precision studs 31 of the plane components are pushed along the direction. For example, in Figure 10 , according to the direction, the two pairs of precision studs 31 of the components are pushed.

[0041] By repeating the above operation logic according to the observed offset vector distribution until the offset meets the expectation. When the coupling between the mosaic filter 1 and the sensor chip 2 reaches the expectation, the UV glue is cured by an ultraviolet lamp, and then the sensor chip 2 is removed from the fixture 3. The present invention can perform real-time detection on the coupling effect of the entire sensor area and give feedback, and achieve precise coupling of the entire mosaic filter 1 and the entire sensor area through the fixture 3, with a coupling error not exceeding one-tenth of a pixel.

[0042] Compared with the prior art, the present invention can calculate the offset by registering according to the reference gray value distribution map and multiple sub-sensor images, so as to couple the mosaic filter at the pixel level rather than the quasi-pixel level, without sacrificing the spatial resolution of the image and wasting the pixels of the sensor chip. The present invention uses an external patch method to couple the mosaic filter and the sensor chip, with lower requirements for the process and the sensor chip, and can adapt to different production lines. By adopting the method of real-time monitoring the sensor output to judge the coupling effect, it can ensure what you see is what you get, and the coupling effect is the effect of the actual sensor used. Compared with using a microscope for area-by-area calibration, the present invention can perform real-time detection on the coupling effect of the entire sensor area and give feedback, and achieve precise coupling of the entire mosaic filter and the entire sensor area through the fixture, with a coupling error not exceeding one-tenth of a pixel.

[0043] Embodiment 2 The embodiment of the present invention also provides a coupling system for a mosaic filter and a sensor chip. Please refer to Figure 11 , Figure 11 which is a schematic structural diagram of a coupling system 200 for a mosaic filter and a sensor chip provided by the embodiment of the present invention, and includes: 201. An installation module for fixing the mosaic filter and the sensor chip; 202. A calibration module for obtaining calibration data of the mosaic filter and calculating a reference gray value distribution map according to the calibration data; In the embodiment of the present invention, the calibration module 202 includes the following units: 2021. A channel gray value calculation unit for calculating the gray value of each channel of the mosaic filter according to preset conditions in combination with the calibration data to obtain a plurality of channel gray value data; 2022. An arrangement unit for arranging the plurality of channel gray value data according to the arrangement order of the respective channels of the mosaic filter to obtain the reference gray value distribution map.

[0044] 203. A segmentation module for obtaining a sensor image and dividing the sensor image into a plurality of sub-sensor images at a preset interval; 204. A registration module, configured to perform registration based on the reference gray value distribution map and multiple sub-sensor images to obtain an offset histogram; wherein, the offset histogram includes a horizontal histogram and a vertical histogram. In an embodiment of the present invention, the registration module 204 includes the following units: 2041. An offset distribution module, configured to calculate the offset amounts of the gray value distribution of the sub-sensor image and the reference gray value distribution map in the horizontal and vertical directions through an image registration algorithm to obtain offset distribution data. 2042. A coordinate calculation module, configured to calculate according to the coordinates of each region in the sub-sensor image and the offset distribution data to obtain the offset histogram.

[0045] 205. An adjustment module, configured to adjust the position of the mosaic filter according to the offset histogram through a fixture to achieve the coupling between the mosaic filter and the sensor chip.

[0046] The coupling system 200 of the mosaic filter and the sensor chip can implement the steps in the coupling method of the mosaic filter and the sensor chip in the above embodiment, and can achieve the same technical effects. Refer to the description in the above embodiment, and details are not described herein again.

[0047] Embodiment III An embodiment of the present invention further provides a computer device. Please refer to Figure 12 , Figure 12 which is a schematic structural diagram of the computer device provided by the embodiment of the present invention. The computer device 300 includes: a memory 302, a processor 301, and a coupling program of the mosaic filter and the sensor chip stored on the memory 302 and executable on the processor 301.

[0048] The processor 301 calls the coupling program of the mosaic filter and the sensor chip stored in the memory 302 to execute the steps in the coupling method of the mosaic filter and the sensor chip provided by the embodiment of the present invention. Please refer to Figure 1 , which specifically includes the following steps: S1. Fix the mosaic filter and the sensor chip.

[0049] In an embodiment of the present invention, the four corners of the mosaic filter 1 contain UV glue (ultraviolet curable glue) of glass microbeads 4 with a size of several micrometers. It is placed on the sensor chip 2 and fixed through a fixture 3. The fixture 3 includes a precision stud 31 and a fixture outer frame 32. The present invention realizes an external patch method by using the fixture 3, thereby coupling the mosaic filter 1 and the sensor chip 2, with lower requirements for the process and the sensor chip 2, and can adapt to different production lines.

[0050] The jig 3 is used to adjust the position of the mosaic filter 1. The jig 3 clamps the mosaic filter 1 located above the sensor chip 2 through eight precision studs 31, and the position of the mosaic filter 1 can be adjusted by changing the advancement of the precision studs 31. The driving device of the jig 3 is not shown. A micrometer head can be used for manual driving, or a servo motor can be connected for driving.

[0051] S2. Obtain the calibration data of the mosaic filter 1, and calculate the reference gray value distribution map according to the calibration data; In the embodiment of the present invention, the reference gray value distribution map refers to the gray value distribution map when the mosaic filter 1 and the sensor chip 2 are successfully coupled.

[0052] The calibration data includes light source spectral data (collected by a spectrometer), the transmittance of each channel of the mosaic filter 1 of the channel (calculated by collection and calculation by a spectrometer), the transmittance of the narrowband filter (calculated by collection and calculation by a spectrometer), the sensor quantum efficiency (given by the sensor manufacturer) and the cut-off film band range .

[0053] In the embodiment of the present invention, in step S2, the following sub-steps are included: S21. Calculate the gray value of each channel of the mosaic filter 1 to obtain a plurality of channel gray value data; S22. Arrange the plurality of channel gray value data according to the arrangement order of each channel of the mosaic filter 1 to obtain the reference gray value distribution map .

[0054] In the embodiment of the present invention, the channel gray value data is calculated according to the following preset conditions: ; wherein, represents the channel gray value data of the i th channel of the mosaic filter 1, represents the minimum cut-off film band range, represents the maximum cut-off film band range, represents the light source spectral data, represents the transmittance of the narrowband filter, represents the i th channel transmittance of the mosaic filter 1, represents the sensor quantum efficiency.

[0055] S3. Obtain a sensor image and divide the sensor image into a plurality of sub - sensor images at a preset interval.

[0056] In an embodiment of the present invention, the sensor image is divided into a plurality of sub - sensor images along the width and height directions at a preset interval .

[0057] S4. Perform registration according to the reference gray - value distribution map and the plurality of sub - sensor images to obtain an offset histogram; wherein, the offset histogram includes a horizontal histogram and a vertical histogram; In an embodiment of the present invention, define the number of pixels of the longest side of the sub - sensor image as , when the rotation angle between the mosaic filter 1 and the sensor chip 2 is less than , it can be considered that the local gray - value distribution of the sub - sensor image relative to the reference gray - value distribution map only has offsets in the horizontal and vertical directions .

[0058] In step S4, the following sub - steps are included: S41. Calculate the offset amounts of the gray - value distribution of the sub - sensor image and the reference gray - value distribution map in the horizontal and vertical directions through an image registration algorithm to obtain offset distribution data. Specifically, the image registration algorithm can be a registration algorithm such as the optical flow method (Optical Flow), the phase cross - correlation method (Phase Cross - Correlation), etc.

[0059] S42. Calculate according to the coordinates of each region in the sub - sensor image and the offset distribution data to obtain the offset histogram. Specifically, when the distribution range of the offset distribution in a certain dimension is large, it reflects that there is a rotation between the mosaic filter 1 and the sensor chip 2, and it can be corrected by pushing a precision stud 31 on one side of the fixture 3. When the offset distribution in a certain dimension is concentrated but the mean value is not 0, it reflects that there is a translation of the mosaic filter 1 in this dimension, and it can be corrected by simultaneously pushing two precision studs 31 on one side of the fixture 3 in the direction of this dimension.

[0060] S5. Adjust the position of the mosaic filter 1 according to the offset histogram through the fixture 3 to realize the coupling between the mosaic filter 1 and the sensor chip 2.

[0061] In an embodiment of the present invention, the position of the mosaic filter 1 can be finely adjusted multiple times by the fixture 3 according to the offset histogram until a preset effect is achieved, realizing the coupling between the mosaic filter 1 and the sensor chip 2.

[0062] By repeating the above operation logic according to the observed offset vector distribution until the offset meets the expectation. When the coupling between the mosaic filter 1 and the sensor chip 2 reaches the expectation, the UV glue is cured by an ultraviolet lamp, and then the sensor chip 2 is removed from the fixture 3. The present invention can detect the coupling effect of the entire sensor area in real time and give feedback, and realize the precise coupling of the entire mosaic filter 1 and the entire sensor area through the fixture 3, with the coupling error not exceeding one-tenth of a pixel.

[0063] The computer device 300 provided in the embodiment of the present invention can implement the steps in the coupling method of the mosaic filter and the sensor chip in the above embodiment, and can achieve the same technical effect. Refer to the description in the above embodiment, and details are not described here again.

[0064] Embodiment 4 The embodiment of the present invention further provides a computer-readable storage medium, on which a coupling program for the mosaic filter and the sensor chip is stored. When the coupling program for the mosaic filter and the sensor chip is executed by a processor, it realizes each process and step in the coupling method of the mosaic filter and the sensor chip provided in the embodiment of the present invention, and can achieve the same technical effect. To avoid repetition, details are not described here again.

[0065] Those of ordinary skill in the art can understand that all or part of the processes of implementing the above embodiment methods can be completed by instructing relevant hardware through a computer program. The program can be stored in a computer-readable storage medium. When the program is executed, it can include the processes of the above method embodiments. Among them, the storage medium can be a magnetic disk, an optical disk, a read-only memory (ROM), or a random access memory (RAM), etc.

[0066] It should be noted that in this article, the term "including", "comprising" or any other variant thereof is intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements not only includes those elements, but also includes other elements not explicitly listed, or further includes elements inherent to such process, method, article or device. Without more limitations, the element defined by the statement "including one..." does not exclude the existence of another identical element in the process, method, article or device including the element.

[0067] Through the description of the above embodiments, those skilled in the art can clearly understand that the above-described example methods can be implemented by means of software plus a necessary general hardware platform. Of course, they can also be implemented by hardware, but in many cases, the former is a better implementation. Based on such an understanding, the technical solution of the present invention, in essence, or the part that contributes to the prior art can be embodied in the form of a software product. This computer software product is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk), and includes several instructions for causing a terminal (which can be a mobile phone, computer, server, air conditioner, or network device, etc.) to execute the methods described in various embodiments of the present invention.

[0068] The embodiments of the present invention have been described above in conjunction with the accompanying drawings. What is disclosed is only the preferred embodiments of the present invention. However, the present invention is not limited to the above specific embodiments. The above specific embodiments are merely illustrative and not restrictive. Under the inspiration of the present invention, those of ordinary skill in the art can also make many equivalent changes in form without departing from the purpose of the present invention and the scope protected by the claims, and all of them fall within the protection scope of the present invention.

Claims

1. A coupling method between a mosaic filter and a sensor chip, characterized in that It includes the following steps: S1. Fix the mosaic filter plate to the sensor chip; S2. Obtain the calibration data of the mosaic filter plate, and calculate the reference gray value distribution map according to the calibration data; S3. Obtain the sensor image, and divide the sensor image into multiple sub-sensor images at a preset interval; S4. Register according to the reference gray value distribution map and the multiple sub-sensor images to obtain an offset histogram; wherein, the offset histogram includes a horizontal histogram and a vertical histogram; S5. Adjust the position of the mosaic filter plate according to the offset histogram through a fixture to realize the coupling between the mosaic filter plate and the sensor chip.

2. The coupling method of the mosaic filter and the sensor chip according to claim 1, characterized in that, The calibration data includes light source spectral data, the transmittance corresponding to each channel of the mosaic filter plate, the transmittance of the narrowband filter, the sensor quantum efficiency, and the cut-off wavelength range of the cut-off filter.

3. The coupling method of the mosaic filter and the sensor chip according to claim 2, characterized in that, In step S2, it includes the following sub-steps: S21. Combine the calibration data, and calculate the gray value of each channel of the mosaic filter plate according to preset conditions to obtain multiple channel gray value data; S22. Arrange the multiple channel gray value data according to the arrangement order of each channel of the mosaic filter plate to obtain the reference gray value distribution map.

4. The coupling method of the mosaic filter and the sensor chip according to claim 3, wherein The channel gray value data is calculated according to the following preset conditions: ； Among them, represents the channel gray value data of the i th channel of the mosaic filter represents the minimum cut-off filter band range, represents the maximum cut-off filter band range, represents the light source spectrum data, represents the transmittance of the narrowband filter, represents the i th channel transmittance of the mosaic filter, represents the sensor quantum efficiency.

5. The coupling method of the mosaic filter and the sensor chip according to claim 1, wherein In step S4, it includes the following sub-steps: S41. Calculate the offset amounts of the gray value distribution of the sub-sensor image and the reference gray value distribution map in the horizontal and vertical directions through an image registration algorithm to obtain offset distribution data; S42. Calculate according to the coordinates of each region in the sub-sensor image and the offset distribution data to obtain the offset histogram.

6. A coupling system of a mosaic filter and a sensor chip, characterized in that It includes: An installation module for fixing the mosaic filter plate to the sensor chip; A calibration module for obtaining the calibration data of the mosaic filter plate and calculating the reference gray value distribution map according to the calibration data; A segmentation module for obtaining the sensor image and dividing the sensor image into multiple sub-sensor images at a preset interval; A registration module for registering according to the reference gray value distribution map and the multiple sub-sensor images to obtain an offset histogram; wherein, the offset histogram includes a horizontal histogram and a vertical histogram; An adjustment module for adjusting the position of the mosaic filter plate according to the offset histogram through a fixture to realize the coupling between the mosaic filter plate and the sensor chip.

7. The coupling system of the mosaic filter and the sensor chip according to claim 6, characterized in that The calibration module includes the following units: A channel gray value calculation unit for combining the calibration data and calculating the gray value of each channel of the mosaic filter plate according to preset conditions to obtain multiple channel gray value data; An arrangement unit for arranging the multiple channel gray value data according to the arrangement order of each channel of the mosaic filter plate to obtain the reference gray value distribution map.

8. The coupling system of the mosaic filter and the sensor chip according to claim 6, wherein The registration module includes the following units: An offset distribution module for calculating the offset amounts of the gray value distribution of the sub-sensor image and the reference gray value distribution map in the horizontal and vertical directions through an image registration algorithm to obtain offset distribution data; A coordinate calculation module, configured to calculate according to the coordinates of each region in the sub-sensor image and the offset distribution data to obtain the offset histogram.

9. A computer device, characterized in that, Comprising: A memory, a processor, and a coupling program of a mosaic filter and a sensor chip stored on the memory and executable on the processor. When the processor executes the coupling program of the mosaic filter and the sensor chip, the steps in the coupling method of the mosaic filter and the sensor chip as described in any one of claims 1-5 are implemented.

10. A computer-readable storage medium, characterized in that, A coupling program of a mosaic filter and a sensor chip is stored on the computer-readable storage medium. When the coupling program of the mosaic filter and the sensor chip is executed by a processor, the steps in the coupling method of the mosaic filter and the sensor chip as described in any one of claims 1-5 are implemented.

Images