Spectrally modulated image acquisition system

Abstract

The utility model relates to the field of spectrum modulation image acquisition technology, concretely relates to a spectrum modulation image acquisition system, including the spectrum modulation image acquisition layer and the base connected in proper order from top to bottom, the spectrum modulation image acquisition layer covers all pixel points on the base, the spectrum modulation image acquisition layer is the single period array spliced into by color channel and spectrum modulation channel, and color channel includes a plurality of R channel, a plurality of G channel and a plurality of B channel, and spectrum modulation channel includes n spectrum modulation channels made of different materials, and the spectrum modulation curve of n spectrum modulation channels is different, and the same color channel is not adjacent, and spectrum modulation channel is not adjacent, the part channel of color channel is replaced as spectrum modulation channel in the application, and the ability of image in target information acquisition is improved significantly, not only can provide abundant spectral information, but also enhance the details and level of image.

Description

Technical Field

[0001] This utility model relates to the field of spectral modulation image acquisition technology, and specifically to a spectral modulation image acquisition system. Background Technology

[0002] In the fields of spectral technology and spectral imaging, the joint acquisition of images and spectral information has become a research hotspot. Traditional image acquisition systems mainly rely on the RGB color space, which can effectively capture image information in the visible light range, but has certain limitations in the comprehensive understanding and utilization of spectral features. With the continuous advancement of science and technology, more and more application scenarios are placing higher demands on high-precision image acquisition systems.

[0003] Spectral modulation image acquisition systems, by incorporating multispectral technology, can acquire the spectral information of objects across multiple wavelengths. This system not only captures the geometric shape and texture features of images but also provides in-depth analysis of the physical and chemical properties of objects from a spectral perspective, thereby achieving more accurate target identification and analysis. Compared to traditional RGB images, multispectral images offer more spectral information, revealing object features that are difficult to identify in the visible light range, greatly enriching the image content.

[0004] However, existing spectral imaging technologies still face challenges in the simultaneous acquisition of images and spectra. Many systems sacrifice real-time performance or resolution when acquiring hyperspectral data, making them unsuitable for certain applications. Therefore, developing a system capable of simultaneously acquiring high-quality images and spectral data has become an urgent problem to be solved in the field of spectral imaging. Utility Model Content

[0005] Therefore, the technical problem to be solved by this utility model is to overcome the defects in the prior art, thereby providing a spectral modulation image acquisition system.

[0006] A spectral modulation image acquisition system includes: a spectral modulation image acquisition layer and a substrate connected sequentially from top to bottom, wherein the spectral modulation image acquisition layer covers all pixels on the substrate;

[0007] The spectral modulation image acquisition layer is a single-period array composed of color channels and spectral modulation channels. The color channels include multiple R channels, multiple G channels and multiple B channels. The spectral modulation channels include n spectral modulation channels made of different materials, and the spectral modulation curves of the n spectral modulation channels are different. Color channels of the same type are not adjacent to each other, and spectral modulation channels are not adjacent to each other.

[0008] Furthermore, the spectral modulation channel includes nine spectral modulation channels made of different materials, denoted as C1, C2, C3, C4, C5, C6, C7, C8 and C9, respectively.

[0009] Furthermore, the spectral modulation image acquisition layer is a 10×10 single-period array composed of color channels and spectral modulation channels.

[0010] Furthermore, the spectral modulation image acquisition layer is a 10×10 single-period array composed of color channels and spectral modulation channels, specifically composed of 25 R channels, 25 B channels, 41 G channels and 9 spectral modulation channels.

[0011] C1 is in the same row as C2 and C3, and C1 is in the same column as C4 and C7;

[0012] C2 is in the same column as C5 and C8;

[0013] C3 is in the same column as C6 and C9;

[0014] C4 is on the same line as C5 and C6;

[0015] C7 is in the same row as C8 and C9.

[0016] Furthermore, in the 10×10 single-cycle array, even-numbered rows are interleaved with G and B channels, and odd-numbered rows are interleaved with R and G channels. C1, C2, and C3 replace the G channels in the second, sixth, and tenth columns of the first row, respectively. C4, C5, and C6 replace the G channels in the fifth row that are in the same column as C1, C2, and C3, respectively. C7, C8, and C9 replace the G channels in the ninth row that are in the same column as C1, C2, and C3, respectively.

[0017] Furthermore, the spectral modulation image acquisition layer is a 6×8 single-cycle array composed of color channels and spectral modulation channels.

[0018] Furthermore, the spectral modulation image acquisition layer is a 6×8 single-period array composed of color channels and spectral modulation channels, specifically composed of 12 R channels, 12 B channels, 15 G channels and 9 spectral modulation channels.

[0019] C1 is in the same row as C2 and C3, and C1 and C7 are in the same column;

[0020] C2 and C8 are in the same column;

[0021] C3 and C9 are in the same column;

[0022] C4 is on the same line as C5 and C6;

[0023] C7 is in the same row as C8 and C9.

[0024] Furthermore, in the 6×8 single-cycle array, even-numbered rows are interleaved with G and B channels, and radix-numbered rows are interleaved with R and G channels. C1, C2, and C3 replace the three G channels in the first row, C1, C2, and C3 replace the three G channels in the fourth row, and C7, C8, and C9 replace the three G channels in the ninth row.

[0025] Furthermore, the peak transmittance wavelength of the R channel is 650 nm, T 650 ≥50%, T(575-800)≥10%;

[0026] The peak transmittance wavelength of the G channel is 550 nm, T 550 ≥50%; T(475-650)≥10%;

[0027] The peak transmittance wavelength of the B channel is 450 nm, T 450 ≥45%; T(400-520)≥10%;

[0028] Where Tλ1 is the transmittance at wavelength λ1, T(λ1-λ2) is the transmittance at each wavelength between wavelengths λ1 and λ2, and λ1 / λ2 is in nm.

[0029] Furthermore, the notch transmittance wavelength of C1 is 500-560nm, T(400-500)≥10%, and T(500-800)≥75%.

[0030] The notch transmittance wavelength of C2 is 550-625nm; T(400-550)≥20%; T(550-650)≤20%; T(625-650)≥15%; T(650-800)≥75%;

[0031] The notch transmittance wavelength of C3 is 500-560nm; T(400-500)≥20%; T(500-560)≤25%; T(560-600)≥20%; T(600-800)≥80%;

[0032] The notch transmittance wavelength of C4 is 550-625nm; T(400-550)≥20%; T(550-650)≤20%; T(625-650)≥15%; T(650-800)≥75%;

[0033] The notch transmittance wavelength of the C5 is 25-650nm; T(400-625)≥10%; T(625-650)≤10%; T(650-675)≥10%; T(675-800)≥80%;

[0034] The notch transmittance wavelength of the C6 is 40-660nm; T(400-640)≥1%; T(640-660)≤5%; T(660-700)≥1%; T(700-800)≥82%;

[0035] The notch transmittance wavelength of the C7 is 60-700nm; T(400-660)≥5%; T(660-700)≤5%; T(700-740)≥5%; T(740-800)≥80%;

[0036] The notch transmittance wavelength of the C8 is 70-730nm; T(400-640)≥20%; T(640-730)≤20%; T(730-770)≥15%; T(770-800)≥80%;

[0037] The notch transmittance wavelength of the C9 is 700-750 nm; T(400-700)≥50%; T(700-750)≤50%; T(750-800)≥50%.

[0038] The technical solution of this utility model has the following advantages:

[0039] This application significantly enhances an image's ability to acquire target information by replacing some color channels with spectral modulation channels. It not only provides rich spectral information but also enhances image detail and depth, helping to meet specific application needs. Simultaneously, the introduction of spectral modulation channels captures reflective properties that are difficult to discern in traditional RGB images, which is crucial for distinguishing different objects or regions within an image. The replaced image exhibits superior detail, revealing subtle changes on object surfaces and enhancing visual richness. This refined performance is particularly important for image analysis, helping professionals more accurately identify target objects. Furthermore, this design significantly enhances recognition and analysis capabilities while maintaining image quality. Through spectral modulation channels, image processing algorithms can extract features more effectively, thereby improving the accuracy of target detection and classification. Attached Figure Description

[0040] To more clearly illustrate the specific embodiments of this utility model or the technical solutions in the prior art, the drawings used in the description of the specific embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are some embodiments of this utility model. For those skilled in the art, other drawings can be obtained from these drawings without creative effort.

[0041] Figure 1 This is a schematic diagram of a 10×10 array for acquiring spectral modulation images;

[0042] Figure 2 This is a schematic diagram of a 6×8 array for acquiring spectral modulation images;

[0043] Figure 3 This is a schematic diagram of the response curve of a silicon-based detector;

[0044] Figure 4 A schematic diagram showing the wavelength and transmittance of various color channels;

[0045] Figure 5 This is a schematic diagram of the spectral modulation curves corresponding to each spectral modulation channel. Detailed Implementation

[0046] The technical solution of this utility model will now be clearly and completely described with reference to the accompanying drawings. Obviously, the described embodiments are only some, not all, of the embodiments of this utility model. Based on the embodiments of this utility model, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this utility model.

[0047] In the description of this utility model, it should be noted that the terms "center," "upper," "lower," "left," "right," "vertical," "horizontal," "inner," and "outer," etc., indicating the orientation or positional relationship, are based on the orientation or positional relationship shown in the accompanying drawings and are only for the convenience of describing this utility model and simplifying the description, and do not indicate or imply that the device or element referred to must have a specific orientation, or be constructed and operated in a specific orientation, and therefore should not be construed as a limitation of this utility model. Furthermore, the terms "first," "second," and "third" are used for descriptive purposes only and should not be construed as indicating or implying relative importance.

[0048] In the description of this utility model, it should be noted that, unless otherwise explicitly specified and limited, the terms "installation," "connection," and "joining" should be interpreted broadly. For example, they can refer to a fixed connection, a detachable connection, or an integral connection; they can refer to a mechanical connection or an electrical connection; they can refer to a direct connection or an indirect connection through an intermediate medium; and they can refer to the internal connection of two components. Those skilled in the art can understand the specific meaning of the above terms in this utility model based on the specific circumstances.

[0049] Furthermore, the technical features involved in the different embodiments of this utility model described below can be combined with each other as long as they do not conflict with each other.

[0050] This application aims to achieve efficient simultaneous image and spectrum acquisition, and therefore designs a spectral modulation image acquisition system, comprising: a spectral modulation image acquisition layer and a substrate connected sequentially from top to bottom, wherein the spectral modulation image acquisition layer covers all pixels on the substrate; the substrate is a silicon-based detector, and the response curve of the silicon-based detector is as follows: Figure 3 As shown.

[0051] The spectral modulation image acquisition layer is a single-period array composed of color channels and spectral modulation channels. The color channels include multiple R channels, multiple G channels and multiple B channels. The spectral modulation channels include n spectral modulation channels made of different materials, and the spectral modulation curves of the n spectral modulation channels are different. Color channels of the same type are not adjacent to each other, and spectral modulation channels are not adjacent to each other.

[0052] The spectral modulation channels include nine spectral modulation channels made of different materials, denoted as C1, C2, C3, C4, C5, C6, C7, C8 and C9 respectively.

[0053] The spectral modulation channel is specifically a colloidal curable film made by mixing resin, photoinitiator, pigment, and solvent. The resin includes soluble resins, such as phenolic resins, polyurethane resins, and polyvinyl alcohol resins; and photocurable resins, such as polyimide resins, polyvinyl alcohol resins, and epoxy resins. Photoinitiators include benzophenones, alkyl phenyl ketones, benzoin and its derivatives, and iron aromatic hydrocarbons. Pigments include aniline pigments, phthalocyanine pigments, azo pigments, and pyrrole pigments. Solvents include ethylene glycol methyl ethers, propylene glycol methyl ether acetates, and triethylene glycol methyl ethers. By mixing and processing different materials, different spectral modulation channels are created, thereby achieving different spectral modulation curves for each channel.

[0054] Please see Figure 1 The spectral modulation image acquisition layer is a 10×10 single-period array composed of color channels and spectral modulation channels.

[0055] Specifically, it is composed of 25 R channels, 25 B channels, 41 G channels, and 9 spectral modulation channels. C1 is in the same row as C2 and C3, and C1 is in the same column as C4 and C7; C2 is in the same column as C5 and C8; C3 is in the same column as C6 and C9; C4 is in the same row as C5 and C6; and C7 is in the same row as C8 and C9.

[0056] In the 10×10 single-cycle array, even-numbered rows are interleaved with G and B channels, and odd-numbered rows are interleaved with R and G channels. C1, C2, and C3 replace the G channels in the second, sixth, and tenth columns of the first row, respectively. C4, C5, and C6 replace the G channels in the fifth row that are in the same column as C1, C2, and C3, respectively. C7, C8, and C9 replace the G channels in the ninth row that are in the same column as C1, C2, and C3, respectively.

[0057] Please see Figure 2 In this embodiment, based on the pixel arrangement of conventional carbon-based detectors, the spectral modulation image acquisition layer is designed as a 6×8 single-cycle array composed of color channels and spectral modulation channels.

[0058] Specifically, it is composed of 12 R channels, 12 B channels, 15 G channels and 9 spectral modulation channels; C1 is in the same row as C2 and C3, C1 and C7 are in the same column; C2 and C8 are in the same column; C3 and C9 are in the same column; C4 is in the same row as C5 and C6; C7 is in the same row as C8 and C9.

[0059] Specifically, in the 6×8 single-period array, even-numbered rows alternate between G and B channels, while radix-numbered rows alternate between R and G channels. C1, C2, and C3 replace the three G channels in the first row, respectively; C1, C2, and C3 replace the three G channels in the fourth row, respectively; and C7, C8, and C9 replace the three G channels in the ninth row, respectively. The silicon-based detector has 40,000 periodic structures within its effective pixel range. This ensures improved image brightness resolution, optimized image quality, reduced noise, and conforms to the human eye's sensitivity to different colors, while also obtaining spectral image data of the target.

[0060] In practical applications, other arrangements can be made according to actual needs, which will not be listed here.

[0061] Please see Figure 4 In this embodiment, the peak transmittance wavelength of the R channel is 650 nm, and T... 650 ≥50%, T(575-800)≥10%;

[0062] The peak transmittance wavelength of the G channel is 550 nm, T 550 ≥50%; T(475-650)≥10%;

[0063] The peak transmittance wavelength of the B channel is 450 nm, T 450 ≥45%; T(400-520)≥10%;

[0064] Please see Figure 5The notch transmittance wavelength of C1 is 500-560nm, T(400-500)≥10%, and T(500-800)≥75%.

[0065] The notch transmittance wavelength of C2 is 550-625nm; T(400-550)≥20%; T(550-650)≤20%; T(625-650)≥15%; T(650-800)≥75%;

[0066] The notch transmittance wavelength of C3 is 500-560nm; T(400-500)≥20%; T(500-560)≤25%; T(560-600)≥20%; T(600-800)≥80%;

[0067] The notch transmittance wavelength of C4 is 550-625nm; T(400-550)≥20%; T(550-650)≤20%; T(625-650)≥15%; T(650-800)≥75%;

[0068] The notch transmittance wavelength of the C5 is 25-650nm; T(400-625)≥10%; T(625-650)≤10%; T(650-675)≥10%; T(675-800)≥80%;

[0069] The notch transmittance wavelength of the C6 is 40-660nm; T(400-640)≥1%; T(640-660)≤5%; T(660-700)≥1%; T(700-800)≥82%;

[0070] The notch transmittance wavelength of the C7 is 60-700nm; T(400-660)≥5%; T(660-700)≤5%; T(700-740)≥5%; T(740-800)≥80%;

[0071] The notch transmittance wavelength of the C8 is 70-730nm; T(400-640)≥20%; T(640-730)≤20%; T(730-770)≥15%; T(770-800)≥80%;

[0072] The notch transmittance wavelength of the C9 is 700-750nm; T(400-700)≥50%; T(700-750)≤50%; T(750-800)≥50%.

[0073] Explanation: Tλ1 is the transmittance at wavelength λ1, T(λ1-λ2) is the transmittance at each wavelength between wavelengths λ1 and λ2, and λ1 / λ2 is in nm.

[0074] This application significantly enhances an image's ability to acquire target information by replacing some color channels with spectral modulation channels. It not only provides rich spectral information but also enhances image detail and depth, helping to meet specific application needs. Simultaneously, the introduction of spectral modulation channels captures reflective properties that are difficult to discern in traditional RGB images, which is crucial for distinguishing different objects or regions within an image. The replaced image exhibits superior detail, revealing subtle changes on object surfaces and enhancing visual richness. This refined performance is particularly important for image analysis, helping professionals more accurately identify target objects. Furthermore, this design significantly enhances recognition and analysis capabilities while maintaining image quality. Through spectral modulation channels, image processing algorithms can extract features more effectively, thereby improving the accuracy of target detection and classification.

[0075] Obviously, the above embodiments are merely illustrative examples for clear explanation and are not intended to limit the implementation. Those skilled in the art will recognize that other variations or modifications can be made based on the above description. It is neither necessary nor possible to exhaustively list all possible implementations here. However, obvious variations or modifications derived therefrom are still within the protection scope of this invention.

Claims

1. A spectral modulation image acquisition system, characterized in that, include: The spectral modulation image acquisition layer and the substrate are connected sequentially from top to bottom, and the spectral modulation image acquisition layer covers all pixels on the substrate. The spectral modulation image acquisition layer is a single-period array composed of color channels and spectral modulation channels. The color channels include multiple R channels, multiple G channels and multiple B channels. The spectral modulation channels include n spectral modulation channels made of different materials, and the spectral modulation curves of the n spectral modulation channels are different. Color channels of the same type are not adjacent to each other, and spectral modulation channels are not adjacent to each other.

2. The spectral modulation image acquisition system according to claim 1, characterized in that, The spectral modulation channels include nine spectral modulation channels made of different materials, denoted as C1, C2, C3, C4, C5, C6, C7, C8 and C9 respectively.

3. The spectral modulation image acquisition system according to claim 2, characterized in that, The spectral modulation image acquisition layer is a 10×10 single-period array composed of color channels and spectral modulation channels.

4. The spectral modulation image acquisition system according to claim 3, characterized in that, The spectral modulation image acquisition layer is a 10×10 single-period array composed of color channels and spectral modulation channels, specifically composed of 25 R channels, 25 B channels, 41 G channels and 9 spectral modulation channels. C1 is in the same row as C2 and C3, and C1 is in the same column as C4 and C7; C2 is in the same column as C5 and C8; C3 is in the same column as C6 and C9; C4 is on the same line as C5 and C6; C7 is in the same row as C8 and C9.

5. The spectral modulation image acquisition system according to claim 4, characterized in that, In the 10×10 single-cycle array, even-numbered rows are interleaved with G and B channels, and odd-numbered rows are interleaved with R and G channels. C1, C2, and C3 replace the G channels in the second, sixth, and tenth columns of the first row, respectively. C4, C5, and C6 replace the G channels in the fifth row that are in the same column as C1, C2, and C3, respectively. C7, C8, and C9 replace the G channels in the ninth row that are in the same column as C1, C2, and C3, respectively.

6. The spectral modulation image acquisition system according to claim 2, characterized in that, The spectral modulation image acquisition layer is a 6×8 single-cycle array composed of color channels and spectral modulation channels.

7. The spectral modulation image acquisition system according to claim 6, characterized in that, The spectral modulation image acquisition layer is a 6×8 single-period array composed of color channels and spectral modulation channels, specifically composed of 12 R channels, 12 B channels, 15 G channels and 9 spectral modulation channels. C1 is in the same row as C2 and C3, and C1 and C7 are in the same column; C2 and C8 are in the same column; C3 and C9 are in the same column; C4 is on the same line as C5 and C6; C7 is in the same row as C8 and C9.

8. The spectral modulation image acquisition system according to claim 7, characterized in that, In the 6×8 single-cycle array, even-numbered rows are interleaved with G and B channels, and radix-numbered rows are interleaved with R and G channels. C1, C2, and C3 replace the three G channels in the first row, C1, C2, and C3 replace the three G channels in the fourth row, and C7, C8, and C9 replace the three G channels in the ninth row.

9. The spectral modulation image acquisition system according to claim 1, characterized in that, The peak transmittance wavelength of the R channel is 650 nm, T 650 ≥50%, T(575-800)≥10%; The peak transmittance wavelength of the G channel is 550 nm, T 550 ≥50%; T(475-650)≥10%; The peak transmittance wavelength of the B channel is 450 nm, T 450 ≥45%; T(400-520)≥10％； Where Tλ1 is the transmittance at wavelength λ1, T(λ1-λ2) is the transmittance at each wavelength between wavelengths λ1 and λ2, and λ1 / λ2 is in nm.

10. The spectral modulation image acquisition system according to claim 9, characterized in that, The notch transmittance wavelength of C1 is 500-560nm, T(400-500)≥10%, T(500-800)≥75%; The notch transmittance wavelength of C2 is 550-625nm; T(400-550)≥20％； T(550-650)≤20%; T(625-650)≥15%; T(650-800)≥75%; The notch transmittance wavelength of C3 is 500-560nm; T(400-500)≥20%; T(500-560)≤25%; T(560-600)≥20%; T(600-800)≥80％； The notch transmittance wavelength of C4 is 550-625nm; T(400-550)≥20％； T(550-650)≤20%; T(625-650)≥15%; T(650-800)≥75%; The notch transmittance wavelength of the C5 is 25-650nm; T(400-625)≥10%; T(625-650)≤10%; T(650-675)≥10%; T(675-800)≥80%; The notch transmittance wavelength of the C6 is 40-660nm; T(400-640)≥1%; T(640-660)≤5%; T(660-700)≥1%; T(700-800)≥82%; The notch transmittance wavelength of the C7 is 60-700nm; T(400-660)≥5%; T(660-700)≤5%; T(700-740)≥5%; T(740-800)≥80%; The notch transmittance wavelength of the C8 is 70-730nm; T(400-640)≥20%; T(640-730)≤20%; T(730-770)≥15%; T(770-800)≥80％； The notch transmittance wavelength of the C9 is 700-750nm; T(400-700)≥50%; T(700-750)≤50%; T(750-800)≥50%.

Images