Spectral chip, spectral imaging method thereof and electronic equipment

Abstract

The invention provides a spectrum chip, a spectrum imaging method thereof and electronic equipment, the spectrum chip comprises a plurality of photosensitive areas, each photosensitive area comprises a plurality of first photosensitive groups and a second photosensitive group, each first photosensitive group comprises a plurality of first photosensitive units, the first photosensitive units are used for sensing optical signals of a first wavelength, and the second photosensitive groups are used for sensing optical signals of a second wavelength. The optical signal of the first wavelength is visible light; the second photosensitive group comprises a plurality of second photosensitive units, the second photosensitive units are used for sensing optical signals of a second wavelength, the second wavelength is different from the first wavelength, and at least two second photosensitive units are used for sensing optical signals of different wavelengths. A plurality of first photosensitive groups for accurately sensing visible light and a second photosensitive group consisting of a plurality of second photosensitive units capable of sensing optical signals with different wavelengths and different from the first wavelengths are arranged in each photosensitive area of the spectrum chip, so that clear images with rich spectrum information can be obtained.

Description

Technical Field

[0001] The present invention relates to the technical field of spectral imaging, and in particular to a spectral chip and a spectral imaging method and electronic equipment thereof. Background Art

[0002] In spectral imaging technology, RGB chips and multispectral chips each have their own advantages and limitations. RGB chips can achieve higher spatial resolution, thus ensuring a higher level of image clarity, but the spectral information they capture is relatively limited and it is difficult to meet the demand for wider spectral information. Multispectral chips can provide rich spectral information and cover a wider spectral range, but their spatial resolution is lower, which results in lower imaging clarity. Summary of the invention

[0003] The embodiments of the present invention provide a spectral chip and a spectral imaging method and electronic device thereof, which can obtain clear images with rich spectral information and can improve the problems in related technologies.

[0004] In a first aspect, an embodiment of the present invention provides a spectral chip, comprising a plurality of photosensitive areas, each of the photosensitive areas comprising:

[0005] A plurality of first photosensitive groups, each of which comprises a plurality of first photosensitive units, the first photosensitive units are used to sense a light signal of a first wavelength, and the light signal of the first wavelength is visible light; and

[0006] The second photosensitive group includes a plurality of second photosensitive units, wherein the second photosensitive units are used to sense light signals of a second wavelength, the second wavelength is different from the first wavelength, and at least two of the second photosensitive units are used to sense light signals of different wavelengths.

[0007] In one embodiment, each of the first photosensitive groups includes a red light photosensitive unit, a green light photosensitive unit, and a blue light photosensitive unit.

[0008] In one embodiment, the first photosensitive group includes four first photosensitive units, the four first photosensitive units include a red light photosensitive unit, two green light photosensitive units, and one blue light photosensitive unit, the four first photosensitive units are arranged in an array, and the two green light photosensitive units are diagonally disposed.

[0009] In one embodiment, in each of the photosensitive areas, each of the second photosensitive units is used to sense light signals of different wavelengths.

[0010] In one embodiment, the first photosensitive unit and the second photosensitive unit have a similar area.

[0011] In one embodiment, the second photosensitive group includes a plurality of photosensitive subgroups, and the plurality of the first photosensitive groups and the plurality of the photosensitive subgroups are arranged in an array, and in the arrangement direction of the array, the first photosensitive groups and the photosensitive subgroups are alternately arranged in sequence.

[0012] In one embodiment, a light shielding layer is provided on a side of the first photosensitive unit in the first photosensitive group that is adjacent to the photosensitive subgroup and faces the photosensitive subgroup; and / or,

[0013] A light shielding layer is provided on a side of the second photosensitive unit in the photosensitive subgroup that is adjacent to the first photosensitive group and faces the first photosensitive group.

[0014] In one embodiment, the number of the first photosensitive units in each of the first photosensitive groups is the same as the number of the second photosensitive units in each of the photosensitive subgroups.

[0015] In one embodiment, in each of the photosensitive areas, the number of the first photosensitive groups is greater than or equal to the number of the photosensitive subgroups.

[0016] In a second aspect, an embodiment of the present application provides an electronic device comprising a spectral chip as described in any one of the above.

[0017] In one embodiment, the electronic device further includes a control device, which is suitable for fusing a first image acquired through the first photosensitive group and a second image acquired through the second photosensitive group to obtain a multispectral image.

[0018] In a third aspect, an embodiment of the present application provides a spectral imaging method, based on the spectral chip as described in any one of the above, the spectral imaging method includes:

[0019] Acquire a first image through the first photosensitive group, and acquire a second image through the second photosensitive group;

[0020] The first image and the second image are fused to obtain a multispectral image.

[0021] In one embodiment, the second photosensitive group includes a plurality of photosensitive subgroups, the plurality of the first photosensitive groups and the plurality of the photosensitive subgroups are arranged in an array, and in the arrangement direction of the array, the first photosensitive groups and the photosensitive subgroups are arranged alternately in sequence, and the steps of acquiring a first image through the first photosensitive group and acquiring a second image through the photosensitive subgroup adjacent to the first photosensitive group include:

[0022] Acquire a first initial image through the first photosensitive group, and acquire a second initial image through the photosensitive subgroup adjacent to the first photosensitive group;

[0023] performing difference processing on the first initial image based on the grayscale value of the second initial image to obtain the first image,

[0024] Based on the grayscale value of the first initial image, difference processing is performed on the second initial image to obtain the second image.

[0025] Beneficial effects of the embodiments of the present invention:

[0026] In an embodiment of the present invention, the spectral chip includes multiple photosensitive areas, each of which includes multiple first photosensitive groups and second photosensitive groups. Multiple first photosensitive units in the multiple first photosensitive groups sense visible light. By accurately sensing visible light, the clarity of the image can be effectively guaranteed. The multiple second photosensitive units in the second photosensitive group can sense light signals different from the first wavelength, and at least two second photosensitive units sense light signals of different wavelengths. This enables the spectral chip to capture a wider range of spectral information and cover a wider spectral range. That is, in an embodiment of the present invention, by setting multiple first photosensitive groups for accurately sensing visible light in each photosensitive area of ​​the spectral chip, and a second photosensitive group composed of multiple second photosensitive units that can sense light signals of different wavelengths and different from the first wavelength, a clear image with rich spectral information can be obtained. BRIEF DESCRIPTION OF THE DRAWINGS

[0027] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative work.

[0028] Figure 1 is a three-dimensional schematic diagram of a first structure of a spectral chip provided by an embodiment of the present invention;

[0029] Figure 2 yes Figure 1 A schematic top view of a first structure of a spectral chip;

[0030] Figure 3 is a top view schematic diagram of a second structure of a spectral chip provided by an embodiment of the present invention;

[0031] Figure 4 is a top view schematic diagram of a third structure of a spectral chip provided by an embodiment of the present invention;

[0032] Figure 5 is a top view schematic diagram of a fourth structure of a spectral chip provided by an embodiment of the present invention;

[0033] Figure 6is a first flow chart of a spectral imaging method provided by an embodiment of the present invention;

[0034] Figure 7 It is a second flow chart of the spectral imaging method provided by an embodiment of the present invention.

[0035] Description of Figure Numbers:

[0036] 100, spectral chip; 101, photosensitive area; 1, first photosensitive group; 11, first photosensitive unit; 2, second photosensitive group; 21, second photosensitive unit; 22, photosensitive subgroup; 3, light shielding layer. DETAILED DESCRIPTION

[0037] The technical solutions in the embodiments of the present invention will be described clearly and completely below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments in the present invention, all other embodiments obtained by those skilled in the art without creative work are within the scope of protection of the present invention. In addition, it should be understood that the specific implementation methods described herein are only used to illustrate and explain the present invention, and are not used to limit the present invention. In the present invention, unless otherwise specified, the directional words used, such as "upper" and "lower", generally refer to the upper and lower parts of the device in actual use or working state, specifically the drawing direction in the drawings; while "inside" and "outside" refer to the outline of the device.

[0038] Combine the following Figures 1 to 5 Describe the spectral chip of the present application, Figure 1 is a three-dimensional schematic diagram of a first structure of a spectral chip provided by an embodiment of the present invention, Figure 2 is a top view of a first structure of a spectral chip provided by an embodiment of the present invention, Figure 3 is a top view of a second structure of a spectral chip provided by an embodiment of the present invention, Figure 4 is a top view of a third structure of a spectral chip provided by an embodiment of the present invention, Figure 5 It is a top view of the fourth structure of the spectral chip provided by an embodiment of the present invention.

[0039] Reference Figure 1 and Figure 2 The spectral chip 100 includes a plurality of photosensitive areas 101, each of which includes a plurality of first photosensitive groups 1 ( Figure 1 and Figure 2 It is shown that each photosensitive area 101 includes two first photosensitive groups 1) and a second photosensitive group 2, and each first photosensitive group 1 includes a plurality of first photosensitive units 11 ( Figure 1 and Figure 2It is shown that each first photosensitive group 1 includes four first photosensitive units 11), the first photosensitive unit 11 is used to sense a light signal of a first wavelength, and the light signal of the first wavelength is visible light; the second photosensitive group 2 includes a plurality of second photosensitive units 21 ( Figure 1 and Figure 2 Eight second photosensitive units 21 are schematically shown in the figure. The second photosensitive units 21 are used to sense light signals of a second wavelength, which is different from the first wavelength. At least two second photosensitive units 21 are used to sense light signals of different wavelengths.

[0040] In the spectral chip 100 of the present invention, each photosensitive area 101 includes multiple groups of first photosensitive groups 1 and second photosensitive groups 2. The multiple first photosensitive units 11 in the multiple first photosensitive groups 1 sense visible light. The precise sensing of visible light can effectively ensure the clarity of the image. The multiple second photosensitive units 21 in the second photosensitive group 2 can sense light signals different from the first wavelength, and at least two second photosensitive units 21 sense light signals of different wavelengths. This enables the spectral chip 100 to capture a wider range of spectral information and cover a wider spectral range. That is, in the spectral chip 100 of the present invention, by setting multiple groups of first photosensitive groups 1 for precise sensing of visible light in each photosensitive area 101 of the spectral chip 100, and the second photosensitive group 2 composed of multiple second photosensitive units 21 that can sense light signals of different wavelengths and different from the first wavelength, a clear image rich in spectral information can be obtained.

[0041] It can be understood that each first photosensitive group 1 includes multiple first photosensitive units 11, and the first photosensitive unit 11 is used to sense the light signal of the first wavelength. The first photosensitive group 1 can be a sensor combination covering different visible spectrum bands. For example, the multiple first photosensitive units 11 include cyan light sensitive units, yellow light sensitive units, magenta light sensitive units, etc.

[0042] In one embodiment, see Figure 2 , Figure 3 , Figure 4 or Figure 5, each first photosensitive group 1 includes a red light photosensitive unit, a green light photosensitive unit, and a blue light photosensitive unit. In this embodiment, the plurality of first photosensitive units 11 include a red (R) light photosensitive unit, a green (G) light photosensitive unit, and a blue (B) light photosensitive unit. In view of the fact that the human visual system mainly relies on red, green, and blue cone cells to perceive colors, the use of RGB photosensitive units can directly simulate the human eye's perception mode of color, thereby allowing the image to more realistically reproduce the colors in nature. The RGB color model belongs to the most commonly used color space in digital image processing. The use of the RGB photosensitive unit design can simplify the subsequent image processing process. Today, most modern displays are based on the RGB primary color principle. Images captured using RGB photosensitive units can be directly and efficiently displayed on these devices without complicated conversion operations. In these devices, each pixel is composed of three sub-pixels of red, green, and blue. This layout can efficiently utilize space and achieve high-resolution imaging. In addition, RGB sensor technology is already quite mature, which results in a relatively low manufacturing cost for related hardware. That is, in this embodiment, by directly setting the photosensitive units corresponding to the three primary colors of human vision, RGB color information can be directly obtained, ensuring that the image reaches a high level in color reproduction and clarity, providing a clear visual presentation basis for the image, and simplifying the image processing process and reducing production costs.

[0043] In one embodiment, see Figure 2 , Figure 3 , Figure 4 or Figure 5 , the first photosensitive group 1 includes four first photosensitive units 11, the four first photosensitive units 11 include a red light photosensitive unit, two green light photosensitive units, and a blue light photosensitive unit, the four first photosensitive units 11 are arranged in an array, and the two green light photosensitive units are set diagonally. In this embodiment, the human eye is more sensitive to green light than other colors. Based on this characteristic, two green light photosensitive units are set in the first photosensitive group 1. The diagonal setting method can cover the image area more widely on the two-dimensional plane and collect green light information from different angles. When collecting images, the color details including green can be captured more comprehensively, so that the green-related color transition in the image is more natural, and the color balance of the image is improved. In addition, this optimized color sampling structure increases the collection points of effective color information per unit area, which helps to improve the spatial resolution of the image, further enhance the image clarity, and make the picture details richer and more realistic.

[0044] In one embodiment, see Figure 2 , Figure 3 , Figure 4 or Figure 5In each photosensitive area 101, each second photosensitive unit 21 is used to sense light signals of different wavelengths. In this embodiment, each second photosensitive unit 21 senses light signals of different wavelength ranges, so that the spectral chip 100 can capture more dispersed light signals of different wavelength ranges. This can greatly broaden the spectral range that the spectral chip 100 can sense, collect more types of spectral information, and provide a basis for obtaining images rich in spectral information. For example, Figure 2 In the figure, eight second photosensitive units 21 are provided, and the eight second photosensitive units 21 correspond to eight channels (B4, B5, B6, B7, B8, B9, B10, B11), plus the three channels (B1, B2, B3) corresponding to the first photosensitive group 1, there are eleven channels in total.

[0045] In one embodiment, see Figure 2 , Figure 3 , Figure 4 or Figure 5 , the areas of the first photosensitive unit 11 and the second photosensitive unit 21 are comparable. In this embodiment, the comparable areas of the first photosensitive unit 11 and the second photosensitive unit 21 help reduce the difficulty of manufacturing. In the chip manufacturing process, photosensitive units of similar areas can use more uniform manufacturing process parameters. For example, in the process links such as photolithography and etching, there is no need to make complex process adjustments for photosensitive units of different areas, which simplifies the manufacturing process and reduces the variables and complexity in the manufacturing process. The first photosensitive unit 11 and the second photosensitive unit 21 of similar area are easier to plan and arrange, which helps to reduce the layout clutter that may be caused by differences in the shape and size of the photosensitive units, thereby improving the regularity of the chip layout. When sensing light signals, it helps to make the first photosensitive unit 11 and the second photosensitive unit 21 have relatively consistent light sensing capabilities under the same spatial constraints, which is conducive to the overall balanced sensing of light signals. Whether it is visible light or light of other wavelengths, it can be collected under relatively uniform sensing conditions, which helps to improve the image quality and the accuracy of spectral information.

[0046] In one embodiment, see Figure 2 , Figure 3 , Figure 4 or Figure 5, the second photosensitive group 2 includes a plurality of photosensitive subgroups 22, and a plurality of first photosensitive groups 1 and a plurality of photosensitive subgroups 22 are arranged in an array, and in the arrangement direction of the array, the first photosensitive groups 1 and the photosensitive subgroups 22 are arranged alternately in sequence. In this embodiment, the first photosensitive group 1 is mainly responsible for capturing the spatial information of the image, which determines the clarity of the image; the photosensitive subgroup 22 is mainly responsible for acquiring the spectral information. They are arranged in an array and alternately, and when light is irradiated to the chip, for each tiny area, the first photosensitive group 1 can quickly capture the spatial details of the area, such as the outline and shape of the object, and the adjacent photosensitive subgroup 22 can immediately collect the spectral information of the area. This close combination at the microscopic level enables each image element to have clear spatial information and rich spectral information at the same time during the imaging process, realizing the simultaneous acquisition of high-definition and rich spectral information.

[0047] In one embodiment, see Figure 1 , a light shielding layer 3 (shown in black in the figure) is provided on the side of the first photosensitive unit 11 adjacent to the photosensitive subgroup 22 in the first photosensitive group 1 facing the photosensitive subgroup 22; and / or, a light shielding layer 3 (shown in black in the figure) is provided on the side of the second photosensitive unit 21 adjacent to the first photosensitive group 1 in the photosensitive subgroup 22 facing the first photosensitive group 1. In this embodiment, when light is irradiated to the chip, due to the close distance between each photosensitive unit, the light may be scattered or refracted, resulting in light crosstalk between different photosensitive units. For example, the signal of visible light sensed by the first photosensitive group 1 may interfere with the accurate reception of the light signal of a specific wavelength by the photosensitive subgroup 22, and vice versa. For the first photosensitive unit 11, the light shielding layer 3 can prevent the non-visible light from the direction of the photosensitive subgroup 22 from interfering with its sensing of visible light, thereby ensuring the accuracy of its sensing of visible light. For the second photosensitive unit 21, the shading layer 3 can prevent the visible light from the direction of the first photosensitive group 1 from interfering with its sensing of other wavelength light signals, thereby improving the accuracy of each photosensitive unit sensing the target wavelength light signal, and further improving the clarity of the image and the accuracy of the spectral information.

[0048] In one embodiment, see Figure 2 , Figure 3 , Figure 4 or Figure 5, the number of first photosensitive units 11 in each first photosensitive group 1 is the same as the number of second photosensitive units 21 in each photosensitive subgroup 22 (as schematically shown in the figure, the number of first photosensitive units 11 in each first photosensitive group 1 and the number of second photosensitive units 21 in each photosensitive subgroup 22 are both four). In this embodiment, the number of first photosensitive units 11 in each first photosensitive group 1 is the same as the number of second photosensitive units 21 in each photosensitive subgroup 22, and a balance can be maintained in the chip layout and the design of light signal sensing. From the perspective of data processing, the same number of photosensitive units can simplify the subsequent algorithm design for light signal data processing, facilitate relatively balanced analysis and processing of two different types of light signals (visible light and other wavelength light signals), and help improve image quality and the integration effect of spectral information.

[0049] In one embodiment, see Figure 2 , Figure 3 , Figure 4 or Figure 5 In each photosensitive area 101, the number of first photosensitive groups 1 is greater than or equal to the number of photosensitive subgroups 22 ( Figure 2 and Figure 4 In the embodiment, the number of the first photosensitive groups 1 is equal to the number of the photosensitive subgroups 22, Figure 3 and Figure 5 In the embodiment, the number of the first photosensitive groups 1 is greater than the number of the photosensitive subgroups 22). In the present embodiment, since the first photosensitive group 1 mainly senses visible light, and visible light is essential for ensuring the clarity of the image. A large number of first photosensitive groups 1 can ensure sufficient sensing capability for visible light, thereby better ensuring the clarity of the image. At the same time, on the basis of ensuring sufficient sensing of visible light, the photosensitive subgroup 22 senses light signals of other wavelengths to enrich the spectral information. This quantitative relationship helps to broaden the scope of spectral information collection as much as possible while ensuring the basic quality (clarity) of the image.

[0050] The following specifically introduces four structures of the spectral chip 100 to more clearly illustrate the technical solution of the present application. Figure 1 and Figure 2 ( Figure 2Each first photosensitive group 1 and each photosensitive subgroup 22 are framed by dotted lines, each photosensitive area 101 of the spectral chip 100 of the first structure includes two groups of first photosensitive groups 1 and second photosensitive groups 2, the second photosensitive group 2 includes two photosensitive subgroups 22, the two groups of first photosensitive groups 1 and two photosensitive subgroups 22 form a 2*2 array, each group of first photosensitive groups 1 includes a red light photosensitive unit (see R in the figure, corresponding to channel B1), two green light photosensitive units (see G in the figure, corresponding to channel B2), and a blue light photosensitive unit (see B in the figure, corresponding to channel B3), each photosensitive subgroup 22 includes four second photosensitive units 21, there are eight second photosensitive units 21, each second photosensitive unit 21 is used to sense light signals in different wavelength ranges (corresponding to channels B4, B5, B6, B7, B8, B9, B10, B11), therefore, the spectral chip 100 includes eight channels (see B1, B2, B3...B7, B8 in the figure). Figure 3 ( Figure 3 Each first photosensitive group 1 and each photosensitive subgroup 22 are framed by dotted lines respectively), each photosensitive area 101 of the spectral chip 100 of the second structure includes five groups of first photosensitive groups 1 and second photosensitive groups 2, the second photosensitive group 2 includes four photosensitive subgroups 22, the five groups of first photosensitive groups 1 and four photosensitive subgroups 22 form a 3*3 array, each group of first photosensitive group 1 includes a red light photosensitive unit, two green light photosensitive units, and one blue light photosensitive unit, each photosensitive subgroup 22 includes four second photosensitive units 21, there are a total of sixteen second photosensitive units 21, each second photosensitive unit 21 is used to sense light signals in different wavelength ranges, therefore, the spectral chip 100 includes photosensitive units of nineteen channels (see B1, B2, B3...B18, B19 in the figure). Figure 4 ( Figure 4 Each first photosensitive group 1 and each photosensitive subgroup 22 are framed by dotted lines, each photosensitive area 101 of the spectrum chip 100 of the third structure includes eight groups of first photosensitive groups 1 and second photosensitive groups 2, the second photosensitive group 2 includes eight photosensitive subgroups 22, and the eight groups of first photosensitive groups 1 and eight photosensitive subgroups 22 form a 4*4 array. Each group of first photosensitive groups 1 includes a red light photosensitive unit, two green light photosensitive units, and a blue light photosensitive unit. Each photosensitive subgroup 22 includes four second photosensitive units 21, and there are a total of thirty-two second photosensitive units 21. Each second photosensitive unit 21 is used to sense light signals in different wavelength ranges. Therefore, the spectrum chip 100 includes thirty-five channels of photosensitive units (see B1, B2, B3...B34, B35 in the figure). Figure 5 ( Figure 5Each first photosensitive group 1 and each photosensitive subgroup 22 are framed by dotted lines respectively), each photosensitive area 101 of the spectral chip 100 of the fourth structure includes thirteen first photosensitive groups 1 and second photosensitive groups 2, the second photosensitive group 2 includes twelve photosensitive subgroups 22, the thirteen first photosensitive groups 1 and the twelve photosensitive subgroups 22 form a 5*5 array, each first photosensitive group 1 includes a red light photosensitive unit, two green light photosensitive units, and one blue light photosensitive unit, each photosensitive subgroup 22 includes four second photosensitive units 21, and there are a total of forty-eight second photosensitive units 21, each second photosensitive unit 21 is used to sense light signals in different wavelength ranges, therefore, the spectral chip 100 includes fifty-one channels of photosensitive units (see B1, B2, B3...B50, B51 in the figure).

[0051] According to an embodiment of the second aspect of the present application, an electronic device is provided, including a spectral chip 100. The structure of the spectral chip 100 is as described above. Since the vehicle adopts all the technical solutions of all the above embodiments, it at least has the beneficial effects brought by the technical solutions of the above embodiments, which will not be described one by one here.

[0052] In one embodiment, the electronic device further includes a control device, which is suitable for fusing the first image obtained by the first photosensitive group 1 and the second image obtained by the second photosensitive group 2 to obtain a multispectral image. In this embodiment, the electronic device is provided with a control device for fusing the images obtained by the first and second photosensitive groups, which can realize efficient synthesis of multispectral images. The first image obtained by the first photosensitive group 1 focuses on spatial information, and the second image obtained by the second photosensitive group 2 focuses on spectral information. The control device can quickly and accurately fuse the two, eliminating manual intervention or complex external processing procedures, improving the efficiency of image generation, and allowing users to obtain multispectral images more timely for subsequent analysis or application. Through fusion processing, the control device combines clear spatial details with rich spectral features, making up for the shortcomings of a single image, so that the generated multispectral image not only has a clear outline, but also can accurately reflect the material, composition and other characteristics of the object, and greatly improves the accuracy and reliability of recognition in tasks such as image classification and target recognition. The fused multispectral image enables the electronic device to be applicable to more professional scenarios, thereby significantly broadening the application scope of the electronic device and improving its use value.

[0053] Please refer to Figure 6 and Figure 7 , Figure 6 and Figure 7 is a flow chart of a spectral imaging method provided by an embodiment of the present application. According to an embodiment of the third aspect of the present application, a spectral imaging method is provided. Based on any one of the spectral chips 100 described above, the spectral imaging method includes:

[0054] S100: acquiring a first image through a first photosensitive group 1, and acquiring a second image through a second photosensitive group 2;

[0055] S200: fusing the first image and the second image to obtain a multispectral image.

[0056] In this embodiment, the first photosensitive group 1 obtains a high-resolution visible light image, and the second photosensitive group 2 obtains a low-resolution multispectral image. The high-resolution visible light image and the low-resolution multispectral image are fused to obtain a high-resolution multispectral image. Therefore, by obtaining a first image through the first photosensitive group 1 and obtaining a second image through the second photosensitive group 2, and then fusing the first image and the second image, a clear image with rich spectral information can be obtained.

[0057] In one embodiment, the second photosensitive group 2 includes a plurality of photosensitive subgroups 22, the plurality of first photosensitive groups 1 and the plurality of photosensitive subgroups 22 are arranged in an array, and in the arrangement direction of the array, the first photosensitive groups 1 and the photosensitive subgroups 22 are arranged alternately in sequence, and the step S100 of acquiring the first image through the first photosensitive group 1 and acquiring the second image through the photosensitive subgroup 22 adjacent to the first photosensitive group 1 includes:

[0058] S110: acquiring a first initial image through the first photosensitive group 1, and acquiring a second initial image through the photosensitive subgroup 22 adjacent to the first photosensitive group 1;

[0059] S120: performing difference processing on the first initial image based on the grayscale value of the second initial image to obtain a first image, and performing difference processing on the second initial image based on the grayscale value of the first initial image to obtain a second image.

[0060] In this embodiment, when the first initial image is acquired through the first photosensitive group 1, the area corresponding to the adjacent photosensitive subgroup 22 is considered as missing pixels. At this time, the grayscale value of the second initial image is used to perform difference processing on the missing pixels to obtain the reconstructed first image. Similarly, when the second initial image is acquired through the photosensitive subgroup 22 adjacent to the first photosensitive group 1, the area corresponding to the adjacent first photosensitive group 1 is considered as missing pixels. At this time, the grayscale value of the first initial image is used to perform difference processing on the missing pixels to obtain the reconstructed second image. In other words, for the first initial image, the area corresponding to the adjacent photosensitive subgroup 22 is considered as missing pixels. By performing difference processing on the grayscale value of the second initial image, the possible value of the missing pixel can be inferred based on the existing image information around it, so that the first image is supplemented with reasonable pixel values ​​in the area where the pixels were originally missing, and the integrity of the image is reconstructed. Similarly, for the second initial image, a similar effect can be achieved through the grayscale value of the first initial image to ensure the integrity of the second image. By difference processing to reconstruct the first and second images, the continuity of the images is restored, and the clarity and accuracy of the images are improved. The final image has both clear details brought by high resolution and rich spectral information.

[0061] The embodiments of the present invention are described in detail above. Specific examples are used herein to illustrate the principles and implementation methods of the present invention. The description of the above embodiments is only used to help understand the method of the present invention and its core idea. At the same time, for those skilled in the art, according to the idea of ​​the present invention, there will be changes in the specific implementation methods and application scopes. In summary, the content of this specification should not be understood as limiting the present invention.

Claims

1. A spectral chip, characterized in that: Comprising a plurality of photosensitive areas, each of the photosensitive areas comprises: A plurality of first photosensitive groups, each of which comprises a plurality of first photosensitive units, the first photosensitive units are used to sense a light signal of a first wavelength, and the light signal of the first wavelength is visible light; and The second photosensitive group includes a plurality of second photosensitive units, wherein the second photosensitive units are used to sense light signals of a second wavelength, the second wavelength is different from the first wavelength, and at least two of the second photosensitive units are used to sense light signals of different wavelengths.

2. The spectral chip according to claim 1, characterized in that: Each of the first photosensitive groups includes a red light photosensitive unit, a green light photosensitive unit, and a blue light photosensitive unit.

3. The spectral chip according to claim 2, characterized in that: The first photosensitive group includes four first photosensitive units, the four first photosensitive units include a red light photosensitive unit, two green light photosensitive units, and a blue light photosensitive unit, the four first photosensitive units are arranged in an array, and the two green light photosensitive units are diagonally disposed.

4. The spectral chip according to claim 1, characterized in that: In each of the photosensitive areas, each of the second photosensitive units is used to sense light signals of different wavelengths.

5. The spectral chip according to claim 1, characterized in that: The first photosensitive unit and the second photosensitive unit have a similar area.

6. The spectral chip according to claim 1, characterized in that: The second photosensitive group includes a plurality of photosensitive subgroups, and the plurality of the first photosensitive groups and the plurality of the photosensitive subgroups are arranged in an array, and in the arrangement direction of the array, the first photosensitive groups and the photosensitive subgroups are alternately arranged in sequence.

7. The spectral chip according to claim 6, characterized in that: A light shielding layer is provided on a side of the first photosensitive unit in the first photosensitive group that is adjacent to the photosensitive subgroup and faces the photosensitive subgroup; and / or, A light shielding layer is provided on a side of the second photosensitive unit in the photosensitive subgroup that is adjacent to the first photosensitive group and faces the first photosensitive group.

8. The spectral chip according to claim 6, characterized in that: The number of the first photosensitive units in each of the first photosensitive groups is the same as the number of the second photosensitive units in each of the photosensitive subgroups.

9. The spectral chip according to claim 6, characterized in that: In each of the photosensitive areas, the number of the first photosensitive groups is greater than or equal to the number of the photosensitive subgroups.

10. An electronic device, characterized in that: Comprising the spectral chip as described in any one of claims 1 to 9.

11. The electronic device according to claim 10, characterized in that: The electronic device also includes a control device, which is suitable for fusing a first image acquired through the first photosensitive group and a second image acquired through the second photosensitive group to obtain a multispectral image.

12. A spectral imaging method, based on the spectral chip according to any one of claims 1 to 9, characterized in that: The spectral imaging method comprises: Acquire a first image through the first photosensitive group, and acquire a second image through the second photosensitive group; The first image and the second image are fused to obtain a multispectral image.

13. The spectral imaging method according to claim 12, characterized in that: The second photosensitive group includes a plurality of photosensitive subgroups, the plurality of the first photosensitive groups and the plurality of the photosensitive subgroups are arranged in an array, and in the arrangement direction of the array, the first photosensitive groups and the photosensitive subgroups are arranged alternately in sequence, and the steps of acquiring a first image through the first photosensitive group and acquiring a second image through the photosensitive subgroup adjacent to the first photosensitive group include: Acquire a first initial image through the first photosensitive group, and acquire a second initial image through the photosensitive subgroup adjacent to the first photosensitive group; performing difference processing on the first initial image based on the grayscale value of the second initial image to obtain the first image, Based on the grayscale value of the first initial image, difference processing is performed on the second initial image to obtain the second image.

Images