Image sensor, camera module and electronic device

Abstract

The application provides an image sensor, a camera module and an electronic device. The image sensor comprises a circuit layer, a pixel layer, a filter array and a microlens array which are sequentially stacked; the filter array comprises a plurality of first filter units, each first filter unit comprises 2N rows * 2N columns of multispectral units, 2N columns of multispectral units are arranged horizontally in the first filter unit, and 2N rows of multispectral units are arranged vertically, wherein N >= 2, the first filter unit comprises more than 4 kinds of multispectral units, by designing the filter array, the N*2N region framed in the horizontal direction and the vertical direction with any multispectral unit as the starting point is all the same type of multispectral unit, the distribution uniformity of different types of multispectral units in the filter array is improved, which is conducive to improving the authenticity of imaging and improving the color restoration effect.

Description

Technical Field

[0001] This application relates to the field of imaging equipment technology, specifically to an image sensor, camera module, and electronic device. Background Technology

[0002] A typical three-channel camera mimics the cone cells of the human eye, possessing three response curves for color reproduction. However, the spectral response curves differ from those of the human eye, making it difficult to reproduce certain colors and impossible to reproduce certain color differences. Therefore, multispectral cameras were introduced.

[0003] Multispectral cameras can use filter arrays to filter various types of visible light to achieve better color reproduction. However, the arrangement of different filter materials in the filter array is not conducive to image processing, resulting in poor color reproduction in multispectral cameras. Summary of the Invention

[0004] This application provides an image sensor, a camera module, and an electronic device. The image sensor includes a circuit layer, a pixel layer, a filter array, and a microlens array stacked sequentially; the filter array includes multiple first filter units, each first filter unit comprising 2N rows. The first filter array has 2N columns of multispectral units arranged horizontally and 2N rows of multispectral units arranged vertically, where N ≥ 2. The first filter array includes at least four types of multispectral units. The filter array is designed so that, starting from any multispectral unit, N rows are selected horizontally and vertically. The 2N region contains the same type of multispectral units, which improves the uniformity of the distribution of different types of multispectral units in the filter array, which is beneficial to improving the realism of the image and thus improving the color reproduction effect.

[0005] In a first aspect, this application provides an image sensor. The image sensor includes a circuit layer, a pixel layer, a filter array, and a microlens stacked sequentially. Visible light can pass sequentially through the microlens and the filter array to the pixel layer, where it is converted into an electrical signal. The circuit layer processes the electrical signal. The filter array includes a plurality of first filter units arranged in an array, each first filter unit comprising 2N rows arranged in the array. The filter array consists of 2N columns of multispectral units, where N ≥ 2. The first filter unit includes at least four types of multispectral units, with different types used to filter different colors of light. Starting from any one of the multispectral units, the array comprises 2N rows. The first region consists of N columns of multispectral units, and N rows... The second region comprises 2N columns of multispectral units. The types of multispectral units in the first region are the same as those in the second region. The image sensor has multiple multispectral channels, each corresponding to a multispectral unit. These channels include the i-th, j-th, and m-th multispectral channels. The i-th and j-th multispectral channels are arranged in the same row, and the i-th and m-th multispectral channels are arranged in the same column. There is a N-1 channel interval between the i-th and j-th multispectral channels, and a N-1 channel interval between the i-th and m-th multispectral channels. Here, i, j, and m are all less than or equal to N. 2N; any two of the i-th multispectral channel, j-th multispectral channel, and m-th multispectral channel satisfy the following: |λ1-λ2|≤30nm; Wherein, λ1 is the wavelength corresponding to the peak value of the response curve of one of the i-th, j-th, and m-th multispectral channels, and λ2 is the wavelength corresponding to the peak value of the response curve of the other of the i-th, j-th, and m-th multispectral channels.

[0006] In this application, by designing that the types of multispectral units in the first region are the same as those in the second region, so that at least some types of multispectral units are repeatedly set, not only can the problem of difficulty in selecting a sufficient variety of filter materials be overcome, but also the distribution of different types of multispectral units can be ensured to be uniform, which is beneficial to the realism of the image and thus facilitates better color reproduction.

[0007] In this application, by setting the i-th, j-th, and m-th multispectral channels to have similar or identical response curve distributions, the i-th, j-th, and m-th multispectral channels can have similar or identical conversion efficiencies for light. This is beneficial for the image sensor to extract information from the i-th, j-th, and m-th multispectral channels for output when performing point-by-point image output, thereby achieving better imaging quality.

[0008] In this application, the i-th multispectral channel, the j-th multispectral channel, and the m-th multispectral channel satisfy the above conditions so that the response curves of the i-th multispectral channel, the j-th multispectral channel, and the m-th multispectral channel have similar peak distributions, which is beneficial to make the response degree of the corresponding light between the i-th multispectral channel, the j-th multispectral channel, and the m-th multispectral channel tend to be consistent.

[0009] In some possible implementations, any two of the i-th multispectral channel, j-th multispectral channel, and m-th multispectral channel satisfy the following: |A1 / A2-1|≤30%; Where A1 is the sensitivity of one of the i-th, j-th, and m-th multispectral channels, and A2 is the sensitivity of the other of the i-th, j-th, and m-th multispectral channels.

[0010] It should be noted that sensitivity, also known as light conversion efficiency, represents the efficiency of light conversion and can be represented by the area of ​​the integral of the response curve. Under the same energy of white light illumination, a multispectral channel with higher sensitivity can obtain more photons, naturally resulting in a larger signal value. Specifically, in an image sensor, the response curve of each multispectral channel can be represented by the visible light response curve of the corresponding pixel for that multispectral channel. The transmittance of a multispectral unit to visible light is represented.

[0011] In this implementation, the i-th, j-th, and m-th multispectral channels satisfy the above conditions so that the response curves of the i-th, j-th, and m-th multispectral channels are similar in distribution and have approximately equal sensitivity. This ensures that the i-th, j-th, and m-th multispectral channels have equal or similar conversion efficiencies for light, as well as equal or similar conversion efficiencies for light of similar or the same wavelength band.

[0012] In some possible implementations, any two of the i-th multispectral channel, j-th multispectral channel, and m-th multispectral channel satisfy the following: , ; Where QE1(n) represents the response curve of one of the i-th, j-th, and m-th multispectral channels, and n1 and n2 are the ordinates of QE1(n) with k as the ordinate. QE1(λ1) represents the two abscissas; QE2(n) represents the response curve of one of the i-th, j-th, and m-th multispectral channels, and n3 and n4 are the ordinates of QE2(n) with k as the abscissa. The two x-coordinates corresponding to QE2(λ2) are 0 < k < 20%.

[0013] In this implementation, the i-th multispectral channel, the j-th multispectral channel, and the m-th multispectral channel satisfy the above relationship so that the i-th multispectral channel, the j-th multispectral channel, and the m-th multispectral channel have approximately or identical response curves and sensitivities, which is beneficial for outputting images with lower resolution when the camera module is in a low power consumption state.

[0014] In some possible implementations, the image sensor is used to output an image based on the electrical signals of the i-th multispectral channel, the j-th multispectral channel, and the m-th multispectral channel.

[0015] In this implementation, since the i-th, j-th, and m-th multispectral channels have similar or identical response curves and sensitivities, when outputting image data, only the i-th, j-th, and m-th multispectral channels can be sampled, and the output can contain only the electrical signals of the i-th, j-th, and m-th multispectral channels. This allows for low-power output images by reducing the resolution of the output image, and the signal distribution in different multispectral channels is uniform, ensuring the performance of coarse image recognition. For example, QR code detection can be achieved in low-power mode.

[0016] In some possible implementations, the first filter unit includes two first filter areas and two second filter areas, and each of the first and second filter areas has N rows. There are N columns of multispectral units. Two first filter regions are arranged along one diagonal of the first filter region, and two second filter regions are arranged along the other diagonal of the first filter region. The types and order of multispectral units in one first filter region are the same as those in the other first filter region. The types and order of multispectral units in one second filter region are the same as those in the other second filter region.

[0017] In this implementation, since the first filter unit is evenly and regularly distributed, it is beneficial to output a low-resolution image. Moreover, in the subsequent image processing flow, it is also beneficial to perform de-mosaic processing on the image.

[0018] In some possible implementations, the image sensor is used to: read the electrical signals of multiple multispectral channels corresponding to multiple first filter areas, average the electrical signals of multiple multispectral channels corresponding to each first filter area to obtain an average value, and output the average value; it is also used to read the electrical signals of multiple multispectral channels corresponding to multiple second filter areas, average the electrical signals of multiple multispectral channels corresponding to each second filter area to obtain an average value, and output the average value.

[0019] In this implementation, for some scenarios where color reproduction is not required and low resolution is needed for coarse recognition, this implementation can be used to reduce the resolution. The two multispectral channels are symmetrically distributed and have less color information, which can significantly reduce the image resolution, which is beneficial for achieving low-power output images and uniform image distribution.

[0020] In some possible implementations, the first filter unit includes D types of multispectral units, where D = 2N. 2N / M, M≥2, where M is the number of times the multispectral unit of each type is repeated in each first filter unit.

[0021] In this implementation, by repeatedly setting the types of multispectral units, the types of multispectral units with different light transmittances in the first filter unit are appropriate, which can overcome the problem of not being able to select a sufficient variety of filter materials.

[0022] In some possible implementations, multiple multispectral channels include multiple statistical channels used for brightness statistics. In each first filter unit, multiple statistical channels are arranged adjacent to each other, and the sensitivity of multiple statistical channels in the multiple multispectral channels is greater than the sensitivity of other multispectral channels.

[0023] In this implementation, by centrally setting up statistical channels with higher sensitivity, it is beneficial for the electronic device to perform brightness statistics during automatic exposure, and it is also beneficial for the path design of the electronic device.

[0024] In some possible implementations, the first filter unit includes 4 rows There are 4 columns of multispectral units. In each first filter unit, there are 8 types of multispectral units. Each type of multispectral unit is repeated twice, which can make the different types of multispectral units in the first filter unit evenly distributed, which is beneficial to improving the imaging effect.

[0025] In some possible implementations, the first filter unit includes different types of first multispectral units, second multispectral units, third multispectral units, fourth multispectral units, fifth multispectral units, sixth multispectral units, seventh multispectral units, and eighth multispectral units; The first multispectral unit satisfies the following: the peak wavelength of light transmittance corresponds to a wavelength between 515nm and 550nm, and the transmittance T12 for light with a wavelength range of 525nm to 560nm is ≥80%; The second multispectral unit satisfies the following: the peak wavelength of light transmittance corresponds to the wavelength between 440nm and 460nm, and the transmittance T21 for light with a wavelength range of 400nm to 480nm is ≥60%; The third multispectral unit satisfies the following: the peak light transmittance corresponds to a wavelength between 525nm and 560nm, and the transmittance T32 for light with a wavelength range of 500nm to 575nm is ≥80%; The fourth multispectral unit satisfies the following: the peak wavelength of light transmittance corresponds to a wavelength between 440 nm and 510 nm, and the transmittance T41 for light with a wavelength range of 415 nm to 420 nm is ≥ 80%; The fifth multispectral unit satisfies the following: the peak wavelength of light transmittance is greater than or equal to 510 nm, and the transmittance T52 for light in the wavelength range of 510 nm to 540 nm is ≥90%; The sixth multispectral unit satisfies the following: the peak wavelength of light transmittance is greater than or equal to 620 nm, and the transmittance T63 for light in the wavelength range of 620 nm to 1000 nm is ≥90%; The seventh multispectral unit satisfies the following: the peak wavelength of light transmittance is greater than or equal to 600 nm, and the transmittance T72 for light in the wavelength range of 600 nm to 1000 nm is ≥90%; The eighth multispectral unit satisfies the following: the peak wavelength of light transmittance corresponds to the wavelength between 440nm and 465nm, and the transmittance T81 for light with a wavelength range of 445nm to 465nm is ≥80%.

[0026] In some possible implementations, the first multispectral unit satisfies the following: transmittance T11 ≤ 10% for light in the wavelength range of 400 nm to 456 nm, transmittance T13 ≤ 10% for light in the wavelength range of 630 nm to 665 nm, and transmittance T14 ≥ 90% for light in the wavelength range of 850 nm to 1000 nm. The second multispectral unit satisfies the following conditions: transmittance T22≤40% for light in the wavelength range of 495nm to 510nm, transmittance T23≤10% for light in the wavelength range of 525nm to 700nm, and transmittance T14≥90% for light in the wavelength range of 830nm to 1000nm. The third multispectral unit satisfies the following conditions: transmittance T31 ≤ 10% for light in the wavelength range of 400nm to 465nm, transmittance T33 ≤ 10% for light in the wavelength range of 650nm to 750nm, and transmittance T34 ≥ 95% for light in the wavelength range of 850nm to 1000nm. The fourth multispectral unit satisfies the following conditions: transmittance T42 ≤ 15% for light in the wavelength range of 590nm to 715nm, and transmittance T43 ≥ 90% for light in the wavelength range of 780nm to 1000nm; The fifth multispectral unit satisfies the following conditions: transmittance T51 ≤ 10% for light in the wavelength range of 400 nm to 470 nm, and transmittance T53 ≥ 95% for light in the wavelength range of 540 nm to 1000 nm; The sixth multispectral unit satisfies the following conditions: transmittance T61 ≥ 60% for light in the wavelength range of 400nm to 460nm, and transmittance T62 ≤ 10% for light in the wavelength range of 530nm to 570nm. The seventh multispectral unit satisfies the following condition: transmittance T71 ≤ 10% for light in the wavelength range of 400 nm to 570 nm; The eighth multispectral unit satisfies the following: transmittance T82 ≥ 60% for light in the wavelength range of 400nm to 485nm, transmittance T83 ≤ 10% for light in the wavelength range of 540nm to 775nm, and transmittance T84 ≥ 90% for light in the wavelength range of 830nm to 1000nm.

[0027] In this implementation, the eight multispectral units satisfy the above conditions to ensure that the multispectral units cannot be linearly fitted by other filter materials. Applying these eight multispectral units to the camera module results in minimal color difference during color reproduction, achieving a color difference of less than 2. Furthermore, the combination of these eight multispectral units, through algorithm simulation, achieves a superior signal-to-noise ratio.

[0028] The first and third multispectral units have similar light transmittance curves, and the multispectral channels corresponding to the first and third multispectral units have similar response curves. This ensures that the multispectral channels corresponding to the first and third multispectral units have similar or identical response curves and sensitivities. Therefore, when outputting image data, only the multispectral channels corresponding to the first and third multispectral units can be sampled, and the output only contains the electrical signals of the multispectral channels corresponding to the first and third multispectral units. This reduces the resolution of the output image, achieving low-power output, and ensures uniform signal distribution in different multispectral channels, thus guaranteeing the performance of coarse image recognition.

[0029] In some possible implementations, the filter array further includes a plurality of second filter units arranged in an array, the plurality of second filter units being arranged around at least a portion of a plurality of first filter units.

[0030] In this implementation, color reproduction is achieved through the first filter unit, and other functions (e.g., imaging) are achieved through the second filter unit. This allows the filter array to achieve hybrid filtering, making the image sensor a hybrid image sensor with multiple functions. This enables multi-functional applications of the image sensor, thereby realizing the multi-functional composite of the camera module. Since the first and second filter units are integrated into the same image sensor, they can share components such as the bracket, lens, and filters, achieving a miniaturized design of the camera module. This allows the electronic device to not only have multiple shooting and / or imaging functions but also improve the overall space utilization and achieve a thinner and lighter design.

[0031] In some possible implementations, there is a gap of O second filter units between two adjacent first filter units, where O ≥ 0. Where O ≥ 0, there is no gap of second filter units between two adjacent first filter units when O is 0.

[0032] In some possible implementations, line P P columns of first filter units are arranged adjacently to form a first multispectral set, and S second filter units are spaced apart between two adjacent first multispectral sets, where S≥0.

[0033] In this implementation, by abutting multiple first filter units to form a first multispectral set, the density of multispectral units is increased, which is beneficial for the multispectral units to filter more light, so that the multispectral channels can receive more optical signals and improve signal processing quality.

[0034] In some possible implementations, there is a gap of T second filter units between two adjacent multispectral units, where T ≥ 0.

[0035] When T=0, there is no second filter unit between two adjacent multispectral units. When T>0, a second filter unit is set between two adjacent multispectral units to disperse the multispectral units, which helps to improve the uniformity of the distribution of multispectral units in the filter array.

[0036] In some possible implementations, the area of ​​a single multispectral unit is U times the area of ​​a single second filter unit, where U = c 2 , c≥1.

[0037] In this implementation, the area of ​​a single multispectral unit is the same as that of a single sub-unit, which is beneficial for layout design. The area of ​​a single multispectral unit can be U times the area of ​​a single second filter unit, where c≥2. This design can increase the area of ​​a single multispectral unit, enabling it to filter more light, thereby allowing the image sensor to receive more light signals in the multispectral channels corresponding to the multispectral unit, which is beneficial for color reproduction.

[0038] Secondly, this application provides a camera module. The camera module includes a lens, a bracket, a circuit assembly, and an image sensor as described in the first aspect. The image sensor and the bracket are both mounted on the circuit assembly, and the lens is mounted on the bracket, with the lens and image sensor facing each other.

[0039] In this application, by designing the filter array in the image sensor, the realism of the image sensor's imaging and the color reproduction effect are improved, thereby improving the shooting effect of the camera module.

[0040] In some possible implementations, the camera module also includes a filter, which is positioned between the image sensor and the lens.

[0041] In this implementation, the filter is used to filter light. The filter can be used to filter infrared light, ultraviolet light, or visible light, etc. The specific filter can be adjusted according to the actual application and is not limited here.

[0042] Among them, the filter can achieve zoned filtering. Specifically, the filter can include multiple filtering areas, and different filtering areas are used to filter light of different wavelengths to achieve zoned filtering. The specific settings can be adjusted according to the actual application and are not limited here.

[0043] Thirdly, an electronic device is provided. The electronic device includes an image processor and a camera module as described in any of the second aspects, the image processor being communicatively connected to the camera module, and the image processor being used to acquire image data from the camera module and process the image data.

[0044] In this application, the shooting effect of the camera module is improved by designing the image sensor in the camera module, thereby improving the shooting effect of the electronic device and enhancing the user experience of the electronic device. Attached Figure Description

[0045] Figure 1A This is a schematic diagram of the structure of the electronic device provided in some embodiments of this application; Figure 1B yes Figure 1A A partially exploded structural diagram of the electronic device shown. Figure 2 yes Figure 1B The diagram shows a schematic representation of the camera module in some embodiments of the electronic device shown. Figure 3 yes Figure 2 The diagram shows a partial structural exploded view of the camera module in some embodiments. Figure 4 yes Figure 3 The diagram shows the structure of the image sensor in some embodiments of the camera module shown. Figure 5 yes Figure 4 The diagram shows a filter array in an image sensor in some embodiments; Figure 6 yes Figure 5 A schematic diagram of the first filter unit in the filter array shown in some embodiments; Figure 7A yes Figure 3 A schematic diagram of the image sensor in the camera module shown in some other embodiments; Figure 7B yes Figure 7A The image sensor shown is a schematic diagram of its layer structure from another perspective. Figure 8 yes Figure 7A A schematic diagram of the first filter unit in some embodiments of the image sensor shown; Figure 9A yes Figure 8 The diagram shows the response curves of the multispectral channels corresponding to the multispectral unit in some embodiments. Figure 9B yes Figure 8 The first filter unit shown is a schematic diagram of a point-by-point output method in some embodiments; Figure 10 yes Figure 3 A schematic diagram of the image sensor in the camera module shown in some other embodiments; Figure 11A yes Figure 10 A schematic diagram of the first filter unit in some embodiments of the image sensor shown; Figure 11B yes Figure 11A The first filter unit shown is a schematic diagram illustrating the averaging method used in some embodiments; Figure 12A yes Figure 3 A schematic diagram of the first filter unit of the image sensor in the camera module shown in some other embodiments; Figure 12B yes Figure 3 A schematic diagram of the first filter unit of the image sensor in the camera module shown in some other embodiments; Figure 13A yes Figure 3 A schematic diagram of the first filter unit of the image sensor in the camera module shown in some other embodiments; Figure 13B Figure 3 A schematic diagram of the first filter unit of the image sensor in the camera module shown in some other embodiments; Figure 14A yes Figure 3 A schematic diagram of the first filter unit of the image sensor in the camera module shown in some other embodiments; Figure 14B yes Figure 3 A schematic diagram of the first filter unit of the image sensor in the camera module shown in some other embodiments; Figure 15A yes Figure 3 A schematic diagram of the first filter unit of the image sensor in the camera module shown in some other embodiments; Figure 15B yes Figure 3 A schematic diagram of the first filter unit of the image sensor in the camera module shown in some other embodiments. Figure 16A yes Figure 3A schematic diagram of the image sensor in the camera module shown in some other embodiments; Figure 16B yes Figure 16A The image sensor shown is a schematic diagram of the layer structure at another row of the first filter unit. Figure 17 yes Figure 16A A schematic diagram of the first filter unit in some embodiments of the image sensor shown; Figure 18 yes Figure 3 A schematic diagram of the filter array in the image sensor of the camera module shown in some other embodiments; Figure 19 yes Figure 3 A schematic diagram of the filter array in the image sensor of the camera module shown in some other embodiments; Figure 20 yes Figure 3 A schematic diagram of the filter array in the image sensor of the camera module shown in some other embodiments; Figure 21 yes Figure 3 A schematic diagram of the filter array in the image sensor of the camera module shown in some other embodiments; Figure 22 yes Figure 3 A schematic diagram of the filter array in the image sensor of the camera module shown in some other embodiments; Figure 23 yes Figure 3 A schematic diagram of the filter array in the image sensor of the camera module shown in some other embodiments; Figure 24 yes Figure 3 A schematic diagram of the filter array in the image sensor of the camera module shown in some other embodiments; Figure 25 yes Figure 3 A schematic diagram of the filter array in the image sensor of the camera module shown in some other embodiments; Figure 26 yes Figure 3 A schematic diagram of the filter array in the image sensor of the camera module shown in some other embodiments; Figure 27 yes Figure 3 The diagram shows a structural schematic of the filter array in the image sensor of the camera module in some other embodiments. Detailed Implementation

[0046] The embodiments of this application are described below with reference to the accompanying drawings.

[0047] In the description of the embodiments of this application, it should be noted that, unless otherwise explicitly specified and limited, the terms "installation" and "connection" should be interpreted broadly. For example, "connection" can be a detachable connection or a non-detachable connection; it can be a direct connection or an indirect connection through an intermediate medium. "Multiple" refers to at least two.

[0048] The directional terms mentioned in the embodiments of this application, such as "upper", "lower", "inner", "outer", "top", "bottom", "side", etc., are only for reference to the directions in the accompanying drawings. Therefore, the directional terms used are for better and clearer explanation and understanding of the embodiments of this application, and are not intended to indicate or imply that the device or element referred to must have a specific orientation, or be constructed and operated in a specific orientation. Therefore, they should not be construed as limitations on the embodiments of this application.

[0049] In the embodiments of this application, the relative positional relationships mentioned, such as parallel, perpendicular, and aligned, are defined in relation to the current technological level, rather than being absolutely strict. Slight deviations are permissible; approximations of parallelism, perpendicularity, or alignment are all acceptable. For example, "A and B are parallel" means that A and B are parallel or approximately parallel, and the angle between A and B can be between 0 and 10 degrees. Similarly, "A and B are perpendicular" means that A and B are perpendicular or approximately perpendicular, and the angle between A and B can be between 80 and 100 degrees.

[0050] In the embodiments of this application, the terms "first," "second," "third," and "fourth" are used for descriptive purposes only and should not be construed as indicating or implying relative importance or implicitly specifying the number of indicated technical features. Thus, a feature defined with "first," "second," "third," and "fourth" may explicitly or implicitly include one or more of that feature.

[0051] Please refer to the following: Figure 1A and Figure 1B , Figure 1A This is a schematic diagram of the structure of the electronic device 100 provided in some embodiments of this application; Figure 1B yes Figure 1A A partially exploded structural diagram of the electronic device 100 shown.

[0052] In some embodiments, the electronic device 100 may be a mobile phone, tablet personal computer, laptop computer, smart screen, personal digital assistant (PDA), camera, personal computer, laptop computer, in-vehicle equipment, wearable device, augmented reality (AR) glasses, AR helmet, virtual reality (VR) glasses, or VR helmet, or other devices with camera functions. Figure 1A In this embodiment, the electronic device 100 is a mobile phone as an example for description. Of course, other types of electronic devices 100 can also adopt a similar structure, which will not be described in detail below.

[0053] Understandable Figure 1A and Figure 1B The electronic device 100 is shown only schematically, and the actual shape, size, location, and construction of these components are not subject to change. Figure 1A and Figure 1B Due to limitations, electronic device 100 may also include, compared to Figure 1A and Figure 1B More or fewer parts.

[0054] In some embodiments, the electronic device 100 may include a camera module 10, a screen 20, and a housing 30. The screen 20 is used to display images, videos, etc. The screen 20 may include a light-transmitting panel 201 and a display screen 202. The light-transmitting panel 201 and the display screen 202 are stacked and fixedly connected. The light-transmitting panel 201 mainly serves to protect the display screen 202 from dust. The material of the light-transmitting panel 201 includes, but is not limited to, glass. The display screen 202 may be a flexible display screen or a rigid display screen. For example, the display screen 202 can be an organic light-emitting diode (OLED) display screen, an active-matrix organic light-emitting diode (AMOLED) display screen, a mini organic light-emitting diode (MLED) display screen, a micro organic light-emitting diode (MOLED) display screen, a quantum dot light-emitting diode (QLED) display screen, a liquid crystal display (LCD) display screen, etc.

[0055] For example, the housing 30 is used to protect the internal electronic components of the electronic device 100. The housing 30 may include a cover plate 301, a frame 302, and a camera trim 303. The cover plate 301 is located on the side of the display screen 202 away from the light-transmitting panel 201, and is stacked with the light-transmitting panel 201 and the display screen 202. The frame 302 is fixed to the cover plate 301. For example, the frame 302 can be fixedly connected to the cover plate 301 by adhesive. The frame 302 may also be integrally formed with the cover plate 301, that is, the frame 302 and the cover plate 301 are a single structure. The frame 302 is located between the cover plate 301 and the light-transmitting panel 201. The light-transmitting panel 201 can be fixed to the frame 302 by adhesive. The light-transmitting panel 201, the cover plate 301, and the frame 302 form an internal accommodating space of the electronic device 100. This internal accommodating space houses the display screen 202. The cover plate 301 can be made of materials such as metal, plastic, or glass. The cover plate 301 can be a plate made of a single material or a plate structure made of multiple materials and spliced ​​from multiple plates. The cover plate 301 is provided with a mounting opening 3011, and the camera decorative piece 303 covers and is fixed to the mounting opening 3011.

[0056] For example, camera module 10 is used to capture photos / videos. For example, camera module 10 is mounted within housing 30, located within the internal accommodating space of electronic device 100. Camera module 10 can be used as a rear-facing camera. For example, the light-incident surface of camera module 10 faces camera trim 303. Camera trim 303 is used to protect camera module 10.

[0057] In some embodiments, the camera trim 303 protrudes from the side of the cover plate 301 away from the light-transmitting panel 201. This increases the mounting space for the camera module 10 in the thickness direction of the electronic device 100. In other embodiments, the camera trim 303 may be flush with the cover plate 301 or recessed into the internal accommodating space of the electronic device 100.

[0058] The camera decorative element 303 has a light-transmitting hole 3031. The light-transmitting hole 3031 allows light from objects to enter the light-receiving surface of the camera module 10. In some other embodiments, the electronic device 100 may not include the camera decorative element 303. In this case, the cover plate 301 no longer has a mounting opening 3011, but the light-transmitting hole 3031 is provided on the cover plate 301, allowing light from objects to enter the light-receiving surface of the camera module 10.

[0059] In some embodiments, the camera module 10 can also be used as a front-facing camera. For example, the light-incident surface of the camera module 10 faces the light-transmitting panel 201. The display screen 202 is provided with a light-path obstruction hole. This light-path obstruction hole allows light from the scene to pass through the light-transmitting panel 201 and then enter the light-incident surface of the camera module 10. In some embodiments, the electronic device 100 may also include one or more other camera modules (not shown in the figures), which are not strictly limited in this application.

[0060] In some embodiments, such as Figure 1B As shown, the electronic device 100 may further include a circuit assembly 40 and an image processor 50, which are located within the internal accommodating space of the electronic device 100. The image processor 50 is fixed to and electrically connected to the circuit assembly 40. The image processor 50 is communicatively connected to the camera module 10. The image processor 50 is used to acquire image data from the camera module 10 and process the image data. The communication connection between the camera module 10 and the image processor 50 may include data transmission via electrical connections such as wiring, or data transmission via coupling. It is understood that the camera module 10 and the image processor 50 may also be connected via other methods capable of data transmission.

[0061] In some embodiments, the electronic device 100 may further include an analog-to-digital converter (also known as an A / D converter, not shown in the figure). The analog-to-digital converter is connected between the camera module 10 and the image processor. The analog-to-digital converter is used to convert the signal generated by the camera module 10 into a digital image signal and transmit it to the image processor, which then processes the digital image signal and finally displays the image or video on the screen 20.

[0062] In some embodiments, the electronic device 100 may further include a memory (not shown in the figure), which is communicatively connected to an image processor. The image processor processes the digital image signal and then transmits the image to the memory, so that the image can be retrieved from the memory and displayed on the screen 20 at any time when it is needed to view the image later. In some embodiments, the image processor may also compress the processed digital image signal before storing it in the memory to save memory space.

[0063] In some other embodiments, the electronic device 100 may also not include the screen 20.

[0064] Understandable Figure 1A and Figure 1B The installation position of the camera module 10 in the illustrated embodiment of the electronic device 100 is merely illustrative, and this application does not strictly limit the installation position of the camera module 10. In some other embodiments, the camera module 10 may also be installed in other locations on the electronic device 100, such as the upper middle or upper right corner of the back of the electronic device 100. In some other embodiments, the electronic device 100 may include a terminal body and an auxiliary component that can rotate, move, or be detached relative to the terminal body, and the camera module 10 may also be disposed on the auxiliary component.

[0065] Please refer to the following: Figure 2 and Figure 3 , Figure 2 yes Figure 1B A schematic diagram of the camera module 10 in some embodiments of the electronic device 100 shown; Figure 3 yes Figure 2 The image shown is a partial exploded view of the camera module 10 in some embodiments.

[0066] Understandable Figure 2 and Figure 3 The images shown are only schematic representations of some of the components included in the camera module 10. The actual shape, size, position, and construction of these components are not subject to change. Figure 2 and Figure 3 Due to limitations, camera module 10 can also include, compared to Figure 2 and Figure 3 More or fewer parts.

[0067] In some embodiments, the camera module 10 may include an image sensor 1, a first circuit board 2, a second circuit board 3, a connector 4, a filter 5, a bracket 6, and a lens 7. The image sensor 1 and the bracket 6 are both mounted on the first circuit board 2, and the second circuit board 3 is mounted between the first circuit board 2 and the connector 4. The connector 4 can be a board-to-board (BTB) connector, serving as a port for connecting the camera module 10 to the electronic device 100. The first circuit board 2 provides the peripheral circuitry required for the image sensor 1 to operate. The second circuit board 3 can be a flexible printed circuit board (FPC), serving as a flexible wire circuit connecting the first circuit board 2 and the connector 4. The lens 7 is mounted on the bracket 6, and the filter 5 is mounted between the lens 7 and the image sensor 1. The bracket 6 is used to fix the lens 7, the lens 7 is used for focusing light for imaging, the filter 5 is used to filter light, and the image sensor 1 is used to sense light information.

[0068] For example, filter 5 can be used to filter infrared light, ultraviolet light, or visible light, etc. The specific type can be adjusted according to the actual application, and is not limited here.

[0069] The filter 5 can achieve zoned filtering. Specifically, the filter 5 may include multiple filtering regions, with different filtering regions used to filter light of different wavelengths to achieve zoned filtering. The specific configuration can be adjusted according to the actual application and is not limited here. It should be noted that in some other embodiments, one or more of the multiple filtering regions may have no filtering function.

[0070] Please refer to the following: Figure 4 and Figure 5 , Figure 4 yes Figure 3 A schematic diagram of the image sensor 1 in some embodiments of the camera module 10 shown; Figure 5 yes Figure 4 The image sensor 1 shown is a schematic diagram of the filter array 13 in some embodiments.

[0071] In some embodiments, the image sensor 1 may include a circuit layer 11, a pixel layer 12, a filter array 13, and a microlens array 14 stacked sequentially. The microlens array 14 is used to focus light. The filter array 13 is used to filter light, and may include four or more filter materials, each with a different transmittance; in this case, the image sensor 1 is also called a multispectral sensor. The pixel layer 12 is used to receive light and convert the optical signal into an electrical signal. The circuit layer 11 is used to process and transmit the electrical signal. In other words, light can pass sequentially through the microlens array 14, the filter array 13, and the pixel layer 12, where it is converted into an electrical signal, and the circuit layer 11 processes the electrical signal.

[0072] For example, the microlens array 14 may include multiple microlenses 141, the filter array 13 may include multiple multispectral units 1311, and the pixel layer 12 may include multiple pixels 121. The image sensor 1 may have multiple multispectral channels 15, each multispectral channel 15 corresponding to one microlens 141, one multispectral unit 1311, and one pixel 121, and different multispectral channels 15 corresponding to different microlenses 141, multispectral units 1311, and pixels 121.

[0073] The microlens array 14 can remove the microlens 141 corresponding to a certain multispectral channel 15 to avoid overexposure.

[0074] The filter array 13 can achieve different transmittances through methods such as single-layer dyes, multi-layer dye stacking, coatings, gratings, and microstructures, thereby filtering more than four types of light. It should be noted that different types of light refer to light in different wavelength bands.

[0075] It should be noted that, Figure 4 The dashed box in the middle represents the multispectral channel 15 of the image sensor 1. Different types of multispectral units 1311 in the filter array 13 are represented by different symbols; this is understandable. Figure 4 The symbol corresponding to the multispectral unit 1311 does not limit its type and location. In other embodiments, there are other design types and locations.

[0076] Please refer to the following: Figure 5 and Figure 6 , Figure 6 yes Figure 5 The first filter unit 131 in the filter array 13 shown is illustrated in some embodiments.

[0077] In some embodiments, the filter array 13 includes a plurality of first filter units 131 arranged in an array, each first filter unit 131 including 2N rows arranged in an array. There are 2N columns of multispectral units 1311, where N≥2. The first filter unit 131 includes more than four types of multispectral units 1311, and different types of multispectral units 1311 are used to filter visible light of different colors. In the filter array 13, starting from any one multispectral unit 1311, 2N rows are formed. N multispectral units 1311 are in the first region 132, N rows The second region 133 consists of 2N multispectral units 1311. The types of multispectral units 1311 in the first region 132 are the same as those in the second region 133. Different types of multispectral units 1311 are different types of filter materials, which can achieve different light transmittance.

[0078] It should be noted that the multiple first filter units 131 configured in the array are all identical. Figure 5 The part highlighted by the thick solid line is a first filter unit 131. Figure 5 and Figure 6 Different types of multispectral units 1311 are illustrated using different symbols, which is understandable. Figure 5 and Figure 6 The illustration only shows one arrangement of different types of multispectral units 1311. In other embodiments, the types of multispectral units 1311 may include more or fewer, and different types of multispectral units 1311 may be arranged in other ways, as long as they conform to the arrangement rules of this embodiment.

[0079] It should be noted that, Figure 5 and Figure 6 The diagram uses N=2 as an example. Figure 5 and Figure 6 The first filter unit 131 shown does not limit the value of N. Understandably, N can also be other values ​​greater than 2.

[0080] In this embodiment, by designing that the types of multispectral units 1311 in the first region 132 are the same as those in the second region 133, so that at least some types of multispectral units 1311 are repeatedly set, it can not only overcome the problem of difficulty in selecting a sufficient number of types of filter materials, but also ensure that the distribution of different types of multispectral units 1311 is uniform, which is beneficial to the realism of the image and thus facilitates better color reproduction.

[0081] For example, when the image sensor 1 outputs an image, it can retain the information of at least one multispectral channel 15 corresponding to the first filter unit 131 by cropping, so as to reduce the resolution of the output image while still achieving color reproduction and reducing the power consumption required for the camera module 10 to operate.

[0082] Please refer to the following: Figures 7A to 8 , Figure 7A yes Figure 3 A schematic diagram of the image sensor 1 in the camera module 10 shown in some other embodiments; Figure 7B yes Figure 7A The image sensor 1 shown is a schematic diagram of its layer structure from another perspective. Figure 8 yes Figure 7A The image sensor 1 shown is a schematic diagram of the first filter unit 131 in some embodiments.

[0083] In some embodiments, the plurality of multispectral channels 15 may include an i-th multispectral channel 151, a j-th multispectral channel 152, and an m-th multispectral channel 153. The i-th multispectral channel 151 and the j-th multispectral channel 152 are arranged in the same row, and the i-th multispectral channel 151 and the m-th multispectral channel 153 are arranged in the same column. There is an interval of (N-1) multispectral channels 151 between the i-th multispectral channel 151 and the j-th multispectral channel 152, and an interval of (N-1) multispectral channels 153 between the i-th multispectral channel 151 and the m-th multispectral channel 153, wherein i, j, and m are all less than or equal to N. 2N; any two of the i-th multispectral channel 151, j-th multispectral channel 152 and m-th multispectral channel 153 have similar or identical response curve distributions.

[0084] It should be noted that the number of multispectral channels 151, j, and m does not limit the number of multispectral channels 15 that meet the above conditions to 3. Instead, it means that the multispectral channels 15 that meet the above conditions are each provided with (N-1) other multispectral channels 15 at intervals in both the horizontal and vertical directions.

[0085] In this embodiment, by setting the i-th multispectral channel 151, j-th multispectral channel 152, and m-th multispectral channel 153 to have similar or identical response curve distributions, the i-th multispectral channel 151, j-th multispectral channel 152, and m-th multispectral channel 153 can have similar or identical conversion efficiencies for light. This is beneficial for the image sensor 1 to extract information from the i-th multispectral channel 151, j-th multispectral channel 152, and m-th multispectral channel 153 for output when performing point-by-point image output, thereby achieving better imaging quality.

[0086] For example, any two of the i-th multispectral channel 151, the j-th multispectral channel 152, and the m-th multispectral channel 153 satisfy the following: |λ1-λ2|≤30nm; Wherein, λ1 is the wavelength corresponding to the peak value of the response curve of one of the i-th multispectral channels 151, j-th multispectral channels 152 and m-th multispectral channels 153, and λ2 is the wavelength corresponding to the peak value of the response curve of the other of the i-th multispectral channels 151, j-th multispectral channels 152 and m-th multispectral channels 153.

[0087] For example, the value of |λ1-λ2| can be, but is not limited to, 30nm, or 28nm, or 26nm, or 24nm, or 22nm, or 20nm, or 18nm, or 17nm, or 16nm, or 14nm, or 12nm, or 10nm, or 8nm, or 6nm, or 4nm, or 2nm, or 0, or other values ​​less than 30nm.

[0088] It should be noted that Figure 8 The multispectral units 1311 corresponding to the i-th multispectral channel 151, j-th multispectral channel 152 and m-th multispectral channel 153 are filled with diagonal lines.

[0089] In this embodiment, the i-th multispectral channel 151, the j-th multispectral channel 152, and the m-th multispectral channel 153 satisfy the above conditions so that the response curves of the i-th multispectral channel 151, the j-th multispectral channel 152, and the m-th multispectral channel 153 have similar peak distributions, which is beneficial for the response degree of the corresponding light among the i-th multispectral channel 151, the j-th multispectral channel 152, and the m-th multispectral channel 153 to tend to be consistent.

[0090] For example, any two of the i-th multispectral channel 151, the j-th multispectral channel 152, and the m-th multispectral channel 153 satisfy the following: |A1 / A2-1|≤30%; Where A1 is the sensitivity of one of the i-th multispectral channel 151, j-th multispectral channel 152 and m-th multispectral channel 153, and A2 is the sensitivity of the other of the i-th multispectral channel 151, j-th multispectral channel 152 and m-th multispectral channel 153.

[0091] For example, the value of |A1 / A2-1| can be, but is not limited to, 30%, or 28%, or 26%, or 24%, or 22%, or 20%, or 18%, or 17%, or 16%, or 14%, or 12%, or 10%, or 8%, or 6%, or 4%, or 2%, or 0, or other values ​​less than 30%.

[0092] It should be noted that sensitivity, also known as light conversion efficiency, represents the efficiency of light conversion and can be represented by the area integral of the response curve. Under the same energy of white light illumination, a multispectral channel 15 with higher sensitivity can obtain more photons, naturally resulting in a larger signal value. Specifically, in the image sensor 1, the response curve of each multispectral channel 15 can be represented by the visible light response curve of the corresponding pixel 121. The transmittance of the multispectral unit 1311 to visible light is represented.

[0093] In this embodiment, the i-th multispectral channel 151, the j-th multispectral channel 152, and the m-th multispectral channel 153 satisfy the above conditions so that the response curves of the i-th multispectral channel 151, the j-th multispectral channel 152, and the m-th multispectral channel 153 are similar in distribution and have approximately equal sensitivity. This results in the i-th multispectral channel 151, the j-th multispectral channel 152, and the m-th multispectral channel 153 having equal or similar conversion efficiencies for light, as well as equal or similar conversion efficiencies for light of similar or the same wavelength band.

[0094] Please refer to the following: Figure 7A , Figure 9A and Figure 9B , Figure 9A yes Figure 8 A schematic diagram of the response curves of the multispectral channel 15 corresponding to the multispectral unit 1311 in some embodiments; Figure 9B yes Figure 8 The first filter unit 131 shown is a schematic diagram of a point-by-point output method in some embodiments.

[0095] In some embodiments, any two of the i-th multispectral channel 151, the j-th multispectral channel 152, and the m-th multispectral channel 153 satisfy the following: , ; Where QE1(n) represents the response curve of one of the i-th multispectral channel 151, the j-th multispectral channel 152, and the m-th multispectral channel 153, and n1 and n2 are the ordinates of QE1(n) with k as the ordinate. QE1(λ1) represents the two horizontal axes; QE2(n) represents the response curve of one of the i-th multispectral channel 151, j-th multispectral channel 152, and m-th multispectral channel 153, and n3 and n4 are the vertical axes of QE2(n) with k as the coordinates. The two x-coordinates corresponding to QE2(λ2) are 0 < k < 20%.

[0096] Where QE1(λ1) is... Figure 9A The ordinates Q1 and QE2 (λ2) in the diagram are... Figure 9A The vertical coordinate is Q2.

[0097] It should be noted that the value of k can be designed according to the actual application. For example, the value of k can be, but is not limited to, 2%, 4%, 6%, 8%, 10%, 12%, 14%, 16%, 18%, or other values ​​between 1 and 20%.

[0098] In this embodiment, the i-th multispectral channel 151, the j-th multispectral channel 152, and the m-th multispectral channel 153 satisfy the above relationship so that the i-th multispectral channel 151, the j-th multispectral channel 152, and the m-th multispectral channel 153 have approximately or the same response curves and sensitivity, which is beneficial for outputting images with lower resolution when the camera module 10 is in a low power consumption state.

[0099] For example, image sensor 1 is used to output an image based on the electrical signals of the i-th multispectral channel 151, the j-th multispectral channel 152 and the m-th multispectral channel 153.

[0100] In this embodiment, since the i-th multispectral channel 151, j-th multispectral channel 152, and m-th multispectral channel 153 have similar or identical response curves and sensitivities, when outputting image data, only the i-th multispectral channel 151, j-th multispectral channel 152, and m-th multispectral channel 153 can be sampled, and the output can contain only the electrical signals of the i-th multispectral channel 151, j-th multispectral channel 152, and m-th multispectral channel 153. This can achieve low-power output image by reducing the resolution of the output image, and the signal distribution of the image in different multispectral channels 15 is uniform, which can ensure the performance of coarse image recognition. For example, QR code detection can be achieved in low-power mode.

[0101] Among them, with Figure 9B Taking the first filter unit 131 as an example, the multispectral channels 15 corresponding to multispectral units 1311(T1) and 1311(T3) have similar response curves and sensitivities. By sampling, multispectral units 1311(T1) and 1311(T3) are extracted, and electrical signals are extracted and output only for the multispectral channels 15 corresponding to multispectral units 1311(T1) and 1311(T3), which can reduce the resolution by a factor of 4. At this time, the output image can be approximately equivalent to a black and white mode.

[0102] In other embodiments, the multispectral unit 1311 corresponding to the i-th multispectral channel 151, the multispectral unit 1311 corresponding to the j-th multispectral channel 152, and the multispectral unit 1311 corresponding to the m-th multispectral channel 153 may have the same or similar light transmittance curves. This is beneficial for achieving similar or identical response curves and sensitivity among the i-th multispectral channel 151, the j-th multispectral channel 152, and the m-th multispectral channel 153, thereby improving the imaging quality of the sampling output.

[0103] Here, similar or identical light transmittance curves refer to the difference in wavelength corresponding to the peaks of the light transmittance curves of two multispectral units 1311 being less than or equal to 30 nm, and the difference in the integrals of the light transmittance curves of two multispectral units 1311 in the region where the transmittance is greater than or equal to k times the peak value being less than or equal to 30%. Thus, by selecting multispectral channels 15 corresponding to multispectral units 1311 with similar or identical light transmittance through point sampling, point sampling of the output image can be achieved, reducing image resolution while ensuring image uniformity.

[0104] Please refer to the following: Figure 10 , Figure 11A and Figure 11B , Figure 10 yes Figure 3 A schematic diagram of the image sensor 1 in the camera module 10 shown in some other embodiments; Figure 11A yes Figure 10 A schematic diagram of the first filter unit 131 in some embodiments of the image sensor 1 shown; Figure 11B yes Figure 11A The first filter unit 131 shown is a schematic diagram of an averaging method in some embodiments.

[0105] In some embodiments, the first filtering unit 131 may include two first filtering areas 1312 and two second filtering areas 1313, and each of the first filtering areas 1312 and the second filtering area 1313 has N rows of... There are N multispectral units 1311, two first filter regions 1312 are arranged along one diagonal of the first filter unit 131, and two second filter regions 1313 are arranged along the other diagonal of the first filter unit 131. The types and order of the multispectral units 1311 in the first filter region 1312a are the same as those in the first filter region 1312b. The types and order of the multispectral units 1311 in the second filter region 1313a are the same as those in the second filter region 1313b.

[0106] The labels of the first filter area 1312a and the first filter area 1312b are only used to distinguish between the two first filter areas 1312, and the labels of the second filter area 1313a and the second filter area 1313b are only used to distinguish between the two second filter areas 1313.

[0107] In this embodiment, since the first filter unit 131 is evenly and regularly distributed, it is beneficial to output a low-resolution image, and in the subsequent image processing flow, it is also beneficial to perform de-mosaic processing on the image.

[0108] For example, the image sensor 1 is configured to: read the electrical signals of multiple multispectral channels 15 corresponding to multiple first filter areas 1312, average the electrical signals of the multiple multispectral channels 15 corresponding to each first filter area 1312 to obtain an average value, and output the average value. It is also configured to: read the electrical signals of multiple multispectral channels 15 corresponding to multiple second filter areas 1313, average the electrical signals of the multiple multispectral channels 15 corresponding to each second filter area 1313 to obtain an average value, and output the average value.

[0109] In this embodiment, for some scenarios that do not require color reproduction and require low resolution for coarse recognition, the resolution can be reduced by using the method of this embodiment. The two multispectral channels 15 are symmetrically distributed and have less color information, which can significantly reduce the image resolution, which is beneficial to achieve low power output image and uniform image distribution.

[0110] Among them, with Figure 11B Taking the first filter unit 131 as an example, it is possible to average T1, T2, T5, and T6 in the multispectral unit 1311 as a, and average T3, T4, T7, and T8 in the multispectral unit 1311 as b, thereby reducing the resolution by a factor of 4.

[0111] Please refer to the following: Figure 6 , Figure 8 and Figure 11A In some embodiments, the image sensor 1 is used to: read the electrical signals of the plurality of multispectral channels 15 corresponding to the first filter unit 131, average the electrical signals of the plurality of multispectral channels 15 corresponding to the first filter unit 131 to obtain an average value, and output the average value.

[0112] In this embodiment, the resolution of the image output by the camera module 10 can be further reduced by averaging the electrical signals of the multiple multispectral channels 15 corresponding to the entire first filter unit 131. This is applicable to scenarios that do not require color information, such as black and white mode, and reduces the required power consumption while reducing the resolution.

[0113] Please continue reading. Figures 4 to 6In some embodiments, the first filter unit 131 includes D types of multispectral units 1311, where D=2N. 2N / M, M≥2, where M is the number of times each type of multispectral unit 1311 is repeatedly set in each first filter unit 131.

[0114] In this embodiment, by repeatedly setting the types of multispectral units 1311, the types of multispectral units 1311 with different light transmittance in the first filter unit 131 are appropriate, which can overcome the problem of difficulty in selecting a sufficient variety of filter materials.

[0115] For example, with Figures 4 to 6 Taking the first filter unit 131 shown as an example, the first filter unit 131 may include 4 rows Four multispectral units 1311 are arranged in each first filter unit 131. There are eight types of multispectral units 1311 in each first filter unit 131. Each type of multispectral unit 1311 is repeated twice, which can make the different types of multispectral units 1311 in the first filter unit 131 evenly distributed, which is beneficial to improving the imaging effect.

[0116] The first filter unit 131 includes different types of first multispectral units T1, second multispectral units T2, third multispectral units T3, fourth multispectral units T4, fifth multispectral units T5, sixth multispectral units T6, seventh multispectral units T7 and eighth multispectral units T8.

[0117] The first multispectral unit T1 satisfies the following conditions: the peak light transmittance corresponds to a wavelength between 515nm and 550nm; the transmittance T11 ≤ 10% for light in the wavelength range of 400nm to 456nm; the transmittance T12 ≥ 80% for light in the wavelength range of 525nm to 560nm; the transmittance T13 ≤ 10% for light in the wavelength range of 630nm to 665nm; and the transmittance T14 ≥ 90% for light in the wavelength range of 850nm to 1000nm. The first multispectral unit T1 is a green-based filter material.

[0118] The second multispectral unit T2 satisfies the following conditions: the peak light transmittance corresponds to a wavelength between 440nm and 460nm; the transmittance T21 for light in the wavelength range of 400nm to 480nm is ≥60%; the transmittance T22 for light in the wavelength range of 495nm to 510nm is ≤40%; the transmittance T23 for light in the wavelength range of 525nm to 700nm is ≤10%; and the transmittance T14 for light in the wavelength range of 830nm to 1000nm is ≥90%. The second multispectral unit T2 is a sky-blue filter material.

[0119] The third multispectral unit T3 satisfies the following conditions: the peak light transmittance corresponds to a wavelength between 525nm and 560nm; the transmittance T31 ≤ 10% for light in the wavelength range of 400nm to 465nm; the transmittance T32 ≥ 80% for light in the wavelength range of 500nm to 575nm; the transmittance T33 ≤ 10% for light in the wavelength range of 650nm to 750nm; and the transmittance T34 ≥ 95% for light in the wavelength range of 850nm to 1000nm. The third multispectral unit T3 is a yellow-green filter material.

[0120] The fourth multispectral unit T4 satisfies the following conditions: the peak light transmittance corresponds to a wavelength between 440nm and 510nm; the transmittance T41 for light in the wavelength range of 415nm to 420nm is ≥80%; the transmittance T42 for light in the wavelength range of 590nm to 715nm is ≤15%; and the transmittance T43 for light in the wavelength range of 780nm to 1000nm is ≥90%. The fourth multispectral unit T4 is a cyan-based filter material.

[0121] The fifth multispectral unit T5 satisfies the following conditions: the peak wavelength corresponding to the light transmittance is greater than or equal to 510 nm; the transmittance T51 for light in the wavelength range of 400 nm to 470 nm is ≤10%; the transmittance T52 for light in the wavelength range of 510 nm to 540 nm is ≥90%; and the transmittance T53 for light in the wavelength range of 540 nm to 1000 nm is ≥95%. The fifth multispectral unit T5 is a yellow-toned filter material.

[0122] The sixth multispectral unit T6 satisfies the following conditions: the peak wavelength corresponding to the light transmittance is greater than or equal to 620 nm; the transmittance T61 for light in the wavelength range of 400 nm to 460 nm is ≥60%; the transmittance T62 for light in the wavelength range of 530 nm to 570 nm is ≤10%; and the transmittance T63 for light in the wavelength range of 620 nm to 1000 nm is ≥90%. The sixth multispectral unit T6 is a violet-based filter material.

[0123] The seventh multispectral unit T7 satisfies the following conditions: the peak wavelength of light transmittance is greater than or equal to 600 nm, the transmittance T71 for light in the wavelength range of 400 nm to 570 nm is ≤10%, and the transmittance T72 for light in the wavelength range of 600 nm to 1000 nm is ≥90%. Among them, the seventh multispectral unit T7 is a red-based filter material.

[0124] The eighth multispectral unit T8 satisfies the following conditions: the peak light transmittance corresponds to a wavelength between 440nm and 465nm; the transmittance T81 ≥ 80% for light in the wavelength range of 445nm to 465nm; the transmittance T82 ≥ 60% for light in the wavelength range of 400nm to 485nm; the transmittance T83 ≤ 10% for light in the wavelength range of 540nm to 775nm; and the transmittance T84 ≥ 90% for light in the wavelength range of 830nm to 1000nm. The eighth multispectral unit T8 is a blue-based filter material.

[0125] In this embodiment, the eight multispectral units 1311 satisfy the above conditions to ensure that the multispectral units 1311 cannot be linearly fitted by other filter materials. When these eight multispectral units 1311 are applied to the camera module 10 for color reproduction, the color difference is small, achieving a color difference of less than 2. Furthermore, the combination of these eight multispectral units 1311, through algorithm simulation, can achieve a superior signal-to-noise ratio.

[0126] The first multispectral unit T1 and the third multispectral unit T3 have similar light transmittance curves, and the multispectral channels 15 corresponding to the first multispectral unit T1 and the third multispectral unit T3 have similar response curves. This ensures that the multispectral channels 15 corresponding to the first multispectral unit T1 and the third multispectral unit T3 have similar or identical response curves and sensitivities. Therefore, when outputting image data, only the multispectral channels 15 corresponding to the first multispectral unit T1 and the third multispectral unit T3 can be sampled, and the output only contains the electrical signals of the multispectral channels 15 corresponding to the first multispectral unit T1 and the third multispectral unit T3. This allows for low-power image output by reducing the resolution of the output image, and the signal distribution in different multispectral channels 15 is uniform, ensuring the performance of coarse image recognition.

[0127] It should be noted that the filter material provided in this embodiment is not limited to the type of material of the multispectral unit 1311 in the first filter unit 131. In some other embodiments, the material of the multispectral unit 1311 in the first filter unit 131 can also be other types of filter materials, such as red filter materials, green filter materials, blue filter materials, yellow filter materials, ultraviolet filter materials, infrared filter materials, white filter materials, etc. In some other embodiments, the types of materials of the multispectral unit 1311 in the first filter unit 131 can be more or fewer, and the specific design can be made according to the actual application.

[0128] Please combine Figures 12A to 15B , Figure 12A yes Figure 3 A schematic diagram of the first filter unit 131 of the image sensor 1 in the camera module 10 shown in some other embodiments; Figure 12B yes Figure 3 A schematic diagram of the first filter unit 131 of the image sensor 1 in the camera module 10 shown in some other embodiments; Figure 13A yes Figure 3 A schematic diagram of the first filter unit 131 of the image sensor 1 in the camera module 10 shown in some other embodiments; Figure 13B Figure 3 A schematic diagram of the first filter unit 131 of the image sensor 1 in the camera module 10 shown in some other embodiments; Figure 14A yes Figure 3 A schematic diagram of the first filter unit 131 of the image sensor 1 in the camera module 10 shown in some other embodiments; Figure 14B yes Figure 3 A schematic diagram of the first filter unit 131 of the image sensor 1 in the camera module 10 shown in some other embodiments; Figure 15A yes Figure 3 A schematic diagram of the first filter unit 131 of the image sensor 1 in the camera module 10 shown in some other embodiments; Figure 15B yes Figure 3 A schematic diagram of the first filter unit 131 of the image sensor 1 in the camera module 10 shown in some other embodiments.

[0129] In some embodiments, the eight multispectral units 1311 can also be arranged in other sequences, while still satisfying the arrangement rules in the above embodiments. For details, please refer to... Figures 12A to 15B The arrangement of the multispectral units 1311.

[0130] It should be noted that the accompanying drawings of this embodiment only illustrate some arrangement methods of different types of multispectral units 1311 in the first filter unit 131. It can be understood that different types of multispectral units 1311 in the first filter unit 131 can also adopt other arrangement methods, as long as they conform to the arrangement rules in the above embodiments. They will not be listed one by one here.

[0131] Please see Figures 16A to 17 , Figure 16A yes Figure 3 A schematic diagram of the image sensor 1 in the camera module 10 shown in some other embodiments; Figure 16B yes Figure 16A The image sensor 1 shown is a schematic diagram of the layer structure at another row of the first filter unit 131. Figure 17 yes Figure 16A The image sensor 1 shown is a schematic diagram of the first filter unit 131 in some embodiments.

[0132] In some embodiments, the multiple multispectral channels 15 may include multiple statistical channels 154, which are used for brightness statistics. In each multispectral unit 1311, the multiple statistical channels 154 are arranged adjacent to each other, and the sensitivity of the multiple statistical channels 154 in the multiple multispectral channels 15 is greater than the sensitivity of the other multispectral channels 15.

[0133] In this embodiment, by centrally setting up the statistical channels 154 with higher sensitivity, it is beneficial for the electronic device 100 to perform brightness statistics during automatic exposure, and it is also beneficial for the path design of the electronic device 100.

[0134] For example, among the above eight types of multispectral units 1311, the sensitivity of the multispectral channels 15 corresponding to the third multispectral unit T3, the fourth multispectral unit T4, the fifth multispectral unit T5, and the sixth multispectral unit T6 is greater than that of the multispectral channels 15 corresponding to the first multispectral unit T1, the second multispectral unit T2, the seventh multispectral unit T7, and the eighth multispectral unit T8. Setting the third multispectral unit T3, the fourth multispectral unit T4, the fifth multispectral unit T5, and the sixth multispectral unit T6 in the upper left corner region of the first filter unit 131 is beneficial for the electronic device 100 to perform brightness statistics on the multispectral channels 15 corresponding to the third multispectral unit T3, the fourth multispectral unit T4, the fifth multispectral unit T5, and the sixth multispectral unit T6 during automatic exposure, thereby improving the brightness statistics efficiency.

[0135] It should be noted that the aforementioned upper left corner area refers to the area corresponding to the first channel counted when the electronic device 100 performs brightness statistics on the multispectral channels 15 in the first filter unit 131 during automatic exposure.

[0136] It should be noted that in the above four lines In the first filter unit 131 of column 4, the arrangement of eight types of multispectral units 1311 repeated twice is only for illustration. It can be understood that in other embodiments, other numbers and types of multispectral units 1311 can also be used for design, as long as the arrangement rules in the above embodiments can be met.

[0137] Please refer to the following: Figure 3 , Figure 4 and Figure 18 , Figure 18 yes Figure 3 The diagram shows a structural schematic of the filter array 13 in the image sensor 1 of the camera module 10 in some other embodiments. It should be noted that... Figure 18 The filter array 13 shown may include some of the technical features of the filter array 13 in any of the foregoing embodiments, and the same features will not be described again here.

[0138] In some embodiments, the filter array 13 may further include a plurality of second filter units 134 arranged in an array, the plurality of second filter units 134 being disposed around at least a portion of a plurality of first filter units 131.

[0139] In this embodiment, color reproduction is achieved through the first filter unit 131, and other functions (e.g., imaging) are achieved through the second filter unit 134, enabling the filter array 13 to achieve hybrid filtering. Thus, the image sensor 1 is a hybrid image sensor 1 with multiple functions, realizing the multi-functional application of the image sensor 1, thereby realizing the multi-functional composite of the camera module 10. Since the first filter unit 131 and the second filter unit 134 are integrated in the same image sensor 1, they can share components such as the bracket 6, lens 7, and filter 5 in the image sensor 1, realizing the miniaturized design of the camera module 10. This allows the electronic device 100 to have multiple shooting and / or imaging functions while also improving the overall space utilization and achieving a thin and light design.

[0140] For example, multiple second filter units 134 can be provided with various filter materials. The filter materials provided in the second filter units 134 can at least partially overlap with the filter materials provided in the first filter unit 131. This design can reduce the difficulty of selecting filter materials and can also improve the overall imaging effect of the image sensor 1 by selecting filter materials that have better compatibility with both the first filter unit 131 and the second filter unit 134.

[0141] The filter materials provided in the plurality of second filter units 134 may include one or more of the following: red filter material, green filter material, blue filter material, yellow filter material, white filter material, ultraviolet filter material, infrared filter material, and filter material that matches the event pixel.

[0142] by Figure 18 For example, multiple second filter units 134 are arranged in an array and surrounding multiple first filter units 131. Among them, the multiple second filter units 134 can be RYYB arrays, also known as Bayer arrays. Figure 18 The filter array 13 provided in the embodiment can be regarded as a Bayer array, in which a plurality of first filter units 131 are arranged in the Bayer array to replace some of the second filter units 134 therein.

[0143] It should be noted that, Figure 18 The filter array 13 provided in the embodiment does not limit the number, type, or arrangement of the multispectral units 1311 in the first filter unit 131. The first filter unit 131 can be any of the first filter units 131 provided in the foregoing embodiments. Figure 18The first filter unit 131 in the diagram is for illustrative purposes only.

[0144] In some embodiments, the electronic device 100 can achieve color reproduction by having the first filter unit 131 and the second filter unit 134 in the filter array 13 work together. Specifically, multiple second filter units 134 are used to form an RYYB array or an RGGB array for illustration. The channel corresponding to the first filter unit 131 is a multispectral channel 15, and the channel corresponding to the second filter unit 134 is an imaging channel. The electronic device 100 can acquire images through the image sensor 1 and extract image data from the multispectral channel 15 and the imaging channel, respectively. The image data of the multispectral channel 15 is used for multispectral imaging to obtain color correction information, and the image data of the imaging channel is used to obtain RYB or RGB images. The electronic device 100 performs color correction on the RYB or RGB images using the color correction information, thereby obtaining an image that can be color reproduced. Compared with RYB or RGB images, this image can more realistically present the true colors of the photographed object, thus improving image quality.

[0145] It should be noted that the above color reproduction is only illustrative. In some other embodiments, the multiple second filter units 134 can also be other types of arrays, and the first filter unit 131 and the second filter unit 134 can also work together to achieve other functions, which will not be listed here.

[0146] Please refer to the following: Figure 18 and Figure 19 , Figure 19 yes Figure 3 The diagram shows a structural schematic of the filter array 13 in the image sensor 1 of the camera module 10 in some other embodiments. It should be noted that... Figure 19 The filter array 13 shown may include some of the technical features of the filter array 13 in any of the foregoing embodiments, and the same features will not be described again here.

[0147] In some embodiments, there may be an interval of O second filter units 134 between two adjacent first filter units 131, where O ≥ 0. Specifically, when O is 0, there is no interval of second filter units 134 between two adjacent first filter units 131.

[0148] It should be noted that, Figure 18 In this embodiment, four second filter units 134 are spaced between two adjacent first filter units 131. The number of second filter units 134 spaced between two adjacent first filter units 131 is not limited. In other embodiments, more or fewer second filter units 134 may be spaced between two adjacent first filter units 131.

[0149] For example, the area of ​​a single multispectral unit 1311 can be U times the area of ​​a single second filter unit 134, where U = c 2 , c≥1.

[0150] In some examples, please refer to Figure 18 The area of ​​a single multispectral unit 1311 is the same as that of a single subunit, which is beneficial for layout design.

[0151] In other examples, please refer to Figure 19 The area of ​​a single multispectral unit 1311 can be U times the area of ​​a single second filter unit 134, where c ≥ 2. This design increases the area of ​​a single multispectral unit 1311, enabling it to filter more light. This allows the image sensor 1 to receive more light signals in the multispectral channel 15 corresponding to the multispectral unit 1311, which is beneficial for color reproduction.

[0152] It should be noted that, Figure 19 In this embodiment, c=2, meaning the area of ​​a single multispectral unit 1311 is four times the area of ​​a single second filter unit 134. In other embodiments, the area of ​​a single multispectral unit 1311 may be a greater or lesser multiple of the area of ​​a single second filter unit 134.

[0153] Please see Figure 20 , Figure 20 yes Figure 3 The diagram shows a structural schematic of the filter array 13 in the image sensor 1 of the camera module 10 in some other embodiments. It should be noted that... Figure 20 The filter array 13 shown may include some of the technical features of the filter array 13 in any of the foregoing embodiments, and the same features will not be described again here.

[0154] In some embodiments, P line P first filter units 131 are arranged adjacently to form a first multispectral set 135, and S second filter units 134 are spaced between two adjacent first multispectral sets 135, where S≥0.

[0155] In this embodiment, by abutting multiple first filter units 131 to form a first multispectral set 135, the arrangement density of multispectral units 1311 is increased, which is beneficial for multispectral units 1311 to filter more light, so that multispectral channel 15 can receive more optical signals and improve signal processing quality.

[0156] It should be noted that, Figure 20In this embodiment, eight second filter units 134 are spaced between two adjacent first multispectral sets 135. It can be understood that in some other embodiments, more or fewer second filter units 134 may be spaced between two adjacent first multispectral sets 135.

[0157] Please combine Figure 21 and Figure 22 , Figure 21 yes Figure 3 A schematic diagram of the structure of the filter array 13 in the image sensor 1 of the camera module 10 shown in some other embodiments; Figure 22 yes Figure 3 The diagram shows a structural schematic of the filter array 13 in the image sensor 1 of the camera module 10 in some other embodiments. It should be noted that... Figure 21 and Figure 22 The filter array 13 shown may include some of the technical features of the filter array 13 in any of the foregoing embodiments, and the same features will not be described again here.

[0158] In some embodiments, there is a T second filter units 134 between two adjacent multispectral units 1311, where T≥0.

[0159] When T=0, there is no second filter unit 134 between two adjacent multispectral units 1311. When T>0, a second filter unit 134 is provided between two adjacent multispectral units to disperse the multispectral units 1311, which helps to improve the uniformity of the distribution of the multispectral units 1311 in the filter array 13.

[0160] It should be noted that, Figure 21 In this embodiment, three second filter units 134 are spaced apart between two adjacent multispectral units 1311. Figure 22 In this embodiment, two second filter units 134 are spaced apart between two adjacent multispectral units 1311. It can be understood that in some other embodiments, more or fewer second filter units 134 may be spaced apart between two adjacent multispectral units 1311.

[0161] In some examples, please refer to Figure 21 The area of ​​a single multispectral unit 1311 is the same as that of a single second filter unit 134, which is beneficial for the layout design.

[0162] In other examples, please refer to Figure 22 The area of ​​a single multispectral unit 1311 can be U times the area of ​​a single second filter unit 134, where U = c 2c≥2. This design can increase the area of ​​a single multispectral unit 1311, so that the multispectral unit 1311 can filter more light, thereby enabling the image sensor 1 to receive more light signals in the multispectral channel 15 corresponding to the multispectral unit 1311, which is beneficial for color reproduction.

[0163] It should be noted that, Figure 22 In this embodiment, c=2, meaning the area of ​​a single multispectral unit 1311 is four times the area of ​​a single second filter unit 134. In other embodiments, the area of ​​a single multispectral unit 1311 may be a greater or lesser multiple of the area of ​​a single second filter unit 134.

[0164] Please refer to the following: Figures 23 to 27 , Figure 23 yes Figure 3 A schematic diagram of the structure of the filter array 13 in the image sensor 1 of the camera module 10 shown in some other embodiments; Figure 24 yes Figure 3 A schematic diagram of the structure of the filter array 13 in the image sensor 1 of the camera module 10 shown in some other embodiments; Figure 25 yes Figure 3 A schematic diagram of the structure of the filter array 13 in the image sensor 1 of the camera module 10 shown in some other embodiments; Figure 26 yes Figure 3 A schematic diagram of the structure of the filter array 13 in the image sensor 1 of the camera module 10 shown in some other embodiments; Figure 27 yes Figure 3 A schematic diagram of the structure of the filter array 13 in the image sensor 1 of the camera module 10 shown in some other embodiments.

[0165] It should be noted that, Figures 23 to 27 The filter array 13 shown may include at least some of the technical features of any of the foregoing embodiments, and the same features will not be repeated here.

[0166] In some embodiments, the plurality of second filter units 134 may also be other types of arrays, for example, the plurality of second filter units 134 may also be a quad array.

[0167] It should be noted that the multiple second filter units 134 can also be other types of arrays, such as RGBW arrays, RYBW arrays, etc. In addition, the filter materials in the multiple second filter units 134 can also be other types of filter materials combined, which will not be listed here.

[0168] It should be noted that, in the absence of conflict, the embodiments and features in the embodiments of this application can be combined with each other, and any combination of features in different embodiments is also within the protection scope of this application. That is to say, the multiple embodiments described above can also be arbitrarily combined according to actual needs.

[0169] It should be noted that all the above figures are exemplary illustrations of this application and do not represent the actual size of the product. Furthermore, the dimensional proportions between the components in the figures are not intended to limit the actual product of this application.

[0170] The above are merely some embodiments and implementation methods of this application. The scope of protection of this application is not limited thereto. Any variations or substitutions that can be easily conceived by those skilled in the art within the scope of the technology disclosed in this application should be included within the scope of protection of this application. Therefore, the scope of protection of this application should be determined by the scope of the claims.

Claims

1. An image sensor (1), characterized in that, The circuit includes a circuit layer (11), a pixel layer (12), a filter array (13), and a microlens array (14) stacked in sequence. Visible light can pass through the microlens array (14) and the filter array (13) to the pixel layer (12) in sequence, and be converted into an electrical signal in the pixel layer (12). The circuit layer (11) is used to process the electrical signal. The filter array (13) includes a plurality of first filter units (131) arranged in an array, each of the first filter units (131) including 2N rows arranged in an array. 2N columns of multispectral units (1311), where N≥2, the first filter unit (131) includes more than 4 types of the multispectral units (1311), and different types of the multispectral units (1311) are used to filter light of different colors; In the filter array (13), starting from any one of the multispectral units (1311), 2N rows are formed. N columns of the multispectral units (1311) constitute the first region (132), and N rows The 2N columns of the multispectral units (1311) form the second region (133), and the types of the multispectral units (1311) in the first region (132) are the same as the types of the multispectral units (1311) in the second region (133). The image sensor (1) has multiple multispectral channels (15), each of which corresponds one-to-one with a multiple multispectral unit (1311). Each multispectral channel (15) includes an i-th multispectral channel (151), a j-th multispectral channel (152), and an m-th multispectral channel (153). The i-th multispectral channel (151) and the j-th multispectral channel (152) are arranged in the same row, and the i-th multispectral channel (151) and the m-th multispectral channel (153) are arranged in the same column. There is a (N-1)-interval between the i-th multispectral channel (151) and the j-th multispectral channel (152), and a (N-1)-interval between the i-th multispectral channel (151) and the m-th multispectral channel (153). Here, i, j, and m are all less than or equal to N. 2N; Any two of the i-th multispectral channel (151), the j-th multispectral channel (152), and the m-th multispectral channel (153) satisfy the following: |λ1-λ2|≤30nm; Wherein, λ1 is the wavelength corresponding to the peak value of the response curve of one of the i-th multispectral channel (151), the j-th multispectral channel (152) and the m-th multispectral channel (153), and λ2 is the wavelength corresponding to the peak value of the response curve of the other of the i-th multispectral channel (151), the j-th multispectral channel (152) and the m-th multispectral channel (153).

2. The image sensor (1) as described in claim 1, characterized in that, Any two of the i-th multispectral channel (151), the j-th multispectral channel (152), and the m-th multispectral channel (153) satisfy the following: |A1 / A2-1|≤30%; Wherein, A1 is the sensitivity of one of the i-th multispectral channel (151), the j-th multispectral channel (152) and the m-th multispectral channel (153), and A2 is the sensitivity of the other of the i-th multispectral channel (151), the j-th multispectral channel (152) and the m-th multispectral channel (153).

3. The image sensor (1) as described in claim 2, characterized in that, Any two of the i-th multispectral channel (151), the j-th multispectral channel (152), and the m-th multispectral channel (153) satisfy the following: ， ； Where QE1(n) represents the response curve of one of the i-th multispectral channel (151), the j-th multispectral channel (152), and the m-th multispectral channel (153), and n1 and n2 are the ordinates of QE1(n) with k as the ordinate. QE1(λ1) represents the two horizontal axes; QE2(n) represents the response curve of one of the i-th multispectral channel (151), the j-th multispectral channel (152), and the m-th multispectral channel (153), and n3 and n4 are the vertical axes of QE2(n) with k as the vertical axis. The two x-coordinates corresponding to QE2(λ2) are 0 < k < 20%.

4. The image sensor (1) as described in any one of claims 1 to 3, characterized in that, The image sensor (1) is used to output an image based on the electrical signals of the i-th multispectral channel (151), the j-th multispectral channel (152) and the m-th multispectral channel (153).

5. The image sensor (1) as described in any one of claims 1 to 4, characterized in that, The first filter unit (131) includes two first filter areas (1312) and two second filter areas (1313), and each of the first filter areas (1312) and the second filter areas (1313) has N rows. N columns of the multispectral units (1311), two first filter regions (1312) are arranged along one diagonal of the first filter unit (131), and two second filter regions (1313) are arranged along the other diagonal of the first filter unit (131); The types and order of the multispectral units (1311) in one of the first filter regions (1312) are the same as those in the other first filter region (1312). The types and order of the multispectral units (1311) in one of the second filter regions (1313) are the same as those of the multispectral units (1311) in the other second filter region (1313).

6. The image sensor (1) as described in claim 5, characterized in that, The image sensor (1) is used to: read the electrical signals of the multiple multispectral channels (15) corresponding to the multiple first filter areas (1312), average the electrical signals of the multiple multispectral channels (15) corresponding to each first filter area (1312) to obtain an average value, and output the average value; It is also used to read the electrical signals of the multiple multispectral channels (15) corresponding to the multiple second filter areas (1313), average the electrical signals of the multiple multispectral channels (15) corresponding to each second filter area (1313) to obtain the average value, and output the average value.

7. The image sensor (1) as described in any one of claims 1 to 6, characterized in that, The first filter unit (131) includes D types of the multispectral units (1311), where D = 2N. 2N / M, M≥2, where M is the number of times the multispectral unit (1311) of each type is repeatedly set in each of the first filter units (131).

8. The image sensor (1) as claimed in any one of claims 1 to 7, characterized in that, The plurality of multispectral channels (15) include a plurality of statistical channels (154), which are used for brightness statistics. In each of the first filter units (131), the plurality of statistical channels (154) are arranged adjacent to each other. The sensitivity of the plurality of statistical channels (154) in the plurality of multispectral channels (15) is greater than the sensitivity of the other multispectral channels (15).

9. The image sensor (1) as described in any one of claims 1 to 8, characterized in that, The first filter unit (131) includes 4 rows The first filter unit (131) has 4 columns of multispectral units (1311). In each of the first filter units (131), there are 8 types of multispectral units (1311), and each type of multispectral unit (1311) is repeated twice.

10. The image sensor (1) as claimed in claim 9, characterized in that, The first filter unit (131) includes different types of first multispectral units (T1), second multispectral units (T2), third multispectral units (T3), fourth multispectral units (T4), fifth multispectral units (T5), sixth multispectral units (T6), seventh multispectral units (T7) and eighth multispectral units (T8). The first multispectral unit (T1) satisfies the following conditions: the peak wavelength of light transmittance corresponds to a wavelength between 515nm and 550nm, and the transmittance T12 for light with a wavelength range of 525nm to 560nm is ≥80%; The second multispectral unit (T2) satisfies the following: the peak wavelength of light transmittance corresponds to the wavelength between 440nm and 460nm, and the transmittance T21 for light with a wavelength range of 400nm to 480nm is ≥60%; The third multispectral unit (T3) satisfies the following: the peak wavelength of light transmittance corresponds to the wavelength between 525nm and 560nm, and the transmittance T32 for light with a wavelength range of 500nm to 575nm is ≥80%; The fourth multispectral unit (T4) satisfies the following: the peak wavelength of light transmittance corresponds to the wavelength between 440 nm and 510 nm, and the transmittance T41 for light with a wavelength range of 415 nm to 420 nm is ≥80%; The fifth multispectral unit (T5) satisfies the following: the peak wavelength of the light transmittance is greater than or equal to 510 nm, and the light transmittance T52 for the wavelength range of 510 nm to 540 nm is ≥90%; The sixth multispectral unit (T6) satisfies the following: the peak wavelength of light transmittance is greater than or equal to 620 nm, and the transmittance of light in the wavelength range of 620 nm to 1000 nm is T63≥90%; The seventh multispectral unit (T7) satisfies the following: the peak wavelength of light transmittance is greater than or equal to 600 nm, and the transmittance T72 for light in the wavelength range of 600 nm to 1000 nm is ≥90%; The eighth multispectral unit (T8) satisfies the following: the peak wavelength of light transmittance corresponds to the wavelength between 440nm and 465nm, and the transmittance T81 for light with a wavelength range of 445nm to 465nm is ≥80%.

11. The image sensor (1) as claimed in claim 10, characterized in that, The first multispectral unit (T1) satisfies the following conditions: transmittance T11 ≤ 10% for light in the wavelength range of 400 nm to 456 nm, transmittance T13 ≤ 10% for light in the wavelength range of 630 nm to 665 nm, and transmittance T14 ≥ 90% for light in the wavelength range of 850 nm to 1000 nm; The second multispectral unit (T2) satisfies the following conditions: transmittance T22 ≤ 40% for light in the wavelength range of 495nm to 510nm, transmittance T23 ≤ 10% for light in the wavelength range of 525nm to 700nm, and transmittance T14 ≥ 90% for light in the wavelength range of 830nm to 1000nm; The third multispectral unit (T3) satisfies the following conditions: transmittance T31 ≤ 10% for light in the wavelength range of 400 nm to 465 nm, transmittance T33 ≤ 10% for light in the wavelength range of 650 nm to 750 nm, and transmittance T34 ≥ 95% for light in the wavelength range of 850 nm to 1000 nm. The fourth multispectral unit (T4) satisfies the following conditions: transmittance T42 ≤ 15% for light in the wavelength range of 590 nm to 715 nm, and transmittance T43 ≥ 90% for light in the wavelength range of 780 nm to 1000 nm; The fifth multispectral unit (T5) satisfies the following conditions: transmittance T51 ≤ 10% for light in the wavelength range of 400 nm to 470 nm, and transmittance T53 ≥ 95% for light in the wavelength range of 540 nm to 1000 nm; The sixth multispectral unit (T6) satisfies the following conditions: transmittance T61 ≥ 60% for light in the wavelength range of 400 nm to 460 nm, and transmittance T62 ≤ 10% for light in the wavelength range of 530 nm to 570 nm. The seventh multispectral unit (T7) satisfies the following condition: transmittance of light in the wavelength range of 400 nm to 570 nm T71 ≤ 10%; The eighth multispectral unit (T8) satisfies the following: transmittance T82 ≥ 60% for light in the wavelength range of 400 nm to 485 nm, transmittance T83 ≤ 10% for light in the wavelength range of 540 nm to 775 nm, and transmittance T84 ≥ 90% for light in the wavelength range of 830 nm to 1000 nm.

12. The image sensor (1) as claimed in any one of claims 1 to 11, characterized in that, The filter array (13) further includes a plurality of second filter units (134) arranged in an array, the plurality of second filter units (134) being arranged around at least a portion of the plurality of first filter units (131).

13. The image sensor (1) as claimed in claim 12, characterized in that, There are O second filter units (134) between two adjacent first filter units (131), where O ≥ 0.

14. The image sensor (1) as claimed in claim 12, characterized in that, P row P columns of the first filter units (131) are arranged adjacently to form a first multispectral set (135), and S second filter units (134) are spaced between two adjacent first multispectral sets (135), where S≥0.

15. The image sensor (1) as claimed in claim 12, characterized in that, The two adjacent multispectral units (1311) are spaced apart by T second filter units (134), where T≥0.

16. The image sensor (1) as claimed in any one of claims 12 to 15, characterized in that, The area of ​​a single multispectral unit (1311) is U times the area of ​​a single second filter unit (134), where U = c 2 , c≥1.

17. A camera module (10), characterized in that, The device includes a lens (7), a bracket (6), a circuit assembly, and an image sensor (1) as claimed in any one of claims 1 to 16. The image sensor (1) and the bracket (6) are both mounted on the circuit assembly, and the lens (7) is mounted on the bracket (6). The lens (7) and the image sensor (1) are positioned opposite each other.

18. The camera module (10) as described in claim 17, characterized in that, The camera module (10) also includes a filter (5), which is disposed between the image sensor (1) and the lens (7).

19. An electronic device (100), characterized in that, Includes an image processor and a camera module (10) as described in claim 17 or 18, wherein the image processor (50) is communicatively connected to the camera module (10), and the image processor (50) is used to acquire image data from the camera module (10) and process the image data.

Images