Image sensor, image pickup apparatus, and display device

Abstract

The embodiment of the present application provides an image sensor, a camera device and a display device, relates to the optical technical field, and is used for solving the problem of low photon utilization rate of an image sensor or a display device caused by an existing color filter. The image sensor comprises a color filter, a first photodiode, a second photodiode, a third photodiode and a light splitting structure; the color filter comprises a first color filter unit and a second color filter unit; the first color filter unit allows first color light and second color light in three primary color lights to transmit, and the second color filter unit allows second color light and third color light in the three primary color lights to transmit; and the light splitting structure is used for transmitting the first color light from the first color filter unit to the first photodiode, transmitting the second color light to the second photodiode, and transmitting the second color light from the second color filter unit to the second photodiode and transmitting the third color light to the third photodiode.

Description

Technical Field

[0001] This application relates to the field of optical technology, and in particular to an image sensor, camera equipment, and display device. Background Technology

[0002] Currently, color filters (CFs) are widely used in optical equipment, such as image sensors or display devices. Existing color filters (CFs) include red (R), green (G), and blue (B) filter units. Taking the application of color filters in image sensors as an example, image sensors are an important component of camera equipment, capable of converting optical images into digital signals. Figure 1 As shown, existing image sensors mainly include color filters and multiple photodiodes (PDs). Each red filter unit R, each green filter unit G, and each blue filter unit B in the color filter CF is associated with a photodiode PD. The red filter unit R, green filter unit G, and blue filter unit B in the color filter CF filter the natural light from the lens to obtain red light R, green light G, and blue light B, respectively. Each photodiode PD receives the light filtered by its corresponding red filter unit R, green filter unit G, or blue filter unit B, and converts the corresponding optical signal into an electrical signal. This electrical signal is then processed by the image processor to reconstruct a full-color R / G / B image.

[0003] However, in both image sensors and display devices, because the red filter unit R, green filter unit G, and blue filter unit B of the color filter CF can only transmit one color of light and absorb the other two colors, for image sensors, 2 / 3 of the photons in the natural light sent from the lens are absorbed by the color filter CF, and only 1 / 3 are received by the photodiode PD; for display devices, 2 / 3 of the photons in the white light provided by the backlight are absorbed by the color filter CF, and only 1 / 3 can be received by the viewer. This results in a relatively low utilization rate of photons. Summary of the Invention

[0004] This application provides an image sensor, camera device, and display device to solve the problem of low photon utilization in image sensors or display devices caused by existing color filters.

[0005] To achieve the above objectives, this application adopts the following technical solution:

[0006] In a first aspect, an image sensor is provided. The image sensor includes a color filter, a photodiode array, and a beam splitter. The color filter includes a plurality of first color filter units and a plurality of second color filter units. At least any one of the plurality of first color filter units allows the transmission of a first color light and a second color light from the three primary colors of light, and at least any one of the plurality of second color filter units allows the transmission of a second color light and a third color light from the three primary colors of light. The photodiode array is disposed on the light-emitting side of the color filter and includes a plurality of first photodiodes, a plurality of second photodiodes, and a plurality of third photodiodes. The beam splitter is disposed between the color filter and the photodiode array. The beam splitter is used to separate the first color light and the second color light transmitted from the first color filter units, and to transmit the first color light to a first photodiode and the second color light to a second photodiode. The beam splitter is also used to separate the second color light and the third color light transmitted from the second color filter units, and to transmit the second color light to a second photodiode and the third color light to a third photodiode. In this application, "at least any one" refers to one or more.

[0007] Since both the first and second color filter units in the color filter of the image sensor allow two colors of light to pass through—specifically, the first color filter unit allows both first and second color light to pass through, and the second color filter unit allows both second and third color light to pass through—compared to the red, green, and blue filter units in prior art image sensors that can only transmit one color of light, this application can increase the amount of light received, i.e., improve photon utilization. Furthermore, compared to prior art image sensors where the color filter includes red, green, and blue filter units, in this application, the area of ​​the first or second color filter unit corresponding to the first, second, and third photodiodes is twice the area of ​​the red, green, and blue filter units corresponding to the first, second, and third photodiodes in the prior art. Therefore, in this application, the amount of light received by the first, second, and third photodiodes is increased by two times.

[0008] Based on this, compared to the case where the color filter in the image sensor of the prior art includes a red filter unit, a green filter unit and a blue filter unit, in this application, each first photodiode, each second photodiode and each third photodiode, that is, each first color pixel, each second color pixel and each third color pixel in the pixel matrix, receives the light after the white light is distributed in the pixel space corresponding to the two color filter units in the prior art. Therefore, only a small amount of spatial resolution is lost, and the spatial resolution is 70% of that of the prior art.

[0009] Furthermore, in the image sensor provided in this application, since the first photodiode receives the first color light from the three primary colors of light, the second photodiode receives the second color light from the three primary colors of light, and the third photodiode receives the third color light from the three primary colors of light, all three primary colors of light can be received by the image sensor, which is beneficial for subsequent image processing. In addition, the first, second, and third photodiodes all receive a single color of light; specifically, the first photodiode receives the first color light, the second photodiode receives the second color light, and the third photodiode receives the third color light. That is to say, the image sensor includes first-color pixels, second-color pixels, and third-color pixels. Compared to an image sensor that includes pixels W+R, pixels WR, pixels W+B, and pixels WB, the difficulty of subsequent algorithm processing in this application is reduced, and no noise is increased.

[0010] In one possible implementation, the beam-splitting structure is further configured to converge the first color light transmitted from the first color filter unit and the second color light. The beam-splitting structure is also configured to converge the second color light transmitted from the second color filter unit and the third color light. Due to the converging function of the beam-splitting structure, more first color light can be transmitted to the first photodiode, and more second color light can be transmitted to the second photodiode. This allows the first photodiode to receive more first color light, and the second photodiode to receive more second color light, thereby increasing the amount and intensity of light received by both photodiodes. Similarly, the converging function of the beam-splitting structure allows the third photodiode to receive more third color light, thereby increasing the amount and intensity of light received by the third photodiode.

[0011] In one possible implementation, the image sensor further includes a plurality of microlenses disposed on the light-incident side of the color filter; the microlenses are used to converge the three primary colors of light and transmit them to the first color filter unit and the second color filter unit. Since the plurality of microlenses disposed on the light-incident side of the color filter can converge the three primary colors of light and transmit them to the first color filter unit and the second color filter unit, the amount and intensity of light transmitted to the color filter can be increased, and the increased amount and intensity of light transmitted to the color filter will in turn increase the amount and intensity of light received by the first photodiode, the second photodiode, and the third photodiode.

[0012] In one possible implementation, a plurality of first photodiodes, a plurality of second photodiodes, and a plurality of third photodiodes are used to form a plurality of 2*2 first photodiode matrices arranged repeatedly along a first direction and a second direction; wherein the first direction is the row direction of the first photodiode matrix, and the second direction is the column direction of the first photodiode matrix. Each first photodiode matrix includes one first photodiode, two second photodiodes, and one third photodiode. This arrangement of the plurality of first photodiodes, second photodiodes, and third photodiodes is beneficial for subsequent image processing.

[0013] In one possible implementation, the first photodiode is located at the upper left corner of the first photodiode matrix, two second photodiodes are located at the upper right and lower left corners of the first photodiode matrix, respectively, and the third photodiode is located at the lower right corner of the first photodiode matrix. When multiple first photodiodes, multiple second photodiodes, and multiple third photodiodes are arranged in this manner, they can be arranged into a Bayer array.

[0014] In one possible implementation, a plurality of first color filter units and a plurality of second color filter units are alternately arranged along two diagonals parallel to the first photodiode matrix; the first color filter units cover the first photodiode and portions of the second photodiodes located in the four neighboring regions of the first photodiode; the second color filter units cover the third photodiode and portions of the second photodiodes located in the four neighboring regions of the third photodiode; each second photodiode is covered by two adjacent first color filter units and two adjacent second color filter units. According to the arrangement of the first and second color filter units and the corresponding design of the first and second color filter units with the first, second, and third photodiodes, it is possible to transmit first-color light transmitted through the first color filter units to the first photodiode, second-color light to the second photodiode, and second-color light transmitted through the second color filter units to the second photodiode, and third-color light to the third photodiode.

[0015] In one possible implementation, the beam-splitting structure includes multiple beam-splitting units; each first photodiode, each second photodiode, and each third photodiode corresponds to four beam-splitting units; each first photodiode receives first-color light split by its corresponding four beam-splitting units, each second photodiode receives second-color light split by its corresponding four beam-splitting units, and each third photodiode receives third-color light split by its corresponding four beam-splitting units. Each beam-splitting unit corresponds to either a first color filter unit or a second color filter unit; the beam-splitting unit corresponding to the first color filter unit receives the first-color light and the second-color light transmitted from the first color filter unit, and separates the first-color light and the second-color light for transmission to a first photodiode and a second photodiode; the beam-splitting unit corresponding to the second color filter unit receives the second-color light and the third-color light transmitted from the second color filter unit, and separates the second-color light and the third-color light for transmission to a second photodiode and a third photodiode.

[0016] In one possible implementation, the beam-splitting structure includes multiple beam-splitting units; each first photodiode, each second photodiode, and each third photodiode corresponds to four beam-splitting units; each first photodiode receives first-color light separated by its corresponding four beam-splitting units, each second photodiode receives second-color light separated by its corresponding four beam-splitting units, and each third photodiode receives third-color light separated by its corresponding four beam-splitting units. Each beam-splitting unit corresponds to a first color filter unit and a second color filter unit. Each beam splitter receives a first color light and a second color light transmitted from the first color filter unit, and separates the first color light and the second color light to a first photodiode and two second photodiodes. It also receives a second color light and a third color light transmitted from the second color filter unit, and separates the second color light and the third color light to a third photodiode and two second photodiodes. Alternatively, each beam splitter receives both the first color light and the second color light transmitted from the first color filter unit, and receives both the second color light and the third color light transmitted from the second color filter unit. It then transmits the first color light to a first photodiode, the second color light to a second photodiode, and the third color light to a third photodiode.

[0017] In one possible implementation, the beam-splitting structure includes multiple beam-splitting units; each first photodiode and each third photodiode correspond to four beam-splitting units; each first photodiode receives first-color light split by its corresponding four beam-splitting units, and each third photodiode receives third-color light split by its corresponding four beam-splitting units; each second photodiode corresponds to one beam-splitting unit; and each second photodiode receives second-color light split by its corresponding beam-splitting unit. Each beam-splitting unit corresponds to two opposing first color filter units and two opposing second color filter units. Each beam-splitting unit receives light transmitted through the two opposing first color filter units and the two opposing second color filter units, and transmits the second-color light to one second photodiode, the first-color light to the two opposing first photodiodes, and the third-color light to the two opposing third photodiodes.

[0018] In one possible implementation, the beam-splitting structure comprises an array of multiple micro / nano dielectric pillars. These pillars do not absorb light; light rays encountering them experience phase delay. The phase of the multiple pillars changes continuously, altering the direction and angle of the light rays. Furthermore, the direction and angle of light rays of different wavelengths differ after passing through the pillars, thus enabling the separation of different wavelengths of light.

[0019] In one possible implementation, the first color filter unit is a yellow filter unit, and the second color filter unit is a cyan filter unit. After the three primary colors of light pass through the yellow filter unit, only red and green light can pass through, while blue light is absorbed. After the three primary colors of light pass through the cyan filter unit, only green and blue light can pass through, while red light is absorbed.

[0020] In one possible implementation, the first color light is red, the second color light is green, and the third color light is blue. Red, green, and blue light constitute the three primary colors of light, so subsequent image processing can form a color image.

[0021] Secondly, an image sensor is provided. The image sensor includes a color filter, a photodiode array, and a beam splitting structure. The color filter includes a plurality of first color filter units, a plurality of second color filter units, and a plurality of third color filter units; at least one of the plurality of first color filter units allows infrared light and a first color of the three primary colors of light to pass through; at least one of the plurality of second color filter units allows infrared light and a second color of the three primary colors of light to pass through; and at least one of the plurality of third color filter units allows infrared light and a third color of the three primary colors of light to pass through. The photodiode array is disposed on the light-emitting side of the color filter, and the photodiode array includes a plurality of first photodiodes, a plurality of second photodiodes, a plurality of third photodiodes, and a plurality of fourth photodiodes. A beam-splitting structure is disposed between the color filter and the first photodiode, the second photodiode, the third photodiode, and the fourth photodiode. The beam-splitting structure is used to separate the first color light and infrared light transmitted from the first color filter unit, the second color light and infrared light transmitted from the second color filter unit, and the third color light and infrared light transmitted from the third color filter unit. The first color light is transmitted to the first photodiode, the second color light is transmitted to the second photodiode, the third color light is transmitted to the third photodiode, and the infrared light is transmitted to the fourth photodiode.

[0022] In this application, since the first, second, and third color filter units in the color filter can all transmit infrared light and another color of light, the light intake can be increased, thus improving photon utilization. Furthermore, compared to the prior art image sensor's color filter which includes red, green, and blue filter units, the light intake received by the first, second, third, and fourth photodiodes in this application is increased by two times. Based on this, compared to the prior art image sensor's color filter which includes red, green, and blue filter units, in this application, each of the first, second, third, and fourth photodiodes—that is, each first-color pixel, second-color pixel, third-color pixel, and fourth-third-color pixel in the pixel matrix—receives light after white light allocation within the pixel space corresponding to the two color filter units in the prior art. Therefore, only a slight loss of spatial resolution is achieved, with the spatial resolution being 70% of that in the prior art. Furthermore, since the first, second, third, and fourth photodiodes in the application can receive light of the three primary colors, and all of them receive light of a single color, the difficulty of subsequent algorithm processing can be reduced. In addition, since the image sensor provided in the second aspect is also used to receive infrared light, infrared light can be used for imaging, thereby making the image obtained from subsequent image processing more accurate.

[0023] In one possible implementation, the beam-splitting structure is further configured to converge first-color light transmitted from the first color filter unit, second-color light transmitted from the second color filter unit, third-color light transmitted from the third color filter unit, and infrared light transmitted from the first, second, and third color filter units. Refer to the description of the related technical effects of the first aspect above; further details are omitted here.

[0024] In one possible implementation, the image sensor further includes a plurality of microlenses disposed on the light-incident side of the color filter; the microlenses are used to converge the three primary colors of light and infrared light and transmit them to the first color filter unit, the second color filter unit, and the third color filter unit. Refer to the description of the relevant technical effects in the first aspect above, which will not be repeated here.

[0025] In one possible implementation, the image sensor further includes a first infrared cut-off filter disposed between the beam-splitting structure and the first, second, and third photodiodes. The first infrared cut-off filter filters out infrared light. The first infrared cut-off filter includes multiple cutout areas, and the projection of the fourth photodiode onto the first infrared cut-off filter overlaps with these cutout areas. Because the first infrared cut-off filter is disposed between the beam-splitting structure and the photodiode array, infrared light transmitted through the beam-splitting structure is absorbed by the first infrared cut-off filter during its transmission to the first, second, and third photodiodes. This prevents the first, second, and third photodiodes from receiving infrared light, ensuring that they receive only a single color of light, which is beneficial for the accuracy of subsequent image processing. Since the first infrared cut-off filter includes cutout areas, and the projection of the fourth photodiode onto the first infrared cut-off filter overlaps with these cutout areas, infrared light transmitted through the beam-splitting structure can be transmitted to and received by the fourth photodiode.

[0026] In one possible implementation, a first color filter unit covers a first photodiode and portions of a fourth photodiode located in the four neighboring regions of the first photodiode; a second color filter unit covers a second photodiode and portions of a fourth photodiode located in the four neighboring regions of the second photodiode; and a third color filter unit covers a third photodiode and portions of a fourth photodiode located in the four neighboring regions of the third photodiode. This design allows first-color light and infrared light transmitted through the first color filter unit to be transmitted to the first and fourth photodiodes, respectively; second-color light and infrared light transmitted through the second color filter unit to be transmitted to the second and fourth photodiodes, respectively; and third-color light and infrared light transmitted through the third color filter unit to be transmitted to the third and fourth photodiodes, respectively.

[0027] In one possible implementation, a row of first photodiodes, a row of fourth photodiodes, a row of second photodiodes, a row of fourth photodiodes, a row of third photodiodes, and a row of fourth photodiodes are arranged alternately along a first direction. This arrangement of multiple first photodiodes, multiple second photodiodes, multiple third photodiodes, and multiple fourth photodiodes is beneficial for subsequent image processing.

[0028] In one possible implementation, a plurality of first photodiodes, a plurality of second photodiodes, a plurality of third photodiodes, and a plurality of fourth photodiodes are used to form a plurality of 2*2 second photodiode matrices and 2*2 third photodiode matrices arranged alternately along a first direction and a second direction; wherein, the first direction is the row direction of the second photodiode matrices and the third photodiode matrices, and the second direction is the column direction of the second photodiode matrices and the third photodiode matrices. Each second photodiode matrix includes one first photodiode, one second photodiode, and two fourth photodiodes; each third photodiode matrix includes one second photodiode, one third photodiode, and two fourth photodiodes. This arrangement of the plurality of first photodiodes, second photodiodes, third photodiodes, and fourth photodiodes is beneficial for subsequent image processing.

[0029] In one possible implementation, in the second photodiode matrix, two fourth photodiodes are located at the upper left and lower right corners of the second photodiode matrix, respectively, and the first and second photodiodes are located at the upper right and lower left corners of the second photodiode matrix, respectively; in the third photodiode matrix, two fourth photodiodes are located at the upper left and lower right corners of the third photodiode matrix, respectively, and the second and third photodiodes are located at the lower left and upper right corners of the third photodiode matrix, respectively.

[0030] In one possible implementation, the beam splitting structure includes multiple beam splitting units, with each first photodiode, each second photodiode, each third photodiode, and each fourth photodiode corresponding to four beam splitting units; each first photodiode is used to receive first color light split by its corresponding four beam splitting units, each second photodiode is used to receive second color light split by its corresponding four beam splitting units, each third photodiode is used to receive third color light split by its corresponding four beam splitting units, and each fourth photodiode is used to receive infrared light split by its corresponding four beam splitting units. Each beam splitting unit corresponds to one of the first color filter unit, the second color filter unit, and the third color filter unit; the beam splitting unit corresponding to the first color filter unit receives the first color light and infrared light transmitted from the first color filter unit, and separates the first color light and infrared light for transmission to the first photodiode and the fourth photodiode; the beam splitting unit corresponding to the second color filter unit receives the second color light and infrared light transmitted from the second color filter unit, and separates the second color light and infrared light for transmission to the second photodiode and the fourth photodiode; the beam splitting unit corresponding to the third color filter unit receives the third color light and infrared light transmitted from the third color filter unit, and separates the third color light and infrared light for transmission to the third photodiode and the fourth photodiode.

[0031] In one possible implementation, the beam splitting structure includes multiple beam splitting units, with each first photodiode, each second photodiode, and each third photodiode corresponding to one beam splitting unit; each first photodiode is used to receive a first color light split by its corresponding beam splitting unit, each second photodiode is used to receive a second color light split by its corresponding beam splitting unit, and each third photodiode is used to receive a third color light split by its corresponding beam splitting unit; each fourth photodiode corresponds to four beam splitting units and is used to receive infrared light split by any one of the four beam splitting units. Each beam splitting unit corresponds to one of the first color filter unit, the second color filter unit, and the third color filter unit; the beam splitting unit corresponding to the first color filter unit receives the first color light and infrared light transmitted from the first color filter unit, and transmits the first color light and infrared light to the first photodiode and any fourth photodiode in its four neighboring regions, respectively; the beam splitting unit corresponding to the second color filter unit receives the second color light and infrared light transmitted from the second color filter unit, and transmits the second color light and infrared light to the second photodiode and any fourth photodiode in its four neighboring regions, respectively; the beam splitting unit corresponding to the third color filter unit receives the third color light and infrared light transmitted from the third color filter unit, and transmits the third color light and infrared light to the third photodiode and any fourth photodiode in its four neighboring regions, respectively.

[0032] In one possible implementation, the beam-splitting structure includes multiple beam-splitting units, with each first photodiode, each second photodiode, and each third photodiode corresponding to four beam-splitting units. Each first photodiode receives first-color light separated by its corresponding four beam-splitting units, each second photodiode receives second-color light separated by its corresponding four beam-splitting units, each third photodiode receives third-color light separated by its corresponding four beam-splitting units, and each fourth photodiode corresponds to one beam-splitting unit and receives infrared light separated by its corresponding beam-splitting unit. Each beam-splitting unit corresponds to two sets of two first-color filter units, two second-color filter units, and two third-color filter units; for example, a beam-splitting unit corresponds to two first-color filter units and two second-color filter units. A beam-splitting unit corresponding to two first color filter units and two second color filter units receives first-color light and infrared light transmitted from the two first color filter units, and receives second-color light and infrared light transmitted from the two second color filter units. It then transmits the first-color light to two first photodiodes, the second-color light to two second photodiodes, and the infrared light to a fourth photodiode. A beam-splitting unit corresponding to two second-color filter units and two third color filter units receives second-color light and infrared light transmitted from the two second-color filter units, and receives third-color light and infrared light transmitted from the two third color filter units. It then transmits the second-color light to two second photodiodes, the third-color light to two third photodiodes, and the infrared light to a fourth photodiode. The beam splitting unit corresponding to the two third color filter units and the two first color filter units receives the third color light and infrared light transmitted from the two third color filter units, and receives the first color light and infrared light transmitted from the two first color filter units. It transmits the first color light to the two first photodiodes, the third color light to the two third photodiodes, and the infrared light to a fourth photodiode.

[0033] In one possible implementation, the beam splitting structure includes multiple beam splitting units, with each first photodiode, each second photodiode, and each third photodiode corresponding to four beam splitting units; each first photodiode is used to receive first-color light split by its corresponding four beam splitting units, each second photodiode is used to receive second-color light split by its corresponding four beam splitting units, each third photodiode is used to receive third-color light split by its corresponding four beam splitting units, and each fourth photodiode corresponds to one beam splitting unit and is used to receive infrared light split by its corresponding beam splitting unit. Each beam splitter corresponds to one first color filter unit, two second color filter units, and one third color filter unit. Each beam splitter receives first color light transmitted through its corresponding first color filter unit and transmits the first color light to a first photodiode. It also receives second color light transmitted through its corresponding second color filter unit and transmits the second color light to two second photodiodes. Furthermore, it receives third color light transmitted through its corresponding third color filter unit and transmits the third color light to a third photodiode. Each beam splitter also receives infrared light transmitted from the first, second, and third color filter units and transmits the infrared light to a fourth photodiode.

[0034] In one possible implementation, the beam-splitting structure includes multiple beam-splitting units, with each first photodiode, each second photodiode, each third photodiode, and each fourth photodiode corresponding to four beam-splitting units. Each first photodiode receives first-color light separated by its corresponding four beam-splitting units, each second photodiode receives second-color light separated by its corresponding four beam-splitting units, each third photodiode receives third-color light separated by its corresponding four beam-splitting units, and each fourth photodiode receives infrared light separated by its corresponding four beam-splitting units. Each beam-splitting unit corresponds to any one of the following combinations: two first color filter units, two second color filter units, two third color filter units, first color filter units and second color filter units, second color filter units and third color filter units, or third color filter units and first color filter units. For example, a beam-splitting unit corresponds to two first color filter units; or, for another example, a beam-splitting unit corresponds to both first and second color filter units. A beam splitter corresponding to each of the two first color filter units receives first-color light and infrared light transmitted from the first color filter units, and transmits the first-color light to two first photodiodes and the infrared light to two fourth photodiodes. A beam splitter corresponding to each of the two second color filter units receives second-color light and infrared light transmitted from the second color filter units, and transmits the second-color light to two second photodiodes and the infrared light to two fourth photodiodes. A beam splitter corresponding to each of the two third color filter units receives third-color light and infrared light transmitted from the third color filter units, and transmits the third-color light to two third photodiodes and the infrared light to two fourth photodiodes. A beam splitter corresponding to each of the first and second color filter units receives both first-color light and infrared light transmitted from the first color filter units and second-color light and infrared light transmitted from the second color filter units, and transmits the first-color light to the first photodiode, the second-color light to the second photodiode, and the infrared light to the two fourth photodiodes. A beam-splitting unit corresponding to the second and third color filter units receives the second color light and infrared light transmitted from the second color filter unit, and receives the third color light and infrared light transmitted from the third color filter unit. It then transmits the second color light to the second photodiode, the third color light to the third photodiode, and the infrared light to two fourth photodiodes. A beam-splitting unit corresponding to the third and first color filter units receives the third color light and infrared light transmitted from the two third color filter units, and receives the first color light and infrared light transmitted from the two first color filter units. It then transmits the first color light to the first photodiode, the third color light to the third photodiode, and the infrared light to the fourth photodiode.

[0035] In one possible implementation, the beam splitting structure includes multiple beam splitting units, with each first photodiode, each second photodiode, each third photodiode, and each fourth photodiode corresponding to four beam splitting units; each first photodiode is used to receive first color light split by its corresponding four beam splitting units, each second photodiode is used to receive second color light split by its corresponding four beam splitting units, each third photodiode is used to receive third color light split by its corresponding four beam splitting units, and each fourth photodiode is used to receive infrared light split by its corresponding four beam splitting units. Each beam splitter corresponds to a first color filter unit and a second color filter unit, or to a second color filter unit and a third color filter unit. The beam splitter corresponding to the first color filter unit and the second color filter unit receives first color light and infrared light transmitted from the first color filter unit, and receives second color light and infrared light transmitted from the second color filter unit. It then transmits the first color light to a first photodiode, the second color light to a second photodiode, and the infrared light to two fourth photodiodes. The beam splitter corresponding to the second color filter unit and the third color filter unit receives second color light and infrared light transmitted from the second color filter unit, and receives third color light and infrared light transmitted from the third color filter unit. It then transmits the second color light to a second photodiode, the third color light to a third photodiode, and the infrared light to two fourth photodiodes.

[0036] Thirdly, an image sensor is provided. The image sensor includes a color filter, a photodiode array, and a beam-splitting structure. The color filter includes multiple first color filter units, multiple second color filter units, multiple third color filter units, and multiple cutout areas. At least one of the multiple first color filter units allows the transmission of a first color of the three primary colors of light; at least one of the multiple second color filter units allows the transmission of a second color of the three primary colors of light; and at least one of the multiple third color filter units allows the transmission of a third color of the three primary colors of light. The photodiode array is disposed on the light-emitting side of the color filter. The photodiode array includes multiple first photodiodes corresponding to the first color filter units, multiple second photodiodes corresponding to the second color filter units, multiple third photodiodes corresponding to the third color filter units, and multiple fourth photodiodes corresponding to the cutout areas. The beam-splitting structure is located on the light-incident side of the color filter. The beam-splitting structure is used to separate infrared light and the three primary color light. The infrared light is transmitted through the cutout area of ​​the color filter to the fourth photodiode, and the three primary color light is transmitted to the first color filter unit, the second color filter unit, and the third color filter unit.

[0037] In this application, because the beam-splitting structure first separates the three primary colors and infrared light, the three primary colors are transmitted to the first, second, and third color filter units of the color filter, while the infrared light is transmitted to the fourth photodiode through the cutout area of ​​the color filter. Compared to the prior art, where the color filter corresponding to the fourth photodiode absorbs the three primary colors, this application can increase the amount of light received. Furthermore, compared to the prior art where the color filter in the image sensor includes a red filter unit, a green filter unit, and a blue filter unit, in this application, each of the first, second, third, and fourth photodiodes—that is, each of the first, second, third, and fourth color pixels in the pixel matrix—receives light after white light distribution within the pixel space corresponding to the two color filter units in the prior art. Therefore, only a small amount of spatial resolution is lost, resulting in a spatial resolution of 70% of that in the prior art. In addition, since the first photodiode, second photodiode, third photodiode and fourth photodiode in this application can receive three primary colors of light, and the light they receive is all of a single color, the difficulty of subsequent algorithm processing can be reduced.

[0038] In one possible implementation, a row of first photodiodes, a row of fourth photodiodes, a row of second photodiodes, a row of fourth photodiodes, a row of third photodiodes, and a row of fourth photodiodes are arranged alternately along a first direction. Refer to the description of the related technical effects above; further details are omitted here.

[0039] In one possible implementation, a plurality of first photodiodes, a plurality of second photodiodes, a plurality of third photodiodes, and a plurality of fourth photodiodes are used to form a plurality of 2*2 second photodiode matrices and 2*2 third photodiode matrices arranged alternately along a first direction and a second direction; wherein, the first direction is the row direction of the second photodiode matrices and the third photodiode matrices, and the second direction is the column direction of the second photodiode matrices and the third photodiode matrices. Each second photodiode matrix includes one first photodiode, one second photodiode, and two fourth photodiodes; each third photodiode matrix includes one second photodiode, one third photodiode, and two fourth photodiodes. Refer to the description of the related technical effects above; further details are omitted here.

[0040] In one possible implementation, in the second photodiode matrix, two fourth photodiodes are located at the upper left and lower right corners of the second photodiode matrix, respectively, while the first and second photodiodes are located at the upper right and lower left corners of the second photodiode matrix, respectively. In the third photodiode matrix, two fourth photodiodes are located at the upper left and lower right corners of the third photodiode matrix, respectively, while the second and third photodiodes are located at the lower left and upper right corners of the third photodiode matrix, respectively. Refer to the description of the related technical effects above; further details are omitted here.

[0041] In one possible implementation, the beam splitting structure includes multiple beam splitting units, with each first photodiode, each second photodiode, and each third photodiode corresponding to four beam splitting units. Each first photodiode is used to receive first-color light split by its corresponding four beam splitting units and filtered by a first color filter unit. Each second photodiode is used to receive second-color light split by its corresponding four beam splitting units and filtered by a second color filter unit. Each third photodiode is used to receive third-color light split by its corresponding four beam splitting units and filtered by a third color filter unit. Each fourth photodiode corresponds to one beam splitting unit and is used to receive infrared light split by its corresponding beam splitting unit.

[0042] Fourthly, an image sensor is provided. The image sensor includes a photodiode array and a beam-splitting structure. The photodiode array includes multiple first photodiodes, multiple second photodiodes, multiple third photodiodes, and multiple fourth photodiodes. The beam-splitting structure is disposed on the light-incident side of the multiple first photodiodes, multiple second photodiodes, multiple third photodiodes, and multiple fourth photodiodes. The beam-splitting structure is used to transmit received first-color light to the first photodiodes, receive second-color light to the second photodiodes, transmit received third-color light to the third photodiodes, and transmit received infrared light to the fourth photodiodes.

[0043] Because the beam-splitting structure in the image sensor provided in this application directly transmits the first color light to the first photodiode, the second color light to the second photodiode, the third color light to the third photodiode, and the infrared light to the fourth photodiode, and does not absorb light, the light intake of the image sensor can be increased. Furthermore, compared to the prior art image sensors where the color filters include red, green, and blue filter units, in this application, each of the first, second, third, and fourth photodiodes—that is, each first-color pixel, second-color pixel, third-color pixel, and fourth-third-color pixel in the pixel matrix—receives the white light distributed within the pixel space corresponding to the two color filter units in the prior art. Therefore, only a slight loss of spatial resolution is achieved, with the spatial resolution being 70% of that in the prior art. Additionally, because the first, second, third, and fourth photodiodes in this application can receive all three primary colors of light, and all receive a single color, the difficulty of subsequent algorithm processing can be reduced.

[0044] In one possible implementation, a plurality of first photodiodes, a plurality of second photodiodes, a plurality of third photodiodes, and a plurality of fourth photodiodes are used to form a plurality of 2*2 fourth photodiode matrices arranged repeatedly along a first direction and a second direction; wherein the first direction is the row direction of the fourth photodiode matrix, and the second direction is the column direction of the fourth photodiode matrix. Each fourth photodiode matrix includes one first photodiode, one second photodiode, one third photodiode, and one fourth photodiode. This arrangement of the plurality of first photodiodes, second photodiodes, third photodiodes, and fourth photodiodes is beneficial for subsequent image processing.

[0045] In one possible implementation, in the fourth photodiode matrix, the first photodiode is located at the upper left of the fourth photodiode matrix, the second photodiode is located at the upper right of the fourth photodiode matrix, the third photodiode is located at the lower right of the fourth photodiode matrix, and the fourth photodiode is located at the lower left of the fourth photodiode matrix.

[0046] In one possible implementation, the beam splitting structure includes multiple beam splitting units, with each first photodiode, each second photodiode, each third photodiode, and each fourth photodiode corresponding to four beam splitting units; each beam splitting unit corresponds to one first photodiode, one second photodiode, one third photodiode, and one fourth photodiode, and is used to transmit received first color light to the first photodiode, receive second color light to the second photodiode, receive third color light to the third photodiode, and receive infrared light to the fourth photodiode.

[0047] Fifthly, a camera device is provided. The camera device includes a lens and an image sensor; the lens is used to focus light emitted or reflected from an object being photographed onto the image sensor; the image sensor is used to convert a received optical image into a digital signal; wherein the image sensor is the image sensor provided in the first aspect described above; the camera device further includes a second infrared cut-off filter; the second infrared cut-off filter is disposed between the lens and the image sensor for filtering out infrared light; or, the image sensor is the image sensor provided in the second, third, or fourth aspect described above.

[0048] In one possible implementation, the camera device further includes an image processor; the image processor processes digital signals and outputs an image of the object being photographed. A color image can be obtained after processing by the image processor.

[0049] Sixthly, a display device is provided. The display device includes a liquid crystal display panel, a backlight, and a beam-splitting structure. The liquid crystal display panel includes a plurality of first color sub-pixels, a plurality of second color sub-pixels, and a plurality of third color sub-pixels. The backlight is disposed on the light-incident side of the liquid crystal display panel and is used to provide a light source for the liquid crystal display panel. The beam-splitting structure is disposed between the backlight and the liquid crystal display panel and is used to split white light emitted from the backlight into first color light, second color light, and third color light, and to transmit the first color light to the first color sub-pixels, the second color light to the second color sub-pixels, and the third color light to the third color sub-pixels. The display device provided in this application includes a liquid crystal display panel and a backlight, as well as a beam-splitting structure disposed between the liquid crystal display panel and the backlight. Since the beam-splitting structure can split white light emitted from the backlight into a first color light, a second color light, and a third color light, and transmit the first color light to a first color subpixel, the second color light to a second color subpixel, and the third color light to a third color subpixel, it allows the first color light to pass through the first color subpixel of the liquid crystal display panel, the second color light to pass through the second color subpixel, and the third color light to pass through the third color subpixel. Based on this, compared to existing display devices, by providing a color filter on the liquid crystal display panel, which absorbs two colors of white light and transmits the other color light, it ensures that the first color light passes through the first color subpixel of the liquid crystal display panel, the second color light passes through the second color subpixel, and the third color light passes through the third color subpixel. Because this application utilizes a beam-splitting structure for beam splitting, and the beam-splitting structure does not absorb light, it is beneficial to improve the utilization rate of photons provided by the backlight.

[0050] In one possible implementation, the liquid crystal display panel includes a color filter; the color filter includes a plurality of first color filter units corresponding to first color subpixels, a plurality of second color filter units corresponding to second color subpixels, and a plurality of third color filter units corresponding to third color subpixels; at least any one of the plurality of first color filter units allows only first color light to pass through, at least any one of the plurality of second color filter units allows only second color light to pass through, and at least any one of the plurality of third color filter units allows only third color light to pass through. By providing a color filter in the liquid crystal display panel, it is ensured that the light passing through the first, second, and third color subpixels of the liquid crystal display panel is all of a single color, preventing color cross-contamination and thus improving the display effect of the display device.

[0051] In one possible implementation, the display device further includes an upper polarizer and a lower polarizer disposed on both sides of the liquid crystal display panel. Attached Figure Description

[0052] Figure 1 A schematic diagram of the structure of an image sensor provided for the prior art;

[0053] Figure 2 A schematic diagram of the structure of a camera device provided for an embodiment of this application;

[0054] Figure 3a A schematic diagram of the structure of an image sensor provided for an embodiment of this application;

[0055] Figure 3b for Figure 3a A schematic diagram of the spectral dispersion of the micro / nano dielectric pillar in the provided image sensor;

[0056] Figure 4a A schematic diagram of the structure of an image sensor is provided for another embodiment of this application;

[0057] Figure 4b for Figure 4a A schematic diagram of the structure of each pixel receiving light in the provided image sensor;

[0058] Figure 5 A schematic diagram of the structure of an image sensor provided for yet another embodiment of this application;

[0059] Figure 6 A schematic diagram of the arrangement structure of a plurality of first photodiodes, a plurality of second photodiodes, and a plurality of third photodiodes provided for embodiments of this application;

[0060] Figure 7a A schematic diagram of the structure of a first color filter unit and a second color filter unit in a color filter provided for embodiments of this application;

[0061] Figure 7b A schematic diagram of the corresponding design structure of a photodiode array and a color filter provided for an embodiment of this application;

[0062] Figure 8 A schematic diagram of a spectral dispersive structure provided for an embodiment of this application;

[0063] Figure 9 A schematic diagram of the structure of an image sensor provided for yet another embodiment of this application;

[0064] Figure 10a A schematic diagram of the corresponding design structure of a beam splitting unit and a photodiode array provided for an embodiment of this application;

[0065] Figure 10b A schematic diagram of a beam-splitting structure provided for an embodiment of this application;

[0066] Figure 11a A schematic diagram of a corresponding design structure of a beam splitting unit and a photodiode array provided for another embodiment of this application;

[0067] Figure 11b A schematic diagram of a beam-splitting structure provided for another embodiment of this application;

[0068] Figure 11c A schematic diagram of a spectral dispersion structure provided for another embodiment of this application;

[0069] Figure 12a A schematic diagram of the corresponding design structure of a beam splitting unit and a photodiode array provided for another embodiment of this application;

[0070] Figure 12b A schematic diagram of a spectral dispersion structure provided for another embodiment of this application;

[0071] Figure 12c A schematic diagram of a spectral dispersion structure provided for another embodiment of this application;

[0072] Figure 13 A schematic diagram of the structure of an image sensor provided for yet another embodiment of this application;

[0073] Figure 14 A schematic diagram of the arrangement structure of a plurality of first photodiodes, a plurality of second photodiodes, a plurality of third photodiodes, and a plurality of fourth photodiodes provided for embodiments of this application;

[0074] Figure 15 A schematic diagram of an arrangement structure of a plurality of first photodiodes, a plurality of second photodiodes, a plurality of third photodiodes, and a plurality of fourth photodiodes provided for another embodiment of this application;

[0075] Figure 16a A schematic diagram of a corresponding design structure of a photodiode array and a color filter provided for another embodiment of this application;

[0076] Figure 16b A schematic diagram of a corresponding design structure of a photodiode array and a color filter provided for another embodiment of this application;

[0077] Figure 17 A schematic diagram of the structure of an image sensor provided for yet another embodiment of this application;

[0078] Figure 18a A schematic diagram of the corresponding design structure of a beam splitting unit and a photodiode array provided for another embodiment of this application;

[0079] Figure 18b A schematic diagram of the corresponding design structure of a beam splitting unit and a photodiode array provided for another embodiment of this application;

[0080] Figure 18c A schematic diagram of a spectral dispersion structure provided for another embodiment of this application;

[0081] Figure 18d A schematic diagram of a spectral dispersion structure provided for another embodiment of this application;

[0082] Figure 19a A schematic diagram of the corresponding design structure of a beam splitting unit and a photodiode array provided for another embodiment of this application;

[0083] Figure 19b A schematic diagram of the corresponding design structure of a beam splitting unit and a photodiode array provided for another embodiment of this application;

[0084] Figure 19c A schematic diagram of a spectral dispersion structure provided for another embodiment of this application;

[0085] Figure 19d A schematic diagram of a spectral dispersion structure provided for another embodiment of this application;

[0086] Figure 20a A schematic diagram of the corresponding design structure of a beam splitting unit and a photodiode array provided for another embodiment of this application;

[0087] Figure 20b A schematic diagram of a spectral dispersion structure provided for another embodiment of this application;

[0088] Figure 21a A schematic diagram of the corresponding design structure of a beam splitting unit and a photodiode array provided for another embodiment of this application;

[0089] Figure 21b A schematic diagram of a spectral dispersion structure provided for another embodiment of this application;

[0090] Figure 22a A schematic diagram of the corresponding design structure of a beam splitting unit and a photodiode array provided for another embodiment of this application;

[0091] Figure 22b A schematic diagram of a spectral dispersion structure provided for another embodiment of this application;

[0092] Figure 23a A schematic diagram of the corresponding design structure of a beam splitting unit and a photodiode array provided for another embodiment of this application;

[0093] Figure 23b A schematic diagram of a spectral dispersion structure provided for another embodiment of this application;

[0094] Figure 24 A schematic diagram of the structure of an image sensor provided for yet another embodiment of this application;

[0095] Figure 25a A schematic diagram of a spectral dispersion structure provided for another embodiment of this application;

[0096] Figure 25b A schematic diagram of a spectral dispersion structure provided for another embodiment of this application;

[0097] Figure 26 A schematic diagram of the structure of an image sensor provided for yet another embodiment of this application;

[0098] Figure 27 A schematic diagram of the arrangement structure of a plurality of first photodiodes, a plurality of second photodiodes, a plurality of third photodiodes and a plurality of fourth photodiodes provided in another embodiment of this application;

[0099] Figure 28 A schematic diagram of the corresponding design structure of a beam splitting unit and a photodiode array provided for another embodiment of this application;

[0100] Figure 29 A schematic diagram of a spectral dispersion structure provided for another embodiment of this application;

[0101] Figure 30 A schematic diagram of the structure of a display device provided for an embodiment of this application;

[0102] Figure 31 A schematic diagram of the structure of a display panel provided for an embodiment of this application includes a plurality of first color subpixels, second color subpixels and third color subpixels;

[0103] Figure 32 This is a schematic diagram of the structure of a display device provided for another embodiment of this application.

[0104] Figure label:

[0105] 1-Camera equipment; 10-Image sensor; 20-Lens; 30-Image processor; 40-Display device; 100-Second infrared cut-off filter; 101-Color filter; 102-Photodiode array; 103-Beam splitting structure; 104-Microlens; 105-First infrared cut-off filter; 401-Liquid crystal display panel; 401a-First color subpixel; 401b-Second color subpixel; 401c-Third color subpixel; 402-Backlight; 403-Upper polarizer; 404-Lower polarizer; 1011-First color filter unit; 1012-Second color filter unit; 1013-Third color filter unit; 1014-Knockout area; 1031-Micro / nano dielectric pillar; 1032-Beam splitting unit; 4011-Array substrate; 4012-Cell substrate; 4013-Liquid crystal layer. Detailed Implementation

[0106] The technical solutions of the embodiments of this application will be described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this application, and not all embodiments.

[0107] In the following description, the terms "first," "second," etc., are used for descriptive convenience only and should not be construed as indicating or implying relative importance or implicitly specifying the number of technical features indicated. Therefore, a feature defined with "first," "second," etc., may explicitly or implicitly include one or more of that feature. In the description of this application, unless otherwise stated, "a plurality of" means two or more.

[0108] In the embodiments of this application, unless otherwise expressly specified and limited, the term "electrical connection" can be a direct electrical connection or an indirect electrical connection through an intermediate medium.

[0109] In the embodiments of this application, the terms "exemplary" or "for example" are used to indicate that something is an example, illustration, or description. Any embodiment or design that is described as "exemplary" or "for example" in the embodiments of this application should not be construed as being more preferred or advantageous than other embodiments or designs. Specifically, the use of the terms "exemplary" or "for example" is intended to present the relevant concepts in a specific manner.

[0110] In the embodiments of this application, "and / or" describes the relationship between associated objects, indicating that three relationships can exist. For example, A and / or B can represent: A existing alone, A and B existing simultaneously, or B existing alone, where A and B can be singular or plural. The character " / " generally indicates that the preceding and following associated objects have an "or" relationship.

[0111] In the embodiments of this application, the directional indications used to explain the structure and movement of different components, such as up, down, left, right, front, and back, are relative. These indications are appropriate when the components are in the positions shown in the figures. However, if the description of the component positions changes, these directional indications will also change accordingly.

[0112] This application provides a camera device, which can be, for example, a webcam, an internet protocol camera (IPC), a mobile phone with front and / or rear cameras, a tablet with front and / or rear cameras, a digital camera, a digital camcorder, a vehicle-mounted camera, or an industrial camera, or any other device with image acquisition capabilities. Furthermore, the camera device can be applied in the fields of security, photography and videography, automotive electronics, or industrial machine vision.

[0113] like Figure 2 As shown, the aforementioned camera device 1 may include an image sensor 10, a lens 20, and an image processor 30. The lens 20 is used to focus the light emitted or reflected by the object being photographed onto the image sensor 10, which converts the received optical image into a digital signal. The image processor 30 processes the digital signal and outputs an image of the object being photographed; typically, the output image of the object is an R / G / B full-color image.

[0114] The image sensor 10 is an important component of the camera device 1, affecting its performance. To address the low photon utilization rate of existing image sensors 10, this application provides several optional implementation methods for the image sensor.

[0115] In the first alternative implementation, such as Figure 3a As shown, the image sensor 10 includes transparent, irregular micro / nano dielectric pillars and multiple photodiodes (PDs). The micro / nano dielectric pillars can deflect incident light of different wavelengths, directing red (R), green (G), and blue (B) light rays to their respective pixel regions. Each pixel region corresponds to a photodiode (PD). The red pixel (R), green pixel (G), and blue pixel (B) are arranged according to... Figure 3b Taking the arrangement shown as an example, Figure 3bA pixel matrix is ​​indicated by a dashed box. Each pixel matrix includes a green pixel G located in the upper left and lower right corners, a red pixel R located in the upper right corner, and a blue pixel B located in the lower left corner. For a pixel matrix, white light incident on the micro / nano dielectric pillar corresponding to that pixel matrix contains red, green, and blue wavelength components. The micro / nano dielectric pillar deflects the green light to the green pixels G in the lower left and upper right corners, the red light to the red pixel R in the upper right corner, and the blue light to the blue pixel B in the lower left corner, thus achieving an effect similar to existing color filters (CF). Since the transparent micro / nano dielectric pillar itself does not absorb light energy, all incident light can be utilized and deflected to the corresponding pixel areas, thereby increasing the amount of light received.

[0116] However, in the first alternative implementation, since each red pixel R, green pixel G, and blue pixel B in the pixel matrix receives light after the white light in the pixel space corresponding to the 2*2 pixels is distributed, the pixel spatial resolution is reduced. Compared with the case where the color filter 101 in the prior art image sensor 10 includes a red filter unit, a green filter unit, and a blue filter unit, the pixel spatial resolution is 25% of that in the prior art, which does not conform to the principle of spatial sampling.

[0117] In the second optional embodiment, the structure of the image sensor 10 is the same as that in the first optional embodiment, except that in the second optional embodiment, after light strikes the micro / nano dielectric pillar, a diffraction effect occurs at the pillar, thus splitting the white light into red and blue light. Since in the second optional embodiment, each red and blue pixel receives light after allocating the white light within the pixel space corresponding to a 2*1 pixel, this leads to a reduction in pixel spatial resolution, which does not conform to the principle of spatial sampling. Furthermore, since the image sensor 10 generally includes red, green, and blue pixels, the second optional embodiment lacks the crucial green pixel, which is detrimental to subsequent image processing.

[0118] In a third alternative implementation, such as Figure 4a As shown, the image sensor 10 includes transparent, irregular micro / nano dielectric pillars and multiple photodiodes (PDs). White light transmitted from the lens is directly transmitted to the photodiodes (PDs) without passing through the micro / nano dielectric pillars. Conversely, some white light is first transmitted to the micro / nano dielectric pillars, where it is split before being transmitted to different photodiodes (PDs). The micro / nano dielectric pillars can split white light into red light and other colors, or into blue light and other colors. Based on the different colors of the light received by the photodiodes (PDs), such as... Figure 4bAs shown, the pixel matrix includes pixel W+R, pixel WR, pixel W+B, and pixel WB; wherein, the photodiode PD corresponding to pixel W+R receives white light and red light, the photodiode PD corresponding to pixel WR receives white light excluding red light, the photodiode PD corresponding to pixel W+B ​​receives white light and blue light, and the photodiode PD corresponding to pixel WB receives white light excluding blue light.

[0119] In the third alternative implementation, the pixel matrix is ​​not simply red pixel R, green pixel G, and blue pixel B, but rather pixel W+R, pixel WR, pixel W+B, and pixel WB. This color scheme increases the difficulty of post-processing algorithms, and post-processing algorithms will increase noise.

[0120] In order to solve the problems of the image sensor 10 provided by the first, second and third optional embodiments described above, this application also provides an image sensor 10, which can be applied to the camera device 1 described above. The image sensor 10 provided by this application will be described by way of example through four specific embodiments.

[0121] Example 1

[0122] like Figure 5 As shown, the image sensor 10 includes a color filter 101 and a photodiode array 102.

[0123] It should be noted that, when the image sensor 10 provided in Embodiment 1 is applied in the above-described camera device 1, the camera device 1 also includes, for example, Figure 5 The second infrared cut-off filter (IR-cut) 100 is shown; the second infrared cut-off filter 100 is disposed between the lens 20 and the image sensor 10 to filter out infrared light. The wavelength of infrared light is above 700nm, which is much larger than the wavelength of the three primary colors of light.

[0124] In some examples, the second infrared cut-off filter 100 can be set independently of the lens 20 and the image sensor 10. In other examples, the second infrared cut-off filter 100 can also be integrated into the lens 20.

[0125] Since infrared light is filtered out after natural light passes through the second infrared cutoff filter 100, the light transmitted to the color filter 101 in the image sensor 10 is natural light excluding infrared light, which is the three primary colors of light. Because infrared light is blocked, interference with the three primary colors of light can be prevented.

[0126] The aforementioned color filter 101 includes a plurality of first color filter units 1011 and a plurality of second color filter units 1012; at least any one of the plurality of first color filter units 1011 allows the first color light and the second color light of the three primary colors to pass through, and at least any one of the plurality of second color filter units 1012 allows the second color light and the third color light of the three primary colors to pass through.

[0127] It is understandable that the three primary colors of light can include red, green, and blue light. In this case, the first, second, and third colors of light are one of red, green, and blue light, and they are not the same. For example, the first color could be red, the second color could be green, and the third color could be blue. Another example is that the first color could be green, the second color could be red, and the third color could be blue.

[0128] It should be understood that the color filter 101 is coated with an absorptive colored pigment organic material, which allows light of a specific wavelength to pass through while blocking light of other wavelengths. The colored pigment organic materials coated on the first color filter unit 1011 and the second color filter unit 1012 are different. The colored pigment organic material coated on the first color filter unit 1011 allows first and second color light to pass through while blocking other color light, while the colored pigment organic material coated on the second color filter unit 1012 allows second and third color light to pass through while blocking other color light.

[0129] When the first color light is green, the second color light is red, and the third color light is blue, the first color filter unit 1011 can be, for example, a yellow filter unit. After red, green, and blue light pass through the yellow filter unit, only red and green light can pass through, while blue light is absorbed. The second color filter unit 1012 can be, for example, a cyan filter unit. After red, green, and blue light pass through the cyan filter unit, only green and blue light can pass through, while red light is absorbed.

[0130] The aforementioned photodiode array 102 is disposed on the light-emitting side of the color filter 101, and the photodiode array 102 includes a plurality of first photodiodes PD1, a plurality of second photodiodes PD2, and a plurality of third photodiodes PD3.

[0131] It is understandable that the number of the first photodiode PD1, the second photodiode PD2, and the third photodiode PD3 can be set as needed.

[0132] It should be noted that the first photodiode PD1, the second photodiode PD2, and the third photodiode PD3 in the photodiode array 102 are all used to convert the received optical signal into an electrical signal.

[0133] The first photodiode PD1, the second photodiode PD2, and the third photodiode PD3 are each used to receive light of a different color. For example, the first photodiode PD1 receives light of the first color, the second photodiode PD2 receives light of the second color, and the third photodiode PD3 receives light of the third color.

[0134] It should be understood that the first photodiode PD1, the second photodiode PD2, and the third photodiode PD3 each represent a pixel. When the first photodiode PD1 is used to receive the first color light, the second photodiode PD2 is used to receive the second color light, and the third photodiode PD3 is used to receive the third color light, it can be considered that the first photodiode PD1 represents the first color pixel, the second photodiode PD2 represents the second color pixel, and the third photodiode PD3 represents the third color pixel.

[0135] In this first embodiment, the first photodiode PD1 represents a first color pixel, such as red; the second photodiode PD2 represents a second color pixel, such as green; and the third photodiode PD3 represents a third color pixel, such as blue. This first embodiment does not limit the pixel matrix design, that is, the arrangement of the multiple first photodiodes PD1, multiple second photodiodes PD2, and multiple third photodiodes PD3 in the photodiode array 102. The multiple first photodiodes PD1, multiple second photodiodes PD2, and multiple third photodiodes PD3 form a two-dimensional array. Depending on the imaging wavelength, the multiple first photodiodes PD1, multiple second photodiodes PD2, and multiple third photodiodes PD3 can be arranged into different arrays, with photodiodes at different positions used to image light of different wavelengths.

[0136] In one alternative implementation, such as Figure 6As shown, multiple first photodiodes PD1, multiple second photodiodes PD2, and multiple third photodiodes PD3 are used to form multiple 2*2 first photodiode matrices M that are repeatedly arranged along a first direction X and a second direction Y; wherein, the first direction X is the row direction of the first photodiode matrix M, the second direction Y is the column direction of the first photodiode matrix M, and the first direction X and the second direction Y are perpendicular. Each first photodiode matrix M includes one first photodiode PD1, two second photodiodes PD2, and one third photodiode PD3.

[0137] The arrangement of one first photodiode PD1, two second photodiodes PD2, and one third photodiode PD3 in the aforementioned first photodiode matrix M is not limited. In some examples, such as... Figure 6 As shown, in the first photodiode matrix M, the first photodiode PD1 is located at the upper left corner of the first photodiode matrix M, the two second photodiodes PD2 are located at the upper right corner and the lower left corner of the first photodiode matrix M, respectively, and the third photodiode PD3 is located at the lower right corner of the first photodiode matrix M. In this case, the multiple first photodiodes PD1, multiple second photodiodes PD2, and multiple third photodiodes PD3 are arranged in a Bayer array.

[0138] Based on the above, when multiple first photodiodes PD1, multiple second photodiodes PD2, and multiple third photodiodes PD3 are used to form multiple 2*2 first photodiode matrices M (the specific details of the first photodiode matrix M can be found above) arranged repeatedly along the first direction X and the second direction Y, as follows: Figure 7a As shown, the plurality of first color filter units 1011 and the plurality of second color filter units 1012 in the aforementioned color filter 101 can be arranged alternately along two diagonals parallel to the first photodiode matrix M. Based on this, as... Figure 7b As shown, the first color filter unit 1011 covers the first photodiode PD1 and a portion of the second photodiode PD2 located in the four neighboring regions of the first photodiode PD1; the second color filter unit 1012 covers the third photodiode PD3 and a portion of the second photodiode PD2 located in the four neighboring regions of the third photodiode PD3; each second photodiode PD2 is covered by two adjacent first color filter units 1011 and two adjacent second color filter units 1012.

[0139] Here, "the second photodiode PD2 located in the four neighboring regions of the first photodiode PD1" refers to the second photodiode PD2 located in the four directions of the first photodiode PD1 (up, down, left, and right). Similarly, "the second photodiode PD2 located in the four neighboring regions of the third photodiode PD3" refers to the second photodiode PD2 located in the four directions of the third photodiode PD3 (up, down, left, and right).

[0140] Since the light transmitted through the first color filter unit 1011 is a mixture of first and second color light, and the light transmitted through the second color filter unit 1012 is a mixture of second and third color light, and the first photodiode PD1, the second photodiode PD2, and the third photodiode PD3 are each used to receive one color of light, therefore... Figure 5 As shown, the image sensor 10 further includes a color splitter 103, which is disposed between the color filter 101 and the first photodiode PD1, the second photodiode PD2, and the third photodiode PD3. The color splitter 103 is used to separate the first color light and the second color light transmitted from the first color filter unit 1011, and transmit the first color light to the first photodiode PD1 and the second color light to the second photodiode PD2. The color splitter 103 is also used to separate the second color light and the third color light transmitted from the second color filter unit 1012, and transmit the second color light to the second photodiode PD2 and the third color light to the third photodiode PD3.

[0141] In some examples, such as Figure 8 As shown, the aforementioned beam-splitting structure 103 may include an array of multiple micro / nano dielectric pillars 1031. The micro / nano dielectric pillars 1031 can be cylindrical, prismatic, or other regular or irregular shapes; prismatic pillars include square prisms, pentagonal prisms, etc. The shapes of the multiple micro / nano dielectric pillars 1031 may be identical or not entirely the same. Figure 8 The illustration is based on an example where the micro / nano dielectric pillar 1031 is cylindrical and multiple micro / nano dielectric pillars 1031 have the same shape.

[0142] Furthermore, multiple micro / nano dielectric pillars 1031 can be arranged regularly along the row and column directions. In this case, the angle between the row and column directions can be a right angle or an acute angle; of course, multiple micro / nano dielectric pillars 1031 can also be arranged irregularly.

[0143] It should be noted that the micro / nano dielectric pillar 1031 is a small pillar with dimensions in the micro / nano range in all directions, formed by a transparent medium. The micro / nano dielectric pillar 1031 does not absorb light; when light shines on the micro / nano dielectric pillar 1031, a phase delay occurs. The phase of multiple micro / nano dielectric pillars 1031 changes continuously, which can change the direction and angle of light. The principle is similar to that of phased array radar. Moreover, the direction and angle of light of different wavelengths after passing through the micro / nano dielectric pillar 1031 are different, thereby enabling the separation of light of different wavelengths.

[0144] To increase the amount and intensity of light received by the photodiode array 102, this embodiment can be achieved, for example, in the following two ways.

[0145] The first type:

[0146] The beam-splitting structure 103 is also used to converge the first color light transmitted from the first color filter unit 1011 and the second color light, and to transmit the converged first color light to the first photodiode PD1 and the converged second color light to the second photodiode PD2. Due to the converging function of the beam-splitting structure 103, more first color light can be transmitted to the first photodiode PD1 and more second color light can be transmitted to the second photodiode PD2. In this way, the first photodiode PD1 can receive more first color light and the second photodiode PD2 can receive more second color light, thereby increasing the amount and intensity of light received by the first photodiode PD1 and the second photodiode PD2.

[0147] The beam-splitting structure 103 is also used to converge the second-color light transmitted from the second color filter unit 1012 and the third-color light, and to transmit the converged second-color light to the second photodiode PD2 and the converged third-color light to the third photodiode PD3. Similarly, the second photodiode PD2 can receive more second-color light and the third photodiode PD3 can receive more third-color light, thereby further increasing the amount and intensity of light received by the second photodiode PD2 and the third photodiode PD3.

[0148] The second type:

[0149] like Figure 9 As shown, the image sensor 10 also includes a plurality of microlenses 104 disposed on the light-incident side of the color filter 101; the microlenses 104 are used to converge the three primary color lights and transmit them to the first color filter unit 1011 and the second color filter unit 1012.

[0150] Here, one first color filter unit 1011 or one second color filter unit 1012 may correspond to one or more microlenses 104. Considering that the light transmitted from the first color filter unit 1011 and the second color filter unit 1012 still needs to be split into different photodiodes by the beam splitter 103, in order to avoid the light in the area corresponding to one first color filter unit 1011 or one second color filter unit 1012 being entirely focused by the first microlens 104 corresponding to that first color filter unit 1011 or one second color filter unit 1012 when one first color filter unit 1011 or one second color filter unit 1012 corresponds to one microlens 104, which would be detrimental to the beam splitter 103 splitting the light into different photodiodes, based on this, in some examples, one first color filter unit 1011 or one second color filter unit 1012 corresponds to multiple microlenses 104.

[0151] Since the multiple microlenses 104 disposed on the light-incident side of the color filter 101 can converge the three primary colors of light and transmit them to the first color filter unit 1011 and the second color filter unit 1012, the amount and intensity of light transmitted to the color filter 101 can be increased. The increase in the amount and intensity of light transmitted to the color filter 101 will in turn increase the amount and intensity of light received by the first photodiode PD1, the second photodiode PD2 and the third photodiode PD3.

[0152] Based on the above, in the photodiode array 102, a plurality of first photodiodes PD1, a plurality of second photodiodes PD2, and a plurality of third photodiodes PD3, and in the color filter 101, a plurality of first color filter units 1011 and a plurality of second color filter units 1012 are arranged as follows: Figure 7b In the arrangement shown, to ensure that the beam-splitting structure 103 can transmit the first color light transmitted from the multiple first color filter units 1011 to the first photodiode PD1, and the second color light to the second photodiode PD2, and can also transmit the second color light transmitted from the multiple second color filter units 1012 to the second photodiode PD2, and the third color light to the third photodiode PD3, the beam-splitting structure 103 can be divided into multiple beam-splitting units. The following provides several exemplary design relationships between the multiple beam-splitting units and the first photodiode PD1, second photodiode PD2, and third photodiode PD3 in the photodiode array 102, and with the first color filter unit 1011 and the second color filter unit 1012 in the color filter 101.

[0153] The first type:

[0154] like Figure 10aAs shown, the beam splitting structure 103 includes multiple beam splitting units 1032; each first photodiode PD1, each second photodiode PD2, and each third photodiode PD3 corresponds to four beam splitting units 1032; each first photodiode PD1 is used to receive the first color light split by the four beam splitting units 1032 corresponding to it, each second photodiode PD2 is used to receive the second color light split by the four beam splitting units 1032 corresponding to it, and each third photodiode PD3 is used to receive the third color light split by the four beam splitting units 1032 corresponding to it.

[0155] Each beam splitter 1032 corresponds to either a first color filter unit 1011 or a second color filter unit 1012; and each beam splitter 1032 corresponds to two photodiodes, specifically, each beam splitter 1032 corresponds to a first photodiode PD1 and a second photodiode PD2, or each beam splitter 1032 corresponds to a second photodiode PD2 and a third photodiode PD3. For example... Figure 10b As shown, the beam splitting unit 1032 corresponding to the first color filter unit 1011 receives the first color light and the second color light transmitted from the first color filter unit 1011, and separates the first color light and the second color light to a first photodiode PD1 and a second photodiode PD2; the beam splitting unit 1032 corresponding to the second color filter unit 1012 receives the second color light and the third color light transmitted from the second color filter unit 1012, and separates the second color light and the third color light to a second photodiode PD2 and a third photodiode PD3.

[0156] It should be noted that, Figure 10b The first color filter unit 1011 and the second color filter unit 1012 are not shown in the figure. Figure 10b The arrow in the image indicates that the beam splitting unit 1032 performs beam splitting, from... Figure 10b It can be seen that each beam splitting unit 1032 can split the light incident on it into two photodiodes.

[0157] The second type:

[0158] like Figure 11aAs shown, the beam splitting structure 103 includes multiple beam splitting units 1032; each first photodiode PD1, each second photodiode PD2, and each third photodiode PD3 corresponds to four beam splitting units 1032; each first photodiode PD1 is used to receive the first color light split by the four beam splitting units 1032 corresponding to it, each second photodiode PD2 is used to receive the second color light split by the four beam splitting units 1032 corresponding to it, and each third photodiode PD3 is used to receive the third color light split by the four beam splitting units 1032 corresponding to it.

[0159] Each beam splitting unit 1032 corresponds to a first color filter unit 1011 and a second color filter unit 1012, and each beam splitting unit 1032 corresponds to four photodiodes. Specifically, each beam splitting unit 1032 corresponds to a first photodiode PD1, two second photodiodes PD2, and a third photodiode PD3.

[0160] like Figure 11b As shown, each beam splitting unit 1032 receives a first color light and a second color light transmitted from the first color filter unit 1011, and separates the first color light and the second color light to transmit to a first photodiode PD1 and two second photodiodes PD2. Each beam splitting unit 1032 also receives a second color light and a third color light transmitted from the second color filter unit 1012, and separates the second color light and the third color light to transmit to a third photodiode PD3 and two second photodiodes PD2.

[0161] Or, such as Figure 11c As shown, each beam splitting unit 1032 receives first color light and second color light transmitted from the first color filter unit 1011, and receives second color light and third color light transmitted from the second color filter unit 1012, and transmits the first color light to a first photodiode PD1, the second color light to a second photodiode PD2, and the third color light to a third photodiode PD3.

[0162] It should be noted that, Figure 11b and Figure 11c The diagram illustrates the spectral splitting relationship between a beam splitting unit 1032 and the first photodiode matrix M.

[0163] The third type:

[0164] like Figure 12aAs shown, the beam splitting structure 103 includes multiple beam splitting units 1032; each first photodiode PD1 and each third photodiode PD3 corresponds to four beam splitting units 1032; each first photodiode PD1 is used to receive the first color light split by the four beam splitting units 1032 corresponding to it, and each third photodiode PD3 is used to receive the third color light split by the four beam splitting units 1032 corresponding to it; each second photodiode PD2 corresponds to one beam splitting unit 1032; each second photodiode PD2 is used to receive the second color light split by the one beam splitting unit 1032 corresponding to it.

[0165] Each beam splitting unit 1032 corresponds to two opposite first color filter units 1011 and two opposite second color filter units 1012, and each beam splitting unit 1032 corresponds to a second photodiode PD2, two opposite first photodiodes PD1 and two opposite third photodiodes PD3.

[0166] Each beam splitter 1032 receives light transmitted through two opposing first color filter units 1011 and two opposing second color filter units 1012, and transmits the second color light to a second photodiode PD2 corresponding to the beam splitter 1032, transmits the first color light to two opposing first photodiodes PD1, and transmits the third color light to two opposing third photodiodes PD3.

[0167] It should be noted that when each beam splitter 1032 receives light transmitted through two opposing first color filter units 1011 and transmits the first color light to two opposing first photodiodes PD1, each first photodiode PD1 receives light transmitted through its corresponding first color filter unit 1011. Similarly, when each beam splitter 1032 receives light transmitted through two opposing second color filter units 1012 and transmits the third color light to two opposing third photodiodes PD3, each third photodiode PD3 receives light transmitted through its corresponding second color filter unit 1012.

[0168] Here, the second-color light transmitted from the first color filter unit 1011 and the second color filter unit 1012 passes directly through the beam splitter unit 1032 and is transmitted to a second photodiode PD2 corresponding to the beam splitter unit 1032, such as... Figure 12b As shown, the first color light incident on the beam splitter 1032a is transmitted to the upper and lower first photodiodes PD1 respectively, and the third color light incident on the beam splitter 1032a is transmitted to the left and right third photodiodes PD3 respectively, or, as... Figure 12cAs shown, the first color light incident on the beam splitting unit 1032b is transmitted to the left and right first photodiodes PD1 respectively, and the third color light incident on the beam splitting unit 1032b is transmitted to the upper and lower third photodiodes PD3 respectively.

[0169] It should be noted that, in the case where the above-mentioned beam splitting structure 103 includes a plurality of micro-nano dielectric pillars 1031 arranged in an array, each beam splitting unit 1032 may include one or more micro-nano dielectric pillars 1031.

[0170] Based on this, when the image sensor 10 includes multiple microlenses 104, one microlens 104 can correspond to one beam splitting unit 1032. The microlens 104 focuses the light and transmits it through the first color filter unit 1011 or the second color filter unit 1012 to the beam splitting unit 1032 corresponding to that microlens 104. Therefore, the corresponding design relationship between the multiple microlenses 104 and the first photodiode PD1, second photodiode PD2, and third photodiode PD3 in the photodiode array 102, and the first color filter unit 1011 and the second color filter unit 1012 in the color filter 101, can be referenced. Figure 10a , Figure 11a , Figure 12a The design relationships between the multiple beam-splitting units in the first, second, and third cases mentioned above and the first photodiode PD1, the second photodiode PD2, the third photodiode PD3 in the photodiode array 102, and the first color filter unit 1011 and the second color filter unit 1012 in the color filter 101, will not be elaborated here.

[0171] It is understood that the design relationship between the beam splitting unit 1032 and the first photodiode PD1, the second photodiode PD2, the third photodiode PD3 in the photodiode array 102, and the first color filter unit 1011 and the second color filter unit 1012 in the color filter 101 includes, but is not limited to, the above three cases.

[0172] In this first embodiment, since both the first color filter unit 1011 and the second color filter unit 1012 of the color filter 101 in the image sensor 10 can allow two colors of light to pass through, specifically, the first color filter unit 1011 allows the first color light and the second color light to pass through, and the second color filter unit 1012 allows the second color light and the third color light to pass through, compared with the red filter unit, green filter unit and blue filter unit of the color filter 101 in the prior art image sensor 10 which can only transmit one color of light, this first embodiment can increase the amount of light entering, that is, it can improve the photon utilization rate.

[0173] Furthermore, compared to the case where the color filter 101 in the image sensor 10 of the prior art includes a red filter unit, a green filter unit, and a blue filter unit, in this embodiment, the area of ​​the first color filter unit 1011 or the second color filter unit 1012 corresponding to the first photodiode PD1, the second photodiode PD2, and the third photodiode PD3 is twice the area of ​​the red filter unit, the green filter unit, and the blue filter unit corresponding to the first photodiode PD1, the second photodiode PD2, and the third photodiode PD3 in the prior art. Therefore, in this embodiment, the amount of light received by the first photodiode PD1, the second photodiode PD2, and the third photodiode PD3 is increased by 2 times.

[0174] Based on this, compared to the case where the color filter 101 in the image sensor 10 of the prior art includes a red filter unit, a green filter unit, and a blue filter unit, in this embodiment, each first photodiode PD1, each second photodiode PD2, and each third photodiode PD3, that is, each first color pixel, each second color pixel, and each third color pixel in the pixel matrix, receives the light after the white light is distributed in the pixel space corresponding to the two color filter units in the prior art. Therefore, only a small amount of spatial resolution is lost, and the spatial resolution is 70% of that of the prior art.

[0175] Furthermore, in the image sensor 10 provided in this embodiment, since the first photodiode PD1 receives the first color light from the three primary colors of light, the second photodiode PD2 receives the second color light from the three primary colors of light, and the third photodiode PD3 receives the third color light from the three primary colors of light, all three primary colors of light can be received by the image sensor 10, which is beneficial for subsequent image processing. In addition, the first photodiode PD1, the second photodiode PD2, and the third photodiode PD3 all receive a single color of light. Specifically, the first photodiode PD1 receives the first color light, the second photodiode PD2 receives the second color light, and the third photodiode PD3 receives the third color light. That is to say, the image sensor 10 includes first color pixels, second color pixels, and third color pixels. Compared with an image sensor that includes pixels W+R, pixels WR, pixels W+B, and pixels WB, the difficulty of subsequent algorithm processing in this embodiment is reduced, and no noise is increased.

[0176] Considering that in some fields, such as security, color requirements are not high, but shape requirements are high, it is desirable for the image sensor 10 to be able to image RGB-NIR (red, green, blue, and near-infrared) light when it is designed. Based on this, the difference between the image sensor 10 provided in Embodiment 1 and the image sensors 10 provided in Embodiments 2, 3, and 4 is that the image sensor 10 provided in Embodiment 1 is used to image RGB, so in Embodiment 1, the light incident on the image sensor 10 is natural light with infrared light filtered out, that is, the light incident on the image sensor 10 is the three primary colors of light. However, the image sensors 10 provided in Embodiments 2, 3, and 4 are used to image RGB-NIR, so in Embodiments 2, 3, and 4, the light incident on the image sensor 10 is natural light, that is, the light incident on the image sensor 10 includes the three primary colors of light and infrared light.

[0177] Based on this, when the image sensor 10 provided in Embodiments 2, 3 and 4 is applied in the above-mentioned camera device 1, no infrared cut-off filter is provided between the lens 20 and the image sensor 10 in the camera device 1.

[0178] The following describes Examples 2, 3, and 4 respectively.

[0179] Example 2

[0180] like Figure 13 As shown, the image sensor 10 includes a color filter 101 and a photodiode array 102.

[0181] The aforementioned color filter 101 includes a plurality of first color filter units 1011, a plurality of second color filter units 1012, and a plurality of third color filter units 1013; at least one of the plurality of first color filter units 1011 allows infrared light and the first color of the three primary colors of light to pass through, at least one of the plurality of second color filter units 1012 allows infrared light and the second color of the three primary colors of light to pass through, and at least one of the plurality of third color filter units 1013 allows infrared light and the third color of the three primary colors of light to pass through.

[0182] Here, the first color light, the second color light, and the third color light can refer to Embodiment 1 above, and will not be repeated here. When the first color light is green, the second color light is red, and the third color light is blue, the first color filter unit 1011 can be, for example, a red filter unit. After infrared light and the three primary colors of light pass through the red filter unit, only infrared light and red light can pass through, while blue light and green light will be absorbed. The second color filter unit 1012 can be, for example, a green filter unit. After infrared light and the three primary colors of light pass through the green filter unit, only infrared light and green light can pass through, while red light and blue light will be absorbed. The third color filter unit 1013 can be, for example, a blue filter unit. After infrared light and the three primary colors of light pass through the blue filter unit, only infrared light and blue light can pass through, while red light and green light will be absorbed.

[0183] The aforementioned photodiode array 102 is disposed on the light-emitting side of the color filter 101, and the photodiode array 102 includes a plurality of first photodiodes PD1, a plurality of second photodiodes PD2, a plurality of third photodiodes PD3, and a plurality of fourth photodiodes PD4.

[0184] Here, the first photodiode PD1, the second photodiode PD2, and the third photodiode PD3 can be referred to in Embodiment 1 above, and will not be repeated here. The fourth photodiode PD4 is used to receive infrared light, and the fourth photodiode PD4 can represent an infrared light pixel.

[0185] It is understandable that the number of the first photodiode PD1, the second photodiode PD2, the third photodiode PD3, and the fourth photodiode PD4 can be set as needed.

[0186] In this second embodiment, the arrangement of the multiple first photodiodes PD1, multiple second photodiodes PD2, multiple third photodiodes PD3, and multiple fourth photodiodes PD4 in the photodiode array 102 is not limited in terms of pixel matrix design. The multiple first photodiodes PD1, multiple second photodiodes PD2, multiple third photodiodes PD3, and multiple fourth photodiodes PD4 form a two-dimensional array. Depending on the imaging wavelength, the multiple first photodiodes PD1, multiple second photodiodes PD2, multiple third photodiodes PD3, and multiple fourth photodiodes PD4 can be arranged into different arrays, with photodiodes at different positions used to image light of different wavelengths. Since the pixel matrix includes first color pixels, second color pixels, third color pixels, and infrared light pixels, when the first color pixel is a red pixel, the second color pixel is a green pixel, and the third color pixel is a blue pixel, the pixel matrix can be called an RGB-NIR pixel matrix. For the RGB-NIR pixel matrix design, two optional implementation methods are provided below as examples.

[0187] The first optional implementation method is as follows: Figure 14 As shown, a row of first photodiode PD1, a row of fourth photodiode PD4, a row of second photodiode PD2, a row of fourth photodiode PD4, a row of third photodiode PD3, and a row of fourth photodiode PD4 are arranged alternately along the first direction X.

[0188] The second optional implementation method is as follows: Figure 15 As shown, multiple first photodiodes PD1, multiple second photodiodes PD2, multiple third photodiodes PD3, and multiple fourth photodiodes PD4 are used to form multiple 2*2 second photodiode matrices P and 2*2 third photodiode matrices Q arranged alternately along a first direction X and a second direction Y. The first direction X is the row direction of the second photodiode matrix P and the third photodiode matrix Q, and the second direction Y is the column direction of the second photodiode matrix P and the third photodiode matrix Q. The first direction X and the second direction Y are perpendicular. Each second photodiode matrix P includes one first photodiode PD1, one second photodiode PD2, and two fourth photodiodes PD4; each third photodiode matrix Q includes one second photodiode PD2, one third photodiode PD3, and two fourth photodiodes PD4.

[0189] The arrangement of one first photodiode PD1, one second photodiode PD2, and two fourth photodiodes PD4 in the second photodiode matrix P is not limited. In some examples, such as... Figure 15 As shown, in the second photodiode matrix P, the two fourth photodiodes PD4 are located at the upper left and lower right corners of the second photodiode matrix P, respectively, while the first photodiode PD1 and the second photodiode PD2 are located at the upper right and lower left corners of the second photodiode matrix P, respectively.

[0190] Similarly, the arrangement of one second photodiode PD2, one third photodiode PD3, and two fourth photodiodes PD4 in the third photodiode matrix Q is not limited. In some examples, such as... Figure 15 As shown, in the third photodiode matrix Q, the two fourth photodiodes PD4 are located at the upper left and lower right corners of the third photodiode matrix Q, respectively, and the second photodiode PD2 and the third photodiode PD3 are located at the lower left and upper right corners of the third photodiode matrix Q, respectively.

[0191] In this second embodiment, the first color filter unit 1011, the second color filter unit 1012, and the third color filter unit 1013 in the color filter 101 can be designed according to the above-described RGB-NIR pixel matrix. In some examples, such as Figure 16a and Figure 16b As shown, a first color filter unit 1011 covers a portion of a first photodiode PD1 and a portion of a fourth photodiode PD4 located in the four neighboring regions of the first photodiode PD1; a second color filter unit 1012 covers a portion of a second photodiode PD2 and a portion of the fourth photodiode PD4 located in the four neighboring regions of the second photodiode PD2; and a third color filter unit 1013 covers a portion of a third photodiode PD3 and a portion of the fourth photodiode PD4 located in the four neighboring regions of the third photodiode PD3. Each fourth photodiode PD4 is covered by the first color filter unit 1011, the third color filter unit 1013, and the two second color filter units 1012.

[0192] Here, the "four neighboring regions" can be referred to the explanation of Embodiment 1 above, and will not be repeated here.

[0193] refer to Figure 16a and Figure 16b It is known that the arrangement of the first photodiode PD1, the second photodiode PD2, the third photodiode PD3, and the fourth photodiode PD4 in the RGB-NIR pixel matrix differs, resulting in different arrangements of the first color filter unit 1011, the second color filter unit 1012, and the third color filter unit 1013 in the color filter 101. When the first photodiode PD1, the second photodiode PD2, the third photodiode PD3, and the fourth photodiode PD4 are arranged according to the first optional embodiment described above, the arrangement of the first color filter unit 1011, the second color filter unit 1012, and the third color filter unit 1013 in the color filter 101 is as follows: Figure 16a As shown. When the first photodiode PD1, the second photodiode PD2, the third photodiode PD3, and the fourth photodiode PD4 are arranged according to the second optional embodiment described above, the arrangement of the first color filter unit 1011, the second color filter unit 1012, and the third color filter unit 1013 in the color filter 101 is as follows: Figure 16b As shown.

[0194] Please continue to refer to this. Figure 13The image sensor 10 provided in this embodiment 2 also includes a beam splitting structure 103, which is disposed between the color filter 101 and the photodiode array 102. The beam splitting structure 103 is used to separate the first color light and infrared light transmitted from the first color filter unit 1011, the second color light and infrared light transmitted from the second color filter unit 1012, and the third color light and infrared light transmitted from the third color filter unit 1013. The first color light is transmitted to the first photodiode PD1, the second color light is transmitted to the second photodiode PD2, the third color light is transmitted to the third photodiode PD3, and the infrared light is transmitted to the fourth photodiode PD4.

[0195] It should be noted that the specific structure of the spectral splitting structure 103 can be referred to the above embodiment 1, and will not be repeated here.

[0196] To increase the amount and intensity of light received by the photodiode array 102, this second embodiment can be achieved, for example, in the following two ways.

[0197] The first type:

[0198] The beam splitter 103 is also used to converge the first color light transmitted from the first color filter unit 1011 and transmit the converged first color light to the first photodiode PD1, converge the second color light transmitted from the second color filter unit 1012 and transmit the converged second color light to the second photodiode PD2, converge the third color light transmitted from the third color filter unit 1013 and transmit the converged third color light to the third photodiode PD3, and converge the infrared light transmitted from the first color filter unit 1011, the second color filter unit 1012 and the third color filter unit 1013 and transmit the converged infrared light to the fourth photodiode PD4.

[0199] In the first case, the technical effects brought about by the beam-splitting structure 103 can be referred to the above embodiment 1, and will not be repeated here.

[0200] The second type:

[0201] like Figure 17 As shown, the image sensor 10 also includes a plurality of microlenses 104 disposed on the light-incident side of the color filter 101; the microlenses 104 are used to converge the three primary colors of light and infrared light and transmit them to the first color filter unit 1011, the second color filter unit 1012 and the third color filter unit 1013.

[0202] Here, the corresponding arrangement relationship between the microlens 104 and the first color filter unit 1011, the second color filter unit 1012 and the third color filter unit 1013, as well as the function of setting the microlens 104, can be referred to the above embodiment one, and will not be repeated here.

[0203] Since the image sensor 10 provided in this embodiment 2 is directly used to receive the three primary colors of light and infrared light, and infrared light can directly pass through the color filter 101 and the beam splitting structure 103, considering that when the beam splitting structure 103 splits the infrared light to transmit it to the fourth photodiode PD4, some infrared light may hit other photodiodes besides the fourth photodiode PD4. This would interfere with the color of the light received by the other photodiodes besides the fourth photodiode PD4, ultimately affecting the accuracy of the image obtained after subsequent processing. Based on this, in some examples, such as... Figure 17 As shown, the image sensor 10 further includes a first infrared cutoff filter 105 disposed between the beam splitting structure 103 and the photodiode array 102; the first infrared cutoff filter 105 is used to filter out infrared light. The first infrared cutoff filter 105 includes multiple cutout areas, and the projection of the fourth photodiode PD4 on the first infrared cutoff filter 105 overlaps with the cutout areas.

[0204] Because a first infrared cutoff filter 105 is disposed between the beam splitter structure 103 and the photodiode array 102, the infrared light transmitted through the beam splitter structure 103 is absorbed by the first infrared cutoff filter 105 during its transmission to the first photodiode PD1, the second photodiode PD2, and the third photodiode PD3. This prevents the first photodiode PD1, the second photodiode PD2, and the third photodiode PD3 from receiving infrared light, thus ensuring that they receive only a single color of light, which is beneficial for the accuracy of subsequent image processing. Furthermore, the first infrared cutoff filter 105 includes a hollow area, and the projection of the fourth photodiode PD4 onto the first infrared cutoff filter 105 overlaps with the hollow area. Therefore, the infrared light transmitted through the beam splitter structure 103 can be transmitted to and received by the fourth photodiode PD4.

[0205] In order to increase the amount of infrared light received by the fourth photodiode PD4, in some examples, the projection of the fourth photodiode PD4 on the first infrared cutoff filter 105 is located in the cutout area of ​​the first infrared cutoff filter package 105.

[0206] Based on this, to ensure that the beam splitting structure 103 can separate the first color light and infrared light transmitted from the first color filter unit 1011, the second color light and infrared light transmitted from the second color filter unit 1012, and the third color light and infrared light transmitted from the third color filter unit 1013, and transmit the first color light to the first photodiode PD1, the second color light to the second photodiode PD2, the third color light to the third photodiode PD3, and the infrared light to the fourth photodiode PD4, the beam splitting structure 103 can be divided into multiple beam splitting units. The following uses the first photodiode PD1, the second photodiode PD2, the third photodiode PD3, and the fourth photodiode PD4 in the photodiode array 102 as... Figure 14 and Figure 15 Taking the arrangement shown as an example, several corresponding design relationships are provided between multiple beam splitting units 1032 and the first photodiode PD1, the second photodiode PD2, the third photodiode PD3 and the fourth photodiode PD4 in the photodiode array 102, as well as the first color filter unit 1011, the second color filter unit 1012 and the third color filter unit 1013 in the color filter 101.

[0207] The first type:

[0208] refer to Figure 18a , Figure 18b , Figure 18c and Figure 18d , Figure 18a and Figure 18c According to the photodiode array 102 Figure 14 The layout shown is arranged as described. Figure 18b and Figure 18d According to the photodiode array 102 Figure 15 The layout is as shown.

[0209] refer to Figure 18a and Figure 18b The beam splitting structure 103 includes multiple beam splitting units 1032. Each first photodiode PD1, each second photodiode PD2, each third photodiode PD3, and each fourth photodiode PD4 corresponds to four beam splitting units 1032. Each first photodiode PD1 is used to receive the first color light split by the four beam splitting units 1032 corresponding to it. Each second photodiode PD2 is used to receive the second color light split by the four beam splitting units 1032 corresponding to it. Each third photodiode PD3 is used to receive the third color light split by the four beam splitting units 1032 corresponding to it. Each fourth photodiode PD4 is used to receive the infrared light split by the four beam splitting units 1032 corresponding to it.

[0210] Each beam splitting unit 1032 corresponds to one of the first color filter unit 1011, the second color filter unit 1012, and the third color filter unit 1013; and each beam splitting unit 1032 corresponds to two photodiodes. Specifically, each beam splitting unit 1032 corresponds to one of the fourth photodiode PD4 and one of the first photodiode PD1, the second photodiode PD2, and the third photodiode PD3.

[0211] Figure 18c and Figure 18d The specific beam splitting configuration of beam splitting unit 1032 is illustrated, as follows: Figure 18c and Figure 18d As shown, the beam splitting unit 1032 corresponding to the first color filter unit 1011 receives the first color light and infrared light transmitted from the first color filter unit 1011, and separates the first color light and infrared light to transmit to the first photodiode PD1 and the fourth photodiode PD4; the beam splitting unit 1032 corresponding to the second color filter unit 1012 receives the second color light and infrared light transmitted from the second color filter unit 1012, and separates the second color light and infrared light to transmit to the second photodiode PD2 and the fourth photodiode PD4; the beam splitting unit 1032 corresponding to the third color filter unit 1013 receives the third color light and infrared light transmitted from the third color filter unit 1013, and separates the third color light and infrared light to transmit to the third photodiode PD3 and the fourth photodiode PD4.

[0212] It should be noted that, Figure 18c and Figure 18d The first color filter unit 1011, the second color filter unit 1012, and the third color filter unit 1013 are not shown in the figure. Figure 18c and Figure 18d The arrow in the image indicates that the beam splitting unit 1032 performs beam splitting, from... Figure 18c and Figure 18d It can be seen that each beam splitting unit 1032 can split the light incident on it into two photodiodes.

[0213] The second type:

[0214] refer to Figure 19a , Figure 19b , Figure 19c and Figure 19d , Figure 19a and Figure 19c According to the photodiode array 102 Figure 14 The layout shown is arranged as described. Figure 19b and Figure 19d According to the photodiode array 102 Figure 15 The layout is as shown.

[0215] refer to Figure 19a and Figure 19b The aforementioned beam-splitting structure 103 includes multiple beam-splitting units 1032. Each first photodiode PD1, each second photodiode PD2, each third photodiode PD3, and each fourth photodiode PD4 corresponds to one beam-splitting unit 1032. Each first photodiode PD1 is used to receive the first color light split by its corresponding beam-splitting unit 1032, each second photodiode PD2 is used to receive the second color light split by its corresponding beam-splitting unit 1032, and each third photodiode PD3 is used to receive the third color light split by its corresponding beam-splitting unit 1032. Each fourth photodiode PD4 corresponds to four beam-splitting units 1032 and is used to receive infrared light split by any one of the four beam-splitting units 1032.

[0216] Each beam splitting unit 1032 corresponds to one of the first color filter unit 1011, the second color filter unit 1012, and the third color filter unit 1013. Figure 19c and Figure 19d The specific beam splitting configuration of beam splitting unit 1032 is illustrated, as follows: Figure 19c and Figure 19d As shown, the beam splitting unit 1032 corresponding to the first color filter unit 1011 receives the first color light and infrared light transmitted from the first color filter unit 1011, and transmits the first color light and infrared light to the first photodiode PD1 and any of the four neighboring fourth photodiodes PD4, respectively; the beam splitting unit 1032 corresponding to the second color filter unit 1012 receives the second color light and infrared light transmitted from the second color filter unit 1012, and transmits the second color light and infrared light to the second photodiode PD2 and any of the four neighboring fourth photodiodes PD4, respectively; the beam splitting unit 1032 corresponding to the third color filter unit 1013 receives the third color light and infrared light transmitted from the third color filter unit 1013, and transmits the third color light and infrared light to the third photodiode PD3 and any of the four neighboring fourth photodiodes PD4, respectively.

[0217] It should be noted that, Figure 19c and Figure 19d The first color filter unit 1011, the second color filter unit 1012, and the third color filter unit 1013 are not shown in the figure. Figure 19c and Figure 19dThe circles in the diagram indicate that the first color light transmitted through the first color filter unit 1011 directly hits the first photodiode PD1, the second color light transmitted through the second color filter unit 1012 directly hits the second photodiode PD2, and the third color light transmitted through the third color filter unit 1013 directly hits the third photodiode PD3. The arrows indicate that the beam splitter 1032 transmits the infrared light incident on it to the fourth photodiode PD4.

[0218] It should be understood that, in order to ensure that each fourth photodiode PD4 can receive infrared light, each beam splitting unit 1032 should transmit infrared light to the fourth photodiode PD4 in the same direction in the four neighboring areas of the first photodiode PD1, the second photodiode PD2, and the third photodiode PD3. For example, the infrared light is transmitted to the fourth photodiode PD4 to the left of the first photodiode PD1, the second photodiode PD2, and the third photodiode PD3.

[0219] The third type:

[0220] In the photodiode array 102 according to Figure 14 In the case of the arrangement shown, such as Figure 20a As shown, the beam splitting structure 103 includes multiple beam splitting units 1032. Each first photodiode PD1, each second photodiode PD2, and each third photodiode PD3 corresponds to four beam splitting units 1032. Each first photodiode PD1 is used to receive the first color light split by the four beam splitting units 1032 corresponding to it. Each second photodiode PD2 is used to receive the second color light split by the four beam splitting units 1032 corresponding to it. Each third photodiode PD3 is used to receive the third color light split by the four beam splitting units 1032 corresponding to it. Each fourth photodiode PD4 corresponds to one beam splitting unit 1032 and is used to receive the infrared light split by the beam splitting unit 1032 corresponding to it.

[0221] Each beam splitter 1032 corresponds to two sets of two first color filter units 1011, two second color filter units 1012, and two third color filter units 1013. For example, beam splitter 1032 corresponds to two first color filter units 1011 and two second color filter units 1012, and each beam splitter 1032 corresponds to five photodiodes.

[0222] Figure 20b The specific beam splitting configuration of beam splitting unit 1032 is illustrated, as follows: Figure 20bAs shown, the beam splitting unit 1032, corresponding to the two first color filter units 1011 and the two second color filter units 1012, receives the first color light and infrared light transmitted from the two first color filter units 1011, and receives the second color light and infrared light transmitted from the two second color filter units 1012. It transmits the first color light to the two first photodiodes PD1, the second color light to the two second photodiodes PD2, and the infrared light to a fourth photodiode PD4.

[0223] The beam splitting unit 1032, corresponding to the two second color filter units 1012 and the two third color filter units 1013, receives the second color light and infrared light transmitted from the two second color filter units 1012, and receives the third color light and infrared light transmitted from the two third color filter units 1013. It transmits the second color light to the two second photodiodes PD2, the third color light to the two third photodiodes PD3, and the infrared light to a fourth photodiode PD4.

[0224] The beam splitting unit 1032, corresponding to the two third color filter units 1013 and the two first color filter units 1013, receives the third color light and infrared light transmitted from the two third color filter units 1013, and receives the first color light and infrared light transmitted from the two first color filter units 1011. It transmits the first color light to the two first photodiodes PD1, the third color light to the two third photodiodes PD3, and the infrared light to a fourth photodiode PD4.

[0225] It should be noted that, Figure 20b The first color filter unit 1011, the second color filter unit 1012, and the third color filter unit 1013 are not shown in the figure. Figure 20b The circles in the diagram indicate that infrared light passes directly through the beam splitter 1032 and is transmitted to the fourth photodiode PD4. The arrows indicate that the first, second, and third color light are separated into the four photodiodes above, below, to the left, and to the right of the fourth photodiode PD4 after passing through the beam splitter 1032.

[0226] The fourth type:

[0227] In the photodiode array 102 according to Figure 15 In the case of the arrangement shown, such as Figure 21aAs shown, the beam splitting structure 103 includes multiple beam splitting units 1032. Each first photodiode PD1, each second photodiode PD2, and each third photodiode PD3 corresponds to four beam splitting units 1032. Each first photodiode PD1 is used to receive the first color light split by the four beam splitting units 1032 corresponding to it. Each second photodiode PD2 is used to receive the second color light split by the four beam splitting units 1032 corresponding to it. Each third photodiode PD3 is used to receive the third color light split by the four beam splitting units 1032 corresponding to it. Each fourth photodiode PD4 corresponds to one beam splitting unit 1032 and is used to receive the infrared light split by the beam splitting unit 1032 corresponding to it.

[0228] Each beam splitting unit 1032 corresponds to one first color filter unit 1011, two second color filter units 1012, and one third color filter unit 1013.

[0229] Figure 21b The specific beam splitting configuration of beam splitting unit 1032 is illustrated, as follows: Figure 21b As shown, each beam splitting unit 1032 receives the first color light transmitted through its corresponding first color filter unit 1011 and transmits the first color light to a first photodiode PD1, receives the second color light transmitted through its corresponding second color filter unit 1012 and transmits the second color light to two second photodiodes PD2, receives the third color light transmitted through its corresponding third color filter unit 1013 and transmits the third color light to a third photodiode PD3; each beam splitting unit 1032 also receives infrared light transmitted from the first color filter unit 1011, the second color filter unit 1012 and the third color filter unit 1013 and transmits the infrared light to a fourth photodiode PD4.

[0230] It should be noted that, Figure 21b The first color filter unit 1011, the second color filter unit 1012, and the third color filter unit 1013 are not shown in the figure. Figure 21b The circles in the diagram indicate that infrared light passes directly through the beam splitter 1032 and is transmitted to the fourth photodiode PD4. The arrows indicate that the first, second, and third color light are separated into the four photodiodes above, below, to the left, and to the right of the fourth photodiode PD4 after passing through the beam splitter 1032.

[0231] The fifth type:

[0232] In the photodiode array 102 according to Figure 14 In the case of the arrangement shown, such as Figure 22aAs shown, the beam splitting structure 103 includes multiple beam splitting units 1032. Each first photodiode PD1, each second photodiode PD2, each third photodiode PD3, and each fourth photodiode PD4 corresponds to four beam splitting units 1032. Each first photodiode PD1 is used to receive the first color light split by the four beam splitting units 1032 corresponding to it. Each second photodiode PD2 is used to receive the second color light split by the four beam splitting units 1032 corresponding to it. Each third photodiode PD3 is used to receive the third color light split by the four beam splitting units 1032 corresponding to it. Each fourth photodiode PD4 is used to receive the infrared light split by the four beam splitting units 1032 corresponding to it.

[0233] Each beam splitter 1032 corresponds to any one of the following combinations: two first color filter units 1011, two second color filter units 1012, two third color filter units 1013, first color filter unit 1011 and second color filter unit 1012, second color filter unit 1012 and third color filter unit 1013, and third color filter unit 1013 and first color filter unit 1011. For example, beam splitter 1032 corresponds to two first color filter units 1011; or, for another example, beam splitter 1032 corresponds to first color filter unit 1011 and second color filter unit 1012, and each beam splitter 1032 corresponds to four photodiodes.

[0234] Figure 22b The specific beam splitting configuration of beam splitting unit 1032 is illustrated, as follows: Figure 22b As shown, the beam splitting unit 1032 corresponding to the two first color filter units 1011 receives the first color light and infrared light transmitted from the first color filter units 1011, and transmits the first color light to the two first photodiodes PD1 and the infrared light to the two fourth photodiodes PD4; the beam splitting unit 1032 corresponding to the two second color filter units 1012 receives the second color light and infrared light transmitted from the second color filter units 1012, and transmits the second color light to the two second photodiodes PD2 and the infrared light to the two fourth photodiodes PD4; the beam splitting unit 1032 corresponding to the two third color filter units 1013 receives the third color light and infrared light transmitted from the third color filter units 1013, and transmits the third color light to the two third photodiodes PD3 and the infrared light to the two fourth photodiodes PD4.

[0235] The beam splitting unit 1032, corresponding to the first color filter unit 1011 and the second color filter unit 1012, receives the first color light and infrared light transmitted from the first color filter unit 1011, and receives the second color light and infrared light transmitted from the second color filter unit 1012. It transmits the first color light to the first photodiode PD1, the second color light to the second photodiode PD2, and the infrared light to the two fourth photodiodes PD4.

[0236] The beam splitting unit 1032, corresponding to the second color filter unit 1012 and the third color filter unit 1013, receives the second color light and infrared light transmitted from the second color filter unit 1012, and receives the third color light and infrared light transmitted from the third color filter unit 1032. It transmits the second color light to the second photodiode PD2, the third color light to the third photodiode PD3, and the infrared light to the two fourth photodiodes PD4.

[0237] The beam splitting unit 1032, corresponding to the third color filter unit 1013 and the first color filter unit 1011, receives the third color light and infrared light transmitted from the two third color filter units 1013, and receives the first color light and infrared light transmitted from the two first color filter units 1011. It transmits the first color light to the first photodiode PD1, the third color light to the third photodiode PD3, and the infrared light to the fourth photodiode PD4.

[0238] It should be noted that, Figure 22b The first color filter unit 1011, the second color filter unit 1012, and the third color filter unit 1013 are not shown in the figure. Figure 22b The arrow in the image indicates that the beam splitting unit 1032 performs beam splitting, from... Figure 22b It can be seen that each beam splitting unit 1032 can split the light incident on it into four photodiodes.

[0239] The sixth type:

[0240] In the photodiode array 102 according to Figure 15 In the case of the arrangement shown, such as Figure 23aAs shown, the beam splitting structure 103 includes multiple beam splitting units 1032. Each first photodiode PD1, each second photodiode PD2, and each third photodiode PD3 corresponds to four beam splitting units 1032. Each first photodiode PD1 is used to receive the first color light split by the four beam splitting units 1032 corresponding to it. Each second photodiode PD2 is used to receive the second color light split by the four beam splitting units 1032 corresponding to it. Each third photodiode PD3 is used to receive the third color light split by the four beam splitting units 1032 corresponding to it. Each fourth photodiode PD4 corresponds to one beam splitting unit 1032 and is used to receive the infrared light split by the beam splitting unit 1032 corresponding to it.

[0241] Each beam splitter 1032 corresponds to the first color filter unit 1011 and the second color filter unit 1012, or to the second color filter unit 1012 and the third color filter unit 1013, and each beam splitter 1032 corresponds to four photodiodes.

[0242] Figure 23b The specific beam splitting configuration of beam splitting unit 1032 is illustrated, as follows: Figure 23b As shown, the beam splitting unit 1032, corresponding to the first color filter unit 1011 and the second color filter unit 1012, receives the first color light and infrared light transmitted from the first color filter unit 1011, and receives the second color light and infrared light transmitted from the second color filter unit 1012. It then transmits the first color light to the first photodiode PD1, the second color light to the second photodiode PD2, and the infrared light to the two fourth photodiodes PD4. Figure 23b As shown, the beam splitting unit 1032 corresponding to the second color filter unit 1012 and the third color filter unit 1013 receives the second color light and infrared light transmitted from the second color filter unit 1012, and receives the third color light and infrared light transmitted from the third color filter unit 1013. It transmits the second color light to the second photodiode PD2, the third color light to the third photodiode PD3, and the infrared light to the two fourth photodiodes PD4.

[0243] It should be noted that, Figure 23b The first color filter unit 1011, the second color filter unit 1012, and the third color filter unit 1013 are not shown in the figure. Figure 23b The arrow in the image indicates that the beam splitting unit 1032 performs beam splitting, from... Figure 23b It can be seen that each beam splitting unit 1032 can split the light incident on it into four photodiodes.

[0244] In this second embodiment, since the first color filter unit 1011, the second color filter unit 1012, and the third color filter unit 1013 in the color filter 101 can all transmit infrared light and light of another color, this second embodiment can increase the amount of light received, that is, it can improve the photon utilization rate. Furthermore, compared to the prior art image sensor 10 where the color filter 101 includes a red filter unit, a green filter unit, and a blue filter unit, in this second embodiment, the amount of light received by the first photodiode PD1, the second photodiode PD2, the third photodiode PD3, and the fourth photodiode PD4 is increased by 2 times. For details, please refer to Embodiment 1.

[0245] Based on this, compared to the case where the color filter 101 in the image sensor 10 of the prior art includes a red filter unit, a green filter unit, and a blue filter unit, in this second embodiment, each first photodiode PD1, each second photodiode PD2, each third photodiode PD3, and each fourth photodiode PD4, that is, each first color pixel, each second color pixel, each third color pixel, and each fourth third color pixel in the pixel matrix, receives the light after the white light is distributed in the pixel space corresponding to the two color filter units in the prior art. Therefore, only a small amount of spatial resolution is lost, and the spatial resolution is 70% of that of the prior art.

[0246] In addition, since the first photodiode PD1, the second photodiode PD2, the third photodiode PD3 and the fourth photodiode PD4 in this second embodiment can receive three primary colors of light, and the light they receive is all of a single color, the difficulty of subsequent algorithm processing can be reduced.

[0247] Example 3

[0248] like Figure 24 As shown, the image sensor 10 includes a color filter 101 and a photodiode array 102.

[0249] The aforementioned color filter 101 includes a plurality of first color filter units 1011, a plurality of second color filter units 1012, a plurality of third color filter units 1013, and a plurality of cutout areas 1014; at least any one of the plurality of first color filter units 1011 allows the first color of the three primary colors of light to pass through, at least any one of the plurality of second color filter units 1012 allows the second color of the three primary colors of light to pass through, and at least any one of the plurality of third color filter units 1013 allows the third color of the three primary colors of light to pass through.

[0250] It should be noted that the first color filter unit 1011, the second color filter unit 1012 and the third color filter unit 1013 can refer to the above embodiment 2, and will not be repeated here.

[0251] The aforementioned photodiode array 102 is disposed on the light-emitting side of the color filter 101, and the photodiode array 102 includes a plurality of first photodiodes PD1, a plurality of second photodiodes PD2, a plurality of third photodiodes PD3, and a plurality of fourth photodiodes PD4. The first photodiodes PD1 correspond to the first color filter unit 1011, the second photodiodes PD2 correspond to the second color filter unit 1012, the third photodiodes PD3 correspond to the third color filter unit 1013, and the fourth photodiodes PD4 correspond to the cutout area 1014 of the color filter 101.

[0252] Here, the first photodiode PD1, the second photodiode PD2, the third photodiode PD3, and the fourth photodiode PD4 can be referred to in the above embodiment 2, and will not be repeated here.

[0253] It should be noted that the arrangement of the multiple first photodiodes PD1, multiple second photodiodes PD2, multiple third photodiodes PD3, and multiple fourth photodiodes PD4 in the photodiode array 102 can be, for example, as follows: Figure 14 and Figure 15 As shown, please refer to the above embodiment 2 for details, which will not be repeated here.

[0254] Please continue to refer to this. Figure 24 The image sensor 10 provided in this embodiment also includes a beam splitting structure 103, which is disposed on the light-incident side of the color filter 101. The beam splitting structure 103 is used to separate infrared light and the three primary color light. The infrared light is transmitted to the fourth photodiode PD4 through the hollow area of ​​the color filter 101, and the three primary color light is transmitted to the first color filter unit 1011, the second color filter unit 1012 and the third color filter unit 1013.

[0255] Since the first color filter unit 1011 allows the first color of the three primary colors of light to pass through, and the first photodiode PD1 corresponds to the first color filter unit 1011, the first photodiode PD1 receives the first color light. Similarly, the second photodiode PD2 receives the second color light, and the third photodiode PD3 receives the third color light.

[0256] It should be noted that the specific structure of the spectral splitting structure 103 can be referred to the above embodiment 1, and will not be repeated here.

[0257] To increase the amount and intensity of light received by the photodiode array 102, this embodiment three can be achieved, for example, in the following two ways.

[0258] The first type:

[0259] The beam-splitting structure 103 is also used to converge the three primary colors of light and the infrared light, and to transmit the converged three primary colors of light to the first color filter unit 1011, the second color filter unit 1012 and the third color filter unit 1013 of the color filter 101, and to transmit the converged infrared light to the cutout area 1014 of the color filter 101.

[0260] In the first case, the technical effects brought about by the beam-splitting structure 103 can be referred to the above embodiment 1, and will not be repeated here.

[0261] The second type:

[0262] like Figure 24 As shown, the image sensor 10 also includes a plurality of microlenses 104 disposed on the light-incident side of the beam splitting structure 103; the microlenses 104 are used to converge the three primary colors of light and infrared light and transmit them to the beam splitting structure 103.

[0263] The number of microlenses 104 can be set as needed.

[0264] In addition, the function of the microlens 104 can be referred to in the above embodiment 1, and will not be repeated here.

[0265] Based on this, to ensure that the beam-splitting structure 103 can separate infrared light and the three primary colors, the infrared light is transmitted through the cutout area of ​​the color filter 101 to the fourth photodiode PD4, and the three primary colors are transmitted to the first color filter unit 1011, the second color filter unit 1012, and the third color filter unit 1013. Therefore, the beam-splitting structure 103 can be divided into multiple beam-splitting units. The following uses the first photodiode PD1, the second photodiode PD2, the third photodiode PD3, and the fourth photodiode PD4 in the photodiode array 102 as... Figure 14 and Figure 15 Taking the arrangement shown as an example, this example provides a design relationship between multiple beam splitting units 1032 and the first photodiode PD1, the second photodiode PD2, the third photodiode PD3 and the fourth photodiode PD4 in the photodiode array 102, as well as the first color filter unit 1011, the second color filter unit 1012 and the third color filter unit 1013 in the color filter 101.

[0266] refer to Figure 18a , Figure 18b , Figure 25a as well as Figure 25b , Figure 18a and Figure 25a Using photodiode array 102 according to Figure 14 Taking the arrangement shown as an example, Figure 18b and Figure 25b Using photodiode array 102 according to Figure 15 The arrangement shown is used as an example.

[0267] like Figure 18a and Figure 18b As shown, the above-mentioned beam splitting structure 103 includes multiple beam splitting units 1032, and each first photodiode PD1, each second photodiode PD2, each third photodiode PD3 and each fourth photodiode PD4 corresponds to four beam splitting units 1032.

[0268] Figure 25a and Figure 25b The specific beam splitting configuration of beam splitting unit 1032 is illustrated, as follows: Figure 25a and Figure 25b As shown, each first photodiode PD1 is used to receive the first color light split by the four beam splitting units 1032 corresponding to it and passed through the first color filter unit 1011; each second photodiode PD2 is used to receive the second color light split by the four beam splitting units 1032 corresponding to it and passed through the second color filter unit 1012; each third photodiode PD3 is used to receive the third color light split by the four beam splitting units 1032 corresponding to it and passed through the third color filter unit 1013; and each fourth photodiode PD4 corresponds to one beam splitting unit 1032 and is used to receive the infrared light split by the corresponding beam splitting unit 1032.

[0269] It should be noted that, Figure 25a and Figure 25b The first color filter unit 1011, the second color filter unit 1012, and the third color filter unit 1013 are not shown in the figure. Figure 25a and Figure 25b The circles in the diagram indicate that after being split by the beam splitter 1032, the infrared light is directly transmitted to the fourth photodiode PD4. The arrows indicate that after being split by the beam splitter 1032, the three primary colors of light are split into the first color filter unit 1011, the second color filter unit 1012, and the third color filter unit 1013 in the four fields of the fourth photodiode PD4. After passing through the first color filter unit 1011, the first color light is transmitted to the first photodiode PD1. After passing through the second color filter unit 1012, the second color light is transmitted to the second photodiode PD2. After passing through the third color filter unit 1013, the third color light is transmitted to the third photodiode PD3.

[0270] It should be noted that when the image sensor 10 includes multiple microlenses 104, one microlens 104 can be configured to correspond to one beam splitting unit 1032.

[0271] In this third embodiment, since the beam splitting structure 103 first separates the three primary colors and infrared light, the three primary colors are transmitted to the first color filter unit 1011, the second color filter unit 1012 and the third color filter unit 1013 of the color filter 101, and the infrared light is transmitted to the fourth photodiode PD4 through the hollow area 1014 of the color filter 101. Compared with the prior art, where the color filter 101 corresponding to the fourth photodiode PD4 absorbs the three primary colors, this second embodiment can increase the amount of light entering the filter.

[0272] Based on this, compared to the case where the color filter 101 in the image sensor 10 of the prior art includes a red filter unit, a green filter unit, and a blue filter unit, in this embodiment, each first photodiode PD1, each second photodiode PD2, each third photodiode PD3, and each fourth photodiode PD4, that is, each first color pixel, each second color pixel, each third color pixel, and each fourth third color pixel in the pixel matrix, receives the light after the white light is distributed in the pixel space corresponding to the two color filter units in the prior art. Therefore, only a small amount of spatial resolution is lost, and the spatial resolution is 70% of that of the prior art.

[0273] In addition, since the first photodiode PD1, the second photodiode PD2, the third photodiode PD3 and the fourth photodiode PD4 in this embodiment can receive three primary colors of light, and the light they receive is all of a single color, the difficulty of subsequent algorithm processing can be reduced.

[0274] Example 4

[0275] like Figure 26 As shown, the image sensor 10 includes a photodiode array 102 and a beam splitter structure 103.

[0276] The aforementioned photodiode array 102 includes multiple first photodiodes PD1, multiple second photodiodes PD2, multiple third photodiodes PD3, and multiple fourth photodiodes PD4.

[0277] The aforementioned beam splitting structure 103 is disposed on the light-incident side of the photodiode array 102; the beam splitting structure 103 is used to transmit the received first color light to the first photodiode PD1, the received second color light to the second photodiode PD2, the received third color light to the third photodiode PD3, and the received infrared light to the fourth photodiode PD4.

[0278] In this fourth embodiment, the arrangement of the pixel matrix design, i.e., the arrangement of the multiple first photodiodes PD1, multiple second photodiodes PD2, multiple third photodiodes PD3, and multiple fourth photodiodes PD4 in the photodiode array 102, is not limited. In some examples, such as Figure 27 As shown, multiple first photodiodes PD1, multiple second photodiodes PD2, multiple third photodiodes PD3, and multiple fourth photodiodes PD4 are used to form multiple 2*2 fourth photodiode matrices N that are repeatedly arranged along a first direction X and a second direction Y; wherein, the first direction X is the row direction of the fourth photodiode matrix N, the second direction Y is the column direction of the fourth photodiode matrix N, and the first direction X and the second direction Y are perpendicular. Each fourth photodiode matrix N includes one first photodiode PD1, one second photodiode PD2, one third photodiode PD3, and one fourth photodiode PD4.

[0279] The arrangement of the first photodiode PD1, the second photodiode PD2, the third photodiode PD3, and the fourth photodiode PD4 in the aforementioned fourth photodiode matrix N is not limited. In some examples, such as... Figure 27 As shown, in the fourth photodiode matrix N, the first photodiode PD1 is located in the upper left of the fourth photodiode matrix N, the second photodiode PD2 is located in the upper right of the fourth photodiode matrix N, the third photodiode PD3 is located in the lower right of the fourth photodiode matrix N, and the fourth photodiode PD4 is located in the lower left of the fourth photodiode matrix N.

[0280] It should be noted that this fourth embodiment can use the two methods provided in the third embodiment to improve the amount and intensity of light received by the photodiode array 102. For details, please refer to the third embodiment above, which will not be repeated here.

[0281] Based on this, in order to ensure that the beam splitting structure 103 can transmit the received first color light to the first photodiode PD1, the received second color light to the second photodiode PD2, the received third color light to the third photodiode PD3, and the received infrared light to the fourth photodiode PD4, the beam splitting structure 103 can be divided into multiple beam splitting units. The following uses the first photodiode PD1, second photodiode PD2, third photodiode PD3, and fourth photodiode PD4 in the photodiode array 102 as... Figure 27Taking the arrangement shown as an example, this paper provides an exemplary design relationship between multiple beam splitting units 1032 and the first photodiode PD1, the second photodiode PD2, the third photodiode PD3 and the fourth photodiode PD4 in the photodiode array 102.

[0282] like Figure 28 As shown, the beam splitting structure 103 includes multiple beam splitting units 1032, and each first photodiode PD1, each second photodiode PD2, each third photodiode PD3 and each fourth photodiode PD4 corresponds to four beam splitting units 1032.

[0283] Figure 29 The beam splitting configuration of beam splitting unit 1032 is illustrated, as follows: Figure 29 As shown, each beam splitting unit 1032 corresponds to a first photodiode PD1, a second photodiode PD2, a third photodiode PD3, and a fourth photodiode PD4, and is used to transmit the received first color light to the first photodiode PD1, the received second color light to the second photodiode PD2, the received third color light to the third photodiode PD3, and the received infrared light to the fourth photodiode PD4.

[0284] Figure 29 The arrows indicate that after the three primary colors of light and infrared light pass through the beam splitter 1032, the first color light is transmitted to the first photodiode PD1, the second color light is transmitted to the second photodiode PD2, the third color light is transmitted to the third photodiode PD3, and the infrared light is transmitted to the fourth photodiode PD4.

[0285] In this fourth embodiment, since the beam splitting structure 103 directly transmits the first color light to the first photodiode PD1, the second color light to the second photodiode PD2, the third color light to the third photodiode PD3, and the infrared light to the fourth photodiode PD4, and the beam splitting structure 103 does not absorb light, the amount of light entering the image sensor 10 can be increased.

[0286] Based on this, compared to the case where the color filter 101 in the image sensor 10 of the prior art includes a red filter unit, a green filter unit, and a blue filter unit, in this embodiment four, each first photodiode PD1, each second photodiode PD2, each third photodiode PD3, and each fourth photodiode PD4, that is, each first color pixel, each second color pixel, each third color pixel, and each fourth third color pixel in the pixel matrix, receives the light after the white light is distributed in the pixel space corresponding to the two color filter units in the prior art. Therefore, only a small amount of spatial resolution is lost, and the spatial resolution is 70% of that of the prior art.

[0287] In addition, since the first photodiode PD1, the second photodiode PD2, the third photodiode PD3 and the fourth photodiode PD4 in this embodiment can receive three primary colors of light, and the light they receive is all of a single color, the difficulty of subsequent algorithm processing can be reduced.

[0288] This application also provides a display device, which can also be called a liquid crystal display (LCD). The display device can be, for example, an LCD TV, a digital photo frame, a mobile phone, a tablet computer, or any other product or component with display function.

[0289] like Figure 30 As shown, the display device 40 includes a liquid crystal display panel 401, a backlight 402, and a beam splitting structure 103.

[0290] The main structure of the aforementioned liquid crystal display panel 401 includes an array substrate 4011, a cell substrate 4012, and a liquid crystal layer 4013 disposed between the array substrate 4011 and the cell substrate 4012. It is understood that the liquid crystal display panel 401 includes multiple sub-pixels, such as... Figure 31 As shown, the multiple sub-pixels include multiple first color sub-pixels 401a, multiple second color sub-pixels 401b, and multiple third color sub-pixels 401c.

[0291] In some examples, the first color subpixel 401a, the second color subpixel 401b, and the third color subpixel 401c are the red subpixel R, the green subpixel G, and the blue subpixel B, respectively.

[0292] Here, the arrangement of the plurality of first color subpixels 401a, the plurality of second color subpixels 401b, and the plurality of third color subpixels 401c in the liquid crystal display panel 401 is not limited. In some examples, such as Figure 31 As shown, a column of first-color subpixels 401a, a column of second-color subpixels 401b, and a column of third-color subpixels 401c are arranged alternately along the first direction X. Figure 31 The following is an example illustrating the first color subpixel 401a as red subpixel R, the second color subpixel 401b as green subpixel G, and the third color subpixel 401c as blue subpixel B.

[0293] The array substrate 4011 in the aforementioned liquid crystal display panel 401 includes a substrate and thin-film transistors and pixel electrodes disposed on the substrate and located at each sub-pixel. The thin-film transistors include an active layer, a source electrode, a drain electrode, a gate electrode, and a gate insulating layer. The source electrode and drain electrode are respectively in contact with the active layer, and the pixel electrode is electrically connected to the drain electrode of the thin-film transistor. In some examples, the array substrate 4011 also includes a common electrode. In other examples, the cell substrate 4012 includes a common electrode. Please refer to [reference needed]. Figure 30 The backlight 402 is disposed on the light-incident side of the liquid crystal display panel 401 and is used to provide a light source for the liquid crystal display panel 401.

[0294] Here, the backlight 402 may include multiple conventional LEDs (light emitting diodes) or multiple mini-LEDs. The aforementioned beam splitting structure 103 is disposed between the liquid crystal display panel 401 and the backlight 402. The beam splitting structure 103 is used to split the white light emitted from the backlight 402 into a first color light, a second color light, and a third color light, and transmits the first color light to a first color sub-pixel, the second color light to a second color sub-pixel, and the third color light to a third color sub-pixel.

[0295] Furthermore, the specific structure of the beam-splitting structure 103 can be referred to in Embodiment 1 above, and will not be repeated here.

[0296] The display device 40 provided in this application embodiment includes a liquid crystal display panel 401 and a backlight 402, and also includes a beam splitting structure 103 disposed between the liquid crystal display panel 401 and the backlight 402. Since the beam splitting structure 103 can split the white light emitted from the backlight 402 into a first color light, a second color light and a third color light, and transmit the first color light to a first color subpixel, the second color light to a second color subpixel, and the third color light to a third color subpixel, the first color subpixel of the liquid crystal display panel 401 can transmit the first color light, the second color subpixel can transmit the second color light, and the third color subpixel can transmit the third color light. Based on this, compared to existing display devices, by providing a color filter 101 on the liquid crystal display panel 401, the color filter 101 absorbs two colors of white light and transmits the other color of light, ensuring that the first color sub-pixel of the liquid crystal display panel 401 transmits the first color light, the second color sub-pixel transmits the second color light, and the third color sub-pixel transmits the third color light. Since this embodiment utilizes a beam-splitting structure 103 for beam splitting, and the beam-splitting structure 103 does not absorb light, it is beneficial to improve the utilization rate of photons provided by the backlight 402. It should be noted that in some examples, the liquid crystal display panel 401 does not include the color filter 101. In other examples, considering that when the beam-splitting structure 103 splits the white light emitted from the backlight 402 into first color light, second color light, and third color light and transmits them to the first color sub-pixel, second color sub-pixel, and third color sub-pixel of the liquid crystal display panel 401 respectively, the light transmitted from the first color sub-pixel, second color sub-pixel, and third color sub-pixel of the liquid crystal display panel 401 may not be a single color of light, which would affect the display effect. Based on this, such as Figure 32 As shown, the liquid crystal display panel 401 includes a color filter 101; the color filter 101 includes a plurality of first color filter units 1011 corresponding to a first color subpixel, a plurality of second color filter units 1012 corresponding to a second color subpixel, and a plurality of third color filter units 1013 corresponding to a third color subpixel. At least any one of the plurality of first color filter units 1011 allows only first color light to pass through, at least any one of the plurality of second color filter units 1012 allows only second color light to pass through, and at least any one of the plurality of third color filter units 1013 allows only third color light to pass through.

[0297] It should be understood that by providing a color filter 101 in the liquid crystal display panel 401, it can be ensured that the light transmitted from the first color subpixel, the second color subpixel and the third color subpixel of the liquid crystal display panel 401 is a single color light, and there will be no color cross-contamination, which is conducive to improving the display effect of the display device.

[0298] It is understood that the arrangement of the plurality of first color filter units 1011, the plurality of second color filter units 1012 and the plurality of third color filter units 1013 in the color filter 101 is the same as the arrangement of the plurality of first color subpixels 401a, the plurality of second color subpixels 401b and the plurality of third color subpixels 401c in the liquid crystal display panel 401, and will not be described again here.

[0299] Here, the placement of the color filter 101 in the liquid crystal display panel 401 is not limited. It can be that the cell substrate 4012 includes the color filter 101. In this case, the cell substrate 4012 can also be called the color filter substrate, or the array substrate 4011 can include the color filter 101. Figure 32 The illustration is based on a substrate 4012 including a color filter 101.

[0300] Based on this, the display device 40 also includes an upper polarizer 403 and a lower polarizer 404 disposed on both sides of the liquid crystal display panel 401.

[0301] In some examples, the display device 40 provided in this application may also include the image sensor 10 described above.

[0302] The above description is merely a specific embodiment of this application, but the scope of protection of this application is not limited thereto. Any variations or substitutions that can be easily conceived by those skilled in the art within the scope of the technology disclosed in this application should be included within the scope of protection of this application. Therefore, the scope of protection of this application should be determined by the scope of the claims.

Claims

1. An image sensor, characterized in that, include: Multiple first photodiodes, multiple second photodiodes, and multiple third photodiodes; A color filter, comprising a plurality of first color filter units and a plurality of second color filter units; at least any one of the plurality of first color filter units allows the first color light and the second color light of the three primary colors to pass through, and at least any one of the plurality of second color filter units allows the second color light and the third color light of the three primary colors to pass through; A beam splitting structure is used to separate the first color light and the second color light transmitted from the first color filter unit, and to transmit the first color light to the first photodiode and the second color light to the second photodiode. The beam splitting structure is also used to separate the second color light and the third color light transmitted from the second color filter unit, and to transmit the second color light to the second photodiode and the third color light to the third photodiode.

2. The image sensor according to claim 1, characterized in that, The beam-splitting structure is further configured to converge the first color light transmitted from the first color filter unit and the second color light, and the beam-splitting structure is further configured to converge the second color light transmitted from the second color filter unit and the third color light.

3. The image sensor according to claim 1 or 2, characterized in that, The image sensor also includes a plurality of microlenses disposed on the light-incident side of the color filter; The microlens is used to converge the three primary colors of light and transmit them to the first color filter unit and the second color filter unit.

4. The image sensor according to claim 1 or 2, characterized in that, A plurality of first photodiodes, a plurality of second photodiodes, and a plurality of third photodiodes are used to form a plurality of 2*2 first photodiode matrices that are repeatedly arranged along a first direction and a second direction; wherein, the first direction is the row direction of the first photodiode matrix, and the second direction is the column direction of the first photodiode matrix; Each of the first photodiode matrices includes one first photodiode, two second photodiodes, and one third photodiode.

5. The image sensor according to claim 4, characterized in that, The first photodiode is located at the upper left corner of the first photodiode matrix, the two second photodiodes are located at the upper right corner and the lower left corner of the first photodiode matrix, respectively, and the third photodiode is located at the lower right corner of the first photodiode matrix.

6. The image sensor according to claim 1 or 2, characterized in that, Multiple first color filter units and multiple second color filter units are arranged alternately along two diagonals parallel to the first photodiode matrix; The first color filter unit covers the first photodiode and portions of the second photodiode located in the four neighboring regions of the first photodiode; the second color filter unit covers the third photodiode and portions of the second photodiode located in the four neighboring regions of the third photodiode; each second photodiode is covered by two adjacent first color filter units and two adjacent second color filter units.

7. The image sensor according to claim 1 or 2, characterized in that, The beam-splitting structure includes multiple beam-splitting units; each of the first photodiode, each of the second photodiode, and each of the third photodiodes corresponds to four beam-splitting units. Each of the beam-splitting units corresponds to one of the first color filter units or one of the second color filter units; the beam-splitting unit corresponding to the first color filter unit receives the first color light and the second color light transmitted from the first color filter unit, and separately transmits the first color light and the second color light to one of the first photodiodes and one of the second photodiodes; the beam-splitting unit corresponding to the second color filter unit receives the second color light and the third color light transmitted from the second color filter unit, and separately transmits the second color light and the third color light to one of the second photodiodes and one of the third photodiodes.

8. The image sensor according to claim 1 or 2, characterized in that, The beam-splitting structure includes multiple beam-splitting units; each of the first photodiode, each of the second photodiode, and each of the third photodiodes corresponds to four beam-splitting units. Each of the beam-splitting units corresponds to the first color filter unit and the second color filter unit; each of the beam-splitting units receives the first color light and the second color light transmitted from the first color filter unit, and transmits the first color light and the second color light separately to one first photodiode and two second photodiodes, and receives the second color light and the third color light transmitted from the second color filter unit, and transmits the second color light and the third color light separately to one third photodiode and two second photodiodes; Alternatively, each of the beam splitting units receives the first color light and the second color light transmitted from the first color filter unit, and receives the second color light and the third color light transmitted from the second color filter unit, and transmits the first color light to a first photodiode, the second color light to a second photodiode, and the third color light to a third photodiode.

9. The image sensor according to claim 1 or 2, characterized in that, The beam-splitting structure includes multiple beam-splitting units; each of the first photodiodes and each of the third photodiodes corresponds to four beam-splitting units; each of the second photodiodes corresponds to one beam-splitting unit; Each of the beam-splitting units corresponds to two opposing first color filter units and two opposing second color filter units. Each beam-splitting unit receives light transmitted through the two opposing first color filter units and the two opposing second color filter units, and transmits the second color light to one of the second photodiodes, the first color light to the two opposing first photodiodes, and the third color light to the two opposing third photodiodes.

10. The image sensor according to claim 1 or 2, characterized in that, The beam-splitting structure comprises an array of multiple micro / nano dielectric pillars.

11. The image sensor according to claim 1 or 2, characterized in that, The first color filter unit is a yellow filter unit, and the second color filter unit is a cyan filter unit.

12. The image sensor according to claim 11, characterized in that, The first color light is red light, the second color light is green light, and the third color light is blue light.

13. An image sensor, characterized in that, include: Multiple first photodiodes, multiple second photodiodes, multiple third photodiodes, and multiple fourth photodiodes; A color filter, comprising a plurality of first color filter units, a plurality of second color filter units, and a plurality of third color filter units; at least any one of the plurality of first color filter units allows infrared light and a first color of the three primary colors of light to pass through, at least any one of the plurality of second color filter units allows infrared light and a second color of the three primary colors of light to pass through, and at least any one of the plurality of third color filter units allows infrared light and a third color of the three primary colors of light to pass through; A beam-splitting structure is used to separate the first color light and infrared light transmitted from the first color filter unit, the second color light and infrared light transmitted from the second color filter unit, the third color light and infrared light transmitted from the third color filter unit, and to transmit the first color light to the first photodiode, the second color light to the second photodiode, the third color light to the third photodiode, and the infrared light to the fourth photodiode.

14. The image sensor according to claim 13, characterized in that, The beam-splitting structure is also used to converge the first color light transmitted from the first color filter unit, converge the second color light transmitted from the second color filter unit, converge the third color light transmitted from the third color filter unit, and converge the infrared light transmitted from the first color filter unit, the second color filter unit, and the third color filter unit.

15. The image sensor according to claim 13 or 14, characterized in that, The image sensor also includes a plurality of microlenses disposed on the light-incident side of the color filter; The microlens is used to converge the three primary colors of light and the infrared light and transmit them to the first color filter unit, the second color filter unit and the third color filter unit.

16. The image sensor according to claim 13 or 14, characterized in that, The image sensor further includes a first infrared cutoff filter disposed between the beam splitting structure and the first photodiode, the second photodiode, and the third photodiode; the first infrared cutoff filter is used to filter out infrared light; The first infrared cut-off filter includes multiple hollow areas, and the projection of the fourth photodiode on the first infrared cut-off filter overlaps with the hollow areas.

17. The image sensor according to claim 13 or 14, characterized in that, A first color filter unit covers a first photodiode and a portion of a fourth photodiode located in the four neighboring regions of the first photodiode; a second color filter unit covers a second photodiode and a portion of the fourth photodiode located in the four neighboring regions of the second photodiode; and a third color filter unit covers a third photodiode and a portion of the fourth photodiode located in the four neighboring regions of the third photodiode.

18. The image sensor according to claim 13 or 14, characterized in that, A row of the first photodiode, a row of the fourth photodiode, a row of the second photodiode, a row of the fourth photodiode, a row of the third photodiode, and a row of the fourth photodiode are arranged alternately along a first direction.

19. The image sensor according to claim 13 or 14, characterized in that, A plurality of first photodiodes, a plurality of second photodiodes, a plurality of third photodiodes, and a plurality of fourth photodiodes are used to form a plurality of 2*2 second photodiode matrices and 2*2 third photodiode matrices arranged alternately along a first direction and a second direction; wherein, the first direction is the row direction of the second photodiode matrices and the third photodiode matrices, and the second direction is the column direction of the second photodiode matrices and the third photodiode matrices; Each second photodiode matrix includes one first photodiode, one second photodiode, and two fourth photodiodes; each third photodiode matrix includes one second photodiode, one third photodiode, and two fourth photodiodes.

20. The image sensor according to claim 19, characterized in that, In the second photodiode matrix, the two fourth photodiodes are located at the upper left and lower right corners of the second photodiode matrix, respectively, and the first photodiode and the second photodiode are located at the upper right and lower left corners of the second photodiode matrix, respectively. In the third photodiode matrix, the two fourth photodiodes are located at the upper left and lower right corners of the third photodiode matrix, respectively, and the second photodiode and the third photodiode are located at the lower left and upper right corners of the third photodiode matrix, respectively.

21. The image sensor according to claim 13 or 14, characterized in that, The beam-splitting structure includes multiple beam-splitting units, and each of the first photodiode, each of the second photodiode, each of the third photodiode, and each of the fourth photodiode corresponds to four beam-splitting units. Each of the beam-splitting units corresponds to one of the first color filter unit, the second color filter unit, and the third color filter unit; the beam-splitting unit corresponding to the first color filter unit receives the first color light and the infrared light transmitted from the first color filter unit, and separately transmits the first color light and the infrared light to the first photodiode and the fourth photodiode; the beam-splitting unit corresponding to the second color filter unit receives the second color light and the infrared light transmitted from the second color filter unit, and separately transmits the second color light and the infrared light to the second photodiode and the fourth photodiode; the beam-splitting unit corresponding to the third color filter unit receives the third color light and the infrared light transmitted from the third color filter unit, and separately transmits the third color light and the infrared light to the third photodiode and the fourth photodiode.

22. The image sensor according to claim 13 or 14, characterized in that, The beam-splitting structure includes multiple beam-splitting units, each of the first photodiode, each of the second photodiode, and each of the third photodiodes corresponds to one beam-splitting unit; each of the fourth photodiodes corresponds to four beam-splitting units and is used to receive the infrared light split by any one of the four beam-splitting units corresponding to it. Each of the beam-splitting units corresponds to one of the first color filter unit, the second color filter unit, and the third color filter unit; the beam-splitting unit corresponding to the first color filter unit receives the first color light and the infrared light transmitted from the first color filter unit, and transmits the first color light and the infrared light to the first photodiode and any of the fourth photodiodes in its four neighboring regions, respectively; the beam-splitting unit corresponding to the second color filter unit receives the second color light and the infrared light transmitted from the second color filter unit, and transmits the second color light and the infrared light to the second photodiode and any of the fourth photodiodes in its four neighboring regions, respectively; the beam-splitting unit corresponding to the third color filter unit receives the third color light and the infrared light transmitted from the third color filter unit, and transmits the third color light and the infrared light to the third photodiode and any of the fourth photodiodes in its four neighboring regions, respectively.

23. The image sensor according to claim 19, characterized in that, The beam-splitting structure includes multiple beam-splitting units, each of the first photodiode, each of the second photodiode, and each of the third photodiodes corresponds to four beam-splitting units; each of the fourth photodiodes corresponds to one beam-splitting unit. Each of the beam-splitting units corresponds to one first color filter unit, two second color filter units, and one third color filter unit; each beam-splitting unit receives the first color light transmitted through its corresponding first color filter unit and transmits the first color light to one first photodiode, receives the second color light transmitted through its corresponding second color filter unit and transmits the second color light to two second photodiodes, receives the third color light transmitted through its corresponding third color filter unit and transmits the third color light to one third photodiode; each beam-splitting unit also receives infrared light transmitted from the first color filter unit, the second color filter unit, and the third color filter unit and transmits the infrared light to the fourth photodiode.

24. The image sensor according to claim 19, characterized in that, The beam-splitting structure includes multiple beam-splitting units, and each of the first photodiode, each of the second photodiode, each of the third photodiode, and each of the fourth photodiode corresponds to four beam-splitting units. Each of the beam-splitting units corresponds to the first color filter unit and the second color filter unit, or to the second color filter unit and the third color filter unit; The beam splitting unit corresponding to the first color filter unit and the second color filter unit receives the first color light and the infrared light transmitted from the first color filter unit, and receives the second color light and the infrared light transmitted from the second color filter unit, and transmits the first color light to the first photodiode, transmits the second color light to the second photodiode, and transmits the infrared light to the two fourth photodiodes; The beam splitting unit corresponding to the second color filter unit and the third color filter unit receives the second color light and the infrared light transmitted from the second color filter unit, and receives the third color light and the infrared light transmitted from the third color filter unit, and transmits the second color light to the second photodiode, transmits the third color light to the third photodiode, and transmits the infrared light to the two fourth photodiodes.

25. An image sensor, characterized in that, include: A color filter includes a plurality of first color filter units, a plurality of second color filter units, a plurality of third color filter units, and a plurality of cutout areas; at least any one of the plurality of first color filter units allows the first color of light from the three primary colors to pass through, at least any one of the plurality of second color filter units allows the second color of light from the three primary colors to pass through, and at least any one of the plurality of third color filter units allows the third color of light from the three primary colors to pass through; Multiple first photodiodes corresponding to the first color filter unit, multiple second photodiodes corresponding to the second color filter unit, multiple third photodiodes corresponding to the third color filter unit, and multiple fourth photodiodes corresponding to the hollowed-out area; A beam-splitting structure is disposed on the light-incident side of the color filter to separate infrared light and the three primary colors of light. The infrared light is transmitted through the hollow area of ​​the color filter to the fourth photodiode, and the three primary colors of light are transmitted to the first color filter unit, the second color filter unit, and the third color filter unit.

26. The image sensor according to claim 25, characterized in that, A row of the first photodiode, a row of the fourth photodiode, a row of the second photodiode, a row of the fourth photodiode, a row of the third photodiode, and a row of the fourth photodiode are arranged alternately along a first direction.

27. The image sensor according to claim 25, characterized in that, A plurality of first photodiodes, a plurality of second photodiodes, a plurality of third photodiodes, and a plurality of fourth photodiodes are used to form a plurality of 2*2 second photodiode matrices and 2*2 third photodiode matrices arranged alternately along a first direction and a second direction; wherein, the first direction is the row direction of the second photodiode matrices and the third photodiode matrices, and the second direction is the column direction of the second photodiode matrices and the third photodiode matrices; Each second photodiode matrix includes one first photodiode, one second photodiode, and two fourth photodiodes; each third photodiode matrix includes one second photodiode, one third photodiode, and two fourth photodiodes.

28. The image sensor according to claim 27, characterized in that, In the second photodiode matrix, the two fourth photodiodes are located at the upper left and lower right corners of the second photodiode matrix, respectively, and the first photodiode and the second photodiode are located at the upper right and lower left corners of the second photodiode matrix, respectively. In the third photodiode matrix, the two fourth photodiodes are located at the upper left and lower right corners of the third photodiode matrix, respectively, and the second photodiode and the third photodiode are located at the lower left and upper right corners of the third photodiode matrix, respectively.

29. The image sensor according to any one of claims 25-28, characterized in that, The beam splitting structure includes multiple beam splitting units. Each first photodiode, each second photodiode, and each third photodiode corresponds to four beam splitting units. Each first photodiode receives first-color light split by its corresponding four beam splitting units and filtered by the first color filter unit. Each second photodiode receives second-color light split by its corresponding four beam splitting units and filtered by the second color filter unit. Each third photodiode receives third-color light split by its corresponding four beam splitting units and filtered by the third color filter unit. Each fourth photodiode corresponds to one beam splitting unit and receives infrared light split by its corresponding beam splitting unit.

30. A camera device, characterized in that, It includes a lens and an image sensor; the lens is used to focus the light emitted or reflected by the object being photographed onto the image sensor; the image sensor is used to convert the received optical image into a digital signal; The image sensor is the image sensor as described in any one of claims 1-12; the camera device further includes a second infrared cut-off filter; the second infrared cut-off filter is disposed between the lens and the image sensor for filtering out infrared light; Alternatively, the image sensor may be the image sensor as described in any one of claims 13-29.

31. The camera device according to claim 30, characterized in that, The camera device also includes an image processor; the image processor is used to process the digital signal and output an image of the object being photographed.

Images