Image sensor, imaging device, electronic device, image processing system, and signal processing method

Abstract

The application discloses an image sensor, an imaging device, an electronic device, an image processing system and a signal processing method. The image sensor comprises a filter array and a pixel array. The filter array comprises a plurality of filter groups. Each filter group comprises at least two filters of different colors, and the number of filters of each color in each filter group is a plurality. The pixel array comprises a plurality of pixels and a plurality of floating diffusion nodes. Each pixel corresponds to a filter of the filter array, and the pixel is used to receive light passing through the corresponding filter to generate an electrical signal. The pixels corresponding to the filters of the same color in the same filter group share one floating diffusion node, and the electrical signals generated by the pixels corresponding to the filters of the same color in the same filter group can be combined at the corresponding floating diffusion node. The image sensor disclosed by the application reduces the amount of data to be output by sharing the floating diffusion node, reduces the time-consuming of analog-to-digital conversion, and is beneficial to improving the frame rate.

Description

Technical Field

[0001] This application relates to the field of imaging technology, and in particular to an image sensor, imaging device, electronic device, image processing system, and signal processing method. Background Technology

[0002] In related technologies, the signal generated by the photosensitive element in an image sensor after receiving light is an analog pixel signal. This analog pixel signal needs to be converted into a digital signal by an analog-to-digital converter (ADC) before being output to the processor. The ADC takes a certain amount of time to convert the analog pixel signal into a digital signal. Currently, the image sensor operates by consuming a significant amount of time in the ADC stage, resulting in a relatively low frame rate for the images it can output. Summary of the Invention

[0003] This application provides an image sensor, an imaging device, an electronic device, an image processing system, and a signal processing method.

[0004] The image sensor of this application includes a filter array and a pixel array. The filter array includes multiple filter groups, each filter group including at least two different colors of filters, and each filter group contains multiple filters of each color. The pixel array includes multiple pixels and multiple floating diffusion nodes. Each pixel corresponds to one filter in the filter array, and the pixel is used to receive light passing through the corresponding filter to generate an electrical signal. Pixels corresponding to the same color filter in the same filter group share one floating diffusion node, so that the electrical signals generated by pixels corresponding to the same color filter in the same filter group can be merged at the corresponding floating diffusion node.

[0005] The imaging apparatus of this application includes an image sensor. The image sensor includes a filter array and a pixel array. The filter array includes multiple filter groups, each filter group including at least two different colors of filters, and the number of filters of each color in each filter group is multiple. The pixel array includes multiple pixels and multiple floating diffusion nodes. Each pixel corresponds to one filter in the filter array, and the pixel is used to receive light passing through the corresponding filter to generate an electrical signal. Pixels corresponding to the same color filter in the same filter group share one floating diffusion node, so that the electrical signals generated by the pixels corresponding to the same color filter in the same filter group can be merged at the corresponding floating diffusion node.

[0006] The electronic device according to embodiments of this application includes an imaging apparatus. The imaging apparatus includes an image sensor. The image sensor includes a filter array and a pixel array. The filter array includes multiple filter groups, each filter group including at least two different colors of filters, and the number of filters of each color in each filter group is multiple. The pixel array includes multiple pixels and multiple floating diffusion nodes. Each pixel corresponds to one filter in the filter array, and the pixel is used to receive light passing through the corresponding filter to generate an electrical signal. Pixels corresponding to the same color filter in the same filter group share one floating diffusion node, so that the electrical signals generated by the pixels corresponding to the same color filter in the same filter group can be merged at the corresponding floating diffusion node.

[0007] The image processing system of this application includes an electronic device. The electronic device includes an imaging apparatus. The imaging apparatus includes an image sensor. The image sensor includes a filter array and a pixel array. The filter array includes multiple filter groups, each filter group including at least two different colors of filters, and the number of filters of each color in each filter group is multiple. The pixel array includes multiple pixels and multiple floating diffusion nodes. Each pixel corresponds to one filter in the filter array, and the pixel is used to receive light passing through the corresponding filter to generate an electrical signal. Pixels corresponding to the same color filter in the same filter group share one floating diffusion node, so that the electrical signals generated by the pixels corresponding to the same color filter in the same filter group can be merged at the corresponding floating diffusion node.

[0008] The signal processing method of this application is used in an image sensor. The image sensor includes a filter array and a pixel array. The filter array includes multiple filter groups, each filter group including at least two different colors of filters, and the number of filters of each color in each filter group is multiple. The pixel array includes multiple pixels and multiple floating diffusion nodes. Each pixel corresponds to one filter in the filter array, and the pixel is used to receive light passing through the corresponding filter to generate an electrical signal. Pixels corresponding to the same color filter in the same filter group share one floating diffusion node. The signal processing method includes controlling the electrical signals generated by the pixels corresponding to the same color filter in the same filter group to be merged at the corresponding floating diffusion node.

[0009] The image sensor, imaging device, electronic device, image processing system, and signal processing method of this application reduce the amount of data to be output by sharing a floating diffusion node, and reduce the time consumed by analog-to-digital conversion, which is beneficial to improving the frame rate.

[0010] Additional aspects and advantages of the embodiments of this application will be set forth in part in the description which follows, and in part will be obvious from the description, or may be learned by practice of this application. Attached Figure Description

[0011] The above and / or additional aspects and advantages of this application will become apparent and readily understood from the description of the embodiments taken in conjunction with the following drawings, wherein: Figure 1 and Figure 2 This is a partial structural schematic diagram of an image sensor according to certain embodiments of this application; Figures 3 to 6 yes Figure 1 or Figure 2 The diagram shows the arrangement of some filters in the image sensor. Figure 7 This is a circuit connection diagram of an image sensor according to certain embodiments of this application; Figure 8A and Figure 8B This is a schematic diagram illustrating the working principle of the image sensor in some embodiments of this application; Figure 9 This is a circuit connection diagram of an image sensor according to certain embodiments of this application; Figure 10A and Figure 10B This is a schematic diagram illustrating the working principle of the image sensor in some embodiments of this application; Figure 11 This is a schematic diagram illustrating the principle of analog-to-digital conversion (ADC) circuits performing ADC conversion in related technologies. Figure 12 This is a schematic diagram illustrating the principle of analog-to-digital conversion performed by the analog-to-digital conversion circuit in the image sensor in certain embodiments of this application; Figures 13 to 16 This is a schematic diagram illustrating the working principle of an image sensor according to certain embodiments of this application; Figure 17 This is a schematic diagram of an imaging apparatus according to certain embodiments of this application; Figure 18 This is a schematic diagram of an electronic device according to certain embodiments of this application; Figure 19 This is a schematic diagram of an image processing system according to certain embodiments of this application; Figure 20 This is a schematic diagram of an image processing circuit in a computer device according to certain embodiments of this application. Detailed Implementation

[0012] The embodiments of this application are described in detail below. Examples of these embodiments are shown in the accompanying drawings, wherein the same or similar reference numerals denote the same or similar elements or elements having the same or similar functions throughout. The embodiments described below with reference to the accompanying drawings are exemplary and are only used to explain the embodiments of this application, and should not be construed as limiting the embodiments of this application.

[0013] Please see Figure 1 , Figure 3 and Figure 7 This application provides an image sensor 10. The image sensor 10 includes a filter array 11 and a pixel array 12. The filter array 11 includes multiple filter groups 113. Each filter group 113 includes at least two different color filters 110. The number of filters 110 of each color in each filter group 113 is multiple. The pixel array 12 includes multiple pixels 120 and multiple floating diffusion nodes FD. Each pixel 120 corresponds to one filter 110 in the filter array 11. The pixel 120 is used to receive light passing through the corresponding filter 110 to generate an electrical signal. Pixels 120 corresponding to the same color filter 110 in the same filter group 113 share a floating diffusion node FD, so that the electrical signals generated by the pixels 120 corresponding to the same color filter 110 in the same filter group 113 can be merged at the corresponding floating diffusion node FD.

[0014] The image sensor 10 of the present application embodiment will be further described below with reference to the accompanying drawings.

[0015] Please see Figure 1 and Figure 2 The image sensor 10 of this application embodiment includes a microlens array 13, a filter array 11, and a pixel array 12. The microlens array 13, the filter array 11, and the pixel array 12 are arranged sequentially along the light-receiving direction of the image sensor 10.

[0016] The filter array 11 includes a plurality of first filter groups 111 and a plurality of second filter groups 112. The first filter groups 111 include an equal number of first color filters A and a plurality of second color filters B. The second filter groups 112 include an equal number of first color filters A and a plurality of third color filters C.

[0017] The pixel array 12 includes a plurality of pixels 120, each pixel 120 corresponding to a filter 110 of the filter array 11. The pixel 120 is used to receive light passing through the corresponding filter 110 to generate an electrical signal.

[0018] The microlens array 13 includes a plurality of microlens groups 131. One microlens group 131 in the microlens array 13 corresponds to one filter group 113 (either a first filter group 111 or a second filter group 112), and corresponds to a plurality of pixels 120 corresponding to that filter group 113. In one example, such as... Figure 1 As shown, each microlens group 131 includes multiple microlenses 130, and each microlens 130 corresponds to a filter 110 and a pixel 120. In another example, as Figure 2 As shown, each microlens group 131 includes a microlens 130, each microlens 130 corresponds to a filter group 113, and corresponds to a plurality of pixels 120 corresponding to the filter group 113.

[0019] Figures 3 to 6 This is a schematic diagram showing the arrangement of some filters 110 in the filter array 11 of various embodiments of this application. Figures 3 to 6 In the filter array 11 shown, each filter array 11 includes a plurality of first filter groups 111 and a plurality of second filter groups 112. Each first filter group 111 includes an equal number of first color filters A and a plurality of second color filters B. Each second filter group 112 includes an equal number of first color filters A and a plurality of third color filters C.

[0020] The color composition of the first color filter A, the second color filter B, and the third color filter C can be varied. For example, the first color filter A can be a green filter G, the second color filter B can be a red filter R, and the third color filter C can be a blue filter Bu; another example is that the first color filter A can be a yellow filter Y, the second color filter B can be a red filter R, and the third color filter C can be a blue filter Bu. The color composition of the first color filter A, the second color filter B, and the third color filter C is not limited to the compositions shown in the two examples above.

[0021] In this design, multiple first filter groups 111 can be arranged along a first diagonal direction D1, and multiple second filter groups 112 can be arranged along a second diagonal direction D2. The first diagonal direction D1 and the second diagonal direction D2 are different. In one example, when multiple first filter groups 111 are arranged along the first diagonal direction D1 and multiple second filter groups 112 are arranged along the second diagonal direction D2, the first filter groups 111 and the second filter groups 112 can be arranged adjacent to each other in the vertical and horizontal directions of the image sensor 10.

[0022] In this design, the number of filters 110 in the first filter group 111 is N*N, and the number of filters 110 in the second filter group 112 is also N*N, where N is an integer greater than or equal to 2. For example, the value of N can be 2, 3, 4, 5, 6, 7, 8, 9, 10, 15, 20, etc., and there is no restriction here.

[0023] The arrangement of the multiple filters 110 in each first filter group 111 can be as follows: (1) Please refer to Figure 3 Multiple first color filters A and multiple second color filters B are in the image sensor 10 ( Figure 1 (2) Please refer to the vertical and horizontal adjacent arrangement shown in the figure; Figure 4 Multiple filters 110 are arranged in rows, and the multiple filters 110 in the same row have the same color; (3) Please refer to Figure 5 Multiple filters 110 are arranged in columns, and the multiple filters 110 in the same column are the same color. Of course, the arrangement of multiple filters 110 in each first filter group 111 is not limited to this.

[0024] The arrangement of the multiple filters 110 in each second filter group 112 can be as follows: (1) Please refer to Figure 3 Multiple first color filters A and multiple third color filters C are in the image sensor 10 ( Figure 1 (2) Please refer to the vertical and horizontal adjacent arrangement shown in the figure; Figure 4 Multiple filters 110 are arranged in rows, and the multiple filters 110 in the same row have the same color; (3) Please refer to Figure 5 Multiple filters 110 are arranged in columns, and the multiple filters 110 in the same column are of the same color. Of course, the arrangement of multiple filters 110 in each second filter group 112 is not limited to this.

[0025] Figure 3 This is a schematic diagram showing the arrangement of some filters 110 in a filter array 11 according to one embodiment of this application. Please refer to... Figure 3 The arrangement of some filters 110 is as follows: ABAC BACA ACAB CABA Wherein, A is the first color filter, B is the second color filter, and C is the third color filter. The number of filters 110 in each first filter group 111 is 2*2, and the number of filters 110 in each second filter group 112 is 2*2.

[0026] like Figure 3As shown, a plurality of first filter groups 111 are arranged in the first diagonal direction D1 (e.g., Figure 3 The direction connecting the upper left and lower right corners of the middle filter array 11), and multiple second filter groups 112 are arranged in the second diagonal direction D2 (e.g., Figure 3 The direction connecting the lower left and upper right corners of the filter array 11), the first diagonal direction D1 and the second diagonal direction D2 are different. For example, the first diagonal direction D1 and the second diagonal direction D2 are perpendicular.

[0027] It should be noted that the first diagonal direction D1 and the second diagonal direction D2 are not limited to diagonals, but also include directions parallel to the diagonals. Here, "direction" is not a single pointing direction, but can be understood as a concept indicating a "straight line" of arrangement, and can have bidirectional pointing at both ends of the straight line. Furthermore, in other embodiments, the first diagonal direction D1 can also be the direction connecting the lower left and upper right corners of the filter array 11, and the second diagonal direction D2 can also be the direction connecting the upper left and lower right corners of the filter array 11. In this case, the positions of the first filter group 111 and the second filter group 112 change corresponding to the change in diagonal direction.

[0028] like Figure 3 As shown, the first filter group 111 and the second filter group 112 are located in the image sensor 10 ( Figure 1 The filter groups 113 are arranged adjacent to each other in the vertical direction V (as shown) and also adjacent to each other in the horizontal direction H. That is, the multiple filter groups 113 are arranged periodically in the vertical direction V in the order of the first filter group 111 and the second filter group 112, and the multiple filter groups 113 are arranged periodically in the horizontal direction H in the order of the first filter group 111 and the second filter group 112.

[0029] It should be noted that the arrangement of the first filter group 111 and the second filter group 112 adjacent to each other in the vertical direction V and in the horizontal direction H is not limited to... Figure 3 Alternatively, multiple filter groups 113 can be arranged periodically in the vertical direction V in the order of the first filter group 111 and the second filter group 112 or the second filter group 112 and the first filter group 111 (from left to right, from top to bottom, the same below), and multiple filter groups 113 can be arranged periodically in the horizontal direction H in the order of the first filter group 111 and the second filter group 112 or the second filter group 112 and the first filter group 111 (from left to right, from top to bottom, the same below).

[0030] like Figure 3As shown, in the first filter group 111, a plurality of first color filters A and a plurality of second color filters B are arranged adjacent to each other in the vertical direction V and the horizontal direction H. That is, in the vertical direction V, the first color filters A and the second color filters B are arranged alternately, and in the horizontal direction H, the first color filters A and the second color filters B are arranged alternately. In the second filter group 112, a plurality of first color filters A and a plurality of third color filters C are arranged adjacent to each other in the vertical direction V and the horizontal direction H. That is, in the vertical direction V, the first color filters A and the third color filters C are arranged alternately, and in the horizontal direction H, the first color filters A and the third color filters C are arranged alternately.

[0031] In some embodiments, the arrangement of some filters 110 in the filter array 11 can also be as follows: ABAACA BABCAC ABAACA ACAABA CACBAB ACAABA Wherein, A is the first color filter, B is the second color filter, and C is the third color filter. The number of filters 110 in each first filter group 111 is 3*3, and the number of filters 110 in each second filter group 112 is 3*3.

[0032] In this arrangement, multiple first filter groups 111 are arranged in the first diagonal direction D1 (e.g., the direction connecting the upper left and lower right corners of the filter array 11), and multiple second filter groups 112 are arranged in the second diagonal direction D2 (e.g., the direction connecting the lower left and upper right corners of the filter array 11). The first diagonal direction D1 and the second diagonal direction D2 are different; for example, the first diagonal direction D1 and the second diagonal direction D2 are perpendicular.

[0033] In this arrangement, the first filter group 111 and the second filter group 112 are located in the image sensor 10 ( Figure 1 The filter groups 113 are arranged adjacently in the vertical direction V (as shown) and also adjacently in the horizontal direction H. That is, the multiple filter groups 113 are arranged periodically in the vertical direction V in the order of the first filter group 111 and the second filter group 112 or the second filter group 112 and the first filter group 111, and the multiple filter groups 113 are arranged periodically in the horizontal direction H in the order of the first filter group 111 and the second filter group 112 or the second filter group 112 and the first filter group 111.

[0034] In this arrangement, in the first filter group 111, multiple first color filters A and multiple second color filters B are arranged adjacent to each other in the vertical direction V and the horizontal direction H. That is, in the vertical direction V, the first color filters A and the second color filters B are arranged alternately, and in the horizontal direction H, the first color filters A and the second color filters B are arranged alternately. In the second filter group 112, multiple first color filters A and multiple third color filters C are arranged adjacent to each other in the vertical direction V and the horizontal direction H. That is, in the vertical direction V, the first color filters A and the third color filters C are arranged alternately, and in the horizontal direction H, the first color filters A and the third color filters C are arranged alternately.

[0035] In some embodiments, the arrangement of some filters 110 in the filter array 11 can also be as follows: ABABACAC BABACACA ABABACAC BABACACA ACACABAB CACABABA ACACABAB CACABABA Wherein, A is the first color filter, B is the second color filter, and C is the third color filter. The number of filters 110 in each first filter group 111 is 4*4, and the number of filters 110 in each second filter group 112 is also 4*4.

[0036] In this arrangement, multiple first filter groups 111 are arranged in the first diagonal direction D1 (e.g., the direction connecting the upper left and lower right corners of the filter array 11), and multiple second filter groups 112 are arranged in the second diagonal direction D2 (e.g., the direction connecting the lower left and upper right corners of the filter array 11). The first diagonal direction D1 and the second diagonal direction D2 are different; for example, the first diagonal direction D1 and the second diagonal direction D2 are perpendicular.

[0037] In this arrangement, the first filter group 111 and the second filter group 112 are located in the image sensor 10 ( Figure 1 The filter groups 113 are arranged adjacently in the vertical direction V (as shown) and also adjacently in the horizontal direction H. That is, the multiple filter groups 113 are arranged periodically in the vertical direction V in the order of the first filter group 111 and the second filter group 112 or the second filter group 112 and the first filter group 111, and the multiple filter groups 113 are arranged periodically in the horizontal direction H in the order of the first filter group 111 and the second filter group 112 or the second filter group 112 and the first filter group 111.

[0038] In this arrangement, in the first filter group 111, multiple first color filters A and multiple second color filters B are arranged adjacent to each other in the vertical direction V and the horizontal direction H. That is, in the vertical direction V, the first color filters A and the second color filters B are arranged alternately, and in the horizontal direction H, the first color filters A and the second color filters B are arranged alternately. In the second filter group 112, multiple first color filters A and multiple third color filters C are arranged adjacent to each other in the vertical direction V and the horizontal direction H. That is, in the vertical direction V, the first color filters A and the third color filters C are arranged alternately, and in the horizontal direction H, the first color filters A and the third color filters C are arranged alternately.

[0039] Figure 4 This is a schematic diagram showing the arrangement of some filters 110 in the filter array 11 of another embodiment of this application. Please refer to... Figure 4 The arrangement of some filters 110 is as follows: AAAA BBCC AAAA CCBB Wherein, A is the first color filter, B is the second color filter, and C is the third color filter. The number of filters 110 in each first filter group 111 is 2*2, and the number of filters 110 in each second filter group 112 is 2*2.

[0040] like Figure 4 As shown, a plurality of first filter groups 111 are arranged in the first diagonal direction D1 (e.g., Figure 4 The direction connecting the upper left and lower right corners of the middle filter array 11), and multiple second filter groups 112 are arranged in the second diagonal direction D2 (e.g., Figure 4 The direction connecting the lower left and upper right corners of the filter array 11), the first diagonal direction D1 and the second diagonal direction D2 are different. For example, the first diagonal direction D1 and the second diagonal direction D2 are perpendicular.

[0041] like Figure 4 As shown, the first filter group 111 and the second filter group 112 are located in the image sensor 10 ( Figure 1The filter groups 113 are arranged adjacently in the vertical direction V (as shown) and also adjacently in the horizontal direction H. That is, the multiple filter groups 113 are arranged periodically in the vertical direction V in the order of the first filter group 111 and the second filter group 112 or the second filter group 112 and the first filter group 111, and the multiple filter groups 113 are arranged periodically in the horizontal direction H in the order of the first filter group 111 and the second filter group 112 or the second filter group 112 and the first filter group 111.

[0042] like Figure 4 As shown, in the first filter group 111, multiple filters 110 are arranged in rows, and the multiple filters 110 in the same row have the same color. For example, the multiple filters 110 in the first row are all first color filters A, and the multiple filters 110 in the second row are all second color filters B. In the second filter group 112, multiple filters 110 are arranged in rows, and the multiple filters 110 in the same row have the same color. For example, the multiple filters 110 in the first row are all first color filters A, and the multiple filters 110 in the second row are all third color filters C.

[0043] In some embodiments, the arrangement of some filters 110 in the filter array 11 can also be as follows: AAAAAA BBBCCC AAAAAA AAAAAA CCCBBB AAAAAA Wherein, A is the first color filter, B is the second color filter, and C is the third color filter. The number of filters 110 in each first filter group 111 is 3*3, and the number of filters 110 in each second filter group 112 is 3*3.

[0044] In this arrangement, multiple first filter groups 111 are arranged in the first diagonal direction D1 (e.g., the direction connecting the upper left and lower right corners of the filter array 11), and multiple second filter groups 112 are arranged in the second diagonal direction D2 (e.g., the direction connecting the lower left and upper right corners of the filter array 11). The first diagonal direction D1 and the second diagonal direction D2 are different; for example, the first diagonal direction D1 and the second diagonal direction D2 are perpendicular.

[0045] In this arrangement, the first filter group 111 and the second filter group 112 are located in the image sensor 10 ( Figure 1The filter groups 113 are arranged adjacently in the vertical direction V (as shown) and also adjacently in the horizontal direction H. That is, the multiple filter groups 113 are arranged periodically in the vertical direction V in the order of the first filter group 111 and the second filter group 112 or the second filter group 112 and the first filter group 111, and the multiple filter groups 113 are arranged periodically in the horizontal direction H in the order of the first filter group 111 and the second filter group 112 or the second filter group 112 and the first filter group 111.

[0046] In this arrangement, in the first filter group 111, multiple filters 110 are arranged in rows, and the multiple filters 110 in the same row have the same color. For example, the multiple filters 110 in the first row are all first color filters A, the multiple filters 110 in the second row are all second color filters B, and the multiple filters 110 in the third row are all first color filters A. In the second filter group 112, multiple filters 110 are arranged in rows, and the multiple filters 110 in the same row have the same color. For example, the multiple filters 110 in the first row are all first color filters A, the multiple filters 110 in the second row are all third color filters C, and the multiple filters 110 in the third row are all first color filters A.

[0047] In some embodiments, the arrangement of some filters 110 in the filter array 11 can also be as follows: AAAAAAAA BBBBCCCC AAAAAAAA BBBBCCCC AAAAAAAA CCCCBBBB AAAAAAAA CCCCBBBB Wherein, A is the first color filter, B is the second color filter, and C is the third color filter. The number of filters 110 in each first filter group 111 is 4*4, and the number of filters 110 in each second filter group 112 is also 4*4.

[0048] In this arrangement, multiple first filter groups 111 are arranged in the first diagonal direction D1 (e.g., the direction connecting the upper left and lower right corners of the filter array 11), and multiple second filter groups 112 are arranged in the second diagonal direction D2 (e.g., the direction connecting the lower left and upper right corners of the filter array 11). The first diagonal direction D1 and the second diagonal direction D2 are different; for example, the first diagonal direction D1 and the second diagonal direction D2 are perpendicular.

[0049] In this arrangement, the first filter group 111 and the second filter group 112 are located in the image sensor 10 ( Figure 1 The filter groups 113 are arranged adjacently in the vertical direction V (as shown) and also adjacently in the horizontal direction H. That is, the multiple filter groups 113 are arranged periodically in the vertical direction V in the order of the first filter group 111 and the second filter group 112 or the second filter group 112 and the first filter group 111, and the multiple filter groups 113 are arranged periodically in the horizontal direction H in the order of the first filter group 111 and the second filter group 112 or the second filter group 112 and the first filter group 111.

[0050] In this arrangement, in the first filter group 111, multiple filters 110 are arranged in rows, and the multiple filters 110 in the same row have the same color. For example, the multiple filters 110 in the first row are all first color filters A, the multiple filters 110 in the second row are all second color filters B, the multiple filters 110 in the third row are all first color filters A, and the multiple filters 110 in the fourth row are all second color filters B. In the second filter group 112, multiple filters 110 are arranged in rows, and the multiple filters 110 in the same row have the same color. For example, the multiple filters 110 in the first row are all first color filters A, the multiple filters 110 in the second row are all third color filters C, the multiple filters 110 in the third row are all first color filters A, and the multiple filters 110 in the fourth row are all third color filters C.

[0051] Figure 5 This is a schematic diagram showing the arrangement of some filters 110 in the filter array 11 of another embodiment of this application. Please refer to... Figure 5 The arrangement of some filters 110 is as follows: ABAC ABAC ACAB ACAB Wherein, A is the first color filter, B is the second color filter, and C is the third color filter. The number of filters 110 in each first filter group 111 is 2*2, and the number of filters 110 in each second filter group 112 is 2*2.

[0052] like Figure 5 As shown, a plurality of first filter groups 111 are arranged in the first diagonal direction D1 (e.g., Figure 5 The direction connecting the upper left and lower right corners of the middle filter array 11), and multiple second filter groups 112 are arranged in the second diagonal direction D2 (e.g., Figure 5The direction connecting the lower left and upper right corners of the filter array 11), the first diagonal direction D1 and the second diagonal direction D2 are different. For example, the first diagonal direction D1 and the second diagonal direction D2 are perpendicular.

[0053] like Figure 5 As shown, the first filter group 111 and the second filter group 112 are located in the image sensor 10 ( Figure 1 The filter groups 113 are arranged adjacently in the vertical direction V (as shown) and also adjacently in the horizontal direction H. That is, the multiple filter groups 113 are arranged periodically in the vertical direction V in the order of the first filter group 111 and the second filter group 112 or the second filter group 112 and the first filter group 111, and the multiple filter groups 113 are arranged periodically in the horizontal direction H in the order of the first filter group 111 and the second filter group 112 or the second filter group 112 and the first filter group 111.

[0054] like Figure 5 As shown, in the first filter group 111, multiple filters 110 are arranged in columns, and the multiple filters 110 in the same column have the same color. For example, the multiple filters 110 in the first column are all first color filters A, and the multiple filters 110 in the second column are all second color filters B. In the second filter group 112, multiple filters 110 are arranged in columns, and the multiple filters 110 in the same column have the same color. For example, the multiple filters 110 in the first column are all first color filters A, and the multiple filters 110 in the second column are all third color filters C.

[0055] In some embodiments, the arrangement of some filters 110 in the filter array 11 can also be as follows: ABAACA ABAACA ABAACA ACAABA ACAABA ACAABA Wherein, A is the first color filter, B is the second color filter, and C is the third color filter. The number of filters 110 in each first filter group 111 is 3*3, and the number of filters 110 in each second filter group 112 is 3*3.

[0056] In this arrangement, multiple first filter groups 111 are arranged in the first diagonal direction D1 (e.g., the direction connecting the upper left and lower right corners of the filter array 11), and multiple second filter groups 112 are arranged in the second diagonal direction D2 (e.g., the direction connecting the lower left and upper right corners of the filter array 11). The first diagonal direction D1 and the second diagonal direction D2 are different; for example, the first diagonal direction D1 and the second diagonal direction D2 are perpendicular.

[0057] In this arrangement, the first filter group 111 and the second filter group 112 are located in the image sensor 10 ( Figure 1 The filter groups 113 are arranged adjacently in the vertical direction V (as shown) and also adjacently in the horizontal direction H. That is, the multiple filter groups 113 are arranged periodically in the vertical direction V in the order of the first filter group 111 and the second filter group 112 or the second filter group 112 and the first filter group 111, and the multiple filter groups 113 are arranged periodically in the horizontal direction H in the order of the first filter group 111 and the second filter group 112 or the second filter group 112 and the first filter group 111.

[0058] In this arrangement, in the first filter group 111, multiple filters 110 are arranged in columns, and the multiple filters 110 in the same column have the same color. For example, the multiple filters 110 in the first column are all first color filters A, the multiple filters 110 in the second column are all second color filters B, and the multiple filters 110 in the third column are all first color filters A. In the second filter group 112, multiple filters 110 are arranged in columns, and the multiple filters 110 in the same column have the same color. For example, the multiple filters 110 in the first column are all first color filters A, the multiple filters 110 in the second column are all third color filters C, and the multiple filters 110 in the third column are all first color filters A.

[0059] In some embodiments, the arrangement of some filters 110 in the filter array 11 can also be as follows: ABABACAC ABABACAC ABABACAC ABABACAC ACACABAB ACACABAB ACACABAB ACACABAB Wherein, A is the first color filter, B is the second color filter, and C is the third color filter. The number of filters 110 in each first filter group 111 is 4*4, and the number of filters 110 in each second filter group 112 is also 4*4.

[0060] In this arrangement, multiple first filter groups 111 are arranged in the first diagonal direction D1 (e.g., the direction connecting the upper left and lower right corners of the filter array 11), and multiple second filter groups 112 are arranged in the second diagonal direction D2 (e.g., the direction connecting the lower left and upper right corners of the filter array 11). The first diagonal direction D1 and the second diagonal direction D2 are different; for example, the first diagonal direction D1 and the second diagonal direction D2 are perpendicular.

[0061] In this arrangement, the first filter group 111 and the second filter group 112 are located in the image sensor 10 ( Figure 1 The filter groups 113 are arranged adjacently in the vertical direction V (as shown) and also adjacently in the horizontal direction H. That is, the multiple filter groups 113 are arranged periodically in the vertical direction V in the order of the first filter group 111 and the second filter group 112 or the second filter group 112 and the first filter group 111, and the multiple filter groups 113 are arranged periodically in the horizontal direction H in the order of the first filter group 111 and the second filter group 112 or the second filter group 112 and the first filter group 111.

[0062] In this arrangement, in the first filter group 111, multiple filters 110 are arranged in columns, and the multiple filters 110 in the same column have the same color. For example, the multiple filters 110 in the first column are all first color filters A, the multiple filters 110 in the second column are all second color filters B, the multiple filters 110 in the third column are all first color filters A, and the multiple filters 110 in the fourth column are all second color filters B. In the second filter group 112, multiple filters 110 are arranged in columns, and the multiple filters 110 in the same column have the same color. For example, the multiple filters 110 in the first column are all first color filters A, the multiple filters 110 in the second column are all third color filters C, the multiple filters 110 in the third column are all first color filters A, and the multiple filters 110 in the fourth column are all third color filters C.

[0063] Figure 6 This is a schematic diagram showing the arrangement of some filters 110 in the filter array 11 of another embodiment of this application. Please refer to... Figure 6 The arrangement of some filters 110 is as follows: ABAA ABCC AAAB CCAB Wherein, A is the first color filter, B is the second color filter, and C is the third color filter. The number of filters 110 in each first filter group 111 is 2*2, and the number of filters 110 in each second filter group 112 is 2*2.

[0064] like Figure 6 As shown, a plurality of first filter groups 111 are arranged in the first diagonal direction D1 (e.g., Figure 6 The direction connecting the upper left and lower right corners of the middle filter array 11), and multiple second filter groups 112 are arranged in the second diagonal direction D2 (e.g., Figure 6 The direction connecting the lower left and upper right corners of the filter array 11), the first diagonal direction D1 and the second diagonal direction D2 are different. For example, the first diagonal direction D1 and the second diagonal direction D2 are perpendicular.

[0065] like Figure 6 As shown, the first filter group 111 and the second filter group 112 are located in the image sensor 10 ( Figure 1 The filter groups 113 are arranged adjacently in the vertical direction V (as shown) and also adjacently in the horizontal direction H. That is, the multiple filter groups 113 are arranged periodically in the vertical direction V in the order of the first filter group 111 and the second filter group 112 or the second filter group 112 and the first filter group 111, and the multiple filter groups 113 are arranged periodically in the horizontal direction H in the order of the first filter group 111 and the second filter group 112 or the second filter group 112 and the first filter group 111.

[0066] like Figure 6 As shown, in the first filter group 111, multiple filters 110 are arranged in columns, and the multiple filters 110 in the same column have the same color. For example, the multiple filters 110 in the first column are all first color filters A, and the multiple filters 110 in the second column are all second color filters B. In the second filter group 112, multiple filters 110 are arranged in rows, and the multiple filters 110 in the same row have the same color. For example, the multiple filters 110 in the first row are all first color filters A, and the multiple filters 110 in the second row are all third color filters C.

[0067] In some embodiments, the arrangement of some filters 110 in the filter array 11 can also be as follows: AAAACA BBBACA AAAACA ACAAAA ACABBB ACAAAA Wherein, A is the first color filter, B is the second color filter, and C is the third color filter. The number of filters 110 in each first filter group 111 is 3*3, and the number of filters 110 in each second filter group 112 is 3*3.

[0068] In this arrangement, multiple first filter groups 111 are arranged in the first diagonal direction D1 (e.g., the direction connecting the upper left and lower right corners of the middle filter array 11), and multiple second filter groups 112 are arranged in the second diagonal direction D2 (e.g., the direction connecting the lower left and upper right corners of the middle filter array 11). The first diagonal direction D1 and the second diagonal direction D2 are different; for example, the first diagonal direction D1 and the second diagonal direction D2 are perpendicular.

[0069] In this arrangement, the first filter group 111 and the second filter group 112 are located in the image sensor 10 ( Figure 1 The filter groups 113 are arranged adjacently in the vertical direction V (as shown) and also adjacently in the horizontal direction H. That is, the multiple filter groups 113 are arranged periodically in the vertical direction V in the order of the first filter group 111 and the second filter group 112 or the second filter group 112 and the first filter group 111, and the multiple filter groups 113 are arranged periodically in the horizontal direction H in the order of the first filter group 111 and the second filter group 112 or the second filter group 112 and the first filter group 111.

[0070] In this arrangement, in the first filter group 111, multiple filters 110 are arranged in rows, and the multiple filters 110 in the same row have the same color. For example, the multiple filters 110 in the first row are all first color filters A, the multiple filters 110 in the second row are all second color filters B, and the multiple filters 110 in the third row are all first color filters A. In the second filter group 112, multiple filters 110 are arranged in columns, and the multiple filters 110 in the same column have the same color. For example, the multiple filters 110 in the first column are all first color filters A, the multiple filters 110 in the second column are all third color filters C, and the multiple filters 110 in the third column are all first color filters A.

[0071] In some embodiments, the arrangement of some filters 110 in the filter array 11 can also be as follows: ABABAAAA ABABCCCC ABABAAAA ABABCCCC AAAAABAB CCCCABAB AAAAABAB CCCCABAB Wherein, A is the first color filter, B is the second color filter, and C is the third color filter. The number of filters 110 in each first filter group 111 is 4*4, and the number of filters 110 in each second filter group 112 is also 4*4.

[0072] In this arrangement, multiple first filter groups 111 are arranged in the first diagonal direction D1 (e.g., the direction connecting the upper left and lower right corners of the filter array 11), and multiple second filter groups 112 are arranged in the second diagonal direction D2 (e.g., the direction connecting the lower left and upper right corners of the filter array 11). The first diagonal direction D1 and the second diagonal direction D2 are different; for example, the first diagonal direction D1 and the second diagonal direction D2 are perpendicular.

[0073] In this arrangement, the first filter group 111 and the second filter group 112 are located in the image sensor 10 ( Figure 1 The filter groups 113 are arranged adjacently in the vertical direction V (as shown) and also adjacently in the horizontal direction H. That is, the multiple filter groups 113 are arranged periodically in the vertical direction V in the order of the first filter group 111 and the second filter group 112 or the second filter group 112 and the first filter group 111, and the multiple filter groups 113 are arranged periodically in the horizontal direction H in the order of the first filter group 111 and the second filter group 112 or the second filter group 112 and the first filter group 111.

[0074] In this arrangement, in the first filter group 111, multiple filters 110 are arranged in columns, and the multiple filters 110 in the same column have the same color. For example, the multiple filters 110 in the first column are all first color filters A, the multiple filters 110 in the second column are all second color filters B, the multiple filters 110 in the third column are all first color filters A, and the multiple filters 110 in the fourth column are all second color filters B. In the second filter group 112, multiple filters 110 are arranged in rows, and the multiple filters 110 in the same row have the same color. For example, the multiple filters 110 in the first row are all first color filters A, the multiple filters 110 in the second row are all third color filters C, the multiple filters 110 in the third row are all first color filters A, and the multiple filters 110 in the fourth row are all third color filters C.

[0075] Please combine Figures 1 to 7In the image sensor 10 of this application embodiment, the electrical signals generated by the plurality of pixels 120 corresponding to each first filter group 111 can be combined to generate a first analog pixel signal and a third analog pixel signal. The electrical signals generated by the plurality of pixels 120 corresponding to each second filter group 112 can be combined to generate a second analog pixel signal and a fourth analog pixel signal. Specifically, the electrical signals generated by the plurality of pixels 120 corresponding to the plurality of first color filters A in each first filter group 111 are combined at the floating diffusion node FD shared by the plurality of pixels 120 corresponding to the plurality of first color filters A in the first filter group 111 to generate the first analog pixel signal. The electrical signals generated by the plurality of pixels 120 corresponding to the plurality of second color filters B in each first filter group 111 are combined at the floating diffusion node shared by the plurality of pixels 120 corresponding to the plurality of second color filters B in the first filter group 111 to generate the third analog pixel signal. The electrical signals generated by the multiple pixels 120 corresponding to the multiple first color filters A in each second filter group 112 are combined at a floating diffusion node shared by the multiple pixels 120 corresponding to the multiple first color filters A in the second filter group 112 to generate a second analog pixel signal. The electrical signals generated by the multiple pixels 120 corresponding to the multiple third color filters C in each second filter group 112 are combined at a floating diffusion node shared by the multiple pixels 120 corresponding to the multiple third color filters C in the second filter group 112 to generate a fourth analog pixel signal.

[0076] Specifically, in one example, within the same filter group 113, multiple pixels 120 corresponding to filters 110 of the same color share a single floating diffusion node FD, while pixels 120 corresponding to filters 110 of different colors correspond to different floating diffusion nodes FD. Please refer to... Figure 1 , Figure 3 and Figure 7 Each pixel 120 includes photoelectric elements (e.g., PD11 / PD12 / PD13 / PD14 / PD21 / PD22 / PD23 / PD24) and an exposure control circuit (TRF). The pixel array 12 also includes readout circuitry 121. Each set of readout circuitry 121 includes a reset circuit (RST), a floating diffusion node (FD), an amplifier circuit (SF), and a select circuit (SEL). A floating diffusion node (FD) is connected to a reset circuit (RST) and an amplifier circuit (SF), and a select circuit (SEL) is connected to an amplifier circuit (SF). For example... Figure 1 , Figure 3 and Figure 7As shown, in the first filter group 111, the two pixels 120 corresponding to the two first color filters A (including the pixel of PD11 and the pixel of PD22) share a set of readout circuits 121, and the two pixels 120 corresponding to the two second color filters B (including the pixel of PD12 and the pixel of PD21) also share a set of readout circuits 121. However, the readout circuit 121 shared by the two pixels 120 corresponding to the two second color filters B is different from the readout circuit 121 shared by the two pixels 120 corresponding to the two first color filters A. In the first filter group 111, the exposure control circuits TRF in the two pixels 120 corresponding to the two first color filters A are all connected to the floating diffusion node FD of the corresponding readout circuit 121, and the exposure control circuits TRF in the two pixels 120 corresponding to the two second color filters B are all connected to the floating diffusion node FD of the corresponding readout circuit 121. Figure 1 , Figure 3 and Figure 7 As shown, in the second filter group 112, the two pixels 120 corresponding to the two first color filters A (including the pixel including PD13 and the pixel including PD24) share a readout circuit 121, and the two pixels 120 corresponding to the two third color filters C (including the pixel including PD14 and the pixel including PD23) also share a readout circuit 121. Furthermore, the readout circuit 121 shared by the two pixels 120 corresponding to the two second color filters B is different from the readout circuit 121 shared by the two pixels 120 corresponding to the two first color filters A. In the second filter group 112, the exposure control circuits TRF in the two pixels 120 corresponding to the two first color filters A are all connected to the floating diffusion node FD of the corresponding readout circuit 121, and the exposure control circuits TRF in the two pixels 120 corresponding to the two third color filters C are all connected to the floating diffusion node FD of the corresponding readout circuit 121.

[0077] When pixel array 12 is operating, the control terminals TX of the exposure control circuits TRF of pixels 120 corresponding to the same color filters 110 in the same filter group 113 are simultaneously turned on. This transfers the charge generated by the multiple pixels 120 corresponding to the same color filters 110 in the same filter group 113 after receiving light to a shared floating diffusion node FD. Within the same filter group 113, the control terminals TX of the exposure control circuits TRF of pixels 120 corresponding to different color filters 110 are turned on simultaneously or at different times. Specifically, as shown... Figure 1 , Figure 3 , Figure 7 , Figure 8A and Figure 8BAs shown, in the first filter group 111, the reset circuit RST resets the floating diffusion node FD shared by the two pixels 120 (including the pixel of PD11 and the pixel of PD22) corresponding to the two first color filters A. Subsequently, the control terminal T1 of the selection circuit SEL shared by the two pixels 120 corresponding to the two first color filters A is turned on to output the reset level at the corresponding floating diffusion node FD. Then, the control terminal TX1 of the exposure control circuit TRF of one pixel 120 (including the pixel of PD11) corresponding to one first color filter A and the control terminal TX2 of the exposure control circuit TRF of the other pixel 120 (including the pixel of PD22) corresponding to the other first color filter A are turned on simultaneously. Then, the charge generated by the pixel 120 corresponding to one first color filter A after receiving light will be transferred to the floating diffusion node FD shared by the two pixels 120 corresponding to the two first color filters A, and the charge generated by the pixel 120 corresponding to the other first color filter A after receiving light will also be transferred to the floating diffusion node FD shared by the two pixels 120 corresponding to the two first color filters A. Thus, the charges generated by the two pixels 120 corresponding to the two first color filters A after receiving light will merge at the floating diffusion node FD shared by these two pixels 120. The amplification circuit SF will amplify the electrical signal corresponding to the charge at this floating diffusion node FD to obtain the first analog pixel signal. When the control terminal T1 of the selection circuit SEL shared by the two pixels 120 corresponding to the two first color filters A is turned on again, the first analog pixel signal is output to the corresponding analog-to-digital converter (ADC). Similarly, in the first filter group 111, the reset circuit RST resets the floating diffusion node FD shared by the two pixels 120 (including the pixel of PD12 and the pixel of PD21) corresponding to the two second color filters B. Subsequently, the control terminal T2 of the selection circuit SEL shared by the two pixels 120 corresponding to the two second color filters B is turned on to output the reset level at the corresponding floating diffusion node FD. Subsequently, the control terminal TX3 of the exposure control circuit TRF of one pixel 120 (including the pixel of PD12) corresponding to one second color filter B and the control terminal TX4 of the exposure control circuit TRF of another pixel 120 (including the pixel of PD21) corresponding to another second color filter B are simultaneously turned on. Then, the charge generated by the pixel 120 corresponding to one second color filter B after receiving light will be transferred to the floating diffusion node FD shared by the two pixels 120 corresponding to the two second color filters B. The charge generated by the pixel 120 corresponding to the other second color filter B after receiving light will also be transferred to the floating diffusion node FD shared by the two pixels 120 corresponding to the two second color filters B.Thus, the charges generated by the two pixels 120 corresponding to the two second color filters B after receiving light will be combined at the floating diffusion node FD shared by these two pixels 120. The amplification circuit SF will amplify the electrical signal corresponding to the charge at this floating diffusion node FD to obtain the third analog pixel signal. When the control terminal T2 of the selection circuit SEL shared by the two pixels 120 corresponding to the two second color filters B is turned on again, the third analog pixel signal is output to the corresponding analog-to-digital conversion circuit. The merging method of the electrical signals generated by the two pixels 120 corresponding to the two first color filters A (including the pixel of PD13 and the pixel of PD24) in the second filter group 112 and the merging method of the electrical signals generated by the two pixels 120 corresponding to the two third color filters C (including the pixel of PD14 and the pixel of PD23) are the same, and will not be described again here.

[0078] Since the pixels 120 corresponding to different color filters 110 in the same filter group 113 share different floating diffusion nodes (FD), during signal merging, the control terminals TX of the exposure control circuits TRF of the pixels 120 corresponding to different color filters 110 in the same filter group 113 can be turned on simultaneously or at different times. For example, in the first filter group 111, the control terminals TX1 and TX2 of the exposure control circuits TRF of the two pixels 120 corresponding to the two first color filters A are turned on at time t1, and the control terminals TX3 and TX4 of the exposure control circuits TRF of the two pixels 120 corresponding to the two second color filters B are turned on at time t2, where t1 can be equal to t2 (e.g., ...). Figure 8A As shown), it can also be different from t2 (e.g. Figure 8B As shown). Specifically, as Figure 8A As shown, when t1=t2, in the first filter group 111, the control terminals TX1, TX2, TX3, and TX4 of the exposure control circuit TRF of the four pixels 120 corresponding to the four filters 110 are simultaneously turned on, so that the electrical signals generated by the two pixels 120 corresponding to the two first color filters A are transferred to the floating diffusion node FD shared by these two pixels 120, and the electrical signals generated by the two pixels 120 corresponding to the two second color filters B are transferred to the floating diffusion node FD shared by these two pixels 120. Figure 8BAs shown, when t1≠t2, in the first filter group 111, the control terminals TX1 and TX2 of the exposure control circuit TRF of the two pixels 120 corresponding to the two first color filters A are simultaneously turned on first, that is, simultaneously turned on at time t1, so that the electrical signals generated by the two pixels 120 corresponding to the two first color filters A are transferred to the floating diffusion node FD shared by the two pixels 120. Subsequently, the control terminals TX3 and TX4 of the exposure control circuit TRF of the two pixels 120 corresponding to the two second color filters B are simultaneously turned on again, that is, simultaneously turned on at time t1, so that the electrical signals generated by the two pixels 120 corresponding to the two second color filters B are transferred to the floating diffusion node FD shared by the two pixels 120. It should be noted that in other examples, the control terminals TX3 and TX4 of the exposure control circuit TRF of the two pixels 120 corresponding to the two second color filters B may also be simultaneously turned on first, and then the control terminals TX1 and TX2 of the exposure control circuit TRF of the two pixels 120 corresponding to the two first color filters A may be simultaneously turned on, which is not limited here.

[0079] In another example, within the same filter group 113, multiple pixels 120 corresponding to all colors of the filter 110 share a single floating diffusion node FD, and each pixel 120 includes an exposure control circuit TRF. Please refer to... Figure 1 and Figure 9 Each pixel 120 includes photoelectric elements (e.g., PD11 / PD12 / PD13 / PD14 / PD21 / PD22 / PD23 / PD24 / PD31 / PD32 / PD33 / PD34 / PD41 / PD42 / PD43 / PD44) and an exposure control circuit TRF. The pixel array 12 also includes readout circuits 121. Each set of readout circuits 121 includes a reset circuit RST, a floating diffusion node FD, an amplifier circuit SF, and a selection circuit SEL. A floating diffusion node FD is connected to a reset circuit RST and an amplifier circuit SF, and a selection circuit SEL is connected to an amplifier circuit SF. For example... Figure 1 , Figure 3 and Figure 9 As shown, in each first filter group 111, the two pixels 120 corresponding to the two first color filters A (including the pixel of PD11 and the pixel of PD22) and the two pixels 120 corresponding to the two second color filters B (including the pixel of PD12 and the pixel of PD21) share a set of readout circuits 121. In the first filter group 111, the exposure control circuits TRF in the two pixels 120 corresponding to the two first color filters A and the two pixels 120 corresponding to the two second color filters B are both connected to the floating diffusion node FD of a readout circuit 121. Figure 1 , Figure 3 and Figure 9 As shown, in each second filter group 112, the two pixels 120 corresponding to the two first color filters A and the two pixels 120 corresponding to the two third color filters C share a readout circuit 121. In the second filter group 112, the exposure control circuit TRF in the two pixels 120 corresponding to the two first color filters A (including the pixel of PD13 and the pixel of PD24) and the exposure control circuit TRF in the two pixels 120 corresponding to the two third color filters C (including the pixel of PD14 and the pixel of PD23) are both connected to the floating diffusion node FD of a readout circuit 121.

[0080] When pixel array 12 is operating, the control terminals TX of the exposure control circuits TRF of multiple pixels 120 corresponding to the same color filter 110 in the same filter group 113 are simultaneously turned on. This transfers the charge generated by the pixels 120 corresponding to the same color filter 110 after receiving light to the floating diffusion node FD shared by the multiple pixels 120 in the same filter group 113. The control terminals of the exposure control circuits TRF of pixels 120 corresponding to different color filters 110 in the same filter group 113 are turned on in a time-division manner. Specifically, as shown... Figure 1 , Figure 3 , Figure 9 and Figure 10AAs shown, for each first filter group 111, the reset circuit RST resets the floating diffusion node FD shared by the four pixels 120 corresponding to the four filters 110 in the first filter group 111. Subsequently, the control terminal T1 of the selection circuit SEL corresponding to the two pixels 120 (including the pixel of PD11 and the pixel of PD22) corresponding to the two first color filters A is turned on to output the reset level at the corresponding floating diffusion node FD. Subsequently, at time t1, the control terminal TX1 of the exposure control circuit TRF of one pixel 120 (including the pixel of PD11) corresponding to one first color filter A and the control terminal TX2 of the exposure control circuit TRF of another pixel 120 (including the pixel of PD22) corresponding to one first color filter A are simultaneously turned on. Then, the charge generated by the pixel 120 (including the pixel of PD11) corresponding to one first color filter A after receiving light will be transferred to the floating diffusion node FD shared by the four pixels 120 (including the pixels of PD11, PD12, PD21, and PD22) corresponding to the first filter group 111. The charge generated by the pixel 120 (including the pixel of PD22) corresponding to another first color filter A after receiving light will also be transferred to the floating diffusion node FD shared by the four pixels 120 corresponding to the first filter group 111. Thus, the charges generated by the two pixels 120 corresponding to the two first color filters A after receiving light will merge at the floating diffusion node FD shared by these four pixels 120. The amplification circuit SF will amplify the electrical signal corresponding to the charge at this floating diffusion node FD to obtain the first analog pixel signal. When the control terminal T1 of the selection circuit SEL corresponding to the two pixels 120 corresponding to the two first color filters A is turned on again, the first analog pixel signal is output to the corresponding analog-to-digital conversion circuit. After the first analog pixel signal is output to the analog-to-digital conversion circuit, the reset circuit RST will reset the floating diffusion node FD shared by the four pixels 120 corresponding to the four filters 110 in the first filter group 111. Subsequently, the control terminal T1 of the selection circuit SEL corresponding to the two pixels 120 (including the pixel of PD12 and the pixel of PD21) corresponding to the two second color filters B is turned on to output the reset level at the corresponding floating diffusion node FD.Subsequently, at time t2 (t1 is less than t2), the control terminal TX3 of the exposure control circuit TRF of one pixel 120 (including the pixel of PD12) corresponding to one second color filter B in the first filter group 111 and the control terminal TX4 of the exposure control circuit TRF of another pixel 120 (including the pixel of PD21) corresponding to another second color filter B are simultaneously turned on. Then, the charge generated by the pixel 120 (including the pixel of PD12) corresponding to one second color filter B after receiving light will be transferred to the floating diffusion node FD shared by the four pixels 120 (including the pixels of PD11, PD12, PD21, and PD22) corresponding to the first filter group 111. The charge generated by the pixel 120 (including the pixel of PD21) corresponding to another second color filter B after receiving light will also be transferred to the floating diffusion node FD shared by the four pixels 120 corresponding to the first filter group 111. Thus, the charges generated by the two pixels 120 corresponding to the two second color filters B after receiving light will be combined at the floating diffusion node FD shared by these four pixels 120. The amplification circuit SF will amplify the electrical signal corresponding to the charge at this floating diffusion node FD to obtain the third analog pixel signal. When the control terminal T1 of the selection circuit SEL corresponding to the two pixels 120 corresponding to the two second color filters B is turned on again, the third analog pixel signal is output to the corresponding analog-to-digital conversion circuit. The merging method of the electrical signals generated by the two pixels 120 corresponding to the two first color filters A (including the pixel of PD13 and the pixel of PD24) in the second filter group 112 and the merging method of the electrical signals generated by the two pixels 120 corresponding to the two third color filters C (including the pixel of PD14 and the pixel of PD23) are the same, and will not be described again here.

[0081] Since multiple pixels 120 corresponding to all colors of filters 110 in the same filter group 113 share a single floating diffusion node FD, if the control terminal TX of the exposure control circuit TRF of all pixels 120 is turned on simultaneously, the electrical signals generated by the pixels 120 corresponding to different colors of filters 110 will merge. Therefore, to avoid this situation, such as... Figure 10A As shown, in the same filter group 113, the control terminal TX of the exposure control circuit TRF for pixels 120 corresponding to different color filters 110 should be turned on in a time-division manner. It should be noted that... Figure 10A The diagram shows that the control terminals TX1 and TX2 of the exposure control circuit TRF for the two pixels 120 corresponding to the two first color filters A are simultaneously turned on first. In other embodiments, the control terminals TX3 and TX4 of the exposure control circuit TRF for the two pixels 120 corresponding to the two second color filters B may also be simultaneously turned on first, and this is not a limitation.

[0082] Please see Figure 11 Image sensors typically also include analog-to-digital (ADC) circuits. Assuming the pixel array contains N*M pixels, and the number of ADC circuits is M, meaning one ADC circuit corresponds to each column of pixels. When performing ADC conversion, the M ADC circuits simultaneously convert the analog pixel signals output from the M pixels in the first row and column, then the M pixels in the second row and column, then the M pixels in the third row and column, and so on, until finally converting the M pixels in the Nth row and column. Assuming that converting the analog pixel signals from the M pixels in each row to digital pixel signals takes time t0, the total time required for the M ADC circuits to convert the analog pixel signals from the N rows to digital pixel signals is N*t0 to complete the ADC conversion of N*M analog pixel signals.

[0083] Please see Figure 1 , Figure 7 and Figure 12 In this embodiment, the image sensor 10 combines the electrical signals output by the pixel 120 using a shared floating diffusion node (FD) to obtain a combined analog pixel signal. When the pixel array 12 includes N*M pixels and the number of analog-to-digital converters is M, the number of analog pixel signals is reduced to N*M / S because the electrical signals of the pixels 120 corresponding to the same color filter 110 in the same filter group 113 are combined. Figure 12 The value of S is 2, determined by the number of pixels 120 corresponding to the same color filter 110 in the same filter group 113, i.e., S = (number of pixels 120 corresponding to the same color filter 110 in the same filter group 113). Therefore, M analog-to-digital conversion circuits only need a total time of N*t0 / S to complete the analog-to-digital conversion of N*M / S analog pixel signals, significantly reducing the conversion time. The frame rate of the image signal output by the image sensor 10 is related to the bandwidth of the I / F interface between the image sensor 10 and the processor, and also to the conversion time. Generally, the larger the amount of data output by the image sensor 10, the more likely it is to cause a bandwidth bottleneck in the I / F interface, resulting in a lower image frame rate; the more time the conversion takes, the lower the image frame rate. The image sensor 10 in this embodiment utilizes a shared floating diffusion node (FD) to reduce the amount of data to be output and reduces the conversion time, which is beneficial for improving the frame rate. The image sensor 10 of this application will have great advantages when applied to application scenarios with high frame rate requirements, such as video chat and motion capture.

[0084] In some embodiments, the filter array 11 ( Figure 1 The area is divided into multiple regions, each region including at least one filter group 113 (as shown). Figure 3 As shown, the number of filter groups 113 in each region is determined by the target frame rate of the image signal output by the image sensor 10. The higher the target frame rate, the more filter groups 113 are in each region. The image sensor 10 can adaptively adjust the number of filter groups 113 in each region for different target frame rates and merge analog pixel signals with the same color channel values ​​in the same region.

[0085] In one example, across all regions, all pixels 120 corresponding to the first color filter A within each region share a single analog-to-digital converter (ADC). Each ADC converts the first analog pixel signal and / or the second analog pixel signal of all pixels 120 corresponding to the first color filter A within each region into a first digital pixel signal. In some regions, all pixels 120 corresponding to the second color filter B within each region share a single ADC. Each ADC converts the third analog pixel signal of all pixels 120 corresponding to the second color filter B within each region into a second digital pixel signal. In another region, all pixels 120 corresponding to the third color filter C within each region share a single ADC. Each ADC converts the fourth analog pixel signal of all pixels 120 corresponding to the third color filter C within each region into a third digital pixel signal. In the case where each region includes multiple filter groups 113: in all regions, the control terminals T of the multiple selection circuits SEL corresponding to the multiple pixels 120 corresponding to all first color filters A in each region are simultaneously turned on, so as to transmit the first analog pixel signals and second analog pixel signals of the multiple pixels 120 to the analog-to-digital conversion circuit shared by the multiple pixels 120. In some regions, the control terminals T of the multiple selection circuits SEL corresponding to the multiple pixels 120 corresponding to all second color filters B in each region are simultaneously turned on, so as to transmit the multiple third analog pixel signals of the multiple pixels 120 to the analog-to-digital conversion circuit shared by the multiple pixels 120. In some regions, the control terminals T of the multiple selection circuits SEL corresponding to the multiple pixels 120 corresponding to all third color filters C in each region are simultaneously turned on, so as to transmit the multiple fourth analog pixel signals of the multiple pixels 120 to the analog-to-digital conversion circuit shared by the multiple pixels 120.

[0086] For example, please combine Figure 1 , Figure 3 , Figure 7 , Figure 8A , Figure 8B and Figure 13 The target frame rate is FP1, and each region includes a filter group 113, that is, the filter group 113 in each region is either the first filter group 111 or the second filter group 112. Taking the first filter group 111 as an example, the two pixels 120 (including the pixel of PD11 and the pixel of PD22) corresponding to the two first color filters A in the first filter group 111 share one analog-to-digital conversion circuit, and the two pixels 120 (including the pixel of PD12 and the pixel of PD21) corresponding to the two second color filters B share another analog-to-digital conversion circuit. If the control terminals TX1 and TX2 of the exposure control circuit TRF of the two pixels 120 corresponding to the two first color filters A and the control terminals TX3 and TX4 of the exposure control circuit TRF of the two pixels 120 corresponding to the two second color filters B are simultaneously turned on, then the control terminal T1 of the selection circuit SEL shared by the two pixels 120 corresponding to the two first color filters A and the control terminal T2 of the selection circuit SEL shared by the two pixels 120 corresponding to the two second color filters B can be turned on simultaneously (e.g., Figure 8A (As shown) or time-sharing (not shown). If the control terminals TX1 and TX2 of the exposure control circuit TRF of the two pixels 120 corresponding to the two first color filters A and the control terminals TX3 and TX4 of the exposure control circuit TRF of the two pixels 120 corresponding to the two second color filters B are time-sharing, then the control terminal T1 of the selection circuit SEL shared by the two pixels 120 corresponding to the two first color filters A and the control terminal T2 of the selection circuit SEL shared by the two pixels 120 corresponding to the two second color filters B can be time-sharing. Figure 8B As shown). When the image sensor 10 is working, the electrical signals of the two pixels 120 corresponding to the two first color filters A in the first filter group 111 are merged at the floating diffusion node FD. Subsequently, the control terminal T1 of the selection circuit SEL shared by the two pixels 120 is turned on, and the merged first analog pixel signal is transmitted to the analog-to-digital conversion circuit shared by the two pixels 120 for analog-to-digital conversion to obtain a first digital pixel signal (as shown). Figure 13 In the lower left figure, each smallest A square corresponds to a first digital pixel signal. The first digital pixel signal is used to characterize the action on at least one filter group 113. Figure 13 The image shows the values ​​of the first color channel of light from multiple pixels 120 corresponding to a filter group 113. The electrical signals of two pixels 120 corresponding to two second color filters B in the first filter group 111 are merged at the floating diffusion node FD. Subsequently, the control terminal T2 of the selection circuit SEL shared by these two pixels 120 is turned on, and the merged third analog pixel signal is transmitted to the analog-to-digital converter circuit shared by these two pixels 120 for analog-to-digital conversion to obtain a second digital pixel signal. Figure 13In the right image below, each smallest B square corresponds to a second digital pixel signal. The second digital pixel signal is used to characterize the action on at least one filter group 113. Figure 13 The diagram shows the values ​​of the second color channels of light rays from multiple pixels 120 corresponding to a filter group 113. The method by which two pixels 120 corresponding to the two first color filters A in the second filter group 112 share an analog-to-digital converter circuit to convert the second analog pixel signal into a first digital pixel signal is the same, and will not be described further here. Similarly, the method by which two pixels 120 corresponding to the two third color filters C in the second filter group 112 share an analog-to-digital converter circuit to convert the fourth analog pixel signal into a third digital pixel signal is the same, and will not be described further here. The third digital pixel signal is used to characterize the value of the third color channel of light rays acting on at least one pixel 120 corresponding to a filter group 113.

[0087] Therefore, as Figure 13 As shown, the image sensor 10 can output two digital image signals. One digital image signal consists of multiple first digital pixel signals, and the other digital image signal consists of multiple second digital pixel signals and multiple third digital pixel signals. The target frame rate achievable by the digital image signals output by the image sensor 10 is FP1.

[0088] For example, please combine Figure 1 , Figure 3 , Figure 9 , Figure 10A , Figure 10B and Figure 15 As shown, the target frame rate is FP3, and each region includes four filter groups 113, that is, each region includes two first filter groups 111 and two second filter groups 112. Taking the two first filter groups 111 in each region as an example, the four pixels 120 corresponding to the four first color filters A (including the pixels of PD11, PD22, PD33, and PD44) in the two first filter groups 111 and the four pixels 120 corresponding to the four first color filters A (including the pixels of PD13, PD24, PD31, and PD42) in the two second filter groups 112 share a common analog-to-digital conversion circuit. Since the two pixels 120 corresponding to the two first color filters A and the two pixels 120 corresponding to the two second color filters B in the same first filter group 111 share a common floating diffusion node FD, therefore, when the image sensor 10 is working, as Figure 9 , Figure 10A and Figure 15As shown in the diagram at the upper center, the electrical signals of two pixels 120 (including the pixel of PD11 and the pixel of PD22) corresponding to two first color filters A in a first filter group 111 are combined at a floating diffusion node FD. Similarly, the electrical signals of two pixels 120 (including the pixel of PD33 and the pixel of PD44) corresponding to two first color filters A in another first filter group 111 are combined at another floating diffusion node FD. Likewise, the electrical signals of two pixels 120 (including the pixel of PD13 and the pixel of PD24) corresponding to two first color filters A in a second filter group 112 are combined at a floating diffusion node FD. And the electrical signals of two pixels 120 (including the pixel of PD31 and the pixel of PD42) corresponding to two first color filters A in another second filter group 112 are combined at another floating diffusion node FD. Subsequently, as... Figure 9 , Figure 10B and Figure 15 As shown in the left figure in the middle position, the control terminal T1 of the selection circuit SEL shared by the two pixels 120 corresponding to the two first color filters A in a first filter group 111 is turned on. Simultaneously, the control terminal T4 of the selection circuit SEL shared by the two pixels 120 corresponding to the two first color filters A in another first filter group 111 is also turned on. The control terminal T1 of the selection circuit SEL shared by the two pixels 120 corresponding to the two first color filters A in a second filter group 112 is also turned on simultaneously. The control terminal T4 of the selection circuit SEL shared by the two pixels 120 corresponding to the two first color filters A in another second filter group 112 is also turned on simultaneously. The merged two first analog pixel signals and the merged two second analog pixel signals ( Figure 15 In the left image at the center position, a smallest A square corresponds to either a first analog pixel signal or a second analog pixel signal. This signal is transmitted to an analog-to-digital converter (not shown) shared by these eight pixels 120 (including pixels PD11, PD22, PD33, PD44, PD13, PD24, PD31, and PD42) for analog-to-digital conversion to obtain a first digital pixel signal (e.g., ...). Figure 15 As shown in the left image below, one smallest A square in this image corresponds to one first digital pixel signal. Subsequently, as... Figure 9 , Figure 10A and Figure 15As shown in the topmost diagram, the electrical signals of two pixels 120 (including the pixel of PD12 and the pixel of PD21) corresponding to two second color filters B in a first filter group 111 are combined at a floating diffusion node FD. Similarly, the electrical signals of two pixels 120 (including the pixel of PD34 and the pixel of PD43) corresponding to two second color filters B in another first filter group 111 are combined at another floating diffusion node FD. Subsequently, as... Figure 9 , Figure 10B and Figure 15 As shown in the right figure in the middle position, the control terminal T1 of the selection circuit SEL shared by the two pixels 120 corresponding to the two second color filters B in one first filter group 111 is turned on, and the control terminal T4 of the selection circuit SEL shared by the two pixels 120 corresponding to the two second color filters B in another first filter group 111 is also turned on at the same time. The merged two third analog pixel signals ( Figure 15 In the right image at the middle position, a smallest B square corresponds to a third analog pixel signal. This signal is transmitted to the analog-to-digital converter circuit shared by these four pixels (120) for analog-to-digital conversion to obtain a second digital pixel signal (e.g., ...). Figure 15 As shown in the right figure below, each smallest B square in the figure corresponds to a second digital pixel signal. The method by which the four pixels 120 corresponding to the four third color filters C in the two second filter groups 112 share an analog-to-digital converter circuit to convert two fourth analog pixel signals into one third digital pixel signal is the same as the method by which the four pixels 120 corresponding to the four second color filters B in the two first filter groups 111 share a digital converter circuit to convert two third analog pixel signals into one second digital pixel signal, and will not be elaborated here.

[0089] It should be noted that, Figure 15 In the illustrated embodiment, only in a portion of the region, the third analog pixel signals of the four pixels 120 corresponding to the four second color filters B of the two first filter groups 111 are merged and converted from analog to digital. Similarly, only in a portion of the region, the fourth analog pixel signals of the four pixels 120 corresponding to the four third color filters C of the two second filter groups 112 are merged and converted from analog to digital.

[0090] Therefore, as Figure 15 As shown, the image sensor 10 can output two digital image signals. One digital image signal consists of multiple first digital pixel signals, and the other digital image signal consists of multiple second digital pixel signals and multiple third digital pixel signals. The target frame rate achievable by the digital image signals output by the image sensor 10 is FP3. (Comparison) Figure 13 and Figure 15 It can be seen that, due to Figure 15In the illustrated embodiment, more analog pixel signals with the same color channel values ​​are merged and converted from analog to digital for output, resulting in Figure 15 The resolution ratio of the digital image signal shown Figure 13 The digital image signal shown has low resolution, but the analog-to-digital conversion time required by the analog-to-digital converter is also reduced due to the decrease in data volume. Figure 15 The target frame rate FP3 of the embodiment shown will be higher than Figure 13 The target frame rate FP1 of the embodiment shown is large.

[0091] It should be noted that, Figure 13 In the embodiment shown, the circuit for the pixel array 12 that outputs analog pixel signals that can be merged can also be Figure 9 The connection methods shown are not limited here. Similarly, Figure 15 In the embodiment shown, the circuit for the pixel array 12 that outputs analog pixel signals that can be merged can also be Figure 7 The connection method shown is not limited here.

[0092] In another example, across all regions, all pixels 120 corresponding to the first color filter A within each region share a single analog-to-digital converter (ADC). Each ADC converts the first analog pixel signal and / or the second analog pixel signal of all pixels 120 corresponding to the first color filter A within each region into a first digital pixel signal. Across all regions, all pixels 120 corresponding to the second color filter B within each region share a single ADC. Each ADC converts the third analog pixel signal of all pixels 120 corresponding to the second color filter B within each region into a second digital pixel signal. Across all regions, all pixels 120 corresponding to the third color filter C within each region share a single ADC. Each ADC converts the fourth analog pixel signal of all pixels 120 corresponding to the third color filter C within each region into a third digital pixel signal. When each region includes multiple filter groups 113: in all regions, the control terminals T of the multiple selection circuits SEL corresponding to the multiple pixels 120 corresponding to the first color filter A in each region are simultaneously turned on, so as to transmit the first analog pixel signal and the second analog pixel signal of the multiple pixels 120 to the analog-to-digital conversion circuit shared by the multiple pixels 120. In all regions, the control terminals T of the multiple selection circuits SEL corresponding to the multiple pixels 120 corresponding to the second color filter B in each region are simultaneously turned on, so as to transmit the multiple third analog pixel signals of the multiple pixels 120 to the analog-to-digital conversion circuit shared by the multiple pixels 120. In all regions, the control terminals T of the multiple selection circuits SEL corresponding to the multiple pixels 120 corresponding to the third color filter C in each region are simultaneously turned on, so as to transmit the multiple fourth analog pixel signals of the multiple pixels 120 to the analog-to-digital conversion circuit shared by the multiple pixels 120.

[0093] For example, please combine Figure 1 , Figure 3 , Figure 9 , Figure 10A , Figure 10B and Figure 14 The target frame rate is FP2. Each region includes four filter groups 113, namely two first filter groups 111 and two second filter groups 112. In each of the two first filter groups 111, the four pixels 120 corresponding to the four first color filters A and the four pixels 120 corresponding to the four second color filters B share one analog-to-digital converter circuit. In each of the two second filter groups 111, the four pixels 120 corresponding to the four first color filters A and the four pixels 120 corresponding to the four third color filters C share another analog-to-digital converter circuit. Figure 14In the embodiment shown, multiple pixels 120 corresponding to the same color filter 110 in the same area share a single analog-to-digital converter circuit to achieve digital pixel signal output. Figure 15 The embodiments shown are largely the same, and will not be repeated here. Figure 14 The process of converting analog pixels into digital pixel signals in the illustrated embodiment will be described in detail. It should be noted that... Figure 14 and Figure 15 The difference between the two implementation methods shown is that, Figure 15 In the illustrated embodiment, only the four third analog pixel signals of the four pixels 120 corresponding to the four second color filters B in a certain region are merged, and only the four fourth analog pixel signals of the four pixels 120 corresponding to the four third color filters C in a certain region are merged. Figure 14 In the embodiment shown, the four third analog pixel signals of the four pixels 120 corresponding to the four second color filters B in all regions will be merged, and the four fourth analog pixel signals of the four pixels 120 corresponding to the four third color filters C in all regions will be merged.

[0094] Therefore, as Figure 14 As shown, the image sensor 10 can output three digital image signals: one digital image signal consists of multiple first digital pixel signals, another digital image signal consists of multiple second digital pixel signals, and the remaining digital image signal consists of multiple third digital pixel signals. The target frame rate achievable by the digital image signals output by the image sensor 10 is FP2. (Comparison) Figure 13 and Figure 14 It can be seen that, due to Figure 14 In the illustrated embodiment, more analog pixel signals with the same color channel values ​​are merged and converted from analog to digital for output, resulting in Figure 14 The resolution ratio of the digital image signal shown Figure 13 The digital image signal shown has low resolution, but the analog-to-digital conversion time required by the analog-to-digital converter is also reduced due to the decrease in data volume. Figure 14 The target frame rate FP2 of the embodiment shown will be higher than Figure 13 The target frame rate FP1 of the illustrated implementation is large. (Comparison) Figure 14 and Figure 15 It can be seen that both have the same resolution of digital image signals, but due to... Figure 15 In the embodiment shown, only the third analog pixel signals of the multiple pixels 120 corresponding to the multiple second color filters B in a certain area are merged and converted from analog to digital, and only the fourth analog pixel signals of the multiple pixels 120 corresponding to the multiple third color filters C in a certain area are merged and converted from analog to digital. Figure 15 The amount of data in the illustrated implementation is compared to Figure 14 The data volume of the illustrated implementation is small, therefore, Figure 15 The target frame rate FP3 of the embodiment shown will be higher than Figure 14 The target frame rate FP2 of the embodiment shown is large.

[0095] For example, please combine Figure 1 , Figure 3 , Figure 9 , Figure 10A , Figure 10B ,and Figure 16 The target frame rate is FP4. Each region includes sixteen filter groups 113, namely, eight first filter groups 111 and eight second filter groups 112. In each of the eight first filter groups 111, the sixteen pixels 120 corresponding to the sixteen first color filters A and the sixteen pixels 120 corresponding to the sixteen second color filters B share a single analog-to-digital converter circuit. In each of the eight second filter groups 111, the sixteen pixels 120 corresponding to the sixteen first color filters A and the sixteen pixels 120 corresponding to the sixteen third color filters C share another analog-to-digital converter circuit. Figure 16 In the embodiment shown, multiple pixels 120 corresponding to the same color filter 110 in the same area share a single analog-to-digital converter circuit to achieve digital pixel signal output. Figure 15 The embodiments shown are the same, and will not be repeated here. Figure 16 The process of converting analog pixels into digital pixel signals in the illustrated embodiment will be described in detail.

[0096] Therefore, as Figure 16 As shown, the image sensor 10 can output three digital image signals: one digital image signal consists of multiple first digital pixel signals, another digital image signal consists of multiple second digital pixel signals, and the remaining digital image signal consists of multiple third digital pixel signals. The target frame rate achievable by the digital image signals output by the image sensor 10 is FP4. (Comparison) Figure 15 and Figure 16 It can be seen that, due to Figure 16 In the illustrated embodiment, more analog pixel signals with the same color channel values ​​are merged and converted from analog to digital for output, resulting in Figure 16 The resolution ratio of the digital image signal shown Figure 15 The digital image signal shown has low resolution, but the analog-to-digital conversion time required by the analog-to-digital converter is also reduced due to the decrease in data volume. Figure 16 The target frame rate FP4 of the embodiment shown will be higher than Figure 15 The target frame rate FP3 of the embodiment shown is large.

[0097] Thus, the image sensor 10 of this application embodiment can adjust the number of filter groups 110 in the region according to the target frame rate, thereby making the image sensor 10 suitable for various scenarios with different requirements for the frame rate of the image, and improving the scene adaptability of the image sensor 10.

[0098] Please see Figure 1 and Figure 17 This application also provides an imaging device 100. The imaging device 100 includes the image sensor 10 described in any of the above embodiments.

[0099] In some embodiments, the imaging apparatus 100 further includes a processor 20. The processor 20 can be used to process data for characterizing the effects acting on at least one filter group 113 (…). Figure 3 (As shown) corresponds to pixel 120 ( Figure 3 A first digital pixel signal representing the value of the first color channel of light (as shown), a second digital pixel signal representing the value of the second color channel of light acting on the corresponding pixel 120 of at least one filter group 113, and a third digital pixel signal representing the value of the third color channel of light acting on the corresponding pixel 120 of at least one filter group 113 are used to generate a color image.

[0100] Specifically, when the digital image signal output by the image sensor 10 includes two signals, the first digital image signal is composed of multiple first digital pixel signals, and the second digital image signal is composed of multiple second digital pixel signals and multiple third digital pixel signals (e.g.) Figure 13 and Figure 15 (As shown in the output), the processor 20 first performs interpolation processing on the second digital image signal, so that each image pixel in the second digital image signal simultaneously has a second digital pixel signal representing the value of the second color channel and a third digital pixel signal representing the value of the third color channel. Subsequently, the processor 20 performs fusion processing on the first digital image signal and the interpolated second digital image signal to generate a color image, where the digital pixel signal corresponding to each image pixel in the color image is composed of the values ​​of the first color channel, the second color channel, and the third color channel.

[0101] When the digital image signal output by the image sensor 10 includes three components, the first digital image signal is composed of multiple first digital pixel signals, the second digital image signal is composed of multiple second digital pixel signals, and the third digital image signal is composed of multiple third digital pixel signals (e.g.) Figure 14 and Figure 16(As shown in the output), the processor 20 directly fuses the first digital image signal, the second digital image signal, and the third digital image signal to generate a color image. The digital pixel signal corresponding to each image pixel in the color image is composed of the value of the first color channel, the value of the second color channel, and the value of the third color channel.

[0102] Please see Figure 1 , Figure 3 and Figure 18 This application also provides an electronic device 1000. The electronic device 1000 may be a mobile phone, tablet computer, laptop computer, smartwatch, smart bracelet, smart helmet, smart glasses, unmanned equipment (e.g., drone, unmanned vehicle, unmanned boat), etc., and is not limited thereto. The electronic device 1000 includes an imaging device 100. The imaging device 100 includes an image sensor 10 as described in any of the above embodiments. The electronic device 1000 also includes a processor 20. The processor 20 of the electronic device 1000 can perform operations related to… Figure 17 The processor 20 in the imaging device 100 shown performs the same functions as the processor 20 shown, which will not be described in detail here.

[0103] Please see Figure 1 , Figure 3 and Figure 19 This application also provides an image processing system 10000. The image processing system 10000 includes an electronic device 1000. The electronic device 1000 includes an imaging device 100. The imaging device 100 includes an image sensor 10 as described in any of the above embodiments. The image processing system 10000 also includes a processor 20. The processor 20 of the image processing system 10000 can perform operations related to... Figure 17 The processor 20 in the imaging device 100 shown performs the same functions as the processor 20 shown, which will not be described in detail here.

[0104] The processor 20 can be located in a server responsible for cloud computing or in a server responsible for edge computing. Thus, the image sensor 10 ( Figure 1 The subsequent processing of the pixel signal output (as shown) can be offloaded to the server, which can save power consumption of the imaging device 100 or electronic device 1000.

[0105] This application also provides a signal processing method. The signal processing method can be applied to the image sensor 10 of any of the above embodiments (…). Figure 1 As shown in the figure. Signal processing methods include: The electrical signals generated by the pixels 120 corresponding to the same color filter 110 in the same filter group 113 are merged at the corresponding floating diffusion node FD.

[0106] In some implementations, please refer to Figure 1 , Figure 3 and Figure 7 The multiple filters 113 include multiple first filter groups 111 and multiple second filter groups 112. The first filter group 111 includes an equal number of first color filters A and multiple second color filters B. The second filter group 112 includes an equal number of first color filters A and multiple third color filters C. The step of controlling the merging of electrical signals generated by pixels 120 corresponding to filters 110 of the same color in the same filter group 113 at the corresponding floating diffusion node FD includes: The electrical signals generated by multiple pixels 120 corresponding to multiple first color filters A in each first filter group 111 are combined at the floating diffusion node FD shared by the multiple pixels 120 corresponding to multiple first color filters A to generate a first analog pixel signal. The electrical signals generated by multiple pixels 120 corresponding to multiple second color filters B in each first filter group 111 are combined at the floating diffusion node FD shared by the multiple pixels 120 corresponding to multiple second color filters B to generate a third analog pixel signal. The electrical signals generated by the multiple pixels 120 corresponding to the multiple first color filters A in each second filter group 112 are combined at the floating diffusion node FD shared by the multiple pixels 120 corresponding to the multiple first color filters A to generate a second analog pixel signal. The electrical signals generated by the multiple pixels 120 corresponding to the multiple third color filters C in each second filter group 112 are combined at the floating diffusion node FD shared by the multiple pixels 120 corresponding to the multiple third color filters C to generate a fourth analog pixel signal.

[0107] In some implementations, please refer to Figure 1 , Figure 3 and Figure 7 In the same filter group 113, pixels 120 corresponding to filters 110 of different colors correspond to different floating diffusion nodes (FDs), and each pixel 120 includes an exposure control circuit (TRF). In the same filter group 113, the control terminals (TX) of the TRFs of multiple pixels 120 corresponding to multiple filters 110 of the same color are simultaneously activated to transfer the charge generated after receiving light by the multiple pixels 120 corresponding to multiple filters 110 of the same color in the same filter group 113 to the floating diffusion node (FD) shared by the multiple pixels 120 corresponding to multiple filters 110 of the same color in the same filter group 113. The control terminals (TX) of the TRFs of the exposure control circuits of pixels 120 corresponding to different filters 110 of the same color in the same filter group 113 are activated simultaneously or at different times.

[0108] In some implementations, please refer to Figure 1 , Figure 3 and Figure 9 In the same filter group 113, multiple pixels 120 corresponding to filters 110 of all colors share a single floating diffusion node FD. Each pixel 120 includes an exposure control circuit TRF. In the same filter group 113, the control terminals TX of the exposure control circuits TRF of multiple pixels 120 corresponding to multiple filters 110 of the same color are simultaneously turned on to transfer the charge generated by the multiple pixels 120 corresponding to multiple filters 110 of the same color in the same filter group 113 after receiving light to the floating diffusion node shared by the multiple pixels 120 corresponding to the filter group 113. In the same filter group 113, the control terminals TX of the exposure control circuits TRF of pixels 120 corresponding to different colors of filters 110 are turned on in a time-division manner.

[0109] In some implementations, please refer to Figure 1 , Figure 3 , Figure 7 ,and Figure 9 The image sensor 10 also includes multiple analog-to-digital converter circuits. The filter array 11 includes multiple regions, each region including at least one filter group 113. The number of filter groups 113 in each region is determined by the target frame rate of the image corresponding to the image signal output by the image sensor 10; the higher the target frame rate, the more filter groups 113 are in each region. In all regions, multiple pixels 120 corresponding to all first color filters A in each region share one analog-to-digital converter circuit. In all regions, multiple pixels 120 corresponding to all second color filters B in each region share one analog-to-digital converter circuit. In all regions, multiple pixels 120 corresponding to all third color filters C in each region share one analog-to-digital converter circuit. The signal processing method further includes: In all regions, the first analog pixel signals and / or second analog pixel signals of all pixels 120 corresponding to the first color filter A in each region are converted into a first digital pixel signal; In all regions, the third analog pixel signals of all pixels 120 corresponding to the second color filter B in each region are converted into a second digital pixel signal; In all regions, the fourth analog pixel signals of all pixels 120 corresponding to the third color filter C in each region are converted into a third digital pixel signal.

[0110] In some implementations, please refer to Figure 1 , Figure 3 , Figure 7 ,and Figure 9The image sensor 10 also includes multiple analog-to-digital converter circuits. The filter array 11 includes multiple regions, each region including at least one filter group 113. The number of filter groups 113 in each region is determined by the target frame rate of the image corresponding to the image signal output by the image sensor 10; the higher the target frame rate, the more filter groups 113 are in each region. In all regions, multiple pixels 120 corresponding to all first color filters A in each region share one analog-to-digital converter circuit. In some regions, multiple pixels 120 corresponding to all second color filters B in each region share one analog-to-digital converter circuit. In another part of the regions, multiple pixels 120 corresponding to all third color filters C in each region share one analog-to-digital converter circuit. The signal processing method further includes: In all regions, the first analog pixel signals and / or second analog pixel signals of all pixels 120 corresponding to the first color filter A in each region are converted into a first digital pixel signal; In a certain region, the third analog pixel signals of all pixels 120 corresponding to the second color filter B in each region are converted into a second digital pixel signal; In a portion of the region, the fourth analog pixel signals corresponding to multiple pixels 120 of all third color filters C in each region are converted into a third digital pixel signal.

[0111] In some implementations, please refer to Figure 1 , Figure 3 and Figure 7 The pixel array 12 also includes a selection circuit SEL. One selection circuit SEL is connected to a floating diffusion node FD and to an analog-to-digital converter circuit. When the region includes multiple filter groups 113: The control terminal T of the multiple selection circuits SEL corresponding to the multiple pixels 120 of all first color filters A in each region is turned on at the same time, so as to transmit the first analog pixel signal and the second analog pixel signal of the multiple pixels 120 to the analog-to-digital conversion circuit shared by the multiple pixels 120. The control terminals T of the multiple selection circuits SEL corresponding to the multiple pixels 120 of all the second color filters B in each region are turned on at the same time, so as to transmit the multiple third analog pixel signals of the multiple pixels 120 to the analog-to-digital conversion circuit shared by the multiple pixels 120. The control terminals T of the multiple selection circuits SEL corresponding to the multiple pixels 120 of all the third color filters C in each region are turned on simultaneously, so as to transmit the multiple fourth analog pixel signals of the multiple pixels 120 to the analog-to-digital conversion circuit shared by the multiple pixels 120.

[0112] In some embodiments, the signal processing method further includes processing the first digital pixel signal, the second digital pixel signal, and the third digital pixel signal to generate a color image.

[0113] This application also provides a computer device. The computer device can be the electronic device 1000 described in any of the above embodiments. Figure 18 (As shown).

[0114] The aforementioned computer device includes an image processing circuit, which can be implemented using hardware and / or software components and may include various processing units that define the ISP (Image Signal Processing) pipeline. Figure 20 This is a schematic diagram of an image processing circuit in one embodiment. For example... Figure 20 As shown, for ease of explanation, only aspects of the image processing technology related to the embodiments of this application are illustrated.

[0115] like Figure 20 As shown, the image processing circuit includes an ISP processor 940 and a control logic unit 950. The ISP processor 940 can function as a processor in the electronic device 1000. Image data captured by the imaging device 910 is first processed by the ISP processor 940, which analyzes the image data to capture image statistics that can be used to determine and / or control parameters of the imaging device 910. The imaging device 910 may include a camera having one or more lenses 912 and an image sensor 914. The image sensor 914 may be an image sensor 10 (… Figure 1 (As shown). Image sensor 914 may include a filter array. Image sensor 914 can acquire light intensity and wavelength information captured by each pixel of image sensor 914 and provide a set of raw image data that can be processed by ISP processor 940, such as raw image data composed of multiple first digital pixel signals, multiple second digital pixel signals, and multiple third digital pixel signals. Sensor 920 (such as a gyroscope) can provide the acquired image processing parameters (such as image stabilization parameters) to ISP processor 940 based on the sensor 920 interface type. Sensor 920 interface can utilize SMIA (Standard Mobile Imaging Architecture) interface, other serial or parallel camera interfaces, or a combination of the above interfaces.

[0116] In addition, image sensor 914 can also send raw image data to sensor 920. Sensor 920 can provide the raw image data to ISP processor 940 based on sensor 920 interface type, or sensor 920 can store the raw image data in image memory 930.

[0117] The ISP processor 940 processes raw image data pixel by pixel in various formats. For example, each image pixel may have a bit depth of 8, 10, 12, or 14 bits. The ISP processor 940 can perform one or more image processing operations on the raw image data and collect statistical information about the image data. The image processing operations can be performed with the same or different bit depth precision.

[0118] The ISP processor 940 can also receive image data from the image memory 930. For example, the sensor 920 interface sends raw image data to the image memory 930, and the raw image data in the image memory 930 is then provided to the ISP processor 940 for processing. The image memory 930 may be part of a memory device, a storage device, or a separate dedicated memory within an electronic device, and may include DMA (Direct Memory Access) features.

[0119] When receiving raw image data from the image sensor 914 interface, the sensor 920 interface, or the image memory 930, the ISP processor 940 can perform one or more image processing operations, such as temporal filtering; or, for example, processing a first digital pixel signal, a second digital pixel signal, and a third digital pixel signal to obtain a color image. The processed image data (e.g., a color image) can be sent to the image memory 930 for further processing before display. The ISP processor 940 receives processed data from the image memory 930 and performs image data processing on the processed data in the raw domain and in the RGB and YCbCr color spaces. The processed image data can be output to the display 970 for user viewing and / or further processed by a graphics engine or GPU (Graphics Processing Unit). Furthermore, the output of the ISP processor 940 can also be sent to the image memory 930, and the display 970 can read image data from the image memory 930. In one embodiment, the image memory 930 can be configured to implement one or more frame buffers. Furthermore, the output of the ISP processor 940 can be sent to the encoder / decoder 960 for encoding / decoding image data. The encoded image data can be saved and decompressed before being displayed on the display device 970. The encoder / decoder 960 can be implemented by a CPU, GPU, or coprocessor.

[0120] The statistical data determined by the ISP processor 940 can be sent to the control logic unit 950. For example, the statistical data may include image sensor 914 statistics such as automatic exposure, automatic white balance, automatic focus, flicker detection, black level compensation, and lens 912 shading correction. The control logic unit 950 may include a processor and / or microcontroller executing one or more routines (such as firmware) that determine control parameters for the imaging device 910 and the ISP processor 940 based on the received statistical data. For example, the control parameters for the imaging device 910 may include sensor 920 control parameters (e.g., gain, integral time for exposure control, image stabilization parameters, etc.), camera flash control parameters, lens 912 control parameters (e.g., focal length for focusing or zooming), or combinations of these parameters. The control parameters for the ISP processor 940 may include gain levels and color correction matrices for automatic white balance and color adjustment (e.g., during RGB processing), and lens 912 shading correction parameters.

[0121] In the description of this specification, the terms "one embodiment," "some embodiments," "illustrative embodiment," "example," "specific example," or "some examples," etc., refer to specific features, structures, materials, or characteristics described in connection with the described embodiment or example, which are included in at least one embodiment or example of this application. In this specification, the illustrative expressions of the above terms do not necessarily refer to the same embodiment or example. Furthermore, the specific features, structures, materials, or characteristics described may be combined in any suitable manner in one or more embodiments or examples. Moreover, without contradiction, those skilled in the art can combine and integrate the different embodiments or examples described in this specification, as well as the features of different embodiments or examples.

[0122] Any process or method described in the flowchart or otherwise herein can be understood as representing a module, segment, or portion of code comprising one or more executable instructions for implementing a particular logical function or process, and the scope of the preferred embodiments of this application includes additional implementations in which functions may be performed not in the order shown or discussed, including substantially simultaneously or in reverse order depending on the function involved, as will be understood by those skilled in the art to which embodiments of this application pertain.

[0123] Although embodiments of this application have been shown and described above, it is understood that the above embodiments are exemplary and should not be construed as limiting this application. Those skilled in the art can make changes, modifications, substitutions and variations to the above embodiments within the scope of this application.

Claims

1. An image sensor, characterized in that, include: Microlens array; A filter array comprising multiple regions, each region comprising at least one filter group, and each filter group comprising multiple filters; and A pixel array comprising a plurality of pixels, the pixels being used to receive light passing through the filter to generate an electrical signal; Multiple analog-to-digital conversion circuits are provided, and all pixels corresponding to the same color filter in each region share one analog-to-digital conversion circuit; The pixel array further includes multiple floating diffusion nodes, wherein pixels corresponding to the same color filter in the same filter group share one floating diffusion node, so that the electrical signals generated by the pixels corresponding to the same color filter in the same filter group can be merged at the corresponding floating diffusion node to generate an analog pixel signal; The analog-to-digital converter circuit is used to convert multiple analog pixel signals corresponding to all filters of the same color in each region into a single digital pixel signal. The plurality of filter groups include a plurality of first filter groups and a plurality of second filter groups. The first filter groups include a plurality of first color filters and a plurality of second color filters of equal number. The second filter groups include a plurality of first color filters and a plurality of third color filters of equal number. The electrical signals generated by the pixels corresponding to the plurality of first color filters in each first filter group are combined at the floating diffusion node shared by the plurality of pixels corresponding to the plurality of first color filters to generate a first analog pixel signal; the electrical signals generated by the pixels corresponding to the plurality of second color filters in each first filter group are combined at the floating diffusion node shared by the plurality of pixels corresponding to the plurality of second color filters to generate a third analog pixel signal. The electrical signals generated by the pixels corresponding to the plurality of first color filters in each second filter group are combined at the floating diffusion node shared by the plurality of pixels corresponding to the plurality of first color filters to generate a second analog pixel signal; the electrical signals generated by the pixels corresponding to the plurality of third color filters in each second filter group are combined at the floating diffusion node shared by the plurality of pixels corresponding to the plurality of third color filters to generate a fourth analog pixel signal. The number of filter groups in each region is determined by the target frame rate of the image corresponding to the image signal output by the image sensor. The higher the target frame rate, the more filter groups there are in each region. In all the regions, all the pixels corresponding to the first color filter in each region share a first analog-to-digital conversion circuit. Each first analog-to-digital conversion circuit is used to convert the first analog pixel signal and the second analog pixel signal of all the pixels corresponding to the first color filter in each region into a first digital pixel signal. In some of the regions, all pixels corresponding to the second color filter in each region share a second analog-to-digital converter circuit. Each second analog-to-digital converter circuit is used to convert the third analog pixel signal of all pixels corresponding to the second color filter in each region into a second digital pixel signal. In another part of the region, all the pixels corresponding to the third color filter in each region share a third analog-to-digital converter circuit. Each third analog-to-digital converter circuit is used to convert the fourth analog pixel signal of the pixels of all the third color filter in each region into a third digital pixel signal.

2. The image sensor according to claim 1, characterized in that, In the same filter group, the pixels corresponding to the filters of different colors correspond to different floating diffusion nodes, and each pixel includes an exposure control circuit. In the same filter group, the control terminals of the exposure control circuits of the multiple pixels corresponding to the multiple filters of the same color are turned on simultaneously, so as to transfer the charge generated by the multiple pixels corresponding to the multiple filters of the same color in the same filter group after receiving light to the floating diffusion node shared by the multiple pixels corresponding to the multiple filters of the same color in the same filter group. In the same filter group, the control terminals of the exposure control circuits of the pixels corresponding to the filters of different colors are turned on simultaneously or at different times.

3. The image sensor according to claim 1, characterized in that, In the same filter group, multiple pixels corresponding to filters of all colors share a floating diffusion node, and each pixel includes an exposure control circuit. In the same filter group, the control terminals of the exposure control circuits of the multiple pixels corresponding to the multiple filters of the same color are turned on simultaneously, so as to transfer the charge generated by the multiple pixels corresponding to the multiple filters of the same color in the same filter group after receiving light to the floating diffusion node shared by the multiple pixels corresponding to the filter group. In the same filter group, the control terminals of the exposure control circuits for the pixels corresponding to different colored filters are turned on in a time-division manner.

4. The image sensor according to claim 2 or 3, characterized in that, The pixel array further includes a selection circuit, which is connected to one of the floating diffusion nodes and to one of the analog-to-digital conversion circuits; when each region includes multiple filter groups: The control terminals of multiple selection circuits corresponding to multiple pixels of all the first color filters in each region are simultaneously turned on, so as to transmit the first analog pixel signal and the second analog pixel signal of the multiple pixels to the first analog-to-digital conversion circuit shared by the multiple pixels. The control terminals of the multiple selection circuits corresponding to the multiple pixels of all the second color filters in each region are turned on simultaneously, so as to transmit the multiple third analog pixel signals of the multiple pixels to the second analog-to-digital conversion circuit shared by the multiple pixels. The control terminals of the multiple selection circuits corresponding to the multiple pixels of all the third color filters in each region are simultaneously turned on, so as to transmit the multiple fourth analog pixel signals of the multiple pixels to the third analog-to-digital conversion circuit shared by the multiple pixels.

5. An imaging device, characterized in that, Includes the image sensor described in any one of claims 1-4.

6. The imaging apparatus according to claim 5, characterized in that, The imaging device further includes a processor, which processes a first digital pixel signal characterizing the value of a first color channel of light acting on at least one pixel of the filter group, a second digital pixel signal characterizing the value of a second color channel of light acting on at least one pixel of the filter group, and a third digital pixel signal characterizing the value of a third color channel of light acting on at least one pixel of the filter group to generate a color image.

7. An electronic device, characterized in that, The device includes an imaging apparatus, which includes the image sensor according to any one of claims 1-4.

8. An image processing system, characterized in that, The device includes an electronic device, which includes an imaging device, and the imaging device includes an image sensor according to any one of claims 1-4.

9. A signal processing method for an image sensor, characterized in that, The image sensor includes a microlens array, a filter array, a pixel array, and multiple analog-to-digital converter circuits. The filter array includes multiple regions, each region including at least one filter group, and each filter group including multiple filters. The pixel array includes multiple pixels, which are used to receive light passing through the filters to generate electrical signals. The analog-to-digital converter circuits include a single circuit shared by all pixels corresponding to filters of the same color within each region. The pixel array also includes multiple floating diffusion nodes, where pixels corresponding to filters of the same color within the same filter group share a single floating diffusion node. The signal processing method includes: The multiple analog pixel signals corresponding to all filters of the same color in each region are controlled to be converted into a single digital pixel signal; The electrical signals generated by the pixels corresponding to the same color filters in the same filter group are controlled to be merged at the corresponding floating diffusion node to generate a simulated pixel signal; The plurality of filter groups include a plurality of first filter groups and a plurality of second filter groups. The first filter groups include an equal number of first color filters and a plurality of second color filters, and the second filter groups include an equal number of first color filters and a plurality of third color filters. The step of controlling the electrical signals generated by the pixels corresponding to the same color filters in the same filter group to be merged at the corresponding floating diffusion node includes: The electrical signals generated by the multiple pixels corresponding to the multiple first color filters in each first filter group are combined at the floating diffusion node shared by the multiple pixels corresponding to the multiple first color filters to generate a first analog pixel signal. The electrical signals generated by the multiple pixels corresponding to the multiple second color filters in each first filter group are combined at the floating diffusion node shared by the multiple pixels corresponding to the multiple second color filters to generate a third analog pixel signal. The electrical signals generated by the multiple pixels corresponding to the multiple first color filters in each second filter group are combined at the floating diffusion node shared by the multiple pixels corresponding to the multiple first color filters to generate a second analog pixel signal; the electrical signals generated by the multiple pixels corresponding to the multiple third color filters in each second filter group are combined at the floating diffusion node shared by the multiple pixels corresponding to the multiple third color filters to generate a fourth analog pixel signal. The image sensor also includes multiple analog-to-digital conversion circuits, and the filter array includes multiple regions, each region including at least one filter group. The number of filter groups in each region is determined by the target frame rate of the image corresponding to the image signal output by the image sensor. The higher the target frame rate, the more filter groups are in each region. In all the regions, in each region, multiple pixels corresponding to the first color filter share a first analog-to-digital converter circuit; in some regions, in each region, multiple pixels corresponding to the second color filter share a second analog-to-digital converter circuit; and in another part of the regions, in each region, multiple pixels corresponding to the third color filter share a third analog-to-digital converter circuit. The signal processing method further includes: In all the regions, the first analog pixel signals and the second analog pixel signals of the plurality of pixels corresponding to the first color filter in each region are converted into a first digital pixel signal; In a portion of the region, the third analog pixel signal of each of the pixels corresponding to the second color filter in each region is converted into a second digital pixel signal; In a portion of the region, the fourth analog pixel signal corresponding to a plurality of pixels of all the third color filters in each region is converted into a third digital pixel signal.

10. The signal processing method according to claim 9, characterized in that, In the same filter group, the pixels corresponding to the filters of different colors correspond to different floating diffusion nodes, and each pixel includes an exposure control circuit. In the same filter group, the control terminals of the exposure control circuits of the multiple pixels corresponding to the multiple filters of the same color are turned on simultaneously, so as to transfer the charge generated by the multiple pixels corresponding to the multiple filters of the same color in the same filter group after receiving light to the floating diffusion node shared by the multiple pixels corresponding to the multiple filters of the same color in the same filter group. In the same filter group, the control terminals of the exposure control circuits of the pixels corresponding to the filters of different colors are turned on simultaneously or at different times.

11. The signal processing method according to claim 9, characterized in that, In the same filter group, multiple pixels corresponding to filters of all colors share a floating diffusion node, and each pixel includes an exposure control circuit. In the same filter group, the control terminals of the exposure control circuits of the multiple pixels corresponding to the multiple filters of the same color are turned on simultaneously, so as to transfer the charge generated by the multiple pixels corresponding to the multiple filters of the same color in the same filter group after receiving light to the floating diffusion node shared by the multiple pixels corresponding to the filter group. In the same filter group, the control terminals of the exposure control circuits for the pixels corresponding to different colored filters are turned on in a time-division manner.

12. The signal processing method according to claim 9 or 10, characterized in that, The pixel array further includes a selection circuit, which is connected to one of the floating diffusion nodes and to one of the analog-to-digital conversion circuits; when the region includes multiple filter groups: The control terminals of multiple selection circuits corresponding to multiple pixels of all the first color filters in each region are simultaneously turned on, so as to transmit the first analog pixel signal and the second analog pixel signal of the multiple pixels to the first analog-to-digital conversion circuit shared by the multiple pixels. The control terminals of the multiple selection circuits corresponding to the multiple pixels of all the second color filters in each region are turned on simultaneously, so as to transmit the multiple third analog pixel signals of the multiple pixels to the second analog-to-digital conversion circuit shared by the multiple pixels. The control terminals of the multiple selection circuits corresponding to the multiple pixels of all the third color filters in each region are simultaneously turned on, so as to transmit the multiple fourth analog pixel signals of the multiple pixels to the third analog-to-digital conversion circuit shared by the multiple pixels.

13. The signal processing method according to claim 9, characterized in that, The signal processing method further includes: The first digital pixel signal, the second digital pixel signal, and the third digital pixel signal are processed to generate a color image.

Images