Image sensor, lens assembly, electronic equipment and imaging method

By setting a plurality of first and second pixels in the TOF image sensor, a two-dimensional image is generated using the first pixel, and the second pixel generates depth information, the problem of large size and insufficient resolution of the image sensor is solved, and high resolution is achieved Image sensor design reduces overall volume and cost.

CN118921573APending Publication Date: 2024-11-08BEIJING AURORA SMART CORE TECH CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202410979944.1
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-07-19
Publication Date
2024-11-08

AI Technical Summary

Technical Problem

The large size of the TOF image sensor leads to inconvenient layout in electronic devices, and increasing the number of photosensitive pixels will lead to an increase in the overall volume, affecting processing and cost control, and it is difficult to meet the needs of high-resolution images.

Method used

Design an image sensor, by setting a plurality of first pixels and second pixels in the pixel area, the first pixel is used to generate a two-dimensional image, and the second pixel is used to generate depth information. The area of ​​the first pixel is smaller and the unit area is More first pixels can be arranged on it to improve resolution, and the resolution and processing convenience of the image sensor can be improved through mixed arrangement.

Benefits of technology

High-resolution two-dimensional image generation is realized, solving the problems of large size and insufficient resolution of TOF image sensors, and reducing the overall volume of the image sensors and improving the effects of processing and cost control.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118921573A_ABST
    Figure CN118921573A_ABST
Patent Text Reader

Abstract

The embodiment of the invention provides an image sensor, a lens assembly, electronic equipment and an imaging method. The image sensor comprises a pixel region; the pixel area is provided with a plurality of first pixels and second pixels, the second pixels are distributed among the first pixels, the first pixels output first photoelectric signals, the first photoelectric signals are used for generating a two-dimensional image, the second pixels output second photoelectric signals, and the second photoelectric signals are used for generating a two-dimensional image. And the second photoelectric signal is used for generating a two-dimensional image and depth information. The image sensor provided by the embodiment of the invention can obtain a high-resolution two-dimensional image while realizing a distance measurement function through a three-dimensional image, and realizes the functions of biological recognition and the like. Moreover, the influence of additionally arranging the first pixels on the image sensor on the overall size is small, the processing and cost control of the image sensor are facilitated, and further, the layout of the image sensor in the electronic equipment is facilitated.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application belongs to the technical field of electronic equipment, and specifically relates to an image sensor, a lens assembly, an electronic device and an imaging method. Background Art

[0002] Time of flight (TOF) camera is a technology for measuring the distance of an object by measuring the time it takes for a light pulse to be sent from a light source to a target object and back. Usually, the image sensor in a TOF camera is provided with photosensitive pixels, which can be used to receive light pulses emitted by the light source and light pulses reflected from the target object, and output a three-dimensional image with depth information to achieve the function of distance measurement.

[0003] In the prior art, due to the exposure time period of the TOF image sensor, the width of the light pulse is relatively narrow, and therefore, the area of ​​the photosensitive pixel needs to be particularly large in order to receive sufficient light signals. When the area of ​​the photosensitive pixel is large, the number of photosensitive pixels that can be set per unit area is relatively small, and therefore, the resolution is low. However, for certain specific application scenarios that require high-resolution images, such as application scenarios that require biometric identification, in order to improve the resolution, it is usually necessary to increase the number of photosensitive pixels. Since the area of ​​the photosensitive pixels in the TOF image sensor is large, the increase in the number of photosensitive pixels will lead to an increase in the overall volume of the TOF image sensor, which is not only not conducive to the processing and cost control of the TOF image sensor, but also affects the layout of the TOF image sensor in electronic devices. Summary of the invention

[0004] The present application aims to provide an image sensor, a lens assembly, an electronic device and an imaging method to solve the problem that the existing TOF image sensor is large in size and not conducive to layout.

[0005] In order to solve the above technical problems, this application is implemented as follows:

[0006] In a first aspect, the present application discloses an image sensor, comprising a pixel area; the pixel area is provided with a plurality of first pixels and a second pixel, and a plurality of second pixels are distributed between a plurality of first pixels, wherein the first pixel outputs a first photoelectric signal, and the first photoelectric signal is used to generate a two-dimensional image, and the second pixel outputs a second photoelectric signal, and the second photoelectric signal is used to generate a two-dimensional image and depth information.

[0007] Optionally, the image sensor satisfies any one or more of the following conditions:

[0008] The area of ​​the first pixel is smaller than or equal to the area of ​​the second pixel;

[0009] The number of the first pixels is greater than the number of the second pixels;

[0010] The total area of ​​the first pixels is greater than the total area of ​​the second pixels.

[0011] Optionally, the second pixels are distributed in the pixel area at equal intervals along a first direction and a second direction, respectively, and the first direction is perpendicular to the second direction.

[0012] Optionally, the pixel area includes a plurality of pixel groups, each of the pixel groups includes n second pixels and m first pixels, where n>=1, and m>n.

[0013] Optionally, the first pixels and the second pixels in the pixel group are arranged in the same or different manners.

[0014] Optionally, an area of ​​the second pixel is larger than an area of ​​the first pixel;

[0015] Alternatively, each of the pixel groups includes a plurality of adjacently arranged second pixels, and an area of ​​the second pixels is equal to an area of ​​the first pixels.

[0016] Optionally, the first pixel is provided with a first pixel circuit, the first pixel circuit is used to convert the light signal projected onto the first pixel into the first photoelectric signal, and the second pixel is provided with a second pixel circuit, the second pixel circuit is used to convert the light signal projected onto the second pixel into the second photoelectric signal;

[0017] The image sensor also includes a row addressing circuit and a readout circuit, wherein the row addressing circuit and the readout circuit are electrically connected to the first pixel circuit and the second pixel circuit, respectively, and the row addressing circuit is used to control the first pixel circuit and the second pixel circuit to output the first photoelectric signal and the second photoelectric signal to the readout circuit, respectively.

[0018] Optionally, the first pixels and the second pixels are arranged in an array along a first direction and a second direction respectively, and the second direction is perpendicular to the first direction;

[0019] The row addressing circuit is arranged at the edge of the pixel area along the first direction, and the row addressing circuit comprises a plurality of row addressing lines extending along the first direction, and each of the row addressing lines is electrically connected to the first pixel circuit of the first pixel and / or the second pixel circuit of the second pixel in the row where the row addressing line is located;

[0020] The readout circuit is arranged at the edge of the pixel area along the second direction, and the readout circuit includes a plurality of readout signal lines extending along the second direction, and the readout signal lines are respectively connected to the first pixel circuit of the first pixel and / or the second pixel circuit of the second pixel in the column.

[0021] Optionally, one of the second pixel circuits shares at least two of the row addressing lines with at least two of the first pixel circuits.

[0022] Optionally, the second pixel circuit includes two pixel circuit modules, and the two pixel circuit modules are respectively connected to one or two of the row addressing lines. The two pixel circuit modules are used to respectively generate the second photoelectric signals obtained by two exposures at different time points, and the row addressing line controls the switches of the two pixel circuit modules to output the second photoelectric signals through the readout signal line.

[0023] Optionally, the pixel circuit module includes a transfer transistor;

[0024] The second pixel circuit further includes a first diode, and the first diode is respectively connected to the transmission transistors of the two pixel circuit modules.

[0025] Optionally, the pixel circuit module includes a transfer transistor;

[0026] The second pixel circuit further includes a second diode, a third diode, a first switch, a second switch and a third switch, wherein the output end of the second diode is connected to the transmission transistor of one of the pixel circuit modules through the first switch and the second switch in sequence, and the output end of the third diode is connected between the first switch and the second switch, and is also connected to the transmission transistor of another pixel circuit module;

[0027] The third switch is connected between the output end of the second diode and the input end of the transfer transistor of one of the pixel circuit modules. When the third switch is turned on and the first switch and the second switch are turned off, the first pixel circuit reuses one of the two pixel circuit modules.

[0028] In a second aspect, an embodiment of the present application further discloses a lens assembly, the lens assembly comprising: a bracket, a lens, a circuit board and any of the above-mentioned image sensors; wherein:

[0029] A through hole is provided in the bracket, and the lens is provided in the through hole;

[0030] The circuit board is connected to the bracket;

[0031] The image sensor is connected to the bracket and is opposite to the lens.

[0032] In a third aspect, the present application further discloses an electronic device, the electronic device comprising any of the above-mentioned image sensors;

[0033] Alternatively, the electronic device comprises the above-mentioned lens assembly.

[0034] In a fourth aspect, the present application further discloses an imaging method of the image sensor described in any one of the above items, the imaging method comprising:

[0035] Obtaining a first pixel value according to a first photoelectric signal output by the first pixel;

[0036] Obtaining a second pixel value and depth information according to a second photoelectric signal output by the second pixel;

[0037] A two-dimensional image is generated according to the first pixel value and the second pixel value; and / or a three-dimensional image is generated according to the second pixel value and the depth information.

[0038] Optionally, the first pixel performs one exposure according to a first exposure time T1 to output the first photoelectric signal, and the second pixel performs n exposures according to a second exposure time T2 to output the second photoelectric signal;

[0039] The step of generating a two-dimensional image according to the first pixel value and the second pixel value comprises:

[0040] Normalizing the second pixel value according to the first exposure time and the second exposure time to obtain a processed second pixel value;

[0041] The two-dimensional image is generated according to the first pixel value and the processed second pixel value.

[0042] Optionally, the area of ​​the second pixel occupies the area of ​​q first pixels;

[0043] The step of generating a two-dimensional image according to the first pixel value and the second pixel value comprises:

[0044] For each of the second pixels, fitting the second pixel value of the second pixel with the first pixel value of its surrounding area to obtain q converted second pixel values; the surrounding area includes at least one first pixel;

[0045] The two-dimensional image is generated according to the first pixel value of each first pixel and q converted second pixel values ​​corresponding to each second pixel.

[0046] Optionally, an output frame rate of the three-dimensional image is lower than an output frame rate of the two-dimensional image.

[0047] In the embodiment of the present application, by providing a plurality of first pixels and second pixels in the pixel area of ​​the image sensor, the first pixel can be used to output a first photoelectric signal, the first photoelectric signal can be used to generate a two-dimensional image, the second pixel can be used to output a second photoelectric signal, the second photoelectric signal can be used to generate a two-dimensional image and depth information, and the depth information can be used for three-dimensional imaging. Since the first pixel only needs to be used to output the first photoelectric signal that can form a two-dimensional image, the area of ​​the first pixel is small, and the number of the first pixels that can be arranged per unit area is large, which is conducive to obtaining a high-resolution two-dimensional image and realizing functions such as biometrics. Moreover, since the area of ​​the first pixel is small, increasing the number of the first pixels on the image sensor has little effect on the overall volume, which is conducive to the processing and cost control of the image sensor. Furthermore, due to the mixed arrangement of the first pixel and the second pixel, the problem of insufficient resolution caused by the large pixel of the image sensor is improved, and the problem that ordinary image sensors cannot obtain depth information is solved.

[0048] Additional aspects and advantages of the present invention will be given in part in the following description and in part will be obvious from the following description, or will be learned through practice of the present invention. BRIEF DESCRIPTION OF THE DRAWINGS

[0049] The above and / or additional aspects and advantages of the present invention will become apparent and easily understood from the description of the embodiments in conjunction with the following drawings, in which:

[0050] Figure 1 is a structural schematic diagram of an image sensor described in an embodiment of the present application;

[0051] Figure 2 is a pixel circuit diagram of a first pixel and a second pixel in an embodiment of the present application;

[0052] Figure 3 yes Figure 1 One of the circuit layout diagrams of the image sensor shown;

[0053] Figure 4 yes Figure 1 The second circuit layout diagram of the image sensor shown;

[0054] Figure 5 It is one of the distribution diagrams of a row addressing circuit described in an embodiment of the present application;

[0055] Figure 6 This is the second distribution diagram of a row addressing circuit described in an embodiment of the present application;

[0056] Figure 7is a structural schematic diagram of a first pixel circuit described in an embodiment of the present application;

[0057] Figure 8 is a structural schematic diagram of a second pixel circuit described in an embodiment of the present application;

[0058] Fig. 9 is a working timing diagram of the image sensor described in the embodiment of the present application;

[0059] Fig.10 is a schematic structural diagram of another image sensor described in an embodiment of the present application;

[0060] Fig.11 is a structural schematic diagram of another second pixel circuit described in an embodiment of the present application;

[0061] Fig.12 A flowchart of the steps of an imaging method described in an embodiment of the present application.

[0062] Reference numerals: 10 - pixel region, 11 - first pixel, 110 - first pixel circuit, 111 - first photosensitive region, 112 - first floating diffusion region, 113 - first transfer transistor, 114 - first reset transistor, 115 - first source follower transistor, 116 - first row selection transistor, 12 - second pixel, 1200 - second photosensitive region, 120 - second pixel circuit, 121 - second transfer transistor, 122 - second reset transistor, 123 - second source follower transistor, 124 - second row selection transistor, 125 - third transfer transistor Transistor, 126 - a third reset transistor, 127 - a third source follower transistor, 128 - a third row selection transistor, 129 - a first diode, 1210 - a first capacitor, 1211 - a second capacitor, 1212 - a first switch, 1213 - a second switch, 1214 - a third switch, 1215 - a second diode, 1216 - a third diode, 13 - a row addressing circuit, 131 - a row addressing line, 14 - a column addressing circuit, 15 - a readout circuit, 151 - a readout signal line, 16 - a row pixel switch, X - a first direction, Y - a second direction. DETAILED DESCRIPTION

[0063] Embodiments of the present invention will be described in detail below, examples of which are shown in the accompanying drawings, wherein the same or similar reference numerals throughout represent the same or similar elements or elements having the same or similar functions. The embodiments described below with reference to the accompanying drawings are exemplary and are only used to explain the present invention, and should not be construed as limiting the present invention. Based on the embodiments in this application, all other embodiments obtained by ordinary technicians in this field without making creative work are within the scope of protection of this application.

[0064] The term "first" or "second" in the specification and claims of the present application may include one or more of the features explicitly or implicitly. In the description of the present invention, unless otherwise specified, "plurality" means two or more. In addition, "and / or" in the specification and claims means at least one of the connected objects, and the character " / " generally means that the objects connected before and after are in an "or" relationship.

[0065] In the description of the present invention, it is to be understood that the terms “center”, “longitudinal”, “lateral”, “length”, “width”, “thickness”, “up”, “down”, “front”, “back”, “left”, “right”, “vertical”, “horizontal”, “top”, “bottom”, “inside”, “outside”, “clockwise”, “counterclockwise”, “axial”, “radial”, “circumferential”, etc., indicating orientations or positional relationships based on the orientations or positional relationships shown in the accompanying drawings, are only for the convenience of describing the present invention and simplifying the description, and do not indicate or imply that the referred device or element must have a specific orientation, be constructed and operated in a specific orientation, and therefore should not be understood as limiting the present invention.

[0066] In the description of the present invention, it should be noted that, unless otherwise clearly specified and limited, the terms "installed", "connected", and "connected" should be understood in a broad sense, for example, it can be a fixed connection, a detachable connection, or an integral connection; it can be a mechanical connection or an electrical connection; it can be a direct connection, or it can be indirectly connected through an intermediate medium, or it can be the internal communication of two components. For ordinary technicians in this field, the specific meanings of the above terms in the present invention can be understood according to specific circumstances.

[0067] Reference Figure 1 , shows a schematic diagram of the structure of an image sensor according to an embodiment of the present application, such as Figure 1 As shown, the image sensor may include a pixel area 10; the pixel area 10 is provided with a plurality of first pixels 11 and a second pixel 12, and the plurality of second pixels 12 are distributed between the plurality of first pixels 11, wherein the first pixel 11 outputs a first photoelectric signal, which can be used to generate a two-dimensional image, and the second pixel 12 outputs a second photoelectric signal, which can be used to generate a two-dimensional image and depth information.

[0068] In the embodiment of the present application, by providing a plurality of first pixels 11 and second pixels 12 in the pixel area 10 of the image sensor, the first pixel 11 can be used to output a first photoelectric signal, the first photoelectric signal can be used to generate a two-dimensional image, and the second pixel 12 can be used to output a second photoelectric signal, the second photoelectric signal can be used to generate a two-dimensional image and depth information, and the depth information can be used for three-dimensional imaging. The first pixel 11 only needs to be used to output a first photoelectric signal that can form a two-dimensional image. The area of ​​the first pixel 11 is small, and the number of first pixels 11 that can be arranged per unit area is large, which is conducive to obtaining a high-resolution two-dimensional image and realizing functions such as biometrics. Moreover, since the area of ​​the first pixel is small, increasing the number of first pixels 11 on the image sensor has little effect on the overall volume, which is conducive to the processing and cost control of the image sensor. Furthermore, due to the mixed arrangement of the first pixel and the second pixel, the problem of insufficient resolution caused by the large pixel of the image sensor is improved, and the problem that ordinary image sensors cannot obtain depth information is solved.

[0069] like Figure 1 As shown, the first pixel 11 can be a two-dimensional pixel, and the two-dimensional pixel only needs to collect the light signal from the imaging object and output the first photoelectric signal to obtain a two-dimensional image through the first photoelectric signal. Usually, in order to achieve a high frame rate, the first photoelectric signal usually adopts a single exposure. Moreover, in order to obtain high resolution, the number of two-dimensional pixels per unit area is usually large, and correspondingly, the area of ​​a single two-dimensional pixel is small. For example, the length and width dimensions of the first pixel 11 are usually 1 to 2um, and the resolution of the two-dimensional pixel is usually greater than or equal to 640*480.

[0070] Specifically, the second pixel 12 may be a three-dimensional pixel using the TOF principle. The second pixel 12 may not only collect light signals from the imaging object and output a second photoelectric signal to generate a two-dimensional image according to the second photoelectric signal, but may also calculate the distance from the imaging object to the image sensor according to the second photoelectric signal outputted by the second pixel 12 to generate depth information, so as to obtain a three-dimensional image according to the depth information. Since the second pixel 12 is used to generate depth information, the corresponding emitted light pulse is short, the photosensitivity requirement is high, and multiple exposures are required to calculate the depth information, the second pixel 12 has a larger area, and the length and width dimensions of the second pixel 12 are generally 7 to 8 um. That is, since the second pixel 12 and the first pixel 11 have different functions and working principles, the size of the second pixel 12 is generally different from that of the first pixel 11, and the area of ​​the second pixel 12 is generally greater than or equal to the area of ​​the first pixel 11.

[0071] For example, the area of ​​the second pixel 12 may be 1.5 times, 2 times, 3 times or 6.6 times the area of ​​the first pixel 11 . The embodiment of the present application does not specifically limit the ratio of the area of ​​the second pixel 12 to the area of ​​the first pixel 11 .

[0072] In the embodiment of the present application, in order to obtain a two-dimensional image with a higher resolution and realize functions such as biometrics, the number of first pixels 11 should be as large as possible. In practical applications, the number of first pixels 11 can be greater than the number of second pixels 12; and / or the total area of ​​the plurality of first pixels 11 is greater than the total area of ​​the plurality of second pixels 12. The embodiment of the present application does not specifically limit the method for improving the resolution of the two-dimensional image.

[0073] like Figure 1 As shown, the second pixels 12 are distributed at equal intervals in the pixel area 10 along the first direction X and the second direction Y, respectively, and the first direction X is perpendicular to the second direction Y, so as to realize the array distribution of the second pixels 12 in the pixel area 10, which is conducive to the second pixels 12 outputting a second photoelectric signal with higher quality, thereby improving the quality of the two-dimensional image and depth information. The first pixels 11 are evenly arranged in the area outside the pixel area 10 where the second pixels 12 are arranged, so as to arrange as many first pixels 11 as possible in the pixel area 10 to improve the resolution of the two-dimensional image.

[0074] like Figure 1 As shown, along the first direction X, the spacing between two adjacent second pixels 12 is a first spacing a; along the second direction Y, the spacing between two adjacent second pixels 12 is a second spacing b. In specific applications, the second spacing b and the first spacing a may be equal or unequal, and the embodiments of the present application do not make specific limitations on this.

[0075] like Figure 1 As shown, the pixel area 10 may include a plurality of pixel groups, each of which includes n second pixels 12 and m first pixels 11, where n>=1 and m>n. In a specific application, by forming the first pixels 11 and the second pixels 12 into a plurality of pixel groups and independently controlling each pixel group, it is beneficial to improve the control efficiency and control accuracy of the first pixels 11 and the second pixels 12.

[0076] Optionally, the first pixels 11 and the second pixels 12 in the pixel group are arranged in the same manner so that the second pixels 12 can be distributed in the entire pixel area 10 array. a is the number of first pixels 11 in the pixel group along the second direction Y, and b is the number of first pixels 11 spaced between two adjacent pixel groups in the first direction X. In practical applications, the values ​​of a and b can be adjusted as needed to adjust the distribution of the first pixels 11 and the second pixels 12 in the pixel group.

[0077] like Figure 1 As shown, at least one second pixel 12 is arranged on the pixel group, and the area of ​​the second pixel 12 is larger than the area of ​​the first pixel 11. Since the area of ​​the second pixel 12 is larger, the photosensitivity of the second pixel 12 is higher, and multiple exposures can be implemented to calculate depth information to obtain a three-dimensional image with depth information. Since the area of ​​the first pixel 11 is smaller, as many first pixels 11 as possible can be arranged between the second pixels 12 to obtain a two-dimensional image with high resolution.

[0078] It should be noted that Figure 1 Only the case where the second pixel 12 occupies the space of two first pixels 11 is shown. In actual applications, the second pixel 12 can also occupy the space of 3, 4 or 6 first pixels 11, etc., and this embodiment of the application is not limited to this.

[0079] Or, if Fig.10 As shown, each of the pixel groups may include a plurality of adjacently arranged second pixels 12, and the area of ​​the second pixel 12 is equal to the area of ​​the first pixel 11, that is, the second pixel 12 is designed to be small in size, about 1 to 3 um, like the first pixel 11. In this way, the problem of reduced image resolution in the area where the second pixel 12 is located can be avoided. In this design, when the two-dimensional pixel 12 is used to calculate the depth, the brightness information of the calculated depth is calculated by summing the brightness of the pixels in the unit area to achieve the accuracy required for the depth calculation. At the same time, the sum of the brightness information of multiple exposures is also used as two-dimensional image information to participate in the two-dimensional image output.

[0080] In some other optional embodiments of the present application, the arrangement of the first pixels 11 and the second pixels 12 in the pixel groups may be different, so as to adjust the arrangement of the first pixels 11 and the second pixels 12 in each of the pixel groups according to actual needs, so as to improve the arrangement flexibility of the first pixels 11 and the second pixels 12 in the pixel groups.

[0081] like Figure 2 As shown, the first pixel 11 may include a first pixel circuit 110 and a first photosensitive area 111, and the first pixel circuit 110 may be used to convert the light signal projected onto the first photosensitive area 111 into the first photoelectric signal. The second pixel 12 may include a second pixel circuit 120 and a second photosensitive area 1200, and the second pixel circuit 120 may be used to convert the light signal projected onto the second photosensitive area 1200 into the second photoelectric signal.

[0082] like Figure 3As shown, the image sensor may further include a row addressing circuit 13 and a readout circuit 15, wherein the row addressing circuit 13 and the readout circuit 15 are electrically connected to the first pixel circuit 110 and the second pixel circuit 120, respectively, and the row addressing circuit 13 may be used to control the first pixel circuit 110 and the second pixel circuit 120 to output the first photoelectric signal and the second photoelectric signal to the readout circuit 15, respectively. The readout circuit 15 may be used to convert the received first photoelectric signal and the second photoelectric signal into digital signals. The column addressing circuit 14 is electrically connected to the readout circuit 15, and the column addressing circuit 14 may be used to output the digital signal to a subsequent target circuit, so as to output the two-dimensional image and / or the depth information through the subsequent target circuit.

[0083] It should be noted that in a specific application, the row addressing circuit 13 can be used to open the row switches of the pixel area row by row after the first pixel 11 and / or the second pixel 12 are exposed, so that the first photoelectric signal obtained by the exposure of the first pixel circuit 110 or the second photoelectric signal obtained by the exposure of the second pixel circuit 120 enters the readout circuit 15 row by row for signal readout. The column addressing circuit 14 can output the signal obtained by the readout circuit 15 to the subsequent target circuit by column.

[0084] It should be noted that, in a specific application, the column addressing circuit 14 may also be cancelled according to actual conditions. In the case where the column addressing circuit 14 is not provided, the digital signal obtained by the readout circuit 15 may be output to the subsequent target circuit at one time.

[0085] like Figure 4 As shown, the first pixel 11 and the second pixel 12 are arranged in an array along a first direction X and a second direction Y, respectively, and the second direction Y is perpendicular to the first direction X; the row addressing circuit 13 is arranged at the edge of the pixel area 10 along the first direction X, and the row addressing circuit 13 may include a plurality of row addressing lines 131 extending along the first direction X, and each row addressing line 131 is electrically connected to the first pixel circuit 110 of the first pixel 11 and / or the second pixel circuit 120 of the second pixel 12 in its row.

[0086] In a specific application, a row pixel switch 16 may be provided on the first pixel circuit 110 and the second pixel circuit 120, and the row addressing line 131 may be electrically connected to the row pixel switches 16 of the first pixel circuits 110 and the second pixel circuits 120 of all the first pixels 11 and the second pixel circuits 12 of the row. In this way, the first photoelectric signal and the second photoelectric signal obtained by exposure of the first pixel circuit 110 and the second pixel circuit 120 can be controlled by the row pixel switch 16 to be output to the readout circuit 15.

[0087] like Figure 4As shown, the readout circuit 15 is arranged at the edge of the pixel area 10 along the second direction Y, and the readout circuit 15 is close to the pixel area 10. The readout circuit 15 may include a plurality of readout signal lines 151 extending along the second direction Y. The readout signal lines 151 are respectively connected to the first pixel circuit 110 of the first pixel 11 and / or the second pixel circuit 120 of the second pixel 12 in the column. The readout signal lines 151 can read out the first photoelectric signal or the second photoelectric signal obtained by exposure on the first pixel circuit 110 and / or the second pixel circuit 120 to the readout circuit 15, and convert it into a digital signal through the readout circuit 15. Figure 4 As shown, a first pixel circuit 110 of a first pixel 11 and a second pixel circuit 120 of a second pixel 12 may share a readout signal line 151 .

[0088] In one implementation, Figure 5 As shown, each row addressing line 131 connects all row pixel switches 16 of this row of pixels, wherein the first pixel 11 and the second pixel 12 use different row pixel switches 16. Since the second pixel 12 requires multiple exposures to calculate the depth, in order to improve the control accuracy, each second pixel circuit 120 is connected to a separate row addressing line 131. That is, the second pixel circuit 120 and the first pixel circuit 110 do not share the row addressing line 131.

[0089] In another implementation, Figure 6 As shown, the second pixel 12 and the first pixel 11 share the row addressing line 131. Since the second pixel 12 needs to output the second photoelectric signal of two exposures to generate the depth information, the row where the second pixel 12 is located corresponds to at least two first pixels. Therefore, in a specific application, one second pixel circuit 120 shares at least two of the row addressing lines with at least two first pixel circuits 110. That is, in this example, one second pixel circuit 120 is connected to two row addressing lines 131, outputs the values ​​of two exposures respectively, and shares two row addressing lines 131 with two first pixel circuits 110 respectively.

[0090] It should be noted that, in a specific application, the row addressing line 131 can be as follows: Figure 5 or Figure 6 As shown, that is, the first pixel 11 and the second pixel 12 may respectively use separate row addressing lines 131 , or may share the row addressing line 131 , which is not limited in the embodiment of the present application.

[0091] Reference Figure 7 , shows a schematic structural diagram of a first pixel circuit according to an embodiment of the present application, such as Figure 7As shown, the first pixel 11 may include a first photosensitive area 111 and a first floating diffusion area 112. The first pixel circuit 110 may be a 4T pixel circuit. Specifically, the first pixel circuit 110 may include: a first transfer transistor 113, a first reset transistor 114, a first source follower transistor 115, and a first row selection transistor 116; wherein the gate of the first reset transistor 114 is used to input a reset signal, the drain is connected to a preset voltage source, and the source is connected to the drain of the first transfer transistor 113 and the gate of the first source follower transistor 115; the gate of the first transfer transistor 113 may be used to input a transmission signal, the source of the first transfer transistor 113 is set in the first photosensitive area 111, and the drain is set in the first floating diffusion area 112; the drain of the first source follower transistor 115 is connected to the preset voltage source, and the source is connected to the drain of the first row selection transistor 116; the gate of the first row selection transistor 116 is connected to the row addressing line 131 for inputting a row selection signal, and the source is connected to the readout signal line 151.

[0092] Specifically, the working process of the first pixel circuit 110 may include the following four working stages: in the first stage, the first reset transistor 114 is turned on to input a reset signal, the first transfer transistor 113 and the first row selection transistor 116 are turned off, at this time, the first photosensitive area 111 can be reset; in the second stage, the first reset transistor 114, the first transfer transistor 113 and the first row selection transistor 116 are all turned off, at this time, the first photosensitive area 111 and the first floating diffusion area 112 can be illuminated, the potential drops, and exposure begins; in the third stage, the first reset transistor 114 is turned on, the first transfer transistor 113 is turned off, and the first row selection transistor 116 is turned off. The selection transistor 116 is turned on. At this time, a reset signal can be input through the first reset transistor 114 to reset the first floating diffusion area 112. In the fourth stage, the first reset transistor 114 is turned off, the first transfer transistor 113 is turned on, and the first row selection transistor 116 is turned on. The electrons in the first photosensitive area 111 are transferred to the first floating diffusion area 112 through the first transfer transistor 113. After the first floating diffusion area 112 is expanded, they are transferred to the readout circuit 15 through the first source follower transistor 115, the first row selection transistor 116, and the readout signal line 151, so that the readout circuit 15 can read and convert data.

[0093] In an embodiment of the present application, the second pixel circuit 120 may include two pixel circuit modules, and the two pixel circuit modules are respectively connected to two row addressing lines 131. The two pixel circuit modules can be used to respectively generate the second photoelectric signals obtained by two exposures at different time points. The two row addressing lines 131 can control the switches of the two pixel circuit modules to output the second photoelectric signals through the readout signal line 151, so as to generate depth information through the second photoelectric signals obtained by two exposures.

[0094] In some optional embodiments of the present application, the pixel circuit module includes a transmission transistor (specifically, Figure 8 The second pixel circuit also includes a first diode 129, which is respectively connected to the transfer transistors (the second transfer transistor 121 and the third transfer transistor 125) of the two pixel circuit modules to output the second photoelectric signal obtained by the divided exposure to the readout circuit 15 through the readout signal line 151.

[0095] Reference Figure 8 , shows a schematic structural diagram of a second pixel circuit according to an embodiment of the present application, such as Figure 8 As shown, the second pixel 12 may include a second photosensitive region and a second floating diffusion region. The second pixel circuit 120 may include two or more 4T pixel circuits (ie, pixel circuit modules). Figure 8As shown, the second pixel circuit 120 may include: a second transfer transistor 121, a second reset transistor 122, a second source follower transistor 123, a second row selection transistor 124, a third transfer transistor 125, a third reset transistor 126, a third source follower transistor 127 and a third row selection transistor 128; wherein the gate of the second reset transistor 122 may be used to input a reset signal, the drain is connected to a preset voltage source, and the source is connected to the drain of the second transfer transistor 121 and the gate of the second source follower transistor 123; the gate of the second transfer transistor 121 may be used to input a transmission signal, the source of the second transfer transistor 121 is arranged in the second photosensitive area, which is equivalent to being connected to the output end of the first diode 129; the drain is arranged in the second floating diffusion area, which is equivalent to connecting a first capacitor 1210 between the drain and the ground; the drain of the second source follower transistor 123 is connected to the preset voltage source, and the source is connected to the second row selection transistor 1 24; the gate of the second row selection transistor 124 is connected to the row addressing line 131 for inputting the row selection signal, and the source is connected to the readout signal line 151; the gate of the third reset transistor 126 can be used to input the reset signal, the drain is connected to the preset voltage source, and the source is connected to the drain of the third transfer transistor 125 and the gate of the third source follower transistor 127; the gate of the third transfer transistor 125 can be used to input the transmission signal, the source of the third transfer transistor 125 is set in the second photosensitive area, which is equivalent to being connected to the output end of the first diode 129, and the drain is set in the second floating diffusion area, which is equivalent to connecting a second capacitor 1211 between the drain and the ground; the drain of the third source follower transistor 127 is connected to the preset voltage source, and the source is connected to the drain of the third row selection transistor 128; the gate of the third row selection transistor 128 is connected to the row addressing line 131 for inputting the row selection signal, and the source is connected to the readout signal line 151.

[0096] It should be noted that the second transfer transistor 121, the second reset transistor 122, the second source follower transistor 123, and the second row selection transistor 124 can form a 4T pixel circuit (pixel circuit module). The third transfer transistor 125, the third reset transistor 126, the third source follower transistor 127, and the third row selection transistor 128 can form a 4T pixel circuit (pixel circuit module). The working process of each 4T pixel circuit is similar to Figure 7 The working process of the 4T pixel circuit shown in is similar and will not be described in detail here.

[0097] like Figure 8As shown, the second pixel circuit 120 may also include: a first diode 129, a first capacitor 1210 and a second capacitor 1211, one end of the first diode 129 is connected to a negative power supply voltage access terminal (e.g., a ground terminal), the other end of the first diode 129 is connected to a source of the second transfer transistor 121, the first capacitor 1210 is connected between the drain of the second transfer transistor 121 and the negative power supply voltage access terminal; the second capacitor 1211 is connected between the drain of the third transfer transistor 125 and the negative power supply voltage access terminal.

[0098] In a specific application, each 3D pixel has two (or more) 4T pixel circuits, and the first diode 129 controls the second transfer transistor 121 and the third transfer transistor 125 to be turned on in sequence, that is, the second transfer transistor 121 and the third transfer transistor 125 are connected in sequence, and the charges obtained from the two exposures at different time points are stored in the first capacitor 1210 and the second capacitor 1211, and are quantified and given by two 4T pixel circuits. The second row selection transistor 124 and the third row selection transistor 128 (equivalent to the switches of the two pixel circuit modules) are connected to the two row addressing lines 131 for reading. In this way, the two pixel circuit modules can be connected to the two row addressing lines 131 respectively, and output after row addressing respectively.

[0099] In another embodiment, Figure 8 As shown, each second pixel 12 only needs one selection signal and one row addressing line 131 to control the second row selection transistor 124 and the third row selection transistor 128, and uses the follower transistor 123 and the third source follower transistor 127 to output signals in sequence.

[0100] In this embodiment, the exposure of the second pixel 12 needs to be coordinated with the light emission timing of the light source, and the timing relative relationship is determined according to the shooting target distance (such as holding a mobile phone to shoot a face). The first pixel 11 does not need to accurately match the timing with the light source, and can be exposed for a long time.

[0101] Reference Fig. 9 , shows the working timing diagram of the image sensor described in the embodiment of the present application. Fig. 9 As shown, LD is the light source emission sequence. In the figure, there are only two light pulses as a cycle. In actual operation, there will be multiple light pulses in one cycle. The integral value of the diode is increased by multiple acquisitions. The first pixel 11 will be turned on throughout the entire light cycle. If a high frame rate is required, it can be turned on and off multiple times in one cycle. The exposure of the second pixel 12 can be divided into multiple sequences, and the number of sequences is determined by the structure of the second pixel circuit 120. For example, Figure 8As shown, in the case where the second pixel circuit 120 includes two 4T pixel circuits, the second pixel 12 may include Fig. 9 The exposure timing relationship between the second pixel A and the second pixel B shown in FIG. 1 is related to the detection target distance range, and the two timings are generally 180 degrees phase offset. Since the two exposures share the same first diode 129, the two exposure timings cannot overlap.

[0102] In an embodiment of the present application, the image sensor can ultimately simultaneously generate a two-dimensional image and a three-dimensional image generated based on depth information, wherein the image of the two-dimensional image at the second pixel 12 position will add multiple exposures and perform calibrated and normalized processing as the pixel value of the two-dimensional image at this position. At the same time, since the area of ​​the second pixel is relatively large, the resolution may be lost. Therefore, it is necessary to fit the pixels at this position with the surrounding positions to expand the resolution.

[0103] For example, if the second pixel 12 occupies the area of ​​two first pixels 11, when outputting a two-dimensional image, the second pixel 12 can be fitted into two first pixels 11 for image output. The three-dimensional image is calculated based on the exposure values ​​obtained by the first exposure and the second exposure. Since the three-dimensional image may need to be accumulated multiple times, the output frame rate may be lower than that of the two-dimensional image, that is, the output frame rate of the two-dimensional image may be different from the output frame rate of the three-dimensional image.

[0104] Reference Fig.11 , shows a schematic structural diagram of another second pixel circuit according to an embodiment of the present application, Fig.11 The second pixel circuit 120 shown can be used for Fig.10 The second pixel 12 is shown. Fig.11As shown, the second pixel circuit 120 may include a second diode 1215, a third diode 1216, a first switch 1212, a second switch 1213 and a third switch 1214, and the first switch 1212, the second switch 1213 and the third switch 1214 may be composed of transistors. The output end of the second diode 1215 is connected to the transfer transistor of one of the pixel circuit modules (i.e., the second transfer transistor 121) through the first switch 1212 and the second switch 1213 in sequence. The output end of the third diode 1216 is connected between the first switch 1212 and the second switch 1213 (i.e., the output end of the first switch 1212 or the input end of the second switch 1213), and is also connected to the transfer transistor of another pixel circuit module (i.e., the third transfer transistor 125). The third switch 1214 is connected between the output end of the second diode 1215 and the input end of the transfer transistor 121 of one of the pixel circuit modules (i.e., the source of the transfer transistor 121). When the third switch 1214 is turned on and the first switch 1212 and the second switch 1213 are turned off, the first pixel circuit 110 multiplexes one of the two pixel circuit modules, so that the second photoelectric signal output by the pixel circuit module in the second pixel circuit can be used to generate a two-dimensional image as well as to generate depth information.

[0105] like Fig.11 As shown, the second pixel circuit 120 may include: a first switch 1212, a second switch 1213, a third switch 1214, a second diode 1215 and a third diode 1216; wherein, the input end of the first switch 1212 (i.e., the source of the third switch transistor) is connected to the output end of the second diode 1215, the output end of the first switch 1212 (i.e., the drain of the first switch transistor) is connected to the source of the third transfer transistor 125 and the input end of the second switch 1213 (i.e., the source of the second switch transistor), and the gate of the first switch 1212 can be used to access the switching signal; the output end of the second switch 1213 (i.e., the drain of the second switch transistor) is connected to the source of the second transfer transistor 121, and the drain of the second switch 1213 is connected to the source of the second transfer transistor 121. The gate can be used to access the switching signal; the input end of the third switch 1214 (i.e., the source of the third switching transistor) is connected to the output end of the second diode 1215, the output end of the third switch 1214 (i.e., the drain of the third switching transistor) is connected to the source of the second transmission transistor 121, and the gate of the third switch 1214 can be used to access the switching signal; one end of the second diode 1215 is connected to the negative power supply voltage access end, and the other end (i.e., the output end) is respectively connected to the input end of the first switch 1212 and the input end of the third switch 1214; one end of the third diode 1216 is connected to the negative power supply voltage access end, and the other end (i.e., the output end) is respectively connected to the source of the third transmission transistor 125 and the input end of the second switch 1213.

[0106] In specific applications, such as Fig.10 The charge quantization process of the plurality of second pixels 12 in each pixel group shown can be controlled by the first switch 1212, the second switch 1213 and the third switch 1214. For example, when the second pixel 12 is used for imaging of a two-dimensional image, the first switch 1212 and the second switch 1213 can be turned off, and the third switch 1214 can be turned on. That is, the first pixel circuit can reuse the pixel circuit module composed of the second diode 1215, the second transfer transistor 121, the second reset transistor 122, the first capacitor 1210, the second source follower transistor 123, and the second row selection transistor 124; the first pixel circuit can also reuse the pixel circuit module composed of the third diode 1216, the third transfer transistor 125, the second capacitor 1211, the third reset transistor 126, the third source follower transistor 127, and the third row selection transistor 128. In this way, the second diode 1215 and the third diode 1216 are independent exposure quantization, which is consistent with the two-dimensional pixel exposure. For another example, when the second pixel 12 is used for imaging a three-dimensional image, the third switch 1214 can be turned off, and the first switch 1212 and the second switch 1213 can be turned on. At this time, the pixel charges of the second diode 1215 and the third diode 1216 are gathered together for quantization to obtain a three-dimensional image.

[0107] It should be noted that, in this embodiment, the switch closed means that the switch is disconnected, the switch opened means that the switch is connected, and the diode is a photodiode.

[0108] In summary, the image sensor described in the embodiments of the present application may at least have the following advantages:

[0109] In the embodiment of the present application, by providing a plurality of first pixels and second pixels in the pixel area of ​​the image sensor, the first pixel can be used to output a first photoelectric signal, the first photoelectric signal can be used to generate a two-dimensional image, the second pixel can be used to output a second photoelectric signal, the second photoelectric signal can be used to generate a two-dimensional image and depth information, and the depth information can be used for three-dimensional imaging. Since the first pixel only needs to be used to output the first photoelectric signal that can form a two-dimensional image, the area of ​​the first pixel is small, and the number of the first pixels that can be arranged per unit area is large, which is conducive to obtaining a high-resolution two-dimensional image and realizing functions such as biometrics. Moreover, since the area of ​​the first pixel is small, increasing the number of the first pixels on the image sensor has little effect on the overall volume, which is conducive to the processing and cost control of the image sensor. Furthermore, due to the mixed arrangement of the first pixel and the second pixel, the problem of insufficient resolution caused by the large pixel of the image sensor is improved, and the problem that ordinary image sensors cannot obtain depth information is solved.

[0110] The present application also provides a lens assembly, which may specifically include: a bracket, a lens, a circuit board, and an image sensor as described in any one of the above items; wherein a through hole is provided in the bracket, and the lens is provided in the through hole; the circuit board is connected to the bracket; and the image sensor is connected to the bracket and opposite to the lens.

[0111] It should be noted that the structure of the image sensor described in the embodiment of the present application is the same as the structure of the image sensor described in any of the above embodiments, and its beneficial effects are also similar, which will not be elaborated here.

[0112] An embodiment of the present application further provides an electronic device, which may include the image sensor described in any of the above embodiments, or the electronic device may include the lens assembly described in any of the above embodiments.

[0113] In the embodiment of the present application, the electronic device may include but is not limited to a mobile phone, a tablet computer, a wearable device, etc. The embodiment of the present application does not specifically limit the specific type of the electronic device.

[0114] Reference Fig.12 , shows a flowchart of the steps of an imaging method described in an embodiment of the present application. The imaging method can be implemented using the image sensor described in any of the above embodiments. Fig.12 The imaging method may specifically include the following steps:

[0115] Step 1201: Obtain a first pixel value according to a first photoelectric signal output by a first pixel.

[0116] In the embodiment of the present application, the first pixel 11 may be a two-dimensional pixel, which may collect light intensity information and output a first photoelectric signal. In a specific application, a first pixel value may be obtained according to the first photoelectric signal, so as to generate a two-dimensional image according to the first pixel value.

[0117] Step 1202: Obtain a second pixel value and depth information according to a second photoelectric signal output by a second pixel.

[0118] In the embodiment of the present application, the second pixel 12 may be a three-dimensional pixel using the TOF principle. The second pixel 12 may not only collect light intensity information and output a second photoelectric signal to obtain a second pixel value capable of generating a two-dimensional image according to the second photoelectric signal, but may also calculate the distance of the imaging object according to the second photoelectric signal outputted by the second pixel 12 to obtain depth information to obtain a three-dimensional image according to the depth information.

[0119] Step 1203: Generate a two-dimensional image according to the first pixel value and the second pixel value; and / or generate a three-dimensional image according to the second pixel value and the depth information.

[0120] In an embodiment of the present application, when the image sensor is only required to generate a two-dimensional image, a two-dimensional image can be generated according to the first pixel value and the second pixel value. When the image sensor is only required to generate a three-dimensional image, a three-dimensional image can be generated according to the second pixel value and the depth information. When the image sensor is required to generate both a two-dimensional image and a three-dimensional image, a two-dimensional image can be generated according to the first pixel value and the second pixel value, and a three-dimensional image can be generated according to the second pixel value and the depth information. In practical applications, the generated two-dimensional image or three-dimensional image can be used for biometrics, such as face recognition, iris recognition, fingerprint recognition, etc.; the generated three-dimensional image can be used for anti-counterfeiting detection.

[0121] In some optional embodiments of the present application, the first pixel performs one exposure according to the first exposure time T1 to output the first photoelectric signal, and the second pixel performs n exposures according to the second exposure time T2 to output the second photoelectric signal.

[0122] The step of generating a two-dimensional image according to the first pixel value and the second pixel value may include the following sub-steps:

[0123] Sub-step S11: normalizing the second pixel value according to the first exposure time T1 and the second exposure time T2 to obtain a processed second pixel value.

[0124] In the embodiment of the present application, the generated two-dimensional image needs to be based on the second pixel value output by the second pixel, and the second pixel value is obtained by multiple exposure addition processing. Therefore, the exposure time for generating the first pixel value and the second pixel value is different. Therefore, normalization processing is required. Specifically, the second pixel value m: (n*T2) = the processed second pixel value m': T1, that is, the second pixel value pixel needs to be converted into a pixel value when the exposure time is normalized to the same standard as the first exposure time.

[0125] Sub-step S12: generating the two-dimensional image according to the first pixel value and the processed second pixel value.

[0126] In an embodiment of the present application, the two-dimensional image can be generated according to the first pixel value and the processed second pixel value. Since the processed second pixel value is calibrated and normalized by referring to the first pixel value obtained by the exposure time of the first pixel 11, the image at the position of the second pixel 12 can achieve a good normalization effect with the image at the position of the first pixel 11. Therefore, the image quality of the two-dimensional image generated according to the second pixel value and the first pixel value is better, which is conducive to biometric identification based on the two-dimensional image.

[0127] In an optional embodiment of the present application, the area of ​​the second pixel 12 occupies the area of ​​q first pixels 11; then the step of generating a two-dimensional image according to the first pixel value and the second pixel value may include the following sub-steps:

[0128] Sub-step S21: for each of the second pixels, fit the second pixel value of the second pixel with the first pixel value of its surrounding area to obtain q converted second pixel values; the surrounding area includes at least one first pixel.

[0129] In the embodiment of the present application, since the area of ​​the second pixel 12 is relatively large and occupies the area of ​​q first pixels 11, the second pixel value at the position needs to be converted into multiple pixel values ​​of the same number to expand the resolution. For example, when the second pixel 12 occupies the area of ​​2 first pixels 11, the initial second pixel value needs to be converted into 2 second pixel values ​​to achieve resolution expansion.

[0130] In a specific application, when converting the second pixel value into a plurality of pixel values ​​of the same number, the first pixel value of the area surrounding the second pixel is considered, so that the converted result is closer to the real pixel value, thereby improving the image quality. The surrounding area may include the first pixel value of at least one first pixel in the upper, lower, left, and right directions. It may be split after fitting, for example, a second pixel value is weighted summed with a plurality of first pixel values ​​in the surrounding area, and then averagely split into q converted second pixel values. It may also be directly fitted with different surrounding areas to directly obtain multiple fitting results as q converted second pixel values. For example, if the second pixel 12 occupies two first pixels 11, it is fitted with the pixel values ​​of the surrounding upper area as a converted second pixel value, and then fitted with the pixel values ​​of the surrounding upper area as another converted second pixel value; for example, if the second pixel 12 occupies four first pixels 11, it is respectively fitted with the pixel values ​​of the surrounding upper, lower, left, and right areas to obtain four converted second pixel values.

[0131] Sub-step S22: generating the two-dimensional image according to the first pixel value of each first pixel and q converted second pixel values ​​corresponding to each second pixel.

[0132] In the embodiment of the present application, the two-dimensional image can be generated based on the first pixel value obtained by the first pixel 11 and the q converted second pixel values ​​corresponding to each second pixel to achieve the expansion of the resolution of the two-dimensional image.

[0133] Optionally, an output frame rate of the two-dimensional image is lower than an output frame rate of the three-dimensional image.

[0134] In the embodiment of the present application, since the three-dimensional image needs to be calculated based on the exposure values ​​obtained by the first exposure and the second exposure, the second pixel value obtained by the second pixel 12 may need to be accumulated multiple times, so the output frame rate may be lower than that of the two-dimensional image, that is, the output frame rate of the three-dimensional image may be different from the output frame rate of the two-dimensional image. Usually, the output frame rate of the three-dimensional image is lower than the output frame rate of the two-dimensional image.

[0135] In the description of this specification, the description with reference to the terms "one embodiment", "some embodiments", "illustrative embodiments", "examples", "specific examples", or "some examples" means that the specific features, structures, materials or characteristics described in conjunction with the embodiment or example are included in at least one embodiment or example of the present invention. In this specification, the schematic representation of the above terms does not necessarily refer to the same embodiment or example. Moreover, the specific features, structures, materials or characteristics described may be combined in any one or more embodiments or examples in a suitable manner.

[0136] Although the embodiments of the present invention have been shown and described, it will be appreciated by those skilled in the art that various changes, modifications, substitutions and variations may be made to the embodiments without departing from the principles and spirit of the present invention, and that the scope of the present invention is defined by the claims and their equivalents.

Claims

1. An image sensor, It is characterized in that The image sensor comprises a pixel area (10); the pixel area (10) is provided with a plurality of first pixels (11) and a second pixel (12), and the plurality of second pixels (12) are distributed between the plurality of first pixels (11), wherein the first pixel (11) outputs a first photoelectric signal, and the first photoelectric signal is used to generate a two-dimensional image, and the second pixel (12) outputs a second photoelectric signal, and the second photoelectric signal is used to generate a two-dimensional image and depth information.

2. The image sensor according to claim 1, It is characterized in that The image sensor satisfies any one or more of the following conditions: The area of ​​the first pixel (11) is smaller than or equal to the area of ​​the second pixel (12); The number of the first pixels is greater than the number of the second pixels; The total area of ​​the plurality of first pixels (11) is greater than the total area of ​​the plurality of second pixels (12).

3. The image sensor according to claim 1, It is characterized in that The second pixels (12) are distributed in the pixel area (10) at equal intervals along a first direction (X) and a second direction (Y), respectively, and the first direction (X) is perpendicular to the second direction (Y).

4. The image sensor according to claim 1, It is characterized in that The pixel area (10) includes a plurality of pixel groups, each of the pixel groups includes n second pixels (12) and m first pixels (11), where n>=1 and m>n.

5. The image sensor according to claim 4, It is characterized in that The first pixels (11) and the second pixels (12) in the pixel group are arranged in the same or different manners.

6. The image sensor according to claim 4, It is characterized in that The area of ​​the second pixel (12) is greater than the area of ​​the first pixel (11); Alternatively, each of the pixel groups comprises a plurality of adjacently arranged second pixels (12), and the area of ​​the second pixels (12) is equal to the area of ​​the first pixels (11).

7. The image sensor according to any one of claims 1 to 6, It is characterized in that The first pixel (11) is provided with a first pixel circuit (110), the first pixel circuit (110) is used to convert the light signal projected onto the first pixel (11) into the first photoelectric signal, and the second pixel (12) is provided with a second pixel circuit (120), the second pixel circuit (120) is used to convert the light signal projected onto the second pixel (12) into the second photoelectric signal; The image sensor further comprises a row addressing circuit (13) and a readout circuit (15), wherein the row addressing circuit (13) and the readout circuit (15) are electrically connected to the first pixel circuit (110) and the second pixel circuit (120), respectively, and the row addressing circuit (13) is used to control the first pixel circuit (110) and the second pixel circuit (120) to output the first photoelectric signal and the second photoelectric signal to the readout circuit (15), respectively.

8. The image sensor according to claim 7, It is characterized in that The first pixels (11) and the second pixels (12) are arranged in an array along a first direction (X) and a second direction (Y), respectively, and the second direction (Y) is perpendicular to the first direction (X); The row addressing circuit (13) is arranged at an edge of the pixel area (10) along the first direction (X), and the row addressing circuit (13) comprises a plurality of row addressing lines (131) extending along the first direction (X), and each of the row addressing lines (131) is electrically connected to a first pixel circuit (110) of the first pixel (11) and / or a second pixel circuit (120) of the second pixel (12) in the row in which it is located; The readout circuit (15) is arranged at an edge of the pixel area (10) along the second direction (Y), and the readout circuit (15) includes a plurality of readout signal lines (151) extending along the second direction (Y), and the readout signal lines (151) are respectively connected to the first pixel circuit (110) of the first pixel (11) and / or the second pixel circuit (120) of the second pixel (12) in the column.

9. The image sensor according to claim 8, It is characterized in that One of the second pixel circuits (120) and at least two of the first pixel circuits (110) share at least two of the row addressing lines (131).

10. The image sensor according to claim 8, It is characterized in that The second pixel circuit comprises two pixel circuit modules, the two pixel circuit modules are respectively connected to one or two row addressing lines (131), the two pixel circuit modules are used to respectively generate the second photoelectric signals obtained by two exposures at different time points, and the row addressing line (131) controls the switches of the two pixel circuit modules to output the second photoelectric signals through the readout signal line (151).

11. The image sensor according to claim 10, It is characterized in that The pixel circuit module includes a transfer transistor (121 / 125); The second pixel circuit further comprises a first diode (129), wherein the first diode (129) is respectively connected to the transmission transistors (121 / 125) of the two pixel circuit modules.

12. The image sensor according to claim 10, It is characterized in that The pixel circuit module includes a transfer transistor (121 / 125); The second pixel circuit further comprises a second diode (1215), a third diode (1216), a first switch (1212), a second switch (1213) and a third switch (1214); the output end of the second diode (1215) is connected to the transmission transistor (121) of one of the pixel circuit modules through the first switch (1212) and the second switch (1213) in sequence; the output end of the third diode (1216) is connected between the first switch (1212) and the second switch (1213), and is also connected to the transmission transistor (125) of another pixel circuit module; The third switch (1214) is connected between the output end of the second diode (1215) and the input end of the transfer transistor (121) of one of the pixel circuit modules. When the third switch is turned on and the first switch (1212) and the second switch (1213) are turned off, the first pixel circuit reuses one of the two pixel circuit modules.

13. A lens assembly, It is characterized in that The lens assembly comprises: a bracket, a lens, a circuit board and the image sensor according to any one of claims 1 to 12; wherein, A through hole is provided in the bracket, and the lens is provided in the through hole; The circuit board is connected to the bracket; The image sensor is connected to the bracket and is opposite to the lens.

14. An electronic device, It is characterized in that The electronic device comprises the image sensor according to any one of claims 1 to 12; Alternatively, the electronic device comprises the lens assembly according to claim 13.

15. An imaging method using the image sensor according to any one of claims 1 to 12, It is characterized in that The imaging method comprises: Obtaining a first pixel value according to a first photoelectric signal output by the first pixel; Obtaining a second pixel value and depth information according to a second photoelectric signal output by the second pixel; A two-dimensional image is generated according to the first pixel value and the second pixel value; and / or a three-dimensional image is generated according to the second pixel value and the depth information.

16. The imaging method according to claim 15, It is characterized in that The first pixel performs one exposure according to a first exposure time T1 to output the first photoelectric signal, and the second pixel performs n exposures according to a second exposure time T2 to output the second photoelectric signal; The step of generating a two-dimensional image according to the first pixel value and the second pixel value comprises: Normalizing the second pixel value according to the first exposure time and the second exposure time to obtain a processed second pixel value; The two-dimensional image is generated according to the first pixel value and the processed second pixel value.

17. The imaging method according to claim 15, It is characterized in that The area of ​​the second pixel occupies the area of ​​q first pixels; The step of generating a two-dimensional image according to the first pixel value and the second pixel value comprises: For each of the second pixels, fitting the second pixel value of the second pixel with the first pixel value of its surrounding area to obtain q converted second pixel values; the surrounding area includes at least one first pixel; The two-dimensional image is generated according to the first pixel value of each first pixel and q converted second pixel values ​​corresponding to each second pixel.

18. The imaging method according to any one of claims 15 to 17, It is characterized in that An output frame rate of the three-dimensional image is lower than an output frame rate of the two-dimensional image.