Image sensor, three-dimensional imaging device, electronic equipment and method
By combining pixel arrays and polarizers in the image sensor, using multiple linear polarization regions to modulate light in different regions, the problem of insufficient imaging accuracy and response speed in existing face recognition technology is solved, and high-precision and high-speed faces are achieved Identify.
Patent Information
- Application Number
- CN202410977216.7
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-07-19
- Publication Date
- 2024-11-08
AI Technical Summary
Among the existing facial recognition technologies, binocular vision schemes, time flight schemes and structured light schemes have problems with insufficient imaging accuracy and response speed, and the recognition accuracy of three-dimensional imaging technology is also low.
Design an image sensor, using a pixel array to combine with a polarizing plate, receive light carrying polarization information through the first pixel and the second pixel, realize two-dimensional and three-dimensional imaging of the target object, and use multiple linear polarization regions of the polarizing plate to divide it. Area modulation of light, combining bandpass filters and microlens arrays to improve recognition accuracy and speed.
By comprehensively utilizing the information of the first pixel and the second pixel, all-round imaging of the target object can be achieved, the accuracy and speed of face recognition can be improved, the ability to reconstruct the contour surface of the target object can be enhanced, and the accuracy of recognition can be enhanced.
Smart Images

Figure CN118921568A_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of biometric identification technology, and in particular to an image sensor, a three-dimensional imaging device, an electronic device and a method. Background Art
[0002] With the development of portable terminal devices, the application of biometric technology is becoming more and more extensive and in-depth. Taking electronic devices as an example, fingerprint recognition, face recognition, etc. have been increasingly used in the device screen wake-up and identity authentication steps of various programs, improving the security of the device and the flexibility of its use.
[0003] At present, the main solutions for face recognition include binocular vision, time-of-flight, and structured light. Among them, the binocular vision solution has a limited scope of use because the reconstruction accuracy is proportional to the camera baseline length; the cost of the time-of-flight camera is relatively high, and it is limited by the time resolution, so the accuracy of 3D imaging is not high; although the structured light solution has the advantage of high imaging accuracy, its response speed is slow and the frame rate is low, and as the imaging distance increases, the imaging accuracy decreases. Therefore, another polarization 3D imaging technology that can be used for face recognition has also been gradually developed, but the current polarization 3D imaging technology usually has the problem of poor recognition accuracy. Summary of the invention
[0004] The purpose of the present application is to provide an image sensor, a three-dimensional imaging device, an electronic device and a method to address the deficiencies in the above-mentioned prior art.
[0005] To achieve the above purpose, the technical solution adopted in the embodiment of the present application is as follows:
[0006] In one aspect of an embodiment of the present application, an image sensor is provided, comprising a pixel array, a polarizer is arranged on a receiving side of the pixel array, and the polarizer has a plurality of linear polarization regions;
[0007] The pixel array includes a plurality of pixels distributed in an array, each pixel has an orthographic projection located on the plane where the polarizer is located, pixels whose orthographic projections are all located in the linear polarization region are first pixels, and pixels whose orthographic projections at most partially intersect with any linear polarization region are second pixels;
[0008] The first pixel and the second pixel are used to receive light carrying polarization information, and the polarization information corresponds to the contour surface of the target object.
[0009] Optionally, first pixels whose orthographic projections are all located in the same linear polarization region form a pixel group, and each pixel group includes at least one first pixel, and an area of the orthographic projection of the pixel group on the plane where the polarizer is located is less than or equal to an area of the linear polarization region.
[0010] Optionally, among the plurality of linear polarization regions, at least some adjacent linear polarization regions are connected to or spaced apart from each other.
[0011] Optionally, two adjacent linear polarization regions have a first center distance in the first direction, two adjacent pixels have a second center distance in the first direction, the first center distance is N times the second center distance, N≥1, the pixel array is distributed in a matrix, and the first direction is the row or column direction of the pixel array.
[0012] Optionally, an area of an orthographic projection of the pixel group is smaller than an area of the linear polarization region, at least some adjacent linear polarization regions are connected to each other, and N>1.
[0013] Optionally, N≥2.
[0014] Optionally, N is an integer greater than 1.
[0015] Optionally, the plurality of pixel groups are distributed along the row direction and the column direction of the pixel array, and a second pixel is provided between two adjacent pixel groups.
[0016] Optionally, among the plurality of linear polarization regions, at least one linear polarization region forms a polarization unit.
[0017] Optionally, when the polarization unit includes at least two linear polarization zones, polarization directions of the at least two linear polarization zones are different.
[0018] Optionally, when the polarization unit includes at least two linear polarization zones, in the same polarization unit, an angle between polarization directions of any two linear polarization zones is greater than 10 degrees.
[0019] Optionally, the polarizer is integrated into the image sensor.
[0020] Optionally, a pixel includes a photosensitive unit and a unit circuit, the photosensitive units of a plurality of pixels are arrayed to form a photosensitive array, and the unit circuits of a plurality of pixels form a pixel circuit:
[0021] The pixel circuit is located between the photosensitive array and the polarizer;
[0022] The pixel circuit is located on the side of the photosensitive array facing away from the polarizer;
[0023] Alternatively, the pixel circuit is located on the side of the polarizer facing away from the photosensitive array.
[0024] Optionally, the polarizing plate is spaced apart from the receiving surface of the image sensor, or the polarizing plate is attached to the receiving surface of the image sensor.
[0025] Optionally, when the polarizer is attached to the receiving surface of the image sensor, the pixel includes a photosensitive unit and a microlens, an array of photosensitive units of multiple pixels is distributed to form a photosensitive array, an array of microlenses of multiple pixels is distributed to form a microlens array, the microlens array is located between the photosensitive array and the polarizer, and the polarizer is attached to the surface of the microlens array.
[0026] Another aspect of an embodiment of the present application provides a three-dimensional imaging device, including a polarized light source for emitting linearly polarized light and any of the above-mentioned image sensors, wherein the linearly polarized light emitted by the polarized light source is reflected by a target object to form light carrying polarization information.
[0027] Optionally, the image sensor comprises a polarizing plate having a plurality of linear polarization regions, and the polarization direction of the linear polarization light is the same as the polarization direction of at least one linear polarization region.
[0028] Optionally, the wavelength band of the linearly polarized light is 850nm±10nm or 940nm±10nm.
[0029] Optionally, a bandpass filter is provided on the receiving side of the pixel array of the image sensor, the bandpass band of the bandpass filter includes the light-emitting band of the polarized light source, and the half bandwidth of the bandpass filter is less than 80 nm.
[0030] In another aspect of the embodiments of the present application, a face recognition method is provided, which is applied to any of the above-mentioned image sensors or three-dimensional imaging devices, and the method includes:
[0031] A polarized image is obtained by light received by a first pixel in the pixel array, and a planar image is obtained by light received by at least a second pixel in the pixel array;
[0032] Face recognition is performed based on the polarization image and the plane image, and a face recognition result is obtained. The face recognition includes: face matching and / or anti-counterfeiting recognition.
[0033] Optionally, performing face recognition according to the polarization image and the plane image, and obtaining a face recognition result includes:
[0034] Performing face matching verification based on at least one of the polarization image and the plane image, and obtaining a face matching verification result;
[0035] And / or; performing anti-counterfeiting identification according to the polarization image and obtaining the anti-counterfeiting identification result.
[0036] In another aspect of the embodiments of the present application, a method for determining a pixel position is provided, the method comprising:
[0037] Obtaining code value signals outputted by each of the plurality of pixels in the pixel array, wherein a polarizer is provided on the receiving side of the pixel array, the polarizer having a plurality of linear polarization regions, and a test light having a preset polarization direction is incident on the pixel array after passing through the polarizer, and the preset polarization direction of the test light is the same as the polarization direction of some of the linear polarization regions;
[0038] A first pixel and a second pixel are selected from the pixel array according to a threshold value and code value signals outputted by each pixel, wherein an orthographic projection of the first pixel on the plane where the polarizer is located is located within the linear polarization region, and an orthographic projection of the second pixel on the plane where the polarizer is located intersects at most partially with any linear polarization region.
[0039] Optionally, at least some of the linear polarization regions have different polarization directions among the multiple linear polarization regions; and selecting the first pixel and the second pixel from the pixel array according to the threshold and the code value signals output by each pixel includes:
[0040] Selecting a portion of first pixels from the pixel array according to the threshold and the code value signals output by each pixel;
[0041] Another portion of first pixels and second pixels are selected from the pixel array according to position information of a portion of first pixels in the pixel array, arrangement information of a plurality of linear polarization regions, and size relationship between the linear polarization regions and the pixels.
[0042] According to another aspect of the embodiments of the present application, an electronic device is provided, including a device body and any one of the above-mentioned image sensors, wherein the image sensor is located in the device body;
[0043] Or, comprising a device body and any one of the above-mentioned three-dimensional imaging devices, wherein the three-dimensional imaging device is located in the device body.
[0044] The beneficial effects of this application include:
[0045] The present application provides an image sensor, a three-dimensional imaging device, an electronic device and a method, wherein the image sensor includes a pixel array, a polarizer is arranged on the receiving side of the pixel array, and the polarizer has multiple linear polarization regions; the pixel array includes multiple pixels distributed in the array, each pixel has an orthographic projection located on the plane where the polarizer is located, and the pixels whose orthographic projections are all located in the linear polarization region are the first pixels, and the pixels whose orthographic projections intersect at most part with any linear polarization region are the second pixels; the first pixel and the second pixel are used to receive light carrying polarization information, and the polarization information corresponds to the contour surface of the target object. In this way, by comprehensively utilizing the first pixel and the second pixel of the pixel array, two-dimensional and three-dimensional imaging of the target object is achieved, thereby obtaining more comprehensive information about the target object, which helps to improve the accuracy of recognition. BRIEF DESCRIPTION OF THE DRAWINGS
[0046] In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings required for use in the embodiments will be briefly introduced below. It should be understood that the following drawings only show certain embodiments of the present application and therefore should not be regarded as limiting the scope. For ordinary technicians in this field, other related drawings can be obtained based on these drawings without paying creative work.
[0047] Figure 1 One of the structural schematic diagrams of an image sensor provided in an embodiment of the present application;
[0048] Figure 2 One of the schematic diagrams of the corresponding relationship between a pixel array and a polarizer provided in an embodiment of the present application;
[0049] Figure 3 A second schematic diagram of the corresponding relationship between a pixel array and a polarizer provided in an embodiment of the present application;
[0050] Figure 4 A third schematic diagram of the corresponding relationship between a pixel array and a polarizer provided in an embodiment of the present application;
[0051] Figure 5 A schematic diagram of the structure of a polarizer provided in an embodiment of the present application;
[0052] Figure 6 A schematic diagram of the structure of a pixel array provided in an embodiment of the present application;
[0053] Figure 7 A fourth schematic diagram of the corresponding relationship between a pixel array and a polarizer provided in an embodiment of the present application;
[0054] Figure 8 A fifth schematic diagram of the corresponding relationship between a pixel array and a polarizer provided in an embodiment of the present application;
[0055] Fig. 9 A sixth schematic diagram of the corresponding relationship between a pixel array and a polarizer provided in an embodiment of the present application;
[0056] Fig.10 A seventh schematic diagram of the corresponding relationship between a pixel array and a polarizer provided in an embodiment of the present application;
[0057] Fig.11 An eighth schematic diagram of the corresponding relationship between a pixel array and a polarizer provided in an embodiment of the present application;
[0058] Fig.12 A ninth schematic diagram of the corresponding relationship between a pixel array and a polarizer provided in an embodiment of the present application;
[0059] Fig.13A second structural schematic diagram of an image sensor provided in an embodiment of the present application;
[0060] Fig.14 The third structural diagram of an image sensor provided in an embodiment of the present application;
[0061] Fig.15 A fourth structural diagram of an image sensor provided in an embodiment of the present application;
[0062] Fig.16 A schematic structural diagram of a three-dimensional imaging device provided in an embodiment of the present application.
[0063] Icon: 100-human face; 200-pixel array; 211-first pixel; 212-second pixel; 300-polarizer; 310-polarization unit; 311-linear polarization area; 400-polarized light source; 410-linear polarized light; 600-pixel circuit; 700-microlens array; 810-support frame; 820-adhesive layer. DETAILED DESCRIPTION
[0064] In order to make the purpose, technical solution and advantages of the embodiments of the present application clearer, the technical solution in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, not all of the embodiments. It should be noted that, in the absence of conflict, the various features in the embodiments of the present application can be combined with each other, and the combined embodiments are still within the scope of protection of the present application.
[0065] In the description of the present application, it should be noted that the terms "center", "upper", "lower", "left", "right", "vertical", "horizontal", "inner", "outer", etc. indicate positions or positional relationships based on the positions or positional relationships shown in the accompanying drawings, or the positions or positional relationships in which the product of the application is usually placed when in use. They are only for the convenience of describing the present application and simplifying the description, and do not indicate or imply that the device or element referred to must have a specific orientation, be constructed and operated in a specific orientation, and therefore cannot be understood as a limitation on the present application. In addition, the terms "second", "first", "secondary", etc. are only used to distinguish the description, and cannot be understood as indicating or implying relative importance.
[0066] In the description of this application, it should also be noted that, unless otherwise clearly specified and limited, the terms "set", "install", "connect", and "connect" should be understood in a broad sense, for example, it can be a fixed connection, a detachable connection, or an integral connection; it can be a mechanical connection or an electrical connection; it can be a direct connection, or it can be indirectly connected through an intermediate medium, or it can be the internal communication of two elements. For ordinary technicians in this field, the specific meanings of the above terms in this application can be understood according to specific circumstances.
[0067] In order to optimize the imaging effect and improve the recognition accuracy, an embodiment of the present application proposes an image sensor that can receive a light beam reflected by a target object. In the process of the image sensor receiving the light beam, a portion of the light beam is first modulated in different regions, and the light beam forms unmodulated light and multiple polarized lights (if all the regions in the light beam are modulated, multiple polarized lights are formed), and then the unmodulated light (if any) and the multiple polarized lights are received by multiple pixels in the pixel array, so that the contour surface of the target object can be reconstructed more accurately by the pixels receiving the light beam in a single polarization state, and the pixels receiving the unmodulated light and / or the mixed polarization state light can participate in the two-dimensional imaging of the target object, thereby improving the recognition speed and accuracy. For ease of understanding, the embodiments of the present application will be described below in conjunction with the accompanying drawings.
[0068] Please refer to Figure 1 , an image sensor is provided, including a pixel array 200, and a polarizer 300 is arranged on the receiving side of the pixel array 200. In this way, when receiving light reflected by a target object, the polarizer 300 is located in the light path between the target object and the pixel array 200, so that at least part of the light reflected by the target object can first pass through the polarizer 300, and then be received by the pixel array 200 for imaging.
[0069] In the process of light entering a target and being reflected by the target, since the degree of change in the polarization state of the light will be different at each point on the contour surface of the target (the points in the contour surface can be understood as the infinitesimal elements that constitute the contour surface), the light after being reflected by the target will carry the polarization information corresponding to the contour surface of the target. Therefore, sensing and obtaining this polarization information is the key to the subsequent reconstruction of the contour surface of the target.
[0070] In order to better obtain the polarization information and provide data support for reconstructing the contour surface of the target object, the image sensor needs to decode the light reflected by the target object, that is, modulate it in different regions, so as to comprehensively analyze the modulated light to obtain the polarization information. Figure 2As shown, the polarizer 300 has a plurality of linear polarization regions 311, so that the light can be modulated into a plurality of linear polarization lights by region after passing through the plurality of linear polarization regions 311. In coordination therewith, the pixel array 200 includes a plurality of pixels distributed in an array, and each pixel has an orthographic projection located in the plane where the polarizer 300 is located. In order to distinguish a plurality of pixels, the pixel whose orthographic projection is entirely located in the linear polarization region 311 can be taken as the first pixel 211, and the pixel whose orthographic projection intersects at least partially with any linear polarization region 311 can be taken as the second pixel 212 (the orthographic projection intersects at least partially with any linear polarization region 311 means that the orthographic projection of the second pixel 212 will not be completely located in any linear polarization region 311, for example, the orthographic projection of the second pixel 212 can intersect, border or not intersect with any linear polarization region 311, wherein intersecting means that the regions of the two partially overlap and do not completely overlap, and not intersecting means that there is no overlapping portion of the regions of the two, so as to distinguish the situation where the orthographic projection is located in the linear polarization region 311). In this way, a corresponding relationship between the first pixel 211 and the linear polarization area 311 is established, that is, the first pixel 211 corresponds to the linear polarization area 311 where its orthographic projection is located.
[0071] Based on the positional relationship between the orthographic projection of the first pixel 211 and the linear polarization region 311, the linear polarized light received by the first pixel 211 comes from the linear polarization region 311 corresponding thereto, so the polarization direction of the linear polarized light received by the first pixel 211 is consistent with the polarization direction of the linear polarization region 311 corresponding thereto, so the linear polarized light received by the first pixel 211 has a single polarization state, and the first pixel 211 outputs a corresponding code value, and then the code values output by each of the first pixels 211 are combined to obtain the polarization information carried by the light reflected by the target, and the degree to which its polarization state is changed by the target is obtained using the polarization information, and the normal vector of the microelement in the target corresponding to the light can be determined, and then combined with the position of each of the first pixels 211, the contour surface of the target can be reconstructed more accurately, so that the reconstructed contour surface is closer to the actual contour surface of the target, thereby utilizing the first pixel 211 to participate in three-dimensional imaging of the target.
[0072] Based on the positional relationship between the orthographic projection of the second pixel 212 and the linear polarization zone 311, the light received by the second pixel 212 is relatively complex. For example, the light received by the second pixel 212 may be in the following situations: if the orthographic projection of the second pixel 212 intersects with at least one linear polarization zone 311, the light received by the second pixel 212 may come from the linear polarization light of the linear polarization zone 311 intersecting therewith, especially when the orthographic projection of the second pixel 212 intersects with at least two linear polarization zones 311, the light received by the second pixel 212 may come from different linear polarization zones 311, and there may also be unmodulated light; if the orthographic projection of the second pixel 212 is connected to or does not intersect with the boundary of any linear polarization zone 311, the light received by the second pixel 212 is unmodulated light. Therefore, since the light received by the second pixel 212 is relatively complex and the situation may be changeable, there are certain difficulties in reconstructing the contour surface of the target object using the second pixel 212. However, since the light received by the second pixel 212 still comes from the reflected light of the target object, the second pixel 212 can be involved in the two-dimensional imaging of the target object. In this way, through the comprehensive use of the first pixel 211 and the second pixel 212 of the pixel array 200, two-dimensional and three-dimensional imaging of the target object can be achieved, thereby obtaining more comprehensive information about the target object, which helps to improve the recognition accuracy.
[0073] Of course, the first pixel 211 and the second pixel 212 may both participate in the two-dimensional imaging of the target object, thereby improving the resolution of the two-dimensional image and thus improving the recognition accuracy.
[0074] It should be understood that the target in this application can be Figure 1 The human face 100 and parts of the human face 100 (such as cheeks, nose, eyes) are of course not limited to these, and may also be other objects with three-dimensional dimensions, such as fingers, palms, etc.
[0075] In order to more clearly understand the relationship between the orthographic projections of the first pixel 211 and the second pixel 212 and the linear polarization area 311, the following will be described by way of example:
[0076] Please refer to Figure 2 , Figure 2, four linear polarization regions C1-C4 of the polarizer 300 are shown, and nine pixels A1-A4 and D1-D5 in the pixel array 200 are also shown. Each pixel has an orthographic projection located on the plane where the polarizer 300 is located, wherein the orthographic projection A1' of the pixel A1 is located in the linear polarization region C1, similarly, the orthographic projection of the pixel A2 is located in the linear polarization region C2, the orthographic projection of the pixel A3 is located in the linear polarization region C3, and the orthographic projection of the pixel A4 is located in the linear polarization region C4, so the pixels A1-A4 are all first pixels 211. The orthographic projection D3' of pixel D3 intersects with the linear polarization areas C1-C4 respectively, and the orthographic projection D5' of pixel D5 intersects with the linear polarization areas C2 and C4 respectively. Similarly, the orthographic projection of pixel D1 intersects with the linear polarization areas C1 and C3 respectively, the orthographic projection of pixel D2 intersects with the linear polarization areas C1 and C2 respectively, and the orthographic projection of pixel D4 intersects with the linear polarization areas C3 and C4 respectively. Therefore, pixels D1-D5 are all second pixels 212.
[0077] Please refer to Figure 3 The light reflected by the target object is divided into a plurality of beams according to the different incident linear polarization zones C1-C4. Taking polarization zones C1 and C3 as examples, the beam incident to linear polarization zone C1 is the first beam B1, and the beam incident to linear polarization zone C3 is the second beam B3. The first beam B1 is modulated by linear polarization zone C1 to form a first modulated beam, which includes a first sub-beam B11 and a second sub-beam B12. The second beam B3 is modulated by linear polarization zone C3 to form a second modulated beam, which includes a third sub-beam B31 and a fourth sub-beam B32. Since pixels A1 and A3 are both first pixels 211, pixel A1 only receives the first sub-beam B11, and pixel A3 only receives the first sub-beam B31. Since pixel D1 is the second pixel 212, and the positive projection of pixel D1 intersects with the linear polarization regions C1 and C3 respectively, pixel D1 may receive the second sub-beam B12 and the fourth sub-beam B32. When the polarization directions of the linear polarization regions C1 and C3 are different, the polarization states of the second sub-beam B12 and the fourth sub-beam B32 are different. The same is true for pixels A2 and A4, as well as D2-D5.
[0078] Please refer to Figure 4 , Figure 42 shows two linear polarization regions C1 and C2 of the polarizer 300, and also shows nine pixels A1-A4 and D1-D5 in the pixel array 200. Each pixel has an orthographic projection located on the plane where the polarizer 300 is located, wherein the orthographic projection A1' of the pixel A1 is located in the linear polarization region C1, and the orthographic projection A2' of the pixel A2 is also located in the linear polarization region C1. Similarly, the orthographic projections of the pixels A3 and A4 are both located in the linear polarization region C2, so the pixels A1-A4 are all first pixels 211. The orthographic projection D2' of pixel D2 intersects with the linear polarization regions C1 and C2 respectively. Similarly, the orthographic projection of pixel D1 intersects with the linear polarization regions C1 and C2 respectively. The orthographic projection D4' of pixel D4 intersects with the linear polarization regions C1 and C2 respectively. Meanwhile, the orthographic projection D4' of pixel D4 also has a portion that does not intersect with the linear polarization regions C1 and C2. Similarly, the orthographic projection of pixel D3 intersects with the linear polarization region C1. Meanwhile, the orthographic projection of pixel D3 also has a portion that does not intersect with the linear polarization region C1. The orthographic projection of pixel D5 intersects with the linear polarization region C2. Meanwhile, the orthographic projection of pixel D5 also has a portion that does not intersect with the linear polarization region C2. Therefore, pixels D1-D5 are all second pixels 212.
[0079] Of course, in other examples, the orthographic projections of the first pixel 211 and the second pixel 212 and the linear polarization zone 311 may also have a relationship not shown in the figure, as long as the conditions that the orthographic projection of the first pixel 211 is entirely located within the linear polarization zone 311 and the orthographic projection of the second pixel 212 at most partially intersects with any of the linear polarization zones 311 are met.
[0080] It can be seen from the above description that the orthographic projections of the first pixels 211 are all located in the linear polarization zone 311, but it should be understood that the number of first pixels 211 whose orthographic projections are located in the same linear polarization zone 311 can be flexible and changeable, such as at least one, and can be reasonably set according to the needs. For the convenience of description and understanding, all first pixels 211 whose orthographic projections are located in the same linear polarization zone 311 are divided into a group of pixel groups, and the area of the orthographic projection of each pixel group on the polarizer 300 is the sum of the areas of the orthographic projections of all first pixels 211 in the pixel group. For example Figure 2 As shown, the pixel A1 as the first pixel 211 forms a pixel group by itself, so Figure 2 Four pixel groups are shown in FIG. 1 , each of which has only one first pixel 211; Figure 4 As shown, the pixels A1 and A2 as the first pixels 211 together form a pixel group, and the pixels A3 and A4 as the first pixels 211 together form another pixel group. Figure 4 Two pixel groups are shown in FIG. 1 , each of which has only two first pixels 211 .
[0081] Therefore, the pixel array 200 may include a plurality of pixel groups, and the pixel groups correspond to the linear polarization regions 311 where their orthogonal projections are located, so that the plurality of pixel groups correspond one-to-one to the plurality of linear polarization regions 311. Therefore, the area of the orthogonal projection of the pixel group on the polarizer 300 should be less than or equal to the area of the linear polarization region 311 to which it corresponds.
[0082] In some possible embodiments, the plurality of linear polarization regions 311 in the polarizer 300 may be distributed in an array or non-array. Based on the correspondence between the pixel groups and the linear polarization regions 311, if the pixel groups in the pixel array 200 are distributed in an array, the linear polarization regions 311 may be distributed in a corresponding array, and vice versa.
[0083] In some possible implementations, the plurality of linear polarization regions 311 on the polarizer 300 may be connected or spaced apart, for example Figures 2 to 5 , Figures 7 to 9 or Fig.11 As shown, the boundaries of adjacent linear polarization zones 311 may be connected; for example Fig.10 or Fig.12 As shown, adjacent linear polarization regions 311 are spaced apart, and the spaced apart regions are non-linear polarization regions; of course, some linear polarization regions 311 may be connected, and some linear polarization regions 311 may be spaced apart. It should be understood that the linear polarization regions 311 in the present application are adjacent, which means that they are adjacent along the row and / or column direction of the pixel array 200.
[0084] In some possible implementations, the polarizer 300 includes a substrate (translucent) and a polarization layer located on the surface of the substrate, and the polarization layer includes a plurality of polarization sublayers laid flat on the surface of the substrate, and each polarization sublayer corresponds to forming one of the aforementioned linear polarization regions 311. The polarization sublayers may be metal wire grids, and the polarization direction in the linear polarization region 311 formed by the polarization sublayers may be determined by the metal wire grids, because the metal wire grids can transmit linear polarized light perpendicular to the direction of the metal wire grids. For example Figure 3 In the figure, the metal wire grid forming the linear polarization region C1 has an angle of 90 degrees with the horizontal direction, and the polarization direction of the linear polarization region C1 has an angle of 0 degrees with the horizontal direction, so the linear polarization region C1 can transmit the linear polarized light with an angle of 0 degrees with the horizontal direction.
[0085] In order to facilitate understanding of the area relationship between the linear polarization area 311 and the pixel, the center distance is introduced. Two adjacent linear polarization areas 311 have a first center distance in the first direction, and two adjacent pixels have a second center distance in the first direction. The pixel array 200 is distributed in a matrix, and the first direction is the row or column direction of the pixel array 200. For example Figure 5 and Figure 6As shown, the pixel array 200 is distributed in a matrix, and the multiple polarization areas are also distributed in a corresponding matrix. Two adjacent linear polarization areas 311 have a first center distance L1 in the row direction of the matrix, and two adjacent pixels also have a second center distance L2 in the row direction of the matrix, and the same is true for the column direction.
[0086] When the area of the orthographic projection of the pixel group on the plane where the polarizer 300 is located is less than or equal to the area of the linear polarization zone 311, the first center spacing is N times the second center spacing, N≥1, that is, the first center spacing is greater than or equal to the second center spacing. Of course, the value range of N can be changed according to the area relationship between the pixel group and the linear polarization zone 311 and whether the linear polarization zone 311 is connected. For ease of understanding, some examples are described below:
[0087] Example 1
[0088] When the area of the orthographic projection of the pixel group is smaller than the area of the linear polarization zone 311, and at least some adjacent linear polarization zones 311 are connected to each other, the two adjacent linear polarization zones 311 have a first center spacing in the first direction, and adjacent pixels have a second center spacing in the first direction, and the first center spacing and the second center spacing satisfy: the first center spacing is N times the second center spacing, and N>1.
[0089] Theoretically, when the polarizer 300 is disposed on the receiving side of the pixel array 200, the center of the orthographic projection of the pixel group on the plane where the polarizer 300 is located is preferably coincident with the center of the corresponding linear polarization area 311, that is, the center of the pixel group is aligned with the center of the corresponding linear polarization area 311, so that the center line of the pixel group and the corresponding linear polarization area 311 will be parallel to the vertical line of the plane where the polarizer 300 is located, but in actual settings, due to the limitation of alignment accuracy, there may be a certain alignment error. However, based on the aforementioned condition of N>1, a certain alignment error between the center of the pixel group and the center of the corresponding linear polarization area 311 can be allowed.
[0090] For example: Please refer to Figure 5 A polarizing plate 300 is shown in a top view, wherein the polarizing plate 300 includes 16 linear polarization regions 311, and the linear polarization regions 311 in the polarizing plate 300 are distributed in a matrix, and adjacent linear polarization regions 311 are connected to each other along a row or column direction of the matrix, and a first center distance between adjacent linear polarization regions 311 in a first direction is L1, and the first direction is a row or column direction of the pixel array 200.
[0091] Please refer to Figure 6A pixel array 200 is shown in a top-down perspective, wherein the pixel array 200 includes 49 pixels, and the pixels in the pixel array 200 are distributed in a matrix, and a second center distance between adjacent pixels in a first direction is L2, and the first direction is a row or column direction of the pixel array 200, wherein the pixel array 200 includes 16 first pixels 211 and 33 second pixels 212, and each first pixel 211 is a pixel group.
[0092] When the polarizer 300 is disposed on the receiving side of the pixel array 200, Figure 5 The polarizer 300 is placed in Figure 6 The pixel array 200 is located above the pixel group, and the area of the positive projection of the pixel group is smaller than the area of the linear polarization region 311, N=2.
[0093] Please refer to Figure 7 , the polarizer 300 is placed above the pixel array 200, and the 16 pixel groups correspond to the 16 linear polarization regions 311 one by one. If the center of the pixel group is just aligned with the center of the corresponding linear polarization region 311, then Figure 7 In the top view of FIG, the center of the pixel group (the first pixel 211) coincides with the center of the corresponding linear polarization area 311.
[0094] Please refer to Figure 8 , the polarizer 300 is placed above the pixel array 200, and the 16 pixel groups correspond to the 16 linear polarization areas 311. If the center of the pixel group is not aligned with the center of the corresponding linear polarization area 311, there is a certain alignment error, such as Figure 8 The center linear polarization area 311 is offset toward the upper left corner compared to the corresponding pixel group. Although there is a deviation between the center of the pixel group and the center of the corresponding linear polarization area 311, the orthographic projection of the pixel group can still be located within the corresponding linear polarization area 311, so that the image sensor can obtain the information of the target object more comprehensively and improve the recognition accuracy.
[0095] Therefore, by setting N>1, the alignment between the polarizer 300 and the pixel array 200 can be compatible with a certain alignment error, thereby reducing the alignment requirement and helping to reduce costs.
[0096] In some possible implementations of this example, N≥2, so that when the polarizer 300 is aligned with the pixel array 200, each linear polarization region 311 can correspond to a group of pixels as much as possible, for example Figure 8 In the example, N=2, the orthographic projections of the 16 pixel groups on the plane where the polarizer 300 is located are respectively located in the 16 linear polarization regions 311 in a one-to-one correspondence; Fig. 9, N=2.5, and each of the nine linear polarization regions 311 has a positive projection of a pixel group, the difference being that some pixel groups have only one first pixel 211 , some pixel groups have two first pixels 211 , and some pixel groups have four first pixels 211 .
[0097] In some possible implementations of this example, N is an integer greater than 1, so that when the polarizer 300 is aligned with the pixel array 200, the number of first pixels 211 in each linear polarization region 311 can be kept as consistent as possible, for example Figure 8 As shown, N=2, each linear polarization region 311 has only one first pixel 211, so that the first pixels 211 are distributed more evenly in the pixel array 200, so that the contour surface of the target object can be reconstructed more accurately. In addition, it should be understood that when N is an integer greater than 1, as N increases, the number of pixel groups in the same pixel array 200 gradually decreases, so if a higher resolution needs to be met, N can be made 2.
[0098] No matter N is an integer greater than 1 or N≥2, as long as the polarizer 300 is approximately located above the pixel array 200 , there must be a portion of the linear polarization region 311 corresponding to a pixel group.
[0099] In some possible implementations of this example, Figure 6 As shown, in order to facilitate the correspondence between the pixel groups and the linear polarization regions 311, multiple pixel groups can be distributed along the row and column directions of the pixel array 200, with a second pixel 212 between two adjacent pixel groups. More specifically, in the row and column directions of the pixel array 200, adjacent pixel groups are separated by the second pixel 212.
[0100] Example 2
[0101] When the area of the orthographic projection of the pixel group is smaller than the area of the linear polarization zone 311, and at least some adjacent linear polarization zones 311 are spaced apart from each other, two adjacently spaced linear polarization zones have a third center spacing in the first direction, and adjacent pixels have a second center spacing in the first direction, and the third center spacing is N times the second center spacing, where N>1.
[0102] Similarly, by the condition of N>1, a certain alignment error between the center of the pixel group and the center of the corresponding linear polarization area can be allowed. Fig.10As shown, a polarizer 300 and a pixel array 200 are shown in a top-down perspective, wherein the polarizer 300 is located above the pixel array 200, and there is a certain interval between any two linear polarization regions 311 in the polarizer 300, and when 1<N<2, 16 groups of pixels correspond to the 16 linear polarization regions 311 respectively, but the allowable alignment error is small.
[0103] Example 3
[0104] When the area of the orthographic projection of the pixel group is equal to the area of the linear polarization region, at least some of the adjacent linear polarization regions are connected to each other, the two connected linear polarization regions have a fourth center distance in the first direction, and the adjacent pixels have a second center distance in the first direction. The fourth center distance is N times the second center distance, N=1, and the first direction is the row or column direction of the pixel array 200.
[0105] When N=1, the center of the pixel group (the first pixel 211) should be aligned with the center of the corresponding linear polarization region. Fig.11 As shown, a polarizer 300 and a pixel array 200 are shown in a top-down perspective, wherein the polarizer 300 is located above the pixel array 200 , and 16 groups of pixels correspond to 16 linear polarization regions 311 , respectively.
[0106] Example 4
[0107] When the area of the orthographic projection of the pixel group is equal to the area of the linear polarization region, at least some of the adjacent linear polarization regions are spaced apart from each other, two adjacently spaced linear polarization regions have a fifth center spacing in the first direction, and adjacent pixels have a second center spacing in the first direction. The fifth center spacing is N times the second center spacing, where N is an integer greater than 1, and the first direction is the row or column direction of the pixel array 200.
[0108] The center of the pixel group (the first pixel 211) should be aligned exactly with the center of the corresponding linear polarization region. Fig.12 As shown, a polarizer 300 and a pixel array 200 are shown in a top-down perspective, wherein the polarizer 300 is located above the pixel array 200, and the pixel group includes only one first pixel 211, and the area of the first pixel 211 is equal to the area of the linear polarization region 311, so the 16 pixel groups correspond one-to-one to the 16 linear polarization regions 311 respectively.
[0109] When decoding the light reflected by the target object, multiple minimum decoding units can be constructed, and the light reflected by the target object can be decoded by the multiple minimum decoding units. Specifically, the minimum decoding unit may include at least one linear polarization area 311 and a pixel group corresponding to each polarization area. For ease of understanding, all linear polarization areas 311 in the minimum decoding unit are referred to as polarization units 310. When the polarization unit 310 includes at least two linear polarization areas 311, their polarization directions should be different. For example Figure 3 As shown, a minimum decoding unit is shown, which includes a polarization unit 310 and four pixel groups (first pixels A1-A4), the polarization unit 310 includes four linear polarization areas C1-C4 corresponding to the four first pixels A1-A4, and the polarization directions of the four linear polarization areas C1-C4 are different (such as Figure 3 The dotted line in the linear polarization region represents the polarization direction of the linear polarization region, and there is an angle between any two dotted lines or the extensions of the dotted lines); for example Figure 4 As shown, a minimum decoding unit is shown, the minimum decoding unit includes a polarization unit 310 and two pixel groups (a pixel group composed of first pixels A1 and A2 and a pixel group composed of first pixels A3 and A4), the polarization unit 310 includes two linear polarization areas C1-C2 corresponding to the two pixel groups, and the polarization directions of the two linear polarization areas C1 and C2 are different. Of course, the minimum decoding unit can also include a polarization unit 310 and a pixel group, and the polarization unit 310 only contains one linear polarization area 311, and the linear polarization area 311 corresponds to the pixel group.
[0110] by Figure 3 Take the minimum decoding unit in as an example: the angle between the polarization direction of the linear polarization zone C1 and the horizontal direction is 0 degrees, so the corresponding first pixel A1 can receive 0-degree linear polarized light, the angle between the polarization direction of the linear polarization zone C3 and the horizontal direction is 45 degrees, so the corresponding first pixel A3 can receive 45-degree linear polarized light, the angle between the polarization direction of the linear polarization zone C4 and the horizontal direction is 90 degrees, so the corresponding first pixel A4 can receive 90-degree linear polarized light, the angle between the polarization direction of the linear polarization zone C2 and the horizontal direction is 135 degrees, so the corresponding first pixel A2 can receive 135-degree linear polarized light.
[0111] when Figure 3 When the number of the minimum decoding units shown is multiple, the components Figure 7 or Figure 8The four minimum decoding units shown in the figure can decode the light beams respectively incident into the polarization unit 310, so as to respectively obtain the polarization information carried by them, and then determine the normal vectors of the four infinitesimal elements in the target object. When the number of minimum decoding units is large, the normal vectors of more infinitesimal elements in the target object can be determined, and then the contour surface of the target object can be reconstructed.
[0112] by Figure 3 Take the single minimum decoding unit shown as an example: a part of the light reflected by the target object will be incident on the polarization unit 310 of the minimum decoding unit, and then the part of the light will be incident on the four linear polarization areas C1-C4 in the polarization unit 310 respectively, so the light incident on each linear polarization area will be modulated by the respective linear polarization areas to form four linear polarized lights with different polarization directions, and then the four linear polarized lights are received one by one by four pixel groups (first pixels 211-A4), and then the polarization direction of each linear polarized light can be obtained based on the code values of the four pixel groups, and then the polarization information of the light incident on the minimum decoding unit can be obtained, thereby obtaining the normal vector of the corresponding microelement in the target object.
[0113] In some possible implementations, such as Figure 3 or Figure 5 As shown, in the same polarization unit 310, the angle between the polarization directions of any two linear polarization regions 311 is greater than 10 degrees. This makes it convenient for the image sensor to simultaneously receive linear polarized light of multiple polarization directions to obtain polarization information carried by the incident light.
[0114] In different implementations, the polarizer 300 may be integrated into the image sensor, so that the overall structure of the image sensor has a higher degree of integration; of course, the polarizer 300 may not be integrated into the image sensor. The following will explain each of them separately:
[0115] First, each pixel may include a photosensitive unit and a unit circuit, so the photosensitive unit arrays of all pixels in the pixel array are distributed to form a photosensitive array, and the unit circuits of all pixels in the pixel array are combined to form a pixel circuit. On this basis, the pixel may also include a microlens, so the microlens arrays of all pixels in the pixel array are distributed to form a microlens array.
[0116] In some possible implementations, the polarizer 300 may be integrated into an image sensor. Specifically, the polarizer 300 and the pixel array 200 are integrated and packaged together to form an image sensor. Fig.13As shown, the packaging level can be at least a sequentially stacked photosensitive array, a pixel circuit 600 (including a pixel light shielding layer), and a polarizer 300. For another example, the packaging level can also be at least a sequentially stacked pixel circuit 600, a photosensitive array, and a polarizer 300. Alternatively, the packaging level can also be at least a sequentially stacked photosensitive array, a polarizer 300, and a pixel circuit 600. In addition, as Fig.13 As shown, the microlens array 700 is stacked on the polarizer 300 .
[0117] In some possible implementations, the polarizer 300 may not be integrated into the image sensor. Specifically, the polarizer 300 is spaced apart from the receiving surface of the image sensor, for example. Fig.14 As shown, the light incident surface of the microlens array 700 serves as the receiving surface of the image sensor, the polarizer 300 is located above the microlens array 700, and the polarizer 300 is connected to the receiving surface of the image sensor via the support frame 810, and there is a gap between the polarizer 300 and the microlens array 700; in addition, the polarizer 300 is attached to the receiving surface of the image sensor, such as Fig.15 As shown, the polarizer 300 is attached to the upper surface of the microlens array 700 via the adhesive layer 820 .
[0118] Another aspect of the present application provides a three-dimensional imaging device, such as Fig.16 As shown, it includes a polarized light source 400 for emitting linear polarized light 410 and any of the above-mentioned image sensors. The linear polarized light 410 emitted by the polarized light source 400 is reflected by a target object to form a light beam carrying polarization information.
[0119] Please refer to Fig.16 The three-dimensional imaging device includes a polarized light source 400. The light reflected by the target comes from the polarized light source 400. The linearly polarized light 410 emitted by the polarized light source 400 propagates toward the target and is incident on the target, and is then reflected by the target to carry polarization information corresponding to the contour surface of the target, and then passes through the polarizer 300 and is received by the pixel array 200.
[0120] The polarized light source 400 may be a light emitting element that directly emits linearly polarized light 410 , or a light emitting element that emits natural light that is then modulated by a linear polarizer to form linearly polarized light 410 , and this application does not impose any limitation on this.
[0121] In some possible embodiments, the polarization direction of the linear polarized light 410 is the same as the polarization direction of at least one linear polarization region 311, for example, the polarization direction of the linear polarized light 410 is the same as the polarization direction of any linear polarization region 311 in the polarization unit 310. This allows more light to be incident on the pixel array 200, thereby providing more signal light for the pixel array 200, which helps to improve recognition accuracy.
[0122] In some possible implementations, the polarized light source 400 may be an infrared light source, and the wavelength band of the linearly polarized light 410 is 850nm±10nm or 940nm±10nm, such as 850nm, 940nm, etc.
[0123] In some possible implementations, a bandpass filter is provided on the receiving side of the pixel array 200 of the image sensor, and the bandpass wavelength of the bandpass filter includes the wavelength of light emitted by the polarized light source 400, which can weaken the perception of the human eye and effectively reduce the interference of ambient light. In order to further improve the utilization rate of light and reduce interference, the half bandwidth of the bandpass filter can be made less than 80nm.
[0124] In another aspect of the embodiments of the present application, a face recognition method is provided, the method comprising:
[0125] S10: Obtain a polarized image through light received by a first pixel in the pixel array, and obtain a planar image through at least light received by a second pixel in the pixel array.
[0126] Since the polarized lights received by the first pixel 211 all come from the same linear polarization region, the polarized lights received by the first pixel 211 are all lights of a single polarization direction. In this way, a polarized image can be generated by multiple first pixels 211, so the code value of the polarized image will include the polarization information carried by the incident light. Since the polarization information corresponds to the contour surface of the face 100, the corresponding contour surface of the face 100 can be represented by the polarized image.
[0127] Since the light received by the second pixel 212 is relatively complex and the situation may be changeable, there are certain difficulties in reconstructing the contour surface of the face 100 using the second pixel 212, but since the light received by the second pixel 212 still comes from the reflected light of the face 100, the second pixel 212 can participate in the two-dimensional imaging of the face 100, so that the plane image can contain the plane image information of the face 100. Of course, the first pixel 211 and the second pixel 212 can both participate in the two-dimensional imaging of the face 100, which can improve the resolution of the two-dimensional image.
[0128] By comprehensively utilizing the first pixel 211 and the second pixel 212 of the pixel array 200 , more comprehensive information of the face 100 can be obtained.
[0129] S20: Perform face recognition according to the polarization image and the plane image, and obtain a face recognition result. The face recognition includes: face matching and / or anti-counterfeiting recognition.
[0130] Because the polarization image can represent the corresponding facial contour surface, and the plane image can represent the plane image information of the face 100, the face recognition can be performed through the polarization image and the plane image, and then the face recognition result is obtained. When the face recognition includes the verification of face matching, according to the 2D and / or 3D matching requirements, it can be performed through the polarization image and the plane image, and the face recognition result will correspond to the result including whether the face 100 matches. Similarly, when the face recognition includes the verification of anti-counterfeiting identification, it needs to be performed with the help of the polarization image, and the face recognition result also corresponds to the result including whether it is a real face 100 or a forged product such as a photo, video, or silicone mold of the face 100.
[0131] Specifically, performing face recognition based on the polarization image and the plane image and obtaining the face recognition result includes: performing face matching verification based on at least one of the polarization image and the plane image and obtaining the face matching verification result; and / or; performing anti-counterfeiting identification based on the polarization image and obtaining the anti-counterfeiting identification result.
[0132] For example: when 2D face matching verification is required, it can be done with the help of a plane image; when 3D face matching verification is required, it can be done with the help of a polarized image and a plane image; when anti-counterfeiting identification is required, it can be done with the help of a polarized image.
[0133] When verifying face matching, the polarization image and the base library polarization image (obtained by pre-entering the correct face 100) can be input into the first neural network model to obtain the result of whether the face 100 matches.
[0134] When verifying face matching, the plane image and the base library plane image (obtained by pre-entering the correct face 100) can be input into the first neural network model to obtain the result of whether the face 100 matches.
[0135] When verifying face matching, the polarization image, the plane image, the base library polarization image, and the base library plane image (obtained by pre-entering the correct face 100) can be input into the first neural network model to obtain a result of whether the face 100 matches. Alternatively, when verifying face matching, the polarization image and the plane image can be fused to form a fused image, which is then input into the first neural network model with the base library fused image (formed by fusion of the base library polarization image and the base library plane image) to obtain a result of whether the face 100 matches.
[0136] When performing anti-counterfeiting identification verification, the polarized image can be input into the second neural network model to obtain an anti-counterfeiting result of whether it is a real face 100 or a forged object such as a photo, a video, a silicone mold of the face 100, etc.
[0137] In addition, when performing face recognition, the polarization information carried by the light reflected by the face 100 can be obtained by comprehensively analyzing the code value of the polarization image, and the degree to which its polarization state is changed by the face 100 can be obtained by using the polarization information. In combination with the microelement corresponding to the light in the face 100, the normal vector of the microelement can be determined. In combination with the position of each first pixel 211, the contour surface of the face 100 can be reconstructed more accurately, so that the reconstructed contour surface is closer to the actual contour surface of the face 100, so that the first pixel 211 is used to participate in the three-dimensional imaging of the face 100. Then, the face recognition result is finally obtained through the reconstructed contour surface of the face 100. Of course, this face recognition method can still include face matching verification and / or anti-counterfeiting recognition verification.
[0138] The above-mentioned face recognition method can be applied to any of the above-mentioned image sensors or three-dimensional imaging devices.
[0139] Based on the above description, it can be known that when the polarizer 300 is configured on the receiving side of the pixel array 200, the center of the orthographic projection of the pixel group on the plane where the polarizer 300 is located may coincide with the center of the corresponding linear polarization area or there may be a misalignment error. Therefore, after the relative positions of the polarizer 300 and the pixel array 200 are fixed, it is necessary to determine which pixels in the pixel array 200 are used as the first pixel 211 and which are used as the second pixel 212. Based on this, another aspect of the embodiment of the present application provides a method for determining pixel positions, the method comprising:
[0140] S30: Obtain code value signals output by each of the multiple pixels in the pixel array, wherein a polarizer is provided on the receiving side of the pixel array, the polarizer having multiple linear polarization regions, and a test light with a preset polarization direction is incident on the pixel array after passing through the polarizer, and the preset polarization direction of the test light is the same as the polarization direction of some of the linear polarization regions.
[0141] S40: Filter out a first pixel and a second pixel from the pixel array according to a threshold value and code value signals outputted by each pixel, wherein an orthographic projection of the first pixel on the plane where the polarizer is located is located within the linear polarization region, and an orthographic projection of the second pixel on the plane where the polarizer is located intersects at most partially with any linear polarization region.
[0142] The polarization areas on the polarizer 300 can be reasonably set according to needs, so the polarization directions of each polarization area on the polarizer 300 are known information. Therefore, the polarization direction of the test light can be preset so that the preset polarization direction of the test light is the same as the polarization direction of some linear polarization areas, which is convenient for subsequent judgment.
[0143] After the test light passes through the polarizer 300, it enters the pixel array 200. Therefore, the linear polarization area with the same polarization direction as the test light will transmit more test light, and the pixels in the pixel array 200 whose orthographic projection is completely located in the linear polarization area will receive more test light, so the code value signal output by such pixels will be very high. By setting a reasonable threshold, the pixels whose code value signals are higher than the threshold are screened out and used as the first pixel 211. Therefore, the orthographic projection of the first pixel 211 on the plane where the polarizer 300 is located is completely located in the linear polarization area. Since the position of the first pixel 211 is determined, the position of the second pixel 212 can be determined based on the position information of the first pixel 211 in the pixel array 200.
[0144] Especially when the polarization directions of all polarization regions in the polarizer 300 are the same, all the first pixels 211 can be screened out at one time through the above method, and the remaining pixels in the pixel array 200 are used as the second pixels 212 .
[0145] Optionally, when some of the linear polarization regions in the plurality of linear polarization regions have different polarization directions, selecting the first pixel and the second pixel from the pixel array according to the threshold and the code value signals output by each pixel includes:
[0146] S41: Selecting a portion of first pixels from the pixel array according to a threshold value and code value signals output by each pixel.
[0147] S42: selecting another portion of first pixels and second pixels from the pixel array according to position information of a portion of first pixels in the pixel array, arrangement information of a plurality of linear polarization regions, and a size relationship between the linear polarization regions and the pixels.
[0148] First, pixels whose code value signals are higher than the threshold are still screened out according to the threshold, and are used as part of the first pixels 211, and the position of the part of the first pixels 211 in the pixel array 200 is determined. Then, according to the first pixels 211 with known positions, combined with the arrangement and size information of multiple linear polarization regions, the position information of the remaining part of the first pixels 211 is determined, and then the position information of the second pixels 212 is finally obtained.
[0149] for example Figure 7 or Figure 8, four linear polarization regions constitute a polarization unit 310, and the polarization directions of the four linear polarization regions are different, for example, the angles between the polarization directions and the horizontal direction are 0 degrees, 45 degrees, 90 degrees and 135 degrees respectively. Then, the polarization unit 310 is arranged periodically, and the area of the linear polarization region is larger than the area of the pixel, N=2, so one of the four pixels in the field-shaped layout must belong to the first pixel 211. The preset polarization direction of the test light can be 0 degrees, so that the code value signal output by the pixel array 200 can be combined with the threshold to first determine the position information of the first pixel 211 in each polarization unit 310 for receiving 0-degree polarized light in the pixel array 200. Based on the position information of the first pixel 211 receiving 0-degree polarized light combined with the arrangement of the polarization directions of the four linear polarization regions in each polarization unit 310, such as 0 degrees, 45 degrees, 90 degrees and 135 degrees in the clockwise direction, the position information of the three first pixels 211 corresponding to the remaining three linear polarization regions in the polarization unit 310 can be determined. Thus, the position information of all the first pixels 211 in the pixel array 200 is obtained, and the remaining pixels serve as the second pixels 212 .
[0150] According to another aspect of the embodiments of the present application, an electronic device is provided, including a device body and any one of the above-mentioned image sensors, wherein the image sensor is located in the device body;
[0151] Or, comprising a device body and any one of the above-mentioned three-dimensional imaging devices, wherein the three-dimensional imaging device is located in the device body.
[0152] Electronic devices can perform two-dimensional and three-dimensional imaging of targets, thereby obtaining more comprehensive information about the targets and helping to improve recognition accuracy.
[0153] The electronic device can specifically be a mobile phone, a tablet computer, a television, a laptop computer, a smart home device (for example, a smart air conditioner, a smart refrigerator, a smart speaker, a smart light or a smart curtain, etc.), a wearable electronic device, a vehicle-mounted device (also referred to as a car computer), a virtual reality device, etc. The embodiments of the present application do not impose any restrictions on this.
[0154] The above description is only the preferred embodiment of the present application and is not intended to limit the present application. For those skilled in the art, the present application may have various modifications and variations. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present application shall be included in the protection scope of the present application.
Claims
1. An image sensor, characterized in that: It includes a pixel array, a polarizer is arranged on the receiving side of the pixel array, and the polarizer has a plurality of linear polarization regions; The pixel array includes a plurality of pixels distributed in an array, each of the pixels has an orthographic projection located on the plane where the polarizer is located, the pixels whose orthographic projections are all located in the linear polarization region are used as first pixels, and the pixels whose orthographic projections at most partially intersect with any of the linear polarization regions are used as second pixels; The first pixel and the second pixel are used to receive light carrying polarization information, and the polarization information corresponds to a contour surface of the target object.
2. The image sensor according to claim 1, wherein: The first pixels whose orthographic projections are all located in the same linear polarization region form a pixel group, and each pixel group includes at least one first pixel, and the area of the orthographic projection of the pixel group on the plane where the polarizer is located is less than or equal to the area of the linear polarization region.
3. The image sensor according to claim 2, wherein: Among the plurality of linear polarization regions, at least some of the adjacent linear polarization regions are connected to or spaced apart from each other.
4. The image sensor according to claim 3, wherein: Two adjacent linear polarization regions have a first center distance in a first direction, and two adjacent pixels have a second center distance in the first direction. The first center distance is N times the second center distance, N≥1, and the pixel array is distributed in a matrix, and the first direction is the row or column direction of the pixel array.
5. The image sensor according to claim 4, wherein: The area of the orthographic projection of the pixel group is smaller than the area of the linear polarization region, at least some of the adjacent linear polarization regions are connected to each other, and N>1.
6. The image sensor according to claim 5, characterized in that N≥2, or N is an integer greater than 1.
7. The image sensor according to any one of claims 2 to 6, characterized in that: The plurality of pixel groups are distributed along the row direction and the column direction of the pixel array, and the second pixel is located between two adjacent pixel groups.
8. The image sensor according to any one of claims 1 to 6, characterized in that: Among the plurality of linear polarization regions, at least one linear polarization region forms a polarization unit. When the polarization unit includes at least two linear polarization regions, polarization directions of at least two linear polarization regions are different.
9. The image sensor according to claim 8, wherein: When the polarization unit includes at least two linear polarization zones, in the same polarization unit, the included angle between polarization directions of any two linear polarization zones is greater than 10 degrees.
10. The image sensor according to any one of claims 1 to 6, characterized in that: The polarizer is integrated into the image sensor.
11. The image sensor according to claim 10, wherein: The pixel includes a photosensitive unit and a unit circuit. The photosensitive units of a plurality of pixels are arranged in an array to form a photosensitive array, and the unit circuits of a plurality of pixels form a pixel circuit. The pixel circuit is located between the photosensitive array and the polarizer; The pixel circuit is located on a side of the photosensitive array away from the polarizer; Alternatively, the pixel circuit is located on a side of the polarizer facing away from the photosensitive array.
12. The image sensor according to any one of claims 1 to 6, characterized in that: The polarizing plate is spaced apart from the receiving surface of the image sensor, or the polarizing plate is attached to the receiving surface of the image sensor.
13. The image sensor according to claim 12, wherein: When the polarizer is attached to the receiving surface of the image sensor, the pixel includes a photosensitive unit and a microlens, a plurality of photosensitive unit arrays of the pixels are distributed to form a photosensitive array, a plurality of microlens arrays of the pixels are distributed to form a microlens array, the microlens array is located between the photosensitive array and the polarizer, and the polarizer is attached to the surface of the microlens array.
14. A three-dimensional imaging device, characterized in that: It comprises a polarized light source for emitting linearly polarized light and an image sensor as claimed in any one of claims 1 to 13, wherein the linearly polarized light emitted by the polarized light source forms light carrying polarization information after being reflected by a target object.
15. The three-dimensional imaging device according to claim 14, characterized in that: The image sensor includes a polarizing plate having a plurality of linear polarization regions, and a polarization direction of the linear polarization light is the same as a polarization direction of at least one of the linear polarization regions.
16. The three-dimensional imaging device according to claim 14, characterized in that: The wavelength band of the linearly polarized light is 850nm±10nm or 940nm±10nm.
17. The three-dimensional imaging device according to claim 14, characterized in that: A bandpass filter is arranged on the receiving side of the pixel array of the image sensor, the bandpass band of the bandpass filter includes the light-emitting band of the polarized light source, and the half bandwidth of the bandpass filter is less than 80nm.
18. A face recognition method, characterized in that: Applied to the image sensor according to any one of claims 1 to 13, or the three-dimensional imaging device according to any one of claims 14 to 17, the method comprises: Obtaining a polarized image through light received by a first pixel in the pixel array, and obtaining a planar image through light received by at least a second pixel in the pixel array; Face recognition is performed according to the polarized image and the plane image, and a face recognition result is obtained, wherein the face recognition includes: face matching and / or anti-counterfeiting recognition.
19. The face recognition method according to claim 18, characterized in that: The performing face recognition according to the polarization image and the plane image and obtaining the face recognition result comprises: Performing face matching verification according to at least one of the polarization image and the plane image, and obtaining a face matching verification result; And / or; performing anti-counterfeiting identification according to the polarization image and obtaining an anti-counterfeiting identification result.
20. A method for determining a pixel position, characterized in that: The method comprises: Acquiring code value signals outputted by each of a plurality of pixels in a pixel array, wherein a polarizer is disposed on a receiving side of the pixel array, the polarizer having a plurality of linear polarization regions, and a test light having a preset polarization direction is incident on the pixel array after passing through the polarizer, and the preset polarization direction of the test light is the same as the polarization direction of some of the linear polarization regions; A first pixel and a second pixel are selected from the pixel array according to a threshold value and code value signals outputted by each pixel, wherein the orthographic projection of the first pixel on the plane where the polarizer is located is located within the linear polarization region, and the orthographic projection of the second pixel on the plane where the polarizer is located intersects at most partially with any of the linear polarization regions.
21. The pixel position determination method according to claim 20, characterized in that: Among the plurality of linear polarization regions, at least some of the linear polarization regions have different polarization directions; and selecting the first pixel and the second pixel from the pixel array according to the threshold and the code value signals output by each pixel includes: Screening out a portion of first pixels from the pixel array according to a threshold value and code value signals outputted by each of the pixels; Another portion of first pixels and second pixels are selected from the pixel array according to position information of the portion of first pixels in the pixel array, arrangement information of the plurality of linear polarization regions, and size relationship between the linear polarization regions and pixels.
22. An electronic device, characterized in that: A device comprising a device body and an image sensor according to any one of claims 1 to 13, wherein the image sensor is located in the device body; Or, comprising a device body and a three-dimensional imaging device as described in any one of claims 14 to 17, wherein the three-dimensional imaging device is located in the device body.
Citation Information
Cited By
Light source, image receiver, image acquisition apparatus, and electronic device
WO2026149200A1
