Image sensor and mobile terminal

Abstract

The present disclosure provides an image sensor and a mobile terminal, the image sensor including a pixel array including a predetermined number of pixel units arranged in a predetermined manner, the pixel units including a first pixel and a second pixel, the first pixel including a red subpixel, a green subpixel, and a blue subpixel, the second pixel including at least one of the red subpixel and the blue subpixel, the green subpixel, and a predetermined subpixel, the first pixel and the second pixel being full-pixel dual-core focus pixels, each including four full-pixel dual-core focus subpixels, the predetermined subpixel receiving light in an infrared light wavelength band and one of the red light wavelength band, the green light wavelength band, and the blue light wavelength band, or receiving light in the infrared light wavelength band, the red light wavelength band, the green light wavelength band, and the blue light wavelength band. [Selected figure] Figure 2a

Description

[Technical field]

[0001] (CROSS REFERENCE TO RELATED APPLICATIONS) This application claims priority to Chinese Patent Application No. 201810796852.4, filed on July 19, 2018, the entire contents of which are incorporated herein by reference. The present disclosure relates to the technical field of image processing, and in particular to image sensors and mobile terminals. [Background technology]

[0002] In the related art, intelligent electronic products have become necessities in people's lives, and the photographing function as an important component of electronic products has been gradually developed. However, with the promotion and popularization of the photographing function, people are not satisfied with only the photographing function of the camera in the current intelligent electronic products, and they want to further diversify the photographing effect, diversify the playing method, and diversify the functions.

[0003] In the market, the most commonly used pixel array arrangement of image sensors based on Complementary Metal Oxide Semiconductor (CMOS) is the Bayer pixel array arrangement pattern of red (R), green (G), and blue (B) as shown in Figures 1a and 1b. However, this arrangement method cannot detect the object distance and can only be used to receive natural light and record images under normal light illumination.

[0004] The pixel array arrangement pattern of the Full Pixel Dual Core Focus 2PD technology, as shown in Figures 1c and 1d, can only be used to receive natural light and capture and record images, but it can also detect the object distance and complete the focusing operation more quickly by using Phase Detection Auto Focus (PDAF) technology.

[0005] The principle of 2PD phase detection technology is as follows: As can be seen from Fig. 1c and Fig. 1d, some R, G and B sub-pixels in the pixel array are divided into two, and the energy of light obtained from different incident directions is different, so the left sub-pixel dot and the right sub-pixel dot form a phase detection pair, and when the brightness values ​​of the left sub-pixel dot and the right sub-pixel dot both reach the relative maximum peak, the image is relatively the clearest at this time, which is the focus, and then the object distance is calculated by an algorithm to achieve fast focusing.

[0006] As described above, the pixel array arrangement of the CMOS image sensor cannot detect the object distance and can only receive natural light, while the pixel array arrangement of the 2PD technology can detect the object distance but can only receive natural light. Therefore, the pixel array arrangement pattern of the image sensor in the related technology has problems such as limited shooting scenes and slow focusing, which affects the user's shooting experience. Summary of the Invention [Problem to be solved by the invention]

[0007] The embodiments of the present disclosure provide an image sensor and a mobile terminal to solve the problems that the pixel array arrangement pattern of the image sensor in the related art has limitations on the shooting scene and slow focusing, which affects the user's shooting experience. [Means for solving the problem]

[0008] In a first aspect, an image sensor according to an embodiment of the present disclosure includes: a pixel array including a predetermined number of pixel units arranged in a predetermined manner, the pixel units including a first pixel and a second pixel positionally adjacent to the first pixel, the first pixel including a red subpixel, a green subpixel, and a blue subpixel, the second pixel including at least one of the red subpixel and the blue subpixel, the green subpixel, and the predetermined subpixel; The first pixel and the second pixel are both full-pixel dual-core focus pixels, and each pixel includes four full-pixel dual-core focus sub-pixels; A given subpixel receives an infrared light wavelength band and one of a red light wavelength band, a green light wavelength band, and a blue light wavelength band, or receives an infrared light wavelength band, a red light wavelength band, a green light wavelength band, and a blue light wavelength band.

[0009] In a second aspect, a mobile terminal according to an embodiment of the present disclosure includes an imaging system, the imaging system comprising: The image sensor; A lens module; a driving module for driving the lens module to move; a filtering module disposed between the lens module and the image sensor; an image data processing module connected to the image sensor; a display module connected to the image data processing module. Effect of the Invention

[0010] According to the technical means disclosed in the present disclosure, the RGB pixel array arrangement method of the 2PD image sensor is improved, and the RGB pixel array arrangement method is improved into a pixel array arrangement method combining RGB and predetermined pixel dots, so that distance detection can be realized in the form of 2PD and fast focusing can be guaranteed; and by providing predetermined pixel dots that receive different light wavelength bands, the amount of incoming light can be increased, photoelectric conversion efficiency can be improved, and the shooting effect in dark places can be guaranteed, so as to meet the usage needs of users.

[0011] Hereinafter, the technical means in the embodiments of the present disclosure will be described clearly and completely with reference to the drawings in the embodiments of the present disclosure. Obviously, the described embodiments are only a part of the embodiments of the present disclosure, but not all of them. All other embodiments obtained based on the embodiments of the present disclosure without the creative labor of those skilled in the art are all within the scope of protection of the present disclosure. [Brief description of the drawings]

[0012] [Figure 1a] FIG. 1 is a schematic diagram showing an RGB arrangement in the related art. [Figure 1b] FIG. 2 is a cross-sectional view showing a pixel dot. [Figure 1c] FIG. 1 is a diagram showing a pixel array arrangement of a 2PD. [Figure 1d] FIG. 2 is a cross-sectional view showing a 2PD pixel dot. [Figure 2a] FIG. 1 is a schematic diagram illustrating a pixel unit according to an embodiment of the present disclosure. [Figure 2b] FIG. 2 is a schematic diagram illustrating a pixel unit according to an embodiment of the present disclosure. [Figure 2c] FIG. 3 is a schematic diagram illustrating a pixel unit according to an embodiment of the present disclosure. [Figure 3a] FIG. 4 is a schematic diagram illustrating a pixel unit according to an embodiment of the present disclosure. [Figure 3b] FIG. 5 is a schematic diagram illustrating a pixel unit according to an embodiment of the present disclosure. [Figure 4a] FIG. 6 is a schematic diagram illustrating a pixel unit according to an embodiment of the present disclosure. [Figure 4b] FIG. 7 is a schematic diagram illustrating a pixel unit according to an embodiment of the present disclosure. [Figure 5a] FIG. 8 is a schematic diagram illustrating a pixel unit according to an embodiment of the present disclosure. [Figure 5b] FIG. 9 is a schematic diagram illustrating a pixel unit according to an embodiment of the present disclosure. [Figure 6a]FIG. 10 is a schematic diagram illustrating a pixel unit according to an embodiment of the present disclosure. [Figure 6b] FIG. 11 is a schematic diagram illustrating a pixel unit according to an embodiment of the present disclosure. [Figure 7] 1 is a cross-section showing a pixel according to an embodiment of the present disclosure. [Figure 8] FIG. 2 is a schematic diagram illustrating a mobile terminal according to an embodiment of the present disclosure. [Figure 9] FIG. 1 is a schematic diagram illustrating an imaging system according to an embodiment of the present disclosure. [Figure 10] FIG. 2 is a schematic diagram showing the hardware configuration of a mobile terminal according to an embodiment of the present disclosure. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0013] Hereinafter, the technical means in the embodiments of the present disclosure will be described clearly and completely with reference to the drawings in the embodiments of the present disclosure. Obviously, the described embodiments are only a part of the embodiments of the present disclosure, but not all of them. All other embodiments obtained based on the embodiments of the present disclosure without the creative labor of those skilled in the art are all within the scope of protection of the present disclosure.

[0014] As shown in FIGS. 2a-2c, 3a-3b, and 4a-4b, an image sensor according to an embodiment of the present disclosure includes a pixel array including a predetermined number of pixel units arranged in a predetermined manner, the pixel array including a first pixel and a second pixel positionally adjacent to the first pixel, the first pixel including a red subpixel, a green subpixel, and a blue subpixel, the second pixel including at least one of the red subpixel and the blue subpixel, the green subpixel, and a predetermined subpixel, The first pixel and the second pixel are both full-pixel dual-core focus pixels, and each includes four full-pixel dual-core focus sub-pixels, and a certain sub-pixel receives an infrared light wavelength band and one of a red light wavelength band, a green light wavelength band and a blue light wavelength band, or receives an infrared light wavelength band, a red light wavelength band, a green light wavelength band and a blue light wavelength band.

[0015] The pixel array included in the image sensor according to the embodiment of the present disclosure includes a predetermined number of pixel units arranged in a predetermined manner, each of which includes a first pixel and a second pixel, the first pixel being different from the second pixel, the first pixel including a red subpixel (R), a green subpixel (G) and a blue subpixel (B), and the second pixel including at least one of the red subpixel and the blue subpixel, and further including a green subpixel and a predetermined subpixel element (D).

[0016] It should be noted that the first pixel and the second pixel in the embodiment of the present disclosure are both full-pixel dual-core focus (2PD) pixels, and the 2PD pixel is adopted to detect the object distance and to complete the focusing operation more quickly, where the first pixel and the second pixel are both 2PD pixels, that is, the sub-pixels in the first pixel and the second pixel are both 2PD sub-pixels, and each of the first pixel and the second pixel in the embodiment of the present disclosure includes four full-pixel dual-core focus sub-pixels.

[0017] In addition, the red subpixel, the green subpixel and the blue subpixel in the first pixel are arranged in a certain manner, and the first pixel includes one red subpixel, one blue subpixel and two green subpixels. For ease of distinction, the two green subpixels are referred to as the first green subpixel and the second green subpixel, respectively, and the first green subpixel and the second green subpixel are the same. The red subpixel is adjacent to the first green subpixel, the second green subpixel is located below the red subpixel, the blue subpixel is located below the first green subpixel and the second green subpixel is adjacent to the blue subpixel.

[0018] The second pixel is obtained by performing subpixel replacement on the basis of the first pixel, and the second pixel includes at least one of a red subpixel and a blue subpixel, and further includes a green subpixel and a predetermined subpixel. That is, the second pixel may include a red subpixel, a green subpixel, and the predetermined subpixel, in which case the blue subpixel in the first pixel may be replaced with the predetermined subpixel, and the second pixel may include a green subpixel, a blue subpixel, and the predetermined subpixel, or in which case the red subpixel in the first pixel may be replaced with the predetermined subpixel, and the second pixel may include a green subpixel, a red subpixel, a blue subpixel, and the predetermined subpixel.

[0019] The position of a given subpixel in the second pixel may be the same as the position of a certain subpixel in the first pixel, or the position in the first pixel may be the same as the positions of two different adjacent 1 / 2 subpixels. Of course, the position of the 1 / 2 given subpixel in the second pixel may be the same as the position of any one of the 1 / 2 subpixels in the first pixel. In this case, the 1 / 2 given subpixels in the two adjacent second pixels constitute a given subpixel. For example, the position of the 1 / 2 given subpixel in the second pixel is the same as the position of the 1 / 2 red subpixel in the first pixel, and the position of the 1 / 2 given subpixel in the second pixel is the same as the position of the 1 / 2 green subpixel in the first pixel, and the two second pixels can be combined to form a complete given subpixel.

[0020] A certain subpixel in the embodiment of the present disclosure can receive one of an infrared light wavelength band, a red light wavelength band, a green light wavelength band, and a blue light wavelength band, that is, a certain subpixel can receive an infrared light wavelength band and a red light wavelength band, or an infrared light wavelength band and a green light wavelength band, or an infrared light wavelength band and a blue light wavelength band. Alternatively, a certain subpixel can receive an infrared light wavelength band, a red light wavelength band, a green light wavelength band, and a blue light wavelength band. That is, a certain subpixel can receive an infrared light wavelength band and a red light wavelength band, a green light wavelength band, and a blue light wavelength band, and the specific manner in which a certain subpixel receives a light wavelength band can be set according to actual requirements.

[0021] According to the present disclosure, distance detection can be realized in the form of 2PD, and rapid focusing can be guaranteed. By setting specific pixel dots for receiving different light wavelength bands, the amount of incoming light can be increased, the photoelectric conversion efficiency can be improved, the shooting effect in dark places can be guaranteed, and the usage needs of users can be met.

[0022] In an embodiment of the present disclosure, as shown in FIG. 2a-FIG. 2c and FIG. 3a-FIG. 3b, the position of a certain subpixel in the second pixel is the same as the position of a red subpixel, a green subpixel, or a blue subpixel in the first pixel; or a location of a given subpixel in the second pixel is the same as a location of a first combined subpixel in the first pixel or is the same as a location of a second combined subpixel in the first pixel; The first combination subpixel is a combination of 1 / 2 the red subpixel and 1 / 2 the green subpixel that are adjacent in position, and the second combination subpixel is a combination of 1 / 2 the green subpixel and 1 / 2 the blue subpixel that are adjacent in position.

[0023] If the position of the given subpixel in the second pixel is the same as the position of the red subpixel in the first pixel, the second pixel includes one blue subpixel, two green subpixels and one given subpixel, in which case the red subpixel is replaced by the given subpixel based on the first pixel.

[0024] If the position of the given subpixel in the second pixel is the same as the position of the blue subpixel in the first pixel, the second pixel includes one red subpixel, two green subpixels and one given subpixel, in which case the blue subpixel is replaced by the given subpixel based on the first pixel.

[0025] If the position of the given subpixel in the second pixel is the same as the position of one green subpixel in the first pixel, the second pixel includes one red subpixel, one green subpixel, one blue subpixel and one given subpixel, in which case, based on the first pixel, one green subpixel is replaced by the given subpixel.

[0026] When the position of a given subpixel in the second pixel is the same as the position of the first combined subpixel in the first pixel, the second pixel includes a red subpixel, a green subpixel, a blue subpixel and a given subpixel, in which case, 1 / 2 the red subpixel and 1 / 2 the green subpixel adjacent to the position in the 2PD subpixel based on the first pixel can be the given subpixel, i.e., the position of the given subpixel in the second pixel is the same as the position of 1 / 2 the green subpixel and 1 / 2 the red subpixel adjacent to the position in the first pixel.

[0027] When the position of a given subpixel in the second pixel is the same as the position of the second combined subpixel in the first pixel, the second pixel includes a red subpixel, a green subpixel, a blue subpixel and a given subpixel, and in this case, the given subpixel can be 1 / 2 of the blue subpixel and 1 / 2 of the green subpixel whose positions are adjacent to each other in the 2PD subpixel based on the first pixel, i.e., the position of the given subpixel in the second pixel is the same as the position of 1 / 2 of the green subpixel and 1 / 2 of the blue subpixel whose positions are adjacent to each other in the first pixel.

[0028] Based on the above embodiment, a pixel unit includes one second pixel and at least one first pixel.

[0029] The pixel unit includes one second pixel and at least one first pixel, and the number of pixels in the pixel unit is at least 2. When the number of pixels in the pixel unit is 2, the pixel unit includes one first pixel and one second pixel. For example, as shown in FIG. 5a, the pixel unit includes one first pixel and one second pixel, and the second pixel includes a red subpixel, a green subpixel, and a given subpixel, and the proportion of the given subpixel in the pixel unit is 1 / 8.

[0030] When the number of pixels in a pixel unit is 3, the pixel unit includes two first pixels and one second pixel. For example, as shown in FIG. 5b, when the pixel unit includes two first pixels and one second pixel, and the second pixel includes a blue subpixel, a green subpixel, and a given subpixel, the proportion of the given subpixel in the pixel unit is 1 / 12.

[0031] When the number of pixels in a pixel unit is four, the pixel unit includes three first pixels and one second pixel. For example, as shown in FIG. 3a, the pixel unit includes three first pixels and one second pixel, and the second pixel includes a blue subpixel, a green subpixel, a red subpixel, and a predetermined subpixel, and based on the first pixel, 1 / 2 the red subpixel and 1 / 2 the green subpixel of the 2PD subpixel can be the predetermined subpixel, and the proportion of the predetermined subpixel in the pixel unit is 1 / 16.

[0032] The pixel array may be configured by periodically arranging 1 / 8 density RGB+D pixel units, 1 / 12 density RGB+D pixel units, or 1 / 16 density RGB+D pixel units as one pixel unit array. Of course, the pixel array may be in other forms, and the enumeration will be omitted here.

[0033] The above corresponding collocation methods of some predetermined sub-pixels are only for illustrative purposes, and other collocation methods may be used, and other collocation methods according to the embodiments of the present disclosure will not be described one by one here. The collocation position (position of the second pixel) of the predetermined sub-pixel in the pixel unit is not limited to the embodiments of the present disclosure. The proportion of the predetermined sub-pixel in the pixel unit is 1 / 4n, where n is an integer equal to or greater than 2, and the size of the pixel array applied to the predetermined sub-pixel does not matter.

[0034] As shown in Figures 4a and 4b, the position of 1 / 2 of the predetermined subpixels in the second pixel is the same as the position of 1 / 2 of the red subpixels, 1 / 2 of the green subpixels or 1 / 2 of the blue subpixels in the first pixel, and 1 / 2 of the predetermined subpixels in two adjacent second pixels constitute the predetermined subpixel.

[0035] The second pixel may include only 1 / 2 of the predetermined subpixel, and two adjacent second pixels may combine to obtain one complete predetermined subpixel. When the second pixel includes 1 / 2 of the predetermined subpixel, the position of the 1 / 2 predetermined subpixel in the second pixel may be the same as the position of the 1 / 2 red subpixel in the first pixel, may be the same as the position of the 1 / 2 green subpixel in the first pixel, or may be the same as the position of the 1 / 2 blue subpixel in the first pixel.

[0036] If the position of 1 / 2 a given subpixel in one second pixel is the same as the position of 1 / 2 a red subpixel in the first pixel, then the position of 1 / 2 a given subpixel in another second pixel is the same as the position of 1 / 2 a green subpixel in the first pixel. If the position of 1 / 2 a given subpixel in one second pixel is the same as the position of 1 / 2 a green subpixel in the first pixel, then the position of 1 / 2 a given subpixel in another second pixel is the same as the position of 1 / 2 a blue subpixel or 1 / 2 a red subpixel in the first pixel.

[0037] Based on the above embodiment, in a pixel unit, the number of second pixels is two, and the number of first pixels is zero or more.

[0038] When the number of pixels in the pixel unit is at least two, the pixel unit includes two second pixels and a first pixel whose number is equal to or greater than zero. When the number of pixels in the pixel unit is two, the pixel unit includes two second pixels. For example, as shown in FIG. 6a, the pixel unit includes two second pixels, one second pixel includes one red subpixel, two green subpixels, 1 / 2 blue subpixels, and 1 / 2 predetermined subpixels, in which the position of the 1 / 2 predetermined subpixels in the second pixel is the same as the position of the 1 / 2 blue subpixels in the first pixel, and another second pixel includes one red subpixel, one green subpixel, one blue subpixel, 1 / 2 green subpixels, and 1 / 2 predetermined subpixels, in which the position of the 1 / 2 predetermined subpixels is the same as the position of the 1 / 2 green subpixels in the first pixel. The proportion of the predetermined subpixels in the pixel unit is 1 / 8.

[0039] When the number of pixels in the pixel unit is three, it includes two second pixels and one first pixel. As shown in FIG. 6b, when the pixel unit includes two second pixels and one first pixel, the one second pixel includes one red subpixel, one green subpixel, one blue subpixel, 1 / 2 green subpixel, and 1 / 2 predetermined subpixel, in which case the position of the 1 / 2 predetermined subpixel in the second pixel may be the same as the position of the 1 / 2 green subpixel in the first pixel, and another second pixel includes two green subpixels, one blue subpixel, 1 / 2 red subpixel, and 1 / 2 predetermined subpixel, in which case the position of the 1 / 2 predetermined subpixel is the same as the position of the 1 / 2 red subpixel in the first pixel. The proportion of the predetermined subpixel in the pixel unit is 1 / 12.

[0040] When the number of pixels in the pixel unit is four, two second pixels and two first pixels are included. For example, as shown in FIG. 4b, when the pixel unit includes two second pixels and two first pixels, one second pixel includes one red subpixel, one green subpixel, one blue subpixel, 1 / 2 green subpixel, and 1 / 2 predetermined subpixel, in which the position of the 1 / 2 predetermined subpixel in the one second pixel is the same as the position of the 1 / 2 green subpixel in the first pixel, and another second pixel includes one blue subpixel, two green subpixels, 1 / 2 red subpixel, and 1 / 2 predetermined subpixel, in which the position of the 1 / 2 predetermined subpixel is the same as the position of the 1 / 2 red subpixel in the first pixel. The ratio of the predetermined subpixel in the pixel unit is 1 / 16.

[0041] The above are only some corresponding embodiments, and further modifications are possible, which are not described here. The selection density of a given subpixel in a pixel unit is 1 / 4n, where n is an integer equal to or greater than 2, and the size of the pixel array applied to the given subpixel does not matter.

[0042] In an embodiment of the present disclosure, a certain subpixel receives a blue light wavelength band and an infrared light wavelength band, and includes a semiconductor layer, a metal layer, a photodiode, a first color filter including a blue filter and an infrared filter, and a micromirror, which are stacked in sequence.

[0043] The semiconductor layer, metal layer, photodiode, first color filter, and micromirror included in a certain subpixel are arranged in order from the bottom, and the semiconductor layer may be, but is not limited to, a silicon substrate. The first color filter is a filter unit array and includes a blue filter and an infrared filter. In this case, the certain subpixel can receive light in a blue light wavelength band and an infrared light wavelength band.

[0044] In an embodiment of the present disclosure, a given subpixel receives a green light wavelength band and an infrared light wavelength band, and includes a semiconductor layer, a metal layer, a photodiode, a second color filter including a green filter and an infrared filter, and a micromirror, which are stacked in sequence.

[0045] The second color filter is a filter unit array, and includes a green filter and an infrared filter, whereby a given sub-pixel can receive a green light wavelength band and an infrared light wavelength band.

[0046] In an embodiment of the present disclosure, a certain subpixel receives a red light wavelength band and an infrared light wavelength band, and includes a semiconductor layer, a metal layer, a photodiode, a third color filter including a red filter and an infrared filter, and a micromirror, which are stacked in sequence.

[0047] The third color filter is a filter unit array, and includes a red filter and an infrared filter, whereby a given sub-pixel can receive a red light wavelength band and an infrared light wavelength band.

[0048] In an embodiment of the present disclosure, a certain subpixel receives a red light wavelength band, a green light wavelength band, a blue light wavelength band, and an infrared light wavelength band, and includes a semiconductor layer, a metal layer, a photodiode, a fourth color filter including a red filter, a green filter, a blue filter, and an infrared filter, which are stacked in order, and a micromirror.

[0049] The fourth color filter is a filter unit array, including a red filter, a green filter, a blue filter and an infrared filter, in which a certain subpixel can receive a red light wavelength band, a green light wavelength band, a blue light wavelength band and an infrared light wavelength band.

[0050] For the same light illumination, the wider the wavelength bandwidth that can pass through a single channel, the more brightness the image sensor can acquire, thus improving the imaging effect in dark places.

[0051] In an embodiment of the present disclosure, the red subpixel includes a semiconductor layer, a metal layer, a photodiode, a red filter, and a micromirror, which are stacked in that order; the green subpixel includes a semiconductor layer, a metal layer, a photodiode, a green filter, and a micromirror, which are stacked in that order; and the blue subpixel includes a semiconductor layer, a metal layer, a photodiode, a blue filter, and a micromirror, which are stacked in that order.

[0052] The semiconductor layer, metal layer, photodiode, red filter, and micromirror included in the red subpixel are arranged in sequence from the bottom. The semiconductor layer, metal layer, photodiode, green filter, and micromirror included in the corresponding green subpixel are arranged in sequence from the bottom. The semiconductor layer, metal layer, photodiode, blue filter, and micromirror included in the blue subpixel are arranged in sequence from the bottom. The semiconductor layer here may be, but is not limited to, a silicon substrate. For the structure of the red subpixel and a specific subpixel, refer to FIG. 7. The D filter in FIG. 7 may be a first color filter, a second color filter, a third color filter, and a fourth color filter, and the red filter may be replaced with a green filter or a blue filter to obtain the structure of the green subpixel or the blue subpixel.

[0053] The red subpixel, green subpixel and blue subpixel obtain the color information of the pixel of the composite image and block the incidence of infrared rays, for example, by only allowing visible light with a wavelength of 380 to 700 nm to enter, a full-color realistic image can be directly generated under high illuminance. The infrared wavelength is 750 to 1100 nm, and a certain subpixel can receive the infrared band, further improving the imaging effect in dark places and realizing the infrared distance measurement function. In an embodiment of the present disclosure, the image sensor is a complementary metal oxide semiconductor CMOS image sensor, a charge coupled device CCD image sensor, or a quantum thin film image sensor.

[0054] The pixel array arrangement method according to the present disclosure is not limited to the type of image sensor to which it is applied, and may be a CMOS image sensor, a charge-coupled device (CCD) image sensor, a quantum thin film image sensor, or other types of image sensors. In addition, the image sensor according to the embodiment of the present disclosure may be applied to any electronic product including a camera module.

[0055] In this way, by improving the RGB pixel array arrangement method of the 2PD image sensor, the RGB pixel array arrangement method is improved to a pixel array arrangement method combining RGB and predetermined pixel dots, so that distance detection can be realized in the form of 2PD and fast focusing can be guaranteed; and by providing predetermined pixel dots for receiving different light wavelength bands, the amount of incoming light can be increased, photoelectric conversion efficiency can be improved, and the shooting effect in dark places can be guaranteed, so as to meet the usage needs of users.

[0056] The embodiment of the present disclosure further provides a mobile terminal. As shown in Figures 8 and 9, the mobile terminal 1 includes an imaging system 2, and the imaging system 2 includes the above-mentioned image sensor 21. The mobile terminal 1 further includes a lens module 22, a driving module 23 for driving the lens module 22 to move, a filtering module 24 disposed between the lens module 22 and the image sensor 21, an image data processing module 25 connected to the image sensor 21, and a display module 26 connected to the image data processing module 25.

[0057] A mobile terminal 1 according to an embodiment of the present disclosure includes an imaging system 2, which includes the above-mentioned image sensor 21, and further includes a lens module 22 for concentrating light rays, and the lens module 22 is connected to a driving module 23, which adjusts the position of the lens module 22 according to the perspective of the subject to be photographed.

[0058] A filter module 24 is installed between the lens module 22 and the image sensor 21, and the light is collected by the lens module 22 and passes through the filtering module 24, and then collected on the pixel array of the image sensor 21. The image sensor 21 is connected to an image data processing module 25, which is connected to a display module 26. After the light is collected on the pixel array of the image sensor 21, the image sensor 21 performs photoelectric conversion and then transfers the data to the image data processing module 25, which processes the data and displays it on the display module 26 as an image.

[0059] After the driving module 23 adjusts the position of the lens module 22, the phase difference is obtained using 2PD pixels in the image sensor 21, thereby obtaining the distance between the object and the imaging plane, thereby achieving rapid focusing.

[0060] The filtering module 24 according to the embodiment of the present invention can pass light wavelengths of 380 nm to 1100 nm. At this time, the light is collected by the lens module 22 and then filtered by the filtering module 24, which can pass natural light and infrared light and ensure the imaging effect of the imaging system 2.

[0061] In this way, by improving the RGB pixel array arrangement method of the 2PD image sensor, the RGB pixel array arrangement method is improved to a pixel array arrangement method combining RGB and predetermined pixel dots, so that distance detection can be realized in the form of 2PD and fast focusing can be guaranteed; and by providing predetermined pixel dots for receiving different light wavelength bands, the amount of incoming light can be increased, photoelectric conversion efficiency can be improved, and the shooting effect in dark places can be guaranteed, so as to meet the usage needs of users.

[0062] FIG. 10 is a schematic hardware configuration diagram of a mobile terminal for implementing each embodiment of the present disclosure, where the mobile terminal 1000 includes components such as, but not limited to, a radio frequency unit 1001, a network module 1002, an audio output unit 1003, an input unit 1004, a sensor 1005, a display unit 1006, a user input unit 1007, an interface unit 1008, a memory 1009, a processor 1010, and a power supply 1011.

[0063] The mobile terminal 1000 further includes an imaging system including an image sensor, a lens module, a driving module for driving the lens module to move, a filtering module installed between the lens module and the image sensor, an image data processing module connected to the image sensor, and a display module connected to the image data processing module.

[0064] The filtering module allows light wavelengths between 380nm and 1100nm to pass through.

[0065] The image sensor includes a pixel array including a predetermined number of pixel units arranged in a predetermined manner, the pixel units including a first pixel and a second pixel positionally adjacent to the first pixel, the first pixel including a red subpixel, a green subpixel, and a blue subpixel, the second pixel including at least one of the red subpixel and the blue subpixel, the green subpixel, and the predetermined subpixel; The first pixel and the second pixel are both full-pixel dual-core focus pixels, and each pixel includes four full-pixel dual-core focus sub-pixels; A given subpixel receives an infrared light wavelength band and one of a red light wavelength band, a green light wavelength band, and a blue light wavelength band, or receives an infrared light wavelength band, a red light wavelength band, a green light wavelength band, and a blue light wavelength band.

[0066] the location of the given subpixel in the second pixel is the same as the location of a red subpixel, a green subpixel, or a blue subpixel in the first pixel; or a location of a given subpixel in the second pixel is the same as a location of a first combined subpixel in the first pixel or is the same as a location of a second combined subpixel in the first pixel; The first combination subpixel is a combination of 1 / 2 the red subpixel and 1 / 2 the green subpixel that are adjacent in position, and the second combination subpixel is a combination of 1 / 2 the green subpixel and 1 / 2 the blue subpixel that are adjacent in position.

[0067] The pixel unit includes one second pixel and at least one first pixel.

[0068] The position of 1 / 2 a given subpixel in the second pixel is the same as the position of 1 / 2 a red subpixel, 1 / 2 a green subpixel, or 1 / 2 a blue subpixel in the first pixel, and 1 / 2 a given subpixel in two adjacent second pixels constitutes the given subpixel.

[0069] In pixel units, the number of second pixels is two and the number of first pixels is zero or more.

[0070] A given subpixel receives a blue light wavelength band and an infrared light wavelength band; A given subpixel includes a semiconductor layer, a metal layer, a photodiode, a first color filter including a blue filter and an infrared filter, and a micromirror, which are stacked in this order.

[0071] A given subpixel receives a green light wavelength band and an infrared light wavelength band; A given subpixel includes a semiconductor layer, a metal layer, a photodiode, a second color filter consisting of a green filter and an infrared filter, and a micromirror, which are stacked in this order.

[0072] A given subpixel receives a red light wavelength band and an infrared light wavelength band; A given subpixel includes a semiconductor layer, a metal layer, a photodiode, a third color filter including a red filter and an infrared filter, and a micromirror, which are stacked in this order.

[0073] A given subpixel receives a red light wavelength band, a green light wavelength band, a blue light wavelength band, and an infrared light wavelength band; A given subpixel includes a semiconductor layer, a metal layer, a photodiode, a fourth color filter including a red filter, a green filter, a blue filter, and an infrared filter, which are stacked in order, and a micromirror.

[0074] The red subpixel includes a semiconductor layer, a metal layer, a photodiode, a red filter and a micromirror, which are stacked in that order; the green subpixel includes a semiconductor layer, a metal layer, a photodiode, a green filter and a micromirror, which are stacked in that order; and the blue subpixel includes a semiconductor layer, a metal layer, a photodiode, a blue filter and a micromirror, which are stacked in that order.

[0075] The image sensor may be a complementary metal oxide semiconductor CMOS image sensor, a charge coupled device CCD image sensor, or a quantum thin film image sensor.

[0076] The above-mentioned mobile terminal improves the RGB pixel array arrangement method of the 2PD image sensor, and improves the RGB pixel array arrangement method into a pixel array arrangement method combining RGB and predetermined pixel dots, thereby realizing distance detection in the form of 2PD and ensuring rapid focusing; and by installing predetermined pixel dots for receiving different light wavelength bands, the amount of incoming light can be increased, photoelectric conversion efficiency can be improved, and the shooting effect in dark places can be guaranteed, so as to meet the usage needs of users.

[0077] As will be appreciated by those skilled in the art, the structure of the mobile terminal shown in Figure 10 is not intended to limit the terminal, and the mobile terminal may include more or fewer components than those shown, may combine certain components, or have different component arrangements. In embodiments of the present invention, mobile terminals include, but are not limited to, mobile phones, tablet computers, laptops, palmtop computers, in-vehicle terminals, wearable devices, pedometers, and the like.

[0078] It should be understood that in the embodiment of the present disclosure, the radio frequency unit 1001 may be used to transmit and receive signals during transmission and reception of information or during a call, specifically, to receive downlink data from a base station, and then have the processor 1010 process the data, and transmit uplink data to the base station. In general, the radio frequency unit 1001 includes, but is not limited to, an antenna, at least one amplifier, a transceiver, a coupler, a low noise amplifier, a duplexer, etc. The radio frequency unit 1001 may also communicate with a network and other devices through a wireless communication system.

[0079] The mobile terminal provides users with wireless broadband Internet access through the network module 1002, helping users, for example, send and receive e-mail, browse web pages, and access streaming media.

[0080] The audio output unit 1003 can convert audio data received by the radio frequency unit 1001 or the network module 1002 or stored in the memory 1009 into an audio signal and output it as a voice. The audio output unit 1003 can also provide audio output (such as a ring tone, a message tone, etc.) related to a specific function executed by the mobile terminal 1000. The audio output unit 1003 includes a speaker, a buzzer, a handset, etc.

[0081] The input unit 1004 inputs an audio or video signal. The input unit 1004 may include a graphics processing unit (GPU) 10041 and a microphone 10042, where the graphics processing unit 10041 processes image data of still images or videos captured by a photographing device (e.g., a camera) in a video shooting mode or a photographing mode. The processed image frames can be displayed on the display unit 1006, where the display unit is the above-mentioned display module. The image frames processed by the graphics processing unit 10041 may be stored in the memory 1009 (or other storage medium) or transmitted by the radio frequency unit 1001 or the network module 1002. The graphics processing unit 10041 is the above-mentioned image data processing module. The microphone 10042 can receive voice and process such voice into audio data. The processed audio data can be converted into a format output that can be transmitted to a mobile communication base station by the radio frequency unit 1001 in a telephone call mode and output.

[0082] The mobile terminal 1000 further includes at least one type of sensor 1005, such as a light sensor, a motion sensor, and other sensors. Specifically, the light sensor includes an ambient light sensor that can adjust the brightness of the display panel 10061 according to the brightness of the ambient light, and a proximity sensor that can turn off the display panel 10061 and / or the backlight when the mobile terminal 1000 is moved to the ear. As a type of motion sensor, an acceleration sensor can detect the magnitude of acceleration in each direction (generally three axes) and can detect the magnitude and direction of gravity when stationary, and may be used for identifying the terminal attitude (e.g., switching between landscape and portrait screens, correlation games, magnetometer attitude calibration), functions related to vibration identification (e.g., pedometer, tapping), etc., and the sensor 1005 may further include a fingerprint sensor, a pressure sensor, an iris sensor, a molecular sensor, a gyroscope, a barometer, a hygrometer, a thermometer, an infrared sensor, etc., and the description thereof will be omitted here.

[0083] The display unit 1006 displays information input by a user or information provided to a user. The display unit 1006 may include a display panel 10061, and the display panel 10061 may be arranged in the form of a liquid crystal display (LCD), an organic light-emitting diode (OLED), or the like.

[0084] The user input unit 1007 can input input numeric or character information, or generate input key signals related to user settings and function control of the mobile terminal. Specifically, the user input unit 1007 includes a touch panel 10071 and other input devices 10072. The touch panel 10071 is also called a touch screen, and can collect a user's touch operation on or near it (e.g., a user's operation on or near the touch panel 10071 with any suitable object or accessory, such as a finger, a stylus pen, etc.). The touch panel 10071 may include two parts: a touch detection device and a touch controller. The touch detection device detects the user's touch direction, detects a signal due to the touch operation, and transmits the signal to the touch controller, and the touch controller receives touch information from the touch detection device, converts it into touch point coordinates, and transmits it to the processor 1010, and receives and executes instructions transmitted from the processor 1010. In addition, the touch panel 10071 can be realized in a number of types, such as a resistive type, a capacitive type, an infrared type, and a surface acoustic wave type. In addition to the touch panel 10071, the user input unit 1007 may further include other input devices 10072. Specifically, the other input devices 10072 include, but are not limited to, a physical keyboard, function keys (such as a volume control key switch key), a trackball, a mouse, and an operating lever, and the description thereof will be omitted here.

[0085] Furthermore, the touch panel 10071 may cover the display panel 10061, and when the touch panel 10071 detects a touch operation on or near it, it transmits it to the processor 1010 to determine the type of the touch event, and then the processor 1010 provides a corresponding visual output to the display panel 10061 according to the type of the touch event. In FIG. 10, the touch panel 10071 and the display panel 10061 are two independent components to realize the input / output function of the mobile terminal, but in some embodiments, the touch panel 10071 and the display panel 10061 may be integrated to realize the input / output function of the mobile terminal, which is not specifically limited herein.

[0086] The interface unit 1008 is an interface that connects an external device to the mobile terminal 1000. For example, the external device may include a wired or wireless headphone port, an external power (or battery charger) port, a wired or wireless data port, a memory card port, a port for connecting to a device having an identification module, an audio input / output (I / O) port, a video I / O port, an earphone port, etc. The interface unit 1008 can receive inputs (e.g., data information, power, etc.) from the external device and transmit the received inputs to one or more elements in the mobile terminal 1000, or transmit data between the mobile terminal 1000 and the external device.

[0087] The memory 1009 can store software programs and various data. The memory 1009 may mainly include a program storage area for storing an operating system, application programs necessary for at least one function (e.g., audio playback function, image playback function, etc.), and a data storage area for storing data created in accordance with the use of the mobile phone (e.g., audio data, phone book, etc.). The memory 1009 may also include a high-speed random access memory, and may include at least one magnetic disk memory element, a non-volatile memory such as a flash memory element, or other volatile solid-state memory element.

[0088] The processor 1010 is a control center of the mobile terminal, and is connected to each part of the entire mobile terminal through various interfaces and lines, and monitors the entire mobile terminal by operating or executing software programs and / or modules stored in the memory 1009, calling up data stored in the memory 1009, executing various functions of the mobile terminal, and processing data. The processor 1010 may include one or more processing units, and preferably, the processor 1010 may integrate an application processor that mainly processes an operation system, a user interface, and application programs, and a modem processor that mainly processes wireless communication. It should be understood that the modem processor may not be integrated into the processor 1010.

[0089] The mobile terminal 1000 may include a power source 1011 (e.g., a battery) to power each component, and preferably, the power source 1011 is logically connected to the processor 1010 via a power management system so that the power management system can realize functions such as charging, discharging, and power consumption management.

[0090] The mobile terminal 1000 also includes several functional modules not shown, but their description will be omitted here.

[0091] It should be noted that, in this specification, the terms "comprise", "comprises" or any variation thereof are intended to cover non-exclusive inclusions, such that a process, method, article, or apparatus that includes a set of elements not only includes those elements, but also includes other elements not expressly illustrated, or further includes elements inherent in the process, method, article, or apparatus. Unless more limited, an element qualified by the phrase "including a..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes the element.

[0092] From the above description of the embodiments, it can be clearly understood by those skilled in the art that the methods of the above embodiments can be realized by a method using both software and a necessary general-purpose hardware platform, and of course, they can also be realized by hardware, but in many cases the former is a more preferred embodiment. Based on this understanding, the technical means of the present disclosure may be embodied in the form of a software product, the essential part or the part that contributes to the prior art, and the computer software product may include some instructions stored in a storage medium (e.g., a read-only memory (ROM) / random access memory (RAM), a magnetic disk, an optical disk) and cause a terminal (which may be a mobile phone, a computer, a server, an air conditioner, or a network device, etc.) to execute the method described in each embodiment of the present disclosure.

[0093] Although the examples of the present disclosure have been described above with reference to the drawings, the present disclosure is not limited to the above specific embodiments, which are not restrictive but merely illustrative. A person skilled in the art can achieve many more forms without departing from the spirit of the present disclosure and the scope of the claims, based on the suggestions of the present disclosure, all of which fall within the scope of protection of the present disclosure.

Claims

1. A pixel array including a predetermined number of pixel units arranged in a predetermined manner, the pixel units including at least one first pixel and one second pixel positionally adjacent to the first pixel, or in the pixel unit, the number of the second pixels is two and the number of the first pixels is zero or more; the first pixel includes one red subpixel, one blue subpixel, and two green subpixels; the second pixel is obtained by replacing one red subpixel, one green subpixel, or one blue subpixel in the first pixel with one predetermined subpixel based on the first pixel, or the second pixel is obtained by replacing one half of the red subpixels, one half of the green subpixels, or one half of the blue subpixels in the first pixel with one half of the predetermined subpixel based on the first pixel, the second pixel includes at least one of a red subpixel and a blue subpixel, a green subpixel, and a predetermined subpixel; The first pixel is a full-pixel dual-core focus pixel and includes four full-pixel dual-core focus sub-pixels; The image sensor, wherein the given subpixel receives an infrared light wavelength band and one of a red light wavelength band, a green light wavelength band, and a blue light wavelength band.

2. A pixel array including a predetermined number of pixel units arranged in a predetermined manner, the pixel units including at least one first pixel and one second pixel positionally adjacent to the first pixel, or in the pixel unit, the number of the second pixels is two and the number of the first pixels is zero or greater; the first pixel includes one red subpixel, one blue subpixel, and two green subpixels; the second pixel is obtained by replacing one red subpixel, one green subpixel, or one blue subpixel in the first pixel with one predetermined subpixel based on the first pixel, or the second pixel is obtained by replacing one half of the red subpixels, one half of the green subpixels, or one half of the blue subpixels in the first pixel with one half of the predetermined subpixel based on the first pixel, the second pixel includes at least one of a red subpixel and a blue subpixel, a green subpixel, and a predetermined subpixel; The first pixel is a full-pixel dual-core focus pixel and includes four full-pixel dual-core focus sub-pixels; a position of the given subpixel in the second pixel is the same as a position of the red subpixel, the green subpixel, or the blue subpixel in the first pixel; Or, a position of the given subpixel in the second pixel is the same as a position of a first combination subpixel in the first pixel, the first combination subpixel being a combination of ½ red subpixels and ½ green subpixels that are adjacent in position, in which the given subpixel is capable of receiving at least an infrared light wavelength band, a red light wavelength band, and a green light wavelength band; Or, An image sensor, wherein a position of the given subpixel in the second pixel is the same as a position of a second combination subpixel in the first pixel, the second combination subpixel being a combination of 1 / 2 a green subpixel and 1 / 2 a blue subpixel that are adjacent in position, and in this case, the given subpixel is capable of receiving at least an infrared light wavelength band, a green light wavelength band, and a blue light wavelength band.

3. A pixel array including a predetermined number of pixel units arranged in a predetermined manner, the pixel units including at least one first pixel and one second pixel positionally adjacent to the first pixel, or in the pixel unit, the number of the second pixels is two and the number of the first pixels is zero or greater; the first pixel includes one red subpixel, one blue subpixel, and two green subpixels; the second pixel is obtained by replacing one red subpixel, one green subpixel, or one blue subpixel in the first pixel with one predetermined subpixel based on the first pixel, or the second pixel is obtained by replacing one half of the red subpixels, one half of the green subpixels, or one half of the blue subpixels in the first pixel with one half of the predetermined subpixel based on the first pixel, the second pixel includes at least one of a red subpixel and a blue subpixel, a green subpixel, and a predetermined subpixel; The first pixel is a full-pixel dual-core focus pixel and includes four full-pixel dual-core focus sub-pixels; a position of a half of a predetermined subpixel in one of the two adjacent second pixels is the same as a position of a half of a blue subpixel in the first pixel, and a position of a half of a predetermined subpixel in the other of the two adjacent second pixels is the same as a position of a half of a green subpixel in the first pixel, and the half of the predetermined subpixels in the two adjacent second pixels constitute the predetermined subpixel, and in this case, the predetermined subpixel is capable of receiving at least an infrared light wavelength band, a blue light wavelength band, and a green light wavelength band; Or, an image sensor in which a position of a predetermined 1 / 2 subpixel in one of the two adjacent second pixels is the same as a position of a green subpixel in the first pixel, and a position of a predetermined 1 / 2 subpixel in the other of the two adjacent second pixels is the same as a position of a red subpixel in the first pixel, and the predetermined 1 / 2 subpixels in the two adjacent second pixels constitute the predetermined subpixel, and in this case, the predetermined subpixel is capable of receiving at least an infrared light wavelength band, a green light wavelength band, and a red light wavelength band.

4. The red subpixel includes a semiconductor layer, a metal layer, a photodiode, a red filter, and a micromirror, which are stacked in order. the green subpixel includes a semiconductor layer, a metal layer, a photodiode, a green filter, and a micromirror, which are stacked in order; 4. The image sensor according to claim 1, wherein the blue subpixel comprises a semiconductor layer, a metal layer, a photodiode, a blue filter and a micromirror, which are stacked in this order.

5. 4. The image sensor according to claim 1, wherein the image sensor is a complementary metal oxide semiconductor CMOS image sensor, a charge coupled device CCD image sensor, or a quantum thin film image sensor.

6. 1. A mobile terminal including an imaging system, the imaging system comprising: An image sensor according to any one of claims 1 to 5; A lens module; a driving module for driving the lens module to move; a filtering module disposed between the lens module and the image sensor; an image data processing module connected to the image sensor; a display module connected to the image data processing module.

7. The mobile terminal of claim 6, wherein the filtering module is capable of passing optical wavelengths between 380 nm and 1100 nm.

Images