Image sensor, control method, imaging device, terminal and readable storage medium

Abstract

The present application discloses an image sensor, a control method, an imaging device, a terminal and a computer-readable storage medium. The image includes a pixel array and a lens array, and the pixel array includes color pixels, full-color pixels, at least one color phase detection pixel pair, and at least one full-color phase detection pixel pair. The full-color phase detection pixel pair includes two adjacent full-color pixels, and the phase information of the full-color pixels in the full-color phase detection pixel pair is used for focus detection. The color phase detection pixel pair includes two adjacent color pixels of the same color, and the phase information of the color pixels in the color phase detection pixel pair is used for focus detection. The lens array includes multiple first lenses, each full-color phase detection pixel pair is covered by the same first lens, and each color phase detection pixel pair is covered by the same first lens. The present application can achieve accurate focus in scenes with different ambient brightness by setting full-color phase detection pixel pairs and color phase detection pixel pairs.

Description

Technical Field

[0001] The present application relates to the field of imaging technology, and in particular to an image sensor, a control method, an imaging device, a terminal and a computer-readable storage medium. Background Art

[0002] With the development of electronic technology, terminals with camera functions have become popular in people's lives. At present, the focusing methods used in mobile phone photography mainly include contrast focus and phase focus. Contrast focus is more accurate, but the speed is too slow. Phase focus is fast, but the phase focus on the market is realized on color sensors, and the focusing performance is not good enough in dark environments. Summary of the invention

[0003] Embodiments of the present application provide an image sensor, a control method, an imaging device, a terminal, and a computer-readable storage medium.

[0004] The embodiment of the present application provides an image sensor. The image includes a pixel array and a lens array, and the pixel array includes a plurality of color pixels, a plurality of full-color pixels, at least one color phase detection pixel pair, and at least one full-color phase detection pixel pair. The full-color phase detection pixel pair includes two adjacent full-color pixels, and the phase information of the full-color pixels in the full-color phase detection pixel pair is used for focus detection. The color phase detection pixel pair includes two adjacent color pixels of the same color, and the color pixels have a narrower spectral response than the full-color pixels, and the phase information of the color pixels in the color phase detection pixel pair is used for focus detection. The lens array includes a plurality of first lenses, each of the full-color phase detection pixel pairs is covered by the same first lens, and each of the color phase detection pixel pairs is covered by the same first lens.

[0005] The embodiment of the present application provides a control method. The control method is used for an image sensor. The image sensor includes a pixel array and a lens array, the pixel array includes a plurality of color pixels, a plurality of panchromatic pixels, at least one color phase detection pixel pair, and at least one panchromatic phase detection pixel pair. The panchromatic phase detection pixel pair includes two adjacent panchromatic pixels. The color phase detection pixel pair includes two adjacent color pixels of the same color, and the color pixels have a narrower spectral response than the panchromatic pixels; the lens array includes a plurality of first lenses, each of the panchromatic phase detection pixel pairs is covered by the same first lens, and each of the color phase detection pixel pairs is covered by the same first lens. The control method includes: when the ambient brightness is less than a first threshold, focusing detection is performed according to the phase information of the panchromatic pixels in the panchromatic phase detection pixel pair to focus; and when the ambient brightness is greater than a second threshold, focusing detection is performed according to the phase information of the color pixels in the color phase detection pixel pair to focus, and the second threshold is greater than the first threshold.

[0006] The embodiment of the present application provides an imaging device. The imaging device includes a lens and an image sensor. The image sensor is capable of receiving light passing through the lens. The image includes a pixel array and a lens array, the pixel array includes a plurality of color pixels, a plurality of panchromatic pixels, at least one color phase detection pixel pair, and at least one panchromatic phase detection pixel pair. The panchromatic phase detection pixel pair includes two adjacent panchromatic pixels, and the phase information of the panchromatic pixels in the panchromatic phase detection pixel pair is used for focus detection. The color phase detection pixel pair includes two adjacent color pixels of the same color, the color pixels have a narrower spectral response than the panchromatic pixels, and the phase information of the color pixels in the color phase detection pixel pair is used for focus detection. The lens array includes a plurality of first lenses, each of the panchromatic phase detection pixel pairs is covered by the same first lens, and each of the color phase detection pixel pairs is covered by the same first lens.

[0007] The embodiment of the present application provides a terminal. The terminal includes a housing and an imaging device. The imaging device is combined with the housing. The imaging device includes a lens and an image sensor. The image sensor is capable of receiving light passing through the lens. The image includes a pixel array and a lens array, the pixel array includes a plurality of color pixels, a plurality of panchromatic pixels, at least one color phase detection pixel pair, and at least one panchromatic phase detection pixel pair. The panchromatic phase detection pixel pair includes two adjacent panchromatic pixels, and the phase information of the panchromatic pixels in the panchromatic phase detection pixel pair is used for focus detection. The color phase detection pixel pair includes two adjacent color pixels of the same color, the color pixels have a narrower spectral response than the panchromatic pixels, and the phase information of the color pixels in the color phase detection pixel pair is used for focus detection. The lens array includes a plurality of first lenses, each of the panchromatic phase detection pixel pairs is covered by the same first lens, and each of the color phase detection pixel pairs is covered by the same first lens.

[0008] The embodiment of the present application provides a non-volatile computer-readable storage medium containing a computer program. When the computer program is executed by a processor, the processor executes a control method. The control method is used for an image sensor. The image sensor includes a pixel array and a lens array, the pixel array includes a plurality of color pixels, a plurality of panchromatic pixels, at least one color phase detection pixel pair, and at least one panchromatic phase detection pixel pair. The panchromatic phase detection pixel pair includes two adjacent panchromatic pixels. The color phase detection pixel pair includes two adjacent color pixels of the same color, and the color pixels have a narrower spectral response than the panchromatic pixels; the lens array includes a plurality of first lenses, each of the panchromatic phase detection pixel pairs is covered by the same first lens, and each of the color phase detection pixel pairs is covered by the same first lens. The control method includes: when the ambient brightness is less than a first threshold, focusing detection is performed according to the phase information of the panchromatic pixels in the panchromatic phase detection pixel pair to focus; and when the ambient brightness is greater than a second threshold, focusing detection is performed according to the phase information of the color pixels in the color phase detection pixel pair to focus, and the second threshold is greater than the first threshold.

[0009] The image sensor, control method, imaging device, terminal and computer-readable storage medium of the embodiments of the present application, by setting color phase detection pixel pairs and full-color phase detection pixel pairs in the image sensor, and performing focus detection based on the phase information of the full-color pixels in the full-color phase detection pixel pairs and / or the phase information of the color pixels in the color pixel phase detection pixel pairs, can achieve accurate focus in scenes with different ambient brightness, especially in dark light environments, so as to improve the scene adaptability of the image sensor.

[0010] Additional aspects and advantages of the embodiments of the present application will be given in part in the description below, and in part will become apparent from the description below, or will be learned through the practice of the present application. BRIEF DESCRIPTION OF THE DRAWINGS

[0011] The above and / or additional aspects and advantages of the present application will become apparent and easily understood from the description of the embodiments in conjunction with the following drawings, in which:

[0012] Figure 1 is a schematic diagram of an image sensor according to some embodiments of the present application;

[0013] Figure 2 is a schematic diagram of a pixel circuit of some embodiments of the present application;

[0014] Figure 3 It is a schematic diagram of the exposure saturation time of different color channels;

[0015] Figures 4 to 13 is a schematic diagram of the pixel arrangement and lens coverage of the minimum repeating unit of certain embodiments of the present application;

[0016] Figures 14 to 19 is a partial cross-sectional schematic diagram of an image sensor according to certain embodiments of the present application;

[0017] Fig. 20 is a flow chart of a control method of certain embodiments of the present application;

[0018] Fig.21 is a schematic structural diagram of an imaging device according to some embodiments of the present application;

[0019] Figure 22 to Figure 25 is a flow chart of a control method of certain embodiments of the present application;

[0020] Fig.26 is a schematic diagram of a mobile terminal according to some embodiments of the present application;

[0021] Fig. 27 The diagram is a schematic diagram of the interaction between a non-volatile computer-readable storage medium and a processor in certain embodiments of the present application. DETAILED DESCRIPTION

[0022] The embodiments of the present application are described in detail below, and examples of the embodiments are shown in the accompanying drawings, wherein the same or similar reference numerals represent the same or similar elements or elements having the same or similar functions from beginning to end. The embodiments described below with reference to the accompanying drawings are exemplary and are only used to explain the embodiments of the present application, and cannot be understood as limiting the embodiments of the present application.

[0023] See also Figure 1 and Figure 4 , an embodiment of the present application provides an image sensor 10. The image sensor 10 includes a pixel array 11 and a lens array 16. The pixel array 11 includes a plurality of color pixels, a plurality of panchromatic pixels W, at least one color phase detection pixel pair 17, and at least one panchromatic phase detection pixel pair 18. The panchromatic phase detection pixel pair 18 includes two adjacent panchromatic pixels W, and the phase information of the panchromatic pixels W in the panchromatic phase detection pixel pair 18 is used for focus detection. The color phase detection pixel pair 17 includes two adjacent color pixels of the same color, and the color pixels have a narrower spectral response than the panchromatic pixels W. The phase information of the color pixels in the color phase detection pixel pair 17 is used for focus detection. The lens array 16 includes a plurality of first lenses 161, each panchromatic phase detection pixel pair 18 is covered by the same first lens 16, and each color phase detection pixel pair 18 is covered by the same first lens 16.

[0024] The image sensor 10 in the embodiment of the present application is provided with a color phase detection pixel pair 17 and a full-color phase detection pixel pair 18, and performs focus detection according to the phase information of the full-color pixel W in the full-color phase detection pixel pair 18 and / or the phase information of the color pixel in the color pixel phase detection pixel pair 17. It can achieve accurate focus in scenes with different ambient brightness, especially in dark light environments, so as to improve the scene adaptability of the image sensor 10.

[0025] Next, the basic structure of the image sensor 10 is introduced. Figure 1 , Figure 1 1 is a schematic diagram of the structure of the image sensor 10 in the embodiment of the present application. The image sensor 10 includes a pixel array 11 and a lens array 16. Along the light receiving direction of the image sensor 10, the lens array 16 and the pixel array 11 are arranged in sequence.

[0026] The image sensor 10 may be a complementary metal oxide semiconductor (CMOS) photosensitive element or a charge-coupled device (CCD) photosensitive element.

[0027] The pixel array 11 includes a plurality of pixels 1101 arranged two-dimensionally in an array form, and each pixel 1101 includes a photoelectric conversion element 117 ( Figure 2 or Fig.14 ) and filter 118 ( Fig.14Each pixel 1101 converts light into electric charge according to the intensity of light incident thereon, and the filter 118 is used to pass light of certain wavelengths and filter out light of other wavelengths. The pixel array 11 includes color pixels and full-color pixels W, and the color pixels have a narrower spectral response than the full-color pixels. Figure 4 The pixel array 11 includes at least one color phase detection pixel pair 17 and at least one full-color phase detection pixel pair. The color phase detection pair 17 includes two adjacent color pixels of the same color, and the full-color phase detection pixel pair 18 includes two adjacent full-color pixels W.

[0028] The lens array 16 includes a plurality of first lenses 161 and a plurality of second lenses 162, and the area that can be covered by the second lenses 162 is smaller than the area that can be covered by the first lenses 161. For example, each full-color phase detection pixel pair 18 is covered by the same first lens 161 (e.g. Fig.16 or Fig.19 As shown), each color phase detection pixel pair 17 is covered by the same first lens 161 (as shown Fig.15 or Fig.18 As shown). Since two adjacent pixels 1101 share the same first lens 161, focus detection can be performed based on the phase information obtained by the two pixels 1101 to focus. That is, the phase information of the full-color pixel W in the full-color phase detection pixel pair 18 is used for focus detection, and the phase information of the color pixel in the color phase detection pixel pair 17 is used for focus detection. In addition, in the pixel array 11, except for the pixels 1101 in the color phase detection pixel pair 17 and the full-color phase detection pixel pair 18, each pixel 1101 is covered by a second lens 162, so that the light incident on the image sensor 10 can be converged to the pixel 1101 below the second lens 162 through the second lens 162.

[0029] Figure 2 1 is a schematic diagram of a pixel circuit 110 in an embodiment of the present application. Figure 1 and Figure 2 The operating principle of the pixel circuit 110 is described.

[0030] like Figure 1 and Figure 2 As shown, the pixel circuit 110 includes a photoelectric conversion element 117 (e.g., a photodiode PD), an exposure control circuit 116 (e.g., a transfer transistor 112), a reset circuit (e.g., a reset transistor 113), an amplifier circuit (e.g., an amplifier transistor 114), and a selection circuit (e.g., a selection transistor 115). In the embodiment of the present application, the transfer transistor 112, the reset transistor 113, the amplifier transistor 114, and the selection transistor 115 are, for example, MOS tubes, but are not limited thereto.

[0031] For example, see Figure 2 , the gate TG of the transfer transistor 112 is connected to the vertical driving unit (not shown in the figure) of the image sensor 10 through an exposure control line (not shown in the figure); the gate RG of the reset transistor 113 is connected to the vertical driving unit through a reset control line (not shown in the figure); the gate SEL of the selection transistor 115 is connected to the vertical driving unit through a selection line (not shown in the figure). The exposure control circuit 116 (for example, the transfer transistor 112) in each pixel circuit 110 is electrically connected to the photoelectric conversion element 117, and is used to transfer the potential accumulated by the photoelectric conversion element 117 after being illuminated. For example, the photoelectric conversion element 117 includes a photodiode PD, and the anode of the photodiode PD is connected to the ground, for example. The photodiode PD converts the received light into electric charge. The cathode of the photodiode PD is connected to the floating diffusion unit FD via the exposure control circuit 116 (for example, the transfer transistor 112). The floating diffusion unit FD is connected to the gate of the amplification transistor 114 and the source of the reset transistor 113.

[0032] For example, the exposure control circuit 116 is a transfer transistor 112, and the control terminal TG of the exposure control circuit 116 is the gate of the transfer transistor 112. When a pulse of an effective level (for example, a VPIX level) is transmitted to the gate of the transfer transistor 112 through the exposure control line, the transfer transistor 112 is turned on. The transfer transistor 112 transfers the charge photoelectrically converted by the photodiode PD to the floating diffusion unit FD.

[0033] For example, the drain of the reset transistor 113 is connected to the pixel power supply VPIX. The source of the reset transistor 113 is connected to the floating diffusion unit FD. Before the charge is transferred from the photodiode PD to the floating diffusion unit FD, a pulse of an effective reset level is transmitted to the gate of the reset transistor 113 via the reset line, and the reset transistor 113 is turned on. The reset transistor 113 resets the floating diffusion unit FD to the pixel power supply VPIX.

[0034] For example, the gate of the amplifier transistor 114 is connected to the floating diffusion unit FD. The drain of the amplifier transistor 114 is connected to the pixel power supply VPIX. After the floating diffusion unit FD is reset by the reset transistor 113, the amplifier transistor 114 outputs a reset level through the output terminal OUT via the selection transistor 115. After the charge of the photodiode PD is transferred by the transfer transistor 112, the amplifier transistor 114 outputs a signal level through the output terminal OUT via the selection transistor 115.

[0035] For example, the drain of the selection transistor 115 is connected to the source of the amplifier transistor 114. The source of the selection transistor 115 is connected to a column processing unit (not shown) in the image sensor 10 through the output terminal OUT. When a pulse of an effective level is transmitted to the gate of the selection transistor 115 through the selection line, the selection transistor 115 is turned on. The signal output by the amplifier transistor 114 is transmitted to the column processing unit through the selection transistor 115.

[0036] It should be noted that the pixel structure of the pixel circuit 110 in the embodiment of the present application is not limited to Figure 2 For example, the pixel circuit 110 may have a three-transistor pixel structure, in which the functions of the amplifying transistor 114 and the selecting transistor 115 are performed by one transistor. For example, the exposure control circuit 116 is not limited to the single transfer transistor 112, and other electronic devices or structures with a control terminal control conduction function can be used as the exposure control circuit in the embodiment of the present application. The implementation of the single transfer transistor 112 is simple, low-cost, and easy to control.

[0037] In an image sensor containing pixels of multiple colors, pixels of different colors receive different exposure amounts per unit time. After some colors are saturated, some colors are not yet exposed to the ideal state. Figure 3 RGBW (red, green, blue, full color) is used as an example. Figure 3 , Figure 3 The horizontal axis is exposure time, the vertical axis is exposure amount, Q is saturated exposure amount, LW is the exposure curve of full-color pixel W, LG is the exposure curve of green pixel G, LR is the exposure curve of red pixel R, and LB is the exposure curve of blue pixel.

[0038] from Figure 3 It can be seen that the slope of the exposure curve LW of the full-color pixel W is the largest, that is, the full-color pixel W can obtain more exposure per unit time and reach saturation at time t1. The slope of the exposure curve LG of the green pixel G is second, and the green pixel is saturated at time t2. The slope of the exposure curve LR of the red pixel R is third, and the red pixel is saturated at time t3. The slope of the exposure curve LB of the blue pixel B is the smallest, and the blue pixel is saturated at time t4. Figure 3 It can be seen that the exposure amount received by the full-color pixel W per unit time is greater than the exposure amount received by the color pixel per unit time, that is, the sensitivity of the full-color pixel W is higher than the sensitivity of the color pixel.

[0039] If only the color phase detection pixel pair 17 is used to implement phase focusing, then in an environment with high brightness, the color pixels in the color phase detection pixel pair 17 can receive more light and can output pixel information with a high signal-to-noise ratio. At this time, the accuracy of phase focusing is high; however, in an environment with low brightness, the color pixels in the color phase detection pixel pair 17 can receive less light, and the signal-to-noise ratio of the output pixel information is low, and the accuracy of phase focusing is also low. If only the full-color phase detection pixel pair 18 is used to implement phase focusing, then in an environment with low brightness, the full-color pixel W in the full-color phase detection pixel pair 18 can receive more light and can output pixel information with a high signal-to-noise ratio. At this time, the accuracy of phase focusing is high; however, in an environment with high brightness, the full-color pixel W in the full-color phase detection pixel pair 18 is prone to reach a saturated state, resulting in overexposure of the full-color pixel W, which affects the phase information and reduces the accuracy of phase focusing.

[0040] Based on the above reasons, the image sensor 10 of the embodiment of the present application simultaneously arranges the color phase detection pixel pair 17 and the full-color phase detection pixel pair 18 in the pixel array 11, and the phase information of the full-color pixel W in the full-color phase detection pixel pair 18 is used for focus detection, and the phase information of the color pixel in the color phase detection pixel pair 17 is used for focus detection. In this way, the image sensor 10 of the embodiment of the present application can achieve accurate focus in scenes with different ambient brightness, thereby improving the scene adaptability of the image sensor 10.

[0041] It should be noted that the spectral response of each pixel 1101 (i.e., the color of light that the pixel 1101 can receive) is determined by the color of the filter 118 corresponding to the pixel 1101. The color pixel and full-color pixel throughout the application refer to the pixel 1101 that can respond to light of the same color as the corresponding filter 118.

[0042] In some embodiments, the phase information of the panchromatic pixel W in the panchromatic phase detection pixel pair 18 is used for focus detection in the first brightness mode, and the phase information of the color pixel in the color phase detection pixel pair 17 is used for focus detection in the second brightness mode. The brightness of the second brightness mode is greater than the first threshold, and the brightness of the first brightness mode is less than the second threshold. That is, when the brightness is greater than the first threshold, the imaging device 100 ( Fig.21As shown in the figure, the image sensor 100 is in the second brightness mode, and at this time, the focus detection is performed according to the phase information of the color pixels in the color phase detection pixel pair 17. Since the brightness is greater than the first threshold at this time, the color pixels in the color phase detection pixel pair 17 can receive more light and can output pixel information with a higher signal-to-noise ratio. At this time, the focus detection is performed using the phase information of the color pixels in the color phase detection pixel pair 17, which can make the focus accuracy higher. When the brightness is less than the second threshold, the imaging device 100 ( Fig.21 As shown in the figure, the image sensor is in the first brightness mode, and at this time, focus detection is performed according to the phase information of the panchromatic pixel W in the panchromatic phase detection pixel pair 18. Since the brightness is low at this time, the panchromatic pixel W in the panchromatic phase detection pixel pair 18 is not easy to reach saturation. At this time, the focus detection is performed using the phase information of the panchromatic pixel W in the panchromatic phase detection pixel pair 18, which can make the focus accuracy higher.

[0043] In some embodiments, the first threshold is less than the second threshold. At this time, when the brightness is greater than the first threshold and less than the second threshold, the imaging device 100 ( Fig.21 The first brightness mode or the second brightness mode can be used as shown in the figure. At this time, focus detection can be performed only according to the phase information of the color pixels in the color phase detection pixel pair 17, or only according to the phase information of the full-color pixel W in the full-color phase detection pixel pair 18. Of course, focus detection can also be performed according to the phase information of the color pixels in the color phase detection pixel pair 17 and the phase information of the full-color pixel W in the full-color phase detection pixel pair 18, which is not limited here.

[0044] It should be noted that in some embodiments, the color pixels in the color phase detection pixel pair 17 can be arranged in the same row (eg Figure 4 As shown), the color pixels in the color phase detection pixel pair 17 can be arranged in the same column (as shown Fig. 9 The full-color pixels W in the full-color phase detection pixel pair 18 can be arranged in the same row (as shown); Figure 4 As shown), the full-color pixels W in the full-color phase detection pixel pair 18 can be arranged in the same column (as shown Fig. 9 ), not limited here.

[0045] In some embodiments, the number of full-color phase detection pixel pairs 18 in the pixel array 11 is equal to the number of color phase detection pixel pairs 17, that is, the ratio of the number of full-color phase detection pixel pairs 18 to the number of color phase detection pixel pairs 17 in the pixel array 11 is 1:1. If the number of full-color phase detection pixel pairs 18 in the pixel array 11 is too large, the focus accuracy is higher when the brightness is low, but when the brightness is high, the full-color pixels W in the full-color phase detection pixel pairs 18 are prone to saturation and overexposure, affecting the image quality of the final image; if the number of color phase detection pixel pairs 17 in the pixel array 11 is too large, the focus accuracy is higher when the brightness is high, but the focus accuracy is lower when the brightness is low. In the embodiment of the present application, since the number of full-color phase detection pixel pairs 18 in the pixel array 11 is equal to the number of color phase detection pixel pairs 17, a focus detection result with high accuracy can be obtained under different brightness conditions. Of course, in some embodiments, according to actual needs, the number of full-color phase detection pixel pairs 18 in the pixel array 11 may also be greater than the number of color phase detection pixel pairs 17; or the number of full-color phase detection pixel pairs 18 in the pixel array 11 may also be less than the number of color phase detection pixel pairs 17, which is not limited here.

[0046] Figures 4 to 13 Pixels 1101 ( Figure 1 See the example of the arrangement shown in Figures 4 to 13 The plurality of pixels 1101 in the pixel array 11 may include a plurality of full-color pixels W and a plurality of color pixels (e.g., a plurality of first color pixels A, a plurality of second color pixels B, and a plurality of third color pixels C) at the same time, wherein the color pixels and the full-color pixels are covered by the filter 118 ( Fig.14 The color pixels have a narrower spectral response than the full-color pixels, and the first color pixel A and the third color pixel C both have a narrower spectral response than the second color pixel B. The response spectrum of the color pixel is, for example, part of the response spectrum of the full-color pixel W. The pixel array 11 is composed of a plurality of minimum repeating units ( Figures 4 to 13 Examples of minimal repeating units in various image sensors 10 are shown), and the minimal repeating units are replicated and arranged in rows and columns.

[0047] It should be noted that the first color photosensitive pixel A may be a red photosensitive pixel R; the second color photosensitive pixel B may be a green photosensitive pixel G; the third color photosensitive pixel C may be a blue photosensitive pixel Bu; or the first color photosensitive pixel A may be a red photosensitive pixel R; the second color photosensitive pixel B may be a yellow photosensitive pixel Y; the third color photosensitive pixel C may be a blue photosensitive pixel Bu; or the first color photosensitive pixel A may be a magenta photosensitive pixel M; the second color photosensitive pixel B may be a cyan photosensitive pixel Cy; the third color photosensitive pixel C may be a yellow photosensitive pixel Y, which is not limited here. For the convenience of description, the following embodiments are described with the first color photosensitive pixel A being a red photosensitive pixel R; the second color photosensitive pixel B being a green photosensitive pixel G; and the third color photosensitive pixel C being a blue photosensitive pixel Bu.

[0048] See also Figures 4 to 9 In some embodiments, the minimum repeating unit includes a first type of pixel unit UA, at least one second type of pixel unit UB, and at least one third type of pixel unit UC. The first type of pixel unit UA does not contain a color phase detection pixel pair 17 and a full-color phase detection pixel pair 18, the second type of pixel unit UB includes at least one color phase detection pixel pair 17, and the third type of pixel unit UC includes at least one full-color phase detection pixel pair 18. For example, the second type of pixel unit UB includes a color phase detection pixel pair 17, and the third type of pixel unit UC includes a full-color phase detection pixel pair 18; or, the second type of pixel unit UB includes a plurality of color phase detection pixel pairs 17, and the third type of pixel unit UC includes a full-color phase detection pixel pair 18; or, the second type of pixel unit UB includes a color phase detection pixel pair 17, and the third type of pixel unit UC includes a plurality of full-color phase detection pixel pairs 18; or, the second type of pixel unit UB includes a plurality of color phase detection pixel pairs 17, and the third type of pixel unit UC includes a plurality of full-color phase detection pixel pairs 18, and the above is not limited here. "Multiple" in this article refers to two or more.

[0049] For example, Figures 4 to 9Schematic diagram of the arrangement of pixels 1101 of certain minimum repeating units and the coverage of lens array 16 in the implementation manner of the present application; the minimum repeating unit is 8 rows and 8 columns with 64 pixels, and the pixel unit (two first-type pixel units UA, one second-type pixel unit UB and one third-type pixel unit UC) is 4 rows and 4 columns with 16 pixels. Among them, the second-type pixel unit UB includes a color phase detection pixel pair 17, and the third-type pixel unit UC includes a full-color phase detection pixel pair 18. Each full-color phase detection pixel pair 18 is covered by the same first lens 161, and each color phase detection pixel pair 17 is covered by the same first lens 161. In the pixel array 11, except for the pixels 1101 in the color phase detection pixel pair 17 and the full-color phase detection pixel pair 18, each pixel 1101 is covered by a second lens 162.

[0050] In an example, Figure 4 As shown, two first-type pixel units UA are arranged in the direction of the first diagonal D1 of the minimum repeating unit, and the second-type pixel units UB and the second-type pixel units UC are arranged in the direction of the second diagonal D2 of the minimum repeating unit, and the first diagonal direction D1 is perpendicular to the second diagonal direction D2. Of course, in other embodiments, the first diagonal direction D1 and the second diagonal direction D2 are not perpendicular, but are at other preset angles. The first diagonal direction D1 is different from the second diagonal direction D2. For example, the first diagonal line is perpendicular to the second diagonal line. Since the color phase detection pixel pair 17 and the full-color phase detection pixel pair 18 are two adjacent pixels 1101 sharing a first lens 1601, that is, the pixel 1101 in the color phase detection pixel pair 17 and the full-color phase detection pixel pair 18 cannot obtain complete information of the incident light. In the subsequent image processing process, the pixel 1101 in the color phase detection pixel pair 17 and the full-color phase detection pixel pair 18 will be treated as a bad pixel for image processing. In the embodiment of the present application, since the first type pixel unit UA is arranged in the first diagonal line D1 direction of the minimum repeating unit, and the second type pixel unit UB and the second type pixel unit UC are arranged in the second diagonal line D2 direction of the minimum repeating unit, it is beneficial to compensate for bad pixels in the subsequent image processing process.

[0051] In another example, Figure 5As shown, the second type pixel unit UB and the third type pixel unit UC are arranged adjacent to each other and arranged in alternate rows with the first type pixel unit UA. That is to say, the second type pixel unit UB and the third type pixel unit UC are arranged in the same row of the minimum repeating unit, and the first type pixel unit UA is arranged in a different row from the second type pixel unit UB and the third type pixel unit UC. Since there is no color phase detection pixel pair 17 or full-color phase detection pixel pair 18 in the row where the first type pixel unit UA is located, there is no need to perform bad pixel compensation on the row of pixels 1101 in the subsequent image processing process. Similarly, in another example, Figure 6 As shown, the second type pixel unit UB and the third type pixel unit UC are arranged adjacent to each other and arranged in alternate columns with the first type pixel unit UA. That is to say, the second type pixel unit UB and the third type pixel unit UC are arranged in the same column of the minimum repeating unit, and the first type pixel unit UA is arranged in a different column from the second type pixel unit UB and the third type pixel unit UC. Since there is no color phase detection pixel pair 17 or full color phase detection pixel pair 18 in the column where the first type pixel unit UA is located, there is no need to perform bad pixel compensation on the column of pixels 1101 in the subsequent image processing process.

[0052] In some embodiments, see Figures 4 to 6 , the position of the color phase detection pixel pair 17 in the second type of pixel unit UB corresponds to the position of the full-color phase detection pixel pair 18 in the third type of pixel unit UC. For example, the minimum repeating unit includes two first type pixel units UA, one second type pixel unit UB and one third type pixel unit UC, wherein the second type pixel unit UB includes a color phase detection pixel pair 17, the third type pixel unit UC includes a full-color phase detection pixel pair 18, and the row where the color phase detection pixel pair 17 in the second type pixel unit UB is located is the same as the row where the full-color phase detection pixel pair 18 in the third type pixel unit UC is located, and the column where the color phase detection pixel pair 17 in the second type pixel unit UB is located is also the same as the column where the full-color phase detection pixel pair 18 in the third type pixel unit UC is located. In this way, the color phase detection pixel pair 17 and the full-color phase detection pixel pair 18 can be evenly distributed in the pixel array 11, which is beneficial to improving the accuracy of focus detection and facilitating subsequent image processing to obtain higher quality images.

[0053] In some embodiments, see Figures 4 to 9, multiple first-type pixel units UA are completely identical, and the second-type pixel unit UB can be formed by the following transformation on the basis of the first-type pixel unit UA: at least one full-color pixel W in the first-type pixel unit UA is replaced by a color pixel, and the color pixel of the same color adjacent to it forms a color phase detection pixel pair 17. The third-type pixel unit UC can be formed by the following transformation on the basis of the first-type pixel unit UA: at least one color pixel in the first-type pixel unit UA is replaced by a full-color pixel W, and the full-color phase detection pixel pair 18 is formed with the full-color pixel W adjacent to it. For example, Figure 4 As shown, the second type of pixel unit UB can be formed by the following transformation on the basis of the first type of pixel unit UA: a full-color pixel W in the first type of pixel unit UA is replaced by a second color pixel B, and a color phase detection pixel pair 17 is formed with the second color pixel B adjacent to it. In this way, the arrangement of the pixels 1101 in the second type of pixel unit UB except for a second color pixel B in the color phase detection pixel pair 17 is exactly the same as that of the first type of sub-unit UA, which is conducive to the compensation of the bad pixel of the second color pixel B in the color phase detection pixel pair 17 in the subsequent image processing process. In addition, since two adjacent second color pixels B are used to form the color phase detection pair 17, compared with two adjacent first color pixels A or two adjacent third color pixels C to form the color phase detection pair 17, more incident light can be received, thereby improving the accuracy of phase focusing. Similarly, the third type of pixel unit UC can be formed by the following transformation on the basis of the first type of pixel unit UA: a second color pixel B in the first type of pixel unit UA is replaced by a full-color pixel W, and a full-color phase detection pixel pair 18 is formed with the full-color pixel W adjacent to it. In this way, the arrangement of pixels 1101 in the third type of pixel unit UC except for one full-color pixel W in the full-color phase detection pixel pair 18 is exactly the same as that of the first type of sub-unit UA, which is beneficial to the bad pixel compensation of the full-color pixel W in the full-color phase detection pixel pair 18 in the subsequent image processing process.

[0054] Please note that Figure 7 In some embodiments, the second type of pixel unit UB can also be formed by the following transformation based on the first type of pixel unit UA: a full-color pixel W in the first type of pixel unit UA is replaced by a third color pixel C, and a color phase detection pixel pair 17 is formed with the third color pixel C adjacent to the first type of pixel unit UA. The third type of pixel unit UC can be formed by the following transformation based on the first type of pixel unit UA: a third color pixel C in the first type of pixel unit UA is replaced by a full-color pixel W, and a full-color phase detection pixel pair 18 is formed with the third color pixel W adjacent to the first type of pixel unit UA. Of course, in some embodiments, such as Figure 8As shown, the second type of pixel unit UB can also be formed by performing the following transformation on the basis of the first type of pixel unit UA: a full-color pixel W in the first type of pixel unit UA is replaced by a first color pixel A, and a color phase detection pixel pair 17 is formed with the first color pixel A adjacent to the pixel unit UA. The third type of pixel unit UC can be formed by performing the following transformation on the basis of the first type of pixel unit UA: a first color pixel A in the first type of pixel unit UA is replaced by a full-color pixel W, and a full-color phase detection pixel pair 18 is formed with the full-color pixel W adjacent to the pixel W, which is not limited here.

[0055] See also Figures 10 to 12 In some embodiments, in the same first-type pixel unit UA, the color pixels are all the same single-color pixels, in the same second-type pixel unit UB, the color pixels are all the same single-color pixels, and in the same third-type pixel unit UC, the color pixels are all the same single-color pixels. In the same first-type pixel unit UA, the color pixels are arranged in the first diagonal direction D1 of the first-type pixel unit UA, and the full-color pixels W are arranged in the second diagonal direction D2 of the first-type pixel unit UA. In the same second-type pixel unit UB, the full-color pixels W are arranged in the second diagonal direction D2 of the second-type pixel unit UB, and the color pixels other than the color phase detection pixel pair 17 are arranged in the first diagonal direction D1 of the second-type pixel unit UB. In the same third-type pixel unit UC, the color pixels are arranged in the first diagonal direction D1 of the third-type pixel unit UC, and the full-color pixels W other than the full-color phase detection pixel pair 18 are arranged in the second diagonal direction D2 of the third-type pixel unit UC.

[0056] It should be noted that the first diagonal direction D1 of the first type of pixel subunit UA, the first diagonal direction D1 of the second type of pixel subunit UB, and the first diagonal direction D1 of the third type of pixel subunit UC are the same, and the second diagonal direction D2 of the first type of pixel subunit UA, the second diagonal direction D2 of the second type of pixel subunit UB, and the second diagonal direction D2 of the third type of pixel subunit UC are the same. The first diagonal direction D1 is different from the second diagonal direction D2. For example, the first diagonal line and the second diagonal line are perpendicular or at other angles. The first diagonal direction D1 and the second diagonal direction D2 are not limited to the diagonal line, but also include directions parallel to the diagonal line. The "direction" here is not a single direction, and can be understood as the concept of indicating the "straight line" of the arrangement, and there can be two-way directions at both ends of the straight line.

[0057] For example, see Figure 10 to Figure 11Schematic diagram of the arrangement of pixels 1101 of certain minimum repeating units and the coverage of lens array 16 in the implementation manner of the present application; the minimum repeating unit is 16 pixels in 4 rows and 4 columns, and the pixel unit (two first-type pixel units UA, one second-type pixel unit UB and one third-type pixel unit UC) is 4 pixels in 2 rows and 2 columns. Among them, the second-type pixel unit UB includes a color phase detection pixel pair 17, and the third-type pixel unit UC includes a full-color phase detection pixel pair 18. Each full-color phase detection pixel pair 18 is covered by the same first lens 161, and each color phase detection pixel pair 17 is covered by the same first lens 161. In the pixel array 11, except for the pixels 1101 in the color phase detection pixel pair 17 and the full-color phase detection pixel pair 18, each pixel 1101 is covered by a second lens 162.

[0058] In one example, the single-color pixels in the two first-type pixel units UA are of different colors. Fig.10 As shown, a first type of pixel unit UA includes color pixels and full-color pixels W, wherein the color pixels are all first color pixels A, and the first color pixels A are arranged along the first diagonal direction D1, and the full-color pixels W are arranged along the second diagonal direction D2. Another first type of pixel unit UA includes color pixels and full-color pixels W, wherein the color pixels are all third color pixels C, and the third color pixels C are arranged along the first diagonal direction D1, and the full-color pixels W are arranged along the second diagonal direction D2. The second type of pixel unit UB includes color pixels, full-color pixels W, and color phase detection pixel pairs 17, and the color pixels are all second color pixels B, that is. The color phase detection pixel pair 17 in the second type of pixel unit UB includes two adjacent second color pixels B. In the second type of pixel unit UB, the full-color pixels W are arranged along the second diagonal direction D2, and the second color pixels B except the color phase detection pixel pair 17 are arranged along the first diagonal direction D1. The third type of pixel unit UC includes color pixels, full-color pixels W, and full-color phase detection pixel pairs 18, and the color pixels are all second color pixels B. In the third type of pixel unit UC, the second color pixels B are arranged along the first diagonal direction D1, and the other full-color pixels W except the full-color phase detection pixel pair 18 are arranged along the second diagonal direction D2.

[0059] In another example, the single-color pixels in the two first-type pixel units UA are of the same color. Fig.11As shown, two first-type pixel units UA include color pixels and full-color pixels W, wherein the color pixels are all second color pixels B, and the second color pixels B are arranged along the first diagonal direction D1, and the full-color pixels W are arranged along the second diagonal direction D2. The second-type pixel unit UB includes color pixels, full-color pixels W and color phase detection pixel pairs 17, and the color pixels are all first color pixels A, that is. The color phase detection pixel pair 17 in the second-type pixel unit UB includes two adjacent first color pixels A. In the second-type pixel unit UB, the full-color pixels W are arranged along the second diagonal direction D2, and the first color pixels A except the color phase detection pixel pair 17 are arranged along the first diagonal direction D1. The third-type pixel unit UC includes color pixels, full-color pixels W and full-color phase detection pixel pairs 18, and the color pixels are all third color pixels C. In the third-type pixel unit UC, the third color pixels C are arranged along the first diagonal direction D1, and the other full-color pixels W except the full-color phase detection pixel pair 18 are arranged along the second diagonal direction D2.

[0060] Of course, in some embodiments, in the same first-type pixel unit UA, the color pixels are arranged in the second diagonal direction D2 of the first-type pixel unit UA, and the full-color pixels W are arranged in the first diagonal direction D1 of the first-type pixel unit UA. In the same second-type pixel unit UB, the full-color pixels W are arranged in the first diagonal direction D1 of the second-type pixel unit UB, and the color pixels other than the color phase detection pixel pair 17 are arranged in the second diagonal direction D2 of the second-type pixel unit UB. In the same third-type pixel unit UC, the color pixels are arranged in the second diagonal direction D2 of the third-type pixel unit UC, and the full-color pixels W other than the full-color phase detection pixel pair 18 are arranged in the first diagonal direction D1 of the third-type pixel unit UC, which is not limited here.

[0061] For example, Fig.12 It is a schematic diagram of the arrangement of pixels 1101 of a minimum repeating unit and the coverage of the lens array 16 in an embodiment of the present application; the minimum repeating unit is 8 rows and 8 columns with 64 pixels, and the pixel unit (two first-type pixel units UA, one second-type pixel unit UB and one third-type pixel unit UC) is 4 rows and 4 columns with 16 pixels. Among them, the second-type pixel unit UB includes a color phase detection pixel pair 17, and the third-type pixel unit UC includes a full-color phase detection pixel pair 18. Each full-color phase detection pixel pair 18 is covered by the same first lens 161, and each color phase detection pixel pair 17 is covered by the same first lens 161. In the pixel array 11, except for the pixels 1101 in the color phase detection pixel pair 17 and the full-color phase detection pixel pair 18, each pixel 1101 is covered by a second lens 162.

[0062] A color phase detection pixel pair 17 and a full-color phase detection pixel pair 18 are set on the minimum repeating unit of 8 rows, 8 columns and 64 pixels. Compared with setting a color phase detection pixel pair 17 and a full-color phase detection pixel pair 18 on the minimum repeating unit of 4 rows, 4 columns and 16 pixels, the density of the phase detection pixel pairs on the pixel array 11 of the image sensor 10 is smaller, which is beneficial to subsequent image processing, thereby improving the image quality of the final image obtained.

[0063] See also Fig.13 In some embodiments, the minimum repeating unit includes a first type of pixel unit UA and at least one second pixel unit UB, wherein the first type of pixel unit UA does not contain a color phase detection pixel pair 17 and a full-color phase detection pixel pair 18, and the second type of pixel unit UB includes at least one color phase detection pixel pair 17 and at least one full-color phase detection pixel pair 18. For example, the second type of pixel unit UB includes one color phase detection pixel pair 17 and one full-color phase detection pixel pair 18; or, the second type of pixel unit UB includes one color phase detection pixel pair 17 and multiple full-color phase detection pixel pairs 18; or, the second type of pixel unit UB includes multiple color phase detection pixel pairs 17 and one full-color phase detection pixel pair 18; or, the second type of pixel unit UB includes multiple color phase detection pixel pairs 17 and one full-color phase detection pixel pair 18; or, the second type of pixel unit UB includes multiple color phase detection pixel pairs 17 and multiple full-color phase detection pixel pairs 18. It should be noted that, in a minimum repeating unit, the number of the first type of pixel units UA may be equal to the number of the second pixel units UB; the number of the first type of pixel units UA may also be greater than the number of the second pixel units UB; the number of the first type of pixel units UA may also be less than the number of the second pixel units UB, which is not limited here.

[0064] For example, Fig.13 1 is a schematic diagram of the arrangement of pixels 1101 of a minimum repeating unit and the coverage of the lens array 16 in an embodiment of the present application; the minimum repeating unit is 8 rows and 8 columns with 64 pixels, and the pixel unit (three first-type pixel units UA and one second-type pixel unit UB) is 4 rows and 4 columns with 16 pixels. Among them, the second-type pixel unit UB includes a color phase detection pixel pair 17 and a full-color phase detection pixel pair 18. Each full-color phase detection pixel pair 18 is covered by the same first lens 161, and each color phase detection pixel pair 17 is covered by the same first lens 161. In the pixel array 11, except for the pixels 1101 in the color phase detection pixel pair 17 and the full-color phase detection pixel pair 18, each pixel 1101 is covered by a second lens 162. Since the color phase detection pixel pair 17 and the full-color phase detection pixel pair 18 are in the same pixel unit, the manufacturing difficulty of the image sensor 10 can be reduced.

[0065] In some embodiments, see Fig.13 , multiple first-type pixel units UA are completely identical, and the second-type pixel unit UB can be formed by the following transformation on the basis of the first-type pixel unit UA: at least one full-color pixel W in the first-type pixel unit UA is replaced by a color pixel, and forms a color phase detection pixel pair 17 with its adjacent color pixel of the same color, and at least one color pixel in the first-type pixel unit UA is replaced by a full-color pixel W, and forms a full-color phase detection pixel pair 18 with its adjacent full-color pixel W. For example, Fig.13 As shown, the second type of pixel unit UB can be formed by the following transformation on the basis of the first type of pixel unit UA: at least one full-color pixel W in the first type of pixel unit UA is replaced by a second color pixel B, and forms a color phase detection pixel pair 17 with the second color pixel B adjacent to it, and at least one second pixel B in the first type of pixel unit UA is replaced by a full-color pixel W, and forms a full-color phase detection pixel pair 18 with the full-color pixel W adjacent to it. In this way, the arrangement of the pixels 1101 in the second type of pixel unit UB, except for one second color pixel B in the color phase detection pixel pair 17 and one full-color pixel W in the full-color phase detection pixel pair 18, is exactly the same as that of the first type of sub-unit UA, which is conducive to the compensation of the bad pixel of the second color pixel B in the color phase detection pixel pair 17 in the subsequent image processing process. In addition, since the color phase detection pair 17 is formed by two adjacent second color pixels B, it can receive more incident light and improve the accuracy of phase focusing compared with the color phase detection pair 17 formed by two adjacent first color pixels A or two adjacent third color pixels C.

[0066] It should be noted that, in some embodiments, the second type of pixel unit UB can also be formed by the following transformation on the basis of the first type of pixel unit UA: a full-color pixel W in the first type of pixel unit UA is replaced by a third color pixel C, and the third color pixel C adjacent to it forms a color phase detection pixel pair 17, and a third color pixel C in the first type of pixel unit UA is replaced by a full-color pixel W, and the full-color phase detection pixel pair 18 is formed with the full-color pixel W adjacent to it. Of course, in some embodiments, the second type of pixel unit UB can also be formed by the following transformation on the basis of the first type of pixel unit UA: a full-color pixel W in the first type of pixel unit UA is replaced by a first color pixel A, and the color phase detection pixel pair 17 is formed with the first color pixel A adjacent to it, and a first color pixel A in the first type of pixel unit UA is replaced by a full-color pixel W, and the full-color phase detection pixel pair 18 is formed with the full-color pixel W adjacent to it, and there is no limitation here.

[0067] Figures 14 to 18 Shows Figures 4 to 13Schematic diagrams of various cross sections of the pixel array 11 taken along the light receiving direction of the image sensor 10 in any of the embodiments described above. Each full-color pixel W and each color pixel include a filter 118 and a photoelectric conversion element 117. Along the light receiving direction of the image sensor 10, the lens 16, the filter 118, and the photoelectric conversion element 117 are arranged in sequence. The photoelectric conversion element 117 can convert the received light into charge. Specifically, the photoelectric conversion element 117 includes a substrate 1171 and an n-well layer 1172 formed inside the substrate 1171, and the n-well layer 1172 can realize the conversion of light to charge. The filter 118 is arranged on the surface of the n-well layer 1172 away from the substrate 1171, and the filter 118 allows light of a specific wavelength band to pass. The microlens 1181 is arranged on the side of the filter 118 away from the n-well layer 1172, and the microlens 1181 is used to converge light and can guide more incident light to the photoelectric conversion element 117.

[0068] The saturated exposure Q of the pixel is related to the full well capacity of the photoelectric conversion element 117. The larger the full well capacity, the larger the saturated exposure Q. The full well capacity is related to the doping concentration and volume of the n-well layer 1172 of the photoelectric conversion element 117. When the doping concentration of the n-well layer 1172 of the photoelectric conversion element 117 is the same, the full well capacity of the photoelectric conversion element 117 is related to the volume of the n-well layer 1172 of the photoelectric conversion element 117, and the larger the volume of the n-well layer 1172, the larger the full well capacity. Among them, the volume of the n-well layer 1172 is related to the cross-section and depth of the n-well layer. When the cross-section of the n-well layer 1172 is fixed, the volume of the n-well layer 1172 can be increased by increasing the depth. When the volume of the n-well layer 1172 of the photoelectric conversion element 117 is the same, the full well capacity of the photoelectric conversion element 117 is related to the doping concentration of the n-well layer 1172 of the photoelectric conversion element 117. The greater the doping concentration of the n-well layer 1172, the greater the full well capacity.

[0069] For example, Figures 14 to 16 is a schematic cross-sectional view of the pixel array 11 of any of the above embodiments taken along the light collection direction. Along the light collection direction, the sizes of multiple cross sections of the n-well layer 1172 of each pixel (the same pixel) are equal; the size of the cross section of the n-well layer 1172 of the full-color pixel W is equal to the size of the cross section of the n-well layer 1172 of the color pixel; the depth H1 of the n-well layer 1172 of the full-color pixel W is equal to the depth H2 of the n-well layer 1172 of the color pixel, and the doping concentration C1 of the n-well layer 1172 of the full-color pixel W is greater than the doping concentration C2 of the n-well layer 1172 of the color pixel, so that the full-color pixel W has a larger full well capacity than the color pixel.

[0070] It should be noted that, along the light collection direction, the sizes of multiple cross sections of the n-well layer 1172 of the same pixel are all equal, which means that the multiple cross sections have the same area and the corresponding side lengths in the multiple cross sections are all equal. The cross section can be a polygon such as a rectangle, square, parallelogram, rhombus, pentagon, hexagon, etc. Of course, along the light collection direction, the sizes of multiple cross sections of the n-well layer 1172 of each pixel (the same pixel) can also be unequal, which is not limited here.

[0071] Since the doping concentration C1 of the n-well layer 1172 of the full-color pixel W is greater than the doping concentration C2 of the n-well layer 1172 of the color pixel, the full-color pixel W has a larger full-well capacity than the color pixel, which increases the saturation exposure Q of the full-color pixel W, avoids the problem of premature saturation of the full-color pixel W, balances the exposure of the full-color pixel W and the color pixel, and improves the image capture quality.

[0072] For example, Figures 17 to 19 is a schematic cross-sectional view of the pixel array 11 of any of the above-mentioned embodiments taken along the light collection direction. The doping concentration C1 of the n-well layer 1172 of the full-color pixel W is equal to the doping concentration C2 of the n-well layer 1172 of the color pixel. Along the light collection direction, the sizes of the multiple cross sections of the n-well layer 1172 of each pixel (the same pixel) are equal; the size of the cross section of the n-well layer 1172 of the full-color pixel W is equal to the size of the cross section of the n-well layer 1172 of the color pixel; the depth H1 of the n-well layer 1172 of the full-color pixel W is greater than the depth H2 of the n-well layer 1172 of the color pixel. In this way, the volume of the n-well layer 1172 of the full-color pixel W is greater than the volume of the n-well layer 1172 of the color pixel, and the full-color pixel W has a larger full well capacity than the color pixel.

[0073] Since the volume of the n-well layer 1172 of the full-color pixel W is larger than the volume of the n-well layer 1172 of the color pixel, the full-color pixel W has a larger full-well capacity than the color pixel, which increases the saturation exposure Q of the full-color pixel W, avoids the problem of premature saturation of the full-color pixel W, balances the exposure of the full-color pixel W and the color pixel, and improves the image capture quality.

[0074] In some embodiments, in order to make the full-color pixel have a larger full-well capacity than the color pixel, the depth H1 of the n-well layer 1172 of the full-color pixel can be set greater than the depth H2 of the n-well layer 1172 of the color pixel (that is, the volume of the n-well layer 1172 of the full-color pixel W is set greater than the volume of the n-well layer 1172 of the color pixel), and at the same time, the doping concentration C1 of the n-well layer 1172 of the full-color pixel W is set greater than the doping concentration C2 of the n-well layer 1172 of the color pixel, thereby increasing the saturation exposure Q of the full-color pixel W, avoiding the problem of premature saturation of the full-color pixel W, and improving the image capture quality.

[0075] See also Figure 4 and Fig. 20 The present application also provides a control method for the image sensor 10 that can be used in any one of the above embodiments. The control method includes:

[0076] 01: When the ambient brightness is less than the first threshold, focus detection is performed based on the phase information of the panchromatic pixel W in the panchromatic phase detection pixel pair 18 to focus:

[0077] 02: When the ambient brightness is greater than a second threshold, focus detection is performed according to the phase information of the color pixels in the color phase detection pixel pair 17 to focus, and the second threshold is greater than the first threshold.

[0078] Please combine Fig.21 The present application also provides an imaging device 100, which includes the image sensor 10 and the lens 20 described in any one of the above embodiments, and the image sensor 10 is capable of receiving light passing through the lens 20. In some embodiments, the imaging device 100 also includes a processor 30, and both step 01 and step 02 in the above control method can be implemented by the processor 30. That is, the processor 30 is used to perform focus detection to focus according to the phase information of the panchromatic pixel W in the panchromatic phase detection pixel pair 18 when the ambient brightness is less than the first threshold; and to perform focus detection to focus according to the phase information of the color pixels in the color phase detection pixel pair 17 when the ambient brightness is greater than the second threshold, and the second threshold is greater than the first threshold.

[0079] The control method and imaging device 100 in the embodiment of the present application are implemented by setting a color phase detection pixel pair 17 and a full-color phase detection pixel pair 18 in the image sensor 10 in the imaging device 100. In an environment with high brightness, the color pixels in the color phase detection pixel pair 17 can receive more light. At this time, focus detection is performed based on the phase information of the color pixels in the color phase detection pixel pair 17 to focus. In an environment with low brightness, the full-color pixel W in the full-color phase detection pixel pair 18 is not easy to reach saturation. At this time, focus detection is performed based on the phase information of the full-color pixel W in the full-color phase detection pixel pair 18 to focus. Accurate focus can be achieved in scenes with different ambient brightness, so as to improve the scene adaptability of the image sensor.

[0080] See also Figure 4 , Fig. 20 and Fig.21When the ambient brightness is less than the first threshold, it means that the brightness is low at this time, and the color pixel can receive less light, then the focus detection is performed according to the phase information of the panchromatic pixel W in the panchromatic phase detection pixel pair 18 to focus. By way of example, the panchromatic phase detection pixel pair 18 includes a first panchromatic pixel W disposed on the first side, and a second panchromatic pixel W disposed on the second side. When the ambient brightness is less than the first threshold, the processor 30 obtains the phase information of the first panchromatic pixel W and the phase information of the second panchromatic pixel W, and then the processor 30 calculates the phase difference according to the phase information of the first panchromatic pixel W and the phase information of the second panchromatic pixel W to focus.

[0081] When the ambient brightness is greater than the second threshold, it means that the brightness is high at this time, and the full-color pixel W is easy to reach saturation, then focus detection is performed according to the phase information of the color pixels in the color phase detection pixel pair 17 to focus. For example, the color phase detection pixel pair 17 includes a first color pixel arranged on the first side, and a second color pixel arranged on the second side. When the ambient brightness is greater than the second threshold, the processor 30 obtains the phase information of the first color pixel and the phase information of the second color pixel, and then the processor 30 calculates the phase difference according to the phase information of the first color pixel and the phase information of the second color pixel to focus.

[0082] In some embodiments, when the ambient brightness is less than a first threshold, the processor 30 calculates the phase difference between the phase information of the first panchromatic pixel W and the phase information of the second panchromatic pixel W. If the phase difference is zero, it indicates that the focus is successful and no other operation is required. If the phase difference is not zero, the image sensor 10 is moved in the first direction. If the phase difference between the phase information of the first panchromatic pixel W and the phase information of the second panchromatic pixel W decreases, the image sensor 10 continues to be moved in the first direction until a certain position is reached, and the phase difference between the phase information of the first panchromatic pixel W and the phase information of the second panchromatic pixel W is zero, thereby completing the focus. If the phase difference between the phase information of the first panchromatic pixel W and the phase information of the second panchromatic pixel W increases, the image sensor 10 is moved in the second direction until a certain position is reached, and the phase difference between the phase information of the first panchromatic pixel W and the phase information of the second panchromatic pixel W is zero, thereby completing the focus. When the ambient brightness is greater than the second threshold, the processor 30 calculates the phase difference between the phase information of the first color pixel and the phase information of the second color pixel. If the phase difference is zero, it means that the focus is successful and no other operation is required. If the phase difference is not zero, the image sensor 10 is moved in the first direction. If the phase difference between the phase information of the first color pixel and the phase information of the second color pixel decreases, the image sensor 10 continues to be moved in the first direction until it reaches a certain position, and the phase difference between the phase information of the first color pixel and the phase information of the second color pixel is zero, so that the focus is completed; if the phase difference between the phase information of the first color pixel and the phase information of the second color pixel increases, the image sensor 10 is moved in the second direction until it reaches a certain position, and the phase difference between the phase information of the first color pixel and the phase information of the second color pixel is zero, so that the focus is completed. It should be noted that the second direction is opposite to the first direction. In some embodiments, focusing can also be achieved by moving the lens 20.

[0083] Since when the brightness is less than the first threshold, the brightness is low at this time, and the full-color pixel W in the full-color phase detection pixel pair 18 is not easy to reach saturation, at this time, the phase information of the full-color pixel W in the full-color phase detection pixel pair 18 is used for focus detection, which can make the focus accuracy higher. When the brightness is greater than the second threshold, the color pixels in the color phase detection pixel pair 17 can receive more light and can output pixel information with a higher signal-to-noise ratio. At this time, the phase information of the color pixels in the color phase detection pixel pair 17 is used for focus detection, which can make the focus accuracy higher.

[0084] It should be noted that if Figure 4 As shown, when two full-color pixels W in the full-color phase detection pixel pair 18 are arranged in the same row of the pixel array 11, the first side of the full-color phase detection pixel pair 18 represents the left side, and the second side represents the right side; Fig. 9When two full-color pixels W in the full-color phase detection pixel pair 18 are arranged in the same column of the pixel array 11, the first side of the full-color phase detection pixel pair 18 represents the upper side, and the second side represents the lower side. Figure 4 As shown, when two color pixels W in the color phase detection pixel pair 17 are arranged in the same row of the pixel array 11, the first side of the color phase detection pixel pair 17 represents the left side, and the second side represents the right side; Fig. 9 As shown, when two color pixels W in the color phase detection pixel pair 17 are arranged in the same column of the pixel array 11, the first side of the color phase detection pixel pair 17 represents the upper side, and the second side represents the lower side. The "left", "right", "upper" and "lower" mentioned above only represent the direction positions shown in the figure, and cannot constitute a limitation to the embodiments of the present application.

[0085] See also Figure 4 and Fig. 22 In some embodiments, the control method further comprises:

[0086] 03: When the ambient brightness is greater than the first threshold and less than the second threshold, focus detection is performed according to the phase information of the panchromatic pixel W in the panchromatic phase detection pixel pair 18 to achieve focus.

[0087] Please combine Fig.21 , step 03 can be implemented by the processor 30. That is, the processor 30 is also used to perform focus detection to focus according to the phase information of the panchromatic pixel W in the panchromatic phase detection pixel pair 18 when the ambient brightness is greater than the first threshold and less than the second threshold.

[0088] When the ambient brightness is greater than the first threshold and less than the second threshold, it means that the brightness is not too high at this time, and the full-color pixel W is not easy to reach saturation, then focus detection can be performed based on the phase information of the full-color pixel W in the full-color phase detection pixel pair 18 for focusing. The specific implementation method of focus detection for focusing is the same as the specific implementation method of performing focus detection for focusing based on the phase information of the full-color pixel W in the full-color phase detection pixel pair 18 in the above-mentioned embodiment, which will not be repeated here.

[0089] See also Figure 4 and Fig.23 In some embodiments, the control method further comprises:

[0090] 04: When the ambient brightness is greater than the first threshold and less than the second threshold, focus detection is performed according to the phase information of the color pixels in the color phase detection pixel pair 17 to focus.

[0091] Please combine Fig.21, step 04 can be implemented by the processor 30. That is, the processor 30 is also used to perform focus detection to focus according to the phase information of the color pixels in the color phase detection pixel pair 17 when the ambient brightness is greater than the first threshold and less than the second threshold.

[0092] When the ambient brightness is greater than the first threshold and less than the second threshold, it means that the brightness is not too low at this time, and the color pixels can receive more incident light. Focus detection can be performed based on the phase information of the color pixels in the color phase detection pixel pair 17 for focusing. The specific implementation method of focus detection for focusing is the same as the specific implementation method of performing focus detection for focusing based on the phase information of the color pixels in the color phase detection pixel pair 17 in the above-mentioned embodiment, which will not be repeated here.

[0093] See also Figure 4 and Fig.24 In some embodiments, the control method further comprises:

[0094] 05: When the ambient brightness is greater than the first threshold and less than the second threshold, focus detection is performed based on the phase information of the panchromatic pixels in the panchromatic phase detection pixel pair 18 and the phase information of the color pixels in the color phase detection pixel pair 17 to achieve focus.

[0095] Please combine Fig.21 , step 05 can be implemented by the processor 30. That is, the processor 30 is also used to perform focus detection to focus according to the phase information of the panchromatic pixels in the panchromatic phase detection pixel pair 18 and the phase information of the color pixels in the color phase detection pixel pair 17 when the ambient brightness is greater than the first threshold and less than the second threshold.

[0096] When the ambient brightness is greater than the first threshold and less than the second threshold, it means that the brightness is not too high at this time, and the full-color pixel W is not easy to reach saturation; and the brightness is not too low, and the color pixel can receive more incident light. Then, focus detection can be performed to focus according to the phase information of the full-color pixels in the full-color phase detection pixel pair 18 and the phase information of the color pixels in the color phase detection pixel pair 17. Since when the ambient brightness is greater than the first threshold and less than the second threshold, focus detection is performed together according to the phase information of the full-color pixels in the color phase detection pixel pair 18 and the phase information of the color pixels in the color phase detection pixel pair 17 to focus, the error can be reduced to improve the accuracy of focus, thereby improving the image quality of the final image.

[0097] For example, see Figure 4 , Fig.24 and Fig.25 , step 05 also includes:

[0098] 051: Obtain phase information of all pixels in the full-color phase detection pixel pair 18 and the color phase detection pixel pair 17;

[0099] 052: Obtaining first phase information according to phase information of a first panchromatic pixel W and phase information of a first color pixel, wherein the first panchromatic pixel is a panchromatic pixel W disposed on a first side of a panchromatic phase detection pixel pair 18, and the first color pixel is a color pixel disposed on a first side of a color phase detection pixel pair 17;

[0100] 053: obtaining second phase information according to phase information of a second full-color pixel W and phase information of a second color pixel, wherein the second full-color pixel is a full-color pixel W disposed on a second side of the full-color phase detection pixel pair 18, and the second color pixel is a color pixel disposed on a second side of the color phase detection pixel pair 17, and the second side is disposed opposite to the first side;

[0101] 054: Calculate the phase difference according to the first phase information and the second phase information to perform focusing.

[0102] Please combine Fig.21 , step 05 can be implemented by the processor 30. That is, the processor 30 is also used to obtain the phase information of all pixels in the full-color phase detection pixel pair 18 and the color phase detection pixel pair 17; obtain the first phase information according to the phase information of the first full-color pixel and the phase information of the first color pixel, the first full-color pixel is the full-color pixel W set on the first side of the full-color phase detection pixel pair 18, and the first color pixel is the color pixel set on the first side of the color phase detection pixel pair 17; obtain the second phase information according to the phase information of the second full-color pixel and the phase information of the second color pixel, the second full-color pixel is the full-color pixel W set on the second side of the full-color phase detection pixel pair 18, and the second color pixel is the color pixel set on the second side of the color phase detection pixel pair 17, and the second side is set opposite to the first side; and calculate the phase difference according to the first phase information and the second phase information to focus.

[0103] Specifically, the full-color phase detection pixel pair 18 includes a first full-color pixel W disposed on the first side and a second full-color pixel W disposed on the second side, and the color phase detection pixel pair 17 includes a first color pixel disposed on the first side and a second color pixel disposed on the second side. When the ambient brightness is greater than the first threshold and less than the second threshold, the processor 30 obtains the phase information of all pixels in the full-color phase detection pixel pair 18 and the color phase detection pixel pair 17, and the processor 30 obtains the phase information of the first full-color pixel W, the second full-color pixel W, the first color pixel and the second color pixel. The first phase information is obtained based on the phase information of the first full-color pixel W and the phase information of the first color pixel; the second phase information is obtained based on the phase information of the second full-color pixel W and the phase information of the second color pixel. Then the processor 30 calculates the phase difference based on the first phase information and the second phase information for focusing.

[0104] See also Fig.26 The present application also provides a mobile terminal 1000. The terminal 1000 may be a mobile phone, a tablet computer, a laptop computer, a smart wearable device (such as a smart watch, a smart bracelet, smart glasses, a smart helmet, etc.), a head display device, a virtual reality device, etc., without limitation. The terminal 1000 includes a housing 200 and an imaging device 100. The housing 200 is combined with the imaging device 100. It should be noted that the processor 30 may also be provided on the terminal 1000.

[0105] The terminal 100 in the embodiment of the present application sets a color phase detection pixel pair 17 and a full-color phase detection pixel pair 18 in the image sensor 10 in the terminal 100, and in an environment with high brightness, the color pixels in the color phase detection pixel pair 17 can receive more light. At this time, focus detection is performed based on the phase information of the color pixels in the color phase detection pixel pair 17 to focus; in an environment with low brightness, the full-color pixel W in the full-color phase detection pixel pair 18 is not easy to reach saturation. At this time, focus detection is performed based on the phase information of the full-color pixel W in the full-color phase detection pixel pair 18 to focus, and accurate focus can be achieved in scenes with different ambient brightness to improve the scene adaptability of the image sensor.

[0106] See also Fig. 27 The present application also provides a non-volatile computer-readable storage medium 600 containing a computer program, on which a computer program 610 is stored. When the computer program is executed by the processor 300, the processor 300 executes the control method of any one of the above embodiments.

[0107] For example, see Fig. 20 and Fig. 27 , when the computer program is executed by the processor 300, the processor 300 performs the following steps:

[0108] 01: When the ambient brightness is less than the first threshold, focus detection is performed based on the phase information of the panchromatic pixel W in the panchromatic phase detection pixel pair 18 to focus:

[0109] 02: When the ambient brightness is greater than a second threshold, focus detection is performed according to the phase information of the color pixels in the color phase detection pixel pair 17 to focus, and the second threshold is greater than the first threshold.

[0110] The computer-readable storage medium 600 may be disposed in the terminal 1000 or in a cloud server. In this case, the terminal 1000 may communicate with the cloud server to obtain the corresponding computer program 310 .

[0111] It can be understood that the computer program 310 includes computer program code. The computer program code can be in source code form, object code form, executable file or some intermediate form. Computer readable storage media can include: any entity or device capable of carrying computer program code, recording medium, USB flash drive, mobile hard disk, magnetic disk, optical disk, computer memory, read-only memory (ROM), random access memory (RAM), and software distribution medium.

[0112] The processor 300 may refer to a driver board. The driver board may be a central processing unit (CPU), or other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), field-programmable gate arrays (FPGA) or other programmable logic devices, discrete gates or transistor logic devices, discrete hardware components, etc. It should be noted that the processor 300 may be the same processor as the processor 30 provided in the imaging device 100, or the processor 30 may not be the same processor as the processor 30 provided in the imaging device 100, and this is not limited here.

[0113] In the description of this specification, the description with reference to the terms "one embodiment", "some embodiments", "illustrative embodiments", "examples", "specific examples" or "some examples" etc. means that the specific features, structures, materials or characteristics described in conjunction with the embodiments or examples are included in at least one embodiment or example of the present application. In this specification, the schematic representations of the above terms do not necessarily refer to the same embodiment or example. Moreover, the specific features, structures, materials or characteristics described may be combined in any one or more embodiments or examples in a suitable manner. In addition, those skilled in the art may combine and combine the different embodiments or examples described in this specification and the features of the different embodiments or examples, unless they are contradictory.

[0114] Any process or method description in a flowchart or otherwise described herein may be understood to represent a module, segment or portion of code that includes one or more executable instructions for implementing the steps of a specific logical function or process, and the scope of the preferred embodiments of the present application includes alternative implementations in which functions may not be performed in the order shown or discussed, including performing functions in a substantially simultaneous manner or in the reverse order depending on the functions involved, which should be understood by technicians in the technical field to which the embodiments of the present application belong.

[0115] Although the embodiments of the present application have been shown and described above, it can be understood that the above embodiments are exemplary and cannot be understood as limitations on the present application. Ordinary technicians in this field can change, modify, replace and modify the above embodiments within the scope of the present application.

Claims

1. An image sensor, characterized in that: The image sensor includes a pixel array and a lens array, the pixel array including a plurality of color pixels, a plurality of panchromatic pixels, at least one color phase detection pixel pair, and at least one panchromatic phase detection pixel pair; The panchromatic phase detection pixel pair includes two adjacent panchromatic pixels, and phase information of the panchromatic pixels in the panchromatic phase detection pixel pair is used for focus detection; The color phase detection pixel pair includes two adjacent color pixels of the same color, the color pixels have a narrower spectral response than the full-color pixels, and phase information of the color pixels in the color phase detection pixel pair is used for focus detection; The lens array includes a plurality of first lenses, each of the full-color phase detection pixel pairs is covered by the same first lens, and each of the color phase detection pixel pairs is covered by the same first lens; The pixel array includes a minimum repeating unit, wherein the minimum repeating unit includes a first type of pixel sub-unit, at least one second type of pixel sub-unit, and at least one third type of pixel sub-unit, wherein the second type of pixel sub-unit includes at least one color phase detection pixel pair and at least one panchromatic phase detection pixel pair; The second type of pixel sub-unit can be formed by performing the following changes on the basis of the first type of pixel sub-unit: At least one of the full-color pixels in the first type of pixel sub-unit is replaced by one of the color pixels, and forms the color phase detection pixel pair with the adjacent color pixel of the same color, and at least one of the color pixels in the first type of pixel sub-unit is replaced by one of the full-color pixels, and forms the full-color phase detection pixel pair with the adjacent full-color pixel.

2. The image sensor according to claim 1, characterized in that The phase information of the panchromatic pixels in the panchromatic phase detection pixel pair is used for focus detection in a first brightness mode, and the phase information of the color pixels in the color phase detection pixel pair is used for focus detection in a second brightness mode; The brightness of the second brightness mode is greater than a first threshold, the brightness of the first brightness mode is less than a second threshold, and the first threshold is less than the second threshold.

3. The image sensor according to claim 1, characterized in that The number of the panchromatic phase detection pixel pairs is equal to the number of the color phase detection pixel pairs.

4. The image sensor according to claim 1, characterized in that The position of the color phase detection pixel pair in the second type of pixel sub-unit corresponds to the position of the full-color phase detection pixel pair in the third type of pixel sub-unit.

5. The image sensor according to claim 1, characterized in that In the same first-type pixel subunit, the color pixels are all the same single-color pixels, in the same second-type pixel subunit, the color pixels are all the same single-color pixels, and in the same third-type pixel subunit, the color pixels are all the same single-color pixels. In the same first-type pixel subunit, the color pixels are arranged in a first diagonal direction of the first-type pixel subunit, and the full-color pixels are arranged in a second diagonal direction of the first-type pixel subunit; In the same second-type pixel subunit, the full-color pixels are arranged in the second diagonal direction of the second-type pixel subunit, and the other color pixels except the color phase detection pixels are arranged in the first diagonal direction of the second-type pixel subunit; In the same third-type pixel subunit, the color pixels are arranged in a first diagonal direction of the third-type pixel subunit, and the other full-color pixels except the full-color phase detection pixels are arranged in a second diagonal direction of the third-type pixel subunit.

6. The image sensor according to claim 1, characterized in that: The doping concentration of the n-well layer of the full-color pixel is greater than the doping concentration of the n-well layer of the color pixel, so that the full-color pixel has a larger full well capacity than the color pixel; and / or The depth of the n-well layer of the full-color pixel is greater than the depth of the n-well layer of the color pixel, so that the full-color pixel has a larger full well capacity than the color pixel.

7. A control method for an image sensor, characterized in that: The image sensor includes a pixel array and a lens array, wherein the pixel array includes a plurality of color pixels, a plurality of panchromatic pixels, at least one color phase detection pixel pair, and at least one panchromatic phase detection pixel pair; the panchromatic phase detection pixel pair includes two adjacent panchromatic pixels; the color phase detection pixel pair includes two adjacent color pixels of the same color, and the color pixels have a narrower spectral response than the panchromatic pixels; the lens array includes a plurality of first lenses, each of the panchromatic phase detection pixel pairs is covered by the same first lens, and each of the color phase detection pixel pairs is covered by the same first lens; the pixel array includes a minimum repeating unit, and the minimum repeating unit includes a first type of pixel subunit, at least one second type of pixel subunit and at least one third type of pixel subunit, the second type of pixel subunit includes at least one color phase detection pixel pair and at least one panchromatic phase detection pixel pair; wherein the second type of pixel subunit can be formed by the following changes on the basis of the first type of pixel subunit: at least one panchromatic pixel in the first type of pixel subunit is replaced by one color pixel, and the color pixel of the same color adjacent to it forms the color phase detection pixel pair, and at least one color pixel in the first type of pixel subunit is replaced by one panchromatic pixel, and the panchromatic pixel adjacent to it forms the panchromatic phase detection pixel pair, and the control method includes: When the ambient brightness is less than a first threshold, performing focus detection to focus according to the phase information of the panchromatic pixel in the panchromatic phase detection pixel pair; and When the ambient brightness is greater than a second threshold, focus detection is performed according to the phase information of the color pixels in the color phase detection pixel pair to focus, and the second threshold is greater than the first threshold.

8. The control method according to claim 7, characterized in that: The control method further comprises: When the ambient brightness is greater than the first threshold and less than the second threshold, performing focus detection according to the phase information of the panchromatic pixel in the panchromatic phase detection pixel pair to focus; or When the ambient brightness is greater than the first threshold and less than the second threshold, performing focus detection to focus according to the phase information of the color pixels in the color phase detection pixel pair; or When the ambient brightness is greater than the first threshold and less than the second threshold, focus detection is performed according to the phase information of the panchromatic pixels in the panchromatic phase detection pixel pair and the phase information of the color pixels in the color phase detection pixel pair to achieve focus.

9. The control method according to claim 7, characterized in that: Focusing is performed according to the phase information of the panchromatic pixel in the panchromatic phase detection pixel pair and the phase information of the color pixel in the color phase detection pixel pair, comprising: Acquiring phase information of all pixels in the panchromatic phase detection pixel pair and the color phase detection pixel pair; Obtaining first phase information according to phase information of a first panchromatic pixel and phase information of a first color pixel, wherein the first panchromatic pixel is the panchromatic pixel disposed on a first side of the panchromatic phase detection pixel pair, and the first color pixel is the color pixel disposed on a first side of the color phase detection pixel pair; Obtaining second phase information according to phase information of a second panchromatic pixel and phase information of a second color pixel, wherein the second panchromatic pixel is the panchromatic pixel disposed on a second side of the panchromatic phase detection pixel pair, and the second color pixel is the color pixel disposed on a second side of the color phase detection pixel pair, and the second side is disposed opposite to the first side; A phase difference is calculated according to the first phase information and the second phase information to perform focusing.

10. An imaging device, characterized in that: include: Lens; and The image sensor according to any one of claims 1 to 6, wherein the image sensor is capable of receiving light passing through the lens.

11. A terminal, characterized in that: include: case; and The imaging device of claim 10, wherein the imaging device is combined with the housing.

12. A non-volatile computer-readable storage medium containing a computer program, characterized in that: When the computer program is executed by a processor, the processor executes the control method according to any one of claims 7 to 9.

Images