Image sensor, camera module, electronic device and pixel information acquisition method

Abstract

The present application discloses an image sensor, a camera module, an electronic device and a pixel information acquisition method, which belongs to the field of image processing technology. The sensor includes: a plurality of color pixel groups and a plurality of real-sensing pixel groups; each real-sensing pixel group includes at least two real-sensing pixel units; each real-sensing pixel group includes at least two microlenses, and each microlens covers an even number of real-sensing pixel units.

Description

Technical Field

[0001] The present application belongs to the field of image processing technology, and specifically relates to an image sensor, a camera module, an electronic device and a method for acquiring pixel information. Background Art

[0002] With the development of electronic technology, the shooting function of electronic devices has attracted more and more attention. Before shooting through the shooting function of electronic devices, it is necessary to perform a focusing operation. The phase information obtained by the image sensor can be used to assist the focusing operation. If the phase information obtained by the image sensor is inaccurate, the focusing effect may be affected. Summary of the invention

[0003] The purpose of the embodiments of the present application is to provide an image sensor, a camera module, an electronic device and a pixel information acquisition method, which can improve the accuracy of the phase information acquired by the image sensor.

[0004] In a first aspect, an embodiment of the present application provides an image sensor, the image sensor comprising: a plurality of color pixel groups and a plurality of real-sense pixel groups;

[0005] Each real-sense pixel group includes at least two real-sense pixel units;

[0006] Each real-sensing pixel group includes at least two microlenses, and each of the microlenses covers an even number of real-sensing pixel units.

[0007] In a second aspect, an embodiment of the present application provides a camera module, which includes an image sensor as described in the first aspect.

[0008] In a third aspect, an embodiment of the present application provides an electronic device, which includes the camera module as described in the second aspect.

[0009] In a fourth aspect, an embodiment of the present application provides a method for obtaining pixel information, which is applied to the electronic device as described in the third aspect; the method includes:

[0010] Acquire at least two sets of phase information for each real-sensing pixel group, where the number of sets of phase information is equal to the number of microlenses in each real-sensing pixel group;

[0011] According to the at least two groups of phase information, average phase information of each real-sensing pixel group is obtained.

[0012] In a fifth aspect, an embodiment of the present application provides another pixel information acquisition method, which is applied to the electronic device as described in the third aspect; the image sensor in the electronic device further includes a plurality of color pixel control circuits, the color pixel group includes at least two color pixel units, the color pixel control circuit includes a first capacitor and at least two second branches, the second branch includes a photosensitive diode and a second switch connected in series; a first branch is set corresponding to one color pixel unit in the color pixel group, and the method includes:

[0013] In the color pixel control circuit, controlling a first number of second switches to be turned on;

[0014] Reading first pixel information through the first capacitor, where the first pixel information is the sum of pixel information of a first number of color pixel units;

[0015] Controlling a second number of second switches to be turned on;

[0016] Reading second pixel information through the first capacitor, wherein the second pixel information is the sum of pixel information of a third number of color pixel units, and the third number is the sum of the first number and the second number;

[0017] Based on the first pixel information and the second pixel information, color pixel merging information is generated, where the color pixel merging information includes a ratio value of the first quantity to the third quantity.

[0018] In a sixth aspect, an embodiment of the present application provides an electronic device, comprising a camera module, a processor, a memory, and a program or instruction stored in the memory and executable on the processor as described in the second aspect, wherein the program or instruction, when executed by the processor, implements the steps of the pixel information acquisition method as described in the fourth aspect.

[0019] In a seventh aspect, an embodiment of the present application provides a readable storage medium, on which a program or instruction is stored. When the program or instruction is executed by a processor, the steps of the pixel information acquisition method described in the fourth aspect are implemented.

[0020] In an eighth aspect, an embodiment of the present application provides a chip, comprising a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is used to run a program or instruction to implement the pixel information acquisition method as described in the fourth aspect.

[0021] In the ninth aspect, an embodiment of the present application provides an electronic device, which includes a camera module, a processor, a memory, and a program or instruction stored in the memory and executable on the processor as described in the second aspect, and when the program or instruction is executed by the processor, the steps of the pixel information acquisition method described in the fifth aspect are implemented.

[0022] In the tenth aspect, an embodiment of the present application provides a readable storage medium, on which a program or instruction is stored. When the program or instruction is executed by a processor, the steps of the pixel information acquisition method described in the fifth aspect are implemented.

[0023] In the eleventh aspect, an embodiment of the present application provides a chip, which includes a processor and a communication interface, the communication interface is coupled to the processor, and the processor is used to run a program or instruction to implement the pixel information acquisition method as described in the fifth aspect.

[0024] In the embodiment of the present application, the image sensor includes: a plurality of color pixel groups and a plurality of real-sensing pixel groups; each real-sensing pixel group includes at least two real-sensing pixel units; each real-sensing pixel group includes at least two microlenses, and each microlens covers an even number of real-sensing pixel units. Through the technical solution of the embodiment of the present application, by setting each real-sensing pixel group to include at least two microlenses, and setting each microlens to cover an even number of real-sensing pixel units, at least two sets of phase information can be obtained through each real-sensing pixel group, so that the average value of the phase information of the real-sensing pixel group can be calculated using at least two sets of phase information to improve the accuracy of the phase information. BRIEF DESCRIPTION OF THE DRAWINGS

[0025] Figure 1 A schematic diagram of the structure of an image sensor provided in an embodiment of the present application;

[0026] Figure 2 A schematic diagram of the circuit structure of a real-sense pixel control circuit in an image sensor provided in an embodiment of the present application;

[0027] Figure 3 A schematic diagram of the circuit structure of a color pixel control circuit in an image sensor provided by an embodiment of the present application;

[0028] Figure 4 A schematic diagram of a camera module provided in an embodiment of the present application;

[0029] Figure 5 A schematic diagram of a first module of an electronic device provided in an embodiment of the present application;

[0030] Figure 6 A schematic diagram of a flow chart of a first pixel information acquisition method provided in an embodiment of the present application;

[0031] Figure 7 A schematic diagram of a second method for obtaining pixel information provided in an embodiment of the present application;

[0032] Figure 8 A schematic diagram of a second module of an electronic device provided in an embodiment of the present application;

[0033] Fig. 9 A schematic diagram of the hardware structure of a first electronic device provided in an embodiment of the present application;

[0034] Fig.10 A schematic diagram of the hardware structure of a second electronic device provided in an embodiment of the present application.

[0035] Description of reference numerals:

[0036] 101-real-sense pixel group, 102-color pixel group, 103-real-sense pixel unit, 104-color pixel unit, 105-microlens;

[0037] 201-first branch, 2011-first photosensitive diode, 2012-first switch, 202-control module, 203-signal processing module;

[0038] 301 - second branch, 3011 - second photosensitive diode, 3012 - second switch, 302 - first capacitor;

[0039] 400-camera module, 401-image sensor, 402-circuit board, 403-lens;

[0040] 500-electronic equipment, 501-camera module;

[0041] 800-electronic device, 801-camera module, 802-processor, 803-memory;

[0042] 900-electronic device, 901-RF unit, 902-network module, 903-audio output unit, 904-input unit, 9041-graphics processor, 9042-microphone, 905-sensor, 906-display unit, 9061-display panel, 907-user input unit, 9071-touch panel, 9072-other input devices, 908-interface unit, 909-memory, 910-processor, 911-camera module;

[0043] 1000-electronic device, 1001-radio frequency unit, 1002-network module, 1003-audio output unit, 1004-input unit, 10041-graphics processor, 10042-microphone, 1005-sensor, 1006-display unit, 10061-display panel, 1007-user input unit, 10071-touch panel, 10072-other input devices, 1008-interface unit, 1009-memory, 1010-processor, 1011-camera module. DETAILED DESCRIPTION

[0044] The following will be combined with the drawings in the embodiments of the present application to clearly describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, rather than all the embodiments. All other embodiments obtained by ordinary technicians in this field based on the embodiments in the present application belong to the scope of protection of this application.

[0045] The terms "first", "second", etc. in the specification and claims of the present application are used to distinguish similar objects, and are not used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable under appropriate circumstances, so that the embodiments of the present application can be implemented in an order other than those illustrated or described here, and the objects distinguished by "first", "second", etc. are generally of one type, and the number of objects is not limited. For example, the first object can be one or more. In addition, "and / or" in the specification and claims represents at least one of the connected objects, and the character " / " generally indicates that the objects associated with each other are in an "or" relationship.

[0046] The processor provided in the embodiment of the present application is described in detail below through specific embodiments and their application scenarios in conjunction with the accompanying drawings.

[0047] Figure 1 A schematic diagram of the structure of an image sensor provided in an embodiment of the present application.

[0048] The image sensor includes: a plurality of color pixel groups 102 and a plurality of real-sensing pixel groups 101 ; each real-sensing pixel group 101 includes at least two real-sensing pixel units 103 ; each real-sensing pixel group 101 includes at least two microlenses 105 , and each microlens 105 covers an even number of real-sensing pixel units 103 .

[0049] like Figure 1 As shown, each real-sense pixel group may include six real-sense pixel units 103, and each color pixel group may include six color pixel units 104. Each real-sense pixel group 101 may include three microlenses 105, and each microlens 105 may cover two real-sense pixel units 103 in the real-sense pixel group 101.

[0050] The real-sensing pixel unit 103 can sense the change of the brightness of the external environment in real time with the pixel clock frequency, convert the change of the ambient brightness into a change of the current, and then convert it into a change of the digital signal. The real-sensing pixel unit 103 has good real-time performance, better signal redundancy and higher precision. The real-sensing pixel unit can be used to capture the motion information of dynamic objects. Each microlens 105 covers an even number of real-sensing pixel units 103, and the even number of real-sensing pixel units 103 covered by each microlens 105 can also obtain at least one set of phase information of the photographed object.

[0051] For example, each microlens 105 covers two real-sensing pixel units 103, and the two real-sensing pixel units 103 can obtain a set of phase information. Alternatively, each microlens 105 covers four real-sensing pixel units 103, and the two real-sensing pixel units 103 can obtain two sets of phase information.

[0052] Optionally, the number of microlenses 105 corresponding to a real-sensing pixel group 101 is a ratio of a first number to a second number, wherein the first number is the total number of real-sensing pixel units 103 in a real-sensing pixel group 101, and the second number is the number of real-sensing pixel units 103 covered by each microlens 105 in a real-sensing pixel group 101.

[0053] For example, each real-sense pixel group 101 includes 6 real-sense pixel units 102, and each microlens covers 2 real-sense pixel units, so each real-sense pixel group 101 includes 3 microlenses 105. That is, the first number is 6, the second number is 2, and the number of microlenses 105 corresponding to one real-sense pixel group 101 is 6 / 2=3.

[0054] For another example, each real-sensing pixel group 101 includes 12 real-sensing pixel units 102, and each microlens covers 4 real-sensing pixel units 103, then each real-sensing pixel group 101 includes 3 microlenses 105, that is, the first number is 12, the second number is 4, and the number of microlenses 105 corresponding to one real-sensing pixel group 101 is 12 / 4=3.

[0055] By calculating the ratio of the first number to the second number, the number of microlenses 105 corresponding to a real-sense pixel group 101 can be determined, and further the number of groups of phase information that can be obtained by a real-sense pixel 101 can be determined.

[0056] The number of phase information groups acquired through each real-sensing pixel group 101 may be equal to the number of microlenses in each real-sensing pixel group.

[0057] For example, each real-sensing pixel group 101 includes six real-sensing pixel units 102 , each microlens covers two real-sensing pixel units 103 , and each real-sensing pixel group 101 includes three microlenses 105 , then each real-sensing pixel group 101 can obtain three sets of phase information.

[0058] For another example, each real-sensing pixel group 101 includes 12 real-sensing pixel units 102 , each microlens covers 2 real-sensing pixel units 103 , and each real-sensing pixel group 101 includes 6 microlenses 105 , then each real-sensing pixel group 101 can obtain 6 sets of phase information.

[0059] The phase information can be used to assist the camera module in focusing. The camera module can be a camera module including the image sensor provided in this embodiment, or a camera module not including the image sensor provided in this embodiment. In the case where the camera module does not include the image sensor provided in this embodiment, the camera module can receive at least one set of phase information sent by the image sensor provided in this embodiment.

[0060] The process of the real-sensing pixel group 101 acquiring a set of phase information through the corresponding microlens 105 can be that the incident light is divided into two beams of light when passing through the microlens 105, and the two beams of light are respectively received by two real-sensing pixel units 103 in the real-sensing pixel group 101. Each real-sensing pixel unit 103 can obtain corresponding phase information based on the analysis of a received beam of light. The phase information corresponding to a beam of light can be information on the alternating waveform changes presented by the vibration of photons when the light wave moves forward. Due to the different positions of the two real-sensing pixel units 103, there is a phase difference in the waveforms of the two beams of light, and the phase difference can be reflected by the difference between the two sub-phase information.

[0061] The color pixel unit 104 can absorb light within a specified wavelength range, thereby obtaining brightness information of the light within the wavelength range.

[0062] exist Figure 1 In the illustrated embodiment of the image sensor, the image sensor includes: a plurality of color pixel groups and a plurality of real-sensing pixel groups; each real-sensing pixel group includes at least two real-sensing pixel units; each real-sensing pixel group includes at least two microlenses, and each microlens covers an even number of real-sensing pixel units. Through the technical solution of the embodiment of the present application, by setting each real-sensing pixel group to include at least two microlenses, and setting each microlens to cover an even number of real-sensing pixel units, at least two sets of phase information can be obtained through each real-sensing pixel group, so that the average value of the phase information of the real-sensing pixel group can be calculated using the at least two sets of phase information to improve the accuracy of the phase information.

[0063] Optionally, the image sensor also includes at least two real-sensing pixel control circuits; the real-sensing pixel control circuit includes an even number of first branches 201, a control module 202 and a signal processing module 203; one first branch 201 is correspondingly arranged for one real-sensing pixel unit 103; one microlens 105 is correspondingly arranged for one real-sensing pixel control circuit; each first branch 201 is respectively connected in series with the control module 202; the control module 202 is connected in series with the signal processing module 303.

[0064] Figure 2 A schematic diagram of the circuit structure of a real-sense pixel control circuit in an image sensor provided in an embodiment of the present application.

[0065] The real-sense pixel control circuit may include two first branches 201, and the first branch 201 includes a first photosensitive diode 2011 and a first switch 2012 connected in series. The first switch 2012 may be a control switch of the first photosensitive diode 2011, and the first switch 2012 may be a triode or other types of switch devices.

[0066] Each real-sense pixel unit 103 may include a first photosensitive diode 2011. Then, a first branch 201 is correspondingly provided for a real-sense pixel unit 103 in the real-sense pixel group 101, and the first photosensitive diode 2011 included in the corresponding first branch 201 is the first photosensitive diode 2011 included in the real-sense pixel unit 103.

[0067] The first photosensitive diode 2011 is used to generate a photosensitive signal, and the photosensitive signal can be regarded as pixel information obtained by the real-sensing pixel unit 103 after exposure.

[0068] When a first switch 2012 is turned on, the photosensitive signal generated by the first photosensitive diode 2011 connected in series with the first switch 2012 can be output to the next node of the first branch 201 in the real-sensing pixel control circuit, that is, the control module 202 .

[0069] The control module 202 may receive a photosensitive signal from each of the first branches 201 that are turned on. If the number of first branches 201 that are turned on at the same time is greater than one, the control module 202 may receive the sum of the photosensitive signals of the greater than one first branch 201. The control module may be used to determine whether to execute a preset control instruction based on a comparison between the received photosensitive signal and a preset threshold.

[0070] like Figure 2 As shown, the real-sense pixel control circuit includes two first branches 201. Each of the two first branches 201 is connected in series with a control module 202. The control module 202 is connected in series with a signal processing module 203.

[0071] By setting each of the at least two first branches 201 to be connected in series with the control module 202 and the control module 202 to be connected in series with the signal processing module 303, the real-sensing pixel control circuit can obtain phase information, and the real-sensing pixel control circuit can perform an exposure once within a preset time range through different first branches 201, thereby obtaining motion information of the photographed object.

[0072] Optionally, among an even number of real-sensing pixel units 103 covered by one microlens 105 , the coverage area of ​​each real-sensing pixel unit 103 by the microlens 105 is the same.

[0073] like Figure 1 As shown, the even number of real-sensing pixel units 103 covered by one microlens 105 is 2 real-sensing pixel units 103 , and the coverage area of ​​the microlens 105 for each real-sensing pixel unit 103 is semicircular, and the areas of the two semicircles are the same.

[0074] By setting the microlens 105 to cover the same area of ​​each real-sensing pixel unit 103 , the photosensitive area of ​​each real-sensing pixel unit 103 can be equal, so that the value of the photosensitive signal generated by each real-sensing pixel unit 103 after exposure is equal.

[0075] Optionally, one microlens 105 covers two real-sensing pixel units 103, and the two real-sensing pixel units 103 include a first real-sensing pixel unit and a second real-sensing pixel unit; the lens cross section of the microlens 105 is a circle of a first size, and the lens cross section is a cross section parallel to the cross section of the real-sensing pixel unit 103; the cross section of the first real-sensing pixel unit and the cross section of the second real-sensing pixel unit form a parallelogram of a second size; the circle of the first size is an inscribed circle of the parallelogram.

[0076] The microlens 105 may be a hemispherical lens or a lens of other shapes, and the lens interface of the microlens may be a circle of a first size. The lens interface may be a cross section parallel to the cross section of the real-sense pixel unit 103 .

[0077] The cross section of the real-sense pixel unit 103 may be a triangle, and the real-sense pixel unit 103 with a triangular cross section may be regarded as a triangular prism. The first photosensitive diode 2011 in the real-sense pixel unit 103 may also be regarded as a triangular photosensitive area.

[0078] Reference Figure 1 As shown, the two real-sense pixel units include a first real-sense pixel unit and a second real-sense pixel unit, and the cross-section of the first real-sense pixel unit and the cross-section of the second real-sense pixel unit form a parallelogram of a second size, that is, two triangles of equal area and size form a parallelogram.

[0079] In a specific implementation, the cross section of the real-sense pixel unit 103 may be an equilateral triangle, and the cross sections of two real-sense pixel units 103 may form a parallelogram composed of two equilateral triangles.

[0080] The circle of the first size is the inscribed circle of the parallelogram.

[0081] By setting the cross section of the real-sense pixel unit 103 to a triangle, the cross section of the first real-sense pixel unit and the cross section of the second real-sense pixel unit can form a parallelogram, and by setting the lens cross section of the microlens 105 to be the inscribed circle of the parallelogram, on the one hand, it can be ensured that the coverage area of ​​each real-sense pixel unit 103 by the microlens 105 is the same, and on the other hand, it can be avoided that the microlens 105 covers other real-sense pixel units or color pixel units outside the real-sense pixel group 101. On the other hand, the area of ​​the microlens 105 is larger, and more light can be obtained during the photosensitization process.

[0082] Optionally, the image sensor further includes a plurality of color pixel control circuits; a color pixel group includes at least two color pixel units 104; and a color pixel control circuit is correspondingly arranged for at least one color pixel unit 104.

[0083] like Figure 1 As shown, the color pixel group 102 may include six color pixel units 104 .

[0084] At least one color pixel unit 104 is provided with a color pixel control circuit, which may be one color pixel unit 104, one color pixel control circuit may be provided with two color pixel units 104, or one color pixel control circuit may be provided with N color pixel units 104. N is a natural number greater than two.

[0085] It should be noted that, in the case where one color pixel control circuit is correspondingly provided for at least two color pixel units 104, the wavelength range of light absorbed by each color pixel unit 104 of the at least two color pixel units 104 is the same. For example, if the wavelength range of light absorbed by one color pixel unit 104 corresponds to red light, and the wavelength range of light absorbed by another color pixel unit 104 corresponds to blue light, then the two color pixel units 104 cannot be correspondingly provided with the same color pixel control circuit.

[0086] By setting at least two color pixel units 104 to correspond to one color pixel control circuit, when the light conditions corresponding to the band range are poor, the pixel information obtained by multiple color pixel units 104 with the same band range of absorbed light can be merged and output, thereby increasing the minimum brightness that can be accurately identified by the color pixel control circuit and expanding the dynamic range of the brightness information corresponding to the pixel information obtained by the color pixel unit 104.

[0087] The dynamic range of the brightness information corresponding to the pixel information obtained by the color pixel unit 104 may be the ratio of the highest brightness to the lowest brightness corresponding to the photosensitive signal generated by the photosensitive diode 3011. In the real-sensing pixel control circuit, by synchronously transmitting the photosensitive signals generated by the plurality of first photosensitive diodes 2012 to the control module 202, the lowest brightness that can be accurately identified by the color pixel control circuit can be increased, thereby expanding the dynamic range of the photosensitive signal.

[0088] Optionally, the color pixel control circuit includes a first capacitor 302 and at least one second branch 301; the second branch 301 includes a photosensitive diode and a control switch connected in series; a second branch is set corresponding to one color pixel unit 104 in the color pixel group 102; when there are at least two second branches, at least two second branches are respectively connected in series with the first capacitor 302.

[0089] Figure 3 A schematic diagram of the circuit structure of a color pixel control circuit in an image sensor provided in an embodiment of the present application.

[0090] The photosensitive diode included in the second branch 301 can refer to Figure 3 The second photosensitive diode 3011 is shown. The control switch included in the second branch 301 can refer to Figure 3 A second switch 3012 is shown.

[0091] The second switch 3012 may be a control switch of the second photodiode 3011 . The second switch 3012 may be a transistor or other types of switch devices.

[0092] The second photodiode 3011 can generate charge when receiving light irradiation, that is, the second photodiode 3011 generates charge after exposure. When the second switch 3012 is disconnected, the charge cannot flow to the first capacitor 302, and the pixel information generated by the exposure cannot be read. When the second switch 3012 is turned on, the charge can flow to the first capacitor 302 through the second switch 3012, and the pixel information generated by the exposure can be read through the first capacitor 302.

[0093] For example, when a second switch 3012 is turned on, the charge generated by the second photodiode 3011 connected in series with the turned-on second switch 3012 due to light irradiation flows to the first capacitor 302 through the turned-on second switch 3012, so that the voltage across the first capacitor 302 decreases. For example, the voltage across the first capacitor 302 is 3V when the second switch 3012 is turned off. When the second switch 3012 is switched from an off state to an on state, the charge flows from the second photodiode 3011 to the first capacitor 302, so that the voltage across the first capacitor 302 decreases to 2.9V. Then, the change in the voltage value across the first capacitor 302 is 0.1V, and the 0.1V can reflect the light intensity information of the light received by the second photodiode 3011.

[0094] The greater the light intensity of the light received by the second photodiode 3011, the greater the change in the voltage value across the first capacitor 302; the smaller the light intensity of the light received by the second photodiode 3011, the smaller the change in the voltage value across the first capacitor 302. By changing the exposure time of the second photodiode 3011, or by changing the light conditions when the second photodiode 3011 is exposed, the light intensity of the light received by the second photodiode 3011 can be changed. For example, under the same light conditions, when the exposure time is 1ms, the change in the voltage value across the first capacitor 302 is 0.05V, and when the exposure time is 3ms, the change in the voltage value across the first capacitor 302 is 0.15V.

[0095] Each color pixel unit 104 may include a second photosensitive diode 3011. Each color pixel unit 104 may also include a filter, or may not include a filter, but include other electronic devices with a filtering effect. In a color pixel unit 104, the filter may be arranged on the second photosensitive diode 3011, and the cross section of the filter may have the same shape as the cross section of the color pixel unit 104.

[0096] The filter can be used to filter light outside a preset wavelength range, and the preset wavelength range can be a corresponding wavelength of the three primary colors of optics: red, green, and blue. For example, a red filter can filter out light outside of red, and only red light can pass through the filter to reach the second photosensitive diode 3011.

[0097] like Figure 3As shown, the color pixel control circuit may include two second branches 301, and each second branch 301 may include a second photosensitive diode 3011 and a second switch 3012 connected in series. Each second branch 301 is respectively connected in series with the first capacitor 302. One second branch 301 is correspondingly provided for one color pixel unit 104 in the color pixel group 102, and the second photosensitive diode 3011 included in the corresponding second branch 301 is the second photosensitive diode 3011 included in the one color pixel unit 104.

[0098] For a color pixel unit 104 in the color pixel group 102, by correspondingly setting a second branch 301, one or more color pixel units 103 can be flexibly controlled to output pixel information or not output pixel information. In the case of at least two second branches 301, at least two second branches 301 are respectively connected in series with the first capacitor 302, so that the charges generated by the second photodiodes 3011 in the two second branches 301 can flow to the first capacitor 302, thereby increasing the amount of charges received by the first capacitor 302, improving the minimum brightness that can be accurately identified by the color pixel control circuit under poor light conditions, and expanding the dynamic range of brightness information corresponding to the pixel information obtained by the color pixel unit 104.

[0099] In one embodiment, each color pixel group 102 may include six color pixel units 104; wherein the cross-section of the color pixel unit 104 is a triangle; the cross-section of the six color pixel units 104 in the color pixel group 102 forms a hexagon; in each color pixel group 102, the wavelength range of light absorbed by two color pixel units 104 that are centrally symmetrically arranged is the same, and the wavelength range of light absorbed by two color pixel units 104 that are adjacent to each other is different.

[0100] like Figure 1 As shown, each color pixel group 102 may include six color pixel units 104; wherein the cross-section of the color pixel unit 104 may be a triangle; and the cross-sections of the six color pixel units in the color pixel group may form a hexagon.

[0101] In the hexagon formed by the cross sections of the six color pixel units 104 in each color pixel group 102, six triangles may be located at the top, bottom, top left, bottom left, top right and bottom right of the hexagon, respectively. The triangles at the top and bottom are centrally symmetrical; the triangles at the top left and bottom right are centrally symmetrical; and the triangles at the top right and bottom left are centrally symmetrical.

[0102] The wavelength range of light absorbed by the color pixel unit 104 corresponding to the triangle directly above is the same as the wavelength range of light absorbed by the color pixel unit 104 corresponding to the triangle directly below; the wavelength range of light absorbed by the color pixel unit 104 corresponding to the triangle at the upper left is the same as the wavelength range of light absorbed by the color pixel unit 104 corresponding to the triangle at the lower right; the wavelength range of light absorbed by the color pixel unit 104 corresponding to the triangle at the upper right is the same as the wavelength range of light absorbed by the color pixel unit 104 corresponding to the triangle at the lower left.

[0103] Furthermore, the wavelength range of light absorbed by the color pixel unit 104 corresponding to the triangle directly above is different from the wavelength range of light absorbed by the color pixel unit 104 corresponding to the triangle on the upper right; the wavelength range of light absorbed by the color pixel unit 104 corresponding to the triangle on the upper right is different from the wavelength range of light absorbed by the color pixel unit 104 corresponding to the triangle on the lower right… The wavelength range of light absorbed by the color pixel unit 104 corresponding to the triangle on the upper left is different from the wavelength range of light absorbed by the color pixel unit 104 corresponding to the triangle directly above.

[0104] For example, the wavelength range of light absorbed by the color pixel units 104 corresponding to the triangles directly above and below corresponds to red; the wavelength range of light absorbed by the color pixel units 104 corresponding to the triangles at the upper left and lower right corresponds to green; and the wavelength range of light absorbed by the color pixel units 104 corresponding to the triangles at the upper right and lower left corresponds to blue.

[0105] By setting the cross section of the color pixel unit 104 to be a triangle, the cross sections of the six color pixel units 104 in the color pixel group 102 form a hexagon; in each color pixel group 102, the wavelength ranges of the light absorbed by the two color pixel units 104 that are centrally symmetrical are the same, and the wavelength ranges of the light absorbed by the two adjacent color pixel units 104 are different. This allows the six color pixel units 104 in each color pixel group 102 to include two color pixel units 104 that absorb red light, two color pixel units 104 that absorb green light, and two color pixel units 104 that absorb blue light. This allows the pixel information of the two color pixel units 104 to be combined and output to expand the dynamic range of the brightness information, while preventing the color resolution of the color pixel group 102 from being reduced.

[0106] In one embodiment, the plurality of color pixel groups 102 include a first color pixel group and a second color pixel group, and the first color pixel group and the second color pixel group are adjacently arranged; the first color pixel group includes a first color pixel unit, and the second color pixel group includes a second color pixel unit, and the first color pixel unit and the second color pixel unit are adjacently arranged; the first color pixel unit and the second color pixel unit absorb the same wavelength range of light.

[0107] The first color pixel group may include six color pixel units 104, and the cross section of each color pixel unit 104 may be a triangle; the cross sections of the six color pixel units 104 in the first color pixel group may form a hexagon. In the hexagon formed by the cross sections of the six color pixel units 104 in the first color pixel group, the six triangles may be located directly above, directly below, to the upper left, to the lower left, to the upper right, and to the lower right of the hexagon, respectively. The first color pixel unit may be the color pixel unit 104 corresponding to the triangle directly above.

[0108] The second color pixel group may include six color pixel units 104, each of which may have a triangular cross section; the cross sections of the six color pixel units 104 in the second color pixel group may form a hexagon. In the hexagon formed by the cross sections of the six color pixel units 104 in the second color pixel group, the six triangles may be located directly above, directly below, to the upper left, to the lower left, to the upper right, and to the lower right of the hexagon, respectively. The second color pixel unit may be the color pixel unit 104 corresponding to the triangle directly below.

[0109] The first color pixel unit and the second color pixel unit are arranged adjacent to each other, which can be expressed as follows: the hexagon formed by the cross-sections of the six color pixel units 104 in the first color pixel group can be located directly below the hexagon formed by the cross-sections of the six color pixel units 104 in the second color pixel group, and the first color pixel unit can be adjacent to the second color pixel unit.

[0110] If the wavelength range of light absorbed by the first color pixel unit and the second color pixel unit is the same, then the two color pixel units 104 that are adjacent to each other and absorb the same wavelength range of light can be configured with the same color pixel control circuit, thereby merging and outputting the pixel information obtained by the first color pixel unit and the second color pixel unit to improve the dynamic range of brightness.

[0111] In one embodiment, the second branch 301 includes a second photosensitive diode 3011 and a second switch 3012 in the first color pixel unit; when the second switch 3012 in the first color pixel unit is turned on, the first end of the second photosensitive diode 3011 in the first color pixel unit is connected to the first end of the first capacitor 302, and the second end of the second photosensitive diode 3011 in the first color pixel unit is grounded.

[0112] The second end of the second photodiode 3011 in the first color pixel unit is grounded. Figure 3 As shown, when the second switch 3012 in the first color pixel unit is turned on, the first end of the second photodiode 3011 in the first color pixel unit is connected to the first end of the first capacitor 302 through the turned-on second switch 3012.

[0113] By controlling the second switch 3012 to be turned on, the charges generated by light irradiation in the second photodiode 3011 in the first color pixel unit can flow to the first capacitor 302. Figure 3 As shown, when the first second switch 3012 is controlled to be turned on, the voltage across the first capacitor 302 can reflect the pixel information obtained by one second photosensitive diode 3011. When the first second switch 3012 is kept turned on and the second second switch 3012 is controlled to be turned on, the voltage across the first capacitor 302 can reflect the sum of the pixel information obtained by the two second photosensitive diodes 3011. Since the photosensitive area of ​​each second photosensitive diode 3011 is the same, the sum of the pixel information obtained by the two second photosensitive diodes 3011 can be equal to twice the pixel information obtained by one second photosensitive diode 3011. For example, the number of charges generated by a second photosensitive diode 3011 after exposure is 5000 electrons. After the 5000 electrons flow to the first capacitor 302, the voltage of the first capacitor 302 is reduced by 0.05V. Then, the sum of the numbers of charges generated by the two second photosensitive diodes 3011 after exposure is 10000 electrons. After the 10000 electrons flow to the first capacitor 302, the voltage of the first capacitor 302 is reduced by 0.1V.

[0114] Therefore, by controlling the number of the turned-on second switches 3012 in the color pixel control circuit, color pixel merging information of different ratios can be flexibly obtained, for example, color pixel merging information of 1:2.

[0115] Optionally, the ratio of the number of the plurality of color pixel groups 102 to the number of the plurality of real-sense pixel groups 101 is less than a first ratio threshold and greater than a second ratio threshold.

[0116] The real-sense pixel group 101 can obtain the motion state of the photographed object, but cannot obtain the color information of the photographed object, and the color pixel group 102 can obtain the color information and brightness information of the photographed object, but cannot obtain the motion state of the photographed object. The image sensor may include a first preset number of color pixel groups 102 and a second preset number of real-sense pixel groups 101. The ratio of the first preset number to the second preset number may be a preset ratio. The preset ratio may be less than a first ratio threshold and greater than a second ratio threshold.

[0117] In the image sensor, by setting the ratio of the number of multiple color pixel groups 102 to the number of multiple real-sense pixel groups 101, the density of the real-sense pixel groups 101 in the image sensor can be controlled, so that the image sensor can maintain a high color resolution and accurately obtain the motion state of the photographed object.

[0118] Optionally, the first ratio threshold is 5% and the second ratio threshold is 1%.

[0119] The ratio of the number of the plurality of color pixel groups 102 to the number of the plurality of real-sense pixel groups 101 may be less than 5% and greater than 1%.

[0120] For example, the image sensor includes 2 million pixel groups, each of which is a real-sense pixel group 101 or a color pixel group 102, each real-sense pixel group 101 includes 6 real-sense pixel units 103, and each color pixel group 102 includes 6 color pixel units 104. The 2 million pixel groups may include 60,000 real-sense pixel groups 101 and 1.94 million color pixel groups, and the ratio of the number of the plurality of color pixel groups 102 to the number of the plurality of real-sense pixel groups 101 is 3%, which satisfies the requirement of being greater than 1% and less than 5%.

[0121] By setting the first ratio threshold to 5% and the second ratio threshold to 1%, on the one hand, the number of real-sensing pixel groups 101 can be much smaller than the number of color pixels 103, thereby avoiding reducing the color resolution of the image sensor; on the other hand, by setting the number ratio to be greater than 1% and less than 5%, the density of the real-sensing pixel group 101 in the image sensor can support the real-sensing pixel group to accurately obtain the motion state of the photographed object.

[0122] Optionally, 31 color pixel groups 102 are correspondingly arranged for each real-sense pixel group 101 .

[0123] In a preferred implementation, each real-sense pixel group 101 may be provided with 31 corresponding color pixel groups 102 .

[0124] For example, the image sensor may include N pixel arrays arranged in the same manner, where N is a natural number greater than 1. Each pixel array includes 31 color pixel groups 102 and 1 real-sense pixel group 101. In each pixel array, the density of the real-sense pixel group 101 may be 1 / 32. In the image sensor, the density of the real-sense pixel group 101 may be 1 / 32.

[0125] By setting each real-sensing pixel group 101 to correspond to 31 color pixel groups 102, the density of the real-sensing pixel groups 101 in the image sensor can be controlled, which can avoid reducing the color resolution of the image sensor and support the real-sensing pixel groups 101 to accurately obtain the motion state of the photographed object.

[0126] Based on the same technical concept as the aforementioned image sensor embodiment, the embodiment of the present application also provides a camera module. Figure 4 A module schematic diagram of a camera module provided in an embodiment of the present application.

[0127] like Figure 4 As shown, the camera module 400 includes an image sensor 401 .

[0128] The image sensor 401 may include various structures in the aforementioned image sensor embodiments, which will not be described in detail here.

[0129] Optionally, the camera module 400 further includes:

[0130] A circuit board 402, the image sensor 401 is electrically connected to the circuit board 402;

[0131] The lens 403 is disposed on a side of the image sensor 401 away from the circuit board 402 .

[0132] The number of lenses 403 may be one or at least two, and this specification does not limit the number of lenses.

[0133] Based on the same technical concept as the aforementioned camera module embodiment, the embodiment of the present application also provides an electronic device. Figure 5 A schematic diagram of a first module of an electronic device provided in an embodiment of the present application.

[0134] like Figure 5 As shown, the electronic device 500 includes a camera module 501.

[0135] The camera module 501 may include various structures as described in the aforementioned camera module embodiments, which will not be described in detail here.

[0136] Figure 6This is a flow chart of a first pixel information acquisition method provided in an embodiment of the present application. The pixel information acquisition method provided in this embodiment is applied to an electronic device provided in the aforementioned electronic device embodiment.

[0137] Step 602: Obtain at least two sets of phase information for each real-sensing pixel group, where the number of sets of phase information is equal to the number of microlenses in each real-sensing pixel group.

[0138] At least two sets of phase information can be obtained through each real-sensing pixel group, and the number of phase information sets is equal to the number of microlenses in each real-sensing pixel group. The acquisition of phase information through the real-sensing pixel group can refer to the above-mentioned image sensor embodiment.

[0139] For example, each real-sensing pixel group 101 includes 6 real-sensing pixel units 102 and 3 microlenses 105, and each real-sensing pixel group 101 can obtain 3 sets of phase information. For another example, each real-sensing pixel group 101 includes 12 real-sensing pixel units 102 and 6 microlenses 105, and each real-sensing pixel group 101 can obtain 6 sets of phase information.

[0140] Step 604: Obtain average phase information of each real-sensing pixel group based on at least two groups of phase information.

[0141] By calculating the average value of at least two sets of phase information, the average phase information of each real-sensing pixel group can be obtained. For example, 10 sets of phase information are obtained from each real-sensing pixel group, and each set of phase information includes left phase information and right phase information. Then, the average values ​​of 10 left phase information and 10 right phase information can be calculated as the average phase information of the real-sensing pixel group; or, the phase information differences of the 10 sets of phase information can be calculated respectively, and then the average value of the 10 phase information differences can be calculated as the average phase information of the real-sensing pixel group.

[0142] Optionally, after step 604 is executed, the pixel information acquisition method further includes: determining focus information according to average phase information of at least one real-sense pixel group; and controlling the focus of the camera module based on the focus information.

[0143] The focus information is determined based on the average phase information of at least one real-sensing pixel group. The distance from the photographed object corresponding to each real-sensing pixel group to the electronic device can be determined based on the average phase information, thereby generating a distance matrix. The focus information can be determined based on the distance matrix, and the focus of the camera module can be controlled based on the focus information.

[0144] By determining the information through averaging the phase information and then controlling the focus of the camera module, it is possible to reduce the focus inaccuracy caused by a small amount of phase information with serious errors.

[0145] exist Figure 6In the method embodiment shown, at least two sets of phase information are obtained for each real-sensing pixel group, and the number of sets of phase information is equal to the number of microlenses in each real-sensing pixel group; based on the at least two sets of phase information, the average phase information of each real-sensing pixel group is obtained. Through this technical solution, multiple sets of phase information with similar positions can be averaged, which improves the accuracy of the phase information and reduces the inaccurate focusing caused by a small amount of phase information with serious errors.

[0146] Figure 7 A flow chart of a second pixel information acquisition method provided in an embodiment of the present application. The pixel information acquisition method provided in this embodiment is applied to an electronic device as provided in the aforementioned electronic device embodiment. The image sensor in the electronic device also includes a plurality of color pixel control circuits, the color pixel group includes at least two color pixel units, the color pixel control circuit includes a first capacitor and at least two second branches, the second branch includes a photosensitive diode and a control switch connected in series; a second branch is provided for each color pixel unit in the color pixel group.

[0147] Step 702: In a color pixel control circuit, control a first number of control switches to be turned on.

[0148] The first number may be one or greater than one.

[0149] Before controlling the first number of control switches to be turned on, an exposure operation may be performed on each photodiode in the color pixel control circuit. The exposure operation may be a manual exposure operation triggered manually or an automatic exposure operation triggered at a preset period.

[0150] Optionally, before step 702 is executed, the pixel information acquisition method provided in this embodiment further includes: acquiring the color pixel sensitivity ratio; and determining a first number of switches turned on for the first time and a second number of switches turned on for the second time according to the color pixel sensitivity ratio.

[0151] The color pixel sensitivity ratio may be a quantitative ratio set when the user wishes to obtain 1:N color pixel merging information, that is, 1:N. N is a natural number greater than 1. For example, when the user wishes to obtain 1:3 color pixel merging information, the color pixel sensitivity ratio is set to 1:3. The color pixel sensitivity ratio may also be 1:N:M, for example, 1:2:3. The embodiment of the present application does not impose any special restrictions on the form of the color pixel sensitivity ratio.

[0152] According to the acquired color pixel sensitivity ratio, the first number of switches turned on for the first time and the second number of switches turned on for the second time can be determined. The sum of the first number and the second number is the third number, and the color pixel sensitivity ratio can be the ratio of the first number to the third number, so the first number and the second number can be determined by the color pixel sensitivity ratio.

[0153] Since the photosensitive area of ​​the photodiode of each color pixel unit is the same, the color pixel information obtained when N control switches are turned on can be N times the color pixel information obtained when only one control switch is turned on.

[0154] For example, when the color pixel sensitivity ratio is 1:3, it can be determined that the first number of switches turned on for the first time is 1, and the second number of switches turned on for the second time is 2.

[0155] Taking the color pixel sensitivity ratio of 1:3 as an example, it should be noted that when the user only needs 3 times the color pixel information and does not need 1 times the color pixel information, only one switch can be turned on to control the 3 control switches to be turned on, and the sum of the pixel information of the three color pixel units can be read through the first capacitor.

[0156] By acquiring the color pixel sensitivity ratio and determining the first number of switches turned on for the first time and the second number of switches turned on for the second time according to the color pixel sensitivity ratio, the number of switches turned on twice can be predetermined to determine how to control the color pixel control circuit.

[0157] Step 704 : read first pixel information through a first capacitor, where the first pixel information is the sum of pixel information of a first number of color pixel units.

[0158] If the first number is one, the first number of color pixel units is one color pixel unit, and the first pixel information is the pixel information of the one color pixel unit. The pixel information of the one color pixel unit can be read through the first capacitor in the color pixel control circuit.

[0159] If the first number is greater than one, the first pixel information is the sum of the pixel information of the first number of color pixel units. The sum of the pixel information of the first number of color pixel units collected on the first capacitor can be read through the first capacitor in the color pixel control circuit.

[0160] Step 706: Control a second number of control switches to be turned on.

[0161] The first number may be the same as the second number, or may be different from the second number. The second number may be one, or a natural number greater than one. It should be noted that there are no duplicate control switches between the first number of control switches and the second number of control switches.

[0162] When the first number of control switches are kept turned on, the second number of control switches are controlled to be turned on, and then in the color pixel control circuit, the third number of control switches are all in the turned-on state.

[0163] Step 708 , reading second pixel information through the first capacitor, wherein the second pixel information is the sum of pixel information of a third number of color pixel units, and the third number is the sum of the first number and the second number.

[0164] The sum of pixel information of a first number of color pixel units collected on the first capacitor and the sum of pixel information of a second number of color pixel units can be read through the first capacitor in the color pixel control circuit, that is, the sum of pixel information of a third number of color pixel units collected on the first capacitor can be read through the first capacitor in the color pixel control circuit.

[0165] For example, the first number is 1, the second number is 1, and the third number is 2. Reading the color pixel information of two color pixel units through the first capacitor is equivalent to obtaining twice the color pixel information of one color pixel unit.

[0166] Step 710: Generate color pixel merging information based on the first pixel information and the second pixel information, where the color pixel merging information includes a ratio of the first quantity to the third quantity.

[0167] Since the photosensitive area of ​​the photodiode in each color pixel unit is the same, the color pixel merging information generated by the first pixel information and the second pixel information can achieve binning (pixel merging) outputs of different proportions. Through one exposure, two images of the first quantity and the third quantity can be obtained, thereby expanding the dynamic range of the color pixel information of the color pixel.

[0168] For example, one control switch is first controlled to be turned on to read the first pixel information, and then another control switch is controlled to be turned on to read the second pixel information, then 1:2 color pixel merging information can be generated according to the first pixel information and the second pixel information. The color pixel merging information includes the ratio of the first quantity 1 to the third quantity 2.

[0169] In another embodiment, after step 608 is executed, a fourth number of control switches can be controlled to be turned on, and third pixel information can be read through the first capacitor, where the third pixel information is the sum of pixel information of a fifth number of color pixel units, and the fifth number is the sum of the third number and the fourth number.

[0170] For example, first one control switch is controlled to be turned on to read the first pixel information, then another control switch is controlled to be turned on to read the second pixel information, and then another control switch is controlled to be turned on to read the third pixel information, thereby obtaining 1:2:3 color pixel merging information.

[0171] Optionally, after step 710 is executed, the pixel information acquisition method may further include: generating RGB color values ​​corresponding to a third number of color pixel units according to the color merged pixel information.

[0172] It should be noted that, in the at least two branches included in the color pixel control circuit, the wavelength range of the light absorbed by the color pixel unit corresponding to each branch is the same. For example, in the at least two branches included in the color pixel control circuit, the wavelength range of the light absorbed by the color pixel unit corresponding to each branch corresponds to green light, then the pixel information can be color-merged to generate the value of the green component (G) in the RGB color value corresponding to the third number of color pixel units.

[0173] Natural light can be used when exposing the color pixel units. Since the color pixel units only absorb light within a specified wavelength band, other light will be filtered out. Therefore, the intensity of light absorbed by the color pixel units is obviously lower than the intensity of natural light. The RGB color values ​​corresponding to the third number of color pixel units generated by color merging pixel information can expand the dynamic range of brightness information corresponding to the pixel information output by the color pixel units, thereby making the colors in the image output by the color pixel units closer to the actual colors of the photographed objects.

[0174] exist Figure 7 In the method embodiment shown, in the color pixel control circuit, a first number of control switches are controlled to be turned on; first pixel information is read through a first capacitor, and the first pixel information is the sum of pixel information of a first number of color pixel units; a second number of control switches are controlled to be turned on; second pixel information is read through a first capacitor, wherein the second pixel information is the sum of pixel information of a third number of color pixel units, and the third number is the sum of the first number and the second number; based on the first pixel information and the second pixel information, color pixel merging information is generated, and the color pixel merging information includes a ratio value of the first number and the third number. In the present technical solution, by controlling the control switch twice so that the control switch is turned on, different ratios of real-sense pixel information can be obtained, and real-sense pixel merging information can be generated, so that a wider range of data support can be provided when data processing is performed according to the real-sense pixel merging information.

[0175] Alternatively, if Figure 8As shown, an embodiment of the present application also provides an electronic device 800, including a camera module 801, a processor 802, a memory 803, and a program or instruction stored in the memory 803 and executable on the processor 802. When the program or instruction is executed by the processor 802, each process of the above-mentioned focusing method embodiment is implemented, and the same technical effect can be achieved. To avoid repetition, it will not be described here.

[0176] The camera module 801 may include various structures as described in the aforementioned camera module embodiments, which will not be described in detail here.

[0177] It should be noted that the electronic device in the embodiments of the present application may be a mobile electronic device or a non-mobile electronic device. For example, the mobile electronic device may be a mobile phone, a tablet computer, a laptop computer, a PDA, an in-vehicle electronic device, a wearable device, an ultra-mobile personal computer (UMPC), a netbook or a personal digital assistant (PDA), etc., and the non-mobile electronic device may be a personal computer (PC), a television (TV), a teller machine or a self-service machine, etc., which is not specifically limited in the embodiments of the present application.

[0178] The electronic device in the embodiment of the present application may be an electronic device having an operating system. The operating system may be an Android operating system, an iOS operating system, or other possible operating systems, which are not specifically limited in the embodiment of the present application.

[0179] Fig. 9 A schematic diagram of the hardware structure of a first electronic device provided in an embodiment of the present application.

[0180] The electronic device 900 includes but is not limited to: a radio frequency unit 901, a network module 902, an audio output unit 903, an input unit 904, a sensor 905, a display unit 906, a user input unit 907, an interface unit 908, a memory 909, a processor 910, a camera module 911 and other components.

[0181] The camera module 911 includes an image sensor, which may include various structures in the aforementioned image sensor embodiments, which will not be described in detail here.

[0182] The camera module 911 also includes: a circuit board, the image sensor is electrically connected to the circuit board; and a lens, which is arranged on a side of the image sensor away from the circuit board. The number of lenses can be one or at least two, and this specification does not limit the number of lenses.

[0183] Those skilled in the art will appreciate that the electronic device 900 may also include a power source (such as a battery) for supplying power to each component, and the power source may be logically connected to the processor 910 through a power management system, thereby implementing functions such as managing charging, discharging, and power consumption management through the power management system. Fig. 9 The structure of the electronic device shown does not constitute a limitation on the electronic device. The electronic device may include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently, which will not be described in detail here.

[0184] The processor 910 is used to obtain at least two sets of phase information for each real-sensing pixel group, and the number of sets of phase information is equal to the number of microlenses in each real-sensing pixel group;

[0185] According to the at least two groups of phase information, average phase information of each real-sensing pixel group is obtained.

[0186] In the embodiment of the present application, at least two sets of phase information are obtained for each real-sense pixel group, and the number of sets of phase information is equal to the number of microlenses in each real-sense pixel group; based on the at least two sets of phase information, the average phase information of each real-sense pixel group is obtained. Through this technical solution, multiple sets of phase information with similar positions can be averaged, which improves the accuracy of the phase information and reduces the inaccurate focusing caused by a small amount of phase information with serious errors.

[0187] Optionally, the processor 910 is further configured to:

[0188] Determining focus information according to average phase information of at least one of the real-sense pixel groups;

[0189] Based on the focus information, the camera module is controlled to focus.

[0190] Through the embodiments of the present application, the average phase information can be used to control the focus of the camera module, thereby reducing the inaccurate focusing caused by a small amount of phase information with serious errors.

[0191] It should be understood that in the embodiment of the present application, the input unit 904 may include a graphics processor (Graphics Processing Unit, GPU) 9041 and a microphone 9042, and the graphics processor 9041 processes the image data of the static picture or video obtained by the image capture device (such as a camera) in the video capture mode or the image capture mode. The display unit 906 may include a display panel 9061, and the display panel 9061 may be configured in the form of a liquid crystal display, an organic light emitting diode, etc. The user input unit 907 includes a touch panel 9071 and other input devices 9072. The touch panel 9071 is also called a touch screen. The touch panel 9071 may include two parts: a touch detection device and a touch controller. Other input devices 9072 may include, but are not limited to, a physical keyboard, a function key (such as a volume control button, a switch button, etc.), a trackball, a mouse, and a joystick, which will not be repeated here. The memory 909 can be used to store software programs and various data, including but not limited to applications and operating systems. The processor 910 can integrate an application processor and a modem processor, wherein the application processor mainly processes an operating system, a user interface, and applications, etc., and the modem processor mainly processes wireless communications. It is understandable that the above-mentioned modem processor may not be integrated into the processor 910.

[0192] An embodiment of the present application also provides a readable storage medium, on which a program or instruction is stored. When the program or instruction is executed by a processor, the various processes of the above-mentioned pixel information acquisition method embodiment are implemented, and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.

[0193] The processor is the processor in the electronic device in the above embodiment. The readable storage medium includes a computer readable storage medium, such as a computer read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk.

[0194] An embodiment of the present application further provides a chip, which includes a processor and a communication interface, wherein the communication interface and the processor are coupled, and the processor is used to run programs or instructions to implement the various processes of the above-mentioned pixel information acquisition method embodiment, and can achieve the same technical effect. To avoid repetition, it will not be repeated here.

[0195] It should be understood that the chip mentioned in the embodiments of the present application can also be called a system-level chip, a system chip, a chip system or a system-on-chip chip, etc.

[0196] Fig.10 A schematic diagram of the hardware structure of a second electronic device provided in an embodiment of the present application.

[0197] The electronic device 1000 includes but is not limited to: a radio frequency unit 1001, a network module 1002, an audio output unit 1003, an input unit 1004, a sensor 1005, a display unit 1006, a user input unit 1007, an interface unit 1008, a memory 1009, a processor 1010, a camera module 1011 and other components.

[0198] The camera module 1011 includes an image sensor, which may include various structures in the aforementioned image sensor embodiments, which will not be described in detail here.

[0199] The camera module 1011 further includes: a circuit board, the image sensor is electrically connected to the circuit board; and a lens, which is arranged on a side of the image sensor away from the circuit board. The number of lenses can be one or at least two, and this specification does not limit the number of lenses.

[0200] Those skilled in the art will appreciate that the electronic device 1000 may also include a power source (such as a battery) for supplying power to each component, and the power source may be logically connected to the processor 1010 through a power management system, thereby implementing functions such as managing charging, discharging, and power consumption management through the power management system. Fig. 9 The structure of the electronic device shown does not constitute a limitation on the electronic device. The electronic device may include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently, which will not be described in detail here.

[0201] The processor 1010 is used to control a first number of second switches to be turned on in the color pixel control circuit;

[0202] Reading first pixel information through the first capacitor, where the first pixel information is the sum of pixel information of a first number of color pixel units;

[0203] Controlling a second number of second switches to be turned on;

[0204] Reading second pixel information through the first capacitor, wherein the second pixel information is the sum of pixel information of a third number of color pixel units, and the third number is the sum of the first number and the second number;

[0205] Based on the first pixel information and the second pixel information, color pixel merging information is generated, where the color pixel merging information includes a ratio value of the first quantity to the third quantity.

[0206] In an embodiment of the present application, in a color pixel control circuit, a first number of control switches are controlled to be turned on; first pixel information is read through a first capacitor, and the first pixel information is the sum of pixel information of a first number of color pixel units; a second number of control switches are controlled to be turned on; second pixel information is read through a first capacitor, wherein the second pixel information is the sum of pixel information of a third number of color pixel units, and the third number is the sum of the first number and the second number; based on the first pixel information and the second pixel information, color pixel merging information is generated, and the color pixel merging information includes a ratio value of the first number and the third number. The technical solution can obtain different ratios of real-sense pixel information and generate real-sense pixel merging information by controlling the control switch twice to turn on the control switch, thereby providing more extensive data support when performing data processing based on the real-sense pixel merging information.

[0207] Optionally, the processor 1010 is further configured to:

[0208] Get the color pixel sensitivity ratio;

[0209] According to the light sensitivity ratio of the color pixels, a first number of switches turned on for the first time and a second number of switches turned on for the second time are determined.

[0210] Optionally, the processor 1010 is further configured to:

[0211] Generate RGB color values ​​corresponding to a third number of color pixel units according to the color merged pixel information.

[0212] Through the embodiments of the present application, by obtaining the color pixel sensitivity ratio and determining the first number of switches turned on for the first time and the second number of switches turned on for the second time according to the color pixel sensitivity ratio, the number of switches turned on twice can be predetermined to determine how to control the color pixel control circuit; the RGB color value corresponding to the third number of color pixel units generated by color merging pixel information can expand the dynamic range of brightness information corresponding to the pixel information output by the color pixel unit, so that the color in the image output by the color pixel unit is closer to the real color of the photographed object.

[0213] It should be understood that in the embodiment of the present application, the input unit 1004 may include a graphics processor (Graphics Processing Unit, GPU) 10041 and a microphone 10042, and the graphics processor 10041 processes the image data of the static picture or video obtained by the image capture device (such as a camera) in the video capture mode or the image capture mode. The display unit 1006 may include a display panel 10061, and the display panel 10061 may be configured in the form of a liquid crystal display, an organic light emitting diode, etc. The user input unit 1007 includes a touch panel 10071 and other input devices 10072. The touch panel 10071 is also called a touch screen. The touch panel 10071 may include two parts: a touch detection device and a touch controller. Other input devices 10072 may include, but are not limited to, a physical keyboard, a function key (such as a volume control button, a switch button, etc.), a trackball, a mouse, and a joystick, which will not be repeated here. The memory 1009 can be used to store software programs and various data, including but not limited to applications and operating systems. The processor 1010 may integrate an application processor and a modem processor, wherein the application processor mainly processes an operating system, a user interface, and application programs, and the modem processor mainly processes wireless communications. It is understandable that the modem processor may not be integrated into the processor 1010.

[0214] An embodiment of the present application also provides a readable storage medium, on which a program or instruction is stored. When the program or instruction is executed by a processor, the various processes of the above-mentioned pixel information acquisition method embodiment are implemented, and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.

[0215] The processor is the processor in the electronic device in the above embodiment. The readable storage medium includes a computer readable storage medium, such as a computer read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk.

[0216] An embodiment of the present application further provides a chip, which includes a processor and a communication interface, wherein the communication interface and the processor are coupled, and the processor is used to run programs or instructions to implement the various processes of the above-mentioned pixel information acquisition method embodiment, and can achieve the same technical effect. To avoid repetition, it will not be repeated here.

[0217] It should be understood that the chip mentioned in the embodiments of the present application can also be called a system-level chip, a system chip, a chip system or a system-on-chip chip, etc.

[0218] It should be noted that, in this article, the terms "comprise", "include" or any other variant thereof are intended to cover non-exclusive inclusion, so that the process, method, article or device including a series of elements includes not only those elements, but also includes other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the sentence "comprise one..." do not exclude the presence of other identical elements in the process, method, article or device including the element. In addition, it should be pointed out that the scope of the methods and devices in the embodiments of the present application is not limited to performing functions in the order shown or discussed, and may also include performing functions in a substantially simultaneous manner or in reverse order according to the functions involved, for example, the described method may be performed in an order different from that described, and various steps may also be added, omitted, or combined. In addition, the features described with reference to certain examples may be combined in other examples.

[0219] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus a necessary general hardware platform, and of course by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present application, or the part that contributes to the prior art, can be embodied in the form of a computer software product, which is stored in a storage medium (such as ROM / RAM, a disk, or an optical disk), and includes a number of instructions for a terminal (which can be a mobile phone, a computer, a server, or a network device, etc.) to execute the methods of each embodiment of the present application.

[0220] The embodiments of the present application are described above in conjunction with the accompanying drawings, but the present application is not limited to the above-mentioned specific implementation methods. The above-mentioned specific implementation methods are merely illustrative and not restrictive. Under the guidance of the present application, ordinary technicians in this field can also make many forms without departing from the purpose of the present application and the scope of protection of the claims, all of which are within the protection of the present application.

Claims

1. An image sensor, characterized in that: include: A plurality of color pixel groups and a plurality of real-sense pixel groups; Each real-sense pixel group includes at least two real-sense pixel units; Each real-sense pixel group includes at least two microlenses, and each of the microlenses covers an even number of real-sense pixel units; Among an even number of real-sense pixel units covered by a microlens, the coverage area of ​​each real-sense pixel unit by the microlens is the same; The color pixel group is used to obtain the color information and brightness information of the photographed object, and the real-sense pixel group is used to obtain the motion state of the photographed object; Each real-sense pixel group includes six real-sense pixel units, the six real-sense pixel units form a hexagon, the cross section of each real-sense pixel unit is a triangle, the cross sections of two adjacent real-sense pixel units form a parallelogram, and the cross section of the microlens is an inscribed circle of the parallelogram; Each color pixel group includes six color pixel units, the cross-section of the color pixel unit is a triangle, and the cross-section of the six color pixel units forms a hexagon; in each color pixel group, the wavelength range of light absorbed by two color pixel units that are centrally symmetrically arranged is the same, and the wavelength range of light absorbed by two color pixel units that are adjacent to each other is different.

2. The image sensor according to claim 1, characterized in that The image sensor also includes at least two real-sense pixel control circuits; The real-sense pixel control circuit includes an even number of first branches, a control module and a signal processing module; One of the real-sense pixel units is correspondingly provided with one of the first branches; One of the real-sense pixel control circuits is correspondingly provided with one of the micro-lenses; Each of the first branches is connected in series with the control module respectively; The control module is connected in series with the signal processing module.

3. The image sensor according to claim 1, characterized in that The number of microlenses corresponding to a real-sense pixel group is the ratio of the first number to the second number, wherein the first number is the total number of real-sense pixel units in a real-sense pixel group, and the second number is the number of real-sense pixel units covered by each microlens in a real-sense pixel group.

4. The image sensor according to claim 1, characterized in that The image sensor further comprises a plurality of color pixel control circuits; the color pixel group comprises at least two color pixel units; and one color pixel control circuit is correspondingly arranged for at least one color pixel unit.

5. The image sensor according to claim 4, characterized in that: The color pixel control circuit includes a first capacitor and at least one second branch; the second branch includes a photosensitive diode and a control switch connected in series; One of the color pixel units in the color pixel group is correspondingly provided with one of the second branches; When there are at least two second branches, the at least two second branches are respectively connected in series with the first capacitor.

6. The image sensor according to claim 1, characterized in that: The ratio of the number of the plurality of color pixel groups to the number of real-sense pixel groups is less than a first ratio threshold and greater than a second ratio threshold.

7. The image sensor according to claim 6, characterized in that: The first ratio threshold is 5%, and the second ratio threshold is 1%.

8. The image sensor according to claim 6 or 7, characterized in that: Each real-sense pixel group corresponds to 31 color pixel groups.

9. A camera module, characterized in that: The invention comprises the image sensor according to any one of claims 1 to 8.

10. The camera module according to claim 9, characterized in that: The camera module also includes: A circuit board, the image sensor being electrically connected to the circuit board; A lens is arranged on a side of the image sensor away from the circuit board.

11. An electronic device, characterized in that: Including the camera module described in claim 9 or 10.

12. A pixel information processing method, applied to the electronic device according to claim 11, characterized in that: include: Acquire at least two sets of phase information for each real-sensing pixel group, where the number of sets of phase information is equal to the number of microlenses in each real-sensing pixel group; According to the at least two groups of phase information, average phase information of each real-sensing pixel group is obtained.

13. The method according to claim 12, characterized in that After obtaining the average phase information of each real-sense pixel group according to the at least two groups of phase information, the method further includes: Determining focus information according to average phase information of at least one of the real-sense pixel groups; Based on the focus information, the camera module is controlled to focus.

14. A pixel information processing method, applied to the electronic device according to claim 11, characterized in that: The image sensor in the electronic device further comprises a plurality of color pixel control circuits, the color pixel group comprises at least two color pixel units, the color pixel control circuit comprises a first capacitor and at least two second branches, the second branch comprises a photosensitive diode and a control switch connected in series; one second branch is correspondingly arranged for one color pixel unit in the color pixel group, The method comprises: In the color pixel control circuit, controlling a first number of control switches to be turned on; Reading first pixel information through the first capacitor, where the first pixel information is the sum of pixel information of a first number of color pixel units; Controlling a second number of control switches to be turned on; Reading second pixel information through the first capacitor, wherein the second pixel information is the sum of pixel information of a third number of color pixel units, and the third number is the sum of the first number and the second number; Based on the first pixel information and the second pixel information, color pixel merging information is generated, where the color pixel merging information includes a ratio value of the first quantity to the third quantity.

15. The method according to claim 14, characterized in that The color pixel control circuit further includes, before controlling the first number of control switches to be turned on: Get the color pixel sensitivity ratio; According to the light sensitivity ratio of the color pixels, a first number of switches turned on for the first time and a second number of switches turned on for the second time are determined.

16. The method according to claim 14, characterized in that After the color pixel merging information is generated based on the first pixel information and the second pixel information, the method further includes: Generate RGB color values ​​corresponding to a third number of color pixel units according to the color merged pixel information.

Images