Image sensor, camera module, electronic device and pixel information acquisition method

Abstract

The present application discloses an image sensor, a camera module, an electronic device and a pixel information acquisition method, which belongs to the field of image processing technology. The image sensor includes: a plurality of color pixel groups and a plurality of real-sensing pixel groups; each real-sensing pixel group includes at least two real-sensing pixel units; each real-sensing pixel group includes a microlens, and each microlens covers all the real-sensing pixel units of the real-sensing pixel group.

Description

Technical Field

[0001] The present application belongs to the field of image processing technology, and specifically relates to an image sensor, a camera module, an electronic device and a method for acquiring pixel information. Background Art

[0002] With the development of electronic technology, the shooting function of electronic devices has attracted more and more attention. When exposing through the shooting function of electronic devices, the image sensor in the electronic device is often required to use different exposure times under different light conditions to obtain pixel information of each pixel unit in the image sensor. For example, in the case of sufficient light, the exposure time is relatively short to avoid overexposure; in the case of dim light, the exposure time is relatively long to avoid too little light to see the image clearly.

[0003] However, due to the performance limitations of electronic devices, in some areas with poor lighting conditions, even if the exposure time is increased, the dynamic range of brightness information that can be obtained by the image sensor is limited, and the photos or images taken are not good. Summary of the invention

[0004] The purpose of the embodiments of the present application is to provide a sensor, a method for obtaining pixel information, and an electronic device, which can increase the dynamic range of brightness information that can be obtained by an image sensor.

[0005] In a first aspect, an embodiment of the present application provides an image sensor, the image sensor comprising: a plurality of color pixel groups and a plurality of real-sense pixel groups;

[0006] Each real-sense pixel group includes at least two real-sense pixel units;

[0007] Each real-sensing pixel group includes a microlens, and each microlens covers all the real-sensing pixel units of the real-sensing pixel group.

[0008] In a second aspect, an embodiment of the present application provides a camera module, which includes an image sensor as described in the first aspect.

[0009] In a third aspect, an embodiment of the present application provides an electronic device, which includes the camera module as described in the second aspect.

[0010] In a fourth aspect, an embodiment of the present application provides a method for acquiring pixel information, which is applied to the electronic device as described in the third aspect; the image sensor in the electronic device further includes a plurality of real-sensing pixel control circuits, the real-sensing pixel control circuit includes a control module and at least two first branches, the first branch includes a first photosensitive diode and a first switch connected in series; one of the real-sensing pixel units in the real-sensing pixel group is correspondingly provided with one of the first branches; the method includes:

[0011] In the real-sense pixel control circuit, controlling a first number of first switches to be turned on;

[0012] Reading first pixel information through the control module, where the first pixel information is the sum of pixel information of the first number of real-sense pixel units;

[0013] Controlling a second number of first switches to be turned on;

[0014] Reading second pixel information through the control module, wherein the second pixel information is the sum of pixel information of a third number of real-sense pixel units, and the third number is the sum of the first number and the second number;

[0015] Based on the first pixel information and the second pixel information, real-sense pixel merging information is generated, where the real-sense pixel merging information includes a ratio value of the first number to the third number.

[0016] In a fifth aspect, an embodiment of the present application provides an electronic device, comprising a processor, a memory, and a program or instruction stored in the memory and executable on the processor, wherein the program or instruction, when executed by the processor, implements the steps of the pixel information acquisition method as described in the fourth aspect.

[0017] In a sixth aspect, an embodiment of the present application provides a readable storage medium, on which a program or instruction is stored. When the program or instruction is executed by a processor, the steps of the pixel information acquisition method described in the fourth aspect are implemented.

[0018] In the seventh aspect, an embodiment of the present application provides a chip, which includes a processor and a communication interface, the communication interface is coupled to the processor, and the processor is used to run a program or instruction to implement the pixel information acquisition method as described in the fourth aspect.

[0019] In the embodiment of the present application, the image sensor includes: a plurality of color pixel groups and a plurality of real-sensing pixel groups; each real-sensing pixel group includes at least two real-sensing pixel units; each real-sensing pixel group includes a microlens, and each microlens covers all the real-sensing pixel units of the real-sensing pixel group. Through the technical solution of the embodiment of the present application, all the real-sensing pixel units of the real-sensing pixel group receive light signals through a microlens, which can expand the dynamic range of brightness information that can be obtained by the real-sensing pixel units. BRIEF DESCRIPTION OF THE DRAWINGS

[0020] Figure 1 A schematic diagram of the structure of an image sensor provided in an embodiment of the present application;

[0021] Figure 2A schematic diagram of the circuit structure of a real-sense pixel control circuit in an image sensor provided in an embodiment of the present application;

[0022] Figure 3 A schematic diagram of the circuit structure of a color pixel control circuit in an image sensor provided by an embodiment of the present application;

[0023] Figure 4 A schematic diagram of a camera module provided in an embodiment of the present application;

[0024] Figure 5 A schematic diagram of a first module of an electronic device provided in an embodiment of the present application;

[0025] Figure 6 A flowchart of a method for obtaining pixel information provided in an embodiment of the present application;

[0026] Figure 7 A schematic diagram of a module of an electronic device provided in an embodiment of the present application;

[0027] Figure 8 A schematic diagram of the hardware structure of an electronic device provided in an embodiment of the present application.

[0028] Description of reference numerals:

[0029] 101-real-sense pixel group, 102-color pixel group, 103-real-sense pixel unit, 104-color pixel unit, 105-microlens;

[0030] 201-first branch, 2011-first photosensitive diode, 2012-first switch, 202-control module, 203-signal processing module;

[0031] 301 - second branch, 3011 - second photosensitive diode, 3012 - second switch, 302 - first capacitor;

[0032] 400-camera module, 401-image sensor, 402-circuit board, 403-lens;

[0033] 500-electronic equipment, 501-camera module;

[0034] 700-electronic device, 701-camera module, 702-processor, 703-memory;

[0035] 800-electronic device, 801-radio frequency unit, 802-network module, 803-audio output unit, 804-input unit, 8041-graphics processor, 8042-microphone, 805-sensor, 806-display unit, 8061-display panel, 807-user input unit, 8071-touch panel, 8072-other input devices, 808-interface unit, 809-memory, 810-processor, 811-camera module. DETAILED DESCRIPTION

[0036] The following will be combined with the drawings in the embodiments of the present application to clearly describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, rather than all the embodiments. All other embodiments obtained by ordinary technicians in this field based on the embodiments in the present application belong to the scope of protection of this application.

[0037] The terms "first", "second", etc. in the specification and claims of the present application are used to distinguish similar objects, and are not used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable under appropriate circumstances, so that the embodiments of the present application can be implemented in an order other than those illustrated or described here, and the objects distinguished by "first", "second", etc. are generally of one type, and the number of objects is not limited. For example, the first object can be one or more. In addition, "and / or" in the specification and claims represents at least one of the connected objects, and the character " / " generally indicates that the objects associated with each other are in an "or" relationship.

[0038] The processor provided in the embodiment of the present application is described in detail below through specific embodiments and their application scenarios in conjunction with the accompanying drawings.

[0039] Figure 1 A schematic diagram of the structure of an image sensor provided in an embodiment of the present application.

[0040] The image sensor includes: a plurality of color pixel groups 102 and a plurality of real-sensing pixel groups 101 ; each real-sensing pixel group 101 includes at least two real-sensing pixel units 103 ; each real-sensing pixel group 101 includes a microlens 105 , and each microlens 105 covers all the real-sensing pixel units 103 of the real-sensing pixel group 101 .

[0041] like Figure 1 As shown, each real-sense pixel group may include six real-sense pixel units 103, and each color pixel group may include six color pixel units 104. Each microlens 105 may be on the six real-sense pixel units 103 of the real-sense pixel group 101.

[0042] The real-sense pixel unit 103 can sense the change of the brightness of the external environment in real time with the pixel clock frequency, and convert the change of the ambient brightness into a change of the current, and then into a change of the digital signal. The real-sense pixel unit 103 has good real-time performance, better signal redundancy, and higher accuracy. The real-sense pixel unit can be used to capture the motion information of dynamic objects.

[0043] The color pixel unit 104 can absorb light within a specified wavelength range, thereby obtaining brightness information of the light within the wavelength range.

[0044] Optionally, the image sensor further includes: a plurality of real-sensing pixel control circuits; the real-sensing pixel control circuit includes at least two first branches 201; the first branch 201 includes a first photosensitive diode 2011 and a first switch 2012 connected in series; and a first branch 201 is correspondingly arranged for one real-sensing pixel unit 103 in the real-sensing pixel group 101.

[0045] The number of first branches 201 included in the real-sense pixel control circuit may be equal to the number of real-sense pixel groups 101. For example, the real-sense pixel group 101 includes four real-sense pixel units, and the real-sense pixel control circuit includes four first branches 201. For each real-sense pixel unit 103 in the real-sense pixel group 101, a first branch 201 of the real-sense pixel control circuit is correspondingly provided.

[0046] The first switch 2012 may be a control switch of the first photodiode 2011 . The first switch 2012 may be a transistor or other types of switch devices.

[0047] Figure 2 A schematic diagram of the circuit structure of a real-sense pixel control circuit in an image sensor provided in an embodiment of the present application.

[0048] like Figure 2 As shown, the real-sense pixel control circuit may include six first branches 201, and the first branch 201 includes a first photosensitive diode 2011 and a first switch 2012 connected in series. Each real-sense pixel unit 103 may include a first photosensitive diode 2011. Then, one real-sense pixel unit 103 in the real-sense pixel group 101 is correspondingly provided with a first branch 201, and the first photosensitive diode 2011 included in the correspondingly provided first branch 201 is the first photosensitive diode 2011 included in the real-sense pixel unit 103.

[0049] The first photosensitive diode 2011 is used to generate a photosensitive signal, and the photosensitive signal can be regarded as pixel information obtained by the real-sensing pixel unit 103 after exposure.

[0050] When a first switch 2012 is turned on, the photosensitive signal generated by the first photosensitive diode 2011 connected in series with the first switch 2012 can be output to the next node of the first branch 201 in the real-sensing pixel control circuit, that is, the control module 202 .

[0051] For a real-sense pixel unit 103 in the real-sense pixel group 101 , by correspondingly setting a first branch 201 , one or more real-sense pixel units 103 in the real-sense pixel group can be flexibly controlled to output pixel information or not output pixel information.

[0052] Optionally, the real-sense pixel control circuit also includes a control module 202 and a signal processing module 203; at least two first branches 201 include multiple first parallel branches and multiple second parallel branches; multiple first parallel branches are connected in parallel; multiple first parallel branches are connected in parallel, and multiple first parallel branches are connected in series with the control module 202; multiple second parallel branches are connected in parallel; multiple second parallel branches are connected in parallel, and multiple second parallel branches are connected in series with the control module 202; the control module 202 is connected in series with the signal processing module 203.

[0053] The control module 202 may receive a photosensitive signal from each of the first branches 201 that are turned on. If the number of first branches 201 that are turned on at the same time is greater than one, the control module 202 may receive the sum of the photosensitive signals of the greater than one first branch 201. The control module may be used to determine whether to execute a preset control instruction based on a comparison between the received photosensitive signal and a preset threshold.

[0054] like Figure 2 As shown, the real-sense pixel control circuit includes six first branches 201, and the six first branches 201 include three first parallel branches and three second parallel branches. The three first parallel branches are connected in parallel, and the three first parallel branches connected in parallel are connected in series with the control module 202. The three second parallel branches are connected in parallel, and the three second parallel branches connected in parallel are connected in series with the control module 202. The control module 202 is connected in series with the signal processing module 203.

[0055] The output end of the first parallel branch is connected to the first input end of the control module 202 , the output end of the second parallel branch is connected to the second input end of the control module 202 , and the output end of the control module 202 is connected to the input end of the signal processing module.

[0056] On one hand, since each microlens 105 covers all the real-sensing pixel units 103 of the real-sensing pixel group 101 , a set of phase information of the photographed object corresponding to the real-sensing pixel can be obtained by setting the first parallel branch and the second parallel branch.

[0057] The phase information can be used to assist the camera module in focusing. The camera module can be a camera module including the image sensor provided in this embodiment, or a camera module not including the image sensor provided in this embodiment. In the case where the camera module does not include the image sensor provided in this embodiment, the camera module can receive at least one set of phase information sent by the image sensor provided in this embodiment.

[0058] The process of the real-sensing pixel group 101 acquiring a set of phase information through the corresponding microlens 105 can be that the incident light is divided into two beams of light when passing through the microlens 105, and the two beams of light are respectively received by two real-sensing pixel units 103 in the real-sensing pixel group 101, and the two real-sensing pixel units 103 can correspond to a first parallel branch and a second parallel branch respectively. Each real-sensing pixel unit 103 can obtain corresponding phase information based on the analysis of a received beam of light. The phase information corresponding to a beam of light can be information about the alternating waveform changes presented by the vibration of photons when the light wave moves forward. Due to the different positions of the two real-sensing pixel units 103, there is a phase difference in the waveforms of the two beams of light, and the phase difference can be reflected by the difference between the two sub-phase information.

[0059] On the other hand, by setting the first parallel branch and the second parallel branch, a first photosensitive diode 2011 in the first parallel branch and a first photosensitive diode 2011 in the second parallel branch can be used to perform an exposure respectively, so as to determine whether the photographed object of the real-sensing pixel group 101 is in a moving state according to the change amount of the photosensitive signal caused by the two exposures. When the change amount of the photosensitive signal is greater than the preset change amount threshold, it can be determined that the photographed object is in a moving state, and the control module 202 can control the output end of the first parallel branch and the output end of the second parallel branch to be connected to the input end of the signal processing module 203 respectively, so that the signal processing module 203 outputs a data packet including coordinate information, brightness information, and time information. The time difference between the two exposures can be a preset time threshold, for example, 0.01ms.

[0060] On the other hand, in scenes with poor lighting conditions, whether phase information is obtained through a pair of real-sensing pixel units, or whether the photographed object is in motion is determined through a pair of real-sensing pixel units, the performance limitations of electronic devices may cause the photosensitive signal generated by the first photosensitive diode 2012 to be small, and it is difficult for the control module 202 to make an accurate judgment based on the received photosensitive signal. By connecting multiple first parallel branches in parallel and multiple second parallel branches in parallel, multiple first parallel branches and multiple second parallel branches can be synchronously controlled to output photosensitive signals to the control module 202, so that the photosensitive signals generated by multiple first photosensitive diodes 2012 are synchronously transmitted to the control module 202, thereby improving the dynamic range of the photosensitive signals output by the real-sensing pixels in scenes with poor lighting conditions.

[0061] Dynamic range refers to the ratio of the maximum value to the minimum value of a variable signal (such as sound or light). The dynamic range of the photosensitive signal can be the ratio of the highest brightness to the lowest brightness corresponding to the photosensitive signal generated by the first photosensitive diode 2012. In the real-sensing pixel control circuit, by synchronously transmitting the photosensitive signals generated by multiple first photosensitive diodes 2012 to the control module 202, the lowest brightness that can be accurately identified by the real-sensing pixel control circuit can be increased, thereby expanding the dynamic range of the photosensitive signal.

[0062] Optionally, the first branch 201 includes a first photosensitive diode 2011 and a first switch 2012 in the real-sensing pixel unit 103; when the first switch 2012 in the real-sensing pixel unit 103 is turned on, the first end of the first photosensitive diode 2011 in the real-sensing pixel unit 103 is connected to the input end of the control module 202, and the second end of the first photosensitive diode 2011 in the real-sensing pixel unit 103 is grounded.

[0063] like Figure 2 As shown, the first branch 201 includes a first photosensitive diode 2011 and a first switch 2012 in the real-sense pixel unit 103. The first end of the first photosensitive diode 2011 may be the output end of the aforementioned first branch 201. The first end of the first photosensitive diode 2011 is grounded.

[0064] When the first switch 2012 in the real-sense pixel unit 103 is turned on, the first end of the first photosensitive diode 2011 is connected to the input end of the control module 202; when the first switch 2012 in the real-sense pixel unit 103 is turned off, the first branch 201 is in an open-circuit state, and the first photosensitive diode 2011 cannot output a photosensitive signal.

[0065] By controlling the first switch 2012 to be turned on, the photoelectric signal generated by the first photodiode 2011 can flow to the control module 202 through the first switch 2012 . By controlling the first switch 2012 to be turned off, the output of the photoelectric signal generated by the first photodiode 2011 can be prohibited.

[0066] Optionally, in all the real-sensing pixel units 103 of a real-sensing pixel group 101 covered by a microlens 105 , the coverage area of ​​each real-sensing pixel unit 103 by the microlens 105 is the same.

[0067] like Figure 1 As shown, all the real-sense pixel units 103 of a real-sense pixel group 101 are six real-sense pixel units 103 , and the coverage area of ​​the microlens 105 for each real-sense pixel unit 103 is a 60-degree sector, and the area of ​​each sector is the same.

[0068] By setting the microlens 105 to cover the same area of ​​each real-sensing pixel unit 103 , the photosensitive area of ​​each real-sensing pixel unit 103 can be equal, so that the value of the photosensitive signal generated by each real-sensing pixel unit 103 after exposure is equal.

[0069] Optionally, the real-sensing pixel group 101 includes six real-sensing pixel units 103; the lens cross-section of the microlens 105 is a circle of a first size, and the lens cross-section is a cross-section parallel to the cross-section of the real-sensing pixel unit 103; the cross-sections of the six real-sensing pixel units 103 in the real-sensing pixel group 101 form a hexagon of a second size; the circle of the first size is an inscribed circle of the hexagon.

[0070] The microlens 105 may be a hemispherical lens or a lens of other shapes, and the lens interface of the microlens may be a circle of a first size. The lens interface may be a cross section parallel to the cross section of the real-sense pixel unit 103 .

[0071] The cross section of the real-sense pixel unit 103 may be a triangle, and the real-sense pixel unit 103 with a triangular cross section may be regarded as a triangular prism. The first photosensitive diode 2011 in the real-sense pixel unit 103 may also be regarded as a triangular photosensitive area.

[0072] Reference Figure 1 As shown, the cross-sections of the six real-sense pixel units 103 in the real-sense pixel group 101 may form a hexagon of the second size.

[0073] In a specific implementation, the cross section of the real-sense pixel unit 103 may be an equilateral triangle, and the cross sections of the six real-sense pixel units 103 in the real-sense pixel group 101 may form a regular hexagon composed of six equilateral triangles.

[0074] The circle of the first size is the inscribed circle of the hexagon.

[0075] By setting the cross section of the real-sensing pixel unit 103 to a triangle, the cross section of the six real-sensing pixel units 103 in the real-sensing pixel group 101 can form a hexagon, and by setting the lens cross section of the microlens 105 to be the inscribed circle of the hexagon, on the one hand, it can be satisfied that the coverage area of ​​each real-sensing pixel unit 103 by the microlens 105 is the same, and on the other hand, it can be avoided that the microlens 105 covers other real-sensing pixel units or color pixel units outside the real-sensing pixel group 101. On the other hand, the area of ​​the microlens 105 is larger, and more light can be obtained during the photosensitization process.

[0076] Optionally, the image sensor further includes a plurality of color pixel control circuits; the color pixel group 102 includes at least two color pixel units 104; and a color pixel control circuit is correspondingly provided to at least one color pixel unit 104.

[0077] like Figure 1 As shown, the color pixel group 102 may include six color pixel units 104 .

[0078] At least one color pixel unit 104 is provided with a color pixel control circuit, which may be one color pixel unit 104, one color pixel control circuit may be provided with two color pixel units 104, or one color pixel control circuit may be provided with N color pixel units 104. N is a natural number greater than two.

[0079] It should be noted that, in the case where one color pixel control circuit is correspondingly provided for at least two color pixel units 104, the wavelength range of light absorbed by each color pixel unit 104 of the at least two color pixel units 104 is the same. For example, if the wavelength range of light absorbed by one color pixel unit 104 corresponds to red light, and the wavelength range of light absorbed by another color pixel unit 104 corresponds to blue light, then the two color pixel units 104 cannot be correspondingly provided with the same color pixel control circuit.

[0080] By setting at least two color pixel units 104 to correspond to one color pixel control circuit, when the light conditions corresponding to the band range are poor, the pixel information obtained by multiple color pixel units 104 with the same band range of absorbed light can be merged and output, thereby increasing the minimum brightness that can be accurately identified by the color pixel control circuit and expanding the dynamic range of the brightness information corresponding to the pixel information obtained by the color pixel unit 104.

[0081] The dynamic range of the brightness information corresponding to the pixel information obtained by the color pixel unit 104 may be the ratio of the highest brightness to the lowest brightness corresponding to the photosensitive signal generated by the second photosensitive diode 3011. In the real-sensing pixel control circuit, by synchronously transmitting the photosensitive signals generated by the plurality of first photosensitive diodes 2012 to the control module 202, the lowest brightness that can be accurately identified by the color pixel control circuit can be increased, thereby expanding the dynamic range of the photosensitive signal.

[0082] Optionally, the color pixel control circuit includes a first capacitor 302 and at least one second branch 301; the second branch 301 includes a second photosensitive diode 3011 and a second switch 3012 connected in series; a second branch 301 is correspondingly arranged for one color pixel unit 104 in the color pixel group; when there are at least two second branches 301, at least two second branches 301 are respectively connected in series with the first capacitor 302.

[0083] The second switch 3012 may be a control switch of the second photodiode 3011 . The second switch 3012 may be a transistor or other types of switch devices.

[0084] The second photodiode 3011 can generate charge when receiving light irradiation, that is, the second photodiode 3011 generates charge after exposure. When the second switch 3012 is disconnected, the charge cannot flow to the first capacitor 302, and the pixel information generated by the exposure cannot be read. When the second switch 3012 is turned on, the charge can flow to the first capacitor 302 through the second switch 3012, and the pixel information generated by the exposure can be read through the first capacitor 302.

[0085] For example, when a second switch 3012 is turned on, the charge generated by the second photodiode 3011 connected in series with the turned-on second switch 3012 due to light irradiation flows to the first capacitor 302 through the turned-on second switch 3012, so that the voltage across the first capacitor 302 decreases. For example, the voltage across the first capacitor 302 is 3V when the second switch 3012 is turned off. When the second switch 3012 is switched from an off state to an on state, the charge flows from the second photodiode 3011 to the first capacitor 302, so that the voltage across the first capacitor 302 decreases to 2.9V. Then, the change in the voltage value across the first capacitor 302 is 0.1V, and the 0.1V can reflect the light intensity information of the light received by the second photodiode 3011.

[0086] The greater the light intensity of the light received by the second photodiode 3011, the greater the change in the voltage value across the first capacitor 302; the smaller the light intensity of the light received by the second photodiode 3011, the smaller the change in the voltage value across the first capacitor 302. By changing the exposure time of the second photodiode 3011, or by changing the light conditions when the second photodiode 3011 is exposed, the light intensity of the light received by the second photodiode 3011 can be changed. For example, under the same light conditions, when the exposure time is 1ms, the change in the voltage value across the first capacitor 302 is 0.05V, and when the exposure time is 3ms, the change in the voltage value across the first capacitor 302 is 0.15V.

[0087] Figure 3 A schematic diagram of the circuit structure of a color pixel control circuit in an image sensor provided in an embodiment of the present application.

[0088] Each color pixel unit 104 may include a second photosensitive diode 3011. Each color pixel unit 104 may also include a filter, or may not include a filter, but include other electronic devices with a filtering effect. In a color pixel unit 104, the filter may be arranged on the second photosensitive diode 3011, and the cross section of the filter may have the same shape as the cross section of the color pixel unit 104.

[0089] The filter can be used to filter light outside a preset wavelength range, and the preset wavelength range can be a corresponding wavelength of the three primary colors of optics: red, green, and blue. For example, a red filter can filter out light outside of red, and only red light can pass through the filter to reach the second photosensitive diode 3011.

[0090] like Figure 3 As shown, the color pixel control circuit may include two second branches 301, and each second branch 301 may include a second photosensitive diode 3011 and a second switch 3012 connected in series. Each second branch 301 is respectively connected in series with the first capacitor 302. One second branch 301 is correspondingly provided for one color pixel unit 104 in the color pixel group 102, and the second photosensitive diode 3011 included in the corresponding second branch 301 is the second photosensitive diode 3011 included in the one color pixel unit 104.

[0091] For a color pixel unit 104 in the color pixel group 102, by correspondingly setting a second branch 301, one or more color pixel units 103 can be flexibly controlled to output pixel information or not output pixel information. In the case of at least two second branches 301, at least two second branches 301 are respectively connected in series with the first capacitor 302, so that the charges generated by the second photodiodes 3011 in the two second branches 301 can flow to the first capacitor 302, thereby increasing the amount of charges received by the first capacitor 302, improving the minimum brightness that can be accurately identified by the color pixel control circuit under poor light conditions, and expanding the dynamic range of brightness information corresponding to the pixel information obtained by the color pixel unit 104.

[0092] Optionally, each color pixel group 102 includes six color pixel units 104; wherein the cross-section of the color pixel unit 104 is a triangle; the cross-section of the six color pixel units 104 in the color pixel group 102 forms a hexagon; in each color pixel group 102, the two color pixel units 104 that are centrally symmetrically arranged absorb the same wavelength range of light, and the two color pixel units 104 that are adjacent to each other absorb different wavelength ranges of light.

[0093] like Figure 1 As shown, each color pixel group 102 may include six color pixel units 104; wherein the cross-section of the color pixel unit 104 may be a triangle; and the cross-sections of the six color pixel units in the color pixel group may form a hexagon.

[0094] In the hexagon formed by the cross sections of the six color pixel units in each color pixel group, the six triangles may be located at the top, bottom, top left, bottom left, top right and bottom right of the hexagon, respectively. The triangles at the top and bottom are centrally symmetrical; the triangles at the top left and bottom right are centrally symmetrical; the triangles at the top right and bottom left are centrally symmetrical.

[0095] The wavelength range of light absorbed by the color pixel unit 104 corresponding to the triangle directly above is the same as the wavelength range of light absorbed by the color pixel unit 104 corresponding to the triangle directly below; the wavelength range of light absorbed by the color pixel unit 104 corresponding to the triangle at the upper left is the same as the wavelength range of light absorbed by the color pixel unit 104 corresponding to the triangle at the lower right; the wavelength range of light absorbed by the color pixel unit 104 corresponding to the triangle at the upper right is the same as the wavelength range of light absorbed by the color pixel unit 104 corresponding to the triangle at the lower left.

[0096] Furthermore, the wavelength range of light absorbed by the color pixel unit 104 corresponding to the triangle directly above is different from the wavelength range of light absorbed by the color pixel unit 104 corresponding to the triangle on the upper right; the wavelength range of light absorbed by the color pixel unit 104 corresponding to the triangle on the upper right is different from the wavelength range of light absorbed by the color pixel unit 104 corresponding to the triangle on the lower right… The wavelength range of light absorbed by the color pixel unit 104 corresponding to the triangle on the upper left is different from the wavelength range of light absorbed by the color pixel unit 104 corresponding to the triangle directly above.

[0097] For example, the wavelength range of light absorbed by the color pixel units 104 corresponding to the triangles directly above and below corresponds to red; the wavelength range of light absorbed by the color pixel units 104 corresponding to the triangles at the upper left and lower right corresponds to green; and the wavelength range of light absorbed by the color pixel units 104 corresponding to the triangles at the upper right and lower left corresponds to blue.

[0098] By setting the cross section of the color pixel unit 104 to be a triangle, the cross sections of the six color pixel units 104 in the color pixel group 102 form a hexagon; in each color pixel group 102, the wavelength ranges of the light absorbed by the two color pixel units 104 that are centrally symmetrical are the same, and the wavelength ranges of the light absorbed by the two adjacent color pixel units 104 are different. This allows the six color pixel units 104 in each color pixel group 102 to include two color pixel units 104 that absorb red light, two color pixel units 104 that absorb green light, and two color pixel units 104 that absorb blue light. This allows the pixel information of the two color pixel units 104 to be combined and output, thereby expanding the dynamic range of the brightness information, and preventing the color resolution of the color pixel group 102 from being reduced.

[0099] Optionally, the multiple color pixel groups 102 include a first color pixel group and a second color pixel group, and the first color pixel group and the second color pixel group are arranged adjacent to each other; the first color pixel group includes a first color pixel unit, and the second color pixel group includes a second color pixel unit, and the first color pixel unit and the second color pixel unit are arranged adjacent to each other; the first color pixel unit and the second color pixel unit absorb the same wavelength range of light.

[0100] The first color pixel group may include six color pixel units 104, and the cross section of each color pixel unit 104 may be a triangle; the cross sections of the six color pixel units 104 in the first color pixel group may form a hexagon. In the hexagon formed by the cross sections of the six color pixel units 104 in the first color pixel group, the six triangles may be located directly above, directly below, to the upper left, to the lower left, to the upper right, and to the lower right of the hexagon, respectively. The first color pixel unit may be the color pixel unit 104 corresponding to the triangle directly above.

[0101] The second color pixel group may include six color pixel units 104, each of which may have a triangular cross section; the cross sections of the six color pixel units 104 in the second color pixel group may form a hexagon. In the hexagon formed by the cross sections of the six color pixel units 104 in the second color pixel group, the six triangles may be located directly above, directly below, to the upper left, to the lower left, to the upper right, and to the lower right of the hexagon, respectively. The second color pixel unit may be the color pixel unit 104 corresponding to the triangle directly below.

[0102] The first color pixel unit and the second color pixel unit are arranged adjacent to each other, which can be expressed as follows: the hexagon formed by the cross-sections of the six color pixel units 104 in the first color pixel group can be located directly below the hexagon formed by the cross-sections of the six color pixel units 104 in the second color pixel group, and the first color pixel unit can be adjacent to the second color pixel unit.

[0103] If the wavelength range of light absorbed by the first color pixel unit and the second color pixel unit is the same, then the two color pixel units 104 that are adjacent to each other and absorb the same wavelength range of light can be configured with the same color pixel control circuit, thereby merging and outputting the pixel information obtained by the first color pixel unit and the second color pixel unit to improve the dynamic range of brightness.

[0104] Optionally, the second branch 301 includes a second photosensitive diode 3011 and a second switch 3012 in the first color pixel unit; when the second switch 3012 in the first color pixel unit is turned on, the first end of the second photosensitive diode 3011 in the first color pixel unit is connected to the first end of the first capacitor 302, and the second end of the second photosensitive diode 3011 in the first color pixel unit is grounded.

[0105] The second end of the second photodiode 3011 in the first color pixel unit is grounded. Figure 3 As shown, when the second switch 3012 in the first color pixel unit is turned on, the first end of the second photodiode 3011 in the first color pixel unit is connected to the first end of the first capacitor 302 through the turned-on second switch 3012.

[0106] By controlling the second switch 3012 to be turned on, the charges generated by light irradiation in the second photodiode 3011 in the first color pixel unit can flow to the first capacitor 302. Figure 3As shown, when the first second switch 3012 is controlled to be turned on, the voltage across the first capacitor 302 can reflect the pixel information obtained by one second photosensitive diode 3011. When the first second switch 3012 is kept turned on and the second second switch 3012 is controlled to be turned on, the voltage across the first capacitor 302 can reflect the sum of the pixel information obtained by the two second photosensitive diodes 3011. Since the photosensitive area of ​​each second photosensitive diode 3011 is the same, the sum of the pixel information obtained by the two second photosensitive diodes 3011 can be equal to twice the pixel information obtained by one second photosensitive diode 3011. For example, the number of charges generated by a second photosensitive diode 3011 after exposure is 5000 electrons. After the 5000 electrons flow to the first capacitor 302, the voltage of the first capacitor 302 is reduced by 0.05V. Then, the sum of the numbers of charges generated by the two second photosensitive diodes 3011 after exposure is 10000 electrons. After the 10000 electrons flow to the first capacitor 302, the voltage of the first capacitor 302 is reduced by 0.1V.

[0107] Therefore, by controlling the number of the turned-on second switches 3012 in the color pixel control circuit, color pixel merging information of different ratios can be flexibly obtained, for example, color pixel merging information of 1:2.

[0108] Optionally, the ratio of the number of the plurality of color pixel groups 102 to the number of the plurality of real-sense pixel groups 101 is less than a first ratio threshold and greater than a second ratio threshold.

[0109] The real-sense pixel group 101 can obtain the motion state of the photographed object, but cannot obtain the color information of the photographed object, and the color pixel group 102 can obtain the color information and brightness information of the photographed object, but cannot obtain the motion state of the photographed object. The image sensor may include a first preset number of color pixel groups 102 and a second preset number of real-sense pixel groups 101. The ratio of the first preset number to the second preset number may be a preset ratio. The preset ratio may be less than a first ratio threshold and greater than a second ratio threshold.

[0110] In the image sensor, by setting the ratio of the number of multiple color pixel groups 102 to the number of multiple real-sense pixel groups 101, the density of the real-sense pixel groups 101 in the image sensor can be controlled, so that the image sensor can maintain a high color resolution and accurately obtain the motion state of the photographed object.

[0111] Optionally, the first ratio threshold is 5% and the second ratio threshold is 1%.

[0112] The ratio of the number of the plurality of color pixel groups 102 to the number of the plurality of real-sense pixel groups 101 may be less than 5% and greater than 1%.

[0113] For example, the image sensor includes 2 million pixel groups, each of which is a real-sense pixel group 101 or a color pixel group 102, each real-sense pixel group 101 includes 6 real-sense pixel units 103, and each color pixel group 102 includes 6 color pixel units 104. The 2 million pixel groups may include 60,000 real-sense pixel groups 101 and 1.94 million color pixel groups, and the ratio of the number of the plurality of color pixel groups 102 to the number of the plurality of real-sense pixel groups 101 is 3%, which satisfies the requirement of being greater than 1% and less than 5%.

[0114] By setting the first ratio threshold to 5% and the second ratio threshold to 1%, on the one hand, the number of real-sensing pixel groups 101 can be much smaller than the number of color pixel groups 102, thereby avoiding reducing the color resolution of the image sensor; on the other hand, by setting the number ratio to be greater than 1% and less than 5%, the density of the real-sensing pixel group 101 in the image sensor can support the real-sensing pixel group to accurately obtain the motion state of the photographed object.

[0115] Optionally, 31 color pixel groups 102 are correspondingly arranged for each real-sense pixel group 101 .

[0116] In a preferred implementation, each real-sense pixel group 101 may be provided with 31 corresponding color pixel groups 102 .

[0117] For example, the image sensor may include N pixel arrays arranged in the same manner, where N is a natural number greater than 1. Each pixel array includes 31 color pixel groups 102 and 1 real-sense pixel group 101. In each pixel array, the density of the real-sense pixel group 101 may be 1 / 32. In the image sensor, the density of the real-sense pixel group 101 may be 1 / 32.

[0118] By setting each real-sensing pixel group 101 to correspond to 31 color pixel groups 102, the density of the real-sensing pixel groups 101 in the image sensor can be controlled, which can avoid reducing the color resolution of the image sensor and support the real-sensing pixel groups 101 to accurately obtain the motion state of the photographed object.

[0119] In such Figure 1 In the illustrated embodiment, the image sensor includes: a plurality of color pixel groups 102 and a plurality of real-sensing pixel groups 101; each real-sensing pixel group 101 includes at least two real-sensing pixel units 103; each real-sensing pixel group 101 includes a microlens 105, and each microlens 105 covers all the real-sensing pixel units 103 of the real-sensing pixel group 101. Through the technical solution of the embodiment of the present application, all the real-sensing pixel units of the real-sensing pixel group receive light signals through one microlens, which can expand the dynamic range of brightness information that can be obtained by the real-sensing pixel units.

[0120] Based on the same technical concept as the aforementioned image sensor embodiment, the embodiment of the present application also provides a camera module. Figure 4 A module schematic diagram of a camera module provided in an embodiment of the present application.

[0121] like Figure 4 As shown, the camera module 400 includes an image sensor 401 .

[0122] The image sensor 401 may include various structures in the aforementioned image sensor embodiments, which will not be described in detail here.

[0123] Optionally, the camera module 400 further includes:

[0124] A circuit board 402, the image sensor 401 is electrically connected to the circuit board 402;

[0125] The lens 403 is disposed on a side of the image sensor 401 away from the circuit board 402 .

[0126] The number of lenses 403 may be one or at least two, and this specification does not limit the number of lenses.

[0127] Based on the same technical concept as the aforementioned camera module embodiment, the embodiment of the present application also provides an electronic device. Figure 5 A schematic diagram of a first module of an electronic device provided in an embodiment of the present application.

[0128] like Figure 5 As shown, the electronic device 500 includes a camera module 501.

[0129] The camera module 501 may include various structures as described in the aforementioned camera module embodiments, which will not be described in detail here.

[0130] Figure 6 A flowchart of a method for obtaining pixel information provided in an embodiment of the present application. The method for obtaining pixel information provided in this embodiment is applied to an electronic device as provided in the aforementioned electronic device embodiment. The image sensor in the electronic device also includes a plurality of real-sensing pixel control circuits, the real-sensing pixel control circuit includes a control module and at least two first branches, the first branch includes a first photosensitive diode and a first switch connected in series; a first branch is provided corresponding to a real-sensing pixel unit in the real-sensing pixel group.

[0131] Step 602: In a real-sense pixel control circuit, control a first number of first switches to be turned on.

[0132] The first number may be one or greater than one.

[0133] Before controlling the first number of first switches to be turned on, an exposure operation may be performed on each first photosensitive diode in the real-sense pixel control circuit. The exposure operation may be a manual exposure operation triggered manually or an automatic exposure operation triggered at a preset period.

[0134] Optionally, before executing step 602, the pixel information acquisition method provided in this embodiment further includes: acquiring a photosensitivity ratio of real-sensing pixels; and determining a first number of switches turned on for the first time and a second number of switches turned on for the second time according to the photosensitivity ratio of the real-sensing pixels.

[0135] The photosensitive ratio of the real-sense pixels can be a quantitative ratio set when the user wants to obtain 1:N real-sense pixel merging information, that is, 1:N. N is a natural number greater than 1. For example, when the user wants to obtain 1:3 real-sense pixel merging information, the photosensitive ratio of the real-sense pixels is set to 1:3. The photosensitive ratio of the real-sense pixels can also be 1:N:M, for example, 1:2:3. The embodiment of the present application does not impose any special restrictions on the form of the photosensitive ratio of the real-sense pixels.

[0136] According to the acquired real-sense pixel light sensitivity ratio, the first number of switches turned on for the first time and the second number of switches turned on for the second time can be determined. The sum of the first number and the second number is the third number, and the real-sense pixel light sensitivity ratio can be the ratio of the first number to the third number, so the first number and the second number can be determined by the real-sense pixel light sensitivity ratio.

[0137] Since the photosensitive area of ​​the first photodiode of each real-sense pixel unit is the same, the real-sense pixel information obtained when N first switches are controlled to be turned on may be N times the real-sense pixel information obtained when only one first switch is turned on.

[0138] For example, when the light sensitivity ratio of the real-sense pixels is 1:3, it can be determined that the first number of switches turned on for the first time is 1, and the second number of switches turned on for the second time is 2.

[0139] Taking the real-sense pixel sensitivity ratio of 1:3 as an example, it should be noted that when the user only needs 3 times the real-sense pixel information and does not need 1 times the real-sense pixel information, only one switch can be turned on to control the 3 first switches to be turned on, and the sum of the pixel information of the three real-sense pixel units can be read through the control module.

[0140] By obtaining the light sensitivity ratio of the real-sensing pixels and determining the first number of switches turned on for the first time and the second number of switches turned on for the second time according to the light sensitivity ratio of the real-sensing pixels, the number of switches turned on twice can be predetermined to determine how to control the real-sensing pixel control circuit.

[0141] Step 604 : reading first pixel information through the control module, where the first pixel information is the sum of pixel information of a first number of real-sense pixel units.

[0142] If the first number is one, the first number of real-sense pixel units is one real-sense pixel unit, and the first pixel information is the pixel information of the one real-sense pixel unit. The pixel information of the one real-sense pixel unit can be read by the control module in the real-sense pixel control circuit.

[0143] If the first number is greater than one, the first pixel information is the sum of the pixel information of the first number of real-sense pixel units. The control module in the real-sense pixel control circuit can read the sum of the pixel information of the first number of real-sense pixel units collected in the control module.

[0144] Step 606: Control a second number of first switches to be turned on.

[0145] The first number may be the same as the second number, or may be different from the second number. The second number may be one, or a natural number greater than one. It should be noted that there is no duplicate first switch between the first number of first switches and the second number of first switches.

[0146] When the first number of first switches are kept turned on, the second number of first switches are controlled to be turned on, and then in the real-sense pixel control circuit, the third number of first switches are all in the turned-on state.

[0147] Step 608 : reading second pixel information through the control module, wherein the second pixel information is the sum of pixel information of a third number of real-sense pixel units, and the third number is the sum of the first number and the second number.

[0148] The control module in the real-sensing pixel control circuit can read the sum of pixel information of a first number of real-sensing pixel units and the sum of pixel information of a second number of real-sensing pixel units collected in the control module, that is, the control module in the real-sensing pixel control circuit can read the sum of pixel information of a third number of real-sensing pixel units collected in the control module.

[0149] For example, the first number is 1, the second number is 1, and the third number is 2. Reading the real-sense pixel information of two real-sense pixel units by the control module is equivalent to obtaining twice the real-sense pixel information of one real-sense pixel unit.

[0150] Step 610: Generate real-sense pixel merging information based on the first pixel information and the second pixel information, where the real-sense pixel merging information includes a ratio of the first quantity to the third quantity.

[0151] Since the photosensitivity area of ​​the first photodiode in each real-sense pixel unit is the same, the real-sense pixel merging information generated by the first pixel information and the second pixel information can achieve binning (pixel merging) outputs of different proportions. Through one exposure, two images of the first quantity and the third quantity can be obtained, thereby expanding the dynamic range of the real-sense pixel information of the real-sense pixel.

[0152] For example, one first switch is controlled to be turned on to read the first pixel information, and then another first switch is controlled to be turned on to read the second pixel information. Then, according to the first pixel information and the second pixel information, 1:2 real-sense pixel merging information can be generated. The real-sense pixel merging information includes a ratio value of the first quantity 1 to the third quantity 2.

[0153] In another embodiment, after step 608 is executed, the fourth number of first switches can be controlled to be turned on, and the third pixel information can be read through the control module. The second pixel information is the sum of the pixel information of the fifth number of real-sense pixel units, and the fifth number is the sum of the third number and the fourth number.

[0154] For example, first control one first switch to be turned on to read the first pixel information, then control another first switch to be turned on to read the second pixel information, and then control another first switch to be turned on to read the third pixel information, thereby obtaining 1:2:3 real-sense pixel merging information.

[0155] Optionally, after step 610 is executed, it also includes: determining the signal change amount of the real-sense pixel group according to the real-sense pixel merging information obtained twice adjacently within a preset time range; and judging whether the photographed object corresponding to the real-sense pixel group is in a moving state according to the comparison result of the signal change amount and a preset change amount threshold.

[0156] The preset time range can be 0.01ms or other preset time ranges. The control module can calculate the difference between the real-sense pixel merging information obtained twice within the preset time range as the signal change of the real-sense pixel group. Compare the signal change with the preset change threshold. When the signal change is greater than the preset change threshold, it can be determined that the photographed object corresponding to the real-sense pixel group is in motion, and output a data packet with coordinate information, brightness information, and time information; when the signal change is less than or equal to the preset change threshold, it can be determined that the photographed object corresponding to the real-sense pixel group is not in motion.

[0157] In the process of data processing based on real-sense pixel information, the larger the multiple of real-sense pixel information, the better. It is necessary to select it in combination with the light conditions. For example, in poor light conditions, select 3 times the real-sense pixel information for data processing; in good light conditions, select 1 times the real-sense pixel information for data processing.

[0158] By determining the signal variation of the real-sensing pixel group and comparing it with a preset variation threshold, it can be determined whether the photographed object of the real-sensing pixel is in motion, so that the real-sensing pixel group has better real-time performance and accuracy.

[0159] like Figure 6 In the embodiment shown, in the real-sense pixel control circuit, the first number of first switches are controlled to be turned on; the first pixel information is read through the control module, and the first pixel information is the sum of the pixel information of the first number of real-sense pixel units; the second number of first switches are controlled to be turned on; the second pixel information is read through the control module, wherein the second pixel information is the sum of the pixel information of the third number of real-sense pixel units, and the third number is the sum of the first number and the second number; based on the first pixel information and the second pixel information, the real-sense pixel merging information is generated, and the real-sense pixel merging information includes the ratio value of the first number and the third number. Through this technical solution, by controlling the first switch to be turned on twice, different proportions of real-sense pixel information can be obtained, and the real-sense pixel merging information can be generated, so that a wider range of data support can be provided when data processing is performed according to the real-sense pixel merging information.

[0160] Out of Figure 6 In another embodiment of the present application, a method for obtaining pixel information may be provided, which is applied to an electronic device as provided in the aforementioned electronic device embodiment. The image sensor in the electronic device also includes a plurality of color pixel control circuits, the color pixel group includes at least two color pixel units, the color pixel control circuit includes a first capacitor and at least two second branches, the second branch includes a second photosensitive diode and a second switch connected in series; one first branch is set corresponding to one color pixel unit in the color pixel group.

[0161] The pixel information acquisition method includes: in a color pixel control circuit, controlling the sixth number of second switches to be turned on; reading the fourth pixel information through the first capacitor, the fourth pixel information being the sum of the pixel information of the sixth number of color pixel units; controlling the seventh number of second switches to be turned on; reading the fifth pixel information through the first capacitor, wherein the fifth pixel information is the sum of the pixel information of the eighth number of color pixel units, the eighth number being the sum of the sixth number and the seventh number; generating color pixel merging information based on the fourth pixel information and the fifth pixel information, the color pixel merging information including the ratio of the sixth number to the eighth number.

[0162] The sixth number may be one or greater than one.

[0163] Before controlling the sixth number of second switches to be turned on, an exposure operation may be performed on each second photodiode in the color pixel control circuit. The exposure operation may be a manual exposure operation triggered manually or an automatic exposure operation triggered at a preset period.

[0164] If the sixth number is one, the sixth number of color pixel units is one color pixel unit, and the first pixel information is the pixel information of the one color pixel unit. The pixel information of the one color pixel unit can be read through the first capacitor in the color pixel control circuit.

[0165] If the sixth number is greater than one, the first pixel information is the sum of the pixel information of the sixth number of color pixel units. The sum of the pixel information of the sixth number of color pixel units collected in the control module can be read through the first capacitor in the color pixel control circuit.

[0166] The sixth number may be the same as the seventh number, or may be different from the seventh number. The seventh number may be one, or a natural number greater than one. It should be noted that there is no duplicate second switch between the sixth number of second switches and the seventh number of second switches.

[0167] When the sixth number of second switches are kept turned on, the seventh number of second switches are controlled to be turned on, and then in the color pixel control circuit, the eighth number of second switches are all in the turned-on state.

[0168] The sum of pixel information of the sixth number of color pixel units collected on the first capacitor and the sum of pixel information of the seventh number of color pixel units can be read through the first capacitor in the color pixel control circuit, that is, the sum of pixel information of the eighth number of color pixel units collected on the first capacitor can be read through the first capacitor in the color pixel control circuit.

[0169] For example, the sixth number is 1, the seventh number is 1, and the eighth number is 2. Reading the color pixel information of two color pixel units through the first capacitor is equivalent to obtaining twice the color pixel information of one color pixel unit.

[0170] Since the photosensitivity area of ​​the second photodiode in each color pixel unit is the same, the color pixel merging information generated by the fourth pixel information and the fifth pixel information can achieve binning (pixel merging) outputs of different proportions. Through one exposure, two images of the sixth quantity and the eighth quantity can be obtained, thereby expanding the dynamic range of the brightness information corresponding to the color pixel information of the color pixel.

[0171] For example, one second switch is first controlled to be turned on to read the fourth pixel information, and then one second switch is controlled to be turned on to read the fifth pixel information, then 1:2 color pixel merging information can be generated according to the fourth pixel information and the fifth pixel information. The color pixel merging information includes the ratio of the sixth number 1 to the eighth number 2.

[0172] In another embodiment, after step 608 is executed, the ninth number of second switches can be controlled to be turned on, and the sixth pixel information can be read through the first capacitor, the sixth pixel information being the sum of the pixel information of the tenth number of color pixel units, and the tenth number being the sum of the eighth number and the ninth number.

[0173] For example, first control one second switch to be turned on to read the fourth pixel information, then control one second switch to be turned on to read the fifth pixel information, and then control one second switch to be turned on to read the sixth pixel information, thereby obtaining 1:2:3 color pixel merging information.

[0174] In the above-mentioned pixel information acquisition method embodiment, in the color pixel control circuit, the sixth number of second switches are controlled to be turned on; the fourth pixel information is read through the first capacitor, and the fourth pixel information is the sum of the pixel information of the sixth number of color pixel units; the seventh number of second switches are controlled to be turned on; the fifth pixel information is read through the first capacitor, wherein the fifth pixel information is the sum of the pixel information of the eighth number of color pixel units, and the eighth number is the sum of the sixth number and the seventh number; based on the fourth pixel information and the fifth pixel information, color pixel merging information is generated, and the color pixel merging information includes the ratio value of the sixth number to the eighth number. Through this technical solution, by controlling the second switch to be turned on twice, color pixel information of different proportions can be obtained, and color pixel merging information can be generated, so that more extensive data support can be provided when data processing is performed according to the color pixel merging information.

[0175] The pixel information acquisition method may further include: acquiring a color pixel sensitivity ratio; and determining a sixth number of switches turned on for the first time and a seventh number of switches turned on for the second time according to the color pixel sensitivity ratio.

[0176] The color pixel sensitivity ratio may be a quantitative ratio set when the user wishes to obtain 1:N color pixel merging information, that is, 1:N. N is a natural number greater than 1. For example, when the user wishes to obtain 1:3 color pixel merging information, the color pixel sensitivity ratio is set to 1:3. The color pixel sensitivity ratio may also be 1:N:M, for example, 1:2:3. The embodiment of the present application does not impose any special restrictions on the form of the color pixel sensitivity ratio.

[0177] According to the obtained color pixel sensitivity ratio, the sixth number of the first switch on and the seventh number of the second switch on can be determined. The sum of the sixth number and the seventh number is the eighth number, and the color pixel sensitivity ratio can be the ratio of the sixth number to the eighth number, so the sixth number and the seventh number can be determined by the color pixel sensitivity ratio.

[0178] Since the photosensitivity area of ​​the second photodiode of each color pixel unit is the same, the color pixel information obtained when N second switches are controlled to be turned on can be N times the color pixel information obtained when only one second switch is turned on.

[0179] For example, when the color pixel sensitivity ratio is 1:3, it can be determined that the sixth number of switches turned on for the first time is 1, and the seventh number of switches turned on for the second time is 2.

[0180] Taking the color pixel sensitivity ratio of 1:3 as an example, it should be noted that when the user only needs 3 times the color pixel information and does not need 1 times the color pixel information, only one switch can be turned on to control the 3 second switches to be turned on, and the sum of the pixel information of the three color pixel units can be read through the first capacitor.

[0181] By obtaining the color pixel sensitivity ratio and determining the sixth number of the first switch conduction and the seventh number of the second switch conduction according to the color pixel sensitivity ratio, the number of two switch conductions can be predetermined to determine how to control the color pixel control circuit.

[0182] In the pixel information acquisition method, after generating color pixel merging information based on the fourth pixel information and the fifth pixel information, the method may further include: generating RGB color values ​​corresponding to an eighth number of color pixel units according to the color merging pixel information.

[0183] It should be noted that, in the at least two branches included in the color pixel control circuit, the wavelength range of the light absorbed by the color pixel unit corresponding to each branch is the same. For example, in the at least two branches included in the color pixel control circuit, the wavelength range of the light absorbed by the color pixel unit corresponding to each branch corresponds to green light, then the pixel information can be color-merged to generate the value of the green component (G) in the RGB color value corresponding to the eighth number of color pixel units.

[0184] Natural light can be used when exposing the color pixel unit. Since the color pixel unit only absorbs light within a specified wavelength band, other light will be filtered out. Therefore, the intensity of light absorbed by the color pixel unit is obviously less than the intensity of natural light. The RGB color value corresponding to the eighth number of color pixel units generated by color merging pixel information can expand the dynamic range of brightness information corresponding to the pixel information output by the color pixel unit, so that the color in the image output by the color pixel unit is closer to the real color of the photographed object.

[0185] Alternatively, if Figure 7 As shown, an embodiment of the present application also provides an electronic device 700, including a camera module 701, a processor 702, a memory 703, and a program or instruction stored in the memory 703 and executable on the processor 702. When the program or instruction is executed by the processor 702, each process of the above-mentioned focusing method embodiment is implemented, and the same technical effect can be achieved. To avoid repetition, it will not be described here.

[0186] The camera module 701 may include various structures as described in the aforementioned camera module embodiments, which will not be described in detail here.

[0187] It should be noted that the electronic device in the embodiments of the present application may be a mobile electronic device or a non-mobile electronic device. For example, the mobile electronic device may be a mobile phone, a tablet computer, a laptop computer, a PDA, an in-vehicle electronic device, a wearable device, an ultra-mobile personal computer (UMPC), a netbook, or a personal digital assistant (PDA), etc., and the non-mobile electronic device may be a personal computer (PC), a television (TV), a teller machine, or a self-service machine, etc., which is not specifically limited in the embodiments of the present application.

[0188] The electronic device in the embodiment of the present application may be an electronic device having an operating system. The operating system may be an Android operating system, an iOS operating system, or other possible operating systems, which are not specifically limited in the embodiment of the present application.

[0189] Figure 8 A schematic diagram of the hardware structure of an electronic device provided in an embodiment of the present application.

[0190] The electronic device 800 includes but is not limited to: a radio frequency unit 801, a network module 802, an audio output unit 803, an input unit 804, a sensor 805, a display unit 806, a user input unit 807, an interface unit 808, a memory 809, a processor 810, a camera module 811 and other components.

[0191] Among them, the camera module 811 includes an image sensor. The image sensor may include various structures as in the aforementioned image sensor embodiment, which will not be repeated here. The camera module 811 also includes: a circuit board, the image sensor is electrically connected to the circuit board; and a lens, which is arranged on a side of the image sensor away from the circuit board. The number of lenses can be one or at least two, and this specification does not limit the number of lenses.

[0192] The processor 810 in the figure may include various structures as in the aforementioned processor embodiment, which will not be described in detail here. Those skilled in the art will understand that the electronic device 800 may also include a power supply (such as a battery) for supplying power to various components, and the power supply may be logically connected to the processor 810 through a power management system, so as to realize functions such as management of charging, discharging, and power consumption management through the power management system. Figure 8 The structure of the electronic device shown does not constitute a limitation on the electronic device. The electronic device may include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently, which will not be described in detail here.

[0193] The processor 810 is used to control a first number of first switches to be turned on in the real-sense pixel control circuit;

[0194] Reading first pixel information through the control module, where the first pixel information is the sum of pixel information of the first number of real-sense pixel units;

[0195] Controlling a second number of first switches to be turned on;

[0196] Reading second pixel information through the control module, wherein the second pixel information is the sum of pixel information of a third number of real-sense pixel units, and the third number is the sum of the first number and the second number;

[0197] Based on the first pixel information and the second pixel information, real-sense pixel merging information is generated, where the real-sense pixel merging information includes a ratio value of the first number to the third number.

[0198] In an embodiment of the present application, in a real-sense pixel control circuit, a first number of first switches are controlled to be turned on; a first pixel information is read through a control module, and the first pixel information is the sum of pixel information of a first number of real-sense pixel units; a second number of first switches are controlled to be turned on; a second pixel information is read through a control module, wherein the second pixel information is the sum of pixel information of a third number of real-sense pixel units, and the third number is the sum of the first number and the second number; based on the first pixel information and the second pixel information, real-sense pixel merging information is generated, and the real-sense pixel merging information includes a ratio value of the first number and the third number. Through this technical solution, by controlling the first switch to be turned on twice, real-sense pixel information of different proportions can be obtained, and real-sense pixel merging information can be generated, so that a wider range of data support can be provided when data processing is performed according to the real-sense pixel merging information.

[0199] Optionally, the processor 810 is further configured to:

[0200] Get the real-sense pixel photosensitivity ratio;

[0201] According to the light sensitivity ratio of the real-sensing pixels, a first number of switches turned on for the first time and a second number of switches turned on for the second time are determined.

[0202] Optionally, the processor 810 is further configured to:

[0203] Determine the signal change amount of the real-sense pixel group according to real-sense pixel merging information acquired twice adjacently within a preset time range;

[0204] According to the comparison result of the signal change amount and the preset change amount threshold, it is determined whether the photographed object corresponding to the real-sense pixel group is in a motion state.

[0205] Through the embodiments of the present application, the first number of switches turned on for the first time and the number of switches turned on for the second time can be predetermined, and whether the photographed object is in motion can be determined based on the real-sense pixel merging information obtained twice.

[0206] It should be understood that in the embodiment of the present application, the input unit 804 may include a graphics processor (GPU) 8041 and a microphone 8042, and the graphics processor 8041 processes the image data of the static picture or video obtained by the image capture device (such as a camera) in the video capture mode or the image capture mode. The display unit 806 may include a display panel 8061, and the display panel 8061 may be configured in the form of a liquid crystal display, an organic light emitting diode, etc. The user input unit 807 includes a touch panel 8071 and other input devices 8072. The touch panel 8071 is also called a touch screen. The touch panel 8071 may include two parts: a touch detection device and a touch controller. Other input devices 8072 may include but are not limited to a physical keyboard, a function key (such as a volume control button, a switch button, etc.), a trackball, a mouse, and a joystick, which will not be repeated here. The memory 809 can be used to store software programs and various data, including but not limited to applications and operating systems. The processor 810 can integrate an application processor and a modem processor, wherein the application processor mainly processes the operating system, the user interface, and the application program, etc., and the modem processor mainly processes wireless communication. It is understandable that the above-mentioned modem processor may not be integrated into the processor 810.

[0207] An embodiment of the present application also provides a readable storage medium, on which a program or instruction is stored. When the program or instruction is executed by a processor, the various processes of the above-mentioned pixel information acquisition method embodiment are implemented, and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.

[0208] The processor is the processor in the electronic device in the above embodiment. The readable storage medium includes a computer readable storage medium, such as a computer read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk.

[0209] An embodiment of the present application further provides a chip, which includes a processor and a communication interface, wherein the communication interface and the processor are coupled, and the processor is used to run programs or instructions to implement the various processes of the above-mentioned pixel information acquisition method embodiment, and can achieve the same technical effect. To avoid repetition, it will not be repeated here.

[0210] It should be understood that the chip mentioned in the embodiments of the present application can also be called a system-level chip, a system chip, a chip system or a system-on-chip chip, etc.

[0211] It should be noted that, in this article, the terms "comprise", "include" or any other variant thereof are intended to cover non-exclusive inclusion, so that the process, method, article or device including a series of elements includes not only those elements, but also includes other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the sentence "comprise one..." do not exclude the presence of other identical elements in the process, method, article or device including the element. In addition, it should be pointed out that the scope of the methods and devices in the embodiments of the present application is not limited to performing functions in the order shown or discussed, and may also include performing functions in a substantially simultaneous manner or in reverse order according to the functions involved, for example, the described method may be performed in an order different from that described, and various steps may also be added, omitted, or combined. In addition, the features described with reference to certain examples may be combined in other examples.

[0212] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus a necessary general hardware platform, and of course by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present application, or the part that contributes to the prior art, can be embodied in the form of a computer software product, which is stored in a storage medium (such as ROM / RAM, a disk, or an optical disk), and includes a number of instructions for a terminal (which can be a mobile phone, a computer, a server, or a network device, etc.) to execute the methods of each embodiment of the present application.

[0213] The embodiments of the present application are described above in conjunction with the accompanying drawings, but the present application is not limited to the above-mentioned specific implementation methods. The above-mentioned specific implementation methods are merely illustrative and not restrictive. Under the guidance of the present application, ordinary technicians in this field can also make many forms without departing from the purpose of the present application and the scope of protection of the claims, all of which are within the protection of the present application.

Claims

1. An image sensor, characterized in that: include: A plurality of color pixel groups and a plurality of real-sense pixel groups; Each real-sense pixel group includes at least two real-sense pixel units; Each real-sense pixel group includes a microlens, and each microlens covers all real-sense pixel units of the real-sense pixel group; The real-sense pixel group includes six real-sense pixel units; The lens cross section of the microlens is a circle of a first size, and the lens cross section is a cross section parallel to the cross section of the real-sense pixel unit; The cross sections of the six real-sense pixel units in the real-sense pixel group form a hexagon of a second size; The circle of the first size is an inscribed circle of the hexagon.

2. The image sensor according to claim 1, characterized in that The image sensor further includes: a plurality of real-sense pixel control circuits; The real-sense pixel control circuit includes at least two first branches; The first branch includes a first photosensitive diode and a first switch connected in series; One of the real-sense pixel units in the real-sense pixel group is correspondingly provided with one of the first branches.

3. The image sensor according to claim 2, characterized in that The real-sense pixel control circuit further includes a control module and a signal processing module; the at least two first branches include a plurality of first parallel branches and a plurality of second parallel branches; A plurality of said first parallel branches are connected in parallel; The plurality of first parallel branches are connected in parallel, and the plurality of first parallel branches are connected in series with the control module; A plurality of said second parallel branches are connected in parallel; The plurality of second parallel branches are connected in parallel, and the plurality of second parallel branches are connected in series with the control module; The control module is connected in series with the signal processing module.

4. The image sensor according to claim 3, characterized in that: The first branch includes a first photosensitive diode and a first switch in the real-sense pixel unit; When the first switch in the real-sense pixel unit is turned on, the first end of the first photosensitive diode in the real-sense pixel unit is connected to the input end of the control module, and the second end of the first photosensitive diode in the real-sense pixel unit is grounded.

5. The image sensor according to claim 1, characterized in that In all real-sensing pixel units of a real-sensing pixel group covered by a microlens, the coverage area of ​​each real-sensing pixel unit by the microlens is the same.

6. The image sensor according to claim 1, characterized in that: The image sensor also includes a plurality of color pixel control circuits; The color pixel group includes at least two color pixel units; At least one of the color pixel units is correspondingly provided with one of the color pixel control circuits.

7. The image sensor according to claim 6, characterized in that: The color pixel control circuit includes a first capacitor and at least one second branch; the second branch includes a second photosensitive diode and a second switch connected in series; One color pixel unit in the color pixel group is correspondingly provided with one second branch; When there are at least two second branches, the at least two second branches are respectively connected in series with the first capacitor.

8. The image sensor according to claim 7, characterized in that: Each of the color pixel groups includes six color pixel units; Wherein, the cross section of the color pixel unit is a triangle; the cross sections of the six color pixel units in the color pixel group form a hexagon; In each of the color pixel groups, the wavelength ranges of the light absorbed by the two color pixel units that are centrally symmetrically arranged are the same, and the wavelength ranges of the light absorbed by the two color pixel units that are adjacent to each other are different.

9. The image sensor according to claim 8, characterized in that: The plurality of color pixel groups include a first color pixel group and a second color pixel group, wherein the first color pixel group and the second color pixel group are adjacently arranged; The first color pixel group includes a first color pixel unit, the second color pixel group includes a second color pixel unit, the first color pixel unit and the second color pixel unit are arranged adjacent to each other; the first color pixel unit and the second color pixel unit absorb the same wavelength range of light.

10. The image sensor according to claim 9, characterized in that: The second branch includes a second photosensitive diode and a second switch in the first color pixel unit; When the second switch in the first color pixel unit is turned on, the first end of the second photosensitive diode in the first color pixel unit is connected to the first end of the first capacitor, and the second end of the second photosensitive diode in the first color pixel unit is grounded.

11. The image sensor according to claim 1, characterized in that: The ratio of the number of the plurality of color pixel groups to the number of real-sense pixel groups is less than a first ratio threshold and greater than a second ratio threshold.

12. The image sensor according to claim 11, characterized in that: The first ratio threshold is 5%, and the second ratio threshold is 1%.

13. The image sensor according to claim 11 or 12, characterized in that: Each real-sense pixel group corresponds to 31 color pixel groups.

14. A camera module, characterized in that: The invention comprises the image sensor according to any one of claims 1 to 13.

15. The camera module according to claim 14, characterized in that: The camera module also includes: A circuit board, the image sensor being electrically connected to the circuit board; A lens is arranged on a side of the image sensor away from the circuit board.

16. An electronic device, characterized in that: Including the camera module described in claim 14 or 15.

17. A method for acquiring pixel information, applied to the electronic device according to claim 16, characterized in that: The image sensor in the electronic device further comprises a plurality of real-sensing pixel control circuits, wherein the real-sensing pixel control circuit comprises a control module and at least two first branches, wherein the first branch comprises a first photosensitive diode and a first switch connected in series; One of the real-sense pixel units in the real-sense pixel group is correspondingly provided with one of the first branches; The method comprises: In the real-sense pixel control circuit, controlling a first number of first switches to be turned on; Reading first pixel information through the control module, where the first pixel information is the sum of pixel information of the first number of real-sense pixel units; Controlling a second number of first switches to be turned on; Reading second pixel information through the control module, wherein the second pixel information is the sum of pixel information of a third number of real-sense pixel units, and the third number is the sum of the first number and the second number; Based on the first pixel information and the second pixel information, real-sense pixel merging information is generated, where the real-sense pixel merging information includes a ratio value of the first number to the third number.

18. The method according to claim 17, characterized in that Before controlling the first number of first switches to be turned on in the real-sense pixel control circuit, the method further includes: Get the real-sense pixel photosensitivity ratio; According to the light sensitivity ratio of the real-sensing pixels, a first number of switches turned on for the first time and a second number of switches turned on for the second time are determined.

19. The method according to claim 17, characterized in that After generating the real-sense pixel merging information based on the first pixel information and the second pixel information, the method further includes: Determine the signal change amount of the real-sense pixel group according to real-sense pixel merging information acquired twice adjacently within a preset time range; According to the comparison result of the signal change amount and the preset change amount threshold, it is determined whether the photographed object corresponding to the real-sense pixel group is in a motion state.

Images