Camera module, electronic device, photographing method, and photographing apparatus

Abstract

The present application relates to the technical field of image processing, and discloses a camera module, an electronic device, a photographing method, and a photographing apparatus. The camera module comprises an image sensor, the image sensor comprising at least two rows of pixels and analog-to-digital conversion circuits; each row of pixels is correspondingly provided with one analog-to-digital conversion circuit; each analog-to-digital conversion circuit comprises a first resistor, a capacitor module, an integration module, a comparison module, a first logic module, a second logic module, and a counting module; a first end of the first resistor is connected to a reference voltage or each pixel unit in each row of pixels, and a second end is connected to a first end of the capacitor module and a first end of the integration module; a second end of the capacitor module and a second end of the integration module are sequentially connected to a first end of the first logic module by means of the comparison module, the second logic module, and the counting module, and a second end of the first logic module is connected to a third end of the capacitor module; and the first logic module is used to control the magnitude of the capacitance of the capacitor module, and the second logic module is used to perform logic operation computation.

Description

Camera module, electronic device, photographing method and photographing apparatus

[0001] Cross Reference to Related Applications:

[0002] The present application claims priority from the Chinese patent application No. 202410418525.0 filed on April 9, 2024 and entitled "Camera module, electronic device, photographing method and photographing apparatus", the content of which is incorporated herein by reference in its entirety. TECHNICAL FIELD

[0003] The present application relates to the technical field of image processing, and particularly relates to a camera module, an electronic device, a photographing method and a photographing apparatus. BACKGROUND

[0004] In the related art, a Complementary Metal Oxide Semiconductor (CMOS) device is mainly used as a camera sensor. The general working process of a CMOS Image Sensor (CIS) is that a large number of photodiodes perceive light signals, the photodiodes convert the light signals into electrical signals, through an amplification circuit and an Analog-to-Digital (AD) conversion circuit, a digital signal matrix (i.e., an image) is formed, and then the image is stored after image signal processing (ISP) and compression.

[0005] In the CIS provided in the related art, each pixel needs to be emptied of accumulated charges before sensing light, and then integrates the light signal within a set exposure time and generates electrons. At the same time, the exposure mode of the CIS is usually rolling shutter, and the CIS performs line-by-line exposure by line-by-line scanning until all pixel points are exposed. This way makes the camera produce flicker phenomenon under 50 / 60Hz light source, that is, a camera picture appears a rolling dark stripe. SUMMARY

[0006] The purpose of the embodiments of the present application is to provide a camera module, an electronic device, a photographing method and a photographing apparatus, which can compensate the exposure energy of each row of pixels and eliminate the flicker phenomenon.

[0007] In a first aspect, an embodiment of the present application provides a camera module, which comprises an image sensor, at least two rows of pixels, and an analog-to-digital conversion circuit; each row of the pixels is provided with one of the analog-to-digital conversion circuits; the analog-to-digital conversion circuit comprises a first resistor, a capacitor module, an integration module, a comparison module, a first logic module, a second logic module, and a counting module; a first end of the first resistor is connected with each pixel unit in each row of the pixels, or the first end of the first resistor is connected with a reference voltage; a second end of the first resistor is connected with a first end of the capacitor module and a first end of the integration module, respectively; a second end of the capacitor module and a second end of the integration module are connected with a first end of the comparison module, respectively; a second end of the comparison module is connected with a first end of the second logic module; a second end of the second logic module is connected with a first end of the counting module; a second end of the counting module is connected with a first end of the first logic module, and a second end of the first logic module is connected with a third end of the capacitor module; wherein the first logic module is configured to control a capacitance of the capacitor module; and the second logic module is configured to perform a logic operation calculation.

[0008] In a second aspect, an embodiment of the present application provides an electronic device, which comprises the camera module according to the first aspect.

[0009] In a third aspect, an embodiment of the present application provides a photographing control method, which is performed by the electronic device according to the second aspect, and the electronic device further comprises a light source frequency detector connected with the camera module, the photographing control method comprising: controlling the light source frequency detector to detect light source frequency information corresponding to a current photographing environment; controlling an image sensor in the camera module to perform photosensing, and controlling an analog-to-digital conversion circuit in the camera module to perform exposure compensation on a target pixel based on the light source frequency information; and outputting target image data.

[0010] In a fourth aspect, an embodiment of the present application further provides a photographing apparatus, which comprises the camera module according to the first aspect, and the photographing apparatus further comprises a light source frequency detector connected with the camera module, and the photographing apparatus further comprises: a first control module configured to control the light source frequency detector to detect light source frequency information corresponding to a current photographing environment; a second control module configured to control an image sensor in the camera module to perform photosensing, and control an analog-to-digital conversion circuit in the camera module to perform exposure compensation on a target pixel based on the light source frequency information; and an output module configured to output target image data.

[0011] In a fifth aspect, an electronic device is provided, and the electronic device includes a memory, a processor, and a computer program stored in the memory and executable on the processor; and the processor is configured to read the program in the memory to implement the steps in the photographing control method according to the third aspect.

[0012] In a sixth aspect, a computer readable storage medium is provided, and the computer readable storage medium is configured to store a computer program, and the computer program is configured to implement the steps in the photographing control method according to the third aspect when executed by a processor.

[0013] In a seventh aspect, a computer program product is provided, and the computer program product includes computer instructions, and the computer instructions are configured to implement the steps in the photographing control method according to the third aspect when executed by a processor.

[0014] In the embodiments of the present application, an analog-to-digital conversion circuit is arranged for each row of pixels, and a capacitor module with variable capacitance is arranged in the analog-to-digital conversion circuit, and a first logic control module is configured to control the capacitance of the capacitor module. In this way, the exposure energy of each row of pixels of the image sensor can be compensated by adjusting the capacitance of the capacitor module, so that the total exposure energy of each row of pixels is consistent. In this way, the flicker phenomenon in the image can be eliminated, and the image quality can be improved.

[0015] Further, in the embodiments of the present application, when the electronic device performs a photographing operation, the light source frequency detector detects the light source frequency information corresponding to the current photographing environment, and then performs exposure compensation on the target pixels based on the light source frequency information, so that the total exposure energy of each row of pixels is consistent, and the flicker phenomenon caused by the change of the light source frequency can be eliminated.

[0016] Additional aspects and advantages of the present application will be in part apparent and in part pointed out hereinafter. BRIEF DESCRIPTION OF DRAWINGS

[0017] The above and / or additional aspects and advantages of the present application will become apparent and be readily appreciated from the following description, including the appended drawings.

[0018] FIG. 1 is a waveform diagram of an alternating current power supply;

[0019] FIG. 2 is a comparison diagram of global exposure and rolling shutter exposure;

[0020] FIG. 3 is a diagram illustrating that the image sensor exposes each row of pixels for the same exposure time, so that the exposure energy of the pixel rows exposed at different exposure times is inconsistent;

[0021] FIG. 4 is a structural diagram of a camera module provided by the embodiments of the present application;

[0022] FIG. 5 is a schematic diagram of a pixel circuit in a camera module according to an embodiment of the present application;

[0023] FIG. 6a is a schematic diagram of a module of an analog-to-digital conversion circuit in a camera module according to an embodiment of the present application;

[0024] FIG. 6b is a schematic diagram of a circuit structure of an analog-to-digital conversion circuit in a camera module according to an embodiment of the present application;

[0025] FIG. 7 is a flowchart of a photographing method according to an embodiment of the present application;

[0026] FIG. 8 is a schematic diagram of a structure of a photographing apparatus according to an embodiment of the present application;

[0027] FIG. 9 is a schematic diagram of a structure of an electronic device according to an embodiment of the present application;

[0028] FIG. 10 is a schematic diagram of a hardware structure of an electronic device according to an embodiment of the present application. DETAILED DESCRIPTION

[0029] Exemplary embodiments of the present application will be described herein below with reference to the accompanying drawings. While exemplary embodiments of the present application are shown in the drawings, it is understood that the present application can be implemented in various forms and should not be limited by the embodiments set forth herein. Rather, these embodiments are provided so that this application will be thorough and complete, and will fully convey the scope of the application to those skilled in the art.

[0030] An image sensor is the core of a camera and is the most critical technology in a camera. There are two types of sensors, one is a Charge-Coupled Device (CCD) which is widely used, and the other is a CMOS device. Compared with a traditional camera, the traditional camera uses "film" as its carrier for recording information, while the "film" of a digital camera is its imaging photosensitive element, which is the "film" that does not need to be replaced and is integrated with the camera.

[0031] In the related art, a digital camera captures an image under an alternating current light source, and the image has flicker, where there are two standards for alternating current power: 50Hz and 60Hz sine waveforms, for example, an alternating current power with a frequency of 60Hz as shown in FIG. 1. Since energy has no directionality, the energy corresponding to the 50Hz and 60Hz alternating current power is a waveform with a frequency of 100Hz and 120Hz.

[0032] Flicker usually occurs in indoor scenes. If the exposure time of each pixel row is not an integer multiple of the light source energy period, the signal intensity accumulated at different positions of the image varies periodically, which is the case of a single frame image. On a video sequence, if certain conditions are met, the video will appear in a striped pattern that moves slowly in the vertical direction.

[0033] When flicker occurs, regular light and dark stripes are found on the video. This phenomenon is also called Newton's ring, so flicker can also be understood as the problem of light and dark stripes appearing in the image.

[0034] As shown in FIG. 2, the CCD sensor can achieve the purpose of deflicker by using global exposure (Global shutter). Its characteristic is that all pixels on the CCD sensor start exposure at the same time, so the sensor collects the picture of the object at the same time point, and there is no flicker in the picture.

[0035] However, as shown in FIG. 2, the CMOS sensor in the related art uses rolling shutter, that is, each row of pixels is scanned and exposed, and after the pixel value of a row of pixels is measured, the next row of pixels is scanned and exposed. In the traditional camera sensor, each pixel needs to be emptied before being exposed, and then the accumulated light signal of the diode is integrated within the set exposure time, and an electron is generated. After these operations, it can be used for scanning and exposure of the next row of pixels. This causes the exposure start time of different pixel rows to be different. Based on the fact that the light source energy changes at a frequency of 100Hz and 120Hz, the light source energy at different times will be different, so that even if different pixel rows are exposed according to the same exposure parameters, the light energy of different pixel rows will be inconsistent.

[0036] Specifically, as shown in FIG. 3, assuming that the light source received by the camera is an alternating current light source, the illumination intensity of which changes periodically with time. At this time, even if the exposure time of each row of pixels in the sensor is the same, the exposure start time of each row of pixels is different, which leads to the fact that the exposure energy (integration of alternating current energy within the exposure time) of x1 (first row of pixels) and x2 (fourth row of pixels) is not equal.

[0037] As can be seen, the reason for the formation of flicker by the camera in the CIS working mode is related to the working principle of rolling shutter, and is affected by the frequency of alternating current.

[0038] In the related art, in order to solve the problem that the image photographed under the alternating current light source exists flicker, the following two methods are proposed:

[0039] 1) using antibanding algorithm, judging the frequency of the current light source by software, and then adjusting the camera exposure time to an integer multiple of the half wavelength of the light source to avoid flicker phenomenon;

[0040] 2) using global shutter exposure mode, so that there is no flicker phenomenon.

[0041] Among them, using antibanding algorithm to avoid flicker phenomenon, there is a problem of limited use range, for example: if the ambient brightness is too high, the exposure time must be within 10ms, at this time the antibanding algorithm will not avoid the flicker phenomenon. Using global shutter mode greatly increases the cost of the camera, and it is difficult to support the design of all exposed pixels. The pixel needs to add a device that can store voltage signals for a long time, which will cause the pixel performance to decline, the noise to increase, and the night shooting effect to be poor, therefore, the overall investment benefit ratio of global shutter is very unprofitable.

[0042] And in the embodiment of the present application, the image sensor adopts rolling shutter mode for image exposure, and the camera module in the embodiment of the present application can change the compensation exposure energy of each row of pixels by adjusting the capacitance of the capacitance module when photographing under alternating current light source, so that the total exposure energy of each row of pixels is consistent, so that the flicker phenomenon can be eliminated.

[0043] The camera module, electronic device, photographing method and photographing device provided by the embodiment of the present application will be described in detail in combination with the specific embodiments and application scenarios.

[0044] Referring to FIGS. 4, 5 and 6a, the camera module provided by the embodiment of the present application comprises an image sensor 2; the image sensor 2 comprises at least two rows of pixels, an analog-to-digital conversion (ADC) circuit 23, and each row of pixels is correspondingly provided with one analog-to-digital conversion circuit 23.

[0045] The analog-to-digital conversion circuit 23 comprises a first resistor R, a capacitance module 231, an integration module 232, a comparison module 233, a first logic module 234, a second logic module 235 and a counting module 236.

[0046] The first end of the first resistor R is connected with each pixel unit in each row of pixels, or the first end of the first resistor R is connected with a reference voltage Vref.

[0047] The second end of the first resistor R is connected with the first end of the capacitor module 231 and the first end of the integration module 232 respectively; the second end of the capacitor module 231 and the second end of the integration module 232 are connected with the first end of the comparison module 233 respectively;

[0048] The second end of the comparison module 233 is connected with the first end of the second logic module 235; the second end of the second logic module 235 is connected with the first end of the counting module 236; the second end of the counting module 236 is connected with the first end of the first logic module 234, and the second end of the first logic module 234 is connected with the third end of the capacitor module 231;

[0049] The first logic module 234 is configured to control the capacitance of the capacitor module 231; and the second logic module 235 is configured to perform a logic operation calculation.

[0050] In some embodiments, the image sensor 2 in the embodiments of the present application can be a CIS, or other image sensors using rolling shutter to perform image exposure. For ease of illustration, the embodiments of the present application are generally exemplified by taking the CIS as an example, which does not constitute a specific limitation.

[0051] It should be noted that the image sensor includes a plurality of pixel rows, and each pixel row includes a plurality of pixel units, and each pixel unit includes a corresponding photodiode. As shown in FIG. 5, the photodiodes PD1, PD2, PD3 and PD4 in the pixel circuit 22 are configured to collect light energy to obtain a photosensitive signal. The photosensitive signal can be a voltage (Pixel(V)) accumulated on the photodiode. In a fixed exposure time, the higher the voltage accumulated on the photodiode, the stronger the light intensity received by the pixel unit corresponding to the photodiode, that is, the more exposure energy of the pixel unit corresponding to the photodiode.

[0052] In some embodiments, the first end of the first resistor R is connected with the output end of each pixel unit Pixel in each row of pixels, or the first end of the first resistor R is connected with a reference voltage Vref. When the photosensitive signal of the pixel unit is sampled, the first end of the first resistor R is connected with the output end of each pixel unit Pixel in each row of pixels, so that the analog-to-digital conversion circuit 23 collects the first voltage corresponding to the photosensitive energy of the pixel unit. When the photosensitive energy of the pixel unit is measured, the first end of the first resistor R is connected with the reference voltage Vref, so that the analog-to-digital conversion circuit 23 measures the photosensitive energy according to the release time of the first voltage.

[0053] It should be noted that the analog-digital conversion circuit 23 can be used to perform analog-digital conversion on the photosensitive signal of each pixel unit in a row of pixels to obtain the final signal value, such as the pixel value, of each pixel unit in each row of pixels, so as to facilitate subsequent processing such as compression and storage of the pixel value.

[0054] In some embodiments, the final pixel value of each pixel unit is measured by the time length of voltage release after the voltage accumulated on the photodiode by the integration module included in the analog-digital conversion circuit 23, and the release time length is related to the capacitance value of the capacitance module 231 and the reference voltage. In this way, by adjusting the capacitance value of the capacitance module 231, the exposure compensation capability of the image sensor can be changed, and then the reading size of the photosensitive energy of the pixel can be changed, and finally the exposure energy of each row of pixels is consistent.

[0055] In the embodiments of the present application, an analog-digital conversion circuit is arranged corresponding to each row of pixels, and a capacitance module with variable capacitance is arranged in the analog-digital conversion circuit, and the first logic control module is used to control the capacitance of the capacitance module. In this way, by adjusting the capacitance of the capacitance module, the exposure energy of each row of pixels of the image sensor can be compensated to make the total exposure energy of each row of pixels consistent, so that the flicker phenomenon in the image can be eliminated and the image quality can be improved.

[0056] In some embodiments, the image sensor 2 includes a first working state and a second working state;

[0057] As shown in FIGS. 6a and 6b, in the first working state, the integration module 232 is used to perform integration processing on the photosensitive signal Pixel(V) of the pixel unit Pixel to form a first voltage on the capacitance module 231;

[0058] As shown in FIGS. 6a and 6b, in the second working state, the integration module 232 is used to release the first voltage formed on the capacitance module 231 based on the reference voltage;

[0059] The comparison module 233 is used to send a first signal, such as a high-level signal, to the second logic module 235 in the case that the output voltage of the integration module 232 is greater than 0;

[0060] The second logic module 235 is used to perform logic processing on the first signal and the clock signal CLK and send a second signal, such as a high-level signal, to the counting module 236 in the case that the first signal is received;

[0061] The counting module 236 is used to count in the case that the second signal is received to obtain the signal value corresponding to the pixel unit Pixel;

[0062] The first logic module 234 is configured to control the capacitance of the capacitance module 231 in the first working state and the second working state respectively.

[0063] At this time, the counting duration of the counting module 236 is the integration duration of the integration module 232 in the second working state.

[0064] In some embodiments, the first working state can realize the collection of the exposure energy of the photosensitive signal, and the second working state can realize the measurement of the exposure energy.

[0065] In some embodiments, the integration module 232 outputs a high voltage when the voltage at the first end (-end) of the integration module 232 is greater than the voltage at the reference end (+end) of the integration module 232. Assuming that the voltage value of the first voltage required by the capacitance module 231 to be discharged in the second working state is Uc-Vref, the integration module 232 outputs a high voltage during the process in which the voltage on the equivalent capacitance of the capacitance module 231 is greater than Vref.

[0066] In this way, the comparison module 233 outputs a high voltage signal to the second logic module 235 when the electrical signal output by the integration module 232 is greater than the reference electrical signal (usually 0V), and the second logic module 235 sends a high voltage signal to the counting module 236 in combination with the clock signal CLK under the action of the high voltage signal, and the counting module 236 continuously counts under the action of the continuous high voltage signal.

[0067] In some embodiments, the integration module 232 outputs a low voltage when the voltage at the first end (-end) of the integration module 232 is less than or equal to the reference voltage. Assuming that the voltage value of the first voltage required by the capacitance module 231 to be discharged in the second working state is Uc-Vref, the integration module 232 outputs a low voltage (usually 0) during the process in which the voltage on the equivalent capacitance of the capacitance module 231 is discharged to be less than or equal to Vref.

[0068] In this way, the comparison module 233 outputs a low voltage signal to the second logic module 235 when the electrical signal output by the integration module 232 is 0, and the second logic module 235 stops sending a voltage signal to the counting module 236 or sends a low voltage signal to the counting module 236 under the action of the low voltage signal, and the counting module 236 stops counting.

[0069] As can be seen from the above, the counting result of the counting module 236 is positively correlated with the duration (second integration duration) of the first voltage discharged by the capacitance module 231 in the second working state.

[0070] In some embodiments, by adjusting the capacitance of the capacitance module 231 in the first working state and the second working state respectively, the proportion of reading the exposure energy of the photosensitive signal in the second working state can be adjusted.

[0071] In one embodiment, by adjusting the capacitance of the capacitance module 231 in the first working state and the second working state respectively, the proportion of the first voltage discharged by the capacitance module 231 in the second working state to the first voltage formed by the capacitance module 231 in the first working state can be adjusted.

[0072] For example, as shown in FIG. 6b, assuming that the second end of the first switch S2 is connected to the first end of the second capacitor C2 in the first working state of the capacitance module 231, and the second switch S3 is disconnected, if the second end of the first switch S2 is connected to the second end of the integration module 232 in the second working state, and the second switch S3 is closed, at this time, the equivalent capacitance value of the capacitance module 231 increases, and the integration time is prolonged.

[0073] As an optional embodiment, the capacitance module 231 comprises: a first capacitor C1, a second capacitor C2, a third capacitor C3, a first switch S2 and a second switch S3;

[0074] The second end of the first logic module 234 is connected to the control end of the first switch S2 and the control end of the second switch S3 respectively, so as to control the on-off of the first switch S2 and the second switch S3;

[0075] The first end of the first capacitor C1 is connected to the second end of the first resistor R, the second end of the first capacitor C1 is connected to the first end of the first switch S2, the second end of the first switch S2 is connected to the second end of the integration module 232 through the second capacitor C2, or the second end of the first switch S2 is directly connected to the second end of the integration module 232;

[0076] The first end of the second switch S3 is connected to the first end of the integration module 232, and the second end of the second switch S3 is connected to the second end of the integration module 232 through the third capacitor C3.

[0077] In some embodiments, the second end of the first switch S2 is connected to the second end of the integration module 232 through the second capacitor C2, or the second end of the first switch S2 is directly connected to the second end of the integration module 232, which can be understood as: by adjusting the switch state of the first switch S2, the second end of the first capacitor C1 can be connected to the second capacitor C2, at this time, the first capacitor C1 and the second capacitor C2 are connected in series, or the second end of the first capacitor C1 is connected to the second end of the integration module 232, at this time, the second capacitor C2 is cut out.

[0078] It should be noted that, assuming that the voltage resistance values of the two capacitors CA and CB are the same, if they are connected in series, the voltage resistance values of CA and CB are added, and the total equivalent capacitance C = (CA*CB) / (CA+CB); if they are connected in parallel, the voltage resistance value remains unchanged, and the total equivalent capacitance C = CA+CB. Based on the above principle, by adjusting the switching state of at least one of the first switch S2 and the second switch S3, the connection state of the first capacitor C1, the second capacitor C2 and the third capacitor C3 can be adjusted, so as to realize the adjustment of the total equivalent capacitance C of the capacitor module 231.

[0079] In some embodiments, the first switch S2 can realize the following two connection states:

[0080] 1) The first capacitor C1 and the second capacitor C2 are connected in series;

[0081] 2) The second capacitor C2 is cut out.

[0082] In some embodiments, the second switch S3 can realize the following two connection states:

[0083] 1) The second switch S3 is closed, at this time, the third capacitor C3 is connected in parallel with the first capacitor C1, or connected in parallel with the equivalent capacitor after the first capacitor C1 and the second capacitor C2 are connected in series, at this time, the third capacitor C3 in the capacitor module 231 participates in voltage division;

[0084] 2) The second switch S3 is open, at this time, the third capacitor C3 is cut out, at this time, the third capacitor C3 in the capacitor module 231 does not participate in voltage division.

[0085] It should be noted that, in addition to adjusting the connection state of the capacitors in the capacitor module 231, the first switch S2 and the second switch S3 can also adjust the number of capacitors that are charged or discharged in the capacitor module 231, wherein the first switch S2 is used to control the opening or closing of the second capacitor C2; the second switch S3 is used to control the opening or closing of the third capacitor C3.

[0086] For example: in the first working state, there are 3 capacitors for charging, and in the second working state, one of them is cut out, so only 2 capacitors are discharged, this method can also be used to adjust the proportion of the released first voltage.

[0087] In some embodiments, for the adjustment of the total equivalent capacitance of the capacitor module 231, it can be divided into two stages, the first stage corresponds to the first working state, and the second stage corresponds to the second working state, in this way, by adjusting the difference between the total equivalent capacitance of the capacitor module 231 in the first working state and the total equivalent capacitance of the capacitor module 231 in the second working state, the exposure compensation capability of the ADC circuit can be adjusted.

[0088] In some embodiments, the total capacitance of the capacitance module in the first working state is greater than the total capacitance of the capacitance module in the second working state; or, the total capacitance of the capacitance module in the first working state is less than the total capacitance of the capacitance module in the second working state; or, the total capacitance of the capacitance module in the first working state is equal to the total capacitance of the capacitance module in the second working state.

[0089] For example, the exposure compensation capability of the analog-to-digital conversion circuit 23 can be changed in the following way:

[0090] In the first working state, the total equivalent capacitance of the capacitance module 231 is reduced, and in the second working state, the original capacitance value of the total equivalent capacitance of the capacitance module 231 is restored.

[0091] In the first working state, the total equivalent capacitance of the capacitance module 231 is reduced, and in the second working state, the total equivalent capacitance of the capacitance module 231 is increased.

[0092] For example, the exposure compensation capability of the analog-to-digital conversion circuit 23 can be changed in the following way:

[0093] In the first working state, the total equivalent capacitance of the capacitance module 231 is increased, and in the second working state, the original capacitance value of the total equivalent capacitance of the capacitance module 231 is restored.

[0094] In the first working state, the total equivalent capacitance of the capacitance module 231 is increased, and in the second working state, the total equivalent capacitance of the capacitance module 231 is reduced.

[0095] It should be noted that the following formula can be established based on the first working state:

[0096] Based on the above formula 1), the following formula can be obtained:

[0097] Where t represents the first integration time, i.e. the time length of the forward integration of the capacitance module 231 on the charging voltage in the first working state; I represents the current value of the total equivalent capacitance branch of the capacitance module 231 during the first working state; C represents the total equivalent capacitance value of the capacitance module 231 during the first working state; R represents the resistance value of the first resistor; U(pixel) represents the voltage value corresponding to the photosensitive signal transmitted by the pixel unit, and Uc represents the voltage value of the first voltage accumulated on the total equivalent capacitance of the capacitance module 231 (i.e. the voltage value corresponding to the exposure energy collected from the photosensitive diode).

[0098] Based on the above formula 1) and formula 2), if R and C are fixed and do not change, the value of Uc is only related to U(pixel).

[0099] In addition, based on the second working state, the following formula can be established:

[0100] Wherein, t1 represents the second integral time length, i.e. the time length of the negative integral of the discharge voltage on the capacitor module 231 by the integral module 232 in the second working state; UC1 represents the voltage value on the total equivalent capacitance of the capacitor module 231 in the second working state; Vref represents the reference voltage, wherein the voltage value released by the capacitor module 231 in the second working state is equal to UC-Vref.

[0101] Since the end condition of the second working state is UC1=0, the above formula 3) can be simplified to the following formula:

[0102] Assuming that Vref, R and C have fixed values, then t1 is only related to Uc. Combining the formula 1) to formula 4) of the first working state and the second working state, it can be concluded that the greater the input voltage U(pixel), the greater the charging voltage Uc of the capacitor module 231 at the end of the first working state, and the longer the time required for the second working state. Therefore, the size of the input voltage U(pixel) can be determined by recording the second integral time length.

[0103] In some embodiments, assuming that Vref and R have fixed values, the proportion of the exposure energy measured based on the second integral time length can be adjusted by adjusting the second integral time length.

[0104] For example, as shown in FIG. 6b, in the analog-to-digital conversion circuit 23, assuming that the second end of the first switch S2 is connected to the second end of the integral module 232, and the second switch S3 is in the closed state, the initial state of the total equivalent capacitance of the capacitor module 231 is that the first capacitor C1 and the third capacitor C3 are connected in parallel. At this time, the adjustment of the total equivalent capacitance C of the capacitor module 231 can be realized according to the following scenarios:

[0105] Scenario one: reducing the capacitance value of the total equivalent capacitance of the capacitor module 231 in the first working state, and restoring the original capacitance value of the total equivalent capacitance of the capacitor module 231 in the second working state.

[0106] In some embodiments, in the first working state, the total equivalent capacitance C is reduced, which can be that the second end of the first switch S2 is connected to the second end of the integration module 232 through the second capacitor C2, at this time, the total equivalent capacitance C of the capacitor module 231 is equal to the first capacitor C1 and the second capacitor C2 in series, and then in parallel with the third capacitor C3. In the second working state, the original value of C is restored, which can be that the second end of the first switch S2 is connected to the second end of the integration module 232, at this time, the total equivalent capacitance C of the capacitor module 231 is equal to the first capacitor C1 and the third capacitor C3 in parallel.

[0107] In scenario one, because the equivalent capacitance in the second working state is greater than that in the first working state, the integration time t1 is prolonged.

[0108] Scenario two: In the first working state, the total equivalent capacitance of the capacitor module 231 is reduced, and in the second working state, the total equivalent capacitance of the capacitor module 231 is increased.

[0109] In some embodiments, in the first working state, the total equivalent capacitance C is reduced, which can be that the second end of the first switch S2 is connected to the second end of the integration module 232 through the second capacitor C2, at this time, the total equivalent capacitance C of the capacitor module 231 is equal to the first capacitor C1 and the second capacitor C2 in series. In the second working state, the capacitance value of C is increased, which can be that the second end of the first switch S2 is connected to the second end of the integration module 232, and the second switch S3 is closed, at this time, the total equivalent capacitance C of the capacitor module 231 is equal to the first capacitor C1 and the third capacitor C3 in parallel.

[0110] In scenario two, because the equivalent capacitance in the second working state is greater than that in the first working state, the integration time t1 is prolonged.

[0111] Scenario three: In the first working state, the total equivalent capacitance of the capacitor module 231 is increased, and in the second working state, the original capacitance value of the total equivalent capacitance of the capacitor module 231 is restored.

[0112] In some embodiments, in the first working state, the total equivalent capacitance C is increased, and in the second working state, the original value of C is restored, which can be that at least two capacitors in parallel in the first working state are adjusted to be in series in the second working state. In scenario three, because the equivalent capacitance in the second working state is smaller than that in the first working state, the integration time t2 is reduced.

[0113] Scenario four: In the first working state, the total equivalent capacitance of the capacitor module 231 is increased, and in the second working state, the total equivalent capacitance of the capacitor module 231 is reduced.

[0114] Similar to the principle of scenario three, in scenario four, the integral time t1 is reduced because the equivalent capacitance in the second working state is smaller than that in the first working state.

[0115] It should be noted that the above scenarios one to four all change the final second integral time, thereby changing the reading ratio of the pixel value, i.e., adjusting the compensation capability of the analog-digital conversion circuit 23 to the pixel exposure energy.

[0116] In some embodiments, as shown in FIG. 6b, the analog-digital conversion circuit 23 further includes a switch module S1.

[0117] The first end of the switch module S1 is connected with each pixel unit in each row of pixels, or the first end of the switch module S1 is connected with the reference voltage Vref; and the second end of the switch module S1 is connected with the first end of the first resistor R.

[0118] In some embodiments, the control end of the switch module S1 is connected with the first logic module 234, so that the first logic module 234 can control the switch module S1 to connect each pixel unit in each row of pixels with the first end of the first resistor R during the first working state, and control the switch module S1 to connect the reference voltage Vref with the first end of the first resistor R during the second working state.

[0119] Of course, the switch module S1 can also be controlled by other logic modules (such as the second logic module 235) or other controllers, which are not limited here.

[0120] In the present embodiment, the first end of the first resistor R can be connected with the reference voltage Vref or each pixel unit in each row of pixels through the switch module S1.

[0121] In some embodiments, the size of the reference voltage is adjustable. In this way, by adjusting the reference voltage, the proportion of the first voltage released by the capacitance module 231 in the second working state can be changed. For example, the first voltage released by the capacitance module 231 in the second working state can be all or part of the first voltage accumulated on the capacitance module 231 in the first working state.

[0122] In some embodiments, the total equivalent capacitance of the capacitance module 231 can affect the speed of releasing the voltage in the second working state. In the case that the total amount of the released voltage is fixed, the faster the speed of releasing the voltage in the second working state, the shorter the second integral time, and the smaller the measured pixel value.

[0123] In some embodiments, the magnitude of the reference voltage can affect the total amount of voltage discharged by the capacitance module 231 in the second working state. In the case of fixing the speed of voltage discharged by the capacitance module 231, the smaller the total amount of voltage discharged by the capacitance module 231 in the second working state, the shorter the second integration time, and the smaller the pixel value measured.

[0124] In an alternative embodiment, only the total equivalent capacitance of the capacitance module 231 in the first working state and the second working state can be adjusted, and the reference voltage is not adjusted, so as to adjust the reading ratio of the analog-to-digital conversion circuit 23 to the exposure energy of the pixel.

[0125] In another alternative embodiment, only the reference voltage can be adjusted, and the total equivalent capacitance of the capacitance module 231 in the first working state and the second working state is not adjusted, so as to adjust the reading ratio of the analog-to-digital conversion circuit 23 to the exposure energy of the pixel.

[0126] In another alternative embodiment, only the reference voltage can be adjusted, and the total equivalent capacitance of the capacitance module 231 in the first working state and the second working state is not adjusted, so as to adjust the reading ratio of the analog-to-digital conversion circuit 23 to the exposure energy of the pixel.

[0127] In some embodiments, as shown in FIG. 4, the camera module can further include a lens group 1, a filter 3, a motor 4, a base 5, and other electronic components 6.

[0128] The lens group 1 can be used for light collection and focusing.

[0129] Optionally, the motor 4 can be a voice coil motor, and the lens group 1 is fixed by the voice coil motor. The upper and lower ends of the voice coil motor are connected to the elastic sheet. When focusing, the voice coil motor is powered to generate an electromagnetic force, which finally pushes the elastic sheet to deform and balance with the elastic force of the elastic sheet. In this way, the position of the motor can be controlled by the size of the power, and the motor and the lens group 1 are pushed to the focus position.

[0130] Optionally, the filter 3 can be an infrared radiation filter (IR filter). The IR filter is located between the lens group 1 and the image sensor. The function of the IR filter is to filter unnecessary light projected to the image sensor 2, prevent the image sensor 2 from generating false colors or ripples, and improve its effective resolution and color restoration. The light after passing through the IR filter can be sensed by the image sensor 2.

[0131] In the working, the image sensor 2 can determine the compensation coefficient of each row of pixels according to the frequency of the light source and the first exposure parameter, and for each row of pixels, adjust the exposure compensation capability of each row of pixels according to the compensation coefficient of each row of pixels, so that the total exposure energy of each row of pixels in the image sensor 2 is consistent.

[0132] In some embodiments, the frequency of the light source can be detected by the detection module, which can be arranged at any position in the camera module that can be illuminated by the light source, or the detection module can be arranged outside the camera housing, for example, the camera module is a camera module on a mobile phone, at this time, the detection module can be arranged at any position on the mobile phone shell.

[0133] In some embodiments, the detection frequency of the detection module is much higher than the frequency of the alternating current light source, for example, assuming that the frequency of the alternating current light source is 100Hz, the detection frequency of the detection module can be 1000Hz, so that the detection module can timely and effectively detect the frequency of the light source to assist in calculating the compensation coefficient.

[0134] It should be noted that the flicker phenomenon only exists when the light source collected by the lens group 1 is an alternating current light source. When the light source collected by the lens group 1 is a direct current light source or natural light, the detection module fails to detect the frequency of the light source, at this time, the CIS 2 can perform image exposure based on the conventional rolling shutter scheme.

[0135] For the convenience of description, the light source collected by the lens group 1 is usually taken as an alternating current light source in the embodiments of the present application, for example, the frequency of the light source is 50Hz or 60Hz.

[0136] In some embodiments, the first exposure parameter can be an auto exposure (AE) parameter obtained by the camera module according to the ambient light intensity. The convergence purpose of the AE parameter is usually that the brightness of the image output by the camera module meets the human eye perception.

[0137] In some embodiments, the exposure time period of each row of pixels can be determined based on the first exposure parameter. For example, the first exposure parameter can include the exposure start time of the first row of pixels and the exposure duration of each row of pixels, so that the exposure time period of each row of pixels can be inferred.

[0138] As can be known from the foregoing related technical introduction, under the alternating current light source, the same length of light energy collected in different time periods is different, thereby causing the existence of stripes with light and dark in the output image of the camera module. In the embodiments of the present application, the exposure energy of each row of pixels can be adjusted to be consistent according to the compensation coefficient.

[0139] For example, if it is predicted that rolling shutter is performed according to the first exposure parameter, the exposure energy of the first row of pixels A is 150 LSB, and the exposure energy of the second row of pixels B is 100 LSB, the exposure energy of the second row of pixels B needs to be compensated based on the exposure energy of the first row of pixels A, and the compensation coefficient is 1.5. Based on the compensation coefficient, the exposure energy of the second row of pixels B can be compensated to be consistent with the exposure energy of the first row of pixels A.

[0140] In some embodiments, the adjustment of the exposure compensation capability of the pixel row in the embodiments of the present application can be to adjust the exposure energy reading ratio of the pixel row.

[0141] It should be noted that in the rolling shutter exposure mode, for each row of pixels, there are an exposure process and an analog-to-digital conversion process. The exposure process is used to accumulate light energy, i.e., exposure energy, on the pixel, and the analog-to-digital conversion process is used to convert the exposure energy into a digital pixel value. The above adjustment of the exposure energy reading ratio of the pixel row can be to adjust the reading ratio of the exposure energy of each pixel row according to the compensation coefficient of the pixel row, so that the exposure energy corresponding to the pixel value finally obtained by each pixel row is consistent. For example, the first row of pixels A and the second row of pixels B are exposed for the same exposure time at different times, and the exposure energy of the first row of pixels A is 1.5 times the exposure energy of the second row of pixels B. Based on the exposure energy of the first row of pixels A, the compensation coefficient of the second row of pixels B can be determined to be 1.5. Assuming that the exposure energy accumulated by the second row of pixels B is 100 LSB, the capacitance value and / or reference voltage of the capacitor module 231 in the analog-to-digital conversion circuit 23 can be adjusted during the analog-to-digital conversion of the 100 LSB exposure energy, so that the pixel value of the second row of pixels B obtained is equivalent to the pixel value obtained by analog-to-digital conversion of 150 LSB exposure energy.

[0142] As an optional embodiment, as shown in FIG. 5, the image sensor 2 further includes an image signal processor (ISP) 21.

[0143] The ISP 21 is configured to predict the exposure energy of each row of pixels in the image obtained by using rolling shutter according to the frequency of the light source and the first exposure parameter.

[0144] According to the exposure energy of each row of pixels, a compensation coefficient of each row of pixels is determined.

[0145] In some embodiments, the ISP 21 can determine the exposure time period of each row of pixels under the rolling shutter exposure according to the first exposure parameter, then determine the energy waveform of the light source based on the frequency of the light source, and integrate the energy waveform based on the exposure time period of each row of pixels to obtain the exposure energy of each row of pixels.

[0146] In some embodiments, the exposure energy of each row of pixels in the predicted image under the rolling shutter exposure based on the frequency of the light source and the first exposure parameter can reflect the situation of the flicker stripes in the image under the conventional rolling shutter exposure, such as the number of flicker stripes, the position of the flicker stripes, the severity of the flicker stripes, etc. Thereafter, the compensation coefficient of each row of pixels can be adjusted according to the situation of the flicker stripes to more specifically eliminate the flicker stripes.

[0147] In the present embodiment, the ISP 21 in the multiplexing image sensor 2 calculates the compensation coefficient of each row of pixels, which can reduce the structural complexity and cost of the camera module compared with calculating the compensation coefficient of each row of pixels by using an additional calculation module.

[0148] Of course, in some other embodiments, the processor outside the camera module can be used to calculate the compensation coefficient of each row of pixels, for example, when the camera module is assembled on a mobile phone, the processor on the mobile phone can be used to calculate the compensation coefficient of each row of pixels.

[0149] It should be noted that the circuit structure of the analog-to-digital conversion circuit 23 shown in FIG. 6b is only an example, and in some other embodiments, the circuit structure of the analog-to-digital conversion circuit 23 can also be adjusted, for example, the number or connection relationship of the capacitors and switches in the capacitor module 231 can be adjusted, or n reference voltage modules Vref1-Vrefn with different values are set, and the second end of the switch module S1 can be connected with one of Vref1-Vrefn or connected with the pixel unit. In this way, during the second working state, the first end of the switch module S1 can be selected to be in communication with one of Vref1-Vrefn to realize the adjustment of the reference voltage.

[0150] In summary, in the embodiment of the present application, in view of the interaction between the time-modulated light source (such as a pulse-width-modulated LED lamp) and the image sensor, which causes the light in the scene where the camera module is located to flicker in the imaging picture and thus produces an undesirable flicker stripe phenomenon, the light source frequency and the exposure start time of each row of pixels are acquired in advance, and the original exposure energy of CIS to each row of pixels is predicted in advance, so that the exposure energy ratio between each row of pixels can be obtained. Then, we can obtain the compensation coefficient required to make the exposure energy of CIS to each row of pixels equal, that is, the exposure compensation coefficient required by the Auto ADC of each row of pixels.

[0151] For example: the exposure energy of y1 (the first row of pixels) in sensor1 is A, and the original exposure energy of y2 (the fourth row of pixels) is 1.2A, and y2 can change the reading ratio of the read pixel voltage by 0.83 times through auto ADC. In this way, even if the exposure time of y1 and y2 is the same, the final exposure energy of y2 is equal to that of y1 (the first row), A = 1.2A*0.83 = 0.99A. Therefore, there is no flicker phenomenon in sensor1.

[0152] The embodiment of the present application also provides an electronic device, which comprises the camera module provided in the foregoing embodiment of the present application.

[0153] In some embodiments, the electronic device provided by the embodiment of the present application can be a terminal or other devices other than the terminal. Illustratively, the electronic device can be a mobile phone, a tablet computer, a notebook computer, a palm computer, a vehicle-mounted electronic device, a mobile Internet device (MID), an augmented reality (AR) / virtual reality (VR) device, a robot, a wearable device, an ultra-mobile personal computer (UMPC), a netbook, or a personal digital assistant (PDA), etc., and can also be a server, a network attached storage (NAS), a personal computer (PC), a television (TV), a teller machine, or a self-service machine, etc., and the embodiment of the present application is not limited in this regard.

[0154] In some embodiments, at least two camera modules can be included on the electronic device. When a user switches a contact image sensor (CIS), the switched camera module can also predict a compensation coefficient required to eliminate flicker in advance according to its own AE parameter and light source frequency information, and directly expose an image without flicker phenomenon at the time of switching.

[0155] For example, in a fast zoom scene, when the user switches the zoom ratio from 1x to 2x, the CIS switches from the main CIS to the portrait CIS. During this process, the portrait CIS can also predict a compensation coefficient required to eliminate flicker in advance according to its own AE parameter and light source frequency information, and directly expose an image without flicker phenomenon at the time of switching, so as to achieve smooth switching of the image without flicker phenomenon during the switching of the camera.

[0156] The electronic device provided by the embodiments of the present application includes the camera module provided by the foregoing embodiments of the present application, can control the camera module to realize the functions of the camera module provided by the foregoing embodiments of the present application, and can achieve the same beneficial effects as the camera module provided by the foregoing embodiments of the present application. To avoid repetition, no further description is given here.

[0157] The embodiments of the present application also provide a photographing method, which can be executed by the electronic device provided by the foregoing embodiments of the present application. The electronic device includes a light source frequency detector, and the light source frequency detector is the camera module provided by the foregoing embodiments of the present application.

[0158] As shown in FIG. 7, the photographing method includes the following steps:

[0159] Step 701: Control the light source frequency detector to detect light source frequency information corresponding to a current shooting environment.

[0160] Step 702: Control an image sensor in the camera module to perform photosensing, and control an analog-to-digital conversion circuit in the camera module to perform exposure compensation on a target pixel based on the light source frequency information.

[0161] Step 703: Output target image data.

[0162] In some embodiments, the control of the image sensor in the camera module to perform photosensing and the control of the analog-to-digital conversion circuit in the camera module to perform exposure compensation on the target pixel based on the light source frequency information include:

[0163] In the process of performing the image shooting operation, before the analog-to-digital conversion of the image exposure energy, the compensation coefficient for making the exposure energy of each row of pixels consistent is predicted in advance according to the frequency of the light source and the first exposure parameter, and in the exposure process, the capacitance value of the capacitance module in the analog-to-digital conversion circuit is adjusted according to the compensation coefficient of each row of pixels to change the exposure compensation capability of the analog-to-digital conversion circuit, so that the total exposure energy of each row of pixels in the image sensor is consistent, thereby eliminating the flicker phenomenon.

[0164] In some embodiments, the image shooting operation can be performed in response to the image shooting operation execution, at which time the exposure start time of the first row of pixels can be determined according to the interval time between the trigger time of the image shooting operation and the exposure start time of the first row of pixels being equal to the preset time difference between the exposure start time of the first row of pixels and the starting time of the image shooting operation.

[0165] Thereafter, the exposure start time difference of any two adjacent rows of pixels can be determined based on the first exposure parameter to infer the exposure start time of each subsequent row of pixels.

[0166] Finally, the exposure start time of each row of pixels is taken as the starting point, and the illumination energy is accumulated according to the fixed exposure duration included in the first exposure parameter to obtain the original exposure energy of each row of pixels.

[0167] In this way, the compensation coefficient required to adjust the total exposure energy of each row of pixels to be consistent is determined according to the difference in the original exposure energy of different rows of pixels.

[0168] As an optional embodiment, the controlling, based on the light source frequency information, the analog-to-digital conversion circuit in the camera module to perform exposure compensation on the target pixels includes at least one of the following:

[0169] In the case where the original exposure amount of the second row of pixels is greater than that of the first row of pixels, the original exposure amount of the second row of pixels is reduced by the analog-to-digital conversion circuit to make the final exposure amount of the second row of pixels equal to the original exposure amount of the first row of pixels;

[0170] In the case where the original exposure amount of the third row of pixels is less than that of the first row of pixels, the original exposure amount of the third row of pixels is increased by the analog-to-digital conversion circuit to make the final exposure amount of the third row of pixels equal to the original exposure amount of the first row of pixels.

[0171] In some of the modes, the original exposure of the pixel can be increased or decreased by adjusting the capacitance value and / or reference voltage of the capacitance module to change the second integration time, which has the same principle and can achieve the same beneficial effects as the mode of adjusting the capacitance value and / or reference voltage of the capacitance module to change the second integration time in the camera module provided in the foregoing embodiments of the application, and thus will not be described here again to avoid repetition.

[0172] In the embodiments of the application, the exposure compensation of the target pixel by the analog-to-digital conversion circuit in the camera module is controlled according to the light source frequency information, which has the same principle and can achieve the same beneficial effects as the mode of controlling the exposure compensation of the target pixel by the analog-to-digital conversion circuit in the camera module according to the light source frequency information in the camera module provided in the foregoing embodiments of the application, and thus will not be described here again to avoid repetition.

[0173] The embodiments of the application also provide a photographing device, as shown in FIG. 8, which includes any one of the camera modules 801 provided in the foregoing embodiments of the application. The photographing device 800 further includes a light source frequency detector 802 connected with the camera module 801, and further includes:

[0174] A first control module 803 is configured to control the light source frequency detector 802 to detect the light source frequency information corresponding to the current shooting environment.

[0175] A second control module 804 is configured to control the image sensor in the camera module 801 to perform photosensing, and control the analog-to-digital conversion circuit in the camera module 801 to perform exposure compensation on the target pixel based on the light source frequency information.

[0176] An output module 805 is configured to output target image data.

[0177] In some embodiments, the second control module 804 is configured to perform at least one of the following:

[0178] In the case where the original exposure of the second row of pixels is greater than the original exposure of the first row of pixels, the original exposure of the second row of pixels is decreased by the analog-to-digital conversion circuit to make the final exposure of the second row of pixels equal to the original exposure of the first row of pixels.

[0179] In the case where the original exposure of the third row of pixels is less than the original exposure of the first row of pixels, the original exposure of the third row of pixels is increased by the analog-to-digital conversion circuit to make the final exposure of the third row of pixels equal to the original exposure of the first row of pixels.

[0180] The photographing device 800 provided by the embodiment of the present application can realize each process of the photographing method provided by the embodiment of the present application, and can achieve the same beneficial effects as the photographing method. To avoid repetition, details are not described herein.

[0181] Optionally, as shown in FIG. 9, the embodiment of the present application further provides an electronic device 900, which includes a processor 901 and a memory 902, and the memory 902 stores programs or instructions executable on the processor 901. When the programs or instructions are executed by the processor 901, each step of the photographing method is realized, and the same technical effects can be achieved. To avoid repetition, details are not described herein.

[0182] It should be noted that the electronic device in the embodiment of the present application includes a mobile electronic device and a non-mobile electronic device.

[0183] FIG. 10 is a schematic diagram of a hardware structure of an electronic device for implementing the embodiment of the present application.

[0184] The electronic device 1000 includes but is not limited to a radio frequency unit 1001, a network module 1002, an audio output unit 1003, an input unit 1004, a sensor 1005, a display unit 1006, a user input unit 1007, an interface unit 1008, a memory 1009, and a processor 1010, etc., and further includes the camera module in the above embodiment.

[0185] Those skilled in the art can understand that the electronic device 1000 can further include a power supply (such as a battery) for supplying power to each component, and the power supply can be logically connected to the processor 1010 through a power management system, so as to realize functions such as management of charging, discharging, and power consumption management through the power management system. The structure of the electronic device shown in FIG. 10 does not constitute a limitation on the electronic device, and the electronic device can include more or fewer components than shown, or combine certain components, or have a different arrangement of components, which are not described herein.

[0186] The sensor 1005 includes a light source frequency detector connected to the camera module.

[0187] The processor 1010 is configured to:

[0188] control the light source frequency detector to detect light source frequency information corresponding to a current shooting environment;

[0189] control an image sensor in the camera module to perform photosensing, and control an analog-to-digital conversion circuit in the camera module to perform exposure compensation on a target pixel based on the light source frequency information;

[0190] output target image data.

[0191] In some embodiments, the processor 1010 performs the controlling, based on the light source frequency information, of the analog-to-digital conversion circuit in the camera module to perform exposure compensation on a target pixel, including at least one of:

[0192] In a case where the original exposure amount of the second row of pixels is greater than the original exposure amount of the first row of pixels, the original exposure amount of the second row of pixels is reduced by the analog-to-digital conversion circuit to make the final exposure amount of the second row of pixels equal to the original exposure amount of the first row of pixels;

[0193] In a case where the original exposure amount of the third row of pixels is less than the original exposure amount of the first row of pixels, the original exposure amount of the third row of pixels is increased by the analog-to-digital conversion circuit to make the final exposure amount of the third row of pixels equal to the original exposure amount of the first row of pixels.

[0194] It can be understood that the implementation process of each implementation manner mentioned in the embodiment can refer to the related description of the foregoing photographing method embodiment and achieve the same or corresponding technical effects. To avoid repetition, details are not described herein.

[0195] It should be understood that in the embodiments of the present application, the input unit 1004 can include a graphics processor (GPU) 10041 and a microphone 10042. The graphics processor 10041 processes image data of a still picture or a video obtained by an image capture device (such as a camera) in a video capture mode or an image capture mode. The display unit 1006 can include a display panel 10061, which can be configured in the form of a liquid crystal display, an organic light-emitting diode, etc. The user input unit 1007 includes at least one of a touch panel 10071 and other input devices 10072. The touch panel 10071 is also called a touch screen. The touch panel 10071 can include two parts of a touch detection device and a touch controller. The other input devices 10072 can include, but are not limited to, a physical keyboard, function keys (such as volume control keys, on-off keys, etc.), trackballs, mice, joysticks, and the like, which are not described herein.

[0196] The memory 1009 can be used to store software programs and various data. The memory 1009 can mainly include a first storage area storing programs or instructions and a second storage area storing data, wherein the first storage area can store an operating system, application programs or instructions required by at least one function (such as a sound playing function, an image playing function, etc.), etc. In addition, the memory 1009 can include a volatile memory or a non-volatile memory, or the memory 1009 can include both volatile and non-volatile memories. The non-volatile memory can be a Read-Only Memory (ROM), a Programmable ROM (PROM), an Erasable PROM (EPROM), an Electrically EPROM (EEPROM), or a flash memory. The volatile memory can be a Random Access Memory (RAM), a Static RAM (SRAM), a Dynamic RAM (DRAM), a Synchronous DRAM (SDRAM), a Double Data Rate SDRAM (DDR SDRAM), an Enhanced SDRAM (ESDRAM), a Synch link DRAM (SLDRAM), and a Direct Rambus RAM (DRRAM). The memory 1009 in the embodiments of the present application includes but is not limited to these and any other suitable types of memories.

[0197] The processor 1010 can include one or more processing units; optionally, the processor 1010 integrates an application processor and a modem processor, wherein the application processor mainly processes operations related to an operating system, a user interface, and an application program, and the modem processor mainly processes wireless communication signals, such as a baseband processor. It can be understood that the above-mentioned modem processor can also not be integrated into the processor 1010.

[0198] The embodiments of the present application also provide a readable storage medium, the readable storage medium stores programs or instructions, the programs or instructions are executed by a processor to realize the processes of the above-mentioned photographing method embodiments, and the same technical effects can be achieved. To avoid repetition, details are not described here.

[0199] The processor is the processor in the electronic device described in the above embodiments. The readable storage medium includes a computer readable storage medium, such as a computer readable only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk, and the like.

[0200] The chip provided in the embodiments of the present application includes a processor and a communication interface, the communication interface is coupled with the processor, the processor is used to run programs or instructions, realizes various processes of the above-mentioned photographing method embodiments, and can achieve the same technical effects. To avoid repetition, details are not described here.

[0201] It should be understood that the chip mentioned in the embodiments of the present application can also be referred to as a system level chip, a system chip, a chip system or a system on chip, etc.

[0202] The embodiments of the present application provide a computer program product, which includes computer instructions, and the computer instructions are executed by a processor to realize various processes of the above-mentioned photographing method embodiments and can achieve the same technical effects. To avoid repetition, details are not described here.

[0203] It should be noted that, in this document, the relationship terms such as first and second are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply that there is any such actual relationship or order between the entities or operations. Moreover, the terms "include", "contain" or any other variants thereof are intended to cover non-exclusive inclusion, so that the process, method, article or device including a series of elements not only includes those elements, but also includes other elements not explicitly listed or inherent to such process, method, article or device. Without more limitations, the element defined by the statement "including a" does not exclude the presence of another identical element in the process, method, article or device including the element.

[0204] Each embodiment in the specification is described in a relevant manner, and the same and similar parts of each embodiment can be referred to each other. Each embodiment focuses on the difference from other embodiments. For the embodiments of the device, the electronic device, the computer readable storage medium and the computer program product including instructions, since they are basically similar to the method embodiments, the description is relatively simple, and the relevant parts can be referred to the part of the method embodiment.

[0205] The above only describes the preferred embodiments of the present application and is not used to limit the protection scope of the present application. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present application is included in the protection scope of the present application.

Claims

1. A camera module, wherein: An image sensor is included, wherein the image sensor includes: At least two rows of pixels; An analog-to-digital conversion circuit, one analog-to-digital conversion circuit being provided for each row of pixels; The analog-to-digital conversion circuit includes a first resistor, a capacitor module, an integration module, a comparison module, a first logic module, a second logic module and a counting module; The first end of the first resistor is connected to each pixel unit in each row of pixels, or the first end of the first resistor is connected to a reference voltage; The second end of the first resistor is connected to the first end of the capacitor module and the first end of the integration module respectively; the second end of the capacitor module and the second end of the integration module are connected to the first end of the comparison module respectively; The second end of the comparison module is connected to the first end of the second logic module; the second end of the second logic module is connected to the first end of the counting module; the second end of the counting module is connected to the first end of the first logic module, and the second end of the first logic module is connected to the third end of the capacitance module; The first logic module is used to control the capacitance of the capacitance module; the second logic module is used to perform logic operation calculations.

2. The camera module according to claim 1, wherein: The capacitor module includes: a first capacitor, a second capacitor, a third capacitor, a first switch and a second switch; The second end of the first logic module is connected to the control end of the first switch and the control end of the second switch respectively, so as to control the on and off of the first switch and the second switch; The first end of the first capacitor is connected to the second end of the first resistor, the second end of the first capacitor is connected to the first end of the first switch, and the second end of the first switch is connected to the second end of the integration module via the second capacitor, or the second end of the first switch is directly connected to the second end of the integration module; A first end of the second switch is connected to a first end of the integration module, and a second end of the second switch is connected to a second end of the integration module via the third capacitor.

3. The camera module according to claim 2, wherein: The image sensor includes a first working state and a second working state; In the first working state, the integration module is used to integrate the light-sensing signal of the pixel unit to form a first voltage on the capacitor module; In the second working state, the integration module is used to release the first voltage formed on the capacitor module based on the reference voltage; The comparison module is configured to send a first signal to the second logic module when the output voltage of the integration module is greater than 0; The second logic module is configured to, upon receiving the first signal, perform logic processing on the first signal and the clock signal, and send a second signal to the counting module; The counting module is configured to count when receiving the second signal to obtain a signal value corresponding to the pixel unit; The first logic module is used to control the capacitance of the capacitor module in the first working state and the second working state respectively.

4. The camera module according to claim 3, wherein: The total capacitance of the capacitor module in the first working state is greater than the total capacitance of the capacitor module in the second working state.

5. The camera module according to claim 3, wherein: The total capacitance of the capacitor module in the first working state is smaller than the total capacitance of the capacitor module in the second working state.

6. The camera module according to claim 3, wherein: The total capacitance of the capacitor module in the first working state is equal to the total capacitance of the capacitor module in the second working state.

7. The camera module according to any one of claims 1 to 6, wherein: The analog-to-digital conversion circuit also includes a switch module; A first end of the switch module is connected to each pixel unit in each row of pixels, and a second end of the switch module is connected to a first end of the first resistor.

8. The camera module according to any one of claims 1 to 6, wherein: The analog-to-digital conversion circuit also includes a switch module; The first end of the switch module is connected to the reference voltage; the second end of the switch module is connected to the first end of the first resistor.

9. The camera module according to any one of claims 1 to 6, wherein: The reference voltage is adjustable.

10. An electronic device, wherein: Comprising a camera module as described in any one of claims 1 to 9.

11. A shooting method, wherein: The method is performed by the electronic device according to claim 10, wherein the electronic device further comprises a light source frequency detector connected to a camera module, and the method comprises: Controlling the light source frequency detector to detect light source frequency information corresponding to the current shooting environment; Controlling the image sensor in the camera module to sense light, and controlling the analog-to-digital conversion circuit in the camera module to perform exposure compensation on the target pixel based on the light source frequency information; Output target image data.

12. The method according to claim 11, wherein The controlling the analog-to-digital conversion circuit in the camera module to perform exposure compensation on the target pixel based on the light source frequency information includes at least one of the following: When the original exposure of the second row of pixels is greater than the original exposure of the first row of pixels, the analog-to-digital conversion circuit reduces the original exposure of the second row of pixels to compensate for the original exposure, so that the final exposure of the second row of pixels is equal to the original exposure of the first row of pixels; When the original exposure of the third row of pixels is less than the original exposure of the first row of pixels, the original exposure of the third row of pixels is increased and compensated by the analog-to-digital conversion circuit so that the final exposure of the third row of pixels is equal to the original exposure of the first row of pixels.

13. A photographing device, wherein: The camera module according to any one of claims 1 to 9, wherein the camera device further comprises a light source frequency detector connected to the camera module, and the camera device further comprises: A first control module is used to control the light source frequency detector to detect light source frequency information corresponding to the current shooting environment; a second control module, configured to control the image sensor in the camera module to sense light, and control the analog-to-digital conversion circuit in the camera module to perform exposure compensation on a target pixel based on the light source frequency information; The output module is used to output target image data.

Images