Shooting method, device, electronic device and storage medium
By calculating the dark current and power effect values under multiple reading durations in the CMOS image sensor, the target reading duration is determined, and the problem of power consumption and image quality cannot be taken into account, which improves the overall performance of the camera.
Patent Information
- Application Number
- CN202310089737.4
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2023-01-18
- Publication Date
- 2025-08-19
- Estimated Expiration
- 2043-01-18
AI Technical Summary
In the prior art, the power consumption and image quality of CMOS image sensors cannot be taken into account, resulting in poor overall camera performance.
By controlling the image sensor to read image data under multiple reading durations, calculate the dark current effect value, power effect value and comprehensive effect value, determine the target reading duration, and dynamically balance power consumption and image quality.
It realizes the reading time adjustment based on the comprehensive effect value before shooting, achieves a dynamic balance between image sensor power consumption and image quality, and improves the overall performance of the camera.
Smart Images

Figure CN116132837B_ABST
Abstract
Description
Technical Field
[0001] The present application belongs to the field of photographing technology, and specifically relates to a photographing method, device, electronic device and storage medium. Background Art
[0002] With the development of semiconductor technology, CMOS image sensors (CIS) designed based on the Complementary Metal Oxide Semiconductor (CMOS) process have been widely used in cameras of electronic devices. CIS is a camera chip with its own pixels, and each pixel in the CIS can perform independent charge conversion.
[0003] As the resolution of CIS becomes higher and higher, the circuit scale of CIS is also getting larger and larger. The use of a large number of transistors in the circuit can easily cause the power consumption of CIS to exceed the safety line. For example, excessive power consumption will cause the internal temperature of CIS to be too high, affecting the stability and reliability of the pixel circuit. In addition, the lens, infrared filter, etc. will also be deformed or even fail due to high temperature, causing unpredictable failures of the camera. Therefore, reducing the power consumption of CIS is crucial for cameras and electronic devices. In related technologies, when reducing the power consumption of CIS, it will affect the stability of the dark current of the pixel circuit in CIS, which in turn affects the image quality of the CIS output image. It is impossible to take into account the power consumption and image quality of CIS, resulting in poor overall performance of the camera. Summary of the Invention
[0004] The purpose of the embodiments of the present application is to provide a shooting method, device, electronic device and storage medium, which can solve the problem in the related art that the power consumption and image quality of the image sensor cannot be taken into account at the same time, and the overall performance of the camera is poor.
[0005] In a first aspect, an embodiment of the present application provides a photographing method, the method comprising:
[0006] Controlling the image sensor to read image data at N different reading time lengths to obtain first image data, wherein the reading time length is a time length corresponding to reading one frame of image data, N is an integer greater than 1, and the first image data includes black image data, current data, and voltage data;
[0007] Controlling the image processing chip to calculate the dark current effect value of the image sensor at each reading time according to the black image data;
[0008] controlling the image processing chip to calculate the power effect value of the image sensor at each reading time according to the current data and the voltage data;
[0009] Controlling the image processing chip to calculate a comprehensive effect value of the image sensor at each reading time according to the dark current effect value and the power effect value;
[0010] Determining a target reading time according to the comprehensive effect value;
[0011] The image sensor is controlled to read image data based on the target reading time to obtain second image data.
[0012] In a second aspect, an embodiment of the present application provides a photographing device, the device comprising:
[0013] a first control module, configured to control the image sensor to read image data at N different reading time lengths to obtain first image data, wherein the reading time length is a time length corresponding to reading one frame of image data, N is an integer greater than 1, and the first image data includes black image data, current data, and voltage data;
[0014] A second control module is used to control the image processing chip to calculate the dark current effect value of the image sensor at each reading time according to the black image data;
[0015] a third control module, configured to control the image processing chip to calculate a power effect value of the image sensor at each reading time according to the current data and the voltage data;
[0016] a fourth control module, configured to control the image processing chip to calculate a comprehensive effect value of the image sensor at each reading time according to the dark current effect value and the power effect value;
[0017] A determination module, configured to determine a target reading time according to the comprehensive effect value;
[0018] A fifth control module is configured to control the image sensor to read image data based on the target reading time to obtain second image data.
[0019] In a third aspect, an embodiment of the present application provides an electronic device comprising a processor and a memory, wherein the memory stores programs or instructions that can be run on the processor, and when the programs or instructions are executed by the processor, the steps of the method described in the first aspect are implemented.
[0020] In a fourth aspect, an embodiment of the present application provides a readable storage medium, on which a program or instruction is stored. When the program or instruction is executed by a processor, the steps of the method described in the first aspect are implemented.
[0021] In a fifth aspect, an embodiment of the present application provides a chip, which includes a processor and a communication interface, the communication interface and the processor are coupled, and the processor is used to run programs or instructions to implement the method described in the first aspect.
[0022] In a sixth aspect, an embodiment of the present application provides a computer program product, which is stored in a storage medium and executed by at least one processor to implement the method described in the first aspect.
[0023] In an embodiment of the present application, the image sensor is controlled to read image data at N different reading time lengths to obtain first image data, where the reading time length is the time length corresponding to reading one frame of image data, N is an integer greater than 1, and the first image data includes black image data, current data, and voltage data; the image processing chip is controlled to calculate the dark current effect value of the image sensor at each reading time length based on the black image data; the image processing chip is controlled to calculate the power effect value of the image sensor at each reading time length based on the current data and the voltage data; the image processing chip is controlled to calculate the comprehensive effect value of the image sensor at each reading time length based on the dark current effect value and the power effect value; the target reading time length is determined based on the comprehensive effect value; the image sensor is controlled to read image data based on the target reading time length to obtain second image data.
[0024] It can be seen that in the embodiments of the present application, for the shooting scene currently located by the electronic device, before the actual shooting is performed, the comprehensive effect value of the image sensor under different reading times can be calculated, and the reading time of the image sensor during the actual shooting can be adjusted according to the comprehensive effect value, and the actual shooting is performed based on the reading time. Since the comprehensive effect value is calculated based on the dark current effect value and the power effect value of the image sensor, and the dark current effect value can represent the dark current stability of the image sensor, and the power consumption effect value can represent the power consumption of the image sensor, it is possible to achieve a dynamic balance between the power consumption of the image sensor and the image quality, thereby achieving the purpose of taking into account the power consumption and image quality of the image sensor, and improving the overall performance of the camera. BRIEF DESCRIPTION OF THE DRAWINGS
[0025] Figure 1 is a flowchart of the shooting method provided in an embodiment of the present application;
[0026] Figure 2 This is an example diagram of an image sensor provided by an embodiment of the present application reading a frame of image data;
[0027] Figure 3 is an example diagram of the relationship between the dark current effect value and vertical blanking provided by an embodiment of the present application;
[0028] Figure 4This is an example diagram of the relationship between the power effect value and vertical blanking provided in an embodiment of the present application;
[0029] Figure 5 is an example diagram of the relationship between the comprehensive effect value and vertical blanking provided in an embodiment of the present application;
[0030] Figure 6 is an example diagram of the connection relationship between the column pixel circuit and the peripheral power supply circuit of the image sensor in the related art;
[0031] Figure 7 is an example diagram of a voltage difference change in a column pixel circuit of an image sensor in the related art;
[0032] Figure 8 is an example diagram of the connection relationship between the column pixel circuit and the peripheral power supply circuit of the image sensor provided by an embodiment of the present application;
[0033] Figure 9 This is an example diagram of a voltage difference change in a column pixel circuit of an image sensor provided by an embodiment of the present application;
[0034] Figure 10 This is a flowchart of an implementation of step 102 provided in an embodiment of the present application;
[0035] Figure 11 This is a flowchart of an implementation of step 103 provided in an embodiment of the present application;
[0036] Figure 12 This is a structural block diagram of a photographing device provided in an embodiment of the present application;
[0037] Figure 13 This is a schematic diagram of the structure of an electronic device provided in an embodiment of the present application;
[0038] Figure 14 It is a schematic diagram of the hardware structure of an electronic device that implements various embodiments of the present application. DETAILED DESCRIPTION
[0039] The following will be combined with the accompanying drawings in the embodiments of the present application to clearly describe the technical solutions in the embodiments of the present application. Obviously, the embodiments described are part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field are within the scope of protection of this application.
[0040] The terms "first," "second," and the like in the specification and claims of this application are used to distinguish similar objects, and are not used to describe a specific order or precedence. It should be understood that the terms used in this manner are interchangeable where appropriate, so that the embodiments of this application can be implemented in an order other than that illustrated or described herein, and that the objects distinguished by "first," "second," and the like are generally of the same type, and do not limit the number of objects; for example, the first object can be one or more. In addition, the term "and / or" in the specification and claims refers to at least one of the connected objects, and the character " / " generally indicates that the objects connected are in an "or" relationship.
[0041] Embodiments of the present application provide a photographing method, apparatus, electronic device, and storage medium.
[0042] To facilitate understanding, some concepts involved in the embodiments of this application are first introduced.
[0043] Complementary Metal Oxide Image Sensor (CIS): A camera-on-chip with its own pixels. Each pixel in a CIS performs independent charge conversion, significantly reducing the energy and supporting circuitry required to produce an image. CIS essentially replaces the function of the human eye, capturing the beauty of life and preserving fond memories. Furthermore, CIS is manufactured using the same materials and technologies as most microprocessors and memory chips. For ease of description, "image sensor" will be used instead of "CIS."
[0044] Image quality refers to the quality of the signal generated by an image sensor after it senses light, and also represents the quality of the image sensor. Image quality is measured in many dimensions, such as resolution, signal-to-noise ratio, and color accuracy. These are all based on the proper functioning of each pixel. Dark current and dark current uniformity are key indicators of pixel performance. A key prerequisite for high-quality image sensor performance is excellent dark-state performance, meaning stable dark current across the entire frame and consistent dark current across each pixel within the frame.
[0045] Power consumption: refers to the energy consumed by the image sensor when it is working, that is, the amount of electricity. As the resolution of image sensors becomes higher and higher, the functional circuits of image sensors become more and more, and the scale of integrated circuits of image sensors also increases significantly, the use of a large number of transistors can easily cause the power consumption of image sensors to exceed the safety line. At present, reducing power consumption is crucial for image sensors. It can reduce the heat generated when the camera is working, making the camera or mobile phone have a longer battery life. Excessive power consumption causes the internal temperature of the image sensor to be too high, which in turn causes the stability and reliability of the pixel circuit to drop sharply. At the same time, the lens, infrared filter, etc. will be deformed or even fail due to high temperature, causing unpredictable failures of the camera.
[0046] Dark current: Image sensors are semiconductor devices. In the absence of light, the transistors themselves will generate some stray currents due to diffusion movement. That is to say, even if there is no incident photons, the image sensor will still have a certain signal output, and the output signal is the dark current.
[0047] The main reason for the change in dark current: When electrons pass through the PN junction, they will encounter the electric potential barrier of the PN junction. The electrons need to go through the kinetic energy-potential energy-kinetic energy conversion process to cross the barrier, so it takes some time. The dark current has nothing to do with the level of the light signal, but is related to the temperature of the sensor. The general rule is that the dark current doubles for every 8 degrees Celsius increase in temperature. Therefore, when designing the circuit, be sure to place electronic components that are prone to heat as far away from the image sensor as possible. At the same time, the output of the dark current is also related to the power supply voltage. When a pixel circuit is performing a reading action, if the voltage is unstable due to digital-analog circuit voltage coupling, magnetic interference, or clock timing staggering, the dark current of this pixel will change unstably, ultimately affecting the image quality.
[0048] Horizontal blanking (Hblanking), also known as line blanking, is a technique used to convert optical signals into electrical signals. Scanning always begins at the upper left corner of the image and proceeds horizontally forward, while the scan point moves downward at a slower rate. When the scan point reaches the right edge of the image, it quickly returns to the left and begins scanning the second line below the starting point of the first line. This return process between lines is called horizontal blanking. A complete image scan signal, consisting of a sequence of line signals separated by horizontal blanking intervals, is called a frame.
[0049] Vertical blanking (Vblanking), also known as field blanking: After the scanning point scans a frame, it returns from the lower right corner of the image to the upper left corner of the image to start scanning a new frame. There will be an interval, this time interval is called vertical blanking. The function of vertical blanking is usually used to adjust the frame rate.
[0050] Frames Per Second (FPS) refers to the frame rate of the image sensor.
[0051] In the embodiment of the present application, dark current can be optimized from the hardware aspect, and a software solution can be embedded at the same time so that the power consumption and image quality of the image sensor can be dynamically balanced, so as to achieve the purpose of taking into account both the power consumption and image quality of the image sensor, thereby improving the overall performance of the camera.
[0052] The following describes the shooting method provided in the embodiment of the present application in detail through specific embodiments and their application scenarios in conjunction with the accompanying drawings.
[0053] It should be noted that the shooting method provided in the embodiment of the present application is applicable to electronic devices. In actual applications, the electronic device may be a mobile terminal such as a smart phone, a tablet computer or a personal digital assistant, and the embodiment of the present application does not limit this.
[0054] Figure 1 This is a flow chart of the shooting method provided in the embodiment of the present application. Figure 1 As shown, the method may include the following steps: step 101, step 102, step 103, step 104, step 105 and step 106;
[0055] In step 101, the image sensor is controlled to read image data at N different reading time lengths to obtain first image data, wherein the reading time length is the time length corresponding to reading one frame of image data, N is an integer greater than 1, and the first image data includes black image data, current data, and voltage data.
[0056] For example, Figure 2 As shown, the above reading time refers to the reading time of one frame, wherein the reading time of one frame is the sum of the total reading time of one row of all pixel rows in one frame image. Taking the first row of pixels as an example, the total reading time of one row is the sum of the reading time of the first row and the Vblanking of the first row.
[0057] In the embodiments of the present application, it is considered that the power consumption of the image sensor is mainly related to the working state of the pixels. When reading pixels, the longer the reading time of the image sensor, the greater the power consumption and the higher the power consumption. Therefore, in order to reduce power consumption, it is necessary to shorten the reading time as much as possible. However, shortening the reading time does not leave much time for the pixels to work. Semiconductor transistors need a certain amount of time to reach a steady state. If the time is not enough, the transistors cannot stabilize, resulting in pixel function degradation or even failure, which in turn affects dark current and image quality. Therefore, when adjusting the reading time of the image sensor, it is necessary to consider both the power consumption and image quality of the image sensor.
[0058] In an embodiment of the present application, one reading duration corresponds to a set of black image data, current data, and voltage data, wherein the black image data is a RAW image captured when the camera lens is blocked, the current data includes the current value of part or all of the circuits in the image sensor, and the voltage data includes the voltage value of part or all of the circuits in the image sensor.
[0059] In step 102 , the image processing chip is controlled to calculate the dark current effect value of the image sensor at each reading time according to the black image data.
[0060] In the embodiment of the present application, a reading duration corresponds to a dark current effect value. The larger the dark current effect value, the smoother the dark current of the pixel circuit of the image sensor, and the higher the image quality of the image sensor.
[0061] In one example, Figure 3 The relationship curve between different vertical blanking and dark current effect values is shown, where the horizontal axis is Vblanking, i.e. vertical blanking, Vblanking = (1 / FPS) - reading time, the vertical axis is the dark current effect value, and FPS is the frame rate of the image sensor. Figure 3 It can be seen that as the vertical blanking time continues to increase, the dark current effect value continues to decrease, that is, vertical blanking is negatively correlated with the dark current effect value. Since vertical blanking is negatively correlated with the reading time, the reading time is positively correlated with the dark current effect value.
[0062] It should be noted that Figure 3 This is only an illustrative example. In actual applications, vertical blanking and dark current effect value may be positively correlated or present a curve relationship, which is not limited in the embodiments of the present application.
[0063] In step 103 , the image processing chip is controlled to calculate the power efficiency value of the image sensor at each reading time according to the current data and the voltage data.
[0064] In the embodiment of the present application, a reading duration corresponds to a power effect value. The larger the power effect value is, the lower the power consumption of the image sensor is.
[0065] In one example, Figure 4 The relationship curves of different vertical blanking and power effect values are shown, wherein the horizontal axis is Vblanking and the vertical axis is the power effect value. Figure 4 It can be seen that as the vertical blanking time increases, the power effect value increases, that is, vertical blanking is positively correlated with the power effect value. Since vertical blanking is negatively correlated with the reading time, the reading time is negatively correlated with the power effect value.
[0066] It should be noted that Figure 4 This is merely an illustrative example. In actual applications, vertical blanking may be positively correlated with the power effect value, or may be in a curved relationship. This embodiment of the present application does not limit this.
[0067] In step 104 , the image processing chip is controlled to calculate the comprehensive effect value of the image sensor at each reading time according to the dark current effect value and the power effect value.
[0068] In the embodiment of the present application, a reading time corresponds to a comprehensive effect value. The larger the comprehensive effect value is, the higher the balance between the power consumption and image quality of the image sensor is, and the more it can take into account the power consumption and image quality of the image sensor.
[0069] In one example, Figure 5The relationship curves of different vertical blanking and comprehensive effect values are shown, wherein the horizontal axis is Vblanking and the vertical axis is the comprehensive effect value. Figure 5 It can be seen that as the vertical blanking time continues to increase, the comprehensive effect value continues to increase, that is, vertical blanking is positively correlated with the comprehensive effect value. Since vertical blanking is negatively correlated with reading time, the reading time is negatively correlated with the comprehensive effect value.
[0070] It should be noted that Figure 5 This is only an illustrative example. In actual applications, vertical blanking and the power effect value may be positively correlated or present a curve relationship, which is not limited in the embodiments of the present application.
[0071] In step 105, the target reading time is determined according to the comprehensive effect value.
[0072] In some embodiments, considering that the larger the comprehensive effect value is, the better the balance between the power consumption and image quality of the image sensor is, and the more the power consumption and image quality of the image sensor can be taken into account, the reading time corresponding to the largest comprehensive effect value among the N reading time periods can be determined as the target reading time to achieve the maximum balance between power consumption and image quality; wherein the comprehensive effect value is positively correlated with the balance between the power consumption and image quality of the image sensor.
[0073] In some embodiments, the user can select a target reading time for shooting in the current scene from N reading times based on actual needs and with reference to a relationship curve between the comprehensive effect value and the reading time.
[0074] In some embodiments, the user can set a range of comprehensive effect values, and the camera can first randomly select a target comprehensive effect value from the range, and then determine the reading time corresponding to the target comprehensive effect value among N reading times as the target reading time for shooting in the current scene.
[0075] In step 106 , the image sensor is controlled to read image data based on the target reading time to obtain second image data.
[0076] In one example, before the user actually takes the photo, he turns on the camera of the electronic device, and the system sends an instruction to operate the camera module to power on and start up. First, all the pixels in the image sensor are controlled to start working. After that, the camera collects a completely black RAW image and calculates the dark current effect value of the image sensor through the built-in algorithm. After that, the voltage and current of the image sensor are read according to the external device of the electronic device (for example, a miniature multimeter), and then the power consumption effect value of the image sensor is calculated. After that, the comprehensive effect value is calculated based on the dark current effect value and the power consumption effect value, and the optimal reading time of the image sensor is selected based on the comprehensive effect value. Finally, the image sensor is controlled to shoot images or videos based on the optimal reading time.
[0077] It can be seen from the above embodiment that in this embodiment, the image sensor is controlled to read image data at N different reading time lengths to obtain first image data, the reading time length is the time length corresponding to reading one frame of image data, N is an integer greater than 1, and the first image data includes black image data, current data and voltage data; the image processing chip is controlled to calculate the dark current effect value of the image sensor at each reading time length based on the black image data; the image processing chip is controlled to calculate the power effect value of the image sensor at each reading time length based on the current data and the voltage data; the image processing chip is controlled to calculate the comprehensive effect value of the image sensor at each reading time length based on the dark current effect value and the power effect value; the target reading time length is determined based on the comprehensive effect value; the image sensor is controlled to read image data based on the target reading time length to obtain second image data.
[0078] It can be seen that in the embodiments of the present application, for the shooting scene currently located by the electronic device, before the actual shooting is performed, the comprehensive effect value of the image sensor under different reading times can be calculated, and the reading time of the image sensor during the actual shooting can be adjusted according to the comprehensive effect value, and the actual shooting is performed based on the reading time. Since the comprehensive effect value is calculated based on the dark current effect value and the power effect value of the image sensor, and the dark current effect value can represent the dark current stability of the image sensor, and the power consumption effect value can represent the power consumption of the image sensor, it is possible to achieve a dynamic balance between the power consumption of the image sensor and the image quality, thereby achieving the purpose of taking into account the power consumption and image quality of the image sensor, and improving the overall performance of the camera.
[0079] In another embodiment provided in the present application, the number of access point groups between the column pixel circuit of the image sensor and the peripheral power supply circuit is greater than 1; or, the number of access point groups between the row pixel circuit of the image sensor and the peripheral power supply circuit is greater than 1.
[0080] Considering the stability and consistency of dark current, in addition to being related to process accuracy, it is also related to the power supply of the image sensor. The image sensor is mainly powered by an external power supply circuit, which outputs an AVDD to the internal part of the image sensor to support operations such as pixel reading and ADC conversion.
[0081] Figure 6 The figure shows the connection relationship between the peripheral power supply circuit and the column pixel circuit of the image sensor in the related art, wherein AVDD1 and AVDD2 are provided by the peripheral power supply circuit, and there is a set of connection points between the column pixel circuit of the image sensor and the peripheral power supply circuit, such as Figure 6The four rectangular connection points on the left and right sides of the image sensor. After the voltage enters the image sensor, it powers the column pixels and ADC so that each pixel can work properly. The power supply of the pixel determines the signal output capability of the pixel. Under normal circumstances, we hope that the operating voltage of each pixel is consistent, but often due to the existence of parasitic capacitance, there will be Figure 7 The problem shown is that the voltage difference of the column pixel circuit of the image sensor continues to decrease from left to right, resulting in poor dark current flatness of each column of pixels.
[0082] In order to solve the above problem, in the embodiment of the present application, several more access points are added in hardware to offset the voltage drop effect caused by parasitic capacitance and resistance, so that the AVDD voltage difference of each column of pixels is as consistent as possible.
[0083] In one example, an average method can be used. For example, an image sensor with 3000 columns needs to access 2 more groups of points. Figure 8 The figure shows the access at 1000 columns and 2000 columns respectively. Figure 6 The access method shown is Figure 8 There are 2 groups of access points in Zhongduo, of which 2 groups of new access points are Figure 8 The circle in the middle is marked. Figure 8 The access method shown can make the voltage difference from left to right of the column pixel circuit of the image sensor relatively stable, such as Figure 9 As shown, correspondingly, the dark current of each column of pixels is also relatively flat.
[0084] Similarly, for the row pixel circuit of the image sensor, the power supply capacity of each row will be different due to line impedance, parasitic capacitance and resistance, etc., and several more access points can also be used. I will not go into details here.
[0085] In another embodiment provided by the present application, in order to ensure the accuracy of the calculation result of the dark current effect value, the dark current effect value of the image sensor can be calculated from multiple dimensions. Accordingly, Figure 10 Said step 102 includes the following steps: step 1021, step 1022, step 1023 and step 1024;
[0086] In step 1021, the image processing chip is controlled to divide the image corresponding to the black image data under each reading time into M image areas, the mean of the pixel values of each image area is calculated, and the first difference between the maximum mean and the minimum mean among the means of the M image areas is calculated, where M is an integer greater than 1.
[0087] In some embodiments, in order to ensure the fairness of the calculation results, the image corresponding to the black image data at each reading time may be divided into M image areas of the same size, that is, the image may be equally divided into M image areas.
[0088] In an example, the image corresponding to the black image data can be divided into 16*12 areas, and the average of the pixel values in each area can be calculated to obtain ave1, ave2~ave192. Then, the first difference difference is calculated according to ave-Max and ave-Min to evaluate the quality of the dark current. The smaller the first difference, the better the dark current effect, and the larger the first difference, the worse the dark current effect.
[0089] In step 1022 , the mean of the pixel values of each row in the image corresponding to the black image data at each reading time length is calculated, and the second difference between the maximum mean and the minimum mean among the mean values of all rows is calculated.
[0090] In an example, the mean of the pixel values in each row of the image corresponding to the black image data is first calculated. For example, for an image with a size of 4000*3000, 3000 mean values ave1~ave3000 can be obtained. Since some entire rows and columns of the image sensor fail, such as DPline (dead pixel line), the pixel columns of ave1~ave3000 need to be filtered (such as median filtering, mean filtering, etc.), and then the second difference gap-H is calculated based on the filtered ave-Max and ave-Min to evaluate the quality of the dark current. The smaller the second difference, the better the dark current effect, and the larger the second difference, the worse the dark current effect.
[0091] In step 1023 , the mean of the pixel values of each column in the image corresponding to the black image data at each reading time length is calculated, and the third difference between the maximum mean and the minimum mean among the means of all columns is calculated.
[0092] In an example, the mean of the pixel values in each column of the image corresponding to the black image data is first calculated. For example, for an image with a size of 4000*3000, 4000 mean values ave1~ave4000 can be obtained. Since some entire rows and columns of the image sensor have failures, such as DPline, it is necessary to filter the pixel columns of ave1~ave4000 at this time, and then calculate the second difference gap-V based on the filtered ave-Max and ave-Min to evaluate the quality of the dark current. Among them, the smaller the third difference, the better the dark current effect, and the larger the third difference, the worse the dark current effect.
[0093] In step 1024 , the dark current effect value of the image sensor at each reading time is calculated based on the first difference, the second difference, and the third difference.
[0094] In some embodiments, the above three evaluation schemes may be weighted and weighted to obtain the dark current effect value. Accordingly, the above step 1024 includes the following steps:
[0095] According to the first weight value, the first difference, the second weight value, the second difference, the third weight value and the third difference, the dark current effect value of the image sensor under each reading time is calculated; wherein, the first weight value is the weight value corresponding to the first difference, the second weight value is the weight value corresponding to the second difference, the third weight value is the weight value corresponding to the third difference, and the sum of the first weight value, the second weight value and the third weight value is 1.
[0096] In the embodiment of the present application, different weights can be assigned to the above three evaluation schemes according to different scenarios.
[0097] In an example, the difference value ranges from 0 to 10 and corresponds to 0 to 100 points respectively, and the first weight is 0.4; the gap-H value ranges from 0 to 10 and corresponds to 0 to 100 points respectively, and the second weight is 0.3; the gap-V value ranges from 0 to 10 and corresponds to 0 to 100 points respectively, and the third weight is 0.3.
[0098] When the difference is 2, the gap-H is 3, and the gap-V is 4, the dark current effect value is (10-2) / 10*100*0.4+(10-3) / 10*100*0.3+(10-4) / 10*100*0.3=71.
[0099] It can be seen that in the embodiment of the present application, the dark current effect value of the image sensor can be calculated from multiple dimensions such as image area, image row and image column to ensure the accuracy of the dark current effect value calculation result.
[0100] In another embodiment provided by the present application, considering that there are three main power consumption circuits in the image sensor, AVDD, DVDD and DOVDD, where AVDD is the power supply circuit of the analog circuit, DVDD is the power supply circuit of the digital circuit, and DOVDD is the power supply circuit of the IO interface, since the voltages of these three circuits are known, it is only necessary to measure the currents of each circuit, multiply them respectively and then sum them to obtain the total power consumption of the image sensor. Accordingly, as Figure 11 As shown, the above step 103 includes the following steps: step 1031, step 1032, step 1033, step 1034 and step 1035;
[0101] In step 1031 , the image processing chip is controlled to calculate a first power value according to the current value of the analog circuit in the current data and the voltage value of the analog circuit in the voltage data at each reading time.
[0102] The first power value=the current value of the analog circuit*the voltage value of the analog circuit.
[0103] In step 1032 , a second power value is calculated based on the current value of the digital circuit in the current data and the voltage value of the digital circuit in the voltage data.
[0104] The second power value=the current value of the digital circuit*the voltage value of the digital circuit.
[0105] In step 1033, a third power value is calculated based on the current value of the IO interface in the current data and the voltage value of the IO interface in the voltage data.
[0106] The third power value=the current value of the IO interface*the voltage value of the IO interface.
[0107] In step 1034 , the total power consumption value of the image sensor is calculated based on the first power value, the second power value, and the third power value.
[0108] In some embodiments, the total power consumption value is the sum of the first power value, the second power value, and the third power value.
[0109] In step 1035 , a power effect value corresponding to the total power consumption value is determined according to the total power consumption value, wherein the power effect value is negatively correlated with the total power consumption value.
[0110] In the embodiment of the present application, the greater the total power consumption value of the image sensor, the smaller the power efficiency value; conversely, the smaller the total power consumption value of the image sensor, the greater the power efficiency value.
[0111] It can be seen that in the embodiment of the present application, the power effect value of the image sensor can be calculated by the power value of the main circuit in the image sensor, which can ensure that the calculated power effect value can accurately reflect the actual power consumption of the image sensor while minimizing the amount of calculation.
[0112] In another embodiment provided by the present application, considering that different reading times have different impacts on the power consumption of the image sensor and the image quality of the image sensor, in order to improve the accuracy of the calculation result of the comprehensive effect value, weights that vary with different reading times or different scenarios can be assigned to the power consumption and image quality of the image sensor. Accordingly, the above step 104 includes the following steps: step 1041;
[0113] In step 1041, the image processing chip is controlled to perform a weighted sum operation on the dark current effect value and the power effect value based on the fourth weight value and the fifth weight value to obtain a comprehensive effect value; wherein the fourth weight value is the weight corresponding to the dark current effect value, the fifth weight value is the weight corresponding to the power effect value, and the sum of the fourth weight value and the fifth weight value is 1.
[0114] The comprehensive effect value=dark current effect value*fourth weight value+power effect value*fifth weight value.
[0115] In one example, as shown in Table 1, the relationship between the fourth weight value, the fifth weight value, and the reading time is shown.
[0116]
[0117] Table 1
[0118] It can be seen that in the embodiment of the present application, weights that vary with different reading times or different scenarios can be assigned to the power consumption and image quality of the image sensor. Based on the assigned weight values, a weighted sum operation is performed on the dark current effect value and the power effect value to obtain a comprehensive effect value, so as to improve the accuracy of the calculation results of the comprehensive effect value and its adaptability to different scenarios.
[0119] The shooting method provided in the embodiment of the present application can be executed by a shooting device. In the embodiment of the present application, the shooting method is executed by a shooting device as an example to illustrate the shooting device provided in the embodiment of the present application.
[0120] Figure 12 This is a structural block diagram of a shooting device provided by an embodiment of the present application. Figure 12 As shown, the photographing device 1200 may include: a first control module 1201, a second control module 1202, a third control module 1203, a fourth control module 1204, a determination module 1205 and a fifth control module 1206;
[0121] A first control module 1201 is configured to control the image sensor to read image data at N different reading durations to obtain first image data, wherein the reading duration is a duration corresponding to reading one frame of image data, N is an integer greater than 1, and the first image data includes black image data, current data, and voltage data;
[0122] A second control module 1202 is configured to control the image processing chip to calculate the dark current effect value of the image sensor at each reading time according to the black image data;
[0123] A third control module 1203 is configured to control the image processing chip to calculate a power efficiency value of the image sensor at each reading time according to the current data and the voltage data;
[0124] A fourth control module 1204 is configured to control the image processing chip to calculate a comprehensive effect value of the image sensor at each reading time according to the dark current effect value and the power effect value;
[0125] A determination module 1205 is configured to determine a target reading time according to the comprehensive effect value;
[0126] The fifth control module 1206 is configured to control the image sensor to read image data based on the target reading time to obtain second image data.
[0127] It can be seen from the above embodiment that in this embodiment, the image sensor is controlled to read image data at N different reading time lengths to obtain first image data, the reading time length is the time length corresponding to reading one frame of image data, N is an integer greater than 1, and the first image data includes black image data, current data and voltage data; the image processing chip is controlled to calculate the dark current effect value of the image sensor at each reading time length based on the black image data; the image processing chip is controlled to calculate the power effect value of the image sensor at each reading time length based on the current data and the voltage data; the image processing chip is controlled to calculate the comprehensive effect value of the image sensor at each reading time length based on the dark current effect value and the power effect value; the target reading time length is determined based on the comprehensive effect value; the image sensor is controlled to read image data based on the target reading time length to obtain second image data.
[0128] It can be seen that in the embodiments of the present application, for the shooting scene currently located by the electronic device, before the actual shooting is performed, the comprehensive effect value of the image sensor under different reading times can be calculated, and the reading time of the image sensor during the actual shooting can be adjusted according to the comprehensive effect value, and the actual shooting is performed based on the reading time. Since the comprehensive effect value is calculated based on the dark current effect value and the power effect value of the image sensor, and the dark current effect value can represent the dark current stability of the image sensor, and the power consumption effect value can represent the power consumption of the image sensor, it is possible to achieve a dynamic balance between the power consumption of the image sensor and the image quality, thereby achieving the purpose of taking into account the power consumption and image quality of the image sensor, and improving the overall performance of the camera.
[0129] Optionally, the second control module 1202 may include:
[0130] a first control submodule, configured to control the image processing chip to divide the image corresponding to the black image data during each reading time into M image regions, calculate the mean of the pixel values of each image region, and calculate a first difference between a maximum mean and a minimum mean among the mean values of the M image regions, where M is an integer greater than 1;
[0131] Calculating the mean of the pixel values of each row in the image corresponding to the black image data at each reading time length, and calculating a second difference between the maximum mean and the minimum mean among the means of all rows;
[0132] Calculating the mean of the pixel values of each column in the image corresponding to the black image data at each reading time, and calculating the third difference between the maximum mean and the minimum mean among the means of all columns;
[0133] The dark current effect value of the image sensor under each of the reading time periods is calculated according to the first difference, the second difference, and the third difference.
[0134] Optionally, the first control submodule is specifically used to calculate the dark current effect value of the image sensor under each reading time according to the first weight value, the first difference, the second weight value, the second difference, the third weight value and the third difference; wherein, the first weight value is the weight value corresponding to the first difference, the second weight value is the weight value corresponding to the second difference, the third weight value is the weight value corresponding to the third difference, and the sum of the first weight value, the second weight value and the third weight value is 1.
[0135] Optionally, the third control module 1203 may include:
[0136] a second control submodule, configured to control the image processing chip to calculate a first power value according to the current value of the analog circuit in the current data and the voltage value of the analog circuit in the voltage data at each reading time;
[0137] Calculating a second power value according to the current value of the digital circuit in the current data and the voltage value of the digital circuit in the voltage data;
[0138] Calculate a third power value according to the current value of the IO interface in the current data and the voltage value of the IO interface in the voltage data;
[0139] Calculating a total power consumption value of the image sensor according to the first power value, the second power value, and the third power value;
[0140] A power effect value corresponding to the total power consumption value is determined according to the total power consumption value, wherein the power effect value is negatively correlated with the total power consumption value.
[0141] Optionally, the fourth control module 1204 may include:
[0142] a third control submodule, configured to control the image processing chip to perform a weighted sum operation on the dark current effect value and the power effect value based on a fourth weight value and a fifth weight value to obtain a comprehensive effect value;
[0143] The fourth weight value is the weight corresponding to the dark current effect value, the fifth weight value is the weight corresponding to the power effect value, and the sum of the fourth weight value and the fifth weight value is 1.
[0144] Optionally, the determining module 1205 may include:
[0145] The determination submodule is configured to determine the reading time corresponding to the largest comprehensive effect value among the N reading time periods as the target reading time period, wherein the comprehensive effect value is positively correlated with the balance between power consumption and image quality of the image sensor.
[0146] Optionally, the number of access point groups between the column pixel circuit of the image sensor and the peripheral power supply circuit is greater than 1;
[0147] Alternatively, the number of access point groups between the row pixel circuit of the image sensor and the peripheral power supply circuit is greater than one.
[0148] The shooting device in the embodiments of the present application can be an electronic device or a component in an electronic device, such as an integrated circuit or a chip. The electronic device can be a terminal or other device other than a terminal. For example, the electronic device can be a mobile phone, a tablet computer, a laptop computer, a PDA, an in-vehicle electronic device, a mobile Internet device (MID), an augmented reality (AR) / virtual reality (VR) device, a robot, a wearable device, an ultra-mobile personal computer (UMPC), a netbook or a personal digital assistant (PDA), etc. It can also be a server, a network attached storage (NAS), a personal computer (PC), a television (TV), a teller machine or a self-service machine, etc., and the embodiments of the present application are not specifically limited.
[0149] The shooting device in the embodiment of the present application may be a device having an operating system. The operating system may be an Android operating system, an iOS operating system, or other possible operating systems, which are not specifically limited in the embodiment of the present application.
[0150] The shooting device provided in the embodiment of the present application can achieve Figure 1 Each process implemented in the method embodiment achieves the same technical effect and will not be described again here to avoid repetition.
[0151] Alternatively, as Figure 13As shown, an embodiment of the present application further provides an electronic device 1300, including a processor 1301 and a memory 1302, wherein the memory 1302 stores a program or instruction that can be run on the processor 1301, and when the program or instruction is executed by the processor 1301, the various steps of the above-mentioned shooting method embodiment are implemented and the same technical effect can be achieved. To avoid repetition, they are not described here.
[0152] It should be noted that the electronic devices in the embodiments of the present application include the mobile electronic devices and non-mobile electronic devices mentioned above.
[0153] Figure 14 It is a schematic diagram of the hardware structure of an electronic device that implements various embodiments of the present application.
[0154] The electronic device 1400 includes but is not limited to components such as a radio frequency unit 1401 , a network module 1402 , an audio output unit 1403 , an input unit 1404 , a sensor 1405 , a display unit 1406 , a user input unit 1407 , an interface unit 1408 , a memory 1409 , and a processor 1410 .
[0155] Those skilled in the art will understand that the electronic device 1400 may also include a power source (such as a battery) to power each component, and the power source may be logically connected to the processor 1410 through a power management system, thereby implementing functions such as charging, discharging, and power consumption management through the power management system. Figure 14 The electronic device structure shown in the figure does not constitute a limitation on the electronic device. The electronic device may include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently, which will not be repeated here.
[0156] Processor 1410 is used to control the image sensor to read image data at N different reading time lengths to obtain first image data, wherein the reading time length is the time length corresponding to reading one frame of image data, N is an integer greater than 1, and the first image data includes black image data, current data and voltage data; control the image processing chip to calculate the dark current effect value of the image sensor at each reading time length according to the black image data; control the image processing chip to calculate the power effect value of the image sensor at each reading time length according to the current data and the voltage data; control the image processing chip to calculate the comprehensive effect value of the image sensor at each reading time length according to the dark current effect value and the power effect value; determine the target reading time length according to the comprehensive effect value; control the image sensor to read image data based on the target reading time length to obtain second image data.
[0157] It can be seen that in the embodiments of the present application, for the shooting scene currently located by the electronic device, before the actual shooting is performed, the comprehensive effect value of the image sensor under different reading times can be calculated, and the reading time of the image sensor during the actual shooting can be adjusted according to the comprehensive effect value, and the actual shooting is performed based on the reading time. Since the comprehensive effect value is calculated based on the dark current effect value and the power effect value of the image sensor, and the dark current effect value can represent the dark current stability of the image sensor, and the power consumption effect value can represent the power consumption of the image sensor, it is possible to achieve a dynamic balance between the power consumption of the image sensor and the image quality, thereby achieving the purpose of taking into account the power consumption and image quality of the image sensor, and improving the overall performance of the camera.
[0158] Optionally, the processor 1410 is further configured to control the image processing chip to divide the image corresponding to the black image data during each reading time into M image regions, calculate the mean of the pixel values of each image region, and calculate a first difference between a maximum mean and a minimum mean among the mean values of the M image regions, where M is an integer greater than 1.
[0159] Calculating the mean of the pixel values of each row in the image corresponding to the black image data at each reading time length, and calculating a second difference between the maximum mean and the minimum mean among the means of all rows;
[0160] Calculating the mean of the pixel values of each column in the image corresponding to the black image data at each reading time, and calculating the third difference between the maximum mean and the minimum mean among the means of all columns;
[0161] The dark current effect value of the image sensor under each of the reading time periods is calculated according to the first difference, the second difference, and the third difference.
[0162] Optionally, the processor 1410 is further used to calculate the dark current effect value of the image sensor at each reading time based on the first weight value, the first difference, the second weight value, the second difference, the third weight value and the third difference; wherein the first weight value is the weight value corresponding to the first difference, the second weight value is the weight value corresponding to the second difference, the third weight value is the weight value corresponding to the third difference, and the sum of the first weight value, the second weight value and the third weight value is 1.
[0163] Optionally, the processor 1410 is further configured to control the image processing chip to calculate a first power value according to a current value of the analog circuit in the current data and a voltage value of the analog circuit in the voltage data during each reading time period;
[0164] Calculating a second power value according to the current value of the digital circuit in the current data and the voltage value of the digital circuit in the voltage data;
[0165] Calculate a third power value according to the current value of the IO interface in the current data and the voltage value of the IO interface in the voltage data;
[0166] Calculating a total power consumption value of the image sensor according to the first power value, the second power value, and the third power value;
[0167] A power effect value corresponding to the total power consumption value is determined according to the total power consumption value, wherein the power effect value is negatively correlated with the total power consumption value.
[0168] Optionally, the processor 1410 is also used to control the image processing chip to perform a weighted sum operation on the dark current effect value and the power effect value based on a fourth weight value and a fifth weight value to obtain a comprehensive effect value; wherein the fourth weight value is the weight corresponding to the dark current effect value, the fifth weight value is the weight corresponding to the power effect value, and the sum of the fourth weight value and the fifth weight value is 1.
[0169] Optionally, the processor 1410 is further used to determine the reading time corresponding to the largest comprehensive effect value among the N reading time periods as the target reading time period, wherein the comprehensive effect value is positively correlated with the balance between power consumption and image quality of the image sensor.
[0170] Optionally, the number of access point groups between the column pixel circuit of the image sensor and the peripheral power supply circuit is greater than one; or the number of access point groups between the row pixel circuit of the image sensor and the peripheral power supply circuit is greater than one.
[0171] It should be understood that in an embodiment of the present application, the input unit 1404 may include a graphics processing unit (GPU) 14041 and a microphone 14042, and the graphics processor 14041 processes the image data of a static picture or video obtained by an image capture device (such as a camera) in a video capture mode or an image capture mode. The display unit 1406 may include a display panel 14061, and the display panel 14061 may be configured in the form of a liquid crystal display, an organic light emitting diode, etc. The user input unit 1407 includes a touch panel 14071 and at least one of other input devices 14072. The touch panel 14071 is also called a touch screen. The touch panel 14071 may include two parts: a touch detection device and a touch controller. Other input devices 14072 may include, but are not limited to, a physical keyboard, function keys (such as volume control keys, switch keys, etc.), a trackball, a mouse, and an operating stick, which will not be repeated here.
[0172] The memory 1409 can be used to store software programs and various data. The memory 1409 may mainly include a first storage area for storing programs or instructions and a second storage area for storing data, wherein the first storage area may store an operating system, applications or instructions required for at least one function (such as a sound playback function, an image playback function, etc.). In addition, the memory 1409 may include a volatile memory or a non-volatile memory, or the memory 1409 may include both volatile and non-volatile memories. Among them, the non-volatile memory may be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or a flash memory. The volatile memory may be random access memory (RAM), static random access memory (SRAM), dynamic random access memory (DRAM), synchronous dynamic random access memory (SDRAM), double data rate synchronous dynamic random access memory (DDRSDRAM), enhanced synchronous dynamic random access memory (ESDRAM), synchronous link dynamic random access memory (SLDRAM), and direct RAM bus random access memory (DRRAM). The memory 1409 in the embodiment of the present application includes but is not limited to these and any other suitable types of memory.
[0173] Processor 1410 may include one or more processing units. Optionally, processor 1410 integrates an application processor and a modem processor. The application processor primarily handles operations related to the operating system, user interface, and application programs, while the modem processor primarily processes wireless communication signals, such as a baseband processor. It is understood that the modem processor may not be integrated into processor 1410.
[0174] An embodiment of the present application also provides a readable storage medium, on which a program or instruction is stored. When the program or instruction is executed by a processor, the various processes of the above-mentioned shooting method embodiment are implemented and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.
[0175] The processor is the processor in the electronic device described in the above embodiment. The readable storage medium includes a computer readable storage medium, such as a computer read-only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disk.
[0176] An embodiment of the present application further provides a chip, which includes a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is used to run programs or instructions to implement the various processes of the above-mentioned shooting method embodiment and achieve the same technical effect. To avoid repetition, it will not be repeated here.
[0177] It should be understood that the chip mentioned in the embodiments of the present application can also be called a system-level chip, a system chip, a chip system or a system-on-chip chip, etc.
[0178] An embodiment of the present application provides a computer program product, which is stored in a storage medium. The program product is executed by at least one processor to implement the various processes of the above-mentioned shooting method embodiment and can achieve the same technical effect. To avoid repetition, it will not be repeated here.
[0179] It should be noted that, in this article, the terms "comprise", "include" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device comprising a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, an element defined by the statement "comprises a ..." does not exclude the presence of other identical elements in the process, method, article or device comprising the element. In addition, it should be noted that the scope of the methods and devices in the embodiments of the present application is not limited to performing functions in the order shown or discussed, and may also include performing functions in a substantially simultaneous manner or in the opposite order according to the functions involved. For example, the described method may be performed in an order different from that described, and various steps may also be added, omitted, or combined. In addition, the features described with reference to certain examples may be combined in other examples.
[0180] Through the description of the above embodiments, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus the necessary general hardware platform, and of course, by hardware, but in many cases the former is a better embodiment. Based on this understanding, the technical solution of the present application, or the part that contributes to the prior art, can be embodied in the form of a computer software product, which is stored in a storage medium such as ROM / RAM, a magnetic disk, or an optical disk, and includes a number of instructions for enabling a terminal such as a mobile phone, a computer, a server, or a network device to execute the methods described in each embodiment of the present application.
[0181] The embodiments of the present application are described above in conjunction with the accompanying drawings, but the present application is not limited to the above-mentioned specific implementation methods. The above-mentioned specific implementation methods are merely illustrative and not restrictive. Under the guidance of this application, ordinary technicians in this field can also make many forms without departing from the purpose of this application and the scope of protection of the claims, all of which are within the protection of this application.
Claims
1. A shooting method, characterized in that: The method comprises: Controlling the image sensor to read image data at N different reading time lengths to obtain first image data, wherein the reading time length is a time length corresponding to reading one frame of image data, N is an integer greater than 1, and the first image data includes black image data, current data, and voltage data; Controlling the image processing chip to calculate the dark current effect value of the image sensor at each reading time according to the black image data; controlling the image processing chip to calculate the power effect value of the image sensor at each reading time according to the current data and the voltage data; Controlling the image processing chip to calculate a comprehensive effect value of the image sensor at each reading time according to the dark current effect value and the power effect value; Determining a target reading time according to the comprehensive effect value; The image sensor is controlled to read image data based on the target reading time to obtain second image data.
2. The method according to claim 1, characterized in that The controlling image processing chip calculates the dark current effect value of the image sensor at each reading time according to the black image data, including: Controlling the image processing chip to divide the image corresponding to the black image data under each reading time length into M image areas, calculating the mean of the pixel values of each image area, and calculating a first difference between the maximum mean and the minimum mean among the mean values of the M image areas, where M is an integer greater than 1; Calculating the mean of the pixel values of each row in the image corresponding to the black image data at each reading time length, and calculating a second difference between the maximum mean and the minimum mean among the means of all rows; Calculating the mean of the pixel values of each column in the image corresponding to the black image data at each reading time, and calculating the third difference between the maximum mean and the minimum mean among the means of all columns; The dark current effect value of the image sensor under each of the reading time periods is calculated according to the first difference, the second difference, and the third difference.
3. The method according to claim 2, characterized in that The calculating, based on the first difference, the second difference, and the third difference, to obtain a dark current effect value of the image sensor at each reading time includes: The dark current effect value of the image sensor under each reading time is calculated according to the first weight value, the first difference, the second weight value, the second difference, the third weight value and the third difference; wherein the first weight value is the weight value corresponding to the first difference, the second weight value is the weight value corresponding to the second difference, the third weight value is the weight value corresponding to the third difference, and the sum of the first weight value, the second weight value and the third weight value is 1.
4. The method according to claim 1, wherein The controlling the image processing chip to calculate the power effect value of the image sensor at each reading time according to the current data and the voltage data includes: Controlling the image processing chip to calculate a first power value according to the current value of the analog circuit in the current data and the voltage value of the analog circuit in the voltage data at each reading time length; Calculating a second power value according to the current value of the digital circuit in the current data and the voltage value of the digital circuit in the voltage data; Calculate a third power value according to the current value of the IO interface in the current data and the voltage value of the IO interface in the voltage data; Calculating a total power consumption value of the image sensor according to the first power value, the second power value, and the third power value; A power effect value corresponding to the total power consumption value is determined according to the total power consumption value, wherein the power effect value is negatively correlated with the total power consumption value.
5. The method according to claim 1, wherein The controlling the image processing chip to calculate the comprehensive effect value of the image sensor at each reading time according to the dark current effect value and the power effect value includes: controlling the image processing chip to perform a weighted sum operation on the dark current effect value and the power effect value based on a fourth weight value and a fifth weight value to obtain a comprehensive effect value; The fourth weight value is the weight corresponding to the dark current effect value, the fifth weight value is the weight corresponding to the power effect value, and the sum of the fourth weight value and the fifth weight value is 1.
6. The method according to claim 1, characterized in that Determining a target reading time according to the comprehensive effect value includes: The reading time corresponding to the largest comprehensive effect value among the N reading time periods is determined as the target reading time period, wherein the comprehensive effect value is positively correlated with the balance between power consumption and image quality of the image sensor.
7. The method according to any one of claims 1 to 6, characterized in that The number of access points between the column pixel circuit of the image sensor and the peripheral power supply circuit is greater than one; Alternatively, the number of access point groups between the row pixel circuit of the image sensor and the peripheral power supply circuit is greater than one.
8. A photographing device, characterized in that: The device comprises: a first control module, configured to control the image sensor to read image data at N different reading time lengths to obtain first image data, wherein the reading time length is a time length corresponding to reading one frame of image data, N is an integer greater than 1, and the first image data includes black image data, current data, and voltage data; A second control module is used to control the image processing chip to calculate the dark current effect value of the image sensor at each reading time according to the black image data; a third control module, configured to control the image processing chip to calculate a power effect value of the image sensor at each reading time according to the current data and the voltage data; a fourth control module, configured to control the image processing chip to calculate a comprehensive effect value of the image sensor at each reading time according to the dark current effect value and the power effect value; A determination module, configured to determine a target reading time according to the comprehensive effect value; A fifth control module is configured to control the image sensor to read image data based on the target reading time to obtain second image data.
9. An electronic device, characterized in that: The method comprises a processor and a memory, wherein the memory stores a program or instruction that can be run on the processor, and when the program or instruction is executed by the processor, the steps of the shooting method according to any one of claims 1 to 7 are implemented.
10. A readable storage medium, characterized in that: The readable storage medium stores a program or instruction, and when the program or instruction is executed by the processor, the steps of the shooting method according to any one of claims 1 to 7 are implemented.
Citation Information
Patent Citations
Readout method for CMOS imager with reduced dark current
CN101513037A
Global reset release control method used for oversized-area-array CMOS (complementary metal-oxide-semiconductor transistor) image sensor
CN104796635A