Electronic device, frequency control method and terminal equipment

Abstract

The invention discloses an electronic device, a frequency control method and terminal equipment, and the electronic device comprises an image sensor, a processing unit, and a DC-DC converter. The processing unit is used for controlling the pulse width modulation frequency of the DC-DC converter to be switched from a third frequency to a fourth frequency under the condition that the sampling frequency of the correlated double sampling unit is switched from a first frequency to a second frequency; wherein the DC-DC converter is used for carrying out voltage conversion according to the pulse width modulation frequency, and outputting the converted voltage to the image sensor; the absolute value of the difference value between the third frequency and the first frequency is smaller than or equal to a first threshold value, and the absolute value of the difference value between the fourth frequency and the second frequency is smaller than or equal to a second threshold value.

Description

Technical Field

[0001] The embodiments of the present application relate to but are not limited to electronic technology, and in particular to an electronic device, a frequency control method and a terminal device. Background Art

[0002] Fixed Pattern Noise (FPN) is introduced by defects in the manufacturing process of image sensors, and changes with changes in the ambient temperature of the sensor and the analog gain of the sensor. Therefore, how to eliminate FPN has always been a concern in this field. Summary of the invention

[0003] Embodiments of the present application provide an electronic device, a frequency control method, and a terminal device.

[0004] In a first aspect, an embodiment of the present application provides an electronic device, the electronic device comprising: an image sensor, a processing unit, and a DC-DC converter;

[0005] The image sensor comprises a correlated double sampling unit, which is used to sample the output signal of the pixel unit in the image sensor twice within a sampling interval of each cycle corresponding to the sampling frequency, and to perform a difference between the two sampled output signals to obtain a differential signal, wherein the differential signal is used to determine the digital image signal;

[0006] The processing unit is used for controlling the pulse width modulation frequency of the DC-DC converter to switch from the third frequency to the fourth frequency when the sampling frequency of the correlated double sampling unit is switched from the first frequency to the second frequency;

[0007] The DC-DC converter is used to perform voltage conversion according to the pulse width modulation frequency and output the converted voltage to the image sensor; the absolute value of the difference between the third frequency and the first frequency is less than or equal to a first threshold, and the absolute value of the difference between the fourth frequency and the second frequency is less than or equal to a second threshold.

[0008] In a second aspect, an embodiment of the present application provides a frequency control method, the frequency control method comprising:

[0009] Determine that the sampling frequency of the correlated double sampling unit is switched from the first frequency to the second frequency; the correlated double sampling unit is used to sample the output signal of the pixel unit in the image sensor twice within the sampling interval of each cycle corresponding to the sampling frequency, and perform a difference between the two sampled output signals to obtain a differential signal, and the differential signal is used to determine the digital image signal;

[0010] Controlling the pulse width modulation frequency of the DC-DC converter to switch from the third frequency to the fourth frequency; the DC-DC converter is used to perform voltage conversion according to the pulse width modulation frequency and output the converted voltage to the image sensor; the absolute value of the difference between the third frequency and the first frequency is less than or equal to a first threshold, and the absolute value of the difference between the fourth frequency and the second frequency is less than or equal to a second threshold.

[0011] In a third aspect, an embodiment of the present application provides a terminal device, which includes the electronic device described in the first aspect, or the terminal device includes a memory and a processor, the memory is used to store a computer program, and the processor is used to call and run the computer program stored in the memory, so that the terminal device executes the method described in the second aspect.

[0012] In an embodiment of the present application, the processing unit is used to control the pulse width modulation frequency of the DC-DC converter to switch from the third frequency to the fourth frequency when the sampling frequency of the correlated double sampling unit is switched from the first frequency to the second frequency, so that when the sampling frequency of the correlated double sampling unit is switched, the pulse width modulation frequency of the DC-DC converter is also switched accordingly, so that the pulse width modulation frequency of the DC-DC converter is as consistent as possible with the sampling frequency of the correlated double sampling unit, and the converted voltage is output to the image sensor through the DC-DC converter, which will not introduce additional noise into the image sensor, and further will not affect the elimination of fixed pattern noise by sampling of the correlated double sampling unit. Therefore, the present application can effectively remove the fixed pattern noise in the image. BRIEF DESCRIPTION OF THE DRAWINGS

[0013] The drawings described herein are used to provide further understanding of the present application and constitute a part of the present application. The illustrative embodiments of the present application and their descriptions are used to explain the present application and do not constitute improper limitations on the present application.

[0014] Figure 1 A schematic diagram of the structure of an electronic device provided in an embodiment of the present application;

[0015] Figure 2 A schematic diagram of the structure of another electronic device provided in an embodiment of the present application;

[0016] Figure 3 A flow chart of a frequency control method provided in an embodiment of the present application;

[0017] Figure 4 A schematic diagram of a frequency regulation framework provided in an embodiment of the present application;

[0018] Figure 5A flowchart of a method for establishing a corresponding relationship provided in an embodiment of the present application;

[0019] Figure 6 A schematic diagram of the relationship between the high and low levels of an exposure signal and a sampling interval provided in an embodiment of the present application;

[0020] Figure 7 A schematic diagram of the relationship between a high-low level difference of an exposure signal and a sampling level of correlated double sampling provided in an embodiment of the present application;

[0021] Figure 8 A schematic diagram of a sampling frequency of correlated double sampling provided in an embodiment of the present application;

[0022] Fig. 9 A schematic diagram of the structure of a DC-DC converter provided in an embodiment of the present application;

[0023] Fig.10 A flow chart of a pulse width modulation frequency adjustment method provided in an embodiment of the present application;

[0024] Fig.11 A schematic diagram of a hardware entity of a terminal device provided in an embodiment of the present application;

[0025] Fig.12 A hardware entity diagram of another terminal device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0026] The technical solution of the present application will be described in detail below through embodiments and in conjunction with the accompanying drawings. The following specific embodiments can be combined with each other, and the same or similar concepts or processes may not be repeated in some embodiments.

[0027] It should be noted that in the examples of the present application, "first", "second", etc. are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence.

[0028] In addition, the technical solutions described in the embodiments of the present application can be combined arbitrarily without conflict. In the description of the present application, "multiple" means two or more, unless otherwise clearly and specifically defined.

[0029] Currently, many terminal devices have a digital overlap (DOL) function. Technicians have found that FPN will be generated during the DOL switching process, or when switching between different exposure levels in a DOL mode. FPN is a type of noise in digital images. FPN is caused by differences in pixel sensitivity on photosensitive elements (such as image sensors). FPN will produce a pattern of visible dark and bright pixels, which will remain consistent between images). In related technologies, the solution to FPN is achieved by adjusting the sampling frequency of Correlated Double Sampling (CDS). However, this method cannot effectively eliminate FPN in the image.

[0030] The terminal device in any embodiment of the present application may include one of the following or a combination of at least two of them: Internet of Things (IoT) devices, satellite terminals, Wireless Local Loop (WLL) stations, Personal Digital Assistants (PDA), handheld devices with wireless communication functions, computing devices or other processing devices connected to wireless modems, servers, mobile phones, tablet computers (Pad), computers with wireless transceiver functions, PDAs, desktop computers, personal digital assistants, portable media players, smart speakers, navigation devices, smart watches, smart glasses, smart necklaces and other wearable devices, learning machines, translation pens, translation machines, point reading machines, pedometers, digital TVs, virtual reality (VR) terminal devices, augmented reality (AR) terminal devices, wireless terminals in industrial control, wireless terminals in self driving, wireless terminals in remote medical surgery, wireless terminals in smart grids, wireless terminals in transportation safety, and wireless terminals in smart cities. The wireless terminals in the Internet of Vehicles (IoV) system include wireless terminals in smart cities, wireless terminals in smart homes, and vehicles, on-board equipment, on-board modules, wireless modems, handheld devices, customer premises equipment (CPE), smart home appliances, etc. in the IoV system.

[0031] Figure 1 A schematic diagram of the structure of an electronic device provided in an embodiment of the present application is shown in FIG. Figure 1 As shown, the electronic device 10 includes an image sensor 11 , a processing unit 12 and a DC-DC converter 13 .

[0032] The image sensor 11 includes a correlated double sampling unit 111, which is used to sample the output signal of a pixel unit (not shown in the figure) in the image sensor 11 twice within a sampling interval of each cycle corresponding to a sampling frequency, and to perform a difference between the output signals of the two samples to obtain a differential signal, and the differential signal is used to determine a digital image signal;

[0033] The processing unit 12 is used for controlling the pulse width modulation frequency of the DC-DC converter 13 to switch from the third frequency to the fourth frequency when the sampling frequency of the correlated double sampling unit 111 is switched from the first frequency to the second frequency;

[0034] Among them, the DC-DC converter 13 is used to perform voltage conversion according to the pulse width modulation frequency, and output the converted voltage to the image sensor 11; the absolute value of the difference between the third frequency and the first frequency is less than or equal to a first threshold, and the absolute value of the difference between the fourth frequency and the second frequency is less than or equal to a second threshold.

[0035] In some embodiments, the correlated double sampling unit 111 may be referred to as a correlated double sampling circuit. The correlated double sampling unit 111 is used to perform correlated double sampling.

[0036] In some embodiments, the image sensor 11 may be included in a camera unit (not shown). In some embodiments, the camera unit may include a lens, an image sensor 11, and a digital signal processor. The lens is used to receive a light signal, convert the light signal into a digital image signal through the image sensor 11, and output it to the digital signal processor for processing.

[0037] In some embodiments, the image sensor 11 may include a pixel unit and a correlated double sampling unit 111. In some embodiments, the correlated double sampling unit 111 samples the output signal of the pixel unit in the image sensor 11 twice within the sampling interval of each cycle. For example, the correlated double sampling unit 111 may sample the output signal of the pixel unit in the image sensor 11 at the starting point and the end point within the sampling interval of each cycle, respectively. In some embodiments, the starting point may be referred to as the integration start time of the photoelectric signal, and the end point may be referred to as the integration end time of the photoelectric signal. In some embodiments, the first sampled output signal of the two sampled output signals may be referred to as a reset level or a reset signal, and the second sampled output signal of the two sampled output signals may be referred to as a signal level or an image signal.

[0038] In some embodiments, the image sensor 11 may further include an analog-to-digital conversion circuit (not shown in the figure), and the correlated double sampling unit 111 may output the differential signal to the analog-to-digital conversion circuit, so that the analog-to-digital conversion circuit converts the differential signal into a digital image signal and then outputs it. In some embodiments, performing a differential operation on the output signals of the two samples may include performing a subtraction operation on the output signals of the two samples.

[0039] In some embodiments, by differentiating the output signals of the two samples, the deviation values ​​in the two sampled measurements of each pixel in the pixel unit will be offset, thereby correcting the fixed pattern noise error of the image signal.

[0040] In some embodiments, the sampling frequency of the correlated double sampling varies according to the change of the exposure duration. For example, the sampling frequency of the correlated double sampling is related to the data volume and the exposure duration. When the single-frame volume remains unchanged, the longer the exposure duration, the longer the data transmission duration will be, so that the sampling frequency of the correlated double sampling will decrease.

[0041] In some embodiments, different sampling frequencies correspond to different sampling intervals.

[0042] In some embodiments, the correlated double sampling unit 111 can control the sampling frequency of the correlated double sampling according to the exposure duration. In some embodiments, the correlated double sampling unit 111 can control the sampling frequency of the correlated double sampling according to the exposure duration and the sampling interval of each cycle corresponding to the sampling frequency.

[0043] In some embodiments, the correlated double sampling unit 111 may control the sampling frequency of the correlated double sampling unit 111 to switch from the first frequency to the second frequency according to the switching of the exposure duration.

[0044] In some embodiments, the first frequency may be the same as the third frequency. In some embodiments, the second frequency may be the same as the fourth frequency.

[0045] In other embodiments, since there is a limitation on the accuracy of the control of the sampling frequency of the correlated double sampling unit 111, and / or there is a limitation on the accuracy of the control of the pulse width modulation frequency, the first frequency may be different from the third frequency, and / or the second frequency may be different from the fourth frequency. For example, the third frequency may be determined according to the control accuracy of the first frequency and the pulse width modulation frequency, and / or the fourth frequency may be determined according to the control accuracy of the second frequency and the pulse width modulation frequency.

[0046] In an embodiment of the present application, the processing unit is used to control the pulse width modulation frequency of the DC-DC converter to switch from the third frequency to the fourth frequency when the sampling frequency of the correlated double sampling unit is switched from the first frequency to the second frequency, so that when the sampling frequency of the correlated double sampling unit is switched, the pulse width modulation frequency of the DC-DC converter is also switched accordingly, so that the pulse width modulation frequency of the DC-DC converter is as consistent as possible with the sampling frequency of the correlated double sampling unit, and the converted voltage is output to the image sensor through the DC-DC converter, which will not introduce additional noise into the image sensor, and further will not affect the elimination of fixed pattern noise by sampling of the correlated double sampling unit. Therefore, the present application can effectively remove the fixed pattern noise in the image.

[0047] In some embodiments, the correlated double sampling unit 111 is further configured to:

[0048] Acquire a first corresponding relationship between an exposure mode and / or an exposure duration and the sampling frequency;

[0049] When the exposure mode is switched from the first exposure mode to the second exposure mode, and / or the exposure duration is switched from the first exposure duration to the second exposure duration, the sampling frequency is controlled to switch from the first frequency to the second frequency according to the first corresponding relationship.

[0050] In some embodiments, different exposure modes correspond to different numbers of exposures and / or exposure durations. For example, among two different exposure modes, one exposure mode corresponds to three exposures, and the exposure durations corresponding to the three exposures are different, and the other exposure mode corresponds to two exposures, and the durations corresponding to the two exposures are different. For another example, among two different exposure modes, one exposure mode corresponds to three exposures, and the exposure durations corresponding to the three exposures are t1, t2, and t3, respectively, and the other exposure mode corresponds to three exposures, and the exposure durations corresponding to the three exposures are t4, t5, and t6, respectively, or the exposure durations corresponding to the three exposures are t3, t4, and t5, respectively. For another example, among two different exposure modes, at least one exposure corresponding to one exposure mode is all long exposure or all short exposure, and at least one exposure corresponding to the other exposure mode includes long exposure and short exposure. Among them, the exposure durations corresponding to the long exposure and the short exposure are different.

[0051] Exemplarily, the first exposure mode may be a 1DOL exposure mode, and the second exposure mode may be a 2DOL exposure mode, or the second exposure mode may be a 1DOL exposure mode, and the first exposure mode may be a 2DOL exposure mode. In the 1DOL exposure mode, multiple different exposures are simultaneously output in one frame output cycle, and the multiple different exposures are all long exposures or all short exposures. In the 2DOL exposure mode, one long exposure and one short exposure are simultaneously output in one frame output cycle.

[0052] In some embodiments, different exposure modes and the same exposure durations correspond to different sampling frequencies. In some embodiments, the same exposure modes and different exposure durations correspond to different sampling frequencies. In some embodiments, different exposure modes and different exposure durations correspond to different sampling frequencies.

[0053] In some embodiments, the processing unit 12 may determine that the exposure mode is switched from the first exposure mode to the second exposure mode according to the change in ambient light brightness and / or the change in the shooting scene, and send information that the exposure mode is switched from the first exposure mode to the second exposure mode to the correlated double sampling unit 111. In some embodiments, the processing unit 12 may obtain an exposure signal sent by the image sensor 11, determine the corresponding exposure duration according to the exposure signal, and send information that the exposure duration is switched from the first exposure duration to the second exposure duration to the correlated double sampling unit 111 when the exposure duration is switched from the first exposure duration to the second exposure duration. In other embodiments, the correlated double sampling unit 111 may obtain an exposure signal, and determine that the exposure duration is switched from the first exposure duration to the second exposure duration according to the exposure signal.

[0054] In some other embodiments of the present application, the exposure signal may be referred to as a synchronization signal or a vertical synchronization (Vertical Synchronization, VSys) signal.

[0055] In some embodiments, the first correspondence may include a correspondence between multiple exposure modes, multiple exposure durations, and multiple sampling frequencies, wherein the multiple exposure modes, multiple exposure durations, and multiple sampling frequencies may have a one-to-one correspondence. In some embodiments, the first correspondence may include multiple first relationship curves, the multiple first relationship curves respectively correspond to the multiple exposure modes, and each first relationship curve is a relationship curve between the exposure duration and the sampling frequency.

[0056] In some embodiments, the first corresponding relationship may be pre-stored in the correlated double sampling unit 111 .

[0057] In some embodiments, the sampling frequency of the correlated double sampling unit 111 is a first frequency. When the exposure mode is switched from the first exposure mode to the second exposure mode, and / or the exposure duration is switched from the first exposure duration to the second exposure duration, the correlated double sampling unit 111 determines the second frequency according to the first corresponding relationship and controls the sampling frequency to switch from the first frequency to the second frequency.

[0058] In some embodiments, the correlated double sampling unit 111 is further configured to:

[0059] Acquire a second corresponding relationship between the sampling frequency and the sampling interval;

[0060] When the exposure mode is switched from the first exposure mode to the second exposure mode, and / or the exposure duration is switched from the first exposure duration to the second exposure duration, the sampling interval of each cycle corresponding to the sampling frequency is controlled according to the first corresponding relationship and the second corresponding relationship, and switched from the first sampling interval of each cycle corresponding to the first frequency to the second sampling interval of each cycle corresponding to the second frequency.

[0061] In some embodiments, the second corresponding relationship may include a corresponding relationship between multiple sampling frequencies and multiple sampling intervals. Wherein, the multiple sampling frequencies and the multiple sampling intervals may correspond one to one. In some embodiments, the second corresponding relationship may include a second relationship curve, and the second relationship curve represents a relationship curve between the sampling frequencies and the sampling intervals.

[0062] In some embodiments, the second corresponding relationship may be pre-stored in the correlated double sampling unit 111 .

[0063] In some embodiments, different sampling frequencies correspond to different sampling intervals.

[0064] In some embodiments, the sampling frequency of the correlated double sampling unit 111 is a first frequency, and the corresponding sampling interval is a first sampling interval. When the exposure mode is switched from the first exposure mode to the second exposure mode, and / or the exposure duration is switched from the first exposure duration to the second exposure duration, the correlated double sampling unit 111 determines the second frequency and the second sampling interval according to the first corresponding relationship and the second corresponding relationship, and controls the sampling interval of each period corresponding to the sampling frequency, switching from the first sampling interval of each period corresponding to the first frequency to the second sampling interval of each period corresponding to the second frequency.

[0065] In some embodiments, the correlated double sampling unit 111 is further configured to:

[0066] According to at least one spectrum data corresponding to at least one exposure duration in each of the multiple exposure modes collected by the spectrum analyzer, at least one sampling frequency corresponding to the at least one exposure duration is determined, and according to the at least one sampling frequency corresponding to the at least one exposure duration, the first corresponding relationship is determined.

[0067] In some embodiments, the correlated double sampling unit 111 is further configured to:

[0068] The second corresponding relationship is determined according to the current value input to the image sensor 11 during the at least one exposure time period obtained.

[0069] In some embodiments, at each exposure time in each exposure mode, the current value input to the image sensor 11 or the correlated double sampling unit 111 of the image sensor 11 can be obtained by collecting the current input to the image sensor 11 or the correlated double sampling unit 111 of the image sensor 11 through a current collection device. In some embodiments, the current value input to the image sensor 11 or the correlated double sampling unit 111 of the image sensor 11 can be the current value input to the image sensor 11 or the correlated double sampling unit 111 of the image sensor 11 by the DC-DC converter 13.

[0070] In some embodiments, in an exposure time under an exposure mode, the exposure time under the exposure mode corresponds to a sampling frequency, and the current value input to the image sensor 11 or the correlated double sampling unit 111 of the image sensor 11 can change periodically, for example, in each first time period, there is a current value of the second time period that is the target current value, the target current value is not 0, and the current value at other moments is 0, wherein each second time period has the same position in each first time period. In some embodiments, the interval in which the current value is the target current value is determined as the sampling interval.

[0071] In some embodiments, the DC-DC converter 13 includes a serial data link (Serial Data Link, SDL) port and a serial clock link (Serial Clock Link, SCL) port, and the processing unit 12 controls the pulse width modulation frequency of the DC-DC converter 13 through the serial data link port and the serial clock link port, switching from the third frequency to the fourth frequency.

[0072] In some embodiments, the DC-DC converter 13 further includes: a general purpose input / output (GPIO) port, a voltage input port, a voltage output port, a feedback (FB) port, and a ground port.

[0073] In some embodiments, the voltage input port can be grounded via a capacitor C.

[0074] In some embodiments, the voltage output port may be connected to a first end of the inductor L, and a second end of the inductor L may be connected to the image sensor 11. In some embodiments, the feedback port may be connected to a first end of the first resistor R1, a second end of the first resistor R1 may be connected to a first end of the second resistor R2, and a second end of the second resistor R2 may be connected to a second end of the inductor L. In some embodiments, the ground port may be connected to a second end of the first resistor R1, and the ground port may also be connected to ground.

[0075] In some embodiments, the processing unit 12 is further used to determine the second input voltage of the DC-DC converter 13 corresponding to the fourth frequency according to the third frequency, the fourth frequency and the first input voltage of the DC-DC converter 13 corresponding to the third frequency, and control the voltage input to the DC-DC converter 13 to be the second input voltage;

[0076] The output voltage of the DC-DC converter 13 corresponding to the first input voltage is the same as the output voltage of the DC-DC converter 13 corresponding to the second input voltage.

[0077] In some embodiments, the processing unit 12 may switch from the first input voltage to the second input voltage by controlling the voltage outputted by the power supply device to the DC-DC converter 13. In some embodiments, the power supply device may be included in the electronic device 10.

[0078] Figure 2 A schematic diagram of the structure of another electronic device provided in an embodiment of the present application is shown in FIG. Figure 2 As shown, the electronic device 10 includes: an image sensor 11, a processing unit 12, a DC-DC converter 13 and a feedback unit 14. For the description of the image sensor 11, the processing unit 12 and the DC-DC converter 13, please refer to the description of the above embodiment, which will not be repeated here.

[0079] The feedback unit 14 is used to: acquire at least one first image captured when the pulse width modulation frequency of the DC-DC converter 13 is switched from the third frequency to the fourth frequency; and determine whether the fourth frequency meets the frequency requirement based on the fixed pattern noise value of the at least one first image.

[0080] In some embodiments, when the pulse width modulation frequency of the DC-DC converter 13 is switched from the third frequency to the fourth frequency, the DC-DC converter 13 may send the fourth frequency or send information of switching from the third frequency to the fourth frequency to the feedback unit 14. When receiving the information, the feedback unit 14 sends request information for capturing at least one first image to the camera unit. The camera unit captures at least one first image according to the request information and sends the at least one first image to the feedback unit 14. The feedback unit 14 may determine the fixed pattern noise value of each first image in the at least one first image, thereby determining whether the fourth frequency meets the frequency requirement according to the fixed pattern noise value of the at least one first image.

[0081] In some embodiments, the DC-DC converter 13 can send the fourth frequency or send information switching from the third frequency to the fourth frequency to the feedback unit 14 through the GPIO, or the DC-DC converter 13 can send the fourth frequency or send information switching from the third frequency to the fourth frequency to the feedback unit 14 through the SDL port and the SCL port.

[0082] In some embodiments, the number of first images in the at least one first image may be one image or may be a plurality of images. For example, the at least one first image may include one first image, two first images, five first images, or ten first images, etc. Exemplarily, the at least one first image may be five first images.

[0083] In some embodiments, the exposure mode used by at least one first image is the second exposure mode, and / or the exposure duration used by at least one first image is the second exposure duration. In some embodiments, the sampling frequency used by at least one first image is the second frequency, and the pulse width modulation frequency used by at least one first image is the fourth frequency.

[0084] In some embodiments, the feedback unit 14 is further configured to: determine that the fourth frequency meets the frequency requirement when the fixed pattern noise values ​​of the at least one first image are all less than or equal to a third threshold.

[0085] In some embodiments, the third threshold may be greater than or equal to 5 dB. For example, the third threshold may be 5 dB, 10 dB, 20 dB, 30 dB, or 50 dB, etc. Exemplarily, the third threshold may be 20 dB.

[0086] In some embodiments, when the feedback unit 14 determines that the fourth frequency meets the frequency requirement, it may send indication information that the fourth frequency meets the frequency requirement to the processing unit 12, so that the processing unit 12 no longer adjusts the pulse width modulation frequency of the DC-DC converter 13. In other embodiments, when the feedback unit 14 determines that the fourth frequency meets the frequency requirement, it may not send any information to the processing unit 12.

[0087] In some embodiments, the feedback unit 14 is also used to send an indication information to the processing unit 12 that the fourth frequency does not meet the frequency requirement when the fixed pattern noise value of some or all of the fixed pattern noise values ​​of the at least one first image is greater than the third threshold; the processing unit 12 is also used to adjust the pulse width modulation frequency of the DC-DC converter 13 from the fourth frequency to the fifth frequency; the feedback unit 14 is also used to: when the pulse width modulation frequency of the DC-DC converter 13 is switched from the fourth frequency to the fifth frequency, acquire at least one captured second image; and determine, based on the fixed pattern noise value of the at least one second image, that the fifth frequency meets the frequency requirement.

[0088] In some embodiments, an absolute value of a difference between the fifth frequency and the second frequency is less than or equal to a second threshold.

[0089] In some embodiments, when the pulse width modulation frequency of the DC-DC converter 13 is switched from the fourth frequency to the fifth frequency, the DC-DC converter 13 may send the fifth frequency or send information of switching from the fourth frequency to the fifth frequency to the feedback unit 14. When receiving the information, the feedback unit 14 sends request information for capturing at least one second image to the camera unit. The camera unit captures at least one second image according to the request information and sends the at least one second image to the feedback unit 14. The feedback unit 14 may determine the fixed pattern noise value of each second image in the at least one second image, thereby determining whether the fifth frequency meets the frequency requirement according to the fixed pattern noise value of the at least one second image.

[0090] In some embodiments, the DC-DC converter 13 can send the fifth frequency or send information switching from the fourth frequency to the fifth frequency to the feedback unit 14 through the GPIO, or the DC-DC converter 13 can send the fifth frequency or send information switching from the fourth frequency to the fifth frequency to the feedback unit 14 through the SDL port and the SCL port.

[0091] In some embodiments, the number of second images in the at least one second image may be one image or may be a plurality of images. For example, the at least one second image may include one second image, two second images, five second images, or ten second images, etc. Exemplarily, the at least one second image may be five second images. In some embodiments, the number of second images in the at least one second image may be the same as the number of first images in the at least one first image. In other embodiments, in order to save resources, the number of second images in the at least one second image may be less than the number of first images in the at least one first image.

[0092] In some embodiments, the exposure mode used by the at least one second image is the second exposure mode, and / or the exposure duration used by the at least one second image is the second exposure duration. In some embodiments, the sampling frequency used by the at least one second image is the second frequency, and the pulse width modulation frequency used by the at least one first image is the fifth frequency.

[0093] In the embodiment of the present application, when the pulse width modulation frequency of the DC-DC converter 13 changes, the feedback unit 14 will determine whether the changed pulse width modulation frequency meets the frequency requirement. If it does not meet the frequency requirement, it will send an indication message to the processing unit 12 so that the processing unit 12 adjusts the pulse width modulation frequency until the changed pulse width modulation frequency meets the frequency requirement.

[0094] Figure 3 A flow chart of a frequency control method provided in an embodiment of the present application, the method is applied to a processing unit or a terminal device, and the method includes:

[0095] S301, determine that the sampling frequency of the correlated double sampling unit is switched from a first frequency to a second frequency; the correlated double sampling unit is used to sample the output signal of the pixel unit in the image sensor twice within a sampling interval of each cycle corresponding to the sampling frequency, and differentiate the output signals of the two samples to obtain a differential signal, and the differential signal is used to determine the digital image signal.

[0096] S302, controlling the pulse width modulation frequency of the DC-DC converter to switch from the third frequency to the fourth frequency; the DC-DC converter is used to perform voltage conversion according to the pulse width modulation frequency, and output the converted voltage to the image sensor; the absolute value of the difference between the third frequency and the first frequency is less than or equal to a first threshold, and the absolute value of the difference between the fourth frequency and the second frequency is less than or equal to a second threshold rate.

[0097] In some embodiments, the DC-DC converter includes a serial data link port and a serial clock link port, and the method further includes: controlling the pulse width modulation frequency of the DC-DC converter from a third frequency to a fourth frequency through the serial data link port and the serial clock link port.

[0098] In some embodiments, the method further includes: determining the second input voltage of the DC-DC converter corresponding to the fourth frequency based on the third frequency, the fourth frequency and the first input voltage of the DC-DC converter corresponding to the third frequency, and controlling the voltage input to the DC-DC converter to be the second input voltage.

[0099] The output voltage of the DC-DC converter corresponding to the first input voltage is the same as the output voltage of the DC-DC converter corresponding to the second input voltage.

[0100] The description of the above method embodiment is similar to the description of the above electronic device embodiment, and has similar beneficial effects as the method embodiment. For technical details not disclosed in the method embodiment of the present application, please refer to the description of the electronic device embodiment of the present application for understanding.

[0101] Fixed pattern noise (FPN) optimization is to reduce FPN noise through correlated double sampling (CDS). During the exposure switching process, the sampling frequency of CDS will change. In the present application, when the sampling frequency of CDS changes, the PWM frequency of the DC-DC converter that inputs voltage to the image sensor also changes accordingly, so that the PWM frequency of the DC-DC converter is as consistent as possible with the sampling frequency of CDS, so that the voltage input to the image sensor by the DC-DC converter will not cause additional noise to the image sensor, and thus has no effect on the sampling of CDS to reduce FPN. In this way, since CDS uses two samples to make a difference to reduce noise, when the PWM frequency of the DC-DC converter is consistent with the sampling frequency of the CDS unit, it has no effect on the difference determined by the CDS unit, thereby not affecting the signal quality output by the CDS unit.

[0102] Figure 4 A schematic diagram of a frequency regulation framework provided in an embodiment of the present application, such as Figure 4 As shown, the implementation of the framework includes two parts, one is the establishment of the corresponding relationship, and the other is the performance optimization.

[0103] In the part of establishing the corresponding relationship, it is necessary to prepare in advance the sampling frequency of the related double sampling unit corresponding to the different exposure durations in each exposure mode under different exposure modes (also called different DOL modes) of the mobile phone. Among them, the exposure signals corresponding to different exposure durations are different. For example, the image sensor can output an exposure signal, and the exposure duration corresponding to the exposure signal can be obtained by analyzing the exposure signal. In some embodiments, the image sensor can output the exposure signal to the processing unit so that the processing unit analyzes the exposure signal and obtains the exposure duration corresponding to the exposure signal. In other embodiments, the image sensor can send the exposure signal to other devices other than the terminal device through the processing unit, or the image sensor can send the exposure signal to other devices other than the terminal device so that other devices analyze the exposure signal and obtain the exposure duration corresponding to the exposure signal. By obtaining the sampling frequency of the related double sampling unit corresponding to the different exposure durations in each exposure mode, a corresponding relationship can be established. Among them, the corresponding relationship includes a first corresponding relationship between the exposure mode and / or exposure duration and the sampling frequency, and a second corresponding relationship between the sampling frequency and the sampling interval. In other embodiments, a first corresponding relationship between the exposure mode, the exposure signal and the sampling frequency is established.

[0104] In the performance optimization part, the processing unit obtains the data of the sampling frequency switching of the correlated double sampling unit. Wherein, the sampling frequency switching of the correlated double sampling unit is performed when the exposure mode is switched from the first exposure mode to the second exposure mode, and / or the exposure duration is switched from the first exposure duration to the second exposure duration. The processing unit adjusts the DC-DC converter according to the data of the sampling frequency switching for the pulse width modulation frequency. The feedback unit can obtain a simulation effect diagram (i.e., at least one first image or at least one second image mentioned above), and when it is determined according to the simulation effect diagram that the adjusted pulse width modulation frequency does not meet the frequency requirement, feedback is performed so that the processing unit readjusts the pulse width modulation frequency according to the feedback, until the feedback unit determines that the adjusted pulse width modulation frequency meets the frequency requirement according to the obtained simulation effect diagram, and no feedback is given, and the simulation effect diagram is the output effect diagram. In this way, first, after the sampling frequency of the correlated double sampling unit before and after the switching is acquired by the processing unit, the pulse width modulation frequency of the DC-DC converter is controlled according to the sampling frequency before and after the switching, so that the pulse width modulation frequency of the DC-DC converter is consistent with the sampling frequency of the correlated double sampling unit, and then the simulation effect diagram is determined, and then the response speed and matching accuracy are optimized through the feedback loop, so as to achieve high-quality output effect diagram. For example, the effect diagram is used to calculate noise (for example, fixed pattern noise), that is, 5 pictures are taken continuously to confirm whether the noise meets the standard. In the embodiment of the present application, since the test acquisition of the correlated double sampling is also accurate, the pulse width modulation frequency control of the DC-DC converter is also accurate. The frequency error of the two is small, that is, whether the objective value of the noise objective self-test is greater than 20 to determine whether the frequency error requirement is met, if it is, it is satisfied, if not, it is not satisfied, so as to obtain a high-quality output effect diagram.

[0105] Figure 5 A flowchart of a method for establishing a corresponding relationship provided in an embodiment of the present application is shown in FIG. Figure 5 As shown, the method includes:

[0106] S501, scanning frequency.

[0107] S502: Determine the sampling frequency of the correlated double sampling unit.

[0108] In some embodiments, the sampling frequency of the correlated double sampling may correspond to the exposure time. In order to obtain the sampling frequency of the correlated double sampling, a spectrum analyzer may be used to scan the closest position of the camera unit to the image sensor (also referred to as sensor) to obtain spectrum data, and the sampling frequency of the correlated double sampling may be obtained by analyzing the spectrum data.

[0109] S503: Collect current.

[0110] S504: Determine a sampling interval of a correlated double sampling unit.

[0111] In some embodiments, a current acquisition device (e.g., a current collector) may be used to acquire the current input to the image sensor, or to acquire the current input to the correlated double sampling unit in the image sensor, and a sampling interval of the correlated double sampling, i.e., a time period corresponding to the start time and the end time, may be determined according to the magnitude of the acquired current value. In some embodiments, the sampling interval of the correlated double sampling may also be referred to as a sampling period.

[0112] S505: Determine an exposure signal.

[0113] In some embodiments, the exposure signal may be output by an image sensor, and the exposure signal corresponds to the exposure duration. In some embodiments, a processing unit or other device may acquire the exposure signal output by the image sensor.

[0114] S506: Establish a corresponding relationship.

[0115] In some embodiments, the corresponding relationship may include the corresponding relationship between the exposure signal, the sampling frequency, and the sampling interval. In other embodiments, the corresponding relationship may include the corresponding relationship between the exposure duration, the sampling frequency, and the sampling interval. For example, the corresponding relationship includes the first corresponding relationship and the second corresponding relationship described above.

[0116] Figure 6 A schematic diagram of the relationship between the high and low levels of an exposure signal and a sampling interval provided in an embodiment of the present application, such as Figure 6 As shown, the horizontal axis represents time T, and the vertical axis represents level V. The high and low levels of an exposure signal correspond to a sampling interval one by one. There is a high level value of the exposure signal and a low level value of the exposure signal at a time. In some embodiments, the sampling interval belongs to the time interval corresponding to the difference between the high level value of the exposure signal and the low level value of the exposure signal is not zero.

[0117] Figure 7 A schematic diagram of the relationship between the high and low level difference of an exposure signal and the sampling level of correlated double sampling provided in an embodiment of the present application, such as Figure 7 As shown, the horizontal axis represents time T, and the vertical axis represents level V. Before moment A, the time when the difference between the high and low levels of the exposure signal is 1 in one cycle is less than the time when the difference between the high and low levels of the exposure signal is 1 in one cycle after moment A. In this way, the exposure duration before moment A is less than the exposure duration after moment A. The sampling level of the correlated double sampling corresponding to the current input to the correlated double sampling, before moment A, the time when the level is 0.6 in one cycle is less than the time when the level is 0.6 in one cycle after moment A. In addition, through Figure 7It can be seen that the difference between the high and low levels of the exposure signal and the sampling level of the correlated double sampling change synchronously. In addition, the time interval corresponding to the maximum value of the difference between the high and low levels of the exposure signal is the same as the time interval corresponding to the maximum value of the sampling level of the correlated double sampling. In some embodiments, the time interval corresponding to the maximum value of the sampling level of the correlated double sampling can be the sampling interval of the correlated double sampling mentioned above, or the sampling interval of the correlated double sampling, which belongs to the time interval corresponding to the sampling level of the correlated double sampling being greater than the target value. In this way, the sampling interval of the correlated double sampling can be changed immediately according to the change of the exposure duration, avoiding the situation where the sampling interval of the correlated double sampling is not changed in time and the fixed pattern noise cannot be effectively eliminated.

[0118] In the embodiment of the present application, the sampling frequency of the correlated double sampling is different for different exposure durations; and the interval width of the sampling interval is different for different exposure durations.

[0119] Figure 8 A schematic diagram of a sampling frequency of a correlated double sampling provided in an embodiment of the present application, such as Figure 8 As shown, the horizontal axis represents time T, and the vertical axis represents frequency Hz. The sampling frequency of the correlated double sampling between time B and time C is 600 Hz. In some embodiments, the sampling frequency of the correlated double sampling of 600 Hz may correspond to a specific exposure duration, or may correspond to a specific exposure mode and a specific exposure duration. The correlated double sampling is performed between time B and time C.

[0120] Fig. 9 A schematic diagram of the structure of a DC-DC converter provided in an embodiment of the present application is shown in FIG. Fig. 9 As shown, the DC-DC converter 13 includes an SDL port (corresponding to the SDL pin), an SCL port (corresponding to the SCL pin), a GPIO (corresponding to an enable (ENable, EN) pin), a voltage input port (corresponding to the VIN pin), a voltage output port (corresponding to the VOUT pin), an FB port (corresponding to the FB pin) and a ground port (corresponding to the GND pin).

[0121] The voltage input port is used to receive a voltage VPH inputted from a power supply device.

[0122] The processing unit controls the pulse width modulation frequency of the DC-DC converter 13 to switch from the third frequency to the fourth frequency through the serial data link port and the serial clock link port.

[0123] In some embodiments, the voltage input port can be grounded (GND) via a capacitor C.

[0124] In some embodiments, the voltage output port may be connected to a first end of the inductor L, and a second end of the inductor L may be connected to an image sensor. In some embodiments, the feedback port may be connected to a first end of a first resistor R1, a second end of the first resistor R1 may be connected to a first end of a second resistor R2, and a second end of the second resistor R2 may be connected to a second end of the inductor L. In some embodiments, the ground port may be connected to a second end of the first resistor R1, and the ground port may also be connected to ground (GND).

[0125] During the implementation process, the DC-DC converter 13 is controlled by an integrated circuit bus (Inter-Integrated Circuit, I2C) (i.e., the above-mentioned SDL port and SCL port), and real-time frequency adjustment can be achieved. Among them, the capacitor C can be a filter capacitor, the inductor L can be an output inductor, and the first resistor R1 and the second resistor R2 can be voltage-dividing resistors to control the voltage Vout output to the image sensor. In the embodiment of the present application, by adding I2C to the DC-DC converter 13, the pulse width modulation frequency of the DC-DC converter 13 can be controlled by I2C. In this way, the sampling frequency of the correlated double sampling unit collected in real time by the processing unit is used to control the pulse width modulation frequency of the DC-DC converter 13 in real time, thereby solving the problem of additional noise generated by exposure mode switching (such as DOL switching) and / or exposure duration switching.

[0126] Fig.10 A flow chart of a pulse width modulation frequency adjustment method provided in an embodiment of the present application is shown as follows: Fig.10 As shown, the method includes:

[0127] S1001. Obtain a corresponding relationship.

[0128] The corresponding relationship may be the corresponding relationship established in the above S506.

[0129] S1002: The processing unit controls the pulse width modulation (PWM) frequency of the DC-DC converter through I2C.

[0130] S1003: The processing unit synchronously adjusts the input voltage.

[0131] For example, when the PWM frequency switches from a third frequency to a fourth frequency, the processing unit is also used to determine the second input voltage of the DC-DC converter corresponding to the fourth frequency based on the third frequency, the fourth frequency and the first input voltage of the DC-DC converter corresponding to the third frequency, and control the voltage input to the DC-DC converter to be the second input voltage; wherein the output voltage of the DC-DC converter corresponding to the first input voltage is the same as the output voltage of the DC-DC converter corresponding to the second input voltage.

[0132] In the implementation process, since the input voltage is equal to the output voltage multiplied by the PWM duty cycle, when the PWM frequency changes, the corresponding PWM duty cycle will also change, so the input voltage must also be adjusted synchronously to ensure that the output voltage remains unchanged, thereby ensuring the stability of the output voltage.

[0133] S1004: The feedback unit determines whether the objective value of at least one image is less than or equal to 20.

[0134] If the answer of S1004 is No, the process returns to S1002; if the answer of S1004 is Yes, the process executes S1005.

[0135] S1005 . The feedback unit determines whether the sampling frequency of the correlated double sampling is synchronized with the pulse width modulation frequency.

[0136] In an embodiment of the present application, the PWM frequency of the DC-DC converter is adjusted through I2C through the collected correspondence, and the input voltage is adjusted synchronously to ensure the output voltage and PWM frequency. Then the power noise feedback is added (by taking 5 original pictures in succession, it can be analyzed with a dedicated software tool. The objective value is the result calculated by the software, 20 units of DB, which is a minimum standard summarized from the test.) If the objective value is less than or equal to 20, the synchronization logic is recorded to confirm that the frequency is synchronized. If it is greater than 20, it is necessary to continue to optimize the synchronization logic. Among them, the error between the PWM frequency and the CDS frequency is optimized. The smaller the error, the better the performance.

[0137] In the embodiment of the present application, noise frequency is optimized according to the DOL working principle to improve the performance of the system. In the embodiment of the present application, a noise optimization scheme for hardware and software synchronization is proposed, and a related circuit design is proposed to solve the noise problem from the root.

[0138] Fig.11 A hardware entity diagram of a terminal device provided in an embodiment of the present application, such as Fig.11 As shown, the hardware entity of the terminal equipment 110 includes: any electronic device 10 described above.

[0139] Fig.12 A schematic diagram of another hardware entity of a terminal device provided in an embodiment of the present application is shown in FIG. Fig.12 As shown, the hardware entity of the terminal device 110 includes: a processor 1101 and a memory 1102, wherein the memory 1102 is used to store computer programs, and the processor 1101 is used to call and run the computer program stored in the memory 1102, so that the terminal device executes a method for implementing any of the above embodiments.

[0140] The memory 1102 stores computer programs that can be run on the processor. The memory 1102 is configured to store instructions and applications executable by the processor 1101. It can also cache data to be processed or processed by the processor 1101 and various modules in the terminal device 110 (for example, image data, audio data, voice communication data, and video communication data). This can be achieved through flash memory (FLASH) or random access memory (Random Access Memory, RAM).

[0141] When the processor 1101 executes the program, the steps of any of the above frequency control methods are implemented. The processor 1101 generally controls the overall operation of the terminal device 110.

[0142] In any embodiment of the present application, the processor may be the processing unit mentioned above.

[0143] An embodiment of the present application provides a computer storage medium, which stores one or more programs. The one or more programs can be executed by one or more processors to implement the steps of the frequency control method of any of the above embodiments.

[0144] It should be noted here that the description of the above storage medium and device embodiments is similar to the description of the above method embodiments, and has similar beneficial effects as the method embodiments. For technical details not disclosed in the storage medium and device embodiments of this application, please refer to the description of the method embodiments of this application for understanding.

[0145] The above-mentioned electronic device, each unit or processor of the electronic device may include any one or more of the following integrations: general-purpose processor, application-specific integrated circuit (ASIC), digital signal processor (DSP), digital signal processing device (DSPD), programmable logic device (PLD), field programmable gate array (FPGA), central processing unit (CPU), graphics processing unit (GPU), embedded neural network processor (neural-network processing units, NPU), controller, microcontroller, microprocessor, programmable logic device, discrete gate or transistor logic device, discrete hardware component. It can be understood that the electronic device that realizes the above-mentioned processor function can also be other, and the embodiment of the present application is not specifically limited. The electronic device, each unit or processor of the electronic device can implement or execute the disclosed methods, steps and logic block diagrams in the embodiment of the present application. The general-purpose processor can be a microprocessor or the processor can also be any conventional processor, etc. The steps of the method disclosed in the embodiments of the present application can be directly embodied as being executed by a hardware decoding processor, or can be executed by a combination of hardware and software modules in the decoding processor. The software module can be located in a storage medium mature in the art such as a random access memory, a flash memory, a read-only memory, a programmable read-only memory, or an electrically erasable programmable memory, a register, etc. The storage medium is located in a memory, and the processor reads the information in the memory and completes the steps of the above method in combination with its hardware.

[0146] It is understood that the memory or computer storage medium in the embodiments of the present application may be a volatile memory or a non-volatile memory, or may include both volatile and non-volatile memories. Among them, the non-volatile memory may be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or a flash memory. The volatile memory may be a random access memory (RAM), which is used as an external cache. By way of example and not limitation, many forms of RAM are available, such as static random access memory (SRAM), dynamic random access memory (DRAM), synchronous dynamic random access memory (SDRAM), double data rate synchronous dynamic random access memory (DDR SDRAM), enhanced synchronous dynamic random access memory (ESDRAM), synchronous link dynamic random access memory (SLDRAM), and direct memory bus random access memory (DR RAM). It should be noted that the memory of the systems and methods described herein is intended to include, but is not limited to, these and any other suitable types of memory.

[0147] It should be understood that the "one embodiment" or "an embodiment" or "an embodiment of the present application" or "the aforementioned embodiment" or "some implementations" or "some embodiments" mentioned throughout the specification means that the specific features, structures or characteristics related to the embodiment are included in at least one embodiment of the present application. Therefore, "in one embodiment" or "in an embodiment" or "an embodiment of the present application" or "the aforementioned embodiment" or "some implementations" or "some embodiments" appearing throughout the specification do not necessarily refer to the same embodiment. In addition, these specific features, structures or characteristics can be combined in one or more embodiments in any suitable manner. It should be understood that in various embodiments of the present application, the size of the sequence number of the above-mentioned processes does not mean the order of execution, and the execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiment of the present application. The above-mentioned sequence numbers of the embodiments of the present application are only for description and do not represent the advantages and disadvantages of the embodiments.

[0148] Unless otherwise specified, the terminal device executes any step in the embodiment of the present application, and the processor of the terminal device may execute the step. Unless otherwise specified, the embodiment of the present application does not limit the order in which the terminal device executes the following steps. In addition, the methods used to process data in different embodiments may be the same method or different methods. It should also be noted that any step in the embodiment of the present application can be independently executed by the terminal device, that is, when the terminal device executes any step in the above embodiment, it can be independent of the execution of other steps.

[0149] In addition, the terms "first" and "second" are used for descriptive purposes only and should not be understood as indicating or implying relative importance or implicitly indicating the number of the indicated technical features. Thus, the features defined as "first" and "second" may explicitly or implicitly include one or more of the features. In the description of this application, the meaning of "plurality" is two or more, unless otherwise clearly and specifically defined.

[0150] In the description of this application, it should be noted that, unless otherwise clearly specified and limited, the terms "installed", "connected", and "connected" should be understood in a broad sense, for example, it can be a fixed connection, a detachable connection, or an integral connection; it can be a mechanical connection, an electrical connection, or mutual communication; it can be a direct connection, or an indirect connection through an intermediate medium, it can be the internal connection of two elements or the interaction relationship between two elements. For ordinary technicians in this field, the specific meanings of the above terms in this application can be understood according to specific circumstances.

[0151] In the several embodiments provided in the present application, it should be understood that the disclosed electronic devices, equipment and methods can be implemented in other ways. The device embodiments described above are only schematic. For example, the division of the units is only a logical function division. There may be other division methods in actual implementation, such as: multiple units or components can be combined, or can be integrated into another system, or some features can be ignored or not executed. In addition, the coupling, direct coupling, or communication connection between the components shown or discussed can be through some interfaces, and the indirect coupling or communication connection of the devices or units can be electrical, mechanical or other forms.

[0152] The units described above as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units; they may be located in one place or distributed on multiple network units; some or all of the units may be selected according to actual needs to achieve the purpose of the present embodiment.

[0153] In addition, all functional units in the embodiments of the present application may be integrated into one processing unit, or each unit may be a separate unit, or two or more units may be integrated into one unit; the above-mentioned integrated units may be implemented in the form of hardware or in the form of hardware plus software functional units.

[0154] The methods disclosed in several method embodiments provided in this application can be arbitrarily combined without conflict to obtain new method embodiments.

[0155] The features disclosed in several product embodiments provided in this application can be arbitrarily combined without conflict to obtain new product embodiments.

[0156] The features disclosed in several method or device embodiments provided in this application can be arbitrarily combined without conflict to obtain new method embodiments or device embodiments.

[0157] Those skilled in the art can understand that all or part of the steps of implementing the above method embodiments can be completed by hardware related to program instructions, and the aforementioned program can be stored in a computer storage medium. When the program is executed, it executes the steps of the above method embodiments; and the aforementioned storage medium includes: mobile storage devices, read-only memories (ROM), magnetic disks or optical disks, and other media that can store program codes.

[0158] Alternatively, if the above-mentioned integrated unit of the present application is implemented in the form of a software function module and sold or used as an independent product, it can also be stored in a computer storage medium. Based on such an understanding, the technical solution of the embodiment of the present application can be essentially or partly embodied in the form of a software product that contributes to the relevant technology. The computer software product is stored in a storage medium, including several instructions to enable a computer device (which can be a personal computer, a server, or a network device, etc.) to execute all or part of the methods described in each embodiment of the present application. The aforementioned storage medium includes: various media that can store program codes, such as mobile storage devices, ROMs, magnetic disks, or optical disks.

[0159] In the embodiments of the present application, the descriptions of the same steps and the same contents in different embodiments can refer to each other. In the embodiments of the present application, the term "and" does not affect the order of the steps. For example, the terminal device executes A and executes B, which means that the terminal device executes A first and then executes B, or the terminal device executes B first and then executes A, or the terminal device executes A and executes B at the same time.

[0160] It is worth noting that the drawings in the embodiments of the present application are only for illustrating the schematic positions of various components on the terminal device and do not represent the actual positions in the terminal device. The actual positions of various components or areas may be changed or offset accordingly according to actual conditions (for example, the structure of the terminal device), and the proportions of different parts of the terminal device in the drawings do not represent the actual proportions.

[0161] As used in the embodiments of the present application and the appended claims, the singular forms "a," "an," "said," and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise.

[0162] It should be understood that the term "and / or" used in this article is only a description of the association relationship of associated objects, indicating that there can be three relationships. For example, A and / or B can represent: A exists alone, A and B exist at the same time, and B exists alone. In addition, the character " / " in this article generally indicates that the associated objects before and after are in an "or" relationship.

[0163] It should be noted that in each embodiment involved in the present application, all steps may be executed or part of the steps may be executed as long as a complete technical solution can be formed.

[0164] The above is only an implementation method of the present application, but the protection scope of the present application is not limited thereto. Any person skilled in the art who is familiar with the present technical field can easily think of changes or substitutions within the technical scope disclosed in the present application, which should be included in the protection scope of the present application. Therefore, the protection scope of the present application should be based on the protection scope of the claims.

Claims

1. An electronic device, characterized in that: The electronic device comprises: an image sensor, a processing unit and a DC-DC converter; The image sensor comprises a correlated double sampling unit, which is used to sample the output signal of the pixel unit in the image sensor twice within a sampling interval of each cycle corresponding to the sampling frequency, and to perform a difference between the two sampled output signals to obtain a differential signal, wherein the differential signal is used to determine the digital image signal; The processing unit is used for controlling the pulse width modulation frequency of the DC-DC converter to switch from the third frequency to the fourth frequency when the sampling frequency of the correlated double sampling unit is switched from the first frequency to the second frequency; The DC-DC converter is used to perform voltage conversion according to the pulse width modulation frequency and output the converted voltage to the image sensor; the absolute value of the difference between the third frequency and the first frequency is less than or equal to a first threshold, and the absolute value of the difference between the fourth frequency and the second frequency is less than or equal to a second threshold.

2. The electronic device according to claim 1, characterized in that: The correlated double sampling unit is also used for: Acquire a first corresponding relationship between an exposure mode and / or an exposure duration and the sampling frequency; When the exposure mode is switched from the first exposure mode to the second exposure mode, and / or the exposure duration is switched from the first exposure duration to the second exposure duration, the sampling frequency is controlled to switch from the first frequency to the second frequency according to the first corresponding relationship.

3. The electronic device according to claim 2, characterized in that: The correlated double sampling unit is also used for: Acquire a second corresponding relationship between the sampling frequency and the sampling interval; When the exposure mode is switched from the first exposure mode to the second exposure mode, and / or the exposure duration is switched from the first exposure duration to the second exposure duration, the sampling interval of each cycle corresponding to the sampling frequency is controlled according to the first corresponding relationship and the second corresponding relationship, and switched from the first sampling interval of each cycle corresponding to the first frequency to the second sampling interval of each cycle corresponding to the second frequency.

4. The electronic device according to claim 3, characterized in that: The correlated double sampling unit is also used for: Determine, according to at least one spectrum data corresponding to at least one exposure duration in each of the multiple exposure modes collected by the spectrum analyzer, at least one sampling frequency corresponding to the at least one exposure duration, and determine the first corresponding relationship according to the at least one sampling frequency corresponding to the at least one exposure duration; The second corresponding relationship is determined according to the acquired current value input to the image sensor at each exposure duration in each exposure mode.

5. The electronic device according to any one of claims 1 to 4, characterized in that: The DC-DC converter includes a serial data link port and a serial clock link port. The processing unit controls the pulse width modulation frequency of the DC-DC converter through the serial data link port and the serial clock link port, and switches from the third frequency to the fourth frequency.

6. The electronic device according to claim 5, characterized in that: The processing unit is further configured to determine a second input voltage of the DC-DC converter corresponding to the fourth frequency according to the third frequency, the fourth frequency, and the first input voltage of the DC-DC converter corresponding to the third frequency, and control the voltage input to the DC-DC converter to be the second input voltage; The output voltage of the DC-DC converter corresponding to the first input voltage is the same as the output voltage of the DC-DC converter corresponding to the second input voltage.

7. The electronic device according to any one of claims 1 to 4, characterized in that: The electronic device further includes a feedback unit; the feedback unit is used to: When the pulse width modulation frequency of the DC-DC converter is switched from the third frequency to the fourth frequency, acquiring at least one first image captured; It is determined whether the fourth frequency meets the frequency requirement according to the fixed pattern noise value of the at least one first image.

8. The electronic device according to claim 7, characterized in that: The feedback unit is further configured to: determine that the fourth frequency meets the frequency requirement when the fixed pattern noise value of the at least one first image is less than or equal to a third threshold; or, The feedback unit is also used to send indication information that the fourth frequency does not meet the frequency requirement to the processing unit when the fixed pattern noise values ​​of some or all of the fixed pattern noise values ​​of the at least one first image are greater than the third threshold; the processing unit is also used to adjust the pulse width modulation frequency of the DC-DC converter from the fourth frequency to the fifth frequency; the feedback unit is also used to: when the pulse width modulation frequency of the DC-DC converter is switched from the fourth frequency to the fifth frequency, acquire at least one captured second image; and determine, based on the fixed pattern noise value of the at least one second image, that the fifth frequency meets the frequency requirement.

9. A frequency control method, characterized in that: The frequency control method comprises: Determine that the sampling frequency of the correlated double sampling unit is switched from the first frequency to the second frequency; the correlated double sampling unit is used to sample the output signal of the pixel unit in the image sensor twice within the sampling interval of each cycle corresponding to the sampling frequency, and perform a difference between the two sampled output signals to obtain a differential signal, and the differential signal is used to determine the digital image signal; Controlling the pulse width modulation frequency of the DC-DC converter to switch from the third frequency to the fourth frequency; the DC-DC converter is used to perform voltage conversion according to the pulse width modulation frequency and output the converted voltage to the image sensor; the absolute value of the difference between the third frequency and the first frequency is less than or equal to a first threshold, and the absolute value of the difference between the fourth frequency and the second frequency is less than or equal to a second threshold.

10. A terminal device, characterized in that: The terminal device includes the electronic apparatus described in any one of claims 1 to 8, or the terminal device includes a memory and a processor, the memory is used to store a computer program, and the processor is used to call and run the computer program stored in the memory, so that the terminal device executes the method described in claim 9.

Images