Electronic device, frequency control method, and terminal device
By adjusting the frequency synchronization between the correlated dual sampling unit and the DC-DC converter of the image sensor, the problem of FPN noise in the image sensor during exposure switching is solved, and high-quality image signal output is achieved.
Patent Information
- Application Number
- CN202311311172.6
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2023-10-10
- Publication Date
- 2025-11-25
- Estimated Expiration
- 2043-10-10
AI Technical Summary
In the prior art, fixed pattern noise (FPN) generated by image sensors during exposure switching is difficult to eliminate effectively, especially during digital overlap switching, where the sampling frequency adjustment of correlated double sampling (CDS) is insufficient to completely remove such noise.
By synchronously adjusting the pulse width modulation frequency of the DC-DC converter to match the sampling frequency during the sampling frequency switching of the relevant dual sampling unit, a stable voltage is output in the image sensor, avoiding the introduction of additional noise and further eliminating FPN.
It effectively removes fixed-pattern noise from images, ensuring image signal quality and avoiding additional noise interference caused by frequency mismatch.
Smart Images

Figure CN119815203B_ABST
Abstract
Description
Technical Field
[0001] The embodiments of this application relate to, but are not limited to, electronic technology, and in particular to an electronic device, a frequency control method, and a terminal device. Background Technology
[0002] Fixed pattern noise (FPN) is introduced due to defects in the image sensor manufacturing process and varies with changes in ambient temperature and analog gain. Therefore, eliminating FPN has been a long-standing concern in this field. Summary of the Invention
[0003] This application provides an electronic device, a frequency control method, and a terminal device.
[0004] In a first aspect, embodiments of this application provide an electronic device, the electronic device comprising: an image sensor, a processing unit, and a DC-DC converter;
[0005] The image sensor includes a correlated double sampling unit, which is used to sample the output signal of the pixel unit in the image sensor twice within the sampling interval of each period corresponding to the sampling frequency, and perform differential sampling on the two sampled output signals to obtain a differential signal, which is used to determine the digital image signal;
[0006] The processing unit is used to control the pulse width modulation frequency of the DC-DC converter to switch from a third frequency to a fourth frequency when the sampling frequency of the relevant dual sampling unit switches from a first frequency to a second frequency.
[0007] The DC-DC converter is used to perform voltage conversion according to the pulse width modulation frequency and output the converted voltage to the image sensor; the absolute value of the difference between the third frequency and the first frequency is less than or equal to a first threshold, and the absolute value of the difference between the fourth frequency and the second frequency is less than or equal to a second threshold.
[0008] Secondly, embodiments of this application provide a frequency control method, the frequency control method comprising:
[0009] The sampling frequency of the correlated dual sampling unit is switched from a first frequency to a second frequency. The correlated dual sampling unit is used to sample the output signal of the pixel unit in the image sensor twice within the sampling interval of each period corresponding to the sampling frequency, and to perform differential analysis on the two sampled output signals to obtain a differential signal, which is used to determine the digital image signal.
[0010] The pulse width modulation frequency of the DC-DC converter is controlled to switch from a third frequency to a fourth frequency; the DC-DC converter is used to perform voltage conversion according to the pulse width modulation frequency and output the converted voltage to the image sensor; the absolute value of the difference between the third frequency and the first frequency is less than or equal to a first threshold, and the absolute value of the difference between the fourth frequency and the second frequency is less than or equal to a second threshold.
[0011] Thirdly, embodiments of this application provide a terminal device, the terminal device including the electronic device described in the first aspect, or the terminal device including a memory and a processor, the memory for storing a computer program, and the processor for calling and running the computer program stored in the memory, causing the terminal device to execute the method described in the second aspect.
[0012] In this embodiment, the processing unit controls the pulse width modulation frequency of the DC-DC converter to switch from a third frequency to a fourth frequency when the sampling frequency of the related dual sampling unit switches from a first frequency to a second frequency. This ensures that the pulse width modulation frequency of the DC-DC converter switches accordingly when the sampling frequency of the related dual sampling unit switches, making the pulse width modulation frequency of the DC-DC converter as consistent as possible with the sampling frequency of the related dual sampling unit. Furthermore, the output of the converted voltage to the image sensor through the DC-DC converter does not introduce additional noise into the image sensor and does not affect the related dual sampling unit's elimination of fixed-pattern noise through sampling. Therefore, this application can effectively remove fixed-pattern noise from the image. Attached Figure Description
[0013] The accompanying drawings, which are provided to further illustrate this application and form part of this application, illustrate exemplary embodiments of this application and are used to explain this application, but do not constitute an undue limitation of this application.
[0014] Figure 1 This is a schematic diagram of the structure of an electronic device provided in an embodiment of this application;
[0015] Figure 2 This is a schematic diagram of the structure of another electronic device provided in an embodiment of this application;
[0016] Figure 3 A flowchart illustrating a frequency control method provided in an embodiment of this application;
[0017] Figure 4 A schematic diagram of a frequency adjustment framework provided for an embodiment of this application;
[0018] Figure 5A flowchart illustrating a method for establishing a correspondence provided in an embodiment of this application;
[0019] Figure 6 This application provides a schematic diagram illustrating the relationship between the high and low levels of an exposure signal and the sampling range, as exemplified in this application.
[0020] Figure 7 A schematic diagram illustrating the relationship between the high and low level difference of an exposure signal and the sampling level of a related double sampling, provided in an embodiment of this application;
[0021] Figure 8 A schematic diagram illustrating the sampling frequency of a correlated double sampling method provided in an embodiment of this application;
[0022] Figure 9 This is a schematic diagram of the structure of a DC-DC converter provided in an embodiment of this application;
[0023] Figure 10 A flowchart illustrating a method for adjusting the pulse width modulation frequency provided in an embodiment of this application;
[0024] Figure 11 This is a schematic diagram of the hardware entity of a terminal device provided in an embodiment of this application;
[0025] Figure 12 This is a schematic diagram of the hardware entity of another terminal device provided in an embodiment of this application. Detailed Implementation
[0026] The technical solutions of this application will be described in detail below through embodiments and in conjunction with the accompanying drawings. These specific embodiments can be combined with each other, and the same or similar concepts or processes may not be described again in some embodiments.
[0027] It should be noted that in this application example, terms such as "first" and "second" are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence.
[0028] Furthermore, the technical solutions described in the embodiments of this application can be combined arbitrarily without conflict. In the description of this application, "multiple" means two or more, unless otherwise explicitly specified.
[0029] Many current terminal devices have Digital Overlap (DOL) functionality. Technicians have discovered that Front-Pixel Noise (FPN) is generated during DOL switching or when switching between different exposure levels within a DOL mode. FPN is a type of noise in digital images, caused by differences in pixel sensitivity on photosensitive elements (such as image sensors). FPN creates a pattern where dark and bright pixels are visible (this pattern remains consistent across images). Related technologies address FPN by adjusting the sampling frequency of Correlated Double Sampling (CDS); however, this method cannot effectively eliminate FPN in images.
[0030] The terminal device in any embodiment of this application may include one or a combination of at least two of the following: Internet of Things (IoT) devices, satellite terminals, Wireless Local Loop (WLL) stations, Personal Digital Assistants (PDAs), handheld devices with wireless communication capabilities, computing devices or other processing devices connected to a wireless modem, servers, mobile phones, tablets, computers with wireless transceiver capabilities, handheld computers, desktop computers, personal digital assistants, portable media players, smart speakers, navigation devices, smartwatches, smart glasses, smart necklaces and other wearable devices, learning machines, translation pens, translation machines, point-and-read machines, pedometers, digital TVs, Virtual Reality (VR) terminal devices, Augmented Reality (AR) terminal devices, wireless terminals in industrial control, wireless terminals in self-driving, wireless terminals in remote medical surgery, wireless terminals in smart grids, wireless terminals in transportation safety, and wireless terminals in smart cities. Wireless terminals in cities, wireless terminals in smart homes, and vehicles, in-vehicle equipment, in-vehicle modules, wireless modems, handheld devices, customer premises equipment (CPE), and smart home appliances in vehicle networking systems.
[0031] Figure 1 This is a schematic diagram of the structure of an electronic device provided in an embodiment of this application, such as... Figure 1 As shown, the electronic device 10 includes an image sensor 11, a processing unit 12, and a DC-DC converter 13.
[0032] The image sensor 11 includes a correlated dual sampling unit 111, which is used to sample the output signal of the pixel unit (not shown in the figure) in the image sensor 11 twice within the sampling interval of each period corresponding to the sampling frequency, and perform differential sampling on the two sampled output signals to obtain a differential signal, which is used to determine the digital image signal.
[0033] The processing unit 12 is used to control the pulse width modulation frequency of the DC-DC converter 13 to switch from a third frequency to a fourth frequency when the sampling frequency of the related dual sampling unit 111 switches from a first frequency to a second frequency.
[0034] The DC-DC converter 13 is used to perform voltage conversion according to the pulse width modulation frequency and output the converted voltage to the image sensor 11; the absolute value of the difference between the third frequency and the first frequency is less than or equal to a first threshold, and the absolute value of the difference between the fourth frequency and the second frequency is less than or equal to a second threshold.
[0035] In some embodiments, the correlation double sampling unit 111 may be referred to as a correlation double sampling circuit. The correlation double sampling unit 111 is used to perform correlation double sampling.
[0036] In some embodiments, the image sensor 11 may be included in the imaging unit (not shown). In some embodiments, the imaging unit may include a lens, the image sensor 11, and a digital signal processor. The lens is used to receive light signals, the image sensor 11 converts the light signals into digital image signals, and outputs them to the digital signal processor for processing.
[0037] In some embodiments, the image sensor 11 may include pixel units and a correlated double sampling unit 111. In some embodiments, the correlated double sampling unit 111 samples the output signal of the pixel unit in the image sensor 11 twice within the sampling interval of each cycle. For example, the correlated double sampling unit 111 may sample the output signal of the pixel unit in the image sensor 11 at the start point and the end point of the sampling interval of each cycle, respectively. In some embodiments, the start point may be referred to as the integration start time of the photoelectric signal, and the end point may be referred to as the integration end time of the photoelectric signal. In some embodiments, the first sampled output signal in the two sampled output signals may be referred to as the reset level or reset signal, and the second sampled output signal in the two sampled output signals may be referred to as the signal level or image signal.
[0038] In some embodiments, the image sensor 11 may further include an analog-to-digital converter (not shown), and the correlated dual sampling unit 111 may output the differential signal to the analog-to-digital converter so that the analog-to-digital converter converts the differential signal into a digital image signal and outputs it. In some embodiments, differential sampling of the two sampled output signals may include performing a subtraction operation on the two sampled output signals.
[0039] In some embodiments, by differentially dividing the output signals from two samplings, the deviation values of each pixel in the pixel unit between the two sampling measurements will be canceled out, thereby correcting the fixed-pattern noise error of the image signal.
[0040] In some embodiments, the sampling frequency of correlated double sampling varies according to the exposure duration. For example, the sampling frequency of correlated double sampling is related to the data size and the exposure duration. With the data size of a single frame remaining constant, a longer exposure duration will result in a longer data transmission time, thereby causing the sampling frequency of correlated double sampling to decrease.
[0041] In some embodiments, different sampling frequencies correspond to different sampling intervals.
[0042] In some embodiments, the correlated double sampling unit 111 can control the sampling frequency of the correlated double sampling according to the exposure duration. In some embodiments, the correlated double sampling unit 111 can control the sampling frequency of the correlated double sampling and the sampling interval of each period corresponding to the sampling frequency according to the exposure duration.
[0043] In some embodiments, the related dual sampling unit 111 can control the sampling frequency of the related dual sampling unit 111 to switch from a first frequency to a second frequency according to the switching of exposure time.
[0044] In some embodiments, the first frequency may be the same as the third frequency. In some embodiments, the second frequency may be the same as the fourth frequency.
[0045] In other embodiments, due to limitations in the precision of controlling the sampling frequency of the associated dual sampling unit 111, and / or limitations in the precision of controlling the pulse width modulation frequency, the first frequency may be different from the third frequency, and / or the second frequency may be different from the fourth frequency. For example, the third frequency may be determined based on the control precision of the first frequency and the pulse width modulation frequency, and / or the fourth frequency may be determined based on the control precision of the second frequency and the pulse width modulation frequency.
[0046] In this embodiment, the processing unit controls the pulse width modulation frequency of the DC-DC converter to switch from a third frequency to a fourth frequency when the sampling frequency of the related dual sampling unit switches from a first frequency to a second frequency. This ensures that the pulse width modulation frequency of the DC-DC converter switches accordingly when the sampling frequency of the related dual sampling unit switches, making the pulse width modulation frequency of the DC-DC converter as consistent as possible with the sampling frequency of the related dual sampling unit. Furthermore, the output of the converted voltage to the image sensor through the DC-DC converter does not introduce additional noise into the image sensor and does not affect the related dual sampling unit's elimination of fixed-pattern noise through sampling. Therefore, this application can effectively remove fixed-pattern noise from the image.
[0047] In some embodiments, the correlated dual sampling unit 111 is further configured to:
[0048] Obtain the first correspondence between the exposure mode and / or exposure duration and the sampling frequency;
[0049] When the exposure mode is switched from the first exposure mode to the second exposure mode, and / or the exposure duration is switched from the first exposure duration to the second exposure duration, the sampling frequency is controlled to switch from the first frequency to the second frequency according to the first correspondence.
[0050] In some embodiments, different exposure methods correspond to different numbers of exposures and / or different exposure durations. For example, among two different exposure methods, one exposure method corresponds to three exposures with different exposure durations, and the other exposure method corresponds to two exposures with different durations. As another example, among two different exposure methods, one exposure method corresponds to three exposures with exposure durations t1, t2, and t3, and the other exposure method corresponds to three exposures with exposure durations t4, t5, and t6, or the three exposures have exposure durations t3, t4, and t5. Yet another example, among two different exposure methods, one exposure method corresponds to at least one exposure that is either all long exposures or all short exposures, and the other exposure method corresponds to at least one exposure that includes both long and short exposures. The long and short exposures have different exposure durations.
[0051] For example, the first exposure mode can be a 1DOL exposure mode, and the second exposure mode can be a 2DOL exposure mode, or the second exposure mode can be a 1DOL exposure mode and the first exposure mode can be a 2DOL exposure mode. In the 1DOL exposure mode, multiple different exposures are generated simultaneously within one frame output cycle, and these multiple different exposures are either all long exposures or all short exposures. In the 2DOL exposure mode, one long exposure and one short exposure are generated simultaneously within one frame output cycle.
[0052] In some embodiments, different exposure methods with the same exposure duration result in different sampling frequencies. In some embodiments, the same exposure method with different exposure durations result in different sampling frequencies. In some embodiments, different exposure methods with different exposure durations result in different sampling frequencies.
[0053] In some embodiments, the processing unit 12 can determine whether to switch the exposure mode from the first exposure mode to the second exposure mode based on changes in ambient light intensity and / or changes in the shooting scene, and send information about the switch to the second exposure mode to the relevant dual sampling unit 111. In some embodiments, the processing unit 12 can acquire the exposure signal sent by the image sensor 11, determine the corresponding exposure duration based on the exposure signal, and send information about the switch to the second exposure duration to the relevant dual sampling unit 111 when the exposure duration switches from the first exposure duration to the second exposure duration. In other embodiments, the relevant dual sampling unit 111 can acquire the exposure signal and determine whether to switch the exposure duration from the first exposure duration to the second exposure duration based on the exposure signal.
[0054] In some other embodiments of this application, the exposure signal may be referred to as a synchronization signal or a vertical synchronization (VSys) signal.
[0055] In some embodiments, the first correspondence may include a correspondence between multiple exposure modes, multiple exposure durations, and multiple sampling frequencies, wherein there may be a one-to-one correspondence between the multiple exposure modes, multiple exposure durations, and multiple sampling frequencies. In some embodiments, the first correspondence may include multiple first relationship curves, each of which corresponds to a multiple exposure mode, and each first relationship curve is a curve showing the relationship between exposure duration and sampling frequency.
[0056] In some embodiments, the first correspondence may be pre-stored in the associated dual sampling unit 111.
[0057] In some embodiments, the sampling frequency of the related dual sampling unit 111 is a first frequency. When the exposure mode is switched from the first exposure mode to the second exposure mode, and / or the exposure duration is switched from the first exposure duration to the second exposure duration, the related dual sampling unit 111 determines a second frequency according to the first correspondence and controls the sampling frequency to switch from the first frequency to the second frequency.
[0058] In some embodiments, the correlated dual sampling unit 111 is further configured to:
[0059] Obtain the second correspondence between sampling frequency and sampling interval;
[0060] When the exposure mode is switched from the first exposure mode to the second exposure mode, and / or the exposure duration is switched from the first exposure duration to the second exposure duration, the sampling interval of each cycle corresponding to the sampling frequency is controlled to switch from the first sampling interval of each cycle corresponding to the first frequency to the second sampling interval of each cycle corresponding to the second frequency, according to the first correspondence and the second correspondence.
[0061] In some embodiments, the second correspondence may include a correspondence between multiple sampling frequencies and multiple sampling intervals. The multiple sampling frequencies and multiple sampling intervals may correspond one-to-one. In some embodiments, the second correspondence may include a second relationship curve, which represents the relationship between sampling frequencies and sampling intervals.
[0062] In some embodiments, the second correspondence may be pre-stored in the associated dual sampling unit 111.
[0063] In some embodiments, different sampling frequencies correspond to different sampling intervals.
[0064] In some embodiments, the sampling frequency of the related dual sampling unit 111 is a first frequency, and the corresponding sampling interval is a first sampling interval. When the exposure mode is switched from the first exposure mode to the second exposure mode, and / or the exposure duration is switched from the first exposure duration to the second exposure duration, the related dual sampling unit 111 determines the second frequency and the second sampling interval according to the first correspondence and the second correspondence, and controls the sampling interval of each cycle corresponding to the sampling frequency to switch from the first sampling interval of each cycle corresponding to the first frequency to the second sampling interval of each cycle corresponding to the second frequency.
[0065] In some embodiments, the correlated dual sampling unit 111 is further configured to:
[0066] Based on at least one spectral data corresponding to at least one exposure duration in each of the multiple exposure modes collected by the spectrum analyzer, at least one sampling frequency corresponding to each of the at least one exposure durations is determined, and based on the at least one sampling frequency corresponding to each of the at least one exposure durations, the first correspondence is determined.
[0067] In some embodiments, the correlated dual sampling unit 111 is further configured to:
[0068] The second correspondence is determined based on the current value input to the image sensor 11 under the at least one exposure duration.
[0069] In some embodiments, the current value input to the image sensor 11 or its associated dual sampling unit 111 for each exposure duration under each exposure mode can be obtained by acquiring the current input to the image sensor 11 or its associated dual sampling unit 111 through a current acquisition device. In some embodiments, the current value input to the image sensor 11 or its associated dual sampling unit 111 can be the current value input to the image sensor 11 or its associated dual sampling unit 111 by the DC-DC converter 13.
[0070] In some embodiments, under an exposure mode and for an exposure duration, which corresponds to a sampling frequency, the current value input to the image sensor 11 or its associated dual sampling unit 111 can vary periodically. For example, within each first duration, there exists a second duration where the current value is the target current value, which is not 0; at other times, the current value is 0. The second duration is located at the same position within each first duration. In some embodiments, the interval where the current value is the target current value is defined as the sampling interval.
[0071] In some embodiments, the DC-DC converter 13 includes a serial data link (SDL) port and a serial clock link (SCL) port. The processing unit 12 controls the pulse width modulation frequency of the DC-DC converter 13 through the serial data link port and the serial clock link port, switching it from a third frequency to a fourth frequency.
[0072] In some embodiments, the DC-DC converter 13 further includes: a general purpose input / output (GPIO) port, a voltage input port, a voltage output port, a feedback (FB) port, and a ground port.
[0073] In some embodiments, the voltage input port can be grounded via capacitor C.
[0074] In some embodiments, the voltage output port can be connected to the first end of the inductor L, and the second end of the inductor L can be connected to the image sensor 11. In some embodiments, the feedback port is connected to the first end of the first resistor R1, the second end of the first resistor R1 is connected to the first end of the second resistor R2, and the second end of the second resistor R2 is connected to the second end of the inductor L. In some embodiments, the ground port is connected to the second end of the first resistor R1, and the ground port is also grounded.
[0075] In some embodiments, the processing unit 12 is further configured to determine the second input voltage of the DC-DC converter 13 corresponding to the fourth frequency based on the third frequency, the fourth frequency, and the first input voltage of the DC-DC converter 13 corresponding to the third frequency, and control the voltage input to the DC-DC converter 13 to be the second input voltage;
[0076] The output voltage of the DC-DC converter 13 corresponding to the first input voltage is the same as the output voltage of the DC-DC converter 13 corresponding to the second input voltage.
[0077] In some embodiments, the processing unit 12 can switch from a first input voltage to a second input voltage by controlling the voltage output to the DC-DC converter 13 by the power supply device. In some embodiments, the power supply device may be included in the electronic device 10.
[0078] Figure 2 A schematic diagram of the structure of another electronic device provided in the embodiments of this application, such as... Figure 2 As shown, the electronic device 10 includes: an image sensor 11, a processing unit 12, a DC-DC converter 13, and a feedback unit 14. For a detailed description of the image sensor 11, the processing unit 12, and the DC-DC converter 13, please refer to the description of the above embodiments; it will not be repeated here.
[0079] The feedback unit 14 is used to: acquire at least one first image when the pulse width modulation frequency of the DC-DC converter 13 is switched from the third frequency to the fourth frequency; and determine whether the fourth frequency meets the frequency requirements based on the fixed pattern noise value of the at least one first image.
[0080] In some embodiments, when the pulse width modulation frequency of the DC-DC converter 13 switches from the third frequency to the fourth frequency, the DC-DC converter 13 may send the fourth frequency or information about switching from the third frequency to the fourth frequency to the feedback unit 14. Upon receiving the information, the feedback unit 14 sends a request to the camera unit to capture at least one first image. The camera unit captures at least one first image according to the request and sends the at least one first image to the feedback unit 14. The feedback unit 14 may determine the fixed-mode noise value of each of the at least one first image, and thereby determine whether the fourth frequency meets the frequency requirements based on the fixed-mode noise value of the at least one first image.
[0081] In some embodiments, the DC-DC converter 13 can send a fourth frequency or information about switching from the third frequency to the fourth frequency to the feedback unit 14 via GPIO. Alternatively, the DC-DC converter 13 can send a fourth frequency or information about switching from the third frequency to the fourth frequency to the feedback unit 14 via the SDL port and the SCL port.
[0082] In some embodiments, the number of first images in at least one first image can be one image or multiple images. For example, at least one first image may include one first image, two first images, five first images, or ten first images, etc. For example, at least one first image may be five first images.
[0083] In some embodiments, the exposure mode used for at least one first image is a second exposure mode, and / or the exposure duration used for at least one first image is a second exposure duration. In some embodiments, the sampling frequency used for at least one first image is a second frequency, and the pulse width modulation frequency used for at least one first image is a fourth frequency.
[0084] In some embodiments, the feedback unit 14 is further configured to: determine that the fourth frequency meets the frequency requirement when the fixed pattern noise values of at least one first image are all less than or equal to a third threshold.
[0085] In some embodiments, the third threshold may be greater than or equal to 5 dB. For example, the third threshold may be 5 dB, 10 dB, 20 dB, 30 dB, or 50 dB, etc. For example, the third threshold may be 20 dB.
[0086] In some embodiments, if the feedback unit 14 determines that the fourth frequency meets the frequency requirement, it may send an indication message indicating that the fourth frequency meets the frequency requirement to the processing unit 12, so that the processing unit 12 no longer adjusts the pulse width modulation frequency of the DC-DC converter 13. In other embodiments, if the feedback unit 14 determines that the fourth frequency meets the frequency requirement, it may not send any information to the processing unit 12.
[0087] In some embodiments, the feedback unit 14 is further configured to send an indication message to the processing unit 12 indicating that the fourth frequency does not meet the frequency requirement when the fixed pattern noise value of some or all of the fixed pattern noise values of the at least one first image is greater than the third threshold; the processing unit 12 is further configured to adjust the pulse width modulation frequency of the DC-DC converter 13 from the fourth frequency to the fifth frequency; the feedback unit 14 is further configured to: acquire at least one captured second image when the pulse width modulation frequency of the DC-DC converter 13 is switched from the fourth frequency to the fifth frequency; and determine that the fifth frequency meets the frequency requirement based on the fixed pattern noise value of the at least one second image.
[0088] In some embodiments, the absolute value of the difference between the fifth frequency and the second frequency is less than or equal to the second threshold.
[0089] In some embodiments, when the pulse width modulation frequency of the DC-DC converter 13 switches from the fourth frequency to the fifth frequency, the DC-DC converter 13 can send the fifth frequency or information about switching from the fourth frequency to the fifth frequency to the feedback unit 14. Upon receiving this information, the feedback unit 14 sends a request to the camera unit to capture at least one second image. The camera unit captures at least one second image according to the request and sends the at least one second image to the feedback unit 14. The feedback unit 14 can determine the fixed-mode noise value of each of the at least one second image, and thus determine whether the fifth frequency meets the frequency requirements based on the fixed-mode noise value of the at least one second image.
[0090] In some embodiments, the DC-DC converter 13 can send a fifth frequency or a switch from the fourth frequency to the fifth frequency to the feedback unit 14 via GPIO. Alternatively, the DC-DC converter 13 can send a fifth frequency or a switch from the fourth frequency to the fifth frequency to the feedback unit 14 via the SDL port and the SCL port.
[0091] In some embodiments, the number of second images in at least one second image can be one image or multiple images. For example, at least one second image may include one second image, two second images, five second images, or ten second images, etc. Exemplarily, at least one second image may be five second images. In some embodiments, the number of second images in at least one second image may be the same as the number of first images in at least one first image. In other embodiments, to save resources, the number of second images in at least one second image may be less than the number of first images in at least one first image.
[0092] In some embodiments, the exposure mode used by at least one second image is a second exposure mode, and / or the exposure duration used by at least one second image is a second exposure duration. In some embodiments, the sampling frequency used by at least one second image is a second frequency, and the pulse width modulation frequency used by at least one first image is a fifth frequency.
[0093] In this embodiment, when the pulse width modulation frequency of the DC-DC converter 13 changes, the feedback unit 14 determines whether the changed pulse width modulation frequency meets the frequency requirements. If the frequency requirements are not met, the feedback unit 14 sends an instruction to the processing unit 12 so that the processing unit 12 adjusts the pulse width modulation frequency until the changed pulse width modulation frequency meets the frequency requirements.
[0094] Figure 3 This is a flowchart illustrating a frequency control method provided in an embodiment of this application. The method is applied to a processing unit or a terminal device and includes:
[0095] S301. Determine that the sampling frequency of the correlated dual sampling unit is switched from the first frequency to the second frequency; the correlated dual sampling unit is used to sample the output signal of the pixel unit in the image sensor twice within the sampling interval of each period corresponding to the sampling frequency, and perform differential sampling on the two sampled output signals to obtain a differential signal, the differential signal being used to determine the digital image signal.
[0096] S302. Control the pulse width modulation frequency of the DC-DC converter to switch from a third frequency to a fourth frequency; the DC-DC converter is used to perform voltage conversion according to the pulse width modulation frequency and output the converted voltage to the image sensor; the absolute value of the difference between the third frequency and the first frequency is less than or equal to a first threshold, and the absolute value of the difference between the fourth frequency and the second frequency is less than or equal to a second threshold rate.
[0097] In some embodiments, the DC-DC converter includes a serial data link port and a serial clock link port, and the method further includes: controlling the pulse width modulation frequency of the DC-DC converter through the serial data link port and the serial clock link port to switch from a third frequency to a fourth frequency.
[0098] In some embodiments, the method further includes: determining a second input voltage of the DC-DC converter corresponding to the fourth frequency based on the third frequency, the fourth frequency, and a first input voltage of the DC-DC converter corresponding to the third frequency, and controlling the voltage input to the DC-DC converter to be the second input voltage.
[0099] The output voltage of the DC-DC converter corresponding to the first input voltage is the same as the output voltage of the DC-DC converter corresponding to the second input voltage.
[0100] The descriptions of the above method embodiments are similar to those of the above electronic device embodiments, and have similar beneficial effects. For technical details not disclosed in the method embodiments of this application, please refer to the descriptions of the electronic device embodiments of this application for understanding.
[0101] Fixed Pattern Noise (FPN) optimization reduces FPN noise through Correlated Double Sampling (CDS). During exposure switching, the CDS sampling frequency changes. In this application, when the CDS sampling frequency changes, the PWM frequency of the DC-DC converter supplying the image sensor's input voltage also changes accordingly. This ensures that the DC-DC converter's PWM frequency is as consistent as possible with the CDS sampling frequency, preventing the voltage input to the image sensor from generating additional noise and thus having no impact on CDS sampling to reduce FPN. Since CDS uses the difference between two samples to reduce noise, when the DC-DC converter's PWM frequency matches the CDS unit's sampling frequency, it has no effect on the difference value determined by the CDS unit, thereby not affecting the signal quality output by the CDS unit.
[0102] Figure 4 This is a schematic diagram of a frequency adjustment framework provided in an embodiment of this application, as shown below. Figure 4 As shown, the implementation of this framework consists of two parts: one is the establishment of the correspondence, and the other is performance optimization.
[0103] In establishing the correspondence, it is necessary to determine the sampling frequency of the relevant dual sampling units corresponding to different exposure durations under different exposure modes (also known as different DOL modes) of the mobile phone. Different exposure durations correspond to different exposure signals. For example, an image sensor can output an exposure signal, and by analyzing the exposure signal, the exposure duration corresponding to the exposure signal can be obtained. In some embodiments, the image sensor can output the exposure signal to a processing unit, so that the processing unit can analyze the exposure signal to obtain the exposure duration corresponding to the exposure signal. In other embodiments, the image sensor can send the exposure signal to other devices outside the terminal device through the processing unit, or the image sensor can send the exposure signal to other devices outside the terminal device, so that other devices can analyze the exposure signal to obtain the exposure duration corresponding to the exposure signal. By obtaining the sampling frequency of the relevant dual sampling units corresponding to different exposure durations under each exposure mode, a correspondence can be established. This correspondence includes a first correspondence between the exposure mode and / or exposure duration and the sampling frequency, and a second correspondence between the sampling frequency and the sampling interval. In other embodiments, a first correspondence is established between the exposure mode, the exposure signal, and the sampling frequency.
[0104] In the performance optimization section, the processing unit acquires data on the sampling frequency switching of the relevant dual sampling units. This sampling frequency switching occurs when the exposure mode changes from a first exposure mode to a second exposure mode, and / or the exposure duration changes from a first exposure duration to a second exposure duration. Based on the sampling frequency switching data, the processing unit adjusts the DC-DC converter to adjust the pulse width modulation frequency according to the pulse width modulation frequency. The feedback unit can acquire a simulated effect image (i.e., at least one of the aforementioned first images or at least one of the aforementioned second images). If, based on the simulated effect image, it determines that the adjusted pulse width modulation frequency does not meet the frequency requirements, feedback is provided so that the processing unit readjusts the pulse width modulation frequency based on the feedback. This continues until the feedback unit, based on the acquired simulated effect image, determines that the adjusted pulse width modulation frequency meets the frequency requirements, and then stops providing feedback. The simulated effect image becomes the output effect image. In this way, the processing unit first obtains the sampling frequencies of the relevant dual sampling units before and after the switching. Based on these sampling frequencies, the pulse width modulation (PWM) frequency of the DC-DC converter is controlled, ensuring that the PWM frequency of the DC-DC converter matches the sampling frequency of the relevant dual sampling units. Then, a simulated effect image is determined, and through a feedback loop, the response speed and matching accuracy are optimized, thereby achieving a high-quality output effect image. For example, the effect image is used to calculate noise (e.g., fixed-pattern noise), i.e., taking five consecutive images to confirm whether the noise meets the standard. In this embodiment, since the test acquisition of the relevant dual sampling unit also has precision, and the control of the PWM frequency of the DC-DC converter also has precision, the frequency error between these two is minimized. Specifically, the frequency error requirement is determined by whether the objective self-measured noise value is greater than 20. If it is, the requirement is met; otherwise, it is not, thus obtaining a high-quality output effect image.
[0105] Figure 5 A flowchart illustrating a method for establishing a correspondence provided in an embodiment of this application is shown below. Figure 5 As shown, the method includes:
[0106] S501, Scanning frequency.
[0107] S502. Determine the sampling frequency of the relevant dual sampling unit.
[0108] In some embodiments, the sampling frequency of the correlated double sampling can correspond to the exposure time. To obtain the sampling frequency of the correlated double sampling, a spectrum analyzer can be used to scan the closest position of the camera unit to the image sensor (also known as the sensor) to obtain spectrum data. Analyzing this spectrum data can yield the sampling frequency of the correlated double sampling.
[0109] S503, current acquisition.
[0110] S504. Determine the sampling interval of the relevant dual sampling unit.
[0111] In some embodiments, a current acquisition device (e.g., a current acquisition unit) can be used to acquire the current input to the image sensor, or to acquire the current input to the correlated double sampling unit in the image sensor. Based on the magnitude of the acquired current value, the sampling interval of the correlated double sampling is determined. 即开始时间和结束时间对应的时间段 In some embodiments, the sampling interval of the correlated double sampling can also be referred to as the sampling period.
[0112] S505, Determine the exposure signal.
[0113] In some embodiments, the exposure signal may be output by an image sensor, and the exposure signal corresponds to the exposure duration. In some embodiments, the processing unit or other device may acquire the exposure signal output by the image sensor.
[0114] S506. Establish corresponding relationships.
[0115] In some embodiments, the correspondence may include a correspondence between exposure signals, sampling frequencies, and sampling intervals. In other embodiments, the correspondence may include a correspondence between exposure duration, sampling frequencies, and sampling intervals. For example, the correspondence may include the first and second correspondences described above.
[0116] Figure 6 This application provides a schematic diagram illustrating the relationship between the high and low levels of an exposure signal and the sampling interval, as shown in the embodiments of this application. Figure 6 As shown, the horizontal axis represents time T, and the vertical axis represents the level V. A high or low level of an exposure signal corresponds one-to-one with a sampling interval. Specifically, at any given moment, there exists both a high level value and a low level value for the exposure signal. In some embodiments, the sampling interval is the time interval corresponding to the non-zero difference between the high and low level values of the exposure signal.
[0117] Figure 7 This application provides a schematic diagram illustrating the relationship between the high and low level difference of an exposure signal and the sampling level of correlated double sampling, as shown in the embodiment. Figure 7 As shown, the horizontal axis represents time T, and the vertical axis represents the level V. Before time A, the time during which the difference between the high and low levels of the exposure signal is 1 within one cycle is less than the time during which the difference is 1 within one cycle after time A. Therefore, the exposure duration before time A is less than the exposure duration after time A. The sampling level of the correlated double sampler corresponding to the current input to the correlated double sampler, before time A, has a level of 0.6 for a period of time within one cycle, less than the time during which the level is 0.6 for a period of time within one cycle after time A. Furthermore, through... Figure 7It can be seen that the difference between the high and low levels of the exposure signal and the sampling level of the correlated double sampling change synchronously. Furthermore, the time interval corresponding to the maximum value of the high and low level difference of the exposure signal is the same as the time interval corresponding to the maximum value of the correlated double sampling level. In some embodiments, the time interval corresponding to the maximum value of the correlated double sampling level can be the aforementioned correlated double sampling interval, or the correlated double sampling interval that corresponds to the time interval where the correlated double sampling level is greater than the target value. In this way, the correlated double sampling interval can change immediately according to the change in exposure time, avoiding the situation where the correlated double sampling interval changes untimely, resulting in the inability to effectively eliminate fixed-pattern noise.
[0118] In the embodiments of this application, the sampling frequency of the related double sampling is different for different exposure durations; the width of the sampling interval is different for different exposure durations.
[0119] Figure 8 A schematic diagram of the sampling frequency of a correlated double sampling method provided in an embodiment of this application is shown below. Figure 8 As shown, the horizontal axis represents time T, and the vertical axis represents frequency Hz. The sampling frequency of the correlation double sampling between time B and time C is 600 Hz. In some embodiments, the sampling frequency of 600 Hz for the correlation double sampling may correspond to a specific exposure duration, or it may correspond to a specific exposure mode and a specific exposure duration. Correlation double sampling is performed between time B and time C.
[0120] Figure 9 This is a schematic diagram of a DC-DC converter provided in an embodiment of this application, as shown below. Figure 9 As shown, the DC-DC converter 13 includes an SDL port (corresponding to the SDL pin), an SCL port (corresponding to the SCL pin), a GPIO (corresponding to the enable (ENable, EN) pin), a voltage input port (corresponding to the VIN pin), a voltage output port (corresponding to the VOUT pin), an FB port (corresponding to the FB pin), and a ground port (corresponding to the GND pin).
[0121] The voltage input port is used to receive the voltage VPH input from the power supply device.
[0122] The processing unit controls the pulse width modulation frequency of the DC-DC converter 13 to switch from the third frequency to the fourth frequency through the serial data link port and the serial clock link port.
[0123] In some embodiments, the voltage input port can be grounded (GND) via capacitor C.
[0124] In some embodiments, the voltage output port can be connected to the first terminal of inductor L, and the second terminal of inductor L can be connected to the image sensor. In some embodiments, the feedback port is connected to the first terminal of a first resistor R1, the second terminal of the first resistor R1 is connected to the first terminal of a second resistor R2, and the second terminal of the second resistor R2 is connected to the second terminal of inductor L. In some embodiments, the ground port is connected to the second terminal of the first resistor R1, and the ground port is also grounded (GND).
[0125] During implementation, the DC-DC converter 13 is controlled via an integrated circuit bus (I2C) (i.e., the SDL and SCL ports mentioned above), enabling real-time frequency adjustment. Here, capacitor C can be a filter capacitor, inductor L can be an output inductor, and the first resistor R1 and the second resistor R2 can be voltage divider resistors, controlling the voltage Vout output to the image sensor. In this embodiment, by adding I2C to the DC-DC converter 13, the pulse width modulation frequency of the DC-DC converter 13 can be controlled via I2C. Thus, by using the sampling frequency of the relevant dual sampling unit acquired in real-time by the processing unit to control the pulse width modulation frequency of the DC-DC converter 13 in real-time, the additional noise problem caused by exposure mode switching (e.g., DOL switching) and / or exposure duration switching is solved.
[0126] Figure 10 A flowchart illustrating a method for adjusting the pulse width modulation frequency provided in this application embodiment is shown below. Figure 10 As shown, the method includes:
[0127] S1001, Obtain the corresponding relationship.
[0128] This correspondence can be the correspondence established in S506 above.
[0129] S1002 The processing unit controls the pulse width modulation (PWM) frequency of the DC-DC converter via I2C.
[0130] S1003, the processing unit synchronously adjusts the input voltage.
[0131] For example, when the PWM frequency switches from a third frequency to a fourth frequency, the processing unit is further configured to determine the second input voltage of the DC-DC converter corresponding to the fourth frequency based on the third frequency, the fourth frequency, and the first input voltage of the DC-DC converter corresponding to the third frequency, and control the voltage input to the DC-DC converter to be the second input voltage; wherein, the output voltage of the DC-DC converter corresponding to the first input voltage is the same as the output voltage of the DC-DC converter corresponding to the second input voltage.
[0132] During implementation, the input voltage equals the output voltage multiplied by the PWM duty cycle. When the PWM frequency changes, the corresponding PWM duty cycle also changes, requiring the input voltage to be adjusted synchronously to ensure a constant output voltage and thus guarantee output voltage stability.
[0133] S1004, The feedback unit determines whether the objective value of at least one image is less than or equal to 20.
[0134] If S1004 is negative, return to S1002; if S1004 is positive, execute S1005.
[0135] S1005, The feedback unit determines that the sampling frequency of the correlated double sampling is synchronized with the pulse width modulation frequency.
[0136] In this embodiment, the PWM frequency of the DC-DC converter is adjusted via I2C based on the acquired correspondence, and the input voltage is simultaneously adjusted to ensure that the output voltage matches the PWM frequency. Then, power noise feedback is added (this is achieved by taking five consecutive raw images, which can be analyzed using dedicated software tools. The objective value is the result calculated by the software; 20 dB is a minimum standard derived from testing). If the objective value is less than or equal to 20, the synchronization logic is recorded to confirm frequency synchronization. If it is greater than 20, the synchronization logic needs further optimization. The optimization focuses on the error between the PWM frequency and the CDS frequency; the smaller the error, the better the performance.
[0137] In this embodiment, noise frequency optimization is performed based on the DOL working principle, thereby improving system performance. This embodiment also proposes a hardware and software synchronous noise optimization scheme and related circuit designs to address the noise problem at its root.
[0138] Figure 11 This is a schematic diagram of the hardware entity of a terminal device provided in an embodiment of this application, such as... Figure 11 As shown, the hardware entity of the terminal device 110 includes: the electronic device 10 described in any of the above-mentioned claims.
[0139] Figure 12 This is a schematic diagram of the hardware entity of another terminal device provided in an embodiment of this application, such as... Figure 12 As shown, the hardware entity of the terminal device 110 includes a processor 1101 and a memory 1102, wherein the memory 1102 is used to store computer programs, and the processor 1101 is used to call and run the computer programs stored in the memory 1102, so that the terminal device executes the method of implementing any of the above embodiments.
[0140] The memory 1102 stores computer programs that can run on the processor. The memory 1102 is configured to store instructions and applications that can be executed by the processor 1101. It can also cache data to be processed or already processed by the processor 1101 and the various modules in the terminal device 110 (e.g., image data, audio data, voice communication data and video communication data). It can be implemented by flash memory or random access memory (RAM).
[0141] When processor 1101 executes a program, it implements the frequency control method steps described above. Processor 1101 typically controls the overall operation of terminal device 110.
[0142] In any embodiment of this application, the processor may be the processing unit described above.
[0143] This application provides a computer storage medium storing one or more programs that can be executed by one or more processors to implement the steps of the frequency control method as described in any of the above embodiments.
[0144] It should be noted that the descriptions of the storage medium and device embodiments above are similar to the descriptions of the method embodiments above, and have similar beneficial effects. For technical details not disclosed in the storage medium and device embodiments of this application, please refer to the descriptions of the method embodiments of this application for understanding.
[0145] The aforementioned electronic device, its various units, or processors may include one or more of the following integrated components: a general-purpose processor, an application-specific integrated circuit (ASIC), a digital signal processor (DSP), a digital signal processing device (DSPD), a programmable logic device (PLD), a field-programmable gate array (FPGA), a central processing unit (CPU), a graphics processing unit (GPU), an embedded neural network processing unit (NPU), a controller, a microcontroller, a microprocessor, a programmable logic device, a discrete gate or transistor logic device, or a discrete hardware component. It is understood that the electronic device implementing the above-mentioned processor functions may also be other types, and this application embodiment does not specifically limit its capabilities. The electronic device, its various units, or processors may implement or execute the methods, steps, and logic block diagrams disclosed in the embodiments of this application. The general-purpose processor may be a microprocessor or any conventional processor, etc. The steps of the method disclosed in the embodiments of this application can be directly manifested as being executed by a hardware decoding processor, or executed by a combination of hardware and software modules in the decoding processor. The software modules can reside in random access memory, flash memory, read-only memory, programmable read-only memory, electrically erasable programmable memory, registers, or other mature storage media in the art. This storage medium is located in memory, and the processor reads information from the memory and, in conjunction with its hardware, completes the steps of the above method.
[0146] It is understood that the memory or computer storage medium in the embodiments of this application can be volatile memory or non-volatile memory, or may include both volatile and non-volatile memory. The non-volatile memory can be read-only memory (ROM), programmable read-only memory (PROM), erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), or flash memory. The volatile memory can be random access memory (RAM), which is used as an external cache. By way of example, but not limitation, many forms of RAM are available, such as Static Random Access Memory (SRAM), Dynamic Random Access Memory (DRAM), Synchronous DRAM (SDRAM), Double Data Rate SDRAM (DDR SDRAM), Enhanced Synchronous DRAM (ESDRAM), Synchlink DRAM (SLDRAM), and Direct Rambus RAM (DR RAM). It should be noted that the memory used in the systems and methods described herein is intended to include, but is not limited to, these and any other suitable types of memory.
[0147] It should be understood that the phrases "an embodiment," "an embodiment," "an embodiment of this application," "the foregoing embodiment," "some implementations," or "some embodiments" mentioned throughout the specification mean that a specific feature, structure, or characteristic related to the embodiment is included in at least one embodiment of this application. Therefore, the phrases "an embodiment," "an embodiment," "an embodiment of this application," "the foregoing embodiment," "some implementations," or "some embodiments" appearing throughout the specification do not necessarily refer to the same embodiment. Furthermore, these specific features, structures, or characteristics can be combined in any suitable manner in one or more embodiments. It should be understood that in the various embodiments of this application, the sequence numbers of the above-described processes do not imply a sequential order of execution; the execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of this application. The sequence numbers of the above-described embodiments of this application are merely descriptive and do not represent the superiority or inferiority of the embodiments.
[0148] Unless otherwise specified, any step in the embodiments of this application performed by the terminal device may be executed by the terminal device's processor. Unless otherwise specified, the embodiments of this application do not limit the order in which the terminal device performs the following steps. Furthermore, the methods used to process data in different embodiments may be the same or different methods. It should also be noted that any step in the embodiments of this application can be executed independently by the terminal device; that is, when the terminal device performs any step in the above embodiments, it may not depend on the execution of other steps.
[0149] Furthermore, the terms "first" and "second" are used for descriptive purposes only and should not be construed as indicating or implying relative importance or implicitly specifying the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of the stated features. In the description of this application, "a plurality of" means two or more, unless otherwise explicitly specified.
[0150] In the description of this application, it should be noted that, unless otherwise expressly specified and limited, the terms "installation," "connection," and "linking" should be interpreted broadly. For example, they can refer to a fixed connection, a detachable connection, or an integral connection; they can refer to a mechanical connection, an electrical connection, or a connection that allows communication between them; they can refer to a direct connection or an indirect connection through an intermediate medium; they can refer to the internal communication between two components or the interaction between two components. Those skilled in the art can understand the specific meaning of the above terms in this application according to the specific circumstances.
[0151] In the several embodiments provided in this application, it should be understood that the disclosed electronic devices, apparatuses, and methods can be implemented in other ways. The device embodiments described above are merely illustrative. For example, the division of units is only a logical functional division, and in actual implementation, there may be other division methods, such as: multiple units or components may be combined, or integrated into another system, or some features may be ignored or not executed. In addition, the coupling, direct coupling, or communication connection between the various components shown or discussed may be through some interfaces, and the indirect coupling or communication connection between devices or units may be electrical, mechanical, or other forms.
[0152] The units described above as separate components may or may not be physically separate. The components shown as units may or may not be physical units. They may be located in one place or distributed across multiple network units. Some or all of the units may be selected to achieve the purpose of this embodiment according to actual needs.
[0153] In addition, each functional unit in the various embodiments of this application can be integrated into one processing unit, or each unit can be a separate unit, or two or more units can be integrated into one unit; the integrated unit can be implemented in hardware or in the form of hardware plus software functional units.
[0154] The methods disclosed in the several method embodiments provided in this application can be arbitrarily combined without conflict to obtain new method embodiments.
[0155] The features disclosed in the several product embodiments provided in this application can be arbitrarily combined without conflict to obtain new product embodiments.
[0156] The features disclosed in the several method or device embodiments provided in this application can be arbitrarily combined without conflict to obtain new method or device embodiments.
[0157] Those skilled in the art will understand that all or part of the steps of the above method embodiments can be implemented by hardware related to program instructions. The aforementioned program can be stored in a computer storage medium. When the program is executed, it performs the steps of the above method embodiments. The aforementioned storage medium includes various media that can store program code, such as mobile storage devices, read-only memory (ROM), magnetic disks, or optical disks.
[0158] Alternatively, if the integrated units described above are implemented as software functional modules and sold or used as independent products, they can also be stored in a computer storage medium. Based on this understanding, the technical solutions of the embodiments of this application, or the parts that contribute to related technologies, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute all or part of the methods described in the various embodiments of this application. The aforementioned storage medium includes various media capable of storing program code, such as mobile storage devices, ROMs, magnetic disks, or optical disks.
[0159] In the embodiments of this application, descriptions of the same steps and contents in different embodiments can be referred to each other. In the embodiments of this application, the term "and" does not affect the order of steps. For example, if the terminal device executes A and executes B, it can mean that the terminal device executes A first and then B, or that the terminal device executes B first and then A, or that the terminal device executes A and B simultaneously.
[0160] It is worth noting that the accompanying drawings in this application are only for illustrating the schematic positions of various devices on the terminal device and do not represent their actual positions in the terminal device. The actual positions of each device or area may be changed or shifted according to the actual situation (e.g., the structure of the terminal device). Furthermore, the proportions of different parts in the terminal device in the drawings do not represent the actual proportions.
[0161] The singular forms “a,” “the,” and “the” used in the embodiments of this application and the appended claims are also intended to include the plural forms, unless the context clearly indicates otherwise.
[0162] It should be understood that the term "and / or" used in this article is merely a description of the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent: A existing alone, A and B existing simultaneously, and B existing alone. Additionally, the character " / " in this article generally indicates that the preceding and following related objects have an "or" relationship.
[0163] It should be noted that in the various embodiments involved in this application, all steps or some steps may be performed, as long as a complete technical solution can be formed.
[0164] The above description is merely an embodiment of this application, but the scope of protection of this application is not limited thereto. Any variations or substitutions that can be easily conceived by those skilled in the art within the scope of the technology disclosed in this application should be included within the scope of protection of this application. Therefore, the scope of protection of this application should be determined by the scope of the claims.
Claims
1. An electronic device, characterized in that, The electronic device includes: an image sensor, a processing unit, and a DC-DC converter; The image sensor includes a correlated double sampling unit, which is used to sample the output signal of the pixel unit in the image sensor twice within the sampling interval of each period corresponding to the sampling frequency, and perform differential sampling on the two sampled output signals to obtain a differential signal, which is used to determine the digital image signal; The processing unit is used to control the pulse width modulation frequency of the DC-DC converter to switch from a third frequency to a fourth frequency when the sampling frequency of the relevant dual sampling unit switches from a first frequency to a second frequency. The DC-DC converter is used to perform voltage conversion according to the pulse width modulation frequency and output the converted voltage to the image sensor; the absolute value of the difference between the third frequency and the first frequency is less than or equal to a first threshold, and the absolute value of the difference between the fourth frequency and the second frequency is less than or equal to a second threshold.
2. The electronic device according to claim 1, characterized in that, The related dual sampling unit is also used for: Obtain the first correspondence between the exposure mode and / or exposure duration and the sampling frequency; When the exposure mode is switched from the first exposure mode to the second exposure mode, and / or the exposure duration is switched from the first exposure duration to the second exposure duration, the sampling frequency is controlled to switch from the first frequency to the second frequency according to the first correspondence.
3. The electronic device according to claim 2, characterized in that, The related dual sampling unit is also used for: Obtain the second correspondence between sampling frequency and sampling interval; When the exposure mode is switched from the first exposure mode to the second exposure mode, and / or the exposure duration is switched from the first exposure duration to the second exposure duration, the sampling interval of each cycle corresponding to the sampling frequency is controlled to switch from the first sampling interval of each cycle corresponding to the first frequency to the second sampling interval of each cycle corresponding to the second frequency, according to the first correspondence and the second correspondence.
4. The electronic device according to claim 3, characterized in that, The related dual sampling unit is also used for: Based on at least one spectrum data corresponding to at least one exposure duration in each of the multiple exposure modes collected by the spectrum analyzer, at least one sampling frequency corresponding to each of the at least one exposure durations is determined, and based on the at least one sampling frequency corresponding to each of the at least one exposure durations, the first correspondence is determined; The second correspondence is determined based on the current value input to the image sensor for each exposure duration under each exposure mode.
5. The electronic device according to any one of claims 1 to 4, characterized in that, The DC-DC converter includes a serial data link port and a serial clock link port. The processing unit controls the pulse width modulation frequency of the DC-DC converter through the serial data link port and the serial clock link port, switching from a third frequency to a fourth frequency.
6. The electronic device according to claim 5, characterized in that, The processing unit is further configured to determine the second input voltage of the DC-DC converter corresponding to the fourth frequency based on the third frequency, the fourth frequency, and the first input voltage of the DC-DC converter corresponding to the third frequency, and control the voltage input to the DC-DC converter to be the second input voltage; The output voltage of the DC-DC converter corresponding to the first input voltage is the same as the output voltage of the DC-DC converter corresponding to the second input voltage.
7. The electronic device according to any one of claims 1 to 4, characterized in that, The electronic device further includes a feedback unit; the feedback unit is used for: When the pulse width modulation frequency of the DC-DC converter is switched from the third frequency to the fourth frequency, at least one first image is captured. Based on the fixed pattern noise value of the at least one first image, determine whether the fourth frequency meets the frequency requirements.
8. The electronic device according to claim 7, characterized in that, The feedback unit is further configured to: determine that the fourth frequency meets the frequency requirement if the fixed-pattern noise values of at least one first image are all less than or equal to a third threshold; or... The feedback unit is further configured to send an indication message to the processing unit that the fourth frequency does not meet the frequency requirement when the fixed pattern noise value of some or all of the fixed pattern noise values of the at least one first image is greater than the third threshold; the processing unit is further configured to adjust the pulse width modulation frequency of the DC-DC converter from the fourth frequency to the fifth frequency; the feedback unit is further configured to: acquire at least one captured second image when the pulse width modulation frequency of the DC-DC converter is switched from the fourth frequency to the fifth frequency; and determine that the fifth frequency meets the frequency requirement based on the fixed pattern noise value of the at least one second image.
9. A frequency control method, characterized in that, The frequency control method includes: The sampling frequency of the correlated dual sampling unit is switched from a first frequency to a second frequency. The correlated dual sampling unit is used to sample the output signal of the pixel unit in the image sensor twice within the sampling interval of each period corresponding to the sampling frequency, and to perform differential analysis on the two sampled output signals to obtain a differential signal, which is used to determine the digital image signal. The pulse width modulation frequency of the DC-DC converter is controlled to switch from a third frequency to a fourth frequency; the DC-DC converter is used to perform voltage conversion according to the pulse width modulation frequency and output the converted voltage to the image sensor; the absolute value of the difference between the third frequency and the first frequency is less than or equal to a first threshold, and the absolute value of the difference between the fourth frequency and the second frequency is less than or equal to a second threshold.
10. A terminal device, characterized in that, The terminal device includes the electronic device according to any one of claims 1 to 8, or the terminal device includes a memory and a processor, the memory being used to store a computer program, and the processor being used to call and run the computer program stored in the memory, causing the terminal device to perform the method of claim 9.
Citation Information
Patent Citations
Pulse width modulation type image sensor circuit and processing method thereof
CN107454350A
DC-DC converter, mode switching method and circuit thereof, and electronic device
CN113437870A