Signal processing method and device and electronic equipment

Abstract

The embodiment of the invention discloses a signal processing method and device and electronic equipment, and the method comprises the steps: carrying out the optical signal collection and conversion processing of a first position corresponding to a pixel group through a first pixel unit in a pixel array in a first exposure period, and obtaining M first signals; wherein the pixel array comprises the pixel groups in i rows and j columns, and each pixel group comprises one first pixel unit and one second pixel unit; m, i and j are respectively integers greater than 1; determining a second signal corresponding to the first position through a second pixel unit in the pixel group; and carrying out fusion processing on the M first signals and the second signals to obtain M image signals corresponding to the positions.

Description

Technical Field

[0001] The present disclosure relates to the field of signal processing technology, and in particular to a signal processing method, device and electronic device. Background Art

[0002] Image sensors have been widely used in digital cameras, mobile phones, medical treatment, automobiles, drones, machine recognition and other fields. In particular, the rapid development of complementary metal oxide semiconductor (CMOS) image sensor technology has led to higher requirements for the output image quality of image sensors. CMOS image sensors can be divided into two categories based on the signal acquisition method: one method is to set the exposure time of the pixel and then measure the change in voltage signal; the second method is to set the voltage change of the pixel and then measure the exposure time. Summary of the invention

[0003] Embodiments of the present disclosure provide a signal processing method, device, and electronic device.

[0004] One aspect of an embodiment of the present disclosure provides a signal processing method, including:

[0005] In a first exposure period, light signals are collected and converted at a first position corresponding to a pixel group by a first pixel unit in a pixel array to obtain M first signals; wherein the pixel array includes pixel groups of i rows and j columns, and each pixel group includes one first pixel unit and one second pixel unit; and M, i, and j are integers greater than 1 respectively;

[0006] Determine a second signal corresponding to the first position by using a second pixel unit in the pixel group;

[0007] The M first signals and the second signal are fused to obtain M image signals corresponding to the first position.

[0008] Optionally, the fusing the M first signals and the second signal to obtain M image signals corresponding to the first position includes:

[0009] Each of the M first signals is weightedly summed with the second signal to obtain M image signals; wherein the weight value corresponding to the first signal is a first weight coefficient, and the weight value corresponding to the second signal is a second weight coefficient.

[0010] Optionally, determining the second signal corresponding to the first position by using the second pixel unit includes:

[0011] In the first exposure period, the light signal at the first position is collected and converted by the second pixel unit to obtain the second signal.

[0012] Optionally, determining the second signal corresponding to the first position by using the second pixel unit includes:

[0013] In a second exposure cycle, light signals at the first position are collected and converted by a second pixel unit to obtain the second signal; wherein the second exposure cycle is the previous exposure cycle of the first exposure cycle.

[0014] Optionally, in the first exposure period, light signal collection and conversion processing are performed on the first position corresponding to the pixel group by the first pixel unit in the pixel array to obtain M first signals, including:

[0015] During the first exposure period, the first pixel unit is controlled to read out the photogenerated charge obtained based on the light signal according to the preset timing period according to the readout signal provided by the first row decoder circuit to obtain the M first signals.

[0016] Optionally, in the first exposure period, after collecting and converting the optical signal at the first position corresponding to the pixel group by the first pixel unit in the pixel array to obtain M first signals, the method further includes:

[0017] According to the first signal, the first pixel unit is controlled to perform a reset.

[0018] Optionally, the first pixel unit is a 3T pixel unit, and the second pixel unit is a 4T pixel unit;

[0019] The area of ​​the second pixel unit in the pixel group is larger than the area of ​​the first pixel unit.

[0020] Another aspect of the embodiment of the present disclosure provides a signal processing device, comprising: a pixel array, a first row decoder circuit, a second row decoder circuit, a first column processing circuit, a second column processing circuit and a signal fusion circuit; wherein the pixel array comprises pixel groups of i rows and j columns, each of the pixel groups comprises a first pixel unit and a second pixel unit;

[0021] The pixel array is used to perform optical signal conversion row by row according to the control of the first row decoder circuit and the second row decoder circuit, output the third signal output by the first pixel unit in each row to the first column processing circuit, and output the fourth signal output by the second pixel unit in each row to the second column processing circuit;

[0022] The first row decoder circuit is used to control the first pixel units in the pixel array row by row to output M third signals in one exposure period according to a preset timing cycle;

[0023] The second row decoder circuit is used to control the second pixel units in the pixel array row by row to output a fourth signal within an exposure period;

[0024] The first column processing circuit is used to receive and process M*j third signals output by the first pixel units in the pixel array in columns to obtain M*j first signals;

[0025] The second column processing circuit is used for receiving and processing j fourth signals output by the second pixel units in the pixel array in columns to obtain j second signals;

[0026] The signal fusion circuit is used to perform fusion processing on the M*j first signals and the j second signals respectively to obtain M*j image signals.

[0027] Optionally, the M*j first signals and the j second signals correspond to j pixel groups in a row;

[0028] The signal fusion circuit is specifically used to perform weighted summation between each of the M first signals and the second signal for each pixel group to obtain M image signals; wherein the weight value corresponding to the first signal is a first weight coefficient, and the weight value corresponding to the second signal is a second weight coefficient.

[0029] Optionally, it also includes: a buffer;

[0030] The buffer is used to store j second signals obtained by the second column processing circuit in a second exposure period, where the second exposure period is an exposure period before the first exposure period;

[0031] The signal fusion circuit is used to fuse the M*j first signals output by the first column processing circuit corresponding to the first exposure period with the j second signals stored in the buffer to obtain the M*j image signals corresponding to a row of the pixel groups.

[0032] Optionally, the first row decoder circuit is specifically used to provide a readout signal with a preset timing period within an exposure period, and control a row of the first pixel units to read out M*j third signals according to the preset timing period according to the readout signal.

[0033] Optionally, it also includes: an external conversion circuit;

[0034] The external conversion circuit processes the first signal output by the first pixel unit to obtain a first reset signal, and controls the first pixel unit to perform reset according to the first reset signal and a first control signal provided by the first row decoder circuit.

[0035] Optionally, the first row decoder circuit provides the first control signal at the end of an exposure period, and controls the first reset signal provided by the external conversion circuit to be input into the first pixel unit through the first control signal;

[0036] The second row decoder circuit provides a second reset signal at the end of an exposure period, and controls the second pixel unit to perform reset through the second reset signal.

[0037] Optionally, the first pixel unit is a 3T pixel unit, and the second pixel unit is a 4T pixel unit;

[0038] The area of ​​the second pixel unit in the pixel group is larger than the area of ​​the first pixel unit.

[0039] According to another aspect of the embodiments of the present disclosure, there is provided an electronic device, comprising: a processor, and a memory communicatively connected to the processor, and further comprising the signal processing device according to any one of the above embodiments;

[0040] The memory stores computer-executable instructions;

[0041] The processor executes the computer-executable instructions stored in the memory to control the timing signal processing device to implement the signal processing method described in any of the above embodiments.

[0042] Optionally, the electronic device is included in any one of the following: image data acquisition equipment, audio / video player, navigation equipment, entertainment equipment, communication equipment, roadside traffic facilities, equipment in motor vehicles, industrial inspection equipment, flight equipment, medical equipment, security equipment.

[0043] Based on the signal processing method, device and electronic device provided by the above-mentioned embodiments of the present disclosure, in the first exposure period, the light signal is collected and converted by the first pixel unit in the pixel array for the first position corresponding to the pixel group to obtain M first signals; wherein, the pixel array includes the pixel groups of i rows and j columns, and each of the pixel groups includes one first pixel unit and one second pixel unit; the M, i, and j are integers greater than 1 respectively; the second signal corresponding to the first position is determined by the second pixel unit in the pixel group; the M first signals and the second signals are fused to obtain M image signals corresponding to the positions. This embodiment fuses the M first signals with the second signals, so that the output image signal combines the advantages of the first pixel unit and the second pixel unit, and at the same time has a high dynamic range and a high frame rate, thereby solving the problem of blurring of images of high-speed moving objects collected by high dynamic range image sensors in the prior art.

[0044] The technical solution of the present disclosure is further described in detail below through the accompanying drawings and embodiments. BRIEF DESCRIPTION OF THE DRAWINGS

[0045] The accompanying drawings, which constitute a part of the specification, illustrate embodiments of the present disclosure and, together with the description, serve to explain the principles of the present disclosure.

[0046] The present disclosure may be more clearly understood from the following detailed description with reference to the accompanying drawings, in which:

[0047] Figure 1 A flowchart of a signal processing method provided in an optional embodiment of the present disclosure;

[0048] Figure 2 A schematic structural diagram of a first pixel unit in a signal processing method provided in an optional embodiment of the present disclosure;

[0049] Figure 3 A schematic structural diagram of a first pixel unit in a signal processing method provided in an optional embodiment of the present disclosure;

[0050] Figure 4a A schematic diagram of the distribution of the second pixel unit and the first pixel unit in an optional example provided by the present disclosure;

[0051] Figure 4b Based on Figure 4a A schematic diagram of the distribution of a pixel array obtained by the pixel group shown;

[0052] Figure 5 A schematic diagram of a photoelectric response curve of a pixel signal acquired by an image sensor of a signal processing method provided in an optional embodiment of the present disclosure;

[0053] Figure 6A schematic diagram of the structure of a signal processing device provided in an optional embodiment of the present disclosure;

[0054] Figure 7 This is a schematic diagram of frame rates corresponding to the first pixel unit and the second pixel unit when signals are read out in an optional example of the present disclosure;

[0055] Figure 8 The figure is a schematic diagram of the structure of an application embodiment of the electronic device disclosed in the present invention. DETAILED DESCRIPTION

[0056] Various exemplary embodiments of the present disclosure will now be described in detail with reference to the accompanying drawings. It should be noted that the relative arrangement of components and steps, numerical expressions and numerical values ​​set forth in these embodiments do not limit the scope of the present disclosure unless otherwise specifically stated.

[0057] Those skilled in the art can understand that the terms "first" and "second" in the embodiments of the present disclosure are only used to distinguish different steps, devices or modules, etc., and neither represent any specific technical meaning nor indicate the necessary logical order between them.

[0058] It should also be understood that in the embodiments of the present disclosure, “plurality” may refer to two or more than two, and “at least one” may refer to one, two, or more than two.

[0059] It should also be understood that any component, data or structure mentioned in the embodiments of the present disclosure can generally be understood as one or more, unless explicitly limited or otherwise indicated in the context.

[0060] In addition, the term "and / or" in the present disclosure is only a description of the association relationship of associated objects, indicating that three relationships may exist. For example, A and / or B can represent: A exists alone, A and B exist at the same time, and B exists alone. In addition, the character " / " in the present disclosure generally indicates that the associated objects before and after are in an "or" relationship.

[0061] It should also be understood that the description of the various embodiments in the present disclosure focuses on the differences between the various embodiments, and the same or similar aspects thereof can be referenced to each other, and for the sake of brevity, they will not be described one by one.

[0062] At the same time, it should be understood that for the convenience of description, the sizes of the various parts shown in the drawings are not drawn according to the actual proportional relationship.

[0063] The following description of at least one exemplary embodiment is merely illustrative in nature and is in no way intended to limit the present disclosure, its application, or uses.

[0064] Technologies, methods, and equipment known to ordinary technicians in the relevant art may not be discussed in detail, but where appropriate, the technologies, methods, and equipment should be considered as part of the specification.

[0065] It should be noted that like reference numerals and letters refer to similar items in the following figures, and therefore, once an item is defined in one figure, it need not be further discussed in subsequent figures.

[0066] The embodiments of the present disclosure can be applied to electronic devices such as terminal devices, computer systems, servers, etc., which can operate with many other general or special computing system environments or configurations. Examples of well-known terminal devices, computing systems, environments and / or configurations suitable for use with electronic devices such as terminal devices, computer systems, servers, etc. include, but are not limited to: personal computer systems, server computer systems, thin clients, thick clients, handheld or laptop devices, microprocessor-based systems, set-top boxes, programmable consumer electronics, network personal computers, small computer systems, large computer systems, and distributed cloud computing technology environments including any of the above systems, etc.

[0067] Electronic devices such as terminal devices, computer systems, servers, etc. can be described in the general context of computer system executable instructions (such as program modules) executed by computer systems. Generally, program modules can include routines, programs, object programs, components, logic, data structures, etc., which perform specific tasks or implement specific abstract data types. Computer systems / servers can be implemented in a distributed cloud computing environment, where tasks are performed by remote processing devices linked through a communication network. In a distributed cloud computing environment, program modules can be located on local or remote computing system storage media including storage devices.

[0068] In the process of implementing the present disclosure, the inventors discovered that CMOS image sensors can be divided into two categories based on the signal acquisition method: one method is to set the exposure time for the pixel and then measure the change in voltage signal, such as the 4T pixel unit reading signal architecture; the second method is to set the voltage change for the pixel and then measure the exposure time, such as the 3T pixel unit reading signal architecture.

[0069] The 4T pixel unit of the prior art can be applied to a high dynamic range (HDR) image sensor. The frame rate of an HDR image sensor of this structure is generally not high, for example, 30 frames per second. Therefore, when capturing high-speed moving objects, the image may be blurred.

[0070] Figure 1 FIG. 1 is a flow chart of a signal processing method provided by an optional embodiment of the present disclosure. Figure 1As shown, the method of this embodiment includes:

[0071] Step 102 : In a first exposure period, light signals are collected and converted from a first position corresponding to a pixel group by a first pixel unit in a pixel array to obtain M first signals.

[0072] Optionally, this embodiment is generally used in a circuit with a pixel array as the main structure, wherein the pixel array includes a pixel group of i rows and j columns, each pixel group includes a first pixel unit and a second pixel unit; M, i, j are integers greater than 1 respectively.

[0073] Optionally, the first pixel unit and the second pixel unit are pixel units with different structures. For example, the first pixel unit is a pixel unit with a high frame rate, and the second pixel unit is a pixel unit with a high dynamic range. This embodiment integrates a first pixel unit and a second pixel unit in each pixel group to obtain high frame rate information and high dynamic range information respectively.

[0074] Step 104: determine a second signal corresponding to the first position through a second pixel unit in the pixel group.

[0075] In this embodiment, within one exposure cycle, the first pixel unit can collect light signals to obtain M first signals, while the second pixel unit can only obtain one second signal within one exposure cycle, thereby realizing light signal collection at different frame rates, and one pixel group in the pixel frame rate corresponds to one position, therefore, the M first signals collected by the first pixel unit in the pixel group and the second signal collected by the second pixel unit correspond to light signals at the same position.

[0076] Optionally, the second signal may be acquired during the first exposure period, or the second signal may be acquired during an exposure period before the first exposure period.

[0077] Step 106: perform fusion processing on the M first signals and the second signal to obtain M image signals corresponding to the first position.

[0078] In this embodiment, the second signal of the first signal corresponds to different frame rates and different dynamic ranges. By fusing M first signals and second signals, the advantages of the first pixel unit and the second pixel unit are combined, and the signal with a high frame rate and the signal with a high dynamic range are fused. The fused image signal has the advantages of both high frame rate and high dynamic range.

[0079] Optionally, each of the M first signals may be fused with the second signal to obtain M image signals.

[0080] The signal processing method, device and electronic device provided by the above-mentioned embodiments of the present disclosure, in the first exposure period, collects and converts the light signal of the first position corresponding to the pixel group through the first pixel unit in the pixel array to obtain M first signals; wherein, the pixel array includes the pixel groups of i rows and j columns, and each of the pixel groups includes one first pixel unit and one second pixel unit; the M, i, and j are integers greater than 1 respectively; the second signal corresponding to the first position is determined by the second pixel unit in the pixel group; the M first signals and the second signals are fused to obtain M image signals corresponding to the positions. This embodiment fuses the M first signals with the second signals, so that the output image signal combines the advantages of the first pixel unit and the second pixel unit, and at the same time has a high dynamic range and a high frame rate, thereby solving the problem of blurring of images of high-speed moving objects collected by high dynamic range image sensors in the prior art.

[0081] In some optional embodiments, step 106 may include:

[0082] Each of the M first signals is weightedly summed with the second signal to obtain M image signals.

[0083] The weight value corresponding to the first signal is the first weight coefficient, and the weight value corresponding to the second signal is the second weight coefficient.

[0084] In this embodiment, the first weight coefficient and the second weight coefficient can be preset values. For example, the first weight coefficient and the second weight coefficient are set according to empirical values, and the specific values ​​of the first weight coefficient and the second weight coefficient are written into the circuit that implements signal fusion processing; the first signal and the second signal are combined as needed in the image signal through weighted summation. In addition, since the output period corresponding to the second signal is longer than the output period of the first signal, if the weight is not increased for adjustment, the proportion of the second signal may be too high, affecting the frame rate of the image signal.

[0085] In some optional embodiments, step 104 may include:

[0086] In the first exposure period, the light signal at the first position is collected and converted by the second pixel unit to obtain a second signal.

[0087] At this time, the corresponding fusion processing in step 106 can determine the image signal based on the following formula (1):

[0088] Sig_N X = K1*S 1NX +K2*S 2N Formula (1)

[0089] Wherein, X is a natural number, ranging from 1 to M, and different values ​​represent one of the M image signals and the corresponding first signal; N represents the Nth exposure cycle, for example, the first exposure cycle in the above embodiment; S 1NX represents the Xth of the M first signals generated by the first pixel unit in the Nth exposure cycle; S 2N represents the second signal generated by the second pixel unit in the Nth exposure cycle; K1 represents the first weighting coefficient, K2 represents the second weighting coefficient; Sig_N X Represents the Xth of M image signals.

[0090] In this embodiment, each of the M first signals is fused with the second signal obtained in the same exposure period to obtain an image signal. Since the second signal corresponding to the first exposure period can be output only after the first exposure period ends, this embodiment can only start outputting the image signal corresponding to the first exposure period after the first exposure period ends. Although there is a certain time delay, the image signal combines the first signal and the second signal in the same exposure period, so a more accurate image signal can be obtained.

[0091] In some other optional embodiments, step 104 may include:

[0092] In the second exposure period, the light signal at the first position is collected and converted by the second pixel unit to obtain the second signal.

[0093] The second exposure cycle is the previous exposure cycle of the first exposure cycle.

[0094] At this time, the corresponding fusion processing in step 106 can determine the image signal based on the following formula (2):

[0095] Sig_N X =K1*S 1NX +K2*S 2(N-1) Formula (2)

[0096] Wherein, X is a natural number ranging from 1 to M, and different values ​​represent one of the M image signals and the corresponding first signal; N represents the Nth exposure cycle, for example, the first exposure cycle in the above embodiment; N-1 represents the N-1th exposure cycle, for example, the second exposure cycle in the above embodiment; S 1NX represents the Xth of the M first signals generated by the first pixel unit in the Nth exposure cycle; S 2(N-1) represents the second signal generated by the second pixel unit in the N-1th exposure cycle; K1 represents the first weighting coefficient, K2 represents the second weighting coefficient; Sig_N X Represents the Xth of M image signals.

[0097] In this embodiment, the M first signals obtained in the first exposure period are fused with the second signals obtained in the second exposure period respectively. Therefore, in the first exposure period, only one first signal needs to be generated to realize signal fusion. The fusion operation of the above formula (2) can be performed synchronously with the generation of the first signal. In the first exposure period, an image signal corresponding to any first signal obtained in the first exposure period can be obtained in real time. The advantage is that the output is in real time without any delay problem.

[0098] In some optional embodiments, step 102 may include:

[0099] In the first exposure period, the first pixel unit is controlled to read out the photogenerated charge obtained based on the light signal according to the preset timing period according to the readout signal provided by the first row decoder circuit to obtain M first signals.

[0100] In this embodiment, the first pixel unit can be a pixel unit that measures the exposure time according to the voltage change, and is used to realize signal acquisition at a high frame rate. In this embodiment, the reading of the first signal is controlled by a readout signal. Whenever a high-level readout signal is received, a first signal is output, and an exposure cycle is divided into M preset timing cycles according to the readout signal. In one exposure cycle, although the first signal is read out multiple times, the first pixel unit is not reset when the first to M-1 first signals are output. Only when the Mth first signal is output, the first pixel unit is reset. Optionally, after step 102, the first pixel unit is controlled to be reset according to the first signal. By reading the first signal multiple times, signal acquisition at a high frame rate is realized. In addition, the number of first signals output in one exposure cycle can be adjusted according to the requirements for image details. For example, when it is desired to obtain a clearer image with more details, the value of M is set to a larger value.

[0101] In some optional embodiments, the first pixel unit is a 3T pixel unit, and the second pixel unit is a 4T pixel unit. Optionally, the first pixel unit is a 3T pixel unit of any existing structure, and the second pixel unit is a 4T pixel unit of any existing structure.

[0102] Figure 2 FIG. 1 is a schematic diagram of the structure of a first pixel unit in a signal processing method provided in an optional embodiment of the present disclosure. Figure 2 As shown, the first pixel unit in this embodiment mainly includes a first photodiode 201, a first reset transistor 202, a first source follower transistor 203, a first pixel selection transistor 204, and a first auxiliary transistor 205 and a second auxiliary transistor 206.

[0103] Among them, one end of the first photodiode 201 is grounded, and the other end of the first photodiode 201 is connected to the drain end of the first reset transistor 202 and the gate end of the first source follower transistor 203. The source end of the first reset transistor 202 is connected to the power supply signal Vdd, and the gate end of the first reset transistor 202 is connected to the source end of the first auxiliary transistor 205 and the source end of the second auxiliary transistor 206. The gate end of the first source follower transistor 203 is connected to the other end of the first photodiode 201 and the drain end of the first reset transistor 202, and is used to generate a first voltage signal according to the charge change in the first photodiode 201; the source end of the first source follower transistor 203 is connected to the power supply signal Vdd, and the drain end of the first source follower transistor 203 is connected to the drain end of the first pixel selection transistor 204. The gate of the first pixel selection transistor 204 receives the first readout signal input from the outside, and the source end of the first pixel selection transistor 204 serves as the output end of the first pixel unit. In response to the first readout signal being at a high level, the first voltage signal corresponding to the first source follower transistor 203 is output through the output end.

[0104] The source terminal of the first auxiliary crystal 205 is connected to the gate terminal of the first reset transistor 202 and the source terminal of the second auxiliary transistor 206; the drain terminal of the first auxiliary crystal 205 is connected to the first reset signal. The first reset signal in this embodiment can be a first voltage signal output by the first pixel unit or a conversion signal obtained by processing the first voltage signal; the gate terminal of the first auxiliary crystal 205 receives a first control signal input from the outside. In response to the first control signal being at a high level, the first auxiliary crystal 205 is turned on, and the first reset signal is connected to the gate terminal of the first reset transistor 202, so that the first reset transistor 202 is turned on, thereby resetting the first photodiode 201.

[0105] The source terminal of the second auxiliary transistor 206 is connected to the gate terminal of the first reset transistor 202 and the source terminal of the first auxiliary crystal 205; the drain terminal of the second auxiliary transistor 206 is grounded; the gate terminal of the second auxiliary transistor 206 receives a second control signal input from the outside, and in response to the second control signal being a high level, the second auxiliary transistor 206 is turned on, so that the gate of the first auxiliary crystal 205 is grounded, that is, the first auxiliary crystal 205 is disconnected, and the first photodiode 201 does not perform reset.

[0106] Figure 3 FIG. 1 is a schematic diagram of the structure of a first pixel unit in a signal processing method provided in an optional embodiment of the present disclosure. Figure 3As shown, the second pixel unit in this embodiment mainly includes: a second photodiode 301 , a charge transfer transistor 302 , a second reset transistor 303 , a second source follower transistor 304 and a second pixel selection transistor 305 .

[0107] One end of the second photodiode 301 is grounded, and the other end of the second photodiode 301 is connected to the drain end of the charge transfer transistor 302. The source end of the charge transfer transistor 302 is connected to the drain end of the second reset transistor 303 and the gate end of the second source follower transistor 304; the gate end of the charge transfer transistor 302 is connected to the external input conduction signal, and in response to the conduction signal being at a high level, the other end of the second photodiode 301 is connected to the drain end of the second reset transistor 303 and the gate end of the second source follower transistor 304 to achieve charge output and reset control. The source end of the second reset transistor 303 is connected to the power supply signal Vdd, and the drain end of the second reset transistor 303 is connected to the source end of the charge transfer transistor 302 and the gate end of the second source follower transistor 304; the gate end of the second reset transistor 303 receives the external input second reset signal, and in response to the second reset signal being at a high level, the second reset transistor 303 is turned on, and if the charge transfer transistor 302 is turned on at the same time at this time, the reset of the second photodiode 301 is achieved.

[0108] The source terminal of the second source follower transistor 304 is connected to the power supply signal Vdd, the drain terminal of the second source follower transistor 304 is connected to the drain terminal of the second pixel selection transistor 305, and the gate terminal of the second source follower transistor 304 is connected to the source terminal of the charge transfer transistor 302, and is used to generate a second voltage signal according to the charge change rate in the second photodiode 301.

[0109] The gate of the second pixel selection transistor 305 receives a second readout signal input externally, and the source terminal of the second pixel selection transistor 305 serves as the output terminal of the second pixel unit. In response to the second readout signal being at a high level, the second voltage signal corresponding to the second source follower transistor 304 is output through the output terminal.

[0110] Generally, the 4T pixel unit is used to collect light signals with weak light intensity, so the area of ​​the second pixel unit in the pixel group provided in this embodiment is larger than the area of ​​the first pixel unit. For example, the area ratio of the second pixel unit to the first pixel unit is 2:1, or 3:1, etc.

[0111] Since the light intensity of the weak light signal is relatively weak, if the second pixel unit has the same area as the first pixel unit or is smaller than the first pixel unit, it may result in that when the exposure period is reached, the second pixel unit does not collect enough photogenerated charge, resulting in less information in the image signal and a blurred image. A large pixel unit area can increase the photosensitivity. In this embodiment, the area of ​​the second pixel unit is increased to enable better collection of weak light signals. In an optional example, the distribution of the second pixel unit and the first pixel unit in a pixel group is as follows: Figure 4a Based on Figure 4a The pixel group shown can be obtained as Figure 4b The pixel array shown.

[0112] In an optional embodiment, a schematic diagram of a photoelectric response curve of a pixel signal acquired by an image sensor using the signal processing method provided by the embodiment of the present disclosure is as follows: Figure 5 As shown, Figure 5 The horizontal axis is exposure energy (exposure capacity is equal to exposure time multiplied by light intensity), and the vertical axis is signal strength. When the first signal and the second signal are digital signals, it represents the value of the digital signal, and the value of the digital signal represents the brightness value of the corresponding position; at this time, the image signal is obtained based on the weighted sum of the first signal and the second signal, so the image signal is also a digital signal. Figure 5 The curve relationship between the three pixel signals and the pixel exposure energy is shown. The highest resolution light energy of the second signal (4T pixel signal) is E1, and the highest resolution light energy of the first signal (3T pixel signal) is E2. Therefore, the dynamic range of the fused image signal in the embodiment of the present disclosure is expanded from the highest resolution light energy of the second signal E1 to the highest resolution light energy of the first signal E2, achieving the advantage of expanding the acquisition of strong light images while keeping the image information in the dark environment clearly visible.

[0113] Any signal processing method provided in the embodiments of the present disclosure may be executed by any appropriate device with data processing capabilities, including but not limited to: a terminal device and a server, etc. Alternatively, any signal processing method provided in the embodiments of the present disclosure may be executed by a processor, such as a processor executing any signal processing method mentioned in the embodiments of the present disclosure by calling corresponding instructions stored in a memory. This will not be described in detail below.

[0114] A person of ordinary skill in the art can understand that all or part of the steps of implementing the above method embodiment can be completed by hardware related to program instructions, and the aforementioned program can be stored in a computer-readable storage medium. When the program is executed, it executes the steps of the above method embodiment; and the aforementioned storage medium includes: ROM, RAM, magnetic disk or optical disk, etc., various media that can store program codes.

[0115] Figure 6This is a schematic diagram of the structure of a signal processing device provided by an optional embodiment of the present disclosure. Figure 6 As shown, the signal processing device provided by this embodiment includes: a pixel array 61, a first row decoder circuit 62, a second row decoder circuit 63, a first column processing circuit 64, a second column processing circuit 65 and a signal fusion circuit 66.

[0116] The pixel array 61 includes pixel groups 611 with i rows and j columns, and each pixel group 611 includes a first pixel unit and a second pixel unit. Optionally, the pixel group 611 may be a structure as shown in FIG. 4 , and the circuit structure of the first pixel unit and the second pixel unit may refer to the above Figure 2 and Figure 3 The circuit structure shown.

[0117] The pixel array 61 is used to convert optical signals row by row according to the control of the first row decoder circuit 62 and the second row decoder circuit 63, output the third signal output by the first pixel unit of each row to the first column processing circuit, and output the fourth signal output by the second pixel unit of each row to the second column processing circuit.

[0118] The first row decoder circuit 62 is used for controlling the first pixel units in the pixel array 61 row by row to output M third signals in one exposure period according to a preset timing cycle.

[0119] The second row decoder circuit 63 is used to control the second pixel units in the pixel array 61 row by row to output a fourth signal within an exposure period.

[0120] In order to distinguish the first row decoder circuit 62 from the second row decoder circuit 63 and facilitate wiring, the first row decoder circuit 62 and the second row decoder circuit 63 may be respectively arranged at both sides of the pixel array.

[0121] The first column processing circuit 64 is used for receiving and processing M*j third signals output by the first pixel units in the pixel array 61 in columns to obtain M*j first signals.

[0122] In this embodiment, the first column processing circuit 64 corresponds to the first pixel unit in the pixel array 61, the first pixel unit in each column of the pixel group outputs M third signals, and processes each third signal respectively. For example, the third signal is a voltage signal, and the first signal obtained after processing is a pulse signal or a digital signal; optionally, when the first signal is a digital signal, it can be a pixel brightness value expressed by a multi-bit binary value. For example, the first signal is 01001001, indicating that the brightness value of the position corresponding to the pixel group is 145 (the brightness value range is 0-255).

[0123] The second column processing circuit 65 is used for receiving and processing j fourth signals output by the second pixel units in the pixel array 61 in columns to obtain j second signals.

[0124] In this embodiment, the second column processing circuit 65 corresponds to the second pixel unit in the pixel array 61, the fourth signal output by the second pixel unit in each column pixel group, and processes each fourth signal respectively. For example, the fourth signal is a voltage signal, and the second signal obtained after processing is a pulse signal or a digital signal. In this embodiment, the first column processing circuit 64 and the second column processing circuit 65 perform the same processing on the signal, and the output first signal and the second signal are also signals of the same type, so as to facilitate signal fusion processing.

[0125] The signal fusion circuit 66 is used to fuse the M*j first signals and the j second signals respectively to obtain M*j image signals.

[0126] Optionally, the signal fusion circuit 66 performs fusion processing on the M first signals and one second signal corresponding to each column in the j columns respectively. Specifically, each of the M first signals may be fused with the second signal to obtain M image signals.

[0127] In the present embodiment, a pixel group consisting of a first pixel unit and a second pixel unit is used to replace a single pixel unit in the prior art, and each pixel group corresponds to an image position, so that the advantages of the first pixel unit and the second pixel unit are combined, and the signal with a high frame rate and the signal with a high dynamic range are fused. The fused image signal has the advantages of both a high frame rate and a high dynamic range.

[0128] In order to achieve the advantages of both high frame rate and high dynamic range, an image sensor using the signal processing device provided by the embodiment of the present disclosure adopts a 3T pixel unit as the first pixel unit and a 4T pixel unit as the second pixel unit. At this time, the pixel groups in the pixel array respectively generate 4T pixel signals (corresponding to the second signal in the above embodiment) and 3T pixel signals (corresponding to the first signal in the above embodiment), wherein the 4T pixel signal is an image signal for a weak light part, and the 3T pixel signal is an image signal for a strong light part. The two signals are fused in a signal fusion circuit, and the information of the first signal and the second signal are fused to output a fused image signal with a high dynamic range.

[0129] In some optional embodiments, the M*j first signals and the j second signals correspond to j pixel groups in a row.

[0130] The signal fusion circuit 66 is specifically configured to perform weighted summation between each first signal in the M first signals and the second signal for each pixel group 611 to obtain M image signals.

[0131] The weight value corresponding to the first signal is the first weight coefficient, and the weight value corresponding to the second signal is the second weight coefficient.

[0132] In some optional embodiments, in order to implement the fusion processing provided by formula (2), the signal processing device provided by the embodiment of the present disclosure may further include: a buffer;

[0133] The buffer is used to store j second signals obtained by the second column processing circuit 65 in a second exposure period, where the second exposure period is an exposure period before the first exposure period.

[0134] The signal fusion circuit 66 is used to fuse the M*j first signals output by the first column processing circuit 64 corresponding to the first exposure period with the j second signals stored in the buffer to obtain M*j image signals corresponding to a row of pixel groups.

[0135] In this embodiment, the second signal generated in the previous exposure cycle (second exposure cycle) is stored in a buffer, and each first signal generated in the current exposure cycle (first exposure cycle) is fused with the stored second signal, thereby realizing real-time generation of a fused image signal in the current exposure cycle. That is, every time the first column processing circuit outputs a first signal, the signal fusion circuit can output a corresponding image signal, thereby overcoming the delay problem and realizing real-time output of the image signal.

[0136] In some optional embodiments, the first row decoder circuit 62 is specifically configured to provide a readout signal with a preset timing period (corresponding to Figure 2 The first readout signal of the embodiment shown in the figure) is used to control a row of first pixel units to read out M*j third signals according to the preset timing cycle according to the readout signal. Correspondingly, the second row decoder circuit 63 is used to provide a readout signal (corresponding to Figure 3 A second readout signal of the embodiment shown in the figure is used to control a row of second pixel units to output j fourth signals according to the readout signal.

[0137] Optionally, a schematic diagram of the frame rates corresponding to the first pixel unit and the second pixel unit when the signal is read out is as follows: Figure 7 As shown. Figure 7 As shown, the first pixel unit is a 3T pixel unit, and the second pixel unit is a 4T pixel unit; the frame rates of the fourth signal output by the 4T pixel unit and the third signal output by the 3T pixel unit are different. The fourth signal is for low-light images, and the frame rate is slow, for example, 30 frames / second or 60 frames / second; the third signal is for high-light images, and the frame rate is high, for example, 1000 frames / second or 10000 frames / second. Figure 7As shown, in the time axis t, S 1(N-1)M It means that the M third signals obtained in the N-1th exposure cycle have been output, and then the Nth exposure cycle begins. From the figure, t N The Nth exposure period starts from the moment , and each T represents a preset timing period. Therefore, a third signal is output every T moments, such as Figure 7 As shown in , the first signals collected in the Nth exposure period are respectively expressed as: S 1N1 , S 1N2 , S 1N3 ……S 1N(M-2) , S 1N(M-1) , S 1NM , these positions in the figure represent the frame positions of the third signal, N and M are natural numbers; S 2(N-1) Indicates the frame position of the fourth signal output in the N-1th frame, S 2N Indicates the frame position of the fourth signal output in the Nth frame. Since the frame rate of the fourth signal is slow, there are M frames of the third signal between two adjacent fourth signals.

[0138] In some optional embodiments, the signal processing device provided in this embodiment may further include: an external conversion circuit; optionally, each first pixel unit corresponds to an external conversion circuit, or the external conversion circuit is integrated on the first pixel unit.

[0139] The external conversion circuit processes the first signal output by the first pixel unit to obtain a first reset signal, and controls the first pixel unit to perform reset according to the first reset signal and a first control signal provided by the first row decoder circuit.

[0140] Optionally, the external conversion circuit may include two inverters connected in series, and the third signal is sorted by the two inverters to obtain a first reset signal that meets the requirements. Figure 2 It can be seen from the structure of the provided first pixel unit that the first row decoder circuit provides a first control signal at the end of an exposure cycle, and the first reset signal provided by the external conversion circuit is controlled by the first control signal to be input into the first pixel unit, thereby resetting the first pixel unit at the end of an exposure cycle.

[0141] The second row decoder circuit provides a second reset signal at the end of an exposure period, and controls the second pixel unit to perform reset through the second reset signal.

[0142] Optionally, a first digital controller circuit and a second digital controller circuit may be included. By writing the timing of each signal in the first digital controller circuit and the second digital controller circuit, the timing control of the signals provided in the first row decoder circuit and the second row decoder circuit is realized. Optionally, the timing of the first readout signal, the first control signal and the second control signal in the first row decoder circuit is written in the first digital controller circuit; the timing of the second readout signal, the conduction signal and the second reset signal in the second row decoder circuit is written in the first and second digital controller circuits. In addition, the M value may be adjusted in the first digital controller circuit.

[0143] Optionally, the first pixel unit is a 3T pixel unit, and the second pixel unit is a 4T pixel unit; an area of ​​the second pixel unit in the pixel group is larger than an area of ​​the first pixel unit.

[0144] In this embodiment, the frame rate of the 4T pixel signal collected by the 4T pixel unit is slow, for example, 30 frames / second or 60 frames / second. The frame rate of the 3T pixel signal collected by the 3T pixel unit is high, for example, 1000 frames / second or 10000 frames / second. In the same time domain, the preferred solution for the high dynamic range image signal is the addition of the 4T pixel signal and the 3T pixel signal.

[0145] In the image sensor using the signal processing device provided by the embodiment of the present disclosure, the 4T pixel unit is suitable for collecting signals of dark light images, and the 3T pixel unit is suitable for collecting signals of strong light images, and both collect dark light and strong light image signals respectively, and output the image at a high frame rate greater than the 3T pixel. Therefore, the image signal collected by the image sensor using the signal processing device provided by the embodiment of the present disclosure has the advantages of high dynamic range and high frame rate, which solves the problem of image blur in the field of high-speed motion collected by the high dynamic range image sensor of the prior art.

[0146] In addition, an embodiment of the present disclosure further provides an electronic device, including:

[0147] Memory for storing computer programs;

[0148] The processor is used to execute the computer program stored in the memory, and when the computer program is executed, the signal processing method described in any of the above embodiments of the present disclosure is implemented.

[0149] The electronic device provided by the present disclosure can be included in any of the following: image data acquisition equipment, audio / video player, navigation equipment, entertainment equipment, communication equipment, roadside traffic facilities, equipment in motor vehicles, industrial inspection equipment, flight equipment, medical equipment, security equipment, etc.

[0150] The electronic device provided by the present disclosure can be applied to any of the following: image data acquisition equipment, audio / video players, navigation equipment, entertainment equipment, communication equipment, roadside traffic facilities, equipment in motor vehicles, industrial inspection equipment, flight equipment, medical equipment, security equipment, etc.

[0151] Figure 8 This is a schematic diagram of the structure of an application embodiment of the electronic device disclosed in the present invention. Figure 8 The electronic device according to the embodiment of the present disclosure is described. The electronic device may be any one or both of the first device and the second device, or a stand-alone device independent of them, and the stand-alone device may communicate with the first device and the second device to receive the collected input signals from them.

[0152] like Figure 8 As shown, the electronic device includes one or more processors and memory.

[0153] The processor may be a central processing unit (CPU) or other forms of processing units having data processing capabilities and / or instruction execution capabilities, and may control other components in the electronic device to perform desired functions.

[0154] The memory may store one or more computer program products, and the memory may include various forms of computer-readable storage media, such as volatile memory and / or non-volatile memory. The volatile memory may include, for example, a random access memory (RAM) and / or a cache memory (cache), etc. The non-volatile memory may include, for example, a read-only memory (ROM), a hard disk, a flash memory, etc. One or more computer program products may be stored on the computer-readable storage medium, and the processor may run the computer program product to implement the signal processing method of each embodiment of the present disclosure described above and / or other desired functions.

[0155] In one example, the electronic device may further include: an input device and an output device, and these components are interconnected via a bus system and / or other forms of connection mechanisms (not shown).

[0156] In addition, the input device may also include, for example, a keyboard, a mouse, and the like.

[0157] The output device can output various information to the outside, including determined distance information, direction information, etc. The output device can include, for example, a display, a speaker, a printer, a communication network and a remote output device connected thereto, and the like.

[0158] Of course, to simplify, Figure 8Only some of the components related to the present disclosure in the electronic device are shown, and components such as a bus, an input / output interface, etc. are omitted. In addition, according to specific application situations, the electronic device may further include any other appropriate components.

[0159] In addition to the above-mentioned methods and devices, an embodiment of the present disclosure may also be a computer program product, which includes computer program instructions, which, when executed by a processor, enable the processor to execute the steps of the signal processing method according to various embodiments of the present disclosure described in the above part of this specification.

[0160] The computer program product may be written in any combination of one or more programming languages ​​to write program code for performing the operations of the disclosed embodiments, including object-oriented programming languages ​​such as Java, C++, etc., and conventional procedural programming languages ​​such as "C" or similar programming languages. The program code may be executed entirely on the user computing device, partially on the user device, as a separate software package, partially on the user computing device and partially on a remote computing device, or entirely on a remote computing device or server.

[0161] In addition, an embodiment of the present disclosure may also be a computer-readable storage medium having computer program instructions stored thereon, which, when executed by a processor, enable the processor to execute the steps of the signal processing method according to various embodiments of the present disclosure described in the above part of this specification.

[0162] The computer readable storage medium can adopt any combination of one or more readable media. The readable medium can be a readable signal medium or a readable storage medium. The readable storage medium can include, for example, but is not limited to, a system, device or device of electricity, magnetism, light, electromagnetic, infrared, or semiconductor, or any combination of the above. More specific examples (non-exhaustive list) of readable storage media include: an electrical connection with one or more wires, a portable disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above.

[0163] The basic principles of the present disclosure are described above in conjunction with specific embodiments. However, it should be noted that the advantages, strengths, effects, etc. mentioned in the present disclosure are only examples and not limitations, and it cannot be considered that these advantages, strengths, effects, etc. are required by each embodiment of the present disclosure. In addition, the specific details disclosed above are only for the purpose of illustration and ease of understanding, and are not limitations. The above details do not limit the present disclosure to the necessity of adopting the above specific details to be implemented.

[0164] Each embodiment in this specification is described in a progressive manner, and each embodiment focuses on the differences from other embodiments. The same or similar parts between the embodiments can be referred to each other. For the system embodiment, since it basically corresponds to the method embodiment, the description is relatively simple, and the relevant parts can be referred to the partial description of the method embodiment.

[0165] The block diagrams of the devices, apparatuses, equipment, and systems involved in this disclosure are only illustrative examples and are not intended to require or imply that they must be connected, arranged, and configured in the manner shown in the block diagrams. As will be appreciated by those skilled in the art, these devices, apparatuses, equipment, and systems can be connected, arranged, and configured in any manner. Words such as "including," "comprising," "having," and the like are open words, referring to "including but not limited to," and can be used interchangeably therewith. The words "or" and "and" used herein refer to the words "and / or," and can be used interchangeably therewith, unless the context clearly indicates otherwise. The word "such as" used herein refers to the phrase "such as but not limited to," and can be used interchangeably therewith.

[0166] The method and apparatus of the present disclosure may be implemented in many ways. For example, the method and apparatus of the present disclosure may be implemented by software, hardware, firmware, or any combination of software, hardware, and firmware. The above order of steps for the method is for illustration only, and the steps of the method of the present disclosure are not limited to the order specifically described above, unless otherwise specifically stated. In addition, in some embodiments, the present disclosure may also be implemented as a program recorded in a recording medium, which includes machine-readable instructions for implementing the method according to the present disclosure. Therefore, the present disclosure also covers a recording medium storing a program for executing the method according to the present disclosure.

[0167] It should also be noted that in the apparatus, device and method of the present disclosure, each component or each step can be decomposed and / or recombined. Such decomposition and / or recombination should be regarded as equivalent solutions of the present disclosure.

[0168] The above description of the disclosed aspects is provided to enable any person skilled in the art to make or use the present disclosure. Various modifications to these aspects will be readily apparent to those skilled in the art, and the general principles defined herein may be applied to other aspects without departing from the scope of the present disclosure. Therefore, the present disclosure is not intended to be limited to the aspects shown herein, but rather to the widest scope consistent with the principles and novel features disclosed herein.

[0169] The above description has been given for the purpose of illustration and description. In addition, this description is not intended to limit the embodiments of the present disclosure to the forms disclosed herein. Although multiple example aspects and embodiments have been discussed above, those skilled in the art will recognize certain variations, modifications, changes, additions and sub-combinations thereof.

Claims

1. A signal processing method, characterized in that: include: In a first exposure period, light signals are collected and converted at a first position corresponding to a pixel group by a first pixel unit in a pixel array to obtain M first signals; wherein the pixel array includes pixel groups of i rows and j columns, and each pixel group includes one first pixel unit and one second pixel unit; and M, i, and j are integers greater than 1 respectively; Determine a second signal corresponding to the first position by using a second pixel unit in the pixel group; The M first signals and the second signal are fused to obtain M image signals corresponding to the first position.

2. The method according to claim 1, characterized in that The fusing the M first signals and the second signal to obtain M image signals corresponding to the first position includes: Each of the M first signals is weightedly summed with the second signal to obtain M image signals; wherein the weight value corresponding to the first signal is a first weight coefficient, and the weight value corresponding to the second signal is a second weight coefficient.

3. The method according to claim 1 or 2, characterized in that: The determining, by using a second pixel unit, a second signal corresponding to the first position includes: In the first exposure period, the light signal at the first position is collected and converted by the second pixel unit to obtain the second signal.

4. The method according to claim 1 or 2, characterized in that: The determining, by using a second pixel unit, a second signal corresponding to the first position includes: In a second exposure cycle, light signals at the first position are collected and converted by a second pixel unit to obtain the second signal; wherein the second exposure cycle is the previous exposure cycle of the first exposure cycle.

5. The method according to any one of claims 1 to 4, characterized in that: In the first exposure period, the light signal is collected and converted at the first position corresponding to the pixel group by the first pixel unit in the pixel array to obtain M first signals, including: During the first exposure period, the first pixel unit is controlled to read out the photogenerated charge obtained based on the light signal according to the preset timing period according to the readout signal provided by the first row decoder circuit to obtain the M first signals.

6. The method according to claim 5, characterized in that In the first exposure period, after collecting and converting the light signal at the first position corresponding to the pixel group through the first pixel unit in the pixel array to obtain M first signals, the method further includes: According to the first signal, the first pixel unit is controlled to perform a reset.

7. The method according to any one of claims 1 to 6, characterized in that: The first pixel unit is a 3T pixel unit, and the second pixel unit is a 4T pixel unit; The area of ​​the second pixel unit in the pixel group is larger than the area of ​​the first pixel unit.

8. A signal processing device, characterized in that: include: A pixel array, a first row decoder circuit, a second row decoder circuit, a first column processing circuit, a second column processing circuit and a signal fusion circuit; wherein the pixel array includes pixel groups of i rows and j columns, and each of the pixel groups includes a first pixel unit and a second pixel unit; The pixel array is used to perform optical signal conversion row by row according to the control of the first row decoder circuit and the second row decoder circuit, output the third signal output by the first pixel unit in each row to the first column processing circuit, and output the fourth signal output by the second pixel unit in each row to the second column processing circuit; The first row decoder circuit is used to control the first pixel units in the pixel array row by row to output M third signals in one exposure period according to a preset timing cycle; The second row decoder circuit is used to control the second pixel units in the pixel array row by row to output a fourth signal within an exposure period; The first column processing circuit is used to receive and process M*j third signals output by the first pixel units in the pixel array in columns to obtain M*j first signals; The second column processing circuit is used for receiving and processing j fourth signals output by the second pixel units in the pixel array in columns to obtain j second signals; The signal fusion circuit is used to perform fusion processing on the M*j first signals and the j second signals respectively to obtain M*j image signals.

9. The device according to claim 8, characterized in that The M*j first signals and the j second signals correspond to j pixel groups in a row; The signal fusion circuit is specifically used to perform weighted summation between each of the M first signals and the second signal for each pixel group to obtain M image signals; wherein the weight value corresponding to the first signal is a first weight coefficient, and the weight value corresponding to the second signal is a second weight coefficient.

10. The device according to claim 8 or 9, characterized in that Also includes: Cache; The buffer is used to store j second signals obtained by the second column processing circuit in a second exposure period, where the second exposure period is an exposure period before the first exposure period; The signal fusion circuit is used to fuse the M*j first signals output by the first column processing circuit corresponding to the first exposure period with the j second signals stored in the buffer to obtain the M*j image signals corresponding to a row of the pixel groups.

11. The device according to any one of claims 8 to 10, characterized in that: The first row decoder circuit is specifically used to provide a readout signal with a preset timing cycle within an exposure cycle, and control a row of the first pixel units to read out M*j third signals according to the preset timing cycle according to the readout signal.

12. The device according to any one of claims 8 to 11, characterized in that: Also includes: External conversion circuit; The external conversion circuit processes the first signal output by the first pixel unit to obtain a first reset signal, and controls the first pixel unit to perform reset according to the first reset signal and a first control signal provided by the first row decoder circuit.

13. The device according to claim 12, characterized in that The first row decoder circuit provides the first control signal at the end of an exposure period, and controls the first reset signal provided by the external conversion circuit to be input into the first pixel unit through the first control signal; The second row decoder circuit provides a second reset signal at the end of an exposure period, and controls the second pixel unit to perform reset through the second reset signal.

14. An electronic device, characterized in that: include: A processor, and a memory communicatively connected to the processor, further comprising the signal processing device according to any one of claims 8 to 13; The memory stores computer-executable instructions; The processor executes the computer-executable instructions stored in the memory to control the timing signal processing device to implement the signal processing method described in any one of claims 1-7.

15. The device according to claim 14, characterized in that The electronic device is included in any of the following: image data acquisition equipment, audio / video player, navigation equipment, entertainment equipment, communication equipment, roadside traffic facilities, equipment in motor vehicles, industrial testing equipment, flight equipment, medical equipment, and security equipment.

Images