Pixel reading circuit, image processing method and device, product and readable storage medium
By performing N sub-exposure in low-illumination long-distance monitoring and saving pixel levels, the blurred image problem of moving objects caused by long-term integration is solved, and the effect of efficient acquisition of moving objects information is achieved.
Patent Information
- Application Number
- CN202510629769.8
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2025-05-15
- Publication Date
- 2025-07-04
AI Technical Summary
In low-illumination long-distance monitoring scenarios, long-term integration causes blurred images of moving objects and cannot recognize information during movement.
N sub-exposure is performed within the first exposure time of the target image frame, and the pixel level of each pixel during the N sub-exposure process is saved, information of moving objects is obtained through multiple sub-frames, and pixel levels are stored using the reset level storage sub-module and the sub-exposure level storage sub-module to store pixel levels, and the output module outputs level difference value.
By obtaining subframe information of moving objects through short-time integration, the amount of data processed in image processing is reduced and the accuracy of recognition of moving objects is improved.
Smart Images
Figure CN120264163A_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the technical field of image processing, and in particular, to a pixel readout circuit, an image processing method, an apparatus, a product, and a readable storage medium. Background Art
[0002] In the application scenario of low-light long-distance monitoring, most of the objects in the captured image are static, and the recognition of the few moving objects existing is very crucial. Under certain lighting conditions, the number of photons captured by each pixel in the image sensor is proportional to time. To obtain a high-quality image, it is necessary to integrate the image for a long time.
[0003] However, for moving objects, long-time integration will lose the information during the movement process, resulting in the blurred image of the moving object being unrecognizable. Summary of the Invention
[0004] The purpose of the present invention is at least to provide a pixel readout circuit, an image processing method, an apparatus, and a readable storage medium, which can obtain the information of a moving object during the movement process in a long exposure scenario.
[0005] In a first aspect, the present invention provides a pixel readout circuit, including: a first pixel readout unit and a second pixel readout unit, wherein: the first pixel readout unit includes a reset transistor, a first source follower transistor, and a first row selection transistor, wherein: the gate of the reset transistor inputs a reset signal; the gate of the first source follower transistor is coupled to the source of the reset transistor, and its source is coupled to the drain of the first row selection transistor; the first row selection transistor, its gate inputs a first row selection signal, and its source is coupled to a first bit line; the second pixel readout unit includes a level storage module and an output module, wherein: the level storage module includes a reset level storage sub-module and N sub-exposure level storage sub-modules; the reset level storage sub-module is used to store the reset level obtained after resetting the jth pixel; the ith sub-exposure level storage sub-module is used to store the pixel level obtained by the jth pixel during the ith sub-exposure within the first exposure duration; the output module is adapted to output the reset level corresponding to the jth pixel and the pixel levels stored in the N sub-exposure level storage sub-modules when receiving a pixel readout instruction; 1≤i≤N, 1≤j≤M, i, j, M, and N are all positive integers, M is the total number of pixels of the image sensor, the first exposure duration is the exposure duration for obtaining a target image frame, and N sub-exposures are performed within the first exposure duration.
[0006] During the first exposure duration of obtaining the target image frame, N sub-exposures are performed, and the pixel levels of each pixel during the N sub-exposures are respectively saved. Based on the pixel levels of each pixel during the N sub-exposures, sub-frames obtained during the N sub-exposures can be obtained. Since the sub-exposure duration is less than the first exposure duration, the integration time required for the obtained sub-frames is shorter. Through multiple sub-frames, information about moving objects during their movement in different sub-frames can be obtained.
[0007] Optionally, the reset level storage sub-module includes: a first switch unit and a first capacitor, where: the first switch unit, its first end is coupled to the drain of the first row selection transistor, its second end is coupled to the first end of the first capacitor, and its control end inputs a control signal; after the jth pixel is reset, the first switch unit is turned on; the first capacitor, its second end is grounded.
[0008] Optionally, any sub-exposure level storage sub-module includes a second switch unit and a second capacitor, where: the second switch unit, its first end is coupled to the drain of the first row selection transistor, its second end is coupled to the first end of the second capacitor, and its control end inputs a control signal; the second switch unit in the ith sub-exposure level storage sub-module is turned on during the ith sub-exposure; the second capacitor, its second end is grounded; the ith second switch unit is turned on during the ith exposure process.
[0009] Optionally, the output unit includes a first NMOS transistor and a second NMOS transistor, where: the first NMOS transistor, its drain inputs a power supply voltage, its gate is coupled to the drain of the first row selection transistor, and its source is coupled to the drain of the second NMOS transistor; the second NMOS transistor is turned on when the pixel readout instruction is input to its gate, and outputs the reset level corresponding to the jth pixel and the pixel levels stored in the N sub-exposure level storage sub-modules through its source.
[0010] In a second aspect, the present invention also provides an image processing method, which is applied in an image processing system, and the image processing system includes any one of the above-mentioned pixel readout circuits; the image processing method includes: obtaining the target image frame; detecting that there is a motion trajectory in the target image frame, and determining a target sub-frame; the target sub-frame is at least a part of the N sub-frames; based on the target sub-frame, identifying the target object corresponding to the motion trajectory.
[0011] After obtaining the target image frame, if it is detected that there is a motion trajectory in the target image frame, the target sub-frame is output; if it is detected that there is no motion trajectory in the target image frame, there is no need to output the target sub-frame, so the number of sub-frames to be processed can be reduced, and the amount of image data to be processed can be reduced.
[0012] Optionally, the target sub-frame is a sub-frame among the N sub-frames where the motion trajectory exists.
[0013] Optionally, detecting the existence of a motion trajectory in the target image frame includes: comparing the target image frame with the first image frame obtained through the first exposure duration last time; when it is detected that the pixel difference between the target image frame and the first image frame exceeds a preset threshold, it is determined that there is a motion trajectory in the target image frame; the first image frame is the image frame obtained through the first exposure duration last time.
[0014] Optionally, detecting the existence of a motion trajectory in the target image frame includes: detecting that there are multiple target pixels in the target image frame whose pixel difference from the first image frame exceeds a preset threshold, and the multiple target pixels are continuous, and determining that there is a motion trajectory in the target image frame; the first image frame is the image frame obtained through the first exposure duration last time.
[0015] The present invention also provides an image processing apparatus, which is applied in an image processing system. The image processing system includes any one of the above-mentioned pixel readout circuits; the image processing apparatus includes: an acquisition unit, configured to acquire the target image frame; a determination unit, configured to determine a target sub-frame when it is detected that there is a motion trajectory in the target image frame; the target sub-frame is at least a part of the N sub-frames; an identification unit, configured to identify a target object corresponding to the motion trajectory based on the target sub-frame.
[0016] In a third aspect, the present invention also provides a computer-readable storage medium, which is a non-volatile storage medium or a non-transient storage medium, on which a computer program is stored. When the computer program is run by a processor, it executes the steps of any one of the above-mentioned image processing methods.
[0017] In a fourth aspect, the present invention also provides a computer program product, including a computer program / instructions. When the computer program / instructions are executed by a processor, they implement the steps of any one of the above-mentioned image processing methods. Description of the Drawings
[0018] Figure 1 is a schematic structural diagram of a pixel readout circuit in an embodiment of the present invention;
[0019] Figure 2 is Figure 1 the exposure timing diagram of the pixel readout circuit shown in
[0020] Figure 3 is a flowchart of an image processing method in an embodiment of the present invention;
[0021] Figure 4It is a structural schematic diagram of an image processing device in an embodiment of the present invention. DETAILED DESCRIPTION
[0022] In the prior art, in the application scenario of low-light long-distance monitoring, in order to obtain high-quality images, it is necessary to integrate the images for a long time. However, for moving objects, long-term integration will lose information during the movement process, resulting in blurred images of moving objects that are unrecognizable.
[0023] In an embodiment of the present invention, N sub-exposures are performed within the first exposure duration for acquiring a target image frame, and the pixel level of each pixel during the N sub-exposures is saved respectively. Based on the pixel level of each pixel during the N sub-exposures, a sub-frame obtained during the N sub-exposures can be obtained. Since the sub-exposure duration is shorter than the first exposure duration, the integration time required for the acquired sub-frame is shorter. Through multiple sub-frames, information about the moving object during the motion process in different sub-frames can be acquired.
[0024] In order to make the above-mentioned objects, features and beneficial effects of the present invention more obvious and easy to understand, specific embodiments of the present invention are described in detail below with reference to the accompanying drawings.
[0025] An embodiment of the present invention provides a pixel readout circuit, referring to Figure 1 . Reference Figure 2 , which gives Figure 1 The exposure timing diagram of the pixel readout circuit in FIG. Figure 1 and Figure 2 Provide explanation.
[0026] In an embodiment of the present invention, the pixel readout circuit may include: a first pixel readout unit and a second pixel readout unit.
[0027] In a specific implementation, the first pixel readout unit may include three MOS tubes and a diode, which are a reset tube, a source follower tube and a row selection tube.
[0028] like Figure 1 The first pixel readout unit shown includes: a reset tube RST, a first source follower tube SF, a first row selection tube Row_SEL and a diode D1.
[0029] Specifically, the drain of the reset tube RST can input the power supply voltage VDD, the gate of the reset tube RST inputs the reset signal, and the source of the reset tube RST is coupled to the cathode of the diode D1;
[0030] The drain of the first source follower tube SF is input with the power supply voltage VDD, the source of the first source follower tube SF is coupled with the drain of the first row selection tube Row_SEL, and the gate of the first source follower tube SF is coupled with the source of the reset tube RST;
[0031] The gate of the first row selection transistor Row_SEL receives the first row selection signal, and the source of the first row selection transistor Row_SEL is connected to the first bit line (BL1).
[0032] The positive electrode of the diode D1 is grounded.
[0033] In some embodiments, the first pixel readout unit may also be an existing 4T pixel circuit. The 4T pixel circuit may include 4 MOS transistors and a diode. The 4 MOS transistors are a reset transistor, a transfer transistor, a source follower transistor, and a row selection transistor respectively. Based on the first pixel readout unit in Figure 1 the drain of the transfer transistor is coupled to the source of the reset transistor, the source of the transfer transistor is coupled to the negative electrode of the diode, and the gate of the transfer transistor receives the transfer signal.
[0034] In the embodiments of the present invention, the second pixel readout unit may include a level storage module and an output module, where:
[0035] The level storage module includes a reset level storage sub-module and a sub-exposure level storage sub-module. The reset level storage sub-module can be used to store the reset level obtained after resetting the j-th pixel;
[0036] The number of sub-exposure level storage sub-modules is N; the i-th sub-exposure level storage sub-module is used to store the pixel level obtained when the j-th pixel undergoes the i-th sub-exposure within the first exposure duration;
[0037] The output module is adapted to output the reset level corresponding to the j-th pixel and the pixel levels stored in the N sub-exposure level storage sub-modules when receiving a pixel readout instruction;
[0038] where 1≤i≤N, 1≤j≤M, i, j, M, and N are all positive integers, M is the total number of pixels of the image sensor, the first exposure duration is the exposure duration for obtaining the target image frame, and N sub-exposures are performed within the first exposure duration.
[0039] In a specific implementation, the reset level storage sub-module may include a first switch unit and a first capacitor, where:
[0040] The first end of the first switch unit is coupled to the drain of the first row selection transistor, and the second end of the first switch unit is coupled to the first end of the first capacitor;
[0041] The second end of the first capacitor is grounded.
[0042] The structures of the N sub-exposure level storage sub-modules may be the same. For any sub-exposure level storage sub-module, it may include: a second switch unit and a second capacitor, where:
[0043] The first end of the second switching unit is coupled to the drain of the first row selection transistor, and the second end of the second switching unit is coupled to the first end of the second capacitor;
[0044] The second end of the second capacitor is grounded.
[0045] As Figure 1 shown, the first end of the first switching unit smpr is coupled to the drain of the first row selection transistor Row_SEL, the second end of the first switching unit smpr is coupled to the first end of the capacitor cr, and the second end of the capacitor cr is grounded.
[0046] The first sub-exposure level storage sub-module includes a second switching unit smps1 and a second capacitor cs1; the second sub-exposure level storage sub-module includes a second switching unit smps2 and a second capacitor cs2; and so on, the (N - 1)th sub-exposure level storage sub-module includes a second switching unit smpsN-1 and a second capacitor csN-1, and the Nth sub-exposure level storage sub-module includes a second switching unit smpsN and a second capacitor csN.
[0047] In a specific implementation, the output unit may include a first NMOS transistor MN1 and a second NMOS transistor MN2, where:
[0048] The drain of the first NMOS transistor MN1 inputs a power supply voltage, the gate of the first NMOS transistor MN1 is coupled to the drain of the first row selection transistor Row_SEL, and the source of the first NMOS transistor is coupled to the drain of the second NMOS transistor MN2;
[0049] The gate of the second NMOS transistor MN2 inputs a pixel readout instruction, and the source of the second NMOS transistor MN2 is coupled to the second bit line BL2; when the pixel readout instruction is at a high level, the second NMOS transistor MN2 is turned on, and then the reset level corresponding to the jth pixel and the pixel levels stored in the N sub-exposure level storage sub-modules are output.
[0050] In an embodiment of the present invention, the image sensor may perform N sub-exposures within a first exposure duration, and the duration of each sub-exposure is equal. As Figure 2 shown, within the first exposure duration T, there are N sub-exposures, and the duration of each sub-exposure is t.
[0051] In some embodiments, the first exposure duration and the sub-exposure duration may be set based on a specific application scenario. Under different lighting conditions, the first exposure duration and the sub-exposure duration may be the same or may be set differently.
[0052] For example, the first exposure duration is 20 s, and the duration of one sub-exposure is 1 s. Within the first exposure duration, 20 sub-exposures are performed.
[0053] The exposure process of the pixel readout circuit in Figure 1 will be described below. The first exposure duration includes N sub-exposures.
[0054] After the start of the first exposure duration, the j-th pixel is first reset. Specifically, the reset signal RST input to the gate of the reset transistor jumps from a low level to a high level, and the reset transistor conducts. The first bit line BL1 is connected to the tail current source, and the first source follower transistor SF has driving ability. The reset signal RST jumps from a high level to a low level, and the reset transistor disconnects. Then, the control signal input to the control terminal of the first switch unit smpr jumps from a low level to a high level, and the first capacitor cr is charged. When the control signal input to the control terminal of the first switch unit smpr jumps from a high level to a low level, the first capacitor cr is fully charged, and the electric charge stored in the first capacitor cr is used to represent the reset level. When the reset transistor conducts, the reset level can be output through the first bit line BL1.
[0055] After the j-th pixel is reset, the first sub-exposure is performed. After the first sub-exposure duration, the control signal input to the control terminal of the second switch unit smps1 jumps from a low level to a high level, and the second capacitor cs1 is charged. When the control signal input to the control terminal of the second switch unit smps1 jumps from a high level to a low level, the second capacitor cs1 is fully charged, and the electric charge stored in the second capacitor cs1 represents the pixel level Dcs1 of the j-th pixel obtained during the first sub-exposure.
[0056] When the control signal input to the control terminal of the second switch unit smps1 jumps from a high level to a low level, the second sub-exposure is performed. After the first sub-exposure duration, the control signal input to the control terminal of the second switch unit smps2 jumps from a low level to a high level, and the second capacitor cs2 is charged. When the control signal input to the control terminal of the second switch unit smps2 jumps from a high level to a low level, the second capacitor cs2 is fully charged, and the electric charge stored in the second capacitor cs2 represents the pixel level Dcs2 of the j-th pixel obtained during the second sub-exposure.
[0057] And so on. By performing the N-th sub-exposure, the electric charge stored in the second capacitor csN can be obtained, which represents the pixel level DcsN of the j-th pixel obtained during the N-th sub-exposure. During each sub-exposure process, the first row selection transistor conducts once.
[0058] After completing the exposure process of the j-th pixel, the reset level corresponding to the j-th pixel and the pixel levels Dcs1~DcsN stored in the N sub-exposure level storage sub-module are output through the output module.
[0059] After the first exposure duration ends, the signal level of the j-th pixel is obtained through the first bit line BL1, and the signal level of the j-th pixel is DS. Based on the reset level Dr of the j-th pixel and the signal level DS, the level difference of the j-th pixel during the first exposure duration can be determined, and this level difference is proportional to the amount of charge generated by the pixel.
[0060] For the M pixels of the image sensor, the level differences between DR and DS corresponding to each pixel are obtained. After ADC sampling and signal processing of the M level differences, the target image frame obtained through the first exposure duration can be obtained.
[0061] Through the second bit line BL2, Dcs1~DcsN are obtained.
[0062] After the first sub-exposure ends, the charge change amount of the j-th pixel is Dcs1 - Dr. After obtaining Dcs1 - Dr corresponding to each of the M pixels after the first sub-exposure ends, the first sub-frame corresponding to the first sub-exposure can be obtained.
[0063] After the second sub-exposure ends, the charge change amount of the j-th pixel is Dcs2 - Dcs1. After obtaining Dcs2 - Dcs1 corresponding to each of the M pixels after the second sub-exposure ends, the second sub-frame corresponding to the second sub-exposure can be obtained.
[0064] And so on. After the N-th sub-exposure ends, the N-th sub-frame corresponding to the N-th sub-exposure can be obtained.
[0065] Thus, after the first exposure duration ends, the target image frame and N sub-frames can be obtained.
[0066] Thus, during the first exposure duration for obtaining the target image frame, N sub-exposures are performed, and the pixel levels of each pixel during the N sub-exposures are saved respectively. Based on the pixel levels of each pixel during the N sub-exposures, the sub-frames obtained during the N sub-exposures can be obtained. Since the sub-exposure duration is less than the first exposure duration, the integration time required for the obtained sub-frames is shorter. Through multiple sub-frames, information about the moving object during the movement in different sub-frames can be obtained.
[0067] In the embodiments of the present invention, after the target image frame is obtained, the target image frame can be output. It can be executed by a chip or device with image processing functions in the image processing system. For example, the chip or device with image processing functions can be a microcontroller, a central processing unit, an image processor, etc.
[0068] After obtaining the output target image frame, the target image frame can be detected to determine whether there is a motion trajectory of a moving object in the target image frame. If a motion trajectory is detected in the target image frame, at least some sub-frames within the first exposure duration can be output; conversely, if no motion trajectory is detected in the target image frame, there is no need to output the sub-frames within the first exposure duration.
[0069] In a specific implementation, if no motion trajectory is detected in the target image frame, it can be characterized that no moving object has passed through the image acquisition area of the image sensor within the first exposure duration. If a motion trajectory is detected in the target image frame, it indicates that a moving object has passed through the image acquisition area of the image sensor within the first exposure duration. Since in the application scenario of low-light long-distance monitoring, the first exposure duration is relatively long, the image of the moving object in the target image frame is relatively blurred and usually appears as a linear trajectory in the target image frame.
[0070] In some embodiments, if a linear trajectory is detected in the target image frame, it can be determined that there is a motion trajectory in the target image frame. That is to say, within the first exposure duration, a moving object has passed through the image acquisition area of the image sensor.
[0071] In other embodiments, the target image frame collected at the current moment can also be compared with the target image frame collected last time. The target image frame collected last time is the target image frame obtained after the last first exposure duration.
[0072] For example, at time T0, the first image frame PL(N - 1) is obtained after the first exposure duration; at time T1, the target image frame PL(N) is obtained after the first exposure duration. Regarding time T1 as the current moment, the first image frame PL(N - 1) is the image frame collected by the last long exposure.
[0073] Obtain the pixel difference between the target image frame PL(N) and the first image frame PL(N - 1). If the pixel difference between the two exceeds the preset threshold, it is determined that there is a motion trajectory in the target image frame PL(N); conversely, if the pixel difference between the two does not exceed the preset threshold, it is determined that there is no motion trajectory in the target image frame PL(N).
[0074] Alternatively, if a pixel difference is detected between the target image frame PL(N) and the first image frame PL(N - 1), obtain the pixel positions where the pixel difference exists. If the pixel positions where the pixel difference exists are continuous and the number of pixels with pixel differences reaches the preset number, it is determined that there is a motion trajectory in the target image frame PL(N).
[0075] In a specific implementation, if a motion trajectory is detected in a target image frame, N sub-frames within the first exposure duration can be output. From the N sub-frames, the sub-frames corresponding to the motion trajectory are obtained, and then the moving object corresponding to the motion trajectory is identified. The sub-frames corresponding to the above-mentioned motion trajectory are the sub-frames with a motion trajectory.
[0076] Alternatively, if a motion trajectory is detected in a target image frame, at least some of the sub-frames within the first exposure duration can be output. The above-mentioned partial sub-frames are the sub-frames with a motion trajectory among the N sub-frames. By identifying the output partial sub-frames, the moving object corresponding to the motion trajectory can be obtained.
[0077] For example, the first exposure duration includes 20 sub-exposures, that is, 20 sub-frames are obtained within the first exposure duration. If there is a motion trajectory in sub-frames 5 to 15, then sub-frames 5 to 15 are output.
[0078] Or, if a motion trajectory is detected in a target image frame, the partial sub-frames with a motion trajectory can be determined first. From the partial sub-frames with a motion trajectory, the image regions with a motion trajectory are selected and output. Thus, only the partial image regions in the partial sub-frames need to be output, without outputting all the image data of all the partial sub-frames with a motion trajectory.
[0079] For example, the first exposure duration includes 20 sub-exposures, that is, 20 sub-frames are obtained within the first exposure duration. If there is a motion trajectory in sub-frames 5 to 15, then the image regions with a motion trajectory are respectively selected from sub-frames 5 to 15 with a preset selection range, and the selected image regions are output.
[0080] In the embodiment of the present invention, after the target image frame is obtained, if a motion trajectory is detected in the target image frame, the target sub-frame is output; if no motion trajectory is detected in the target image frame, the target sub-frame does not need to be output, so the number of sub-frames to be processed can be reduced, and the amount of image data to be processed can be reduced.
[0081] Refer to Figure 3 , and a method for image processing in the embodiment of the present invention is given, and the following is described in detail through specific steps.
[0082] In a specific implementation, the image processing method described in the following steps 301 to 303 can be executed by a chip or device with an image data processing function in an image processing system. The image processing system may further include the pixel readout circuit provided in any of the above embodiments.
[0083] Step 301, obtain a target image frame.
[0084] Step 302: Detect that there is a motion trajectory in the target image frame and determine the target sub-frame.
[0085] Step 303: Based on the target sub-frame, identify the target object corresponding to the motion trajectory.
[0086] In specific implementation, for the specific acquisition process of the above-mentioned target image frame and sub-frame, reference can be made to the description in the above embodiment, which will not be elaborated here.
[0087] In the embodiment of the present invention, the target sub-frame can be at least a part of the N sub-frames. Or, the target sub-frame can be the N sub-frames.
[0088] In the embodiment of the present invention, detecting that there is a motion trajectory in the target image frame may include: comparing the target image frame with the first image frame obtained in the previous time through the first exposure duration; when it is detected that the pixel difference between the target image frame and the first image frame exceeds a preset threshold, determining that there is a motion trajectory in the target image frame; the first image frame is the image frame obtained in the previous time through the first exposure duration.
[0089] In the embodiment of the present invention, detecting that there is a motion trajectory in the target image frame may include: detecting that there are multiple target pixels in the target image frame whose pixel difference from the first image frame exceeds a preset threshold, and the multiple target pixels are continuous, determining that there is a motion trajectory in the target image frame; the first image frame is the image frame obtained in the previous time through the first exposure duration.
[0090] In specific implementation, for the specific process of identifying the motion trajectory and obtaining the target sub-frame, reference can also be made to the relevant description in the above embodiment.
[0091] Refer to Figure 4 , an image processing device 40 in the embodiment of the present invention is given, including: an acquisition unit 401, a determination unit 402, and an identification unit 403, where:
[0092] The acquisition unit 401 is used to acquire the target image frame;
[0093] The determination unit 402 is used to detect that there is a motion trajectory in the target image frame and determine the target sub-frame; the target sub-frame is at least a part of the N sub-frames;
[0094] The identification unit 403 is used to identify the target object corresponding to the motion trajectory based on the target sub-frame.
[0095] In specific implementation, the specific execution processes of the above acquisition unit 401, determination unit 402, and identification unit 403 can be correspondingly referred to steps 301 to 303, which will not be elaborated here.
[0096] In a specific implementation, for each device and product described in the above embodiments, each module / unit included therein may be a software module / unit, a hardware module / unit, or may be partially a software module / unit and partially a hardware module / unit.
[0097] For example, for each device and product applied to or integrated into a chip, each module / unit included therein may be implemented in the form of hardware such as circuits. Alternatively, at least some of the modules / units may be implemented in the form of a software program that runs on a processor integrated within the chip, and the remaining (if any) modules / units may be implemented in the form of hardware such as circuits. For each device and product applied to or integrated into a chip module, each module / unit included therein may be implemented in the form of hardware such as circuits. Different modules / units may be located in the same component (such as a chip, a circuit module, etc.) or different components of the chip module. Alternatively, at least some of the modules / units may be implemented in the form of a software program that runs on a processor integrated within the chip module, and the remaining (if any) modules / units may be implemented in the form of hardware such as circuits. For each device and product applied to or integrated into a terminal, each module / unit included therein may be implemented in the form of hardware such as circuits. Different modules / units may be located in the same component (such as a chip, a circuit module, etc.) or different components within the terminal. Alternatively, at least some of the modules / units may be implemented in the form of a software program that runs on a processor integrated within the terminal, and the remaining (if any) modules / units may be implemented in the form of hardware such as circuits.
[0098] An embodiment of the present invention further provides a computer-readable storage medium, which is a non-volatile storage medium or a non-transitory storage medium, on which a computer program is stored. When the computer program is run by a processor, it executes the steps of the image processing method provided in any one of the above embodiments.
[0099] The present invention also provides a computer program product, including a computer program / instructions. When the computer program / instructions are executed by a processor, they implement the steps of the image processing method provided in any one of the above embodiments.
[0100] An embodiment of the present invention further provides another image processing device, including a memory and a processor. A computer program that can run on the processor is stored on the memory. When the processor runs the computer program, it executes the steps of the image processing method provided in any one of the above embodiments.
[0101] Those of ordinary skill in the art can understand that all or part of the steps in the various methods of the above embodiments can be completed by a program instructing relevant hardware, and the program can be stored in a computer-readable storage medium, which can include: ROM, RAM, magnetic disk or optical disc, etc.
[0102] Although the present invention is disclosed as above, the present invention is not limited thereto. Any person skilled in the art can make various changes and modifications without departing from the spirit and scope of the present invention. Therefore, the protection scope of the present invention should be subject to the scope defined by the claims.
Claims
1. A pixel readout circuit, characterized in that, Including: A first pixel readout unit and a second pixel readout unit, where: The first pixel readout unit includes a reset transistor, a first source follower transistor, and a first row selection transistor, where: the gate of the reset transistor inputs a reset signal; the gate of the first source follower transistor is coupled to the source of the reset transistor, and its source is coupled to the drain of the first row selection transistor; the first row selection transistor, its gate inputs a first row selection signal, and its source is coupled to the first bit line; The second pixel readout unit includes a level storage module and an output module, where: The level storage module includes a reset level storage sub-module and N sub-exposure level storage sub-modules; the reset level storage sub-module is used to store the reset level obtained after resetting the j-th pixel; the i-th sub-exposure level storage sub-module is used to store the pixel level obtained when the j-th pixel is sub-exposed for the i-th time within the first exposure duration; The output module is adapted to output the reset level corresponding to the j-th pixel and the pixel levels stored in the N sub-exposure level storage sub-modules when receiving a pixel readout instruction; 1 ≤ i ≤ N, 1 ≤ j ≤ M, i, j, M, and N are all positive integers, M is the total number of pixels of the image sensor, the first exposure duration is the exposure duration for obtaining the target image frame, and N sub-exposures are performed within the first exposure duration.
2. The pixel readout circuit according to claim 1, wherein The reset level storage sub-module includes: a first switch unit and a first capacitor, where: The first switch unit, its first end is coupled to the drain of the first row selection transistor, its second end is coupled to the first end of the first capacitor, and its control end inputs a control signal; after the j-th pixel is reset, the first switch unit conducts; The first capacitor, its second end is grounded.
3. The pixel readout circuit according to claim 1, characterized in that Any sub-exposure level storage sub-module includes a second switch unit and a second capacitor, where: The second switch unit, its first end is coupled to the drain of the first row selection transistor, its second end is coupled to the first end of the second capacitor, and its control end inputs a control signal; the second switch unit in the i-th sub-exposure level storage sub-module conducts during the i-th sub-exposure; The second capacitor, its second end is grounded; The i-th second switch unit conducts during the i-th exposure.
4. The pixel readout circuit according to any one of claims 1 to 3, characterized in that, The output unit includes a first NMOS transistor and a second NMOS transistor, where: The first NMOS transistor, its drain inputs a power supply voltage, its gate is coupled to the drain of the first row selection transistor, and its source is coupled to the drain of the second NMOS transistor; The second NMOS transistor conducts when the pixel readout instruction is input to its gate, and outputs the reset level corresponding to the j-th pixel and the pixel levels stored in the N sub-exposure level storage sub-modules through its source.
5. An image processing method, characterized in that, Applied in an image processing system, the image processing system includes the pixel readout circuit according to any one of claims 1 to 4; The image processing method includes: Obtaining the target image frame; Detecting that there is a motion trajectory in the target image frame, and determining a target sub-frame; the target sub-frame is at least a part of the N sub-frames; Based on the target sub-frame, identify the target object corresponding to the motion trajectory.
6. The image processing method according to claim 5, wherein The target sub-frame is the sub-frame among the N sub-frames in which the motion trajectory exists.
7. The image processing method according to claim 5, wherein Detecting the existence of a motion trajectory in the target image frame includes: Comparing the target image frame with the first image frame obtained through the first exposure duration last time; When it is detected that the pixel difference between the target image frame and the first image frame exceeds a preset threshold, it is determined that there is a motion trajectory in the target image frame; the first image frame is the image frame obtained through the first exposure duration last time.
8. The image processing method according to claim 5, wherein Detecting the existence of a motion trajectory in the target image frame includes: When it is detected that there are multiple target pixels in the target image frame whose pixel difference from the first image frame exceeds a preset threshold and the multiple target pixels are continuous, it is determined that there is a motion trajectory in the target image frame; the first image frame is the image frame obtained through the first exposure duration last time.
9. An image processing apparatus, characterized in that, Applied in an image processing system, the image processing system includes the pixel readout circuit according to any one of claims 1 to 4; The image processing device includes: An acquisition unit for acquiring the target image frame; A determination unit for determining a target sub-frame when it is detected that there is a motion trajectory in the target image frame; the target sub-frame is at least a part of the N sub-frames; An identification unit for identifying the target object corresponding to the motion trajectory based on the target sub-frame.
10. A computer-readable storage medium, the computer-readable storage medium being a non-volatile storage medium or a non-transitory storage medium, having a computer program stored thereon, characterized in that, When the computer program is run by a processor, it executes the steps of the image processing method according to any one of claims 5 to 8.
11. A computer program product, comprising a computer program / instructions, characterized in that, When the computer program / instructions are executed by a processor, the steps of the image processing method according to any one of claims 5 to 8 are implemented.
12. An image processing apparatus, comprising a memory and a processor, wherein a computer program executable on the processor is stored on the memory, characterized in that When the processor runs the computer program, it executes the steps of the image processing method according to any one of claims 5 to 8.