Pixel array control method, device and electronic equipment

By unifying the control of the rolling shutter and global shutter modules through the pixel array controller, the problem of the inability to control the hybrid pixel array simultaneously in the prior art is solved, realizing independent and simultaneous control, reducing noise, and improving the performance of the image sensor.

CN115396616BActive Publication Date: 2025-11-04VIVO MOBILE COMM CO LTD
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
CN202211049620.5
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2022-08-30
Publication Date
2025-11-04
Estimated Expiration
2042-08-30

AI Technical Summary

Technical Problem

Existing pixel array control methods cannot simultaneously control the hybrid pixel array of a CIS that includes both rolling shutter and global shutter.

Method used

By outputting signals to at least one of the rolling shutter module and the global shutter module through the pixel array controller, at least one row or column of pixels is controlled to reset, expose, and read out, thereby achieving independent or simultaneous control of the rolling shutter and the global shutter.

Benefits of technology

Independent and simultaneous control of the rolling shutter and global shutter modules was achieved, reducing noise and improving the performance of the image sensor.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN115396616B_ABST
    Figure CN115396616B_ABST
Patent Text Reader

Abstract

The application discloses a pixel array control method and device and electronic equipment, and belongs to the technical field of image processing. The image sensor comprises a photoelectric module, a pixel array controller and a plurality of pixels arranged in an array, each pixel comprising a rolling shutter module and a global shutter module; each row or column of rolling shutter modules is connected with the pixel array controller; each row or column of global shutter modules is connected with the pixel array controller, and the pixel array control method comprises: the pixel array controller outputs a reset signal to at least one of the rolling shutter module and the global shutter module, controls at least one row or column of pixels to reset; in the case where the resetting is completed, the at least one row or column of pixels that have completed the resetting is controlled to expose to obtain electric charges; in the case where the exposure is completed, the electric charges are controlled to enter at least one of the rolling shutter module and the global shutter module, and the output signal of the at least one row or column of pixels that have completed the exposure is read.
Need to check novelty before this filing date? Find Prior Art

Description

TECHNICAL FIELD

[0001] The present application belongs to the technical field of image processing, and particularly relates to a pixel array control method and device and electronic equipment. BACKGROUND

[0002] In a complementary metal-oxide semiconductor (COMS) image sensor (CIS), there are two pixel exposure modes: rolling shutter and global shutter. Global shutter pixels are divided into charge domain global shutter and voltage domain global shutter.

[0003] In the related art, CIS widely adopts rolling shutter, and a pixel array control method thereof is that the first row of pixels first performs resetting, then enters an exposure stage, the second row of pixels performs resetting after the first row of pixels completes resetting, and then enters the exposure stage, and after the exposure stage ends, a reading stage is entered, and when signal processing of the first row of pixels is completed, a resetting period of the next frame is directly entered, and until all pixels complete signal processing. Due to the row-by-row staggered characteristics of the rolling shutter, CIS generally adopts a pixel control method of row-by-row scanning, but for a mixed pixel array that simultaneously outputs rolling shutter signals and global shutter signals, the above control method cannot be adopted. The pixel array control method of CIS adopting the global shutter is that pixels on all rows of pixels are uniformly reset, then uniformly exposed, and finally uniformly read. Due to the special control mode of the global shutter, for a mixed pixel array that simultaneously outputs rolling shutter signals and global shutter signals, the above control method cannot be adopted. SUMMARY

[0004] Embodiments of the present application provide a pixel array control method, device and electronic equipment, which can solve the problem that the existing pixel array control method cannot control the pixel array of CIS including rolling shutter and global shutter.

[0005] In a first aspect, embodiments of the present application provide a pixel array control method applied to an image sensor, the image sensor including a photoelectric module, a pixel array controller and a plurality of pixels arranged in an array, each of the pixels including a rolling shutter module and a global shutter module; each row or column of the rolling shutter modules is connected with the pixel array controller; each row or column of the global shutter modules is connected with the pixel array controller, and the pixel array control method includes:

[0006] The pixel array controller outputs a reset signal to at least one of the rolling shutter module and the global shutter module to control at least one row or column of the pixels to perform resetting;

[0007] in the case where the resetting is completed, controlling at least one row or one column of the pixels which have completed the resetting to be exposed to obtain charges;

[0008] in the case where the exposure is completed, controlling the charges to enter at least one of the rolling shutter module and the global shutter module, and reading output signals of at least one row or one column of the pixels which have completed the exposure.

[0009] In a second aspect, an embodiment of the present application provides a pixel array control device, applied to an image sensor, the image sensor comprising a photoelectric module, a pixel array controller and a plurality of pixels arranged in an array, each of the pixels comprising a rolling shutter module and a global shutter module; each row or each column of the rolling shutter modules is connected to the pixel array controller; each row or each column of the global shutter modules is connected to the pixel array controller, and the pixel array control device comprises:

[0010] a resetting module configured to output a resetting signal from the pixel array controller to at least one of the rolling shutter module and the global shutter module, and control at least one row or one column of the pixels to be reset;

[0011] an exposure module configured to, in the case where the resetting is completed, control at least one row or one column of the pixels which have completed the resetting to be exposed to obtain charges;

[0012] a reading module configured to, in the case where the exposure is completed, control the charges to enter at least one of the rolling shutter module and the global shutter module, and read output signals of at least one row or one column of the pixels which have completed the exposure.

[0013] In a third aspect, an embodiment of the present application provides an electronic device, which comprises a processor, a memory, and a program or instructions stored in the memory and executable on the processor, and the program or instructions are executed by the processor to implement the steps of the method according to the first aspect.

[0014] In a fourth aspect, an embodiment of the present application provides a readable storage medium, which stores a program or instructions, and the program or instructions are executed by a processor to implement the steps of the method according to the first aspect.

[0015] In a fifth aspect, an embodiment of the present application provides a chip, which comprises a processor and a communication interface, the communication interface is coupled to the processor, and the processor is configured to execute a program or instructions to implement the method according to the first aspect.

[0016] In the embodiment of the present application, the pixel array controller outputs a signal to at least one of the rolling shutter module and the global shutter module, controls at least one row or column of pixels to reset, controls the at least one row or column of pixels that have completed resetting to expose, obtains charges, controls the charges to enter at least one of the rolling shutter module and the global shutter module, and reads the output signal of the at least one row or column of pixels that have completed exposure. The embodiment of the present application controls the rolling shutter function and the global shutter function of the pixels through the pixel array controller, can control the rolling shutter module or the global shutter module through the pixel array controller output signal, can control the rolling shutter module and the global shutter module at the same time, and can realize independent control and simultaneous control of the rolling shutter module and the global shutter module without using two sets of control methods to control the rolling shutter module and the global shutter module respectively. BRIEF DESCRIPTION OF DRAWINGS

[0017] Figure 1 is a structural schematic diagram of an image sensor provided by an embodiment of the present application;

[0018] Figure 2 is a flowchart of a pixel array control method provided by an embodiment of the present application;

[0019] Figure 3 is a schematic diagram of a pixel array control method implementation timeline provided by an embodiment of the present application;

[0020] Figure 4 is a time sequence diagram of independently controlling a rolling shutter module provided by an embodiment of the present application;

[0021] Figure 5 is a time sequence diagram of independently controlling a global shutter module provided by an embodiment of the present application;

[0022] Figure 6 is a time sequence diagram of simultaneously controlling a rolling shutter module and a global shutter module provided by an embodiment of the present application;

[0023] Figure 7 is a schematic diagram of another pixel array control method implementation timeline provided by an embodiment of the present application;

[0024] Figure 8 is a time sequence diagram of independently controlling a global shutter module provided by an embodiment of the present application;

[0025] Figure 9 is a time sequence diagram of independently controlling a rolling shutter module provided by an embodiment of the present application;

[0026] Figure 10is a time sequence diagram of simultaneously controlling a rolling shutter module and a global shutter module provided by an embodiment of the present application;

[0027] Figure 11 is a schematic diagram of a pixel array control device provided by an embodiment of the present application;

[0028] Figure 12 is a structural schematic diagram of an electronic device provided by an embodiment of the present application;

[0029] Figure 13 is a hardware structural schematic diagram of an electronic device provided by an embodiment of the present application. DETAILED DESCRIPTION

[0030] The technical solutions in the embodiments of the present application will be clearly described below with reference to the drawings in the embodiments of the present application. Obviously, the described embodiments are only some of the embodiments of the present application, but not all of the embodiments of the present application. Based on the embodiments in the present application, all other embodiments obtained by a person of ordinary skill in the art belong to the scope of protection of the present application.

[0031] The terms "first", "second", and the like in the specification and claims of the present application are used to distinguish similar objects, and are not used to describe a specific order or sequence. It should be understood that the data used in this way can be interchanged under appropriate circumstances, so that the embodiments of the present application can be implemented in an order other than those illustrated or described herein, and the objects distinguished by "first", "second", etc. are usually a category, and are not limited to the number of objects, for example, the first object can be one or more. In addition, "and / or" in the specification and claims indicates at least one of the connected objects, and the character " / ", generally indicates that the front and rear associated objects are in a "or" relationship.

[0032] The technical solutions in the embodiments of the present application will be clearly described below with reference to the drawings in the embodiments of the present application. Obviously, the described embodiments are only some of the embodiments of the present application, but not all of the embodiments of the present application. Based on the embodiments in the present application, all other embodiments obtained by a person of ordinary skill in the art belong to the scope of protection of the present application. Figures 1-13 The pixel array control method, device and electronic device provided by the embodiments of the present application will be described in detail below through specific embodiments and application scenarios.

[0033] The pixel array control method provided by the embodiments of the present application is applied to an image sensor, as shown in the figure, the image sensor includes a photoelectric module, a pixel array controller and a plurality of pixels distributed in an array, each pixel includes a rolling shutter module and a global shutter module. Wherein, the photoelectric module can convert light into electric charge, and the pixel array controller can control at least one of the rolling shutter module and the global shutter module by outputting different signals. Figure 1

[0034] As shown in the figure, the image sensor includes a photoelectric module, a pixel array controller and a plurality of pixels distributed in an array, each pixel includes a rolling shutter module and a global shutter module. Wherein, the photoelectric module can convert light into electric charge, and the pixel array controller can control at least one of the rolling shutter module and the global shutter module by outputting different signals. Figure 1 ​As shown, the pixel array can be an M*N array, each row or column of rolling shutter module is connected with the pixel array controller, and each row or column of global shutter module is connected with the pixel array controller. Each pixel in the pixel array receives control of the signal generated by the pixel array controller, wherein the signal for controlling the rolling shutter module includes a rolling shutter reset signal (RS_RST), a rolling shutter charge transfer signal (RS_TX), and a rolling shutter signal output signal (RS_SEL), the signal for controlling the global shutter module includes a global shutter reset signal (GS_RST), a global shutter charge transfer signal (GS_TX), and a global shutter signal output signal (GS_SEL), and a rolling shutter-global shutter charge transfer signal (RS_GS) for controlling the charge transfer from the rolling shutter to the global shutter, and the above signals are controlled to realize the reset, exposure and readout of the pixel in the rolling shutter / global shutter mode. Wherein, the RS_RST, RS_TX, RS_SEL, GS_RST, GS_TX, and GS_SEL signals are controlled by the pixel array controller in a row-parallel or column-parallel manner to access each row or column of pixels, all RS_GS signals are connected to the pixel array controller through a line, that is, global control, and the same RS_GS signal can be imported to all pixels at the same time.

[0035] As shown in Figure 2 , a flowchart of a pixel array control method provided by an embodiment of the present application, as shown in Figure 2 , the pixel array control method can include the contents shown in S101-S103.

[0036] In S101, the pixel array controller outputs a reset signal to at least one of the rolling shutter module and the global shutter module to control at least one row or column of pixels to reset.

[0037] Since the pixels can be row-parallel or column-parallel, at least one row or column of pixels can be controlled to reset. If the rolling shutter signal needs to be output, only the rolling shutter module needs to be controlled to reset, if the global shutter signal needs to be output, only the global shutter module needs to be controlled to reset, and if the rolling shutter signal and the global shutter signal need to be output at the same time, the rolling shutter module and the global shutter module need to be controlled to reset, which is determined by actual application.

[0038] In S102, after the reset is completed, at least one row or column of pixels that have completed the reset are controlled to expose to obtain charges.

[0039] After the reset is completed, the exposure phase is entered, which is performed on at least one row or column of pixels that have completed the reset, and the process can transfer the charges generated by the photoelectric module to the rolling shutter module or the global shutter module.

[0040] In S103, in a case where the exposure is completed, the charge is controlled to enter at least one of the rolling shutter module and the global shutter module, and the output signal of at least one row or column of pixels for which the exposure is completed is read.

[0041] After the exposure is completed, a reading stage is entered, and the output signal of the pixel is read.

[0042] It is worth noting that the sum of the time for any pixel to complete the reset, the exposure, and the reading in the above process is referred to as the time of one frame.

[0043] In the embodiment of the present application, the pixel array controller outputs a signal to at least one of the rolling shutter module and the global shutter module, controls at least one row or column of pixels to be reset, in a case where the reset is completed, controls the at least one row or column of pixels for which the reset is completed to be exposed, obtains the charge, in a case where the exposure is completed, controls the charge to enter at least one of the rolling shutter module and the global shutter module, and reads the output signal of the at least one row or column of pixels for which the exposure is completed. The embodiment of the present application controls the pixel to realize the rolling shutter function and the global shutter function through the pixel array controller, can control the rolling shutter module or the global shutter module through the pixel array controller output signal, and can also control the rolling shutter module and the global shutter module at the same time, without using two sets of control methods to control the rolling shutter module and the global shutter module respectively, so as to realize the independent control and the simultaneous control of the rolling shutter module and the global shutter module.

[0044] As shown in Figure 3 , the embodiment of the present application is based on the logical control method of the traditional rolling shutter, and the control logic of the global shutter is embedded in one frame of time, so that the rolling shutter module and the global shutter module can be controlled at the same time, and the rolling shutter module and the global shutter module can also be controlled independently. Using the scheme provided in the embodiment of the present application, the reset stage is the reset process of the traditional rolling shutter, and if the rolling shutter module output signal is controlled independently, the process is the same as the control method of the traditional rolling shutter. Taking N rows of pixels as an example, the control method of the rolling shutter module controlled independently is as follows, and the time sequence diagram is as shown in Figure 4 .

[0045] The RS_RST and RS_TX signals of the first row of pixels are pulled up to a high voltage level according to reset logic to reset the rolling shutter module and the photodiode (PD) in the pixel. The GS_RST and GS_TX signals control the reset of the global shutter module in the pixel, but since only the rolling shutter needs to be output, the global shutter module can be pulled up to a high voltage level to reset it or can remain at a low voltage level to not reset the global shutter module. The reset signals of the second row of pixels are the same as those of the first row, except that there is a time difference from the reset of the first row. According to the design requirements of the frame rate (equivalent to one frame time) of a user, the time difference can be less than, equal to, or greater than the reset time of the first row of pixels. This is similarly applied to the reset of the Nth row of pixels. After the reset of each row of pixels is completed, the rolling shutter exposure time is entered, during which the RS_TX signal of all pixels remains at a low voltage level to ensure that the charge generated by the exposure of the PD is in the PD. The RS_GS signal of all pixels remains at a low voltage level to ensure that the rolling shutter module and the global shutter module in the pixel are in a disconnected state. When the exposure period is completed, the first row of pixels enters the reading period first, and the RS_TX and RS_SEL signals in the pixel are transferred and read according to the logic. At the same time, some functions such as CDS (Correlated Double Sampling) are also completed during this period. The reading of the second row of pixels is performed after the exposure time of the second row of pixels is completed, and the reading step is performed with a time difference from the first row. According to the requirements and the design of the pixel signal processing link, the time difference can be less than, equal to, or greater than the reading time of the first row of pixels. This is similarly applied to the reading of the Nth row of pixels. After the reading of all rows of pixels is completed, the reset time of the next frame is entered, and the time of a frame is defined as the sum of the reset, exposure, and reading times of any row of pixels, and the sum of the times of any row of pixels is consistent.

[0046] If only the output of the global shutter signal needs to be controlled separately, only the control method of the global shutter needs to be implemented, and the reset process is the same as that of the rolling shutter control method, and is specifically as follows.

[0047] In a possible implementation of the present application, the pixel array controller outputs a reset signal to at least one of a rolling shutter module and a global shutter module to control at least one row or column of pixels to reset, which can include that the pixel array controller outputs a reset signal to the rolling shutter module to control the first row or column of rolling shutter modules to reset.

[0048] Correspondingly, the pixel array control method can further include: after a first preset time length after the first row or the first column of the rolling shutter module is reset, controlling the second row or the second column of the rolling shutter module to be reset until all the rolling shutter modules are reset.

[0049] Specifically, the control method for controlling the output signal of the rolling shutter module has been described in detail above, and will not be described again in the embodiments of the present application.

[0050] After the reset is completed, an exposure phase is entered. Specifically, in one possible embodiment of the present application, in the case where the reset is completed, at least one row or one column of pixels for which the reset is completed is controlled to be exposed to obtain charges, which can include: controlling all rows or all columns of global shutter modules to be reset at the same time after a second preset time length after the reset of the last row or the last column of the rolling shutter module is started; and in the case where the reset of all rows or all columns of the global shutter modules is completed, controlling all rows or all columns of the global shutter modules to be exposed, and controlling the charges generated by the photoelectric module to be transferred to the global shutter modules through the rolling shutter module.

[0051] That is, the reset phase of the global shutter module is started after a period of time after the reset of the last row or the last column of the rolling shutter module is started, and all rows or all columns of the global shutter modules are reset at the same time. After the reset is completed, all rows or all columns of the global shutter modules are exposed at the same time. That is, the global shutter module still follows the principle of simultaneous reset and exposure, but the control of the global shutter module is integrated into the control of the rolling shutter module in the present application, so that the independent control and simultaneous control of the rolling shutter module and the global shutter module can be realized.

[0052] After the exposure is completed, a reading phase is entered. Specifically, in one possible embodiment of the present application, in the case where the exposure is completed, the charges enter at least one of the rolling shutter module and the global shutter module, and the output signal of at least one row or one column of pixels for which the exposure is completed is read, which can include: in the case where the exposure of all rows or all columns of the global shutter modules is completed, the output signal of the first row or the first column of the global shutter module is read.

[0053] Correspondingly, the pixel array control method can further include: after a third preset time length after the output signal of the first row or the first column of the global shutter module is read, the output signal of the second row or the second column of the global shutter module is read until the reading of the output signal of all rows or all columns of the global shutter module is completed.

[0054] The reading in the embodiments of the present application is performed after the global shutter module exposure of all rows or all columns is completed, and the reading is also performed row by row or column by column, which is different from the reading of the traditional global shutter module, so as to be integrated into the control of the rolling shutter module.

[0055] Taking N rows of pixels as an example, the control method of the global shutter module is as follows, and the time sequence diagram is as shown in Figure 5

[0056] At the beginning of a frame time, the RS_RST and RS_TX signals of the first row of pixels are pulled high to reset the rolling shutter module and the PD in the pixel according to the reset logic. The reset signals of the second row of pixels are the same as those of the first row, except that there is a time difference in the reset of the first row. According to the design requirements of the user for the frame rate, the time difference can be less than, equal to or greater than the reset time of the first row of pixels. In this way, the reset of the Nth row of pixels is completed. It is worth noting that at the same time when the Nth row of pixels is reset, the RS_TX, RS_GS, GS_TX and GS_RST signals of all rows of pixels need to be pulled high at the same time according to the logical order. The purpose is to reset all global shutter modules of all pixels in the pixel array at the same time, and sample the charge signals generated by the PD during the rolling shutter exposure time (which is regarded as noise signal and buffered in the global shutter module after reset). After the global shutter module is reset, the global shutter exposure period starts. After the global shutter exposure period ends, the RS_TX signals of all rows are pulled high again to transfer the charge signals generated by the PD to the rolling shutter module. Then, the RS_GS signal is pulled high to transfer the signals, and enters the reading stage. In the reading stage, since only the global shutter signal needs to be output, the RS_SEL signal remains low. The reading mode of the global shutter signal follows the rhythm of the rolling shutter and uses a row-by-row reading mode, and the first row is read first. In each row, the GS_SEL is first pulled high to read and output the noise signals accumulated during the previous global shutter reset period and the global shutter exposure period. Then, the GS_TX and GS_SEL read and output the signals generated during the global shutter exposure period. After all rows of pixels are read, the next frame reset time is entered, and the time of a frame is defined as the sum of the reset, exposure and reading times of any row of pixels, and the sum of the times of any row of pixels is consistent.

[0057] If it is necessary to control the output of the rolling shutter signal and the global shutter signal at the same time, the rolling shutter signal needs to be output on the basis of the control method of the global shutter module described above, and the specific method is as follows. The reset process is the same as that in the control method of the global shutter module described above, and details are described above. The exposure and reading stages are as follows.​

[0058] In a possible implementation of the present application, in the case where the resetting is completed, the exposure of at least one row or one column of pixels whose resetting is completed is controlled to obtain the charges, which can include: in the case where the resetting of the first row or the first column of the rolling shutter module is completed, the exposure of the first row or the first column of the rolling shutter module is controlled, and the charges generated by the photoelectric module are transferred to the rolling shutter module.

[0059] Correspondingly, the pixel array control method can further include: in the case where the resetting of the second row or the second column of the rolling shutter module is completed, the exposure of the second row or the second column of the rolling shutter module is controlled, and the charges generated by the photoelectric module are transferred to the rolling shutter module until the second preset time length from the start of the resetting of the last row or the last column of the rolling shutter module, the resetting of all rows or all columns of the global shutter module is controlled to be performed simultaneously; and in the case where the resetting of all rows or all columns of the global shutter module is completed, the exposure of all rows or all columns of the global shutter module is controlled, and the charges generated by the photoelectric module are transferred to the global shutter module through the rolling shutter module.

[0060] In the embodiments of the present application, the exposure of the first row or the first column of the rolling shutter module is performed when the resetting of the first row or the first column of the rolling shutter module is completed, the exposure of the second row or the second column of the rolling shutter module is performed when the resetting of the second row or the second column of the rolling shutter module is completed, and the resetting of all rows or all columns of the global shutter module is controlled to be performed simultaneously until the second preset time length from the start of the resetting of the last row or the last column of the rolling shutter module. The exposure of all rows or all columns of the global shutter module is controlled to be performed when the resetting of all rows or all columns of the global shutter module is completed. That is, the exposure of the global shutter module is completed in the process of the exposure of the rolling shutter module, and the rolling shutter module and the global shutter module can be controlled simultaneously by the control method of the present application.

[0061] After the exposure, reading is performed. Specifically, in a possible implementation of the present application, in the case where the exposure is completed, the reading of the output signals of at least one row or one column of pixels whose exposure is completed by controlling the charges to enter at least one of the rolling shutter module and the global shutter module can include: in the case where the exposure of all rows or all columns of the global shutter module is completed, the reading of the output signals of the first row or the first column of the global shutter module and the output signals of the first row or the first column of the rolling shutter module is performed.

[0062] Correspondingly, the pixel array control method can further include: in the case where the exposure of the second row or the second column of the rolling shutter module is completed, the reading of the output signals of the second row or the second column of the global shutter module and the output signals of the second row or the second column of the rolling shutter module is performed until the reading of the output signals of all rows or all columns of the global shutter module and the output signals of all rows or all columns of the rolling shutter module is completed.

[0063] That is, the reading process is that the output signals of the rolling shutter module and the global shutter module are read at the same time in the reading mode of the rolling shutter module.

[0064] Taking N rows of pixels as an example, the control method of simultaneously controlling the rolling shutter module and the global shutter module is as follows, and a time sequence diagram is as shown in Figure 6

[0065] The control method of each signal is consistent with the above-mentioned global shutter separate output control method, and the only difference is that the rolling shutter signal needs to be output in this embodiment. Therefore, the RS_SEL signal needs to be pulled high to the high level for CDS sampling (if CDS is not performed, sampling is not needed during the rolling shutter exposure time period) and rolling shutter signal reading during the rolling shutter exposure time period. Similarly, the time of one frame is defined as the sum of the times of completing reset, exposure and reading of any one pixel row, and the sum of the times of any pixel row is consistent.

[0066] The embodiment of the present application integrates the control method of the global shutter into the control method of the rolling shutter based on the control method of the pixel array rolling shutter, and realizes independent control and simultaneous control of the rolling shutter and the global shutter. Since the control of the rolling shutter and the global shutter is completed within one frame of time, the pixel array controlled by the control method can realize rolling shutter signal or global shutter signal output within one frame, or dual output of the rolling shutter signal and the global shutter signal. The embodiment can also select noise reduction methods such as CDS to effectively reduce the noise in the rolling shutter / global shutter output signal.

[0067] In addition to the above-mentioned integration of the control method of the global shutter into the control method of the rolling shutter, as shown in Figure 7 The embodiment of the present application can also embed the control logic of the rolling shutter into the control method of the pixel array global shutter within one frame of time based on the control method of the pixel array global shutter, so that the control method of the present application can simultaneously control the rolling shutter module and the global shutter module, or independently control the rolling shutter module and the global shutter module. Using the scheme provided by the embodiment of the present application, the reset phase is the reset process of the traditional global shutter, that is, all rows or all columns are reset at the same time. If the global shutter module output signal is controlled independently, the process is the same as the control method of the traditional global shutter. Taking N rows of pixels as an example, the control method of independently controlling the global shutter module is as follows, and a time sequence diagram is as shown in Figure 8

[0068] ​​At the beginning of a frame time, the reset period, all the RS_RST, RS_TX, RS_GS, GS_RST, GS_TX signals of all the rows are pulled high to reset the rolling shutter and global shutter modules in each pixel. After the reset, the pixel array enters the global shutter exposure period. After the exposure is completed, the read time is entered. Since only the global shutter signal needs to be output, the RS_SEL signal remains low. The RS_TX signal and the RS_GS signal are pulled high to realize the transfer of the signal from the PD to the global shutter module. Then, the GS_TX and GS_SEL signals are sequentially pulled high according to the logic to realize the CDS function and the read output of the global shutter signal. Depending on the type of pixel signal processing architecture, if it is a row-parallel processing architecture, a row-by-row reading mode is adopted. If it is a pixel-parallel processing architecture, all the rows are processed in a unified reading mode. The time of a frame is defined as the sum of the reset, exposure, and read times of any pixel row, and the sum of the times of any pixel row is consistent.

[0069] If only the output of the rolling shutter signal needs to be controlled separately, only the control method of the rolling shutter needs to be implemented, which is the same as the control method of the global shutter, and is specifically as follows.

[0070] In a possible implementation of the present application, the pixel array controller outputs a reset signal to at least one of the rolling shutter module and the global shutter module, and controls at least one row or one column of pixels to reset, which can include: the pixel array controller outputs a reset signal to the rolling shutter module and the global shutter module, and controls all rows or all columns of the rolling shutter module and all rows or all columns of the global shutter module to reset at the same time.

[0071] Correspondingly, the pixel array control method can further include: sampling the first output signal of the rolling shutter module row by row or column by column after the reset of all rows or all columns of the rolling shutter module and all rows or all columns of the global shutter module is completed.

[0072] Specifically, the control method of the above-mentioned separate control of the global shutter module output signal has been described in detail, and will not be repeated in the embodiments of the present application.

[0073] After the reset is completed, the exposure stage is entered. Specifically, in a possible implementation of the present application, after the reset is completed, the at least one row or one column of pixels that have completed the reset are controlled to be exposed to obtain charges, which can include: after the reset of all rows or all columns of the rolling shutter module and all rows or all columns of the global shutter module is completed, the first row or the first column of the rolling shutter module is controlled to be exposed, and the charges generated by the photoelectric module are transferred to the rolling shutter module.

[0074] Correspondingly, the pixel array control method can further include: controlling the second row or the second column of the rolling shutter module to expose after a fourth preset time length after the first row or the first column of the rolling shutter module starts to expose, and controlling the electric charge generated by the photoelectric module to be transferred to the rolling shutter module until the exposure of all rows or all columns of the rolling shutter module is completed.

[0075] That is, the reset of the rolling shutter module is the same as that of the global shutter module, that is, all rows or all columns are reset at the same time, and when the reset is completed, the first row or the first column of the rolling shutter module exposes, and then a period of time, that is, the second row or the second column of the rolling shutter module exposes, and so on until the exposure of all rows or all columns of the rolling shutter module is completed. That is, the rolling shutter module still follows its exposure principle, but the control of the rolling shutter module is integrated into the control of the global shutter module, so that the independent control and simultaneous control of the rolling shutter module and the global shutter module can be realized.

[0076] After the exposure is completed, the reading stage is entered. Specifically, in one possible embodiment of the present application, when the exposure is completed, the control of the electric charge entering at least one of the rolling shutter module and the global shutter module, and the reading of the output signal of at least one row or one column of pixels exposed can include: when the exposure of the first row or the first column of the rolling shutter module is completed, the second output signal of the first row or the first column of the rolling shutter module is read, and the difference between the second output signal and the first output signal is taken as the output signal of the first row or the first column of the rolling shutter module.

[0077] Correspondingly, the pixel array control method can further include: reading the output signal of the second row or the second column of the rolling shutter module when the exposure of the second row or the second column of the rolling shutter module is completed, and so on until the reading of the output signal of all rows or all columns of the rolling shutter module is completed.

[0078] The reading in the embodiment of the present application is performed when the exposure of the first row or the first column of the rolling shutter module is completed, that is, the second output signal of the first row or the first column of the rolling shutter module is read when the exposure of the first row or the first column of the rolling shutter module is completed, and then the difference between the second output signal and the first output signal is taken as the output signal of the first row or the first column of the rolling shutter module. When the exposure of the second row or the second column of the rolling shutter module is completed, the output signal of the second row or the second column of the rolling shutter module is read, and so on until the reading of the output signal of all rows or all columns of the rolling shutter module is completed. That is, the rolling shutter module still follows its reading principle, but the control of the rolling shutter module is integrated into the control of the global shutter module, so that the independent control and simultaneous control of the rolling shutter module and the global shutter module can be realized.

[0079] Taking N rows of pixels as an example, the control method of the individual control rolling shutter module is as follows, and a time sequence diagram is as shown in Figure 9 .

[0080] Since the basis of this implementation mode is the global shutter control method, the global reset must be performed at the beginning of a frame, consistent with the global shutter control method described above. Then, RS_TX and RS_SEL signals are sequentially pulled high row by row to sample and output. The output sample signal is buffered on the pixel signal processing link, and this sample is completed to mark the beginning of the rolling shutter exposure time period. When the exposure is completed, the reading stage is entered. The reading stage also follows the reading mode of the rolling shutter, and RS_TX and RS_SEL are pulled high row by row for signal reading. The read-out signal is subtracted from the previously buffered sample signal in the pixel signal processing link to obtain the corresponding rolling shutter signal.

[0081] If it is necessary to control the rolling shutter signal and the global shutter signal to be output simultaneously, the pixel array controller control logic needs to implement the global shutter and rolling shutter control method, specifically as follows. The reset process is the same as that in the control method of the individual output of the rolling shutter module described above, and details are described above. The exposure and reading stages are as follows.

[0082] In one possible implementation of the present application, in the case where the reset is completed, the at least one row or column of pixels of which the reset is completed is controlled to expose and obtain charges, which can include: in the case where the reset of all rows or columns of rolling shutter modules and all rows or columns of global shutter modules is completed, the first row or column of rolling shutter modules and all rows or columns of global shutter modules are controlled to expose, and the charges generated by the photoelectric module are transferred to the rolling shutter module and the global shutter module.

[0083] Correspondingly, the pixel array control method can further include: controlling the second row or column of rolling shutter modules to expose and controlling the charges generated by the photoelectric module to be transferred to the rolling shutter module for a fourth preset time length after the exposure of the first row or column of rolling shutter modules starts, until the exposure of all rows or columns of rolling shutter modules is completed.

[0084] In the embodiments of the present application, the exposure of the rolling shutter module still follows its own exposure principle, that is, one row or one column is exposed at a time, and the exposure of the global shutter module also follows its own exposure principle, that is, all rows or all columns are exposed at the same time. The embodiments of the present application only fuse the exposure of the rolling shutter module into the process of global shutter exposure, that is, the exposure of the rolling shutter module is completed in the process of global shutter module exposure, and the rolling shutter module and the global shutter module can be controlled simultaneously by the control method of the present application.

[0085] After exposure, reading is performed, specifically, in one possible implementation of the present application, in the case that exposure of at least one row or one column of pixels is completed, reading the output signal of the at least one row or one column of pixels can include: in the case that exposure of all rows or all columns of global shutter modules is completed, reading the output signal of all rows or all columns of global shutter modules; in the case that exposure of a first row or a first column of rolling shutter modules is completed, reading a second output signal of the first row or the first column of rolling shutter modules, and taking the difference between the second output signal and a first output signal as the output signal of the first row or the first column of rolling shutter modules.

[0086] Correspondingly, the pixel array control method can further include: in the case that exposure of a second row or a second column of rolling shutter modules is completed, reading the output signal of the second row or the second column of rolling shutter modules until reading of the output signal of all rows or all columns of rolling shutter modules is completed.

[0087] In the embodiments of the present application, reading of the global shutter modules still follows the reading principle of the global shutter modules, that is, all rows or all columns are read at the same time, and reading of the rolling shutter modules also follows the reading principle of the rolling shutter modules, that is, one row or one column is read at a time. That is, reading of the rolling shutter modules is completed in the process of exposure and reading of the global shutter modules, and the rolling shutter modules and the global shutter modules can be controlled at the same time by the control method of the present application.

[0088] Taking N rows of pixels as an example, the control method of simultaneously controlling the rolling shutter modules and the global shutter modules is as follows, and a time sequence diagram is as shown in Figure 10 .

[0089] The control method of each signal is basically a combination of the above-mentioned global shutter and rolling shutter control methods. It is worth noting that, in the reading stage, the RS_TX signal is continuously pulled high to the high level until the RS_SEL is pulled high to the high level for reading of the rolling shutter signal. In addition, in the present embodiment, the global shutter exposure time in one frame is longer than the rolling shutter exposure time. Similarly, the time of one frame is defined as the sum of the time of completing reset, exposure and reading of any one pixel row, and the sum of the time of any pixel row is consistent.

[0090] The embodiment of the present application is based on a control method of a pixel array global shutter, integrates a control method of a rolling shutter, and realizes independent control and simultaneous control of the rolling shutter and the global shutter. Since the control of the rolling shutter and the global shutter is completed within one frame, the pixel array controlled by the control method can realize single-frame rolling shutter or global shutter signal output or double output of the rolling shutter and the global shutter signals. The embodiment can also select a noise reduction method such as CDS to effectively reduce the noise in the rolling shutter / global shutter output signals.

[0091] It should be noted that the execution subject of the pixel array control method provided in the embodiment of the present application can be a pixel array control device or a control module in the pixel array control device for executing the pixel array control method. The pixel array control device provided in the embodiment of the present application is described by taking the pixel array control device as an example.

[0092] As shown in Figure 11 , it is a structure block diagram of a pixel array control device provided in the present application. The pixel array control device is applied to an image sensor, and the image sensor includes a photoelectric module, a pixel array controller, and a plurality of pixels arranged in an array. Each pixel includes a rolling shutter module and a global shutter module. The photoelectric module can convert light into electric charge, and the pixel array controller can control at least one of the rolling shutter module and the global shutter module by outputting different signals.

[0093] As shown in Figure 11 , the pixel array control device can include a reset module 1101, an exposure module 1102, and a reading module 1103.

[0094] The reset module 1101 is configured to output a reset signal from the pixel array controller to at least one of the rolling shutter module and the global shutter module, and control at least one row or column of pixels to reset. The exposure module 1102 is configured to control at least one row or column of pixels that have completed resetting to expose and obtain electric charge. The reading module 1103 is configured to control the electric charge to enter at least one of the rolling shutter module and the global shutter module, and read the output signal of at least one row or column of pixels that have completed exposure.

[0095] The embodiment of the present application realizes the rolling shutter function and the global shutter function by controlling the pixels through the pixel array controller. The rolling shutter module or the global shutter module can be controlled separately through the pixel array controller output signal, or the rolling shutter module and the global shutter module can be controlled simultaneously. Two sets of control methods are not needed to control the rolling shutter module and the global shutter module respectively, and independent control and simultaneous control of the rolling shutter module and the global shutter module can be realized.

[0096] In a possible implementation of the present application, the reset module 1101 can be configured to output a reset signal to the rolling shutter module from the pixel array controller, to control the first row or the first column of the rolling shutter module to reset; and after a first preset time length from the reset of the first row or the first column of the rolling shutter module, control the second row or the second column of the rolling shutter module to reset, until all the rolling shutter modules are reset.

[0097] In a possible implementation of the present application, the exposure module 1102 can be configured to, after a second preset time length from the start of the reset of the last row or the last column of the rolling shutter module, control all the rows or all the columns of the global shutter module to reset at the same time; and after the reset of all the rows or all the columns of the global shutter module is completed, control all the rows or all the columns of the global shutter module to expose, and control the charges generated by the photoelectric module to be transferred to the global shutter module through the rolling shutter module.

[0098] In a possible implementation of the present application, the reading module 1103 can be configured to, after the exposure of all the rows or all the columns of the global shutter module is completed, read the output signal of the first row or the first column of the global shutter module; and after a third preset time length from the reading of the output signal of the first row or the first column of the global shutter module, read the output signal of the second row or the second column of the global shutter module, until the reading of the output signal of all the rows or all the columns of the global shutter module is completed.

[0099] In a possible implementation of the present application, the exposure module 1102 can be configured to, after the reset of the first row or the first column of the rolling shutter module is completed, control the first row or the first column of the rolling shutter module to expose, and control the charges generated by the photoelectric module to be transferred to the rolling shutter module; after the reset of the second row or the second column of the rolling shutter module is completed, control the second row or the second column of the rolling shutter module to expose, and control the charges generated by the photoelectric module to be transferred to the rolling shutter module, until a second preset time length from the start of the reset of the last row or the last column of the rolling shutter module, control all the rows or all the columns of the global shutter module to reset at the same time; and after the reset of all the rows or all the columns of the global shutter module is completed, control all the rows or all the columns of the global shutter module to expose, and control the charges generated by the photoelectric module to be transferred to the global shutter module through the rolling shutter module.

[0100] In a possible implementation of the present application, the reading module 1103 can be configured to: read the output signal of the first row or column global shutter module and the output signal of the first row or column rolling shutter module when the exposure of all rows or columns global shutter modules is completed; read the output signal of the second row or column global shutter module and the output signal of the second row or column rolling shutter module when the exposure of the second row or column rolling shutter module is completed, until the reading of the output signal of all rows or columns global shutter modules and the output signal of all rows or columns rolling shutter modules is completed.

[0101] In a possible implementation of the present application, the resetting module 1101 can be configured to: output a reset signal to the rolling shutter module and the global shutter module by the pixel array controller, to control all rows or columns rolling shutter modules and all rows or columns global shutter modules to reset at the same time; sample the first output signal of the rolling shutter module row by row or column by column when the resetting of all rows or columns rolling shutter modules and all rows or columns global shutter modules is completed.

[0102] In a possible implementation of the present application, the exposure module 1102 can be configured to: control the first row or column rolling shutter module to expose and control the charge generated by the photoelectric module to be transferred to the rolling shutter module when the resetting of all rows or columns rolling shutter modules and all rows or columns global shutter modules is completed; control the second row or column rolling shutter module to expose and control the charge generated by the photoelectric module to be transferred to the rolling shutter module at the fourth preset time length after the exposure of the first row or column rolling shutter module starts, until the exposure of all rows or columns rolling shutter modules is completed.

[0103] In a possible implementation of the present application, the reading module 1103 can be configured to: read the second output signal of the first row or column rolling shutter module when the exposure of the first row or column rolling shutter module is completed, and take the difference between the second output signal and the first output signal as the output signal of the first row or column rolling shutter module; read the output signal of the second row or column rolling shutter module when the exposure of the second row or column rolling shutter module is completed, until the reading of the output signal of all rows or columns rolling shutter modules is completed.

[0104] In a possible implementation of the present application, the exposure module 1102 can be configured to: control the first row or first column of rolling shutter modules and all rows or all columns of global shutter modules to perform exposure when exposure of all rows or all columns of rolling shutter modules and all rows or all columns of global shutter modules is completed, and control the charges generated by the photoelectric module to be transferred to the rolling shutter modules and the global shutter modules; control the second row or second column of rolling shutter modules to perform exposure and control the charges generated by the photoelectric module to be transferred to the rolling shutter modules after a fourth preset time length from the start of exposure of the first row or first column of rolling shutter modules, until exposure of all rows or all columns of rolling shutter modules is completed.

[0105] In a possible implementation of the present application, the reading module 1103 can be configured to: read the output signals of all rows or all columns of global shutter modules when exposure of all rows or all columns of global shutter modules is completed; read the second output signals of the first row or first column of rolling shutter modules when exposure of the first row or first column of rolling shutter modules is completed, and take the difference between the second output signals and the first output signals as the output signals of the first row or first column of rolling shutter modules; read the output signals of the second row or second column of rolling shutter modules when exposure of the second row or second column of rolling shutter modules is completed, until reading of the output signals of all rows or all columns of rolling shutter modules is completed.

[0106] The pixel array control apparatus in the embodiments of the present application can be an apparatus, or a component, an integrated circuit, or a chip in a terminal. The apparatus can be a mobile electronic device or a non-mobile electronic device. Exemplarily, the mobile electronic device can be a mobile phone, a tablet computer, a notebook computer, a palm computer, a vehicle-mounted electronic device, a wearable device, an ultra-mobile personal computer (UMPC), a netbook, or a personal digital assistant (PDA), and the like, and the non-mobile electronic device can be a server, a network attached storage (NAS), a personal computer (PC), a television (TV), a teller machine, or a self-service machine, and the like, which are not limited in the embodiments of the present application.

[0107] The pixel array control apparatus in the embodiments of the present application can be an apparatus with an operating system. The operating system can be an Android operating system, an ios operating system, or other possible operating systems, which are not limited in the embodiments of the present application.

[0108] The pixel array control apparatus provided in the embodiments of the present application canFigures 1 to 10 The various processes implemented in the method implementation examples will not be described again here to avoid repetition.

[0109] Optionally, such as Figure 12 As shown, this application embodiment also provides an electronic device 1200, including a processor 1201, a memory 1202, and a program or instructions stored in the memory 1202 and executable on the processor 1201. When the program or instructions are executed by the processor 1201, they implement the various processes of the above-described pixel array control method embodiment and achieve the same technical effect. To avoid repetition, they will not be described again here.

[0110] It should be noted that the electronic devices in the embodiments of this application include the mobile electronic devices and non-mobile electronic devices described above.

[0111] Figure 13 A schematic diagram of the hardware structure of an electronic device to implement an embodiment of this application.

[0112] The electronic device 1300 includes, but is not limited to, components such as: radio frequency unit 1301, network module 1302, audio output unit 1303, input unit 1304, sensor 1305, display unit 1306, user input unit 1307, interface unit 1308, memory 1309, and processor 1310.

[0113] Those skilled in the art will understand that the electronic device 1300 may also include a power supply (such as a battery) for supplying power to various components. The power supply may be logically connected to the processor 1310 through a power management system, thereby enabling functions such as managing charging, discharging, and power consumption through the power management system. Figure 13 The electronic device structure shown does not constitute a limitation on the electronic device. The electronic device may include more or fewer components than shown, or combine certain components, or have different component arrangements, which will not be elaborated here.

[0114] The processor 1310 is configured to control the pixel array controller to output a reset signal to at least one of the rolling shutter module and / or the global shutter module, thereby controlling at least one row or column of pixels to be reset; when the reset is complete, controlling the at least one row or column of pixels to be exposed to generate a charge; and when the exposure is complete, controlling the charge to enter at least one of the rolling shutter module and / or the global shutter module to read the output signal of the at least one row or column of pixels that have been exposed.

[0115] In the embodiment of the present application, the pixel array controller outputs a signal to at least one of the rolling shutter module and the global shutter module, controls at least one row or column of pixels to reset, controls the at least one row or column of pixels that have completed resetting to expose, obtains charges, controls the charges to enter at least one of the rolling shutter module and the global shutter module, and reads the output signal of the at least one row or column of pixels that have completed exposure. The embodiment of the present application controls the rolling shutter function and the global shutter function of the pixels through the pixel array controller, can control the rolling shutter module or the global shutter module through the pixel array controller output signal, can control the rolling shutter module and the global shutter module at the same time, and can realize independent control and simultaneous control of the rolling shutter module and the global shutter module without using two sets of control methods to control the rolling shutter module and the global shutter module respectively.

[0116] It should be understood that in the embodiment of the present application, the input unit 1304 can include a graphics processing unit (GPU) 13041 and a microphone 13042. The graphics processing unit 13041 processes image data of a still picture or a video obtained by an image capture device (such as a camera) in a video capture mode or an image capture mode. The display unit 1306 can include a display panel 13061, which can be configured in the form of a liquid crystal display, an organic light-emitting diode, etc. The user input unit 1307 includes a touch panel 13071 and other input devices 13072. The touch panel 13071 is also called a touch screen. The touch panel 13071 can include a touch detection device and a touch controller. The other input devices 13072 can include, but are not limited to, a physical keyboard, function keys (such as volume control keys, on-off keys, etc.), a trackball, a mouse, a joystick, and the like, which will not be described here. The memory 1309 can be used to store software programs and various data, including but not limited to application programs and an operating system. The processor 1310 can integrate an application processor and a modem processor, wherein the application processor mainly processes the operating system, the user interface and the application programs, and the modem processor mainly processes wireless communication. It can be understood that the above-mentioned modem processor can also not be integrated into the processor 1310.

[0117] The embodiment of the present application also provides a readable storage medium, the readable storage medium stores a program or instructions, the program or instructions are executed by a processor to realize the processes of the above-mentioned pixel array control method embodiment, and the same technical effects can be achieved. To avoid repetition, details are not described here.

[0118] The processor is the processor in the electronic device described in the above embodiments. The readable storage medium includes a computer readable storage medium, such as a computer read-only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disk.

[0119] The chip provided in the embodiments of the present application includes a processor and a communication interface, the communication interface is coupled with the processor, the processor is used to run programs or instructions, realizes the processes of the pixel array control method embodiments, and achieves the same technical effects. To avoid repetition, details are not described herein.

[0120] It should be understood that the chip mentioned in the embodiments of the present application can also be referred to as a system-level chip, a system chip, a chip system, or a system-on-chip, etc.

[0121] It should be noted that in this document, the terms "comprising", "including", or any other variant thereof are intended to cover non-exclusive inclusion, so that processes, methods, articles, or devices including a series of elements not only include those elements, but also include other elements not explicitly listed, or include elements inherent to such processes, methods, articles, or devices. Without more limitations, the element defined by the statement "including a" does not exclude the presence of additional identical elements in the process, method, article, or device including the element. In addition, it should be pointed out that the scope of the methods and devices in the embodiments of the present application is not limited to the order of performing the functions as shown or discussed, but can also include performing the functions in a substantially simultaneous manner or in reverse order, for example, the described method can be performed in an order different from the described order, and various steps can also be added, omitted, or combined. In addition, the features described with reference to some examples can be combined in other examples.

[0122] From the above description of the embodiments, those skilled in the art can clearly understand that the above-mentioned embodiment method can be realized by means of software and necessary general hardware platform, of course, it can also be realized by hardware, but in many cases, the former is a better embodiment. Based on such understanding, the technical solutions of the present application can be embodied in the form of a computer software product, which is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk), and includes a plurality of instructions for making a terminal (which can be a mobile phone, computer, server, or network device, etc.) execute the methods described in the embodiments of the present application.

[0123] The embodiments of the present application are described above with reference to the accompanying drawings, but the present application is not limited to the specific embodiments described above, and the specific embodiments described above are merely illustrative, but not restrictive, and a person of ordinary skill in the art can make many forms under the inspiration of the present application without departing from the purpose of the present application and the scope protected by the claims.

Claims

1. A pixel array control method applied to an image sensor, the image sensor comprising a photoelectric module, a pixel array controller, and a plurality of pixels arranged in an array, each pixel comprising a rolling shutter module and a global shutter module; each row or column of the rolling shutter module being connected to the pixel array controller; each row or column of the global shutter module being connected to the pixel array controller, characterized in that, The pixel array control method includes: The pixel array controller outputs a reset signal to the rolling shutter module and the global shutter module to control at least one row or column of pixels to be reset; Upon completion of the reset, at least one row or column of pixels that have completed the reset are exposed to obtain charge. When the exposure is complete, the charge is controlled to enter the rolling shutter module and the global shutter module to read the output signal of at least one row or column of the pixels after the exposure is complete.

2. The pixel array control method according to claim 1, characterized in that, The pixel array controller outputs a reset signal to the rolling shutter module and the global shutter module to control at least one row or column of pixels to reset, including: The pixel array controller outputs a reset signal to the rolling shutter module to control the rolling shutter module in the first row or the first column to reset; The method further includes: After a first preset time period following the reset of the rolling shutter modules in the first row or first column, the rolling shutter modules in the second row or second column are controlled to reset until all rolling shutter modules have completed the reset.

3. The pixel array control method according to claim 2, characterized in that, Upon completion of the reset, controlling at least one row or column of pixels to be exposed to obtain charge includes: During the second preset duration after the roller shutter module in the last row or last column is reset, control all global shutter modules in all rows or all columns to reset simultaneously. When the global shutter modules in all rows or all columns have been reset, control the global shutter modules in all rows or all columns to perform exposure, and control the charge generated by the photoelectric module to be transferred to the global shutter module through the rolling shutter module.

4. The pixel array control method according to claim 3, characterized in that, When the exposure is complete, controlling the charge to enter the rolling shutter module and the global shutter module, and reading the output signal of at least one row or column of pixels after the exposure is complete, includes: After all rows or columns of the global shutter module have been exposed, the output signal of the global shutter module in the first row or first column is read. The method further includes: After a third preset time period for reading the output signal of the global shutter module in the first row or first column, the output signal of the global shutter module in the second row or second column is read, until the output signals of the global shutter modules in all rows or all columns are read.

5. The pixel array control method according to claim 2, characterized in that, Upon completion of the reset, controlling at least one row or column of pixels to be exposed to obtain charge includes: When the rolling shutter module in the first row or first column is reset, the rolling shutter module in the first row or first column is controlled to perform exposure, and the charge generated by the photoelectric module is controlled to be transferred to the rolling shutter module. The method further includes: When the rolling shutter module in the second row or second column has been reset, the rolling shutter module in the second row or second column is controlled to perform exposure, and the charge generated by the photoelectric module is controlled to be transferred to the rolling shutter module. Until the second preset time period after the last row or last column of the rolling shutter module resets, the global shutter modules in all rows or all columns are controlled to reset simultaneously. When the global shutter modules in all rows or all columns have been reset, control the global shutter modules in all rows or all columns to perform exposure, and control the charge generated by the photoelectric module to be transferred to the global shutter module through the rolling shutter module.

6. The pixel array control method according to claim 5, characterized in that, When the exposure is complete, controlling the charge to enter the rolling shutter module and the global shutter module, and reading the output signal of at least one row or column of pixels after the exposure is complete, includes: When the exposure of the global shutter module in all rows or all columns is completed, the output signal of the global shutter module in the first row or first column and the output signal of the rolling shutter module in the first row or first column are read. The method further includes: When the exposure of the rolling shutter module in the second row or second column is completed, the output signals of the global shutter module in the second row or second column and the output signals of the rolling shutter module in the second row or second column are read until the output signals of the global shutter module in all rows or all columns and the output signals of the rolling shutter module in all rows or all columns are read.

7. The pixel array control method according to claim 1, characterized in that, The pixel array controller outputs a reset signal to the rolling shutter module and the global shutter module to control at least one row or column of pixels to reset, including: The pixel array controller outputs a reset signal to the rolling shutter module and the global shutter module, controlling all rows or all columns of the rolling shutter module and all rows or all columns of the global shutter module to reset simultaneously; The method further includes: Once all rows or all columns of the rolling shutter module and all rows or all columns of the global shutter module have been reset, the first output signal of the rolling shutter module is sampled row by row or column by column.

8. The pixel array control method according to claim 7, characterized in that, Upon completion of the reset, controlling at least one row or column of pixels to be exposed to obtain charge includes: When all rows or columns of the rolling shutter module and all rows or columns of the global shutter module have been reset, control the first row or column of the rolling shutter module to perform exposure, and control the charge generated by the photoelectric module to transfer to the rolling shutter module; The method further includes: After a fourth preset time following the start of exposure of the rolling shutter module in the first row or first column, the rolling shutter module in the second row or second column is controlled to perform exposure, and the charge generated by the photoelectric module is controlled to be transferred to the rolling shutter module until the exposure of all rows or all columns of the rolling shutter module is completed.

9. The pixel array control method according to claim 8, characterized in that, When the exposure is complete, controlling the charge to enter the rolling shutter module and the global shutter module, and reading the output signal of at least one row or column of pixels after the exposure is complete, includes: When the exposure of the rolling shutter module in the first row or first column is completed, the second output signal of the rolling shutter module in the first row or first column is read, and the difference between the second output signal and the first output signal is taken as the output signal of the rolling shutter module in the first row or first column. The method further includes: After the exposure of the rolling shutter module in the second row or second column is completed, the output signal of the rolling shutter module in the second row or second column is read, until the output signal of the rolling shutter module in all rows or all columns is read.

10. The pixel array control method according to claim 7, characterized in that, Upon completion of the reset, controlling at least one row or column of pixels to be exposed to obtain charge includes: When all rows or columns of the rolling shutter module and all rows or columns of the global shutter module have been reset, control the first row or first column of the rolling shutter module and all rows or columns of the global shutter module to perform exposure, and control the charge generated by the photoelectric module to be transferred to the rolling shutter module and the global shutter module; The method further includes: After a fourth preset time following the start of exposure of the rolling shutter module in the first row or first column, the rolling shutter module in the second row or second column is controlled to perform exposure, and the charge generated by the photoelectric module is controlled to be transferred to the rolling shutter module until the exposure of all rows or all columns of the rolling shutter module is completed.

11. The pixel array control method according to claim 10, characterized in that, When the exposure is complete, controlling the charge to enter the rolling shutter module and the global shutter module, and reading the output signal of at least one row or column of pixels after the exposure is complete, includes: Once the exposure of the global shutter module in all rows or all columns is complete, read the output signal of the global shutter module in all rows or all columns. When the exposure of the rolling shutter module in the first row or first column is completed, the second output signal of the rolling shutter module in the first row or first column is read, and the difference between the second output signal and the first output signal is taken as the output signal of the rolling shutter module in the first row or first column. The method further includes: After the exposure of the rolling shutter module in the second row or second column is completed, the output signal of the rolling shutter module in the second row or second column is read, until the output signal of the rolling shutter module in all rows or all columns is read.

12. A pixel array control device applied to an image sensor, the image sensor comprising a photoelectric module, a pixel array controller, and a plurality of pixels arranged in an array, each pixel comprising a rolling shutter module and a global shutter module; each row or column of the rolling shutter module being connected to the pixel array controller; each row or column of the global shutter module being connected to the pixel array controller, characterized in that, The pixel array control device includes: A reset module is used by the pixel array controller to output a reset signal to the rolling shutter module and the global shutter module to control at least one row or one column of pixels to be reset. An exposure module is configured to, upon completion of the reset, control at least one row or column of pixels that have been reset to be exposed to obtain charge; The reading module is used to control the charge to enter the rolling shutter module and the global shutter module when the exposure is completed, and to read the output signal of at least one row or one column of the pixels after the exposure is completed.

13. An electronic device, characterized in that, It includes a processor, a memory, and a program or instructions stored in the memory and executable on the processor, wherein the program or instructions, when executed by the processor, implement the steps of the pixel array control method as described in any one of claims 1-11.

Citation Information

Patent Citations

  • Imaging apparatus, operation method of imaging apparatus, and operation program of imaging apparatus

    US20190215470A1