A high frame rate CMOS image sensor and its control method

Abstract

This application discloses a high frame rate CMOS image sensor and its control method, belonging to the field of CMOS image sensing technology. The image sensor includes: a row selector for decoding received row address signals and sending row selection signals to a pixel array; a pixel array for converting light signals into voltage signals row by row, unit by unit for individual pixels; a column selector for selecting specific columns from each readout row of pixels, including a general column selector used for full-frame readout and a dedicated column selector for ROI readout, and the dedicated ROI column selector enables the reuse of the analog-to-digital converter for the region of interest (ROI) during ROI readout; an analog-to-digital converter for converting analog signals of pixels into digital signals and outputting them to an image signal processor; and a control unit. This application improves the output frame rate of the region of interest and enhances the smoothness of alternating readout between the ROI and full-frame.

Description

Technical Field

[0001] This application belongs to the field of CMOS image sensing technology, specifically relating to a high frame rate CMOS image sensor and its control method. Background Technology

[0002] Typically, the output frame rate of CMOS image sensors is limited by the number of pixel rows. Pixel binning methods used to improve frame rate inevitably lead to a decrease in resolution. Therefore, in recent years, a scheme for separate output of the Region of Interest (ROI) has been developed. This involves cropping out the surrounding non-interesting content and retaining only the central ROI, thereby reducing the number of readout pixel rows and increasing the frame rate. Clearly, separate ROI output is only suitable for situations where the viewer's gaze is focused on a specific part of the image and is unconcerned about other surrounding subjects—that is, the Region of Non-Interest (RONI). Its drawback is that it sacrifices the integrity of the image.

[0003] To address the aforementioned issues, existing technologies have proposed a method of alternating ROI and full-frame readout. This method involves storing ROI data in memory after each full-frame readout, and then combining the ROI data with the ROI data to create a full-frame image each time the ROI is read out separately. However, the frame rate of the full-frame mode differs from that of the ROI mode, affecting the smoothness of the image.

[0004] Furthermore, when an ROI is read out individually, the column selector and analog-to-digital converter (ADC) are fixed within each minimum cycle unit because the ROI is not being read out, leaving its corresponding column selector and ADC idle. This waste of resources also limits the upper frame rate limit for reading out individual ROIs. Summary of the Invention

[0005] To address the issue of insufficient utilization of digital-to-analog converters during ROI readout in existing technologies, this application proposes a high frame rate CMOS image sensor and its control method. This image sensor, by configuring a dedicated column selector for ROI, enables the use of the digital-to-analog converter in the ROI region during individual ROI readout, thereby accelerating the data readout efficiency of ROI and increasing the output frame rate of ROI images.

[0006] This application is achieved through the following technical solution:

[0007] A high frame rate CMOS image sensor, comprising:

[0008] The row selector is used to decode the received row address signal and then send the row selection signal to the pixel array.

[0009] A pixel array, consisting of regions of interest and regions of non-interest, is responsible for converting light signals into voltage signals row by row, unit by individual pixel.

[0010] A column selector is used to select a specific column in each row of pixels read out, including a general column selector used when reading out the whole frame and a dedicated column selector for the region of interest (ROI) when reading out the region of interest separately. The dedicated column selector for the ROI enables the analog-to-digital converter of the region of interest to be reused when reading out the region of interest separately.

[0011] An analog-to-digital converter is used to convert analog signals of pixels into digital signals and output them to an image signal processor.

[0012] An image signal processor is used to store or process received pixel data.

[0013] And a control unit for controlling the operation of the row selector, column selector, analog-to-digital converter and image signal processor.

[0014] In some implementations, the number of pixel signal lines and column selectors configured in each column of the floating diffuser in the region of interest is P times the number of pixel signal lines and column selectors configured in each column of the floating diffuser in the region of non-interest, while the number of pixel columns corresponding to the region of interest should be less than or equal to 1 / P of the total number of pixel columns;

[0015] Where P is a positive integer greater than 1.

[0016] In some implementations, the column selector further includes an ROI region selector;

[0017] The ROI region selector is positioned between the ROI dedicated column selector and the pixel array;

[0018] The image signal processor detects the position of the moving object frame by frame and transmits the moving object position information to the control unit. The control unit controls the ROI region selector to select the position of the region of interest in the pixel array based on the moving object position information and outputs the pixel signal line at that position to the ROI dedicated column selector.

[0019] In some implementations, the control unit outputs a corresponding control signal to the column selector based on the current readout mode, including:

[0020] In full-frame readout mode, the control unit disables the ROI-specific column selector, enables the normal column selector, and selects the corresponding pixel signal line.

[0021] In the Region of Interest (ROI) readout mode, the control unit disables the normal column selector, controls the ROI region selector to select the ROI region according to the position of the moving object, and simultaneously enables the ROI dedicated column selector to select the corresponding pixel signal line.

[0022] In some implementations, the control unit employs a control method that switches between a region-of-interest readout mode and a full-frame readout mode, and in the full-frame readout mode, it employs a horizontally spaced readout method.

[0023] In some implementations, the horizontal interval readout method includes:

[0024] For a pixel array constructed using Quad-Bayer, data is read out every other pixel row. The image signal processor then copies the data from the read-out pixel rows to the unread-out pixel rows to complete the full-frame image.

[0025] In some implementations, the horizontal interval readout method includes:

[0026] For a pixel array constructed by Bayer, data is read out every two pixel rows. The image signal processor then copies the data from the read-out pixel rows to the unread-out pixel rows to complete the full-frame image.

[0027] On the other hand, this application also proposes a control method for a high frame rate CMOS image sensor according to any of the above embodiments, including:

[0028] The system switches between a region of interest (ROI) readout mode and a full-frame readout mode, and uses the ROI-specific column selector in the ROI readout mode.

[0029] The aforementioned control of switching between the region-of-interest readout mode and the full-frame readout mode includes:

[0030] After reading N-1 frames of data from the region of interest, the system switches to full-frame readout for 1 frame, and this cycle repeats. Here, N is the ratio of the frame rate in the region of interest readout mode to the frame rate in the full-frame readout mode. When N is not a positive integer, N-1 is rounded up.

[0031] Each time the full frame is read out, new data of the uninterested area is stored in memory;

[0032] Each time the region of interest data is read out, it is merged with the region of non-interest data in the memory to output a full-frame image.

[0033] In some implementations, the control method further includes:

[0034] When reading pixel data in full-frame readout mode, a horizontally spaced readout method is used.

[0035] In some implementations, the control method further includes:

[0036] The full-frame readout mode reads out pixel data and continuously detects moving objects through the image signal processor;

[0037] When no moving object is detected, the full-frame image is output and the full-frame readout mode continues to read out pixel data;

[0038] When a moving object is detected, the system switches between the region of interest readout mode and the full-frame readout mode.

[0039] This application discloses a high frame rate CMOS image sensor and its control method. The image sensor, by configuring a dedicated ROI column selector, enables the use of the ROI region's analog-to-digital converter during individual ROI readout, thereby accelerating the data readout efficiency of the ROI region and increasing the output frame rate of the ROI image. Furthermore, based on continuously detected moving object position information, the image sensor uses the configured ROI region selector to select the pixel signal lines of the target region (i.e., the region of interest) in real time, achieving high frame rate readout of the ROI while dynamically adjusting the ROI region. Additionally, when alternating between ROI and full-frame readout, the image sensor uses a horizontally spaced readout method for full-frame pixel data, improving the frame rate difference between full-frame and ROI, thus enhancing the smoothness of the image during mode switching. Attached Figure Description

[0040] The accompanying drawings, which are included to provide a further understanding of the embodiments of this application and form part of this application, do not constitute a limitation on the embodiments of this application. In the drawings:

[0041] Figure 1 This is a schematic diagram of the image sensor structure proposed in the embodiments of this application;

[0042] Figure 2 This is a schematic diagram illustrating the connection relationship between a typical column selector, a floating diffuser in a pixel array, and an ADC.

[0043] Figure 3 In order to be in Figure 2 The diagram shows the connection relationships after adding the ROI-specific column selector.

[0044] Figure 4 This is a schematic diagram illustrating the connection relationship between a dedicated ROI column selector that can dynamically adjust the ROI region, the floating diffuser, and the ADC.

[0045] Figure 5 This describes the connection relationship between the control unit and the column selector.

[0046] Figure 6 A schematic diagram of horizontal interval readouts constructed for Quad-Bayer;

[0047] Figure 7 A schematic diagram of horizontal interval readouts constructed for Bayer;

[0048] Figure 8 Example 1 is a flowchart of the control method according to an embodiment of this application;

[0049] Figure 9 When N=5, use Figure 8 A schematic diagram of the mode switching of the control method shown;

[0050] Figure 10 Example 2 is a flowchart of the control method according to an embodiment of this application;

[0051] Figure 11 When N=5, use Figure 10 The diagram shows the mode switching of the control method. Detailed Implementation

[0052] In the following, the terms “comprising” or “may include” as used in the various embodiments of this application indicate the presence of a function, operation, or element of the invention and do not limit the addition of one or more functions, operations, or elements. Furthermore, as used in the various embodiments of this application, the terms “comprising,” “having,” and their cognates are intended only to indicate a specific feature, number, step, operation, element, component, or combination of the foregoing and should not be construed as primarily excluding the presence of one or more other features, numbers, steps, operations, elements, components, or combinations of the foregoing, or adding one or more combinations of the foregoing.

[0053] In various embodiments of this application, the expression "or" or "at least one of A and / or B" includes any combination or all combinations of the words listed simultaneously. For example, the expression "A or B" or "at least one of A and / or B" may include A, may include B, or may include both A and B.

[0054] The terms used in the various embodiments of this application (such as "first," "second," etc.) may modify various constituent elements in the various embodiments, but do not limit the corresponding constituent elements. For example, the above terms do not limit the order and / or importance of the elements. The above terms are only used for the purpose of distinguishing one element from other elements. For example, a first user device and a second user device refer to different user devices, although both are user devices. For example, without departing from the scope of the various embodiments of this application, a first element may be referred to as a second element, and similarly, a second element may be referred to as a first element.

[0055] It should be noted that if a description is made of "connecting" one component to another, then the first component can be directly connected to the second component, and a third component can be "connected" between the first and second components. Conversely, when a component is "directly connected" to another component, it can be understood that there is no third component between the first and second components.

[0056] The terminology used in the various embodiments of this application is for the purpose of describing particular embodiments only and is not intended to limit the various embodiments of this application. As used herein, the singular form is intended to include the plural form as well, unless the context clearly indicates otherwise. Unless otherwise defined, all terms used herein (including technical and scientific terms) have the same meaning as commonly understood by one of ordinary skill in the art to which the various embodiments of this application pertain. The terms (such as those defined in a generally used dictionary) are to be interpreted as having the same meaning as in the context of the relevant technical field and are not to be interpreted as having an idealized or overly formal meaning, unless clearly defined in the various embodiments of this application.

[0057] To make the objectives, technical solutions, and advantages of this application clearer, the following detailed description is provided in conjunction with the embodiments and accompanying drawings. The illustrative embodiments and descriptions of this application are only for explaining this application and are not intended to limit this application.

[0058] Existing methods that alternate between ROI and full-frame readout suffer from insufficient image smoothness due to the different frame rates in full-frame and ROI modes. Furthermore, existing methods for reading out ROI alone result in insufficient utilization of the analog-to-digital converter. To address these issues, this application proposes a high frame rate CMOS image sensor, specifically as follows: Figure 1 As shown, the image sensor includes a pixel signal readout unit, a control unit, a memory, and an image signal processor; wherein the pixel signal readout unit includes:

[0059] The pixel array is responsible for converting light signals into voltage signals row by row, with each pixel as a unit. The rectangular pixel array in the middle, which occupies about a quarter of the pixel array area, is the region of interest (ROI) of the image, and the rest is the region of non-interest (RONI).

[0060] The row selector is used to decode the row address signal from the control unit and then send the row selection signal to the pixel array.

[0061] Column selectors are used to select specific columns in each row of pixels read out, including the general column selector used when reading out the whole frame, the ROI region selector used when reading out the ROI separately, and the ROI-specific column selector.

[0062] A ramp signal generator is used to generate a ramp signal that is compared with the pixel signal.

[0063] A comparator is used to compare the ramp signal and the pixel signal and output the comparison result;

[0064] Furthermore, an analog-to-digital converter (ADC) converts the pixel voltage signal into a digital signal based on the comparison result of the comparator and the clock of the counter, and outputs it to the image signal processor. It should be noted that the improvements to the image sensor in this application do not involve comparators and ADCs; in the following description, the comparator will be incorporated into the ADC, typically an ADC (Analog-Digital Converter).

[0065] The control unit controls all operations of the row selector, column selector, ramp signal generator, comparator, and analog-to-digital converter when reading pixel signals row by row. When the image signal processor outputs a moving object detection signal, the control unit controls the image signal processor to store the pixel data of the ROI into the memory, and after the ROI is read out, it controls the image signal processor to merge the ROI data with the ROI data in the memory into full-frame data. In addition, during the ROI readout process, the image signal processor detects the position of the moving object frame by frame, and the control unit controls the ROI region selector to select the position of the ROI region in the pixel array based on the moving object position information.

[0066] Furthermore, Figure 2 A schematic diagram illustrating the connection relationship between a typical column selector (SW0~SW7) and the floating diffusion (FD) and ADC in the pixel array is shown. As shown in the figure, when four column selectors and four ADCs are configured for every two columns of FD, at least four reads are required to complete the reading in ROI mode. Table 1 shows one possible readout order.

[0067] Table 1

[0068] Column selector sequence number read order SW2 SW3 SW4 SW5 first FD02 FD00 FD10 FD12 The second FD03 FD01 FD11 FD13 The third FD06 FD04 FD14 FD16 Fourth FD07 FD05 FD15 FD17

[0069] It should be noted that at this time, only the column selectors (SW2~SW5) and analog-to-digital converters (ADC2~ADC5) of the ROI region are involved in pixel signal readout, while the column selectors and analog-to-digital converters of the RONI region are not used.

[0070] Furthermore, Figure 3This diagram illustrates the connection relationships between the column selectors, FD, and ADC after adding ROI-specific column selectors (ROI SW0~SW7) to the standard column selectors. As shown in the figure, in ROI mode, the pixel signal lines are connected to the eight ROI-specific column selectors, and the outputs of these selectors are connected to the eight ADCs (four for the ROI region and four for the ROI region). Reading in the order shown in Table 2 requires only two reads, thus halving the time to read FD data and correspondingly reducing the frame length, thereby increasing the frame rate.

[0071] Table 2

[0072] Column selector sequence number read order ROI SW0 ROI SW1 ROI SW2 ROI SW3 ROI SW4 ROI SW5 ROI SW6 ROI SW7 first FD03 FD02 FD01 FD00 FD10 FD11 FD12 FD13 The second FD07 FD06 FD05 FD04 FD14 FD15 FD16 FD17

[0073] It should be noted that since the number of ADCs actually used in every two columns of FD in the ROI region is twice that of the RONI, in order not to increase the total number of ADC loops, the number of pixel columns in the ROI region should be less than or equal to 1 / 2 of the total number of pixel columns.

[0074] Similarly, the number of pixel signal lines and column selectors (ROI-specific column selectors) configured in each column of the FD in the ROI region can be adjusted to P times the number of pixel signal lines and column selectors (normal column selectors) configured in each column of the FD in the ROI region. The output frame rate of the ROI will also increase by the corresponding multiple. At the same time, the number of pixel columns corresponding to the ROI should be less than or equal to 1 / P of the total number of pixel columns (P can be any positive integer greater than 1).

[0075] Furthermore, in practical applications, the ROI (Region of Interest) is often not fixed within the entire frame and needs to be adjusted based on the captured image information. For example, when a surveillance camera captures a moving object, if the object moves to one side of the frame, the camera also needs to rotate in the same direction to keep the target object always in the frame and, as far as possible, keep the object in the ROI area in the center of the frame. If the object continues to move out of the lens when the camera rotates to its maximum range of motion, then in order to ensure a high frame rate for the moving part of the image, the position of the ROI area in the frame needs to be adjusted in a timely manner.

[0076] Figure 4 This illustrates a simplified connection between a dedicated ROI column selector and the FD and ADC that can be dynamically adjusted for ROI regions. Figure 3 Based on this, an ROI region selector was added between the ROI-dedicated column selector and the FD. The connections between the ROI-dedicated column selector and the regular column selector and ADC, as well as the connections between the FD and the regular column selector and ADC, remain unchanged. All pixel signal lines are arranged in a loop along the horizontal direction for each FD, and are input to the ROI region selector. It is understandable that... Figure 4 Lieutenant General Figure 3 The 4-column column selector (FD) is padded to a 6-column FD, and a corresponding ADC and column selector are added. However, the connection relationship between the ROI-specific column selector and the regular column selector and ADC remains unchanged. For example... Figure 4 As shown, in the horizontal direction, a set of normal column selectors or ROI-specific column selectors are configured for every two columns of FD (separated by dashed lines). The pixel signal lines input to the ROI region selector are also grouped in pairs of FD (thick black lines). The control unit outputs control signals to the ROI region selector in pairs of FD. All pixel signal lines are connected to the ROI region selector in the exact same way.

[0077] When a moving object moves to the left side of the screen, the ROI region selector receives a control signal from the control unit, selects the corresponding area on the left side of the screen as the ROI region, and outputs the pixel signal lines on that side to the dedicated ROI column selector for subsequent readout. Each time the moving object's position changes in the screen, after the current frame is output, the image signal processor transmits the moving object's position information to the control unit. The control unit then controls the ROI region selector to select the ROI region for the next frame, thus achieving dynamic adjustment of the ROI region while outputting high frame rates.

[0078] Furthermore, Figure 5 The connection between the control unit and the two types of column selectors is shown. The control unit outputs corresponding control signals to the column selectors according to the current readout mode. During full-frame readout, the control unit closes the dedicated ROI column selector, opens the normal column selector, and selects the corresponding pixel signal lines; during ROI readout alone, the control unit closes the normal column selector, controls the ROI area selector to select the ROI area based on the position of the moving object, and simultaneously opens the dedicated ROI column selector to select the corresponding pixel signal lines.

[0079] Furthermore, when switching between full-frame readout mode and ROI standalone readout mode, to address the issue of discontinuous frame rates in the final output image due to the difference in frame length between full-frame mode and ROI mode, this application embodiment shortens the frame length by changing the data readout method of full-frame mode. Based on different pixel structures, this application embodiment illustrates two different methods for horizontally spaced readout:

[0080] (1) The horizontal intervals of the Quad-Bayer construction are read out, such as Figure 6 As shown, for a pixel array constructed by Quad-Bayer, since the color filters of every two adjacent pixel rows are exactly the same, a row can be read out every other pixel row. The image signal processor copies the data of the read pixel row to the unread pixel row to complete the full-frame image.

[0081] (2) Read out the horizontal intervals of the Bayer construction, such as Figure 7 As shown, for a pixel array constructed by Bayer, since the color filters are exactly the same for every two pixel rows, two rows can be read out every two pixel rows. The image signal processor copies the data of the read pixel rows to the unread pixel rows to complete the full-frame image.

[0082] Furthermore, embodiments of this application also propose a control method based on the above-described image sensor, the control method comprising:

[0083] The system switches between ROI mode and full-frame mode, and uses a dedicated ROI column selector to accelerate readout efficiency when reading out ROIs individually; optionally, a horizontally spaced readout method is used when reading out full-frame images. Specifically, such as... Figure 8 As shown, let m be the number of consecutive frames for the Region of Interest (ROI), and let N be the frame rate of the ROI read out individually, which is N times the frame rate of the full-frame readout. After reading out N-1 consecutive frames from the ROI (N can be a non-positive integer, in which case N-1 should be rounded up), the system switches to reading out 1 full-frame frame, and this process repeats. Each time a full-frame readout occurs, the pixel data of the new ROI region is stored in memory; each time the ROI is read out individually, it is merged with the ROI data in memory to form a full-frame image for output, thus achieving a high frame rate for the ROI region.

[0084] Figure 9 The diagram illustrates mode switching in an embodiment of this application when N=5. When using a dedicated column selector for the Region of Interest (ROI) (with a 2:1 ratio to the number of regular column selectors for the ROI), data readout time is halved, and the output frame rate is doubled. Simultaneously, the full-frame mode employs a horizontally spaced readout method, improving the smoothness of alternating readout between the region of interest and the full-frame view. In the diagram, FULL represents full-frame readout.

[0085] Furthermore, in Figure 8 Based on the mode switching shown, the control method of this application embodiment further includes:

[0086] When reading pixel data in full-frame mode, the image signal processor continuously detects moving objects. If no moving object is detected, a full-frame image is output while full-frame data continues to be read. At this time, the output image is at the normal full-frame frame rate, and the sensor circuit is in a relatively low-power state. When moving object is detected, the system switches between ROI mode and full-frame mode until the moving object detection is deactivated (i.e., no moving object is detected), at which point it returns to continuous full-frame mode (i.e., outputting a full-frame image and continuing to read full-frame data). Figure 10 As shown.

[0087] Figure 11 The diagram shows the moving body detection and mode switching when N=5 (the effect of the ROI dedicated column selector is omitted).

[0088] The image sensor and its control method proposed in this application configure a dedicated ROI column selector, enabling the use of the ROI region's analog-to-digital converter when reading out the ROI alone, thereby accelerating the data readout efficiency of the ROI and improving the output frame rate of the ROI image. Secondly, based on continuously detected moving object position information, the pixel signal lines of the target region are selected in real time through the ROI region selector, realizing high frame rate readout of the ROI while dynamically adjusting the ROI region. In addition, when reading out the ROI and full-frame alternately, the frame rate difference between the full-frame and ROI is improved by using a horizontal interval readout method for the full-frame pixels, thereby improving the smoothness of the image during mode switching.

[0089] The specific embodiments described above further illustrate the purpose, technical solution, and beneficial effects of this application. It should be understood that the above description is only a specific embodiment of this application and is not intended to limit the scope of protection of this application. Any modifications, equivalent substitutions, improvements, etc., made within the spirit and principles of this application should be included within the scope of protection of this application.

Claims

1. A high frame rate CMOS image sensor, characterized in that, include: The row selector is used to decode the received row address signal and then send the row selection signal to the pixel array. A pixel array, consisting of regions of interest and regions of non-interest, is responsible for converting light signals into voltage signals row by row, unit by individual pixel. A column selector is used to select a specific column in each row of pixels read out, including a general column selector used when reading out the whole frame and a dedicated column selector for the region of interest (ROI) when reading out the region of interest separately. The dedicated column selector for the ROI enables the analog-to-digital converter of the region of interest to be reused when reading out the region of interest separately. An analog-to-digital converter is used to convert analog signals of pixels into digital signals and output them to an image signal processor. An image signal processor is used to store or process received pixel data. And a control unit for controlling the operation of the row selector, column selector, analog-to-digital converter and image signal processor.

2. The high frame rate CMOS image sensor according to claim 1, characterized in that, The number of pixel signal lines and column selectors configured in each column of the floating diffuser in the region of interest is P times the number of pixel signal lines and column selectors configured in each column of the floating diffuser in the region of non-interest, and the number of pixel columns corresponding to the region of interest should be less than or equal to 1 / P of the total number of pixel columns; Where P is a positive integer greater than 1.

3. A high frame rate CMOS image sensor according to claim 2, characterized in that, The column selector also includes an ROI region selector; The ROI region selector is positioned between the ROI dedicated column selector and the pixel array; The image signal processor detects the position of the moving object frame by frame and transmits the moving object position information to the control unit. The control unit controls the ROI region selector to select the position of the region of interest in the pixel array based on the moving object position information and outputs the pixel signal line at that position to the ROI dedicated column selector.

4. A high frame rate CMOS image sensor according to claim 3, characterized in that, The control unit outputs corresponding control signals to the column selector according to the current readout mode, including: In full-frame readout mode, the control unit disables the ROI-specific column selector, enables the normal column selector, and selects the corresponding pixel signal line. In the Region of Interest (ROI) readout mode, the control unit disables the normal column selector, controls the ROI region selector to select the ROI region according to the position of the moving object, and simultaneously enables the ROI dedicated column selector to select the corresponding pixel signal line.

5. A high frame rate CMOS image sensor according to any one of claims 1-4, characterized in that, The control unit employs a control method that switches between a region-of-interest readout mode and a full-frame readout mode, and in the full-frame readout mode, it uses a horizontally spaced readout method.

6. A high frame rate CMOS image sensor according to claim 5, characterized in that, The horizontal interval readout method includes: For a pixel array constructed using Quad-Bayer, data is read out every other pixel row. The image signal processor then copies the data from the read-out pixel rows to the unread-out pixel rows to complete the full-frame image.

7. A high frame rate CMOS image sensor according to claim 5, characterized in that, The horizontal interval readout method includes: For a pixel array constructed by Bayer, data is read out every two pixel rows. The image signal processor then copies the data from the read-out pixel rows to the unread-out pixel rows to complete the full-frame image.

8. A control method for a high frame rate CMOS image sensor according to any one of claims 1-7, characterized in that, include: The system switches between a region of interest (ROI) readout mode and a full-frame readout mode, and uses the ROI-specific column selector in the ROI readout mode. The switching between the region-of-interest readout mode and the full-frame readout mode includes: After reading N-1 frames of data from the region of interest, the system switches to full-frame reading for 1 frame, and this cycle repeats. Here, N is the ratio of the frame rate in the ROI standalone reading mode to the frame rate in the full-frame reading mode. When N is not a positive integer, N-1 is rounded up. Each time the full frame is read out, new data of the uninterested area is stored in memory; Each time the region of interest data is read out, it is merged with the region of non-interest data in the memory to output a full-frame image.

9. The control method according to claim 8, characterized in that, Also includes: When reading pixel data in full-frame readout mode, a horizontally spaced readout method is used.

10. The control method according to claim 8 or 9, characterized in that, Also includes: The full-frame readout mode reads out pixel data and continuously detects moving objects through the image signal processor; When no moving object is detected, the full-frame image is output and the full-frame readout mode continues to read out pixel data; When a moving object is detected, the system switches between the region of interest readout mode and the full-frame readout mode.

Images