Image sensor, image processing system, and method for operating the same

Abstract

An image sensor, an image processing system, and an operation method thereof are disclosed. The image sensor includes: a pixel array including a plurality of pixels arranged in a matrix, the plurality of pixels being configured to generate individual pixel signals; a row driver configured to selectively read the pixel signals generated by the pixels of a plurality of rows of the pixel array; a merging circuit configured to selectively sum or pass through the read pixel signals to generate merged pixel signals; a column array including a plurality of analog-to-digital converters (ADCs) configured to perform analog-to-digital conversion on the merged pixel signals; and a mode selection circuit configured to: based on a mode signal received at the image sensor for changing an operation mode of the image sensor, control the row driver and the merging circuit to change the operation mode of the image sensor.

Description

[0001] This application claims the benefit of Korean Patent Application No. 10-2019-0092007, filed on Jul. 29, 2019, in the Korean Intellectual Property Office, the disclosure of which is incorporated herein by reference in its entirety. Technical Field

[0002] The present inventive concept relates to an image sensor. More particularly, the present inventive concept relates to a method of reading out an image sensor and a configuration for implementing the method. Background Art

[0003] An image capturing device including an image sensor may be included in various types of electronic devices (such as a smart phone, a personal computer (PC), a surveillance camera, and a vehicle), or may be used as a stand-alone electronic device.

[0004] The image capturing device may include a charge-coupled device (CCD) image sensor or a complementary metal-oxide semiconductor (CMOS) image sensor as the image sensor. The CMOS image sensor is simpler to drive than the CCD image sensor and may include a signal processing circuit integrated in a single chip. Accordingly, the CMOS image sensor is miniaturized, and due to low power consumption, the CMOS image sensor is widely used in portable electronic devices such as smart phones.

[0005] An image sensor is a sensor in which a plurality of pixels configured to convert an optical signal into an electrical signal are integrated. The image sensor may include a plurality of transistors for each pixel, and the image sensor may control turning on / off the transistors. The electrical signal converted by the pixels may be read out, and a global shutter method or the like may be used as a readout method. The global shutter method may read out the electrical signal converted by the pixels in a specific row unit order, or may read out the electrical signal in a column unit order that is arbitrarily changed according to a control signal.

[0006] For example, the pixels of a CMOS image sensor may be read out in a specific column unit order from the uppermost end to the lowermost end, or after reading out the pixels of the CMOS image sensor from the middle to the lowermost end in column units according to a control signal, the pixels of the CMOS image sensor may be read out from the uppermost end to the middle in column units. Summary of the Invention

[0007] The present inventive concept provides an image sensor based on generating a plurality of images having two or more image angles using one camera module.

[0008] According to an aspect of the inventive concept, an image sensor may include: a pixel array including a plurality of pixels arranged in a matrix, the plurality of pixels being configured to generate individual pixel signals; a row driver configured to selectively read pixel signals generated by pixels of a plurality of rows of the pixel array; a combining circuit configured to selectively sum or pass through the read pixel signals to generate combined pixel signals; a column array including a plurality of analog-to-digital converters (ADCs) configured to perform analog-to-digital conversion on the combined pixel signals; and a mode selection circuit configured to control the row driver and the combining circuit to change an operation mode of the image sensor based on a mode signal received at the image sensor for changing the operation mode of the image sensor.

[0009] According to another aspect of the inventive concept, an image processing system may include: an image sensor configured to change a readout of rows of pixels of a pixel array according to an operation mode of the image sensor; and a processing circuit configured to process a frame output from the image sensor. The image sensor may include a pixel array, wherein the pixel array includes a plurality of pixels arranged in a matrix, the plurality of pixels being configured to generate individual pixel signals in units of rows of pixels of the plurality of rows of the pixel array. The image sensor may include: a row driver configured to selectively read pixel signals generated by pixels of selected rows among the plurality of rows; a combining circuit configured to selectively sum or pass through the read pixel signals to generate combined pixel signals; a column array configured to perform analog-to-digital conversion on the combined pixel signals; and a mode selection circuit configured to control the row driver and the combining circuit to change an operation mode of the image sensor based on a mode signal received at the image sensor. The processing circuit may be configured to output a cropping signal for setting a region of interest (ROI), output a mode signal for setting an operation mode of the image sensor, and process row images of an image read from the image sensor.

[0010] According to another aspect of the inventive concept, an operation method of an image sensor may include: generating a signal for commanding to read at least one row corresponding to an ROI among a plurality of rows of a pixel array based on a cropping signal associated with the region of interest (ROI); reading odd rows among the plurality of rows of the pixel array; and reading even rows among the plurality of rows of the pixel array in response to an even row corresponding to the ROI. Description of the Drawings

[0011] Example embodiments of the inventive concept will be more clearly understood from the following detailed description in conjunction with the accompanying drawings, in which:

[0012] Figure 1is a block diagram of an electronic device including an image sensor according to some example embodiments of the inventive concept;

[0013] Figure 2 is a block diagram of an image processing system including an image sensor according to some example embodiments of the inventive concept;

[0014] Figure 3 is a block diagram of an image sensor according to some example embodiments of the inventive concept;

[0015] Figure 4A is a diagram illustrating an example of a readout method of an image sensor and a readout image according to some example embodiments of the inventive concept;

[0016] Figure 4B is a diagram illustrating another example of a readout method of an image sensor and a readout image according to some example embodiments of the inventive concept;

[0017] Figure 4C is a diagram illustrating a readout method of a readout signal according to a pixel array of an image sensor according to some example embodiments of the inventive concept;

[0018] Figure 5A is a diagram illustrating an example of a readout method of an image sensor and a readout image according to some example embodiments of the inventive concept;

[0019] Figure 5B and Figure 5C are diagrams respectively illustrating readout methods of different readout signals according to a pixel array of an image sensor according to example embodiments of the inventive concept;

[0020] Figure 6A is a diagram illustrating an output of images having different viewing angles according to a readout method according to some example embodiments of the inventive concept;

[0021] Figure 6B and Figure 6C are diagrams respectively illustrating readout methods of different readout signals according to a pixel array of an image sensor according to example embodiments of the inventive concept;

[0022] Figure 7A is a diagram illustrating another output of images having different viewing angles according to a readout method according to some example embodiments of the inventive concept;

[0023] Figure 7B is a diagram illustrating a readout method according to some example embodiments of the inventive concept, in which a pixel array of an image sensor is read according to a readout signal in one frame;

[0024] Figure 8A table that summarizes the readout signals and binning signals output for each operation mode according to some example embodiments of the inventive concept;

[0025] Figure 9 A circuit diagram showing a binning circuit of an image sensor according to some example embodiments of the inventive concept performing a summing operation on signals;

[0026] Figure 10 A diagram showing an interpolation operation of an image sensor according to some example embodiments of the inventive concept;

[0027] Figure 11 A block diagram of an image processing system according to some example embodiments of the inventive concept;

[0028] Figure 12 A flowchart of an operation method of an image sensor according to some example embodiments of the inventive concept;

[0029] Figure 13 A flowchart of an operation method of an image sensor in a first operation mode according to some example embodiments of the inventive concept;

[0030] Figure 14 and Figure 15 A flowchart of an operation method of an image sensor in a second operation mode according to some example embodiments of the inventive concept; and

[0031] Figure 16 A flowchart of an operation method of an image processing system in a second operation mode according to some example embodiments of the inventive concept. DETAILED DESCRIPTION

[0032] Hereinafter, example embodiments of the inventive concept will be described in detail with reference to the accompanying drawings.

[0033] Figure 1 A block diagram showing an electronic device 1 including an image sensor 100 according to some example embodiments of the inventive concept. Figure 1 The electronic device 1 in [reference] may correspond to various systems including the image sensor 100. For example, various mobile devices (such as digital cameras, camcorders, smartphones, and vehicles equipped with cameras) may correspond to Figure 1 the electronic device 1 in [reference].

[0034] As Figure 1As shown in [Figure 0], the electronic device 1 may include an application processor (hereinafter referred to as AP) 20, a complementary metal oxide semiconductor (CMOS) image sensor 100, a sensor system 30, a modem 40, a storage device 50, and a display device 60. The AP 20 may be implemented in various forms. For example, the AP 20 may be implemented as a system on a chip (SoC). The AP 20 may include a system having various functions and may control the overall operations related to the driving of the electronic device 1.

[0035] As an example of the image sensor 100, a CMOS image sensor (hereinafter, referred to as an image sensor) may include a pixel array, and each pixel included in the pixel array may include a photosensitive element. The photosensitive element may generate an electrical signal according to the intensity of the absorbed light. An image processing system may be provided in the AP 20 or may be provided separately to receive the electrical signal from the image sensor 100, process the electrical signal, and convert the electrical signal into digital data.

[0036] The image sensor 100 may be embedded in the electronic device 1 or may be implemented as the electronic device 1. The electronic device 1 may be implemented as, for example, a personal computer (PC), an Internet of Things (IoT) device, or a portable electronic device. The portable electronic device may include a laptop computer, a mobile phone, a smart phone, a tablet PC, a personal digital assistant (PDA), an enterprise digital assistant (EDA), a digital camera, a digital camcorder, an audio device, a portable multimedia player (PMP), a personal navigation device (PND), an MP3 player, a handheld game console, an e-book, a wearable device, etc.

[0037] The sensor system 30 may include an accelerometer sensor, a compass sensor, a global positioning system (GPS) sensor, a gyroscope sensor, an odometer, a geomagnetic sensor, a radio detection and ranging (RADAR) device, a light detection and ranging (LIDAR) device, etc. The sensor system 30 may obtain positioning information indicating the position of the vehicle. In addition, the sensor system 30 may physically measure the surrounding environment of the vehicle.

[0038] The modem 40 may support establishing a wired communication channel or a wireless communication channel between the electronic device 1 and an external electronic device (not shown), and may support communication via the established communication channel. The modem 40 may include one or more communication processors that operate independently of the AP 20 and support wired communication or wireless communication. According to some example embodiments, the modem 40 may include a wireless communication module (not shown) (e.g., a cellular communication module, a near-field communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module (not shown) (e.g., a local area network (LAN) communication module or a power line communication module), and may communicate with an external electronic device via a network by using the corresponding communication module. The various types of modems 40 described above may be implemented in one chip or in separate chips.

[0039] The storage device 50 may store various system or user data required to drive the electronic device 1. For example, the storage device 50 may include a non-volatile memory that stores various types of information in a non-volatile manner and a volatile memory in which information related to the operation of the electronic device 1 (such as firmware) is loaded, and the like.

[0040] The display device 60 may be an example of an output device. Other examples of output devices may include a graphics / display device, a computer screen, an alarm system, a computer-aided design / computer-aided manufacturing (CAD / CAM) system, a video game console, a smart phone display screen, or any other type of data output device.

[0041] Although Figure 1 the electronic device 1 is shown as including functional blocks such as the AP 20, the sensor system 30, the modem 40, the storage device 50, and the display device 60, example embodiments are not limited thereto. For example, the AP 20 may include various types of intellectual property (IP) blocks, and thus, an image processing system ( Figure 2At least some of the functions of 10) in and some of the functions of the modem 40 may be executed in the AP 20. In some example embodiments, the image processing system 10 and / or the modem 40 may be integrated in the AP 20. It will be understood that any functional block and all functional blocks described herein may be implemented by one or more instances of a processing circuit (such as hardware including logic circuits, a hardware / software combination (such as a processor executing software), or a combination thereof). For example, the processing circuit may more specifically include, but is not limited to: a central processing unit (CPU), an arithmetic logic unit (ALU), a digital signal processor, a microcomputer, a field programmable gate array (FPGA), a system on a chip (SoC), a programmable logic unit, a microprocessor, an application specific integrated circuit (ASIC), etc. In some example embodiments, the processing circuit may include a non-transitory computer-readable storage device (such as a memory) storing a program of instructions, such as a solid state drive (SSD), and a processor configured to execute the program of instructions to implement the functions of one or more of the functional blocks described herein.

[0042] At least some of the APs 20 described herein may be included in one or more instances of a processing circuit (such as hardware including logic circuits, a hardware / software combination (such as a processor executing software), or a combination thereof), may include one or more instances of a processing circuit, and / or may be implemented by one or more instances of a processing circuit. For example, the processing circuit may more specifically include, but is not limited to: a central processing unit (CPU), an arithmetic logic unit (ALU), a digital signal processor, a microcomputer, a field programmable gate array (FPGA), a system on a chip (SoC), a programmable logic unit, a microprocessor, an application specific integrated circuit (ASIC), etc. In some example embodiments, the processing circuit may include a non-transitory computer-readable storage device (such as a memory) storing a program of instructions, such as a solid state drive (SSD), and a processor configured to execute the program of instructions to implement the functions of at least some of the APs 20. It will be understood that the AP 20 may be implemented by the same instance of the processing circuit or a separate instance of the processing circuit.

[0043] In some example embodiments, at least some of the image sensors 100 may be included in one or more instances of processing circuitry (such as hardware including logic circuitry, a hardware / software combination such as a processor executing software, or a combination thereof), may include one or more instances of processing circuitry, and / or may be implemented by one or more instances of processing circuitry. For example, the processing circuitry may more specifically include, but is not limited to, a central processing unit (CPU), an arithmetic logic unit (ALU), a digital signal processor, a microcomputer, a field programmable gate array (FPGA), a system on a chip (SoC), a programmable logic unit, a microprocessor, an application specific integrated circuit (ASIC), etc. In some example embodiments, the processing circuitry may include a non-transitory computer-readable storage device (e.g., a memory) storing a program of instructions, such as a solid state drive (SSD), and a processor configured to execute the program of instructions to implement the functions of at least some of the image sensors 100.

[0044] Figure 2 is a block diagram showing Figure 1 some example embodiments of the image sensor 100 in Figure 2 Also shown is an image processing system 10, which includes an image signal processor (hereinafter referred to as ISP) 200 of the AP 20 together with the image processing system 10.

[0045] The image sensor 100 may convert an optical signal incident on an object 80 through an optical lens into an electrical signal or an image (i.e., image data). For example, the image sensor 100 may include a pixel array ( Figure 3 130 in

[0046] The image sensor 100 may further include a mode selection circuit 110 and a binning circuitry 140. The mode selection circuit 110 receives a mode signal of information related to an operation mode and accordingly changes the operation mode of the image sensor 100. The binning circuitry 140 selectively sums the electrical signals output from a plurality of pixels or passes the electrical signals as they are to output binned pixel signals. This issue will be described later. As described herein, the image sensor 100 may output specific pixel signals as image data based on a specific operation mode. Therefore, the image sensor 100 can generate various images with various viewing angles, sizes, and / or resolutions via various methods based on being configured to change the operation mode.

[0047] The ISP 200 may perform image processing on the row data Row_DTA provided from the image sensor 100 and generate a converted image. That is, the ISP 200 may process the frame output from the image sensor 100. For example, the ISP 200 may perform image processing on the row data Row_DTA based on a set white balance, parameters, color space, etc. The converted image may include a color space image (e.g., red-green-blue (RGB) and YUV). The size (i.e., resolution) of the converted image may be the same as the size of the row data Row_DTA. The converted image may be output (e.g., displayed) in the display device 60 and / or processed by one or more parts of the electronic device 1 (e.g., utilized by the navigation computer of the vehicle electronic device 1 to facilitate navigation and / or driving operations). The converted image may be stored in a memory (not shown). The memory (not shown) may include a volatile memory (such as a dynamic random access memory (RAM) (DRAM), a static RAM (SRAM), etc.) or a non-volatile memory (such as a phase change RAM (PRAM), a resistive RAM (ReRAM), or a flash memory, etc.). The converted image stored in the memory (not shown) may be used later by the image processing system 10 or stored in a storage device.

[0048] In addition, the ISP 200 may generate a scaled image by reducing or increasing the size of the converted image. For example, the ISP 200 may generate a scaled image by scaling the size of the image that has been converted to match the resolution of the display device 60 (i.e., by scaling the resolution). The ISP 200 may provide the scaled image to the display device 60.

[0049] The ISP 200 may operate according to a command of the embedded AP in the AP 20 set in the electronic device 1. In addition, the ISP 200 may be separately provided in the electronic device 1 from the AP 20. Hereinafter, the ISP 200 will be described based on being embedded in the AP 20.

[0050] The ISP 200 may include an interpolator 210 for recovering row data Row_DTA that has been lost during image processing based on the converted image. This issue will be described later. It will be understood that the ISP 200 may be implemented by the processing circuit as described above, where the processing circuit may be included in the AP 20 and / or the processing circuit may implement the AP 20.

[0051] Figure 3 is a block diagram of an image sensor 100 according to some example embodiments of the inventive concept.

[0052] Referring to Figure 3 , the image sensor 100 may include a mode selection circuit 110, a row driver 120, a pixel array 130, a merging circuit 140, and a column array 150. In addition to these components, the image sensor 100 may further include additional components for improving processing speed and generating images with various perspectives. The image sensor 100 may include a CMOS image sensor.

[0053] The mode selection circuit 110 may generate a signal for changing the operation mode of the image sensor 100 based on an external signal received at the mode selection circuit 110 from a signal source external to the image sensor 100 (e.g., the operation mode of the image sensor 100 may be changed by generating one or more signals for controlling the operation of the merging circuit 140 and generating one or more signals for controlling the operation of the row driver 120). For example, the mode selection circuit 110 may change the operation mode of the image sensor 100 by receiving, as one or more external signals, a mode signal MODE associated with changing the mode of the image sensor 100 and a cropping signal CROP including information about a region of interest (ROI) from the AP 20. The mode signal MODE may set the operation mode of the image sensor 100. The cropping signal CROP may set the region of interest ROI. For example, the mode selection circuit 110 of the image sensor 100 may change the operation mode of the image sensor 100 by generating a readout signal and by generating a merging signal, the readout signal controlling the row driver 120 to change the readout method of the pixel array 130, and the merging signal controlling the merging circuit 140 to sum or pass the electrical signals output from multiple pixels. Accordingly, it will be understood that the image sensor 100 may be configured to change the readout of the rows of pixels of the pixel array 130 according to a specific operation mode, thereby providing improved performance, versatility, and / or efficiency in the use of computing resources and / or power with respect to providing various images having various perspectives, resolutions, and / or sizes.

[0054] The pixel array 130 may include a plurality of row lines, a plurality of column lines, and a plurality of pixels 131. Each pixel 131 is connected to a row line and a column line, and the plurality of pixels 131 are arranged in a matrix. Each pixel 131 may perform the function of a photoelectric conversion element that converts light into an electrical signal, and each pixel 131 may include a photosensitive element (not shown, such as a photodiode, a photogate, and a phototransistor) capable of accumulating optical charges. Each pixel 131 may sense light by using a light sensing element and convert the sensed light into a pixel signal as an electrical signal. Therefore, it will be understood that the plurality of pixels 131 of the pixel array 130 are configured to generate individual pixel signals. Hereinafter, it is assumed that each pixel 131 of the pixel array 130 includes a photodiode as a light sensing element. In some example embodiments, the pixels 131 of the pixel array 130 are configured to generate individual pixel signals in units of rows among the multiple rows of pixels 131 of the pixel array 130.

[0055] The row driver 120 may drive the pixel array 130 in units of rows based on a readout signal and selectively read a plurality of rows. In other words, the row driver 120 may selectively read pixel signals generated by pixels in a plurality of rows of the pixel array. The row driver 120 may selectively read pixel signals generated by pixels in a selected row among the plurality of rows of the pixel array 130. The row driver 120 may decode an applied signal (e.g., a readout signal generated by the mode selection circuit 110), and in response, select and read at least one row (e.g., a set of rows, where the set may include a single row) among the rows at least partially including the pixel array 130. The set of rows may correspond to the ROI. It will be understood here that the "set" of rows may include only one row. It will be understood here that the "set" of rows may include a plurality of rows. The mode selection circuit 110 may generate a readout signal based on a crop signal CROP received at the image sensor 100, and the readout signal causes the row driver 120 to selectively read a set of rows corresponding to the ROI, where the crop signal CROP includes row information corresponding to the ROI. For example, the row driver 120 may read pixel signals by sequentially driving the pixel array 130 from the first row in response to the readout signal, or only read odd rows, or read pixel signals by sequentially driving a set of rows corresponding to the ROI, or only read odd rows among the set of rows corresponding to the ROI. In the present specification, the image sensor 100 is described as reading odd rows among a plurality of rows and skipping even rows, but the example embodiments are not limited thereto. On the contrary, it will be understood that only even rows are read while odd rows are skipped.

[0056] The combining circuit 140 may selectively sum pixel signals received via column lines of the columns where the pixels read from the pixel array 130 are located based on a combining signal, or pass the pixel signals received via column lines of the columns where the pixels read from the pixel array 130 are located. The pixel signals summed or passed by the combining circuit 140 may be referred to as combined pixel signals, and the combined pixel signals are generated by the combining circuit 140 based on summing the pixel signals received at the combining circuit 140 or passing the pixel signals received at the combining circuit 140. The operation of the combining circuit 140 will be described in detail later with reference to Figure 9 Describe the operation of the combining circuit 140 in detail.

[0057] The column array 150 may convert pixel signals (e.g., combined pixel signals) received via column lines and summed or passed by the combining circuit 140 into digital values based on address signals provided by a timing generation circuit, store the converted digital values, and then output the stored digital values, where the timing generation circuit generates signals (e.g., row control signals, address signals, clock signals, and ramp control signals) for driving each component of the image sensor 100. In addition, the converted digital values may be post-processed by the AP 20 on a row-by-row basis. The image sensor 100 may output the digital values as row data Row_DTA to the AP 20 on a row-by-row basis. Accordingly, the AP 20 may process the row data Row_DTA as a row image of the image read from the image sensor 100.

[0058] The column array 150 may include a plurality of analog-to-digital converters (ADCs, Figure 11 151 in). Each of the plurality of ADCs 151 may receive a pixel signal from a corresponding column line among a plurality of column lines and convert the pixel signal into a digital value. In other words, the ADC 151 may perform analog-to-digital conversion on the combined pixel signal received from the combining circuit 140. Accordingly, the column array 150 may be configured to perform analog-to-digital conversion on the combined pixel signal received from the combining circuit 140 at the column array 150.

[0059] Multiple pixel signals output from multiple pixels may have deviations caused by the inherent characteristics of each pixel 131 (e.g., fixed pattern noise (FPN), etc.), and / or deviations caused by the characteristic differences between the logics used to output pixel signals from the pixels 131 (e.g., transistors for outputting the optical charges stored in the photoelectric conversion elements in the pixels 131). To compensate for the deviations between the multiple pixel signals output via multiple column lines, the reset signal (or reset component) and the cell signal (or unit component) of the pixel signals may be extracted, and then the difference (e.g., voltage difference) between them may be extracted as the effective signal component. The process performed in this way is referred to as correlated double sampling (hereinafter, referred to as CDS). The ADC 151 may output a comparison signal as a signal that is the comparison result to which CDS has been applied, and the column array 150 may output a digital value by counting the output comparison signal.

[0060] The method of reading the pixel array 130 may be classified into a method of reading by row unit and a method of reading by column unit.

[0061] The row reading methods may include a row-full-read (R_Full_Read) method, a row-crop-read (R_Crop_Read) method, a row-1read-1skip (R_1Read_1Skip) method, a row-1read-2skip (R_1Read_2Skip) method, and a row-1read-3skip (R_1Read_3Skip) method. In the row-full-read method, all the multiple rows of the pixel array 130 are read; in the row-crop-read method, a selected area among the rows of the pixel array 130 is read; in the row-1read-1skip method, the row driver 120 alternately repeats reading any one of the multiple rows of the pixel array 130 and skipping another row; in the row-1read-2skip method, the row driver 120 alternately repeats reading any one of the multiple rows of the pixel array 130 and continuously skipping two rows immediately below that any one row; in the row-1read-3skip method, the row driver 120 alternately repeats reading any one of the multiple rows of the pixel array 130 and continuously skipping three rows immediately below that any one row. However, there may be various additional row reading methods.

[0062] The column-by-column reading method may include a column-full-read method, a column-1read-1skip (C_1Read_1skip) method, a 2-binning method, and a 3-binning method. In the column-full-read method, pixel signals of all pixels 131 on a read row in a plurality of rows of the pixel array 130 are received, and all pixel signals are digitally converted as they are; in the 1-column-skip-1-column method, the column array 150 receives only the pixel signals of each odd-numbered row. In the merging 2-column method, the merging circuit 140 receives pixel signals of two adjacent pixels 131 in a read row among rows of the pixel array 130 and sums them, outputs the summed pixel signal to the column array 150, and the column array 150 digitally converts the summed pixel signal; in the merging 3-column method, the merging circuit 140 receives pixel signals of three adjacent pixels 131 in a read row among rows of the pixel array 130 and sums them, outputs the summed pixel signal to the column array 150, and the column array 150 digitally converts the summed pixel signal. However, there may be additional various column-by-column reading methods.

[0063] The readout signal generated by the mode selection circuit 110 and controlling the pixel array 130 in units of rows may include at least one of an RS signal, a CR signal, and a CRS signal. The RS signal may correspond to a signal indicating that skipping and reading are alternately performed along the rows for a plurality of rows of the pixel array 130. For example, the RS signal may include a first signal commanding the alternating and sequential repetition of the following process: reading a first row among a plurality of rows and skipping a second row immediately below the first row among a plurality of rows. The CR signal may correspond to a signal indicating that a set of rows corresponding to at least some regions of a plurality of rows of the pixel array 130 (for example, including one or more rows corresponding to the ROI) is sequentially read. For example, the CR signal may include a second signal commanding the sequential reading of one or more rows corresponding to the ROI. The CRS signal may correspond to a signal indicating that skipping and reading are sequentially performed along the rows for a set of rows corresponding to at least some regions of a plurality of rows of the pixel array 130. For example, the CRS signal may include a third signal commanding the alternating and sequential repetition of the following process: sequentially reading and skipping a set of rows corresponding to the ROI. Refer to later Figure 4C , Figure 5B and Figure 5C A readout operation of the image sensor 100 based on the RS signal, the CR signal, and the CRS signal is described.

[0064] The combining signal generated by the mode selection circuit 110 and indicating to sum or pass the pixel signals read from the pixel array 130 may include an enable signal ENABLE and a disable signal DISABLE. For example, the enable signal ENABLE may be applied to the combining circuit 140 to sum the read pixel signals, and the disable signal DISABLE may be applied to the combining circuit 140 to pass the read pixel signals. For example, the combining circuit 140 may receive and sum the pixel signals through the column lines of the column in which the read pixel 131 is located in response to the enable signal ENABLE, and receive the pixel signals passed through the column lines of the column in which the read pixel is located in response to the disable signal DISABLE. The operation of the combining circuit 140 will be described in detail later with reference to Figure 9 the operation of the combining circuit 140 is described in detail.

[0065] The image sensor 100 may have a plurality of operation modes including a first operation mode and a second operation mode. The image sensor 100 may have a plurality of operation modes including a first operation mode, a second operation mode, and a third operation mode. Accordingly, it will be understood that the operation mode of the image sensor 100 that can be changed based on the control of the row driver 120 and the combining circuit 140 by the mode selection circuit 110 based on the mode signal MODE may include one of the first operation mode, the second operation mode, or the third operation mode. The first operation mode and the second operation mode will be described in detail later with reference to Figures 4A to 7B The first operation mode and the second operation mode are described in detail. The third operation mode will be described in detail later with reference to Figure 10 The third operation mode is described in detail.

[0066] Figure 4A is a diagram illustrating an example of a readout method of the image sensor 100 according to some example embodiments of the inventive concept and a readout image. For ease of explanation, Figure 4A the readout method shown in may be a readout method applying a read 1 row skip 1 row (R_1Read_1Skip) method on a row basis and a read 1 column skip 1 column (C_1Read_1Skip) method on a column basis. As a result of applying the read 1 row skip 1 row (R_1Read_1Skip) method and the read 1 column skip 1 column (C_1Read_1Skip) method, an output image having 1 / 4 resolution, 1 / 2 horizontal length, and 1 / 2 vertical length of the original image of the image sensor 100 may be generated. However, the example embodiments are not limited thereto, and output images of various resolutions may be generated by using various readout methods. For example, as a result of applying a read 1 row skip 2 rows (R_1Read_2Skip) method and a read 1 column skip 2 columns (C_1Read-2Skip) method, an output image having 1 / 9 resolution may be generated.

[0067] Reading a pixel may include four sub-pixels arranged in a clockwise order of R-G-B-G from the upper left, where R represents red, G represents green, and B represents blue. In all the following drawings, the four sub-pixels arranged in a clockwise order of R-G-B-G from the upper left may indicate that the color is represented by a combination of R-G-B when output to the display device 60, but this does not mean the actual implementation of the pixel array 130 of the image sensor 100 by using four sub-pixels.

[0068] When reading the top row of the pixel array 130, a read 1 column skip 1 column (C_1Read_1Skip) method for sequentially reading only the pixel signals of each odd column in the right direction from the leftmost pixel may be executed.

[0069] When the readout method is based on the read 1 row skip 1 row (R_1Read_1Skip) method and the read 1 column skip 1 column (C_1Read_1Skip) method, the second output image 2001 may be generated by reading the pixel signals of the pixels at each odd column and each odd row. As a result, the second output image 2001 may be an image having 1 / 4 the resolution, 1 / 2 the horizontal length, and 1 / 2 the vertical length of the first output image 1001, and the first output image 1001 has been generated by using the row full read (R_Full_Read) method for the rows of the previous pixel array 130 and the column full read (C_Full_Read) method for the columns of the previous pixel array 130.

[0070] Figure 4B It is a diagram showing another example of the readout method of the image sensor 100 according to some example embodiments of the inventive concept and the readout image. Figure 4B The readout method shown in [the figure] may be a readout method applying the read 1 row skip 1 row (R_1Read_1Skip) method in units of rows and the merge 2 columns (2_Binning) method in units of columns.

[0071] When reading the top row of the pixel array 130, pixel signals of all pixels on the row read sequentially in the right direction from the leftmost pixel can be read, and a 2-column (2_Binning) readout method in which the pixel signals are summed in the combining circuit 140 can be performed. In other words, based on a readout method applying a 1-row read 1-row skip (R_1Read_1Skip) method and a 2-column (2_Binning) method, a fourth output image 3002 can be generated by reading pixel signals of two pixels at each odd row and each odd column and at each odd row and each even column and summing them. As a result of the summation, the fourth output image 3002 can be an image having 1 / 4 resolution, 1 / 2 horizontal length, and 1 / 2 vertical length of a third output image 1002, which has been generated by using a row full read (R_Full_Read) method for rows of a previous pixel array 130 and a column full read (C_Full_Read) method for columns of the previous pixel array 130.

[0072] Figure 4C is a diagram illustrating a 1-row read 1-row skip (R_1Read_1Skip) method of RS signals according to a pixel array 130 of an image sensor 100 according to some example embodiments of the inventive concept. Different from Figure 4A and Figure 4B showing an image output on the display device 60, Figure 4C a direct readout process from the pixel array 130 can be shown.

[0073] As described above, the RS signal can be a signal (e.g., a first signal) that commands to alternately repeat the following process: read a first row among a plurality of rows of the pixel array 130, skip a second row immediately below the first row (where "immediately below" means below the first row without any inserted rows), read a third row immediately below the second row, until all rows of the pixel array 130. In other words, the RS signal can be a signal for controlling the pixel array 130 to be read by a 1-row read 1-row skip (R_1Read_1Skip) method. That is, the RS signal can command to alternately repeat reading a first row among a plurality of rows and skipping a second row immediately below it.

[0074] The pixel array 130 can respond to the RS signal to alternately repeat reading a first row or the top row among a plurality of rows and skipping a second row. Pixel signals read for each row can be output as a first pixel signal PS1 for each row along a column line of a first column located at the leftmost side of the pixel array 130, and can be output as a second pixel signal PS2 for each row along a column line of a second column that is the first right column of the first column.

[0075] Figure 5A FIG. 1 is an example of a readout method of an image sensor 100 showing some example embodiments according to the inventive concept and a view of a readout image. Figure 5A The readout method shown in FIG. 1 may be a readout method to which a row cropping read (R_Crop_Read) method and a column full read (C_Full_Read) method are applied.

[0076] When pixel signals are sequentially read from the top row to the bottom row in a selected region (e.g., a region of interest ROI) among a plurality of rows of the pixel array 130, pixel signals PX may be read in a region sequentially selected from the leftmost pixel to the rightmost pixel of the selected region of the read row, and a readout may be performed in which the pixel signals pass through the combining circuit 140 without being summed. In other words, based on a readout method to which a row cropping read (R_Crop_Read) method and a column full read (C_Full_Read) method are applied, a sixth output image 4003 may be generated, in which pixel signals of pixels at each column and each row in a selected region (e.g., a region of interest ROI) among a plurality of rows of the column array 150 are read.

[0077] In addition, in a selected region among a plurality of rows of the pixel array 130, an operation of skipping odd rows and reading even rows may be alternately repeated from the top row, pixel signals of all pixels may be sequentially read from the leftmost pixel to the right on the read rows, and a readout may be performed in which the pixel signals pass through the combining circuit 140 without being summed. In other words, based on a readout method to which a row cropping read (R_Crop_Read) method and a column full read (C_Full_Read) method are applied, a seventh output image 5003 may be generated, in which pixel signals of pixels at each column and each even row in a selected region (e.g., a region of interest ROI) among a plurality of rows of the column array 150 are read.

[0078] Referring to Figure 3 , the selected region may be set as a region of interest ROI by the AP 20 and may be related to a crop signal CROP sent to the image sensor 100. That is, the AP 20 may output a crop signal CROP that sets (e.g., defines) a specific region of the pixel array 130 as a region of interest ROI. Referring again to Figure 5A , the fifth output image 1003 may correspond to an image generated by a row full read (R_Full_Read) method of rows and a column full read (C_Full_Read) method of columns, and the region of interest ROI may correspond to a region indicated by a thick line on the fifth output image 1003.

[0079] As a result of alternately and repeatedly reading odd-numbered lines starting from the topmost line in a region selected from among multiple lines and skipping even-numbered lines, the seventh output image 5003 can read only odd-numbered lines, and thus can have the same horizontal length as the sixth output image 4003 and a vertical length that is 1 / 2 times as long.

[0080] Figure 5B And Figure 5C are diagrams respectively showing readout methods of different readout signals according to a pixel array 130 of an image sensor 100 according to exemplary embodiments of the inventive concept; Figure 5B is a diagram showing a Crop_Read method of a CR signal in a row driver 120 of an image sensor 100 according to some exemplary embodiments of the inventive concept, Figure 5C is a diagram showing a Crop_Read method of a CRS signal in a pixel array 130 of an image sensor 100 according to some exemplary embodiments of the inventive concept. Different from showing an image output to a display device 60, Figure 5A Different, Figure 5B And Figure 5C can show a direct readout process from the pixel array 130. In addition, as shown in Figure 4A And Figure 4B shown, output images having various resolutions can be generated through various readout methods. Hereinafter, for ease of description, it is assumed that a region of interest ROI has dimensions corresponding to half of the horizontal length and half of the vertical length of the pixel array 130 and a resolution of 1 / 4 of the pixel array 130.

[0081] Referring to Figure 5B a pixel array 130 can sequentially read a plurality of lines corresponding to a region of interest ROI (e.g., a set of lines corresponding to the region of interest ROI) among a plurality of lines in response to a CR signal. For example, the region of interest ROI may include the Mth line to the Nth line. In other words, the pixel array 130 can skip the remaining lines other than the region of interest ROI and sequentially read the Mth line to the Nth line along the rows. Pixel signals read out for each line can be output as first pixel signals PS1 for each line along column lines of a first column located at the leftmost side of the pixel array 130, and can be output as second pixel signals PS2 for each line along column lines of a second column that is a first right column of the first column.

[0082] Referring to Figure 5C, in response to the CRS signal, the pixel array 130 may sequentially read a plurality of rows corresponding to the region of interest ROI (e.g., a set of rows corresponding to the region of interest ROI) from the M-th row, and the M-th row is the topmost row in the set of rows corresponding to the region of interest ROI among the plurality of rows. For example, the region of interest ROI may include the M-th row to the N-th row. In other words, the pixel array 130 may alternately repeat the steps of skipping the M-th row, which is an odd row among the M-th row to the N-th row, and reading the (M + 1)-th row, which is an even row, along the rows up to the N-th row. The pixel signals read out for each row may be output as the first pixel signal PS1 for each row along the column lines of the first column located at the leftmost side of the pixel array 130, and may be output as the second pixel signal PS2 for each row along the column lines of the second column, which is the first right column of the first column.

[0083] Figure 6A is a diagram illustrating outputting images with different viewing angles according to a readout method according to some example embodiments of the inventive concept. Figure 6A The eighth output image 4004 in may be an image that is a frame image generated and output to the display device 60 by the image sensor 100 by using a readout method applying a Crop_read method and a C_Full_Read method, and Figure 6A The ninth output image 3004 in may be an image that is a frame image generated and output to the display device 60 by the image sensor 100 by using a readout method applying a R_1Read_1Skip method and a 2_Binning method. As a result, the ninth output image 3004 may have the same resolution as the eighth output image 4004, but have a relatively wider viewing angle.

[0084] Figure 6B and Figure 6C are diagrams respectively illustrating readout methods according to different readout signals of the pixel array 130 of the image sensor 100 according to example embodiments of the inventive concept. Figure 6B illustrates for outputting from the current frame Figure 6A the readout method of the ninth output image 3004 in Figure 6C illustrates outputting from the next frame Figure 6A the readout method of the eighth output image 4004 in

[0085] Referring to Figure 6B, the mode selection circuit 110 may receive a mode signal MODE related to an operation mode of the image sensor 100, generate an RS signal, and apply the RS signal to the row driver 120. The row driver 120 may alternately repeat reading multiple rows of the pixel array 130 by using a read 1 row skip 1 row (R_1Read_1Skip) method.

[0086] Referring to Figure 6B , in the current frame, the first pixel array 130_1 may alternately repeat reading the first row and skipping the second row in the same manner as described with respect to Figure 4C in response to the RS signal, where the first row is the topmost row among the multiple rows.

[0087] Referring to Figure 6C , in the next frame, the second pixel array 130_2 may sequentially read a set of rows corresponding to the region of interest ROI among the multiple rows in response to the CR signal. For example, the second pixel array 130_2 may sequentially read from the Mth row to the Nth row corresponding to the region of interest ROI in the next frame.

[0088] The readout operations of Figure 6B and Figure 6C may be sequentially repeated in different frames from each other. For example, in odd frames, the third pixel array 130_3 may respond to the RS signal, and in even frames, the fourth pixel array 130_4 may respond to the CR signal.

[0089] The operation mode of the image sensor 100 according to some example embodiments of the inventive concept may be determined by the AP 20, and the determined operation mode may be received by the image sensor 100 as the mode signal MODE. The mode selection circuit 110 may output a readout signal to the row driver 120 based on the mode signal MODE, and output a merge signal to the merge circuit 140. In addition, the AP 20 may set the region of interest ROI, generate a crop signal CROP indicating the rows of the pixel array 130 corresponding to the region of interest ROI, and output the generated crop signal CROP to the image sensor 100.

[0090] When an RS signal is generated in the mode selection circuit 110 of the image sensor 100 according to some example embodiments of the inventive concept, an enable signal ENABLE for operating the merging circuit 140 may be generated together. That is, the mode selection circuit 110 may generate the enable signal ENABLE simultaneously with and / or in response to generating the RS signal (e.g., the first signal of the readout signal). It can be understood that the RS signal reads each odd row among all rows of the pixel array 130, so the columns of the pixel array 130 may also need to be merged to maintain the aspect ratio of the image sensor 100. In other words, the RS signal and the enable signal ENABLE may be generated and applied to the image sensor 100 at the same time.

[0091] The operation mode of the image sensor 100 based on the RS signal, the CR signal, and the merging signal may be referred to as the first operation mode. That is, the first operation mode may be an operation mode in which the mode selection circuit 110 is configured to generate the RS signal (e.g., the first signal) and the CR signal (e.g., the second signal). For example, the first operation mode may correspond to a mode in which the mode selection circuit 110 applies the RS signal and the ENABLE signal of the merging signal to the image sensor 100 for the current frame, and the mode selection circuit 110 applies the CR signal and the DISABLE signal of the merging signal to the image sensor 100 for the next frame. That is, in the first operation mode, the mode selection circuit 110 may be configured to apply the RS signal (e.g., the first signal) to the row driver 120 and the enable signal ENABLE to the merging circuit 140 for the current frame, and apply the CR signal (e.g., the second signal) to the row driver 120 and the disable signal DISABLE to the merging circuit 140 for the next frame.

[0092] The image sensor 100 operating in the first operation mode may generate two images having different viewing angles from each other. For example, when a camera (e.g., a camera module that may be some or all of a single image processing system 10) equipped with the image sensor 100 according to some example embodiments of the inventive concept captures an image of an object at a speed of 120 fps (frames per second) in the first operation mode, the camera may generate approximately 60 images with a wide viewing angle and approximately 60 images with a narrow viewing angle. When the image sensor 100 operates in the first operation mode, multiple virtual channels may be used. For example, Figure 6A the eighth output image 4004 in Figure 6AThe ninth output image 3004 in [the figure] can be output through the second virtual channel. In other words, the first virtual channel can be a path for odd frames output by the image sensor 100 operating in the first operation mode, and the second virtual channel can be a path for even frames output by the image sensor 100 operating in the first operation mode.

[0093] In other words, when operating in the first operation mode, the image sensor 100 according to some example embodiments of the inventive concept can generate images having different perspectives from each other by using only one camera module (e.g., one image processing system 10, one image sensor 100, etc.). In addition, since images having different perspectives from each other are generated only by using the image sensor 100, in-time image processing can be feasible and fast image post-processing can be feasible compared to the case where the ISP 200 generates images having different perspectives by using software. Accordingly, the image processing system 10 including at least the image sensor 100 can provide improved performance, versatility, and efficiency in terms of the use of computing resources and / or power consumption for generating images having different perspectives, sizes, and / or resolutions.

[0094] Figure 7A is another diagram illustrating an output of images having different perspectives according to a readout method according to some example embodiments of the inventive concept. Figure 7A The tenth output image 5005 in [the figure] can correspond to an image in which the image sensor 100 generates a frame image based on a readout method applying a Crop_Read method and a C-full_read method for reading each even row and outputs the generated frame image via the display device 60. Figure 7A The eleventh output image 3005 in [the figure] can correspond to an image in which the image sensor 100 generates a frame image based on a readout method applying an R_1Read_1Skip method and a 2_Binning method and outputs the generated frame image via the display device 60. The tenth output image 5005 can be generated by reading even rows in a set of rows corresponding to a region of interest (ROI) and can have the same horizontal length, 1 / 2 times the vertical length, and 1 / 2 the resolution as Figure 6A the eighth output image 4004 in [the figure].

[0095] Figure 7B is a diagram illustrating a readout method according to some example embodiments of the inventive concept, in which a pixel array 130 of the image sensor 100 is read according to a readout signal in one frame.

[0096] Referring to Figure 7B Together withFigure 3 When the mode selection circuit 110 may receive a mode signal MODE for an operation mode and a clipping signal CROP for a region of interest ROI from the AP 20, output an RS signal and a CRS signal to the line driver 120, and output a merge signal to the merge circuit 140. The line driver 120 may alternately repeat reading multiple lines of the pixel array 130 in a read-one-line-skip-one-line (R_1Read_1Skip) method in response to the RS signal, or may read only even lines among a set of lines corresponding to the region of interest ROI and skip odd lines in response to the CRS signal. That is, the line driver 120 may read all odd lines among multiple lines of the pixel array 130, all odd lines including odd lines corresponding to the region of interest ROI and odd lines not corresponding to the region of interest ROI, and the line driver 120 may only read the selection of even lines corresponding to the ROI and skip reading all even lines not corresponding to the ROI. In other words, the even lines read in response to the CRS signal among multiple lines corresponding to the region of interest ROI may be the lines skipped in response to the RS signal, and the odd lines skipped in response to the CRS signal among multiple lines corresponding to the region of interest ROI may be the lines read in response to the RS signal.

[0097] When the currently driven line is not a line corresponding to the region of interest ROI, the line driver 120 may alternately repeat reading and skipping. For example, the line driver 120 may alternately repeat reading the first line or the top line among all lines and skipping the second line immediately below the first line in response to the RS signal.

[0098] When the currently driven line is a line corresponding to the region of interest ROI (the Mth line to the Nth line), the set of lines corresponding to the region of interest ROI may be divided into odd lines (the Mth line, the (M + 2)th line,...) and even lines (the (M + 1)th line,..., the Nth line).

[0099] The odd lines among the set of lines corresponding to the region of interest ROI may be the lines read in response to the RS signal. The mode selection circuit 110 may generate an enable signal ENABLE when generating the RS signal, and the merge circuit 140 may sum pixel signals read from pixels on odd lines among the set of lines corresponding to the region of interest ROI.

[0100] The even lines among the set of lines corresponding to the region of interest ROI may be the lines read in response to the CRS signal. The mode selection circuit 110 may generate a disable signal DISABLE when generating the CRS signal, and the merge circuit 140 may not sum pixel signals by pixel signals read from pixels on even lines among the set of lines corresponding to the region of interest ROI.

[0101] In short, all odd-numbered rows among the multiple rows of the readable pixel array 130 and all even-numbered rows in the set of rows corresponding to the region of interest ROI (but not the even-numbered rows not within the set of rows corresponding to the region of interest ROI) can be read. For example, in Figure 7B all odd-numbered rows (the first row,..., the Mth row, the (M + 2)th row,..., the (N + 1)th row,...) and all even-numbered rows (the (M + 1)th row,..., the Nth row) among the set of rows corresponding to the region of interest ROI can be read.

[0102] The cropping signal CROP for the region of interest ROI can also provide the position information of the pixels 131 on the corresponding rows (i.e., the position information of the column lines). For ease of description, it is outlined as reading the rows corresponding to the region of interest ROI. However, it can be understood that when performing the readout of the Crop_Read method in units of rows, the pixel signals within the column range corresponding to the region of interest ROI are received. In other words, when the mode selection circuit 110 generates a CR signal or a CRS signal, only the pixel signals within the column range corresponding to the region of interest ROI can be received by the column array 150.

[0103] Referring to Figure 7B the operation mode of the image sensor 100 that operates based on the RS signal, the CRS signal, and the merge signal can be referred to as the second operation mode. That is, the second operation mode can be an operation mode in which the mode selection circuit 110 is configured to generate an RS signal (e.g., the first signal) and a CRS signal (e.g., the third signal). For example, the second operation mode can be such an operation mode of the image sensor 100 that when an RS signal is applied to the pixel array 130 for one frame, an enable signal ENABLE is applied to the merge circuit 140, and when a CRS signal is applied to the pixel array 130, a disable signal DISABLE is applied to the merge circuit 140. That is, in the second operation mode, the mode selection circuit 110 can be configured to apply an enable signal ENABLE to the merge circuit 14 and / or apply an enable signal ENABLE to the merge circuit 140 simultaneously with the mode selection circuit 110 applying an RS signal to the row driver 120 in response to the mode selection circuit 110 applying an RS signal (e.g., the first signal) to the row driver 120, and apply a disable signal DISABLE to the merge circuit 140 and / or apply a disable signal DISABLE to the merge circuit 140 simultaneously with the mode selection circuit 110 applying a CRS signal to the row driver 120 in response to the mode selection circuit 110 applying a CRS signal (e.g., the third signal) to the row driver 120. As Figure 7BAs shown, the row driver 120 may be configured to read all odd rows of the pixel array 130 based on the RS signal (e.g., the first signal), and read even rows among the rows corresponding to the ROI of the pixel array 130 based on the CRS signal (e.g., the third signal) and the crop signal CROP.

[0104] The image sensor 100 operating in the second operation mode may generate two images having different viewing angles from each other. For example, when a camera equipped with the image sensor 100 according to some example embodiments of the inventive concept captures an image of an object at a speed of 120 fps (frames per second) in the second operation mode, the camera may generate approximately 120 images having a wide viewing angle and approximately 120 images having a narrow viewing angle. In contrast, compared to the case where two frames including the current frame and the next frame are read out separately, Figure 6B and Figure 6C different, in Figure 7B two images may be obtained by performing one readout in one frame, and an image that is relatively twice as large as the image generated in the first operation mode may be generated.

[0105] In other words, when operating in the second operation mode, the image sensor 100 according to some example embodiments of the inventive concept may generate images having various different viewing angles from each other by using only one camera module (e.g., one image sensor 100, one image processing system 10, etc.). Therefore, the image processing system 10 including at least the image sensor 100 may provide improved performance, versatility, and efficiency in terms of the use of computational resources and / or power consumption for generating images having different viewing angles, sizes, and / or resolutions. As Figure 7A shown, the eleventh output image 3005 may be generated based on the read odd rows of the pixel array 130, while the tenth output image 5005 may be generated based on all the read rows (both the read odd rows and the read even rows) corresponding to the region of interest ROI (e.g., not based on the read rows not corresponding to the region of interest ROI).

[0106] Figure 8 Table T1 is a summary of the readout signals (RS, CR, and CRS) and the merge signals output for each operation mode according to some example embodiments of the inventive concept.

[0107] With Figure 3 referring together Figure 8When the operation mode of the image sensor 100 and the region of interest (ROI) are determined in the AP 20, the AP 20 may send a mode signal MODE and a crop signal CROP to the image sensor 100. The mode selection circuit 110 may output readout signals (RS, CR, CRS, etc.) corresponding to each operation mode to the row driver 120 in response to the received mode signal MODE and crop signal CROP, and may output a merge signal and a readout signal corresponding to each operation mode to the merge circuit 140.

[0108] The first operation mode and the third operation mode may require the i-th frame and the (i + 1)-th frame (i is a positive integer), that is, two frames, to generate an output image. The second operation mode may generate an output image using only one frame. Refer to Figure 10 the description of the third operation mode later.

[0109] Figure 9 is a circuit diagram showing the summing operation of signals by the merge circuit 140 of the image sensor 100 according to some example embodiments of the inventive concept.

[0110] According to some example embodiments of the inventive concept, the first pixel signal PS1 to the fourth pixel signal PS4 output from the pixel array 130 based on the row driver 120 reading the individual pixels 131 of the rows of the pixel array 130 may be applied to the merge circuit 140. The merge circuit 140 may operate or stop its operation in response to the merge signal generated by the mode selection circuit 110. For example, the merge circuit 140 may sum the first pixel signal PS1 and the second pixel signal PS2 based on the enable signal ENABLE and output the sum result as a merged pixel signal to the first ADC 151_1 of the column array 150, sum the third pixel signal PS3 and the fourth pixel signal PS4 and output the sum result as a merged pixel signal to the third ADC 151_3 of the column array 150. In addition, for example, the merge circuit 140 may pass through the first pixel signal PS1 and the second pixel signal PS2 based on the disable signal DISABLE, and output the first pixel signal PS1 and the second pixel signal PS2 as merged pixel signals to the first ADC 151_1 and the second ADC 151_2 of the column array 150 respectively, and pass through the third pixel signal PS3 and the fourth pixel signal PS4, and output the third pixel signal PS3 and the fourth pixel signal PS4 as merged pixel signals to the third ADC 151_3 and the fourth ADC 151_4 of the column array 150 respectively. That is, the merge circuit 140 may be configured to: read all the pixels in the rows of the pixels 131 read by the row driver 120 based on the disable signal DISABLE, and sum and read every two pixels in the rows of the pixels 131 read by the row driver 120 based on the enable signal ENABLE.

[0111] Figure 10 It is a diagram showing the interpolation operation of the image sensor 100 according to some example embodiments of the inventive concept.

[0112] Referring again to Figure 5A ,the image sensor 100 operating in the second operation mode may read even rows among a set of rows corresponding to a region of interest (ROI), and generate a seventh output image 5003. The seventh output image 5003 may have the same horizontal length as the sixth output image 4003 and a vertical length of 1 / 2. When it is required to keep the ratio between the horizontal length and the vertical length constant, the AP 20 may restore an image having a height corresponding to the sixth output image 4003 through an interpolation operation.

[0113] Referring to Figure 10 ,the AP 20 may include an interpolator 210 that restores pixel information of unread rows by using the stochastic correlation between adjacent pixels of an image. The interpolator may be implemented by one or more instances of a processing circuit. The interpolator 210 may estimate pixel information (e.g., pixel values) about unread rows (e.g., skipped rows) by using a logic circuit implementing arithmetic operations, including estimating unread odd rows among the rows corresponding to the ROI of the pixel array 130 based on the pixel values of read odd rows and the sum pixel values of even rows. For example, when the image sensor 100 operates in the second operation mode, all odd rows of the pixel array 130 may be read and processed column by column by a column full read (C_Full_Read) method, and even rows of a set of rows corresponding to the ROI may be read and processed column by column by a 2-column merging (2_Binning) method.

[0114] Referring to Figure 10 ,the pixel values corresponding to pixels adjacent to the target pixel value D(x,y) to be restored and that will be read as odd rows by the column full read (C_Full_Read) method may be represented as D(x-1,y-1), D(x,y-1), and D(x-1,y+1), and the pixel values of pixels adjacent to the target pixel value D(x,y) to be restored and that will be read as even rows by the 2-column merging (2_Binning) method may be represented as D(x-1,y). For example, the interpolator 210 may obtain the arithmetic mean of the pixel values D(x,y-1) and D(x,y+1) directly adjacent to the target pixel value D(x,y) on the odd row and that have been read by the column full read (C_Full_Read) method, and generate a first restored value D1.

[0115] [Equation 1]

[0116]

[0117] The first recovered value D1 (also referred to herein as the conversion value of the read pixel) generated by using Equation 1 can be the result of an assumption of the linear data deviation between the upper pixel and the lower pixel. Equation 1 can be referred to as linear interpolation.

[0118] Referring to Figure 10 , the interpolator 210 can generate a second recovered value D2 based on the pixel values D(x, y-1) and D(x, y+1) that are directly adjacent to the target pixel value D(x, y) on the odd rows and have been read by the column full read (C_Full_Read) method, and the pixel value D(x-1, y) of the even rows that has been read by the 2-binning method.

[0119] [Formula 2]

[0120]

[0121] In addition to assuming the linear data deviation between the upper pixel and the lower pixel, by additionally using the information related to the even rows that have been read by performing the 2-binning method, the second recovered value D2 (also referred to herein as the conversion value summed by the combining circuit 140) generated by using Equation 2 can estimate the information related to the target pixel value D(x, y) lost due to the summation in the combining circuit 140 more precisely than the first recovered value D1(x, y).

[0122] Although two recovery methods are presented in Figure 10 , the methods are not limited thereto, and various other interpolation methods can be used. For example, various interpolation methods (such as weighted sum interpolation, spline interpolation, exponential interpolation, log-linear interpolation, bilinear interpolation, cubic interpolation, etc.) can be performed. In addition, in addition to including the logic circuit that performs arithmetic operations in response to various interpolation methods, the interpolator can also include various logic circuits that perform mathematical operations (such as differentiators and integrators).

[0123] An image processing system 10 according to some example embodiments of the inventive concept may be implemented such that an image sensor 100 and an AP 20 form a closed loop. For example, the image sensor 100 may receive a crop signal CROP for a region of interest ROI generated in the AP 20 and a mode signal MODE that determines an operation of the image sensor 100. The AP 20 may output a signal (not shown) that finely controls the operation of the image sensor 100, for example, by restoring an image by receiving the first through fifth output images (1001, 2001, 1002, 3002, and 1003) or row data Row_DTA output from the image sensor 100 again, or by controlling a gain of the image sensor 100 through sensor exposure control to reduce white noise of the image. Accordingly, a new crop signal CROP and a new mode signal MODE may be updated. Accordingly, based on the image sensor 100 including a mode selection circuit 110, the image processing system 10 including the image sensor 100 and the AP may provide improved performance, versatility, and efficiency in terms of usage of computational resources and / or power consumption for generating images having different perspectives, sizes, and / or resolutions, where the mode selection circuit 110 is configured to control a row driver 120 and a merge circuit 140 to change an operation mode of the image sensor 100 (e.g., between a first operation mode, a second operation mode, and / or a third operation mode as described herein) based on the mode signal MODE received at the image sensor 100 (e.g., from the AP 20) for changing the operation mode of the image sensor 100.

[0124] Although not shown in the drawings, the operation mode of the image sensor 100 that operates based on the CR signal, the CRS signal, and the DISABLE signal may be referred to as a third operation mode. For example, in the third operation mode, for two frames including a current frame and a next frame, the CR signal may be applied to the current frame while the CRS signal is applied to the next frame, and the merge signal may be disabled for both frames. That is, the third operation mode may be an operation mode in which the mode selection circuit 110 is configured to generate the CR signal (e.g., the second signal) and the CRS signal (e.g., the third signal). In the third operation mode, the mode selection circuit 110 may be configured to apply the DISABLE signal to the merge circuit 140 in response to the mode selection circuit applying the CR signal (e.g., the second signal) to the row driver 120, and / or apply the DISABLE signal to the merge circuit 140 while the mode selection circuit applies the CR signal (e.g., the second signal) to the row driver 120, and apply the CRS signal (e.g., the third signal) to the row driver 120 and apply the DISABLE signal to the merge circuit based on the CR signal (e.g., the second signal) and the CROP signal. As a result, the target pixel D(x,y) that has not been read in the current frame may be read in the next frame. Therefore, since the third operation mode can compare the restored value with the actually read pixel value, the third operation mode can be used as a test mode for verifying the interpolator 210.

[0125] Figure 11 is a block diagram of an image processing system 10 according to some example embodiments of the inventive concept.

[0126] Referring to Figure 2 and Figure 11 , the image processing system 10 may include an image sensor 100, an AP 20, a display device 60, and a lens 70. The image sensor 100 may include a mode selection circuit 110, a row driver 120, a pixel array 130, a merge circuit 140, and a column array 150. The AP 20 may include an ISP 200, a camera controller 220, and a personal computer (PC) interface (I / F) 230. The ISP 200 may include an interpolator 210, and the image sensor may further include other functional blocks.

[0127] In some example embodiments, at least some of the APs 20 (including one or more or all of the PCI / F 230, the camera controller 220, or the image signal processor 200) may be included in one or more instances of a processing circuit (such as hardware including logic circuits, a hardware / software combination (such as a processor executing software), or a combination thereof), may include one or more instances of a processing circuit, and / or may be implemented by one or more instances of a processing circuit. For example, the processing circuit may more specifically include, but is not limited to: a central processing unit (CPU), an arithmetic logic unit (ALU), a digital signal processor, a microcomputer, a field programmable gate array (FPGA), a system on a chip (SoC), a programmable logic unit, a microprocessor, an application specific integrated circuit (ASIC), etc. In some example embodiments, the processing circuit may include a non-transitory computer-readable storage device (such as a memory) storing a program of instructions, such as a solid state drive (SSD), and a processor configured to execute the program of instructions to implement the functions of at least some of the APs 20 (including one or more or all of the PCI / F 230, the camera controller 220, or the image signal processor 200). In some example embodiments, the PCI / F 230, the camera controller 220, or the image signal processor 200 may be implemented by separate processing circuits. In some example embodiments, two or more or all of the PCI / F 230, the camera controller 220, or the image signal processor 200 may be implemented by the same processing circuit.

[0128] In some example embodiments, at least some of the image sensors 100 may be included in one or more instances of a processing circuit (such as hardware including logic circuits, a hardware / software combination (such as a processor executing software), or a combination thereof), may include one or more instances of a processing circuit, and / or may be implemented by one or more instances of a processing circuit. For example, the processing circuit may more specifically include, but is not limited to: a central processing unit (CPU), an arithmetic logic unit (ALU), a digital signal processor, a microcomputer, a field programmable gate array (FPGA), a system on a chip (SoC), a programmable logic unit, a microprocessor, an application specific integrated circuit (ASIC), etc. In some example embodiments, the processing circuit may include a non-transitory computer-readable storage device (such as a memory) storing a program of instructions, such as a solid state drive (SSD), and a processor configured to execute the program of instructions to implement the functions of at least some of the image sensors 100.

[0129] Figure 11 The operation of the image sensor 100 of the image processing system 10 may be similar to Figure 3 that of the image sensor 100 in Figure 11The operation of the image processing system 10 and Figure 3 the operation of the image sensor 100 in

[0130] The image sensor 100 can sense an object 80 photographed using a lens 70 under the control of the AP 20, and the AP 20 can display an image that has been sensed and output by the image sensor 100 to the display device 60. In this case, the display device 60 can include all devices capable of outputting an image. For example, the display device 60 can include a computer, a mobile phone, and other image output terminals.

[0131] The timing generation circuit 160 can provide control signals, address signals, and / or clock signals corresponding to components of the image sensor 100 (e.g., the mode selection circuit 110, the pixel array 130, the row driver 120, the column array 150, and the ramp signal generation circuit 170), respectively. The mode selection circuit 110, the pixel array 130, the row driver 120, the column array 150, and the ramp signal generation circuit 170 can operate according to the timing set for the corresponding components based on the control signals, address signals, and / or clock signals provided by the timing generation circuit 160.

[0132] The ramp signal generation circuit 170 can generate a ramp signal having a slope set based on the ramp control signal provided by the timing generation circuit 160. The generated ramp signal can be compared with the pixel signal in the column array 150.

[0133] The output buffer 152 can temporarily store a plurality of digital values output from a plurality of counters (not shown), and amplify and sequentially output the stored digital values. The output buffer 152 can include a plurality of memories and a plurality of sense amplifiers.

[0134] The AP 20 can include an ISP 200, a camera controller 220, and a PCI / F 230. For example, the camera controller 220 can control the image sensor 100 by using an internal integrated circuit I 2 C. However, the example embodiments are not limited thereto, and various interfaces can be applied between the camera controller 220 and the image sensor 100. In addition to the ISP 200, the camera controller 220, and the PCI / F 230, the AP 20 can include various intellectual property (IP) blocks (such as a color interpolation block, a lens shading correction block, an automatic white balance block, a chromatic aberration correction block, a noise removal block, and a gamma correction block).

[0135] The AP 20 can detect a removed area in an image including one or more frames, which is a set of read lines, and can output a crop signal CROP and a mode signal MODE related to the removed area to the image sensor 100. For example, the mode selection circuit 110 can operate in response to the crop signal CROP to cause the line driver to skip the lines corresponding to the removed area among the lines of the pixel array 130. For example, the AP 20 may not set the portion corresponding to the sky as the region of interest ROI, so that the detected sky region is not set as the region of interest ROI. For example, the AP 20 can exclude the lines vertically downward from the topmost line of the image sensor 100 to the lines proportional to 1 / 4 of the height of the image sensor 100 from the region of interest ROI, and can output the excluded crop signal CROP to the image sensor 100. The number 1 / 4 is only an example, and various ratios (such as 1 / 3, 1 / 2, and 3 / 4) can be used to exclude lines from the region of interest ROI.

[0136] Figure 12 is a flowchart of an operation method of the image sensor 100 according to some example embodiments of the inventive concept. Since Figure 12 illustrates the operation method of the image sensor 100, and excludes the third operation mode, which is a test mode of the interpolator 210 in the image processing system 10, the image sensor 100 is described as operating based on the first operation mode and the second operation mode.

[0137] The image sensor 100 can receive the mode signal MODE output to the outside and determine the operation mode of the image sensor 100 (S101). The image sensor 100 can identify one operation mode among the first operation mode to the second operation mode based on the mode signal MODE (S102).

[0138] Next, when the operation mode is the first operation mode, the mode selection circuit 110 may generate an RS signal and output the RS signal to the row driver 120. The row driver 120 may perform a read 1 row skip 1 row (R_1Read_1Skip) readout (S103) on multiple rows of the pixel array 130 in response to the RS signal for the current frame. Next, the mode selection circuit 110 may generate a CR signal for the next frame and output the CR signal to the row driver 120. The row driver 120 may perform a crop read (Crop_Read) readout (S104) on the rows corresponding to the region of interest (ROI) among the multiple rows of the pixel array 130 in response to the received CR signal. Next, when the required number of images with different perspectives has not been generated by performing readouts on all multiple frames that at least partially include an image, the read 1 row skip 1 row (R_1Read_1Skip) readout associated with the RS signal for the current frame may be performed again. And when the read 1 row skip 1 row (R_1Read_1Skip) readout has been performed and the required number of images with different perspectives has been generated, the process may end (S105).

[0139] When the operation mode is not the first operation mode (i.e., is the second operation mode), the row driver 120 may perform a read 1 row skip 1 row (R_1Read_1Skip) readout on multiple rows of the pixel array 130 in response to the RS signal for the current frame, and may perform a crop read (Crop_Read) readout on the even rows among the set of rows corresponding to the region of interest (ROI) among the multiple rows of the pixel array 130 in response to the CRS signal (S106). Next, when the required number of images with different perspectives has not been generated by performing readouts on all multiple frames that at least partially include an image, the read 1 row skip 1 row (R_1Read_1Skip) readout and the crop read (Crop_Read) readout may be performed again for the current frame. And when both readouts have been performed and the required number of images with different perspectives has been generated, the process may end (S107).

[0140] Figure 13 is a flowchart of an operation method of the image sensor 100 in the first operation mode according to some example embodiments of the inventive concept.

[0141] The image sensor 100 may identify the first operation mode based on the mode signal MODE (S201).

[0142] Next (e.g., in response to S201), for the current frame, the mode selection circuit 110 may generate an RS signal and output the RS signal to the line driver 120, and generate an enable signal ENABLE and output the enable signal ENABLE to the merging circuit 140 (S202). Then, for the current frame, the line driver 120 may alternately read and skip all rows of the pixel array 130 in response to the received RS signal. For example, the line driver 120 may read odd rows among all rows of the pixel array 130 and skip even rows (S203). Next, in the current frame, the merging circuit 140 may add signals at the merging circuit 140 in response to the received enable signal ENABLE (S204).

[0143] Next, for the next frame, the mode selection circuit 110 may generate a CR signal and output the CR signal to the line driver 120, and generate a disable signal DISABLE and output the disable signal DISABLE to the merging circuit 140 (S205). Next, for the next frame, the line driver 120 may read rows corresponding to the region of interest ROI among multiple rows of the pixel array 130 in response to the received CR signal. For example, the line driver 120 may read a set of all rows corresponding to the region of interest ROI among multiple rows of the pixel array 130 (S206). Next, in the next frame, the merging circuit 140 may, in response to the received disable signal DISABLE, pass the signals received by the merging circuit 140 (S207). The above process may be repeated until a desired number (e.g., number) of images with different perspectives are generated by performing reads on all multiple frames.

[0144] Figure 14 and Figure 15 is a flowchart of an operation method of the image sensor 100 in a second operation mode according to some example embodiments of the inventive concept.

[0145] Referring to Figure 14 , the operation method of the image sensor 100 may include: based on an external signal (e.g., MODE, CROP, etc.), generating a signal (e.g., RS, CR, and CRS) for reading at least one row corresponding to the region of interest ROI among multiple rows of the pixel array 130 through the mode selection circuit 110 (S301); then, reading odd rows among multiple rows of the pixel array 130 (S302); next, determining based on the external signal whether the row to be read now is a row corresponding to the region of interest ROI (S303).

[0146] When the row to be read currently is the row corresponding to the region of interest (ROI), the even rows in the set of rows corresponding to the ROI among multiple rows may also be read out (S304). Next, it may be determined whether the row to be read currently is the last row of the pixel array 130 (S305). The operation of reading the even rows in the set of rows corresponding to the ROI may further include an operation of summing every two pixels of the even rows and outputting the summation result as a pixel signal.

[0147] When the row to be read currently is not the row corresponding to the ROI, it may be determined whether the row to be read currently is the last row of the pixel array 130 (S305).

[0148] When the row to be read currently is determined not to be the last row of the pixel array 130, the odd rows may be continuously read out, and when the row to be read currently is determined to be the last row of the pixel array 130, the operation of the image sensor 100 may be terminated.

[0149] Refer to Figure 15 , the image sensor 100 may identify whether the operation mode is the second operation mode by receiving a mode signal MODE input from the outside, and determine the operation mode of the image sensor 100 (S401). Next, in one frame, the mode selection circuit 110 may apply an RS signal to the row driver 120, and may apply an enable signal ENABLE to the merging circuit 140 (S402). Next, the row driver 120 may alternately repeat reading and skipping each row of the pixel array 130. For example, the row driver 120 may read the odd rows among all the rows of the pixel array 130 and skip the even rows (S403). Next, the merging circuit 140 may add the pixel signals of the read rows in response to the enable signal ENABLE (S404).

[0150] Next, the image sensor 100 may determine whether it has entered the region of interest (ROI) (S405). When it has not entered the ROI, the row driver 120 may repeat the operation of reading all the odd rows of the pixel array 130. When it has entered the ROI, the row driver 120 may maintain the operation of reading all the odd rows of the pixel array 130, and may additionally perform column full read (C_Full_Read) readout on the even rows in the set of rows corresponding to the ROI among multiple rows of the pixel array 130 (S406). Next, the image sensor 100 may output row data Row_DTA to the AP20, and the ISP 200 of the AP 20 may recover the pixels on the unread odd rows in the set of rows corresponding to the ROI.

[0151] Figure 16It is a flowchart of an operation method of an image processing system 10 according to some example embodiments of the inventive concept in a second operation mode.

[0152] Referring to Figure 16 , the image sensor 100 may recognize the second operation mode (S501). Next, the image sensor 100 may output the first row data Row_DTA_1 and Row_DTA_2 to the AP 20. The first row data Row_DTA_1 has been obtained by alternately repeating reading and skipping for all rows, and the second row data Row_DTA_2 has been obtained by alternately repeating reading and skipping a set of rows corresponding to the region of interest ROI (S502). Next, the interpolator 210 of the ISP 200 may recover the target pixels of the skipped rows in the region of interest ROI based on the pixels on the already read rows (S503). Next, the ISP 200 may output (e.g., send, display, etc.) the image with the vertical resolution already recovered to the display device 60 or the electronic device 1 (S504). Such an output may include providing an image to be displayed by the display device 60. In some example embodiments, when the electronic device 1 is a vehicle, the output may include providing the image to a processing circuit of the vehicle, and the processing circuit may process the image to facilitate the operation of the vehicle's navigation and / or driving control system. Therefore, based on including the image processing system 10 (the image processing system 10 includes an image sensor 100 according to any example embodiment, and the image sensor 100 is configured to change the operation mode and / or generate various images with various sizes, resolutions, viewing angles, etc.), the electronic device 1 as a vehicle may be configured to provide improved navigation and / or driving control based on processing the image.

[0153] As described above, example embodiments have been disclosed in the drawings and the specification. Although some example embodiments have been described herein with reference to specific terms, it should be understood that they are only for the purpose of describing the technical concept of the inventive concept and not for limiting the scope of the inventive concept as defined in the claims. Therefore, those of ordinary skill in the art will understand that various modifications and equivalent example embodiments are possible without departing from the scope of the inventive concept. Therefore, the true protection scope of the inventive concept should be determined by the technical concept of the appended claims.

[0154] Although the inventive concept has been specifically shown and described with reference to example embodiments of the inventive concept, it will be understood that various changes in form and detail may be made therein without departing from the spirit and scope of the claims.

Claims

1. An image sensor, comprising: A pixel array including a plurality of pixels arranged in a matrix, the plurality of pixels being configured to generate individual respective pixel signals; A row driver configured to selectively read pixel signals generated by pixels of a plurality of rows of the pixel array; A combining circuit configured to selectively sum or pass through the read pixel signals to generate a combined pixel signal; A column array including a plurality of analog-to-digital converters configured to perform analog-to-digital conversion on the combined pixel signal; And A mode selection circuit configured to: based on a mode signal received at the image sensor for changing an operation mode of the image sensor, control the row driver and the combining circuit to change the operation mode of the image sensor, wherein the mode selection circuit is configured to: based on a cropping signal received at the image sensor, generate a readout signal to cause the row driver to selectively read a set of rows corresponding to a region of interest among the plurality of rows of the pixel array, the cropping signal including row information corresponding to the region of interest, wherein the mode selection circuit is configured to change the operation mode of the image sensor to a first operation mode, in which the mode selection circuit is configured to generate a first signal for alternately repeating the reading of the first row among all rows of the pixel array in a command sequence and skipping the second row immediately below the first row among all rows of the pixel array and a second signal for sequentially reading the set of rows corresponding to the region of interest, wherein the mode selection circuit is further configured to change the operation mode of the image sensor to a second operation mode, in which the mode selection circuit is configured to generate the first signal and a third signal for alternately repeating the reading and skipping of the set of rows corresponding to the region of interest in a command sequence, and wherein the mode selection circuit is further configured to change the operation mode of the image sensor to a third operation mode, in which the mode selection circuit is configured to generate the second signal and the third signal.

2. The image sensor according to claim 1, wherein the mode selection circuit is configured to generate an enable signal in response to generating the first signal.

3. The image sensor according to claim 1, wherein the mode selection circuit is configured to: in the first operation mode, apply the first signal to the row driver and apply the enable signal to the combining circuit for the current frame, and apply the second signal to the row driver and apply a disable signal to the combining circuit for the next frame.

4. The image sensor according to claim 1, wherein the mode selection circuit is configured to: in the second operation mode, apply the enable signal to the combining circuit in response to the mode selection circuit applying the first signal to the row driver, and apply the disable signal to the combining circuit in response to the mode selection circuit applying the third signal to the row driver.

5. The image sensor according to claim 4, wherein the row driver is configured to: read all odd rows of the pixel array based on the first signal, and read even rows among the set of rows corresponding to the region of interest of the pixel array based on the third signal and the cropping signal, The combining circuit is configured to: read all pixels of the read row based on the disable signal, and sum every two pixels of the read row based on the enable signal and read the sum.

6. The image sensor according to claim 1, wherein the mode selection circuit is configured to: in a third operation mode, in response to the mode selection circuit applying a second signal to the row driver, apply a disable signal to the combining circuit, and based on the second signal and the cropping signal, apply a third signal to the row driver and apply a disable signal to the combining circuit.

7. An image processing system, comprising: an image sensor configured to change the readout of rows of pixels of a pixel array according to an operation mode of the image sensor; and a processing circuit configured to process a frame output from the image sensor, wherein the image sensor includes: a pixel array, wherein the pixel array includes a plurality of pixels arranged in a matrix, the plurality of pixels being configured to: generate individual pixel signals in units of the rows of pixels of the plurality of rows of the pixel array, a row driver configured to: selectively read pixel signals generated by pixels of a selected row among the plurality of rows, a combining circuit configured to: selectively sum the read pixel signals or pass the read pixel signals to generate combined pixel signals, a column array configured to: perform analog-to-digital conversion on the combined pixel signals, and a mode selection circuit configured to: control the row driver and the combining circuit based on a mode signal received at the image sensor to change the operation mode of the image sensor, wherein the processing circuit is configured to: output a cropping signal for setting a region of interest, output a mode signal for setting the operation mode of the image sensor, and process row images of an image read from the image sensor, wherein the mode selection circuit is configured to: generate a readout signal based on the cropping signal to cause the row driver to selectively read a set of rows corresponding to the region of interest, wherein the mode selection circuit is configured to change the operation mode of the image sensor to a first operation mode, in which the mode selection circuit is configured to generate a first signal for alternately repeating the reading of the first row among all rows of the pixel array in a command sequence and skipping the second row immediately below the first row among all rows of the pixel array and a second signal for sequentially reading a set of rows corresponding to the region of interest, wherein the mode selection circuit is further configured to change the operation mode of the image sensor to a second operation mode, in which the mode selection circuit is configured to generate a first signal and a third signal for alternately repeating the reading and skipping of a set of rows corresponding to the region of interest in a command sequence, and wherein the mode selection circuit is further configured to change the operation mode of the image sensor to a third operation mode, in which the mode selection circuit is configured to generate the second signal and the third signal.

8. The image processing system according to claim 7, wherein the processing circuit is configured to estimate pixel values of the skipped rows.

9. The image processing system according to claim 8, wherein The processing circuit is configured to estimate pixel values of skipped lines based on conversion values of read pixels and conversion values that have been summed by the merging circuit.

10. The image processing system according to claim 7, wherein the mode selection circuit is configured to, in a first operation mode, apply a first signal to the row driver and an enable signal to the merging circuit for a current frame, and apply a second signal to the row driver and a disable signal to the merging circuit for a next frame.

11. The image processing system according to claim 7, wherein the mode selection circuit is configured to, in a second operation mode, apply an enable signal to the merging circuit in response to the mode selection circuit applying a first signal to the row driver, and apply a disable signal to the merging circuit in response to the mode selection circuit applying a third signal to the row driver, wherein the row driver is configured to read all odd-numbered lines of the pixel array based on the first signal, and read even-numbered lines among a set of lines corresponding to a region of interest of the pixel array based on the third signal and a cropping signal.

12. The image processing system according to claim 11, wherein the merging circuit is configured to read all pixels of the read lines based on the disable signal, and sum and read every two pixels of the read lines based on the enable signal, and the processing circuit is configured to estimate unread odd-numbered lines among lines corresponding to the region of interest of the pixel array based on pixel values of the read odd-numbered lines and sum pixel values of the even-numbered lines.

13. The image processing system according to claim 7, wherein the processing circuit is configured to detect a removed region in a frame that is a set of read lines, and the mode selection circuit is configured to control the row driver to skip lines corresponding to the removed region among the multiple lines of the pixel array in response to a cropping signal.

14. An operating method of an image sensor, the operating method comprising: generating a signal for commanding to read at least one line corresponding to a region of interest among multiple lines of a pixel array based on a cropping signal associated with the region of interest; and changing an operating mode of the image sensor based on a mode signal for changing the operating mode of the image sensor, wherein in a first operation mode of the image sensor, a first signal for commanding to alternately repeat reading a first line among all lines of the pixel array and skipping a second line immediately below the first line among all lines of the pixel array and a second signal for commanding to sequentially read a set of lines corresponding to the region of interest are generated, in a second operation mode of the image sensor, the first signal and a third signal for commanding to sequentially alternately repeat reading and skipping the set of lines corresponding to the region of interest are generated, and in a third operation mode of the image sensor, the second signal and the third signal are generated, wherein in the second operation mode, the operating method further comprises: reading all odd-numbered lines among the multiple lines of the pixel array; only reading even-numbered lines corresponding to the region of interest among the multiple lines of the pixel array and skipping reading all even-numbered lines not corresponding to the region of interest such that each even-numbered line corresponding to the region of interest is read; Generate two images having different perspectives from each other, wherein a first image is generated based only on the read odd-numbered rows among the plurality of rows of the pixel array, and a second image is generated based on both all the read odd-numbered rows corresponding to the region of interest and all the even-numbered rows corresponding to the region of interest; and Output both the first image and the second image from the image sensor to a device external to the image sensor.

15. The method of operation according to claim 14, wherein the step of reading the even-numbered rows corresponding to the region of interest includes: reading after summing every two pixels of the even-numbered rows.

Images