Image sensor and image sensing system including the image sensor

By introducing a ramp signal generator, a bias voltage generator, and a noise compensator into the image sensor, and utilizing analog and digital signal processing to generate and compensate for noise components, the voltage noise problem in the image sensor is solved, thereby improving product reliability and image quality.

CN114567735BActive Publication Date: 2026-11-17SAMSUNG ELECTRONICS CO LTD
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202111411695.9
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Priority Date
2020-11-27
Filing Date
2021-11-25
Publication Date
2026-11-17
Estimated Expiration
2041-11-25

AI Technical Summary

Technical Problem

Existing image sensors suffer from voltage noise during signal processing, which affects product reliability.

Method used

By introducing a ramp signal generator, bias voltage generator, noise compensator, and conversion circuit into the image sensor, analog and digital signal processing are used to generate voltage and compensate for noise components, generate a reference voltage, and perform analog-to-digital conversion, thereby reducing the impact of voltage noise.

Benefits of technology

It effectively compensates for voltage noise in image signals, improving the reliability and image quality of image sensors and sensing systems.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN114567735B_ABST
    Figure CN114567735B_ABST
Patent Text Reader

Abstract

An image sensor and an image sensing system including the image sensor are provided. The image sensor includes: a pixel configured to generate a pixel signal using an analog signal processing voltage; a ramp signal generator configured to generate a ramp signal using an analog signal processing voltage; a bias voltage generator configured to generate a bias voltage using an analog signal processing voltage; and a noise compensator configured to generate a noise component using a digital signal processing voltage and an analog signal processing voltage, and to add the generated noise component to the generated bias voltage. The image sensor also includes a conversion circuit configured to generate a reference voltage based on the generated ramp signal and the bias voltage to which the noise component is added, and to generate an image signal by performing analog-to-digital conversion on the generated pixel signal based on the generated reference voltage.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This disclosure relates to an image sensor and an image sensing system including the image sensor. Background Technology

[0002] Image sensing devices are semiconductor components that convert optical information into electrical signals. Image sensing devices can include charge-coupled device (CCD) image sensing devices and complementary metal-oxide-semiconductor (CMOS) image sensing devices.

[0003] A CMOS image sensor can be abbreviated as CIS. A CIS can comprise multiple pixels arranged in a two-dimensional array. Each pixel can include, for example, a photodiode. A photodiode can convert incident light into an electrical signal.

[0004] Recently, with the development of the computer and communications industry, the demand for image sensors with enhanced performance has been increasing in various fields such as digital cameras, camcorders, smartphones, gaming devices, security cameras, medical miniature cameras, and robots. Summary of the Invention

[0005] An image sensor is provided to improve product reliability by compensating for voltage noise in image signals.

[0006] An image sensing system is also provided to improve product reliability by compensating for voltage noise in image signals.

[0007] Additional aspects will be set forth in part in the description which follows, and in part will be obvious from the description or may be learned by practice of the presented embodiments.

[0008] According to one aspect of this disclosure, an image sensor includes: a pixel configured to generate a pixel signal using an analog signal processing voltage; a ramp signal generator configured to generate a ramp signal using an analog signal processing voltage; a bias voltage generator configured to generate a bias voltage using an analog signal processing voltage; and a noise compensator configured to generate a noise component using a digital signal processing voltage and an analog signal processing voltage, and to add the generated noise component to the generated bias voltage. The image sensor also includes a conversion circuit configured to generate a reference voltage based on the generated ramp signal and the bias voltage to which the noise component is added, and to generate an image signal by performing analog-to-digital conversion on the generated pixel signal based on the generated reference voltage.

[0009] According to one aspect of this disclosure, an image sensor includes: a pixel configured to generate a pixel signal using an analog signal processing voltage; a ramp signal generator configured to generate a ramp signal using an analog signal processing voltage; a bias voltage generator configured to generate a bias voltage using an analog signal processing voltage; a conversion circuit configured to generate a reference voltage based on the generated bias voltage and the generated ramp signal, and to generate a first digital signal by performing analog-to-digital conversion on the generated pixel signal based on the generated reference voltage. The image sensor further includes: a noise compensator configured to generate a noise signal using a digital signal processing voltage and an analog signal processing voltage, and to generate a second digital signal by performing analog-to-digital conversion on the generated noise signal based on the generated ramp signal; and a subtractor configured to generate a third digital signal by subtracting the generated second digital signal from the generated first digital signal.

[0010] According to one aspect of this disclosure, an image sensing system includes: an image sensor configured to output an image signal by sensing light incident on pixels; and an image signal processor configured to process the output image signal using a first digital signal processing voltage. The image sensor includes: pixels configured to generate pixel signals using an analog signal processing voltage; a ramp signal generator configured to generate a ramp signal using an analog signal processing voltage; a bias voltage generator configured to generate a bias voltage using an analog signal processing voltage; and a noise compensator configured to generate a noise component using the first digital signal processing voltage, a second digital signal processing voltage, and an analog signal processing voltage, and to add the generated noise component to the generated bias voltage. The image sensor also includes a conversion circuit configured to generate a reference voltage based on the generated ramp signal and the bias voltage to which the noise component is added, and to generate an image signal by performing analog-to-digital conversion on the generated pixel signal based on the generated reference voltage. Attached Figure Description

[0011] The above and other aspects, features and advantages of embodiments of the present disclosure will become more apparent from the following description taken in conjunction with the accompanying drawings.

[0012] Figure 1 This is a block diagram of an image sensing system according to an embodiment.

[0013] Figure 2 This is a block diagram of an image sensor according to an embodiment.

[0014] Figure 3 This is a diagram used to explain the conceptual layout of the image sensor according to an embodiment.

[0015] Figure 4This is a block diagram of an image sensor according to an embodiment.

[0016] Figure 5 and Figure 6 yes Figure 4 The circuit diagram of the unit pixel.

[0017] Figure 7 yes Figure 4 Circuit diagram of a ramp signal generator.

[0018] Figure 8 yes Figure 4 A block diagram of the conversion circuit.

[0019] Figure 9 yes Figure 8 The circuit diagram of the CDS circuit.

[0020] Figure 10 yes Figure 8 The circuit diagram of the ramp buffer.

[0021] Figure 11 This is a circuit diagram of a noise compensator according to an embodiment.

[0022] Figure 12 yes Figure 11 The circuit diagram of the first compensator.

[0023] Figure 13 This is a circuit diagram of a ramp buffer that uses a bias voltage VBP to generate a reference voltage VREF according to an embodiment.

[0024] Figure 14 This is a circuit diagram of a comparator that generates a comparison signal CMP using a reference voltage VREF, according to an embodiment.

[0025] Figure 15 This is a graph showing the noise compensation performed by the noise compensator according to an embodiment.

[0026] Figure 16 This is a timing diagram used to explain the operation of the image sensor according to an embodiment.

[0027] Figure 17 and Figure 18 This is a block diagram of an image sensor according to an embodiment.

[0028] Figure 19 and Figure 20 This is a block diagram of an image sensor according to an embodiment.

[0029] Figure 21 This is a block diagram of an image sensing system according to an embodiment.

[0030] Figure 22 This is a block diagram of an image sensing system according to an embodiment.

[0031] Figure 23 This is a block diagram of an electronic device including multiple camera modules according to an embodiment.

[0032] Figure 24 yes Figure 23 Detailed block diagram of the camera module. Detailed Implementation

[0033] In the following description, embodiments will be described in more detail with reference to the accompanying drawings.

[0034] Figure 1 This is a block diagram of an image sensing system 1 according to an embodiment.

[0035] refer to Figure 1 The image sensing system 1 may include an image sensor 2 and an image signal processor 4 (ISP).

[0036] Image sensor 2 can be connected to image signal processor 4 to provide image data IDATA to image signal processor 4. Image sensor 2 can generate image data IDATA using analog signal processing voltage VA and a first digital signal processing voltage VD1.

[0037] Image signal processor 4 can receive image data IDATA from image sensor 2 and perform image processing on the image data IDATA. Image signal processor 4 can perform image processing on image data IDATA using a second digital signal processing voltage VD2. However, the embodiment is not limited to this, and other types of voltages can also be used for image sensor 2 and image signal processor 4.

[0038] Figure 2 This is a block diagram of the image sensor 2 according to an embodiment.

[0039] refer to Figure 2 The image sensor 2 may include a pixel array 100, a control circuit 200, and a readout circuit 201. The readout circuit 201 may include a ramp signal generator 250, a bias voltage generator 400, a noise compensator 10, a conversion block 300, and a buffer 190.

[0040] Pixel array 100 can generate an analog signal AS by sensing incident light. Pixel array 100 may include multiple unit pixels consisting of multiple rows and multiple columns. Each unit pixel can generate an analog signal AS by sensing incident light.

[0041] The ramp signal generator 250 can generate a ramp signal VR that changes linearly with the slope of the amplitude.

[0042] The bias voltage generator 400 can generate a bias voltage VBP or VBN based on the power supply voltage. The bias voltage generator 400 can adjust the amplitude of the AC component of the bias voltage VBP or VBN, and then provide the bias voltage VBP or VBN to the converter block 300 through the noise compensator 10.

[0043] The noise compensator 10 can add noise components to the bias voltage VBP. The noise compensator 10 can sample the power supply voltage and add noise components to the bias voltage VBP based on the power supply voltage.

[0044] Conversion block 300 can generate a reference voltage based on the bias voltage VBP and the ramp signal VR. Conversion block 300 can use the reference voltage to generate a digital signal DGS by performing a single-slope analog-to-digital conversion on the analog signal AS. Conversion block 300 can provide the generated digital signal DGS to buffer 190.

[0045] The control circuit 200 can generate first control signals CTL1 to sixth control signals CTL6. The control circuit 200 can control the operation of the pixel array 100 through the first control signal CTL1, control the operation of the ramp signal generator 250 through the second control signal CTL2, control the operation of the bias voltage generator 400 through the third control signal CTL3, control the operation of the noise compensator 10 through the fourth control signal CTL4, control the operation of the conversion block 300 through the fifth control signal CTL5, and control the operation of the buffer 190 through the sixth control signal CTL6.

[0046] The buffer 190 can temporarily store the digital signal DGS, then amplify the digital signal DGS, and output the amplified digital signal DGS as image data IDATA.

[0047] Figure 3 This is a diagram used to explain the conceptual layout of the image sensor 2 according to an embodiment.

[0048] refer to Figure 3 The image sensor 2 may include a first region R1 and a second region R2 stacked in a first direction (e.g., the vertical direction). As shown, the first region R1 and the second region R2 may extend upward in a second direction and a third direction intersecting the first direction, and Figure 2 The blocks shown can be arranged in the first region R1 and the second region R2.

[0049] A third region containing the memory can be arranged below the second region R2. Here, the memory arranged in the third region can receive image data from the first region R1 and the second region R2, store or process the image data, and send the image data back to the first region R1 and the second region R2. In this case, the memory can include memory elements such as dynamic random access memory (DRAM) elements, static random access memory (SRAM) elements, spin-transfer torque magnetic random access memory (STT-MRAM) elements, or flash memory elements. When the memory includes, for example, DRAM elements, it can receive and process image data at a relatively high speed. Furthermore, in some embodiments, the memory can be arranged in the second region R2.

[0050] The first region R1 may include a pixel array PA and a first peripheral region PH1, and the second region R2 may include a logic circuit region LC and a second peripheral region PH2. The first region R1 and the second region R2 may be stacked sequentially in the vertical direction.

[0051] In the first region R1, the pixel array PA can be compared with the reference. Figure 2 The pixel array 100 described is the same. Pixel array 100 may include multiple unit pixels arranged in a matrix. Each pixel may include a photodiode and a transistor.

[0052] The first peripheral region PH1 may include multiple pads and may be arranged around the pixel array PA. The pads can send electrical signals to and receive electrical signals from external devices.

[0053] In the second region R2, the logic circuit region LC may include electronic components containing multiple transistors. The electronic components included in the logic circuit region LC may be electrically connected to the pixel array PA to provide signals or control output signals to each pixel unit of the pixel array PA.

[0054] In the logic circuit region LC, for example, a reference can be arranged. Figure 2 The described components include a control circuit 200, a ramp signal generator 250, a bias voltage generator 400, a noise compensator 10, a switching block 300, and a buffer 190. These can be arranged, for example, in the logic circuit region LC. Figure 2 The blocks that are not pixel array 100.

[0055] The second peripheral region PH2 can be arranged in the second region R2, which corresponds to a part of the first peripheral region PH1, but the embodiments are not limited to this.

[0056] Figure 4 This is a block diagram of the image sensor 2 according to an embodiment.

[0057] refer to Figure 4 The image sensor 2 may include a pixel array 100, a control circuit 200, a ramp signal generator 250, a bias voltage generator 400, a noise compensator 10, a conversion block 300, a buffer 190, and an interface IF.

[0058] Control circuitry 200 may include a timing controller 210 and a row driver 220. Pixel array 100 may include a plurality of unit pixels 110 (UP) arranged in a matrix comprising multiple rows and multiple columns. Conversion block 300 may include a plurality of conversion circuits 310 connected to the unit pixels 110 of pixel array 100 via corresponding column lines. Buffer 190 may include a plurality of memories 193 (MEM) storing digital signals DGS received from each of the conversion circuits 310. Furthermore, buffer 190 may include a sense amplifier 192 (AMP) that senses and amplifies the digital signals DGS stored in each of the memories 193, and outputs the amplified digital signals DGS as image data IDATA. Interface IF can transmit the image data IDATA to an external device.

[0059] The ramp signal generator 250 can operate using the analog signal processing voltage VA_R. The bias voltage generator 400 can operate using the analog signal processing voltage VA_B. The pixel array 100 can operate using the analog signal processing voltage VA_P. The converter block 300 can operate using the analog signal processing voltage VA_C and the first digital signal processing voltage VD1_1. The interface IF can operate using the first digital signal processing voltage VD1_2.

[0060] The noise compensator 10 can sample the analog signal processing voltage VA, the first digital signal processing voltage VD1, and the second digital signal processing voltage VD2 to add noise to the bias voltage VBP. That is, the noise compensator 10 can use all power supply voltages including the analog signal processing voltage VA, the first digital signal processing voltage VD1, and the second digital signal processing voltage VD2.

[0061] Here, the amplitudes of the first digital signal processing voltage VD1 and the second digital signal processing voltage VD2 can be smaller than the amplitude of the analog signal processing voltage VA. For example, the amplitude of the analog signal processing voltage VA can be 1.0V, but the amplitudes of the first digital signal processing voltage VD1 and the second digital signal processing voltage VD2 can be 2.8V.

[0062] Each component can use a different power supply voltage. However, the embodiments are not limited to this, and components can also use a common power supply voltage.

[0063] For example, the analog signal processing voltage VA may include analog signal processing voltage VA_P, analog signal processing voltage VA_R, analog signal processing voltage VA_B, and analog signal processing voltage VA_C. That is, analog signal processing voltages VA_P, VA_R, VA_B, and VA_C can be the same. Furthermore, for example, the first digital signal processing voltage VD1 may include first digital signal processing voltage VD1_1 and first digital signal processing voltage VD1_2. That is, first digital signal processing voltage VD1_1 and first digital signal processing voltage VD1_2 can be the same.

[0064] The timing controller 210 can provide the row driver 220 with a first internal control signal ICTL1 and an address signal ADDR. The row driver 220 can control the unit pixels 110 of the pixel array 100 row by row based on the first internal control signal ICTL and the address signal ADDR. For example, the row driver 220 can control the operation of the unit pixels 110 of the pixel array 100 row by row by providing the pixel array 100 with a row selection signal SEL, a reset control signal RST, and a transfer control signal TX.

[0065] The pixel array 100 can generate a first analog signal AS1 indicating a reset component and a second analog signal AS2 indicating an image component based on the row selection signal SEL, the reset control signal RST, and the transfer control signal TX received from the row driver 220. Due to differences in the unique characteristics of each unit pixel 110 or the differences in the logic characteristics used to output the analog signal AS from each unit pixel 110, differences may exist between the amplitudes of the analog signals AS generated by the unit pixel 110 from the same incident light. Therefore, the effective component of the incident light can be extracted by acquiring the reset component generated by each unit pixel 110 and the difference between the reset component and the image component of the incident light.

[0066] Each of the unit pixels 110 can sequentially generate a first analog signal AS1 and a second analog signal AS2 based on the row selection signal SEL, the reset control signal RST, and the transmission control signal TX. The conversion block 300 can generate a first digital signal corresponding to the first analog signal AS1 and a second digital signal corresponding to the second analog signal AS2, and output a digital signal DGS indicating the difference between the first digital signal and the second digital signal. That is, the digital signal DGS can indicate the effective component of the incident light.

[0067] Figure 5 and Figure 6 yes Figure 4 The circuit diagram of unit pixel 110.

[0068] refer to Figure 5 The unit pixel 110a may include a light sensing element 111, a transmission transistor 113, a reset transistor 115, a sensing transistor 117, and a selection transistor 119.

[0069] The first terminal of the photosensitive element 111 (PD) can be connected to ground voltage GND. The photosensitive element 111 can convert incident light into an electrical signal. The transmission transistor 113 can be connected to the second terminal of the photosensitive element 111 and the floating diffusion node FD. The reset transistor 115 can be connected between the analog signal processing voltage VA_P and the floating diffusion node FD. The sensing transistor 117 can be connected to the analog signal processing voltage VA_P and the floating diffusion node FD. The select transistor 119 can be connected to the column line CL corresponding to the sensing transistor 117.

[0070] refer to Figure 6 ,and Figure 5 The unit pixel 110a is different. Figure 6 The unit pixel 110b may also include a transistor 121. The first terminal of the transistor 121 may be connected to the gate of the transmission transistor 113, the gate of the transistor 121 may be connected to the gate of the selection transistor 119, and the second terminal of the transistor 121 may receive a transmission control signal TX.

[0071] Refer again Figure 4 and Figure 5 The photosensitive element 111 can generate electron-hole pairs by sensing incident light, and the generated electrical signal can be accumulated in the source node of the transmission transistor 113.

[0072] Selection transistor 119 can be turned on by selection control signal SEL, and one of the rows included in pixel array 100 can be selected. An activated reset control signal RST can be provided to the selected row, thereby turning on reset transistor 115. Therefore, the potential of the floating diffusion node FD can be converted into an analog signal processing voltage VA_P. Then, sensing transistor 117 can be turned on, so a first analog signal AS1 indicating the reset component can be output from cell pixel 110a. Afterwards, the reset control signal RST can be deactivated.

[0073] The transmission transistor 113 can be turned on by the transmission control signal TX, and electrons in the electron-hole pairs accumulated in the source node of the transmission transistor 113 can be transferred to the floating diffusion node FD. The potential of the floating diffusion node FD can vary according to the amount of electrons in the received electron-hole pairs, and at the same time, the potential of the gate of the sensing transistor 117 can also vary. When the selection transistor 119 is turned on, a second analog signal AS2 corresponding to the potential of the floating diffusion node FD can be output from the unit pixel 110a.

[0074] In other words, the first analog signal AS1 and the second analog signal AS2 can be output sequentially, line by line.

[0075] refer to Figure 4 The timing controller 210 can control the operation of the ramp signal generator 250 by providing a count enable signal CNT_EN to the ramp signal generator 250. The ramp signal generator 250 can generate a ramp signal VR that decreases in slope with amplitude during the active period when the count enable signal CNT_EN is enabled.

[0076] Figure 7 yes Figure 4 Circuit diagram of ramp signal generator 250.

[0077] refer to Figure 7 The ramp signal generator 250 may include a resistor 260 and a current generator 270. The resistor 260 may be connected between the analog signal processing voltage VA_R and the current generator 270. The resistor 260 may have a resistance value R1.

[0078] Current generator 270 can be connected between resistor 260 and analog signal processing voltage VA_R. Current generator 270 can receive a counting enable signal CNT_EN from control circuit 200. Current generator 270 can generate a reference current Iref, which increases at a constant rate during the activation period when the counting enable signal CNT_EN is enabled.

[0079] The current generator 270 may include a constant current source 271, a current amplification unit 280, and a current control unit 275 (CIU). The constant current source 271 can generate a constant current Io of a certain amplitude. The current amplification unit 280 can amplify the amplitude of the constant current Io based on the amplification control signal SCS1 received from the current control unit 275. The current amplification unit 280 may include multiple switches and multiple current mirrors.

[0080] The current control unit 275 can generate an amplified control signal SCS1 based on the counting enable signal CNT_EN, and selectively open and close the switch by providing the amplified control signal SCS1 to the switch, thereby adjusting the amplitude of the reference current Iref flowing through the resistor 260.

[0081] The ramp signal generator 250 can output a ramp signal VR from the node to which the resistor 260 and the current amplification unit 280 are connected.

[0082] Refer again Figure 4 The timing controller 210 can control the operation of the bias voltage generator 400 by providing a third control signal CTL3 to the bias voltage generator 400. The bias voltage generator 400 can generate a cascode voltage VCP or VCN based on the third control signal CTL3, and provide the generated cascode voltage VCP or VCN to the conversion block 300.

[0083] The timing controller 210 can control the operation of the noise compensator 10 by providing a fourth control signal CTL4 to the noise compensator 10. For example, the noise compensator 10 can adjust the noise added to the bias voltage VBP based on the fourth control signal CTL4.

[0084] The timing controller 210 can control the operation of the conversion block 300 by providing a fifth control signal CTL5 to the conversion block 300. The fifth control signal CTL5 can be a signal that is toggled only during the valid period when the count enable signal CNT_EN is enabled.

[0085] The timing controller 210 can control the operation of the buffer 190 by providing a sixth control signal CTL6 to the buffer 190. The buffer 190 can output the digital signal DGS received from the conversion block 300 as image data IDATA based on the sixth control signal CTL6.

[0086] Figure 8 yes Figure 4 Block diagram of the conversion circuit 310.

[0087] refer to Figure 8The conversion circuit 310 may include a correlated double sampling (CDS) circuit 320, a ramp buffer 330, and a counter 340.

[0088] The ramp buffer 330 can receive a ramp signal VR and a bias voltage VBP. The ramp buffer 330 can generate a reference voltage VREF based on the ramp signal VR and the bias voltage VBP. However, the embodiments are not limited to this, and the ramp buffer 330 may not be included in the conversion circuit 310, but may be included in another component. For example, the ramp buffer 330 may be included in the bias voltage generator 400 or the ramp signal generator 250.

[0089] The CDS circuit 320 can perform correlated double sampling on each of the first analog signal AS1 and the second analog signal AS2 using a reference voltage VREF, and generate a reset signal corresponding to the reset component and an image signal corresponding to the image component. The CDS circuit 320 can compare the amplitude of each of the reset signal and the image signal with the amplitude of the reference voltage VREF and output a comparison signal CMP. For example, when the reset signal or the image signal is less than the reference signal VREF, the CDS circuit 320 can output a comparison signal CMP with a logic high level. Furthermore, for example, when the reset signal or the image signal is equal to or greater than the reference voltage VREF, the CDS circuit 320 can output a comparison signal CMP with a logic low level.

[0090] Counter 340 can generate the digital signal DGS based on the comparison signal CMP and the counting clock signal CLKC. For example, when CDS circuit 320 outputs the comparison signal CMP by performing a correlated double sampling operation on the reset component, counter 340 can generate a first count value by performing a counting operation synchronously with the counting clock signal CLKC until the comparison signal CMP turns low. For example, when CDS circuit 320 outputs the comparison signal CMP by performing a correlated double sampling operation on the image component, counter 340 can generate a second count value by performing a counting operation synchronously with the counting clock signal CLKC until the comparison signal CMP turns low. Counter 340 can generate the digital signal DGS by subtracting the first count value from the second count value.

[0091] Figure 9 yes Figure 8 The circuit diagram of CDS circuit 320.

[0092] refer to Figure 9 The CDS circuit 320 may include a comparator 325, a first capacitor C1, a second capacitor C2, a first switch 321, and a second switch 323.

[0093] The first switch 321 can control the supply of a first analog signal AS1 and a second analog signal AS2 to the first capacitor C1 based on the first switch control signal S1. The first capacitor C1 can be connected between the first switch 321 and the negative input terminal of the comparator 325. The first capacitor C1 can sample either the first analog signal AS1 or the second analog signal AS2.

[0094] The second switch 323 can be connected between the negative input terminal and the output terminal of the comparator 325. The second switch 323 can be opened or closed based on the second switch control signal S2. The second capacitor C2 can be connected in parallel to the second switch 323.

[0095] A reference voltage VREF can be applied to the positive input terminal of comparator 325. That is, ramp buffer 330 can be connected to comparator 325. CDS circuit 320 can determine the voltage levels of reset signal RSTS and image signal IMGS based on reference voltage VREF.

[0096] Figure 10 yes Figure 8 Circuit diagram of ramp buffer 330.

[0097] refer to Figure 10 The ramp buffer 330 may include first to third p-channel metal-oxide-semiconductor (PMOS) transistors 331, 333 and 335 connected in series between the analog signal processing voltage VA_C and the ground voltage GND.

[0098] The first PMOS transistor 331 may include a source connected to the analog signal processing voltage VA_C, a gate receiving a bias voltage VBP, and a drain connected to the second PMOS transistor 333. The second PMOS transistor 333 may include a source connected to the first PMOS transistor 331, a gate receiving a common-source gate voltage VCP, and a drain connected to the third PMOS transistor 335 at the output node NO. The third PMOS transistor 335 may include a source connected to the second PMOS transistor 333 at the output node NO, a gate receiving a ramp signal VR, and a drain connected to ground voltage GND. The body of the third PMOS transistor 335 may be connected to its source. Furthermore, a reference voltage VREF may be provided by the output node NO.

[0099] Figure 11 This is a circuit diagram of the noise compensator 10 according to an embodiment. Figure 12 yes Figure 11 The circuit diagram of the first compensator 20. Figure 13This is a circuit diagram of a ramp buffer 330 that generates a reference voltage VREF using a bias voltage VBP, according to an embodiment.

[0100] refer to Figure 11 The bias voltage generator 400 can be connected to the noise compensator 10. That is, the bias voltage VBP output from the bias voltage generator 400 can be added to the noise component by the noise compensator 10 and then provided to the conversion block 300.

[0101] A current source 401 can be connected to an analog signal processing voltage VA_B to output a first current I1 of a certain magnitude to the first node N21. A current mirror 410 can be connected to the first node N21, the second node N22, and ground voltage GND. The current mirror 410 may include multiple transistors 413 and 414. The current mirror 410 can mirror the first current I1 and output a second current I2 of the same magnitude as the first current I1 to the second node N22. A PMOS transistor 403 may include a source connected to the analog signal processing voltage VA_B and a gate and drain connected to the second node N22. The PMOS transistor 403 can provide a bias voltage VBP based on the second current I2 to the switching block 300.

[0102] Here, the analog signal processing voltage VA_B may include a first noise component NP. That is, the bias voltage VBP generated by the bias voltage generator 400 may include a second noise component N_VBP, and the second noise component N_VBP may be affected by the first noise component NP.

[0103] The sampling switch 11 can be connected between the second node N22 and the first compensator 20. The sampling switch 11 can switch the bias voltage VBP to the third node N23 in response to the sampling control signal SPC1.

[0104] The noise compensator 10 may include multiple compensators. The first compensator 20 to the seventh compensator 26 may be connected in series between the sampling switch 11 and the ramp buffer 330. However, the embodiment is not limited to this, and the first compensator 20 to the seventh compensator 26 may not necessarily be connected in series, but may be arranged in other ways.

[0105] The first compensator 20 can be connected to the analog signal processing voltage VA_P to sample the bias voltage VBP using the analog signal processing voltage VA_P. The second compensator 21 can be connected to the analog signal processing voltage VA_R to sample the bias voltage VBP using the analog signal processing voltage VA_R. The third compensator 22 can be connected to the analog signal processing voltage VA_B to sample the bias voltage VBP using the analog signal processing voltage VA_B. The fourth compensator 23 can be connected to the analog signal processing voltage VA_C to sample the bias voltage VBP using the analog signal processing voltage VA_C.

[0106] The fifth compensator 24 can be connected to the digital signal processing voltage VD1_1 to sample the bias voltage VBP using the digital signal processing voltage VD1_1. The sixth compensator 25 can be connected to the digital signal processing voltage VD1_2 to sample the bias voltage VBP using the digital signal processing voltage VD1_2. The seventh compensator 26 can be connected to the digital signal processing voltage VD2 to sample the bias voltage VBP using the digital signal processing voltage VD2. That is, the noise compensator 10 can use all the power supply voltages included in the image sensing system 1.

[0107] refer to Figure 12 The first compensator 20 may include a first sampler 30 and a second sampler 40. The first sampler 30 may be connected between the analog signal processing voltage VA_P and the third node N23, and may sample and store a first portion of the bias voltage VBP in response to a first switch control signal SC4. The second sampler 40 may be connected between the third node N23 and the ground voltage GND, and may sample and store a second portion of the bias voltage VBP in response to a second switch control signal SC5.

[0108] The first sampler 30 may include first capacitors 31 to 32 connected in parallel to the analog signal processing voltage VA, and first switches SW31 to SW32 connected in parallel between the first capacitors 31 to 32 and the third node N23. Multiple bits of the first switch control signal SCS4 may be applied to the first switches SW31 to SW32. For example, the capacitances of the first capacitors 31 to 32 may be identical.

[0109] The second sampler 40 may include second switches SW41 to SW42 connected in parallel to the third node N23 and second capacitors 41 to 42 connected in parallel between the second switches SW41 to SW42 and ground voltage GND. Multiple bits of the second switch control signal SCS5 may be applied to the second switches SW41 to SW42. For example, the capacitances of the second capacitors 41 to 42 may be identical.

[0110] The ratio of the first portion of the bias voltage VBP stored in the first capacitors 31 to 32 to the second portion of the bias voltage VBP stored in the second capacitors 41 to 42 can vary depending on the combination of the bits of the first switch control signal SCS4 and the bits of the second switch control signal SCS5.

[0111] Assuming the noise component is not included in the ground voltage GND, the amplitude of the second noise component N_VBP of the bias voltage VBP can vary according to the ratio of the amplitude of the first portion of the bias voltage VBP stored in the first sampler 30 to the amplitude of the second portion of the bias voltage VBP stored in the second sampler 40. Therefore, the amplitude of the third noise component N_VREF of the reference voltage VREF can also vary.

[0112] refer to Figure 13 As the amplitude of the second noise component N_VBP of the bias voltage VBP changes, the amplitude of the third noise component N_VREF of the reference voltage VREF can also change. Here, the amplitude of the second noise component N_VBP of the bias voltage VBP can be adjusted using the analog signal processing voltage VA, the first digital signal processing voltage VD1, and the second digital signal processing voltage VD2 in the noise compensator 10.

[0113] Refer again Figure 11 The noise compensator 10 may include compensators 20 to 26 using different voltages. That is, all compensators 20 to 26 can be used to change the amplitude of the second noise component N_VBP of the bias voltage VBP. In other words, the noise compensator 10 can use the analog signal processing voltage VA, the first digital signal processing voltage VD1, and the second digital signal processing voltage VD2 to adjust the amplitude of the second noise component N_VBP of the bias voltage VBP.

[0114] Because the noise compensator 10 uses not only the analog signal processing voltage VA used for processing analog signals, but also the digital signal processing voltages VD1 and VD2 used for processing digital signals (i.e., using sampled voltage or noise) to adjust the amplitude of the second noise component N_VBP, the digital signal DGS and the image data IDATA output from the image sensor 2 can be further improved by having less power noise.

[0115] Figure 14 This is a circuit diagram of comparator 325 that generates a comparison signal CMP using a reference voltage VREF according to an embodiment. Figure 15 This is a graph showing the noise compensation performed by the noise compensator 10 according to an embodiment.

[0116] refer to Figure 14The unit pixel 110a and the ramp buffer 330 can be connected to the CDS circuit 320. The analog signal processing voltage VA_C used by the ramp buffer 330 may include a first noise component NP, and the bias voltage VBP applied to the first PMOS transistor 331 of the ramp buffer 330 may include a second noise component N_VBP. The amplitude of the third noise component N_VREF of the reference voltage VREF generated by the ramp buffer 330 using the analog signal processing voltage VA_C and the bias voltage VBP can be equal to the amplitude of the noise component N_AS of the analog signal AS output from the unit pixel 110a. That is, the amplitude of the third noise component N_VREF of the reference voltage VREF can be adjusted to be equal to the amplitude of the noise component N_AS of the analog signal AS.

[0117] The comparator 325 of the CDS circuit 320 can output a comparison signal CMP by comparing the reference voltage VREF and the analog signal AS. (Reference) Figure 15 The third noise component N_VREF of the reference voltage VREF and the noise component N_AS of the analog signal AS or pixel signal Vpix can cancel each other out. Therefore, the comparison signal CMP may not include noise components. In this case, the third noise component N_VREF can take into account not only the analog signal processing voltage VA used in the analog domain, but also the first digital signal processing voltage VD1 used in the digital domain and the second digital signal processing voltage VD2 used in the image signal processor 4. Therefore, the digital signal DGS and the image data IDATA output from the image sensor 2 can be further improved.

[0118] Now refer to Figures 1 to 16 Describe the operation of image sensor 2.

[0119] Figure 16 This is a timing diagram used to explain the operation of the image sensor according to an embodiment.

[0120] refer to Figure 16 At time t21, the row driver 220 can select one of the rows included in the pixel array 100 by providing a selection control signal SEL that is activated to a logic high level to the pixel array 100.

[0121] At time t22, the row driver 220 provides a reset control signal RST to the selected row. At this time, the pixel voltage signal Vpix output from the pixel array 100 can be a first analog signal AS1 indicating the reset component.

[0122] At time t23, the timing controller 210 can provide a counting enable signal CNT_EN with a logic high level to the ramp signal generator 250, and the ramp signal generator 250 can reduce the voltage level of the ramp signal VR with a slope a of a certain magnitude. Furthermore, the timing controller 210 can provide a counting clock signal CLKC to the counter 340, and the counter 340 can start counting operations synchronously with the counting clock signal CLKC.

[0123] At time t24, the reference voltage VREF and the reset signal voltage levels can become the same, and the comparison signal CMP output from comparator 325 can transition to a logic low level, thereby ending the counting operation. At this time, counter 340 can generate a first count value CNT1 corresponding to the reset signal. Here, due to the operation of bias voltage generator 400, noise compensator 10, and ramp buffer 330, the comparison signal CMP may not contain noise components.

[0124] At time t25, the ramp generator 250 can be disabled when the count enable signal CNT_EN is deactivated to a logic low level. The time period from time t23 to time t25 can be the maximum time period for counting the reset signal, and can be set to correspond to an appropriate number of clock cycles according to the characteristics of the image sensor 2.

[0125] At time t26, the row driver 220 may provide a transmission control signal TX to the selected row. At this time, the pixel voltage signal Vpix output from the pixel array 100 may be a second analog signal AS2 indicating the image components according to the incident light.

[0126] At time t27, timing controller 210 can again provide a counting enable signal CNT_EN with a logic high level to ramp signal generator 250. Ramp signal generator 250 can then begin to decrease the voltage level of ramp signal VR at a slope a with the same magnitude as the slope a at time t23. Furthermore, timing controller 210 can provide a counting clock signal CLKC to counter 340, and counter 340 can begin counting operations synchronously with the counting clock signal CLKC.

[0127] At time t28, the reference voltage VREF and the voltage level of the image signal can become the same, and the comparison signal CMP output from comparator 325 can transition to a logic low level, thereby ending the counting operation. At this time, counter 340 generates a second count value CNT2 corresponding to the image signal. Here, due to the operation of bias voltage generator 400 and ramp buffer 330, the comparison signal CMP may not include noise components. Counter 340 can output a digital signal DGS indicating the effective component of the incident light by subtracting the first count value CNT1 from the second count value CNT2.

[0128] At time t29, the ramp generator 250 can be disabled when the counting enable signal CNT_EN is deactivated to a logic low level. The time period from time t27 to time t29 can be the maximum time period for counting the image signal and can be set to correspond to an appropriate number of clock cycles according to the characteristics of the image sensor 2.

[0129] At time t30, the row driver 220 can deselect the selected row by providing the pixel array 100 with a selection control signal SEL that is deactivated to a logic low level.

[0130] Now refer to Figure 17 and Figure 18 The image sensor 2b according to an embodiment is described.

[0131] Figure 17 and Figure 18 This is a block diagram of the image sensor 2b according to an embodiment. For ease of description, references will be briefly given or omitted. Figures 1 to 16 Descriptions of the same components and features.

[0132] refer to Figure 17 The noise compensator 10b can receive a ramp signal VR from the ramp signal generator 250 and a bias voltage VBP from the bias voltage generator 400. The noise compensator 10b can generate a reference voltage VREF based on the received ramp signal VR and the received bias voltage VBP. Furthermore, the noise compensator 10b can transmit the generated reference voltage VREF to the conversion circuit 310b.

[0133] refer to Figure 18 The noise compensator 10b can receive a ramp signal VR and a bias voltage VBP, and generate a reference voltage VREF in response to the ramp signal VR and the bias voltage VBP. For example, the noise compensator 10b may include a method using... Figures 1 to 16 The ramp buffer 330 is described. The noise compensator 10b can provide the generated reference voltage VREF to the conversion circuit 310b.

[0134] The conversion circuit 310b may include a CDS circuit 320 and a counter 340. The conversion circuit 310b may not include a ramp buffer 330. The CDS circuit 320 may receive a reference voltage VREF and output a comparison signal CMP by comparing the reference voltage VREF with an analog signal AS.

[0135] In other words, with use Figures 1 to 16 The noise compensator 10 of the image sensor 2 described is different. The noise compensator 10b can generate a reference voltage VREF itself and provide the reference voltage VREF to the conversion circuit 310b. In addition, the conversion circuit 310b may not include the ramp buffer 330. However, the embodiments are not limited to this.

[0136] Now refer to Figure 19 and Figure 20 The image sensor 2c according to an embodiment is described.

[0137] Figure 19 and Figure 20 This is a block diagram of the image sensor 2c according to an embodiment. For ease of description, references will be briefly given or omitted. Figures 1 to 16 Descriptions of the same components and features.

[0138] refer to Figure 19 The image sensor 2c may also include a noise compensator 10c connected to the ramp signal generator 250, subtractor 194, etc.

[0139] Although using Figures 1 to 16 The noise compensator 10 described is connected between the bias voltage generator 400 and the converter block 300, but the noise compensator 10c can be connected between the ramp signal generator 250 and the subtractor 194.

[0140] The noise compensator 10c can receive a ramp signal VR, an analog signal processing voltage VA, a first digital signal processing voltage VD1, and a second digital signal processing voltage VD2. In response to these signals, the noise compensator 10c can provide a second digital signal DGS2 to the subtractor 194.

[0141] The conversion circuit 310 can generate a first digital signal DGS1 in response to the ramp signal VR received from the ramp signal generator 250 and the bias voltage VBP received from the bias voltage generator 400. Here, the first digital signal DGS1 may include noise components. That is, although using... Figures 1 to 16 The described digital signal DGS contains almost no noise components, but the first digital signal DGS1 may contain noise components. However, the embodiments are not limited thereto.

[0142] Subtractor 194 can receive a first digital signal DGS1 and a second digital signal DGS2, and generate a digital signal DGS' by subtracting the second digital signal DGS2 from the first digital signal DGS1.

[0143] refer to Figure 20 The noise compensator 10c may include a first compensator 20 to a seventh compensator 26. The noise compensator 10c may generate a noise signal NS based on an analog signal processing voltage VA, a first digital signal processing voltage VD1, and a second digital signal processing voltage VD2. (This is in contrast to the use of...) Figures 1 to 16 Unlike the noise compensator 10 described, the noise compensator 10c can generate the noise signal NS by itself, rather than generating it by changing the noise component of the bias voltage VBP.

[0144] The noise compensator 10c may include a conversion circuit 310'. The conversion circuit 310' may have the same structure as the conversion circuit 310 included in the conversion block 300. The conversion circuit 310' may receive a noise signal NS and a ramp signal VR, and generate a second digital signal DGS2 based on the noise signal NS and the ramp signal VR. The second digital signal DGS2 may be transmitted to the subtractor 194.

[0145] Refer again Figure 19 Subtractor 194 can generate digital signal DGS' by subtracting second digital signal DGS2 from first digital signal DGS1. Although using... Figures 1 to 16 The noise removal in the described image sensor 2 is performed in the analog domain, but the noise removal in the subtractor 194 can be performed in the digital domain. Therefore, the digital signal DGS' and the image data IDATA output from the image sensor 2c can be further improved.

[0146] Figure 21 This is a block diagram of the image sensing system 1b according to an embodiment. For ease of description, references will be briefly given or omitted. Figures 1 to 16 Descriptions of the same components and features.

[0147] refer to Figure 21 The image sensing system 1b may include an image sensor 2 and an application processor 3 (AP). An image signal processor 4 may be included in the application processor 3. The application processor 3 may receive image data IDATA from the image sensor 2.

[0148] Noise compensator 10 may be included in image sensor 2. Here, noise compensator 10 may use a second digital signal processing voltage VD2 used by application processor 3 or image signal processor 4 to improve noise. That is, noise compensator 10 may use a voltage used not only by image sensor 2, but also by external devices such as application processor 3.

[0149] Figure 22 This is a block diagram of an image sensing system 1c according to an embodiment. For ease of description, references will be briefly given or omitted. Figures 1 to 16 Descriptions of the same components and features.

[0150] refer to Figure 22 The image sensing system 1c may include an image sensor 2 and an application processor 3. An image signal processor 4 may be included in the image sensor 2. The application processor 3 may receive image data IDATA from the image sensor 2.

[0151] Although image signal processor 4 is included Figure 21 The image sensing system 1b is in the application processor 3, but the image signal processor 4 can be included in the image sensor 2. The noise compensator 10 can use the analog signal processing voltage VA, the first digital signal processing voltage VD1, and the second digital signal processing voltage VD2 used in the image sensor 2 to improve noise.

[0152] Now refer to Figure 23 and Figure 24 An electronic device 1000 according to an embodiment is described.

[0153] Figure 23 This is a block diagram of an electronic device 1000 including multiple camera modules 1100a to 1100c according to an embodiment. Figure 24 yes Figure 23 A detailed block diagram of the camera module 1100b is provided. For ease of description, references will be briefly given or omitted. Figures 1 to 22 Descriptions of the same components and features.

[0154] refer to Figure 23 The electronic device 1000 may include a camera module group 1100, an application processor 1200, a power management integrated circuit (PMIC) 1300, an external memory 1400, and a display 1500.

[0155] Camera module group 1100 may include a plurality of camera modules 1100a to 1100c. Although an embodiment with three camera modules 1100a to 1100c arranged is shown in the accompanying drawings, the embodiments are not limited thereto. In some embodiments, camera module group 1100 may be modified to include only two camera modules. Furthermore, in some embodiments, camera module group 1100 may be modified to include n camera modules (n is a natural number 4 or a greater natural number).

[0156] Here, one of the three camera modules 1100a to 1100c may include the use of Figures 1 to 22 The image sensor 2 described is a camera module. Alternatively, one of the three camera modules 1100a to 1100c may include a camera module using... Figures 1 to 22 The image sensor 2 and image signal processor 4 described are camera modules.

[0157] Now refer to Figure 24 The detailed configuration of camera module 1100b is described in more detail, but the following description is equally applicable to other camera modules 1100a and 1100c according to the embodiments.

[0158] refer to Figure 24 The camera module 1100b may include a prism 1105, an optical path folding element (OPFE) 1110, an actuator 1130, an image sensing device 1140, and a storage unit 1150.

[0159] The prism 1105 may include a reflective surface 1107 of a light-reflecting material to alter the path of light L incident from the outside.

[0160] In some embodiments, prism 1105 can change the path of light L incident in the first direction X to a second direction Y perpendicular to the first direction X. Furthermore, prism 1105 can change the path of light L incident in the first direction X to a second direction Y perpendicular to the first direction X by rotating the reflective surface 1107 of the light-reflecting material about the central axis 1106 in direction A or by rotating the central axis 1106 in direction B. In this case, OPFE 1110 can also move in a third direction Z perpendicular to the first and second directions X and Y.

[0161] In some embodiments, as shown in the figure, the maximum rotation angle of the prism 1105 in the A direction may be 15 degrees or less in the positive (+) A direction and greater than 15 degrees in the negative (-) A direction, but is not limited thereto.

[0162] In some embodiments, prism 1105 can move at an angle of approximately 20 degrees, 10 to 20 degrees, or 15 to 20 degrees in the positive (+) or negative (-) B direction. Here, prism 1105 can move at the same angle in the positive (+) or negative (-) B direction, or it can move at almost the same angle differing by approximately 1 degree.

[0163] In some embodiments, the prism 1105 can move the reflective surface 1107 of the light-reflecting material in a third direction (e.g., the Z direction) parallel to the direction in which the central axis 1106 extends.

[0164] OPFE 1110 may include a set of m optical lenses (where m is a natural number). The m lenses can be moved in the second direction Y to change the optical zoom ratio of camera module 1100b. For example, when the basic optical zoom ratio of camera module 1100b is Z, if the m optical lenses included in OPFE 1110 are moved, the optical zoom ratio of camera module 1100b can be changed to 3Z or 5Z or a larger optical zoom ratio.

[0165] Actuator 1130 can move OPFE 1110 or optical lens (hereinafter referred to as optical lens) to a position. For example, actuator 1130 can adjust the position of optical lens so that image sensor 1142 is within the focal length of optical lens for accurate sensing.

[0166] Image sensing device 1140 may include image sensor 1142, control logic 1144, and memory 1146. Image sensor 1142 can use light L provided through an optical lens to sense an image of a sensing target. In some embodiments, image sensor 1142 may include the image sensor 2 described above.

[0167] Control logic 1144 can control the overall operation of camera module 1100b. For example, control logic 1144 can control the operation of camera module 1100b according to the control signals provided through control signal line CSLb.

[0168] Memory 1146 may store information for the operation of camera module 1100b, such as calibration data 1147. Calibration data 1147 may include information for camera module 1100b to generate image data using light L provided externally. Calibration data 1147 may include, for example, information about the degree of rotation, information about the focal length, and information about the optical axis. When camera module 1100b is implemented as a multi-state camera where the focal length changes according to the position of the optical lens, calibration data 1147 may include the focal length value for each position (or state) of the optical lens and information related to autofocus.

[0169] Storage unit 1150 can store image data sensed by image sensor 1142. Storage unit 1150 can be arranged outside of image sensing device 1140 and can be implemented in a stacked manner, wherein sensor chips constitute image sensing device 1140. In some embodiments, storage unit 1150 can be implemented as, but is not limited to, electrically erasable programmable read-only memory (EEPROM).

[0170] Let's refer to each other. Figure 23 and Figure 24 In some embodiments, each of camera modules 1100a to 1100c may include an actuator 1130. Therefore, camera modules 1100a to 1100c may include the same or different calibration data 1147 depending on the operation of the actuator 1130 included therein.

[0171] In some embodiments, one of camera modules 1100a to 1100c (e.g., 1100b) may be a folding lens camera module including the prism 1105 and OPFE 1110 described above, and the other camera modules (e.g., 1100a and 1100c) may be vertical camera modules excluding the prism 1105 and OPFE 1110. However, the embodiments are not limited thereto.

[0172] In some embodiments, one of the camera modules 1100a to 1100c (e.g., 1100c) may be a vertical depth camera that extracts depth information using, for example, infrared (IR). In this case, the application processor 1200 can generate a 3D depth image by combining image data received from the depth camera and image data received from another camera module (e.g., 1100a or 1100b).

[0173] In some embodiments, at least two of the camera modules 1100a to 1100c (e.g., 1100a and 1100c) may have different fields of view (angles of view). In this case, the optical lenses of at least two of the camera modules 1100a to 1100c (e.g., 1100a and 1100c) may be different from each other, but the embodiments are not limited thereto.

[0174] Furthermore, in some embodiments, camera modules 1100a to 1100c may have different viewing angles. In this case, the optical lenses included in camera modules 1100a to 1100c may also be different from each other, but the embodiments are not limited thereto.

[0175] In some embodiments, camera modules 1100a to 1100c may be physically separated from each other. That is, the sensing area of ​​an image sensor 1142 may not be divided and used by camera modules 1100a to 1100c, but an independent image sensor 1142 may be arranged in each of camera modules 1100a to 1100c.

[0176] Refer again Figure 23 The application processor 1200 may include an image processing device 1210, a memory controller 1220, and internal memory 1230. The application processor 1200 may be separate from the camera modules 1100a to 1100c. For example, the application processor 1200 and the camera modules 1100a to 1100c may be implemented as separate semiconductor chips.

[0177] The image processing device 1210 may include a plurality of sub-image processors 1212a to 1212c, an image generator 1214, and a camera module controller 1216.

[0178] The image processing device 1210 may include a plurality of sub-image processors 1212a to 1212c corresponding to the number of camera modules 1100a to 1100c.

[0179] Image data generated by camera modules 1100a to 1100c can be provided to sub-image processors 1212a to 1212c via corresponding, separate image signal lines ISLa to ISLc. For example, image data generated by camera module 1100a can be provided to sub-image processor 1212a via image signal line ISLa, image data generated by camera module 1100b can be provided to sub-image processor 1212b via image signal line ISLb, and image data generated by camera module 1100c can be provided to sub-image processor 1212c via image signal line ISLc. This image data transmission can be performed, for example, using a camera serial interface (CSI) based on a mobile industry processor interface (MIPI), but the embodiments are not limited thereto.

[0180] In some embodiments, a sub-image processor may be arranged to correspond to multiple camera modules. For example, sub-image processors 1212a and 1212c may not be separated from each other as shown, but may be integrated into a single sub-image processor, and image data provided by camera modules 1100a and 1100c may be selected by a selection element (e.g., a multiplexer) and then provided to the single sub-image processor.

[0181] Image data provided to each of the sub-image processors 1212a to 1212c can be provided to the image generator 1214. The image generator 1214 can generate an output image using the image data received from each of the sub-image processors 1212a to 1212c, based on image generation information or pattern signals.

[0182] Image generator 1214 can generate an output image by merging at least some of the image data generated by camera modules 1100a to 1100c with different viewpoints, based on image generation information or pattern signals. Furthermore, image generator 1214 can generate an output image by selecting any one of the image data generated by camera modules 1100a to 1100c with different viewpoints, based on image generation information or pattern signals.

[0183] In some embodiments, image generation information may include a zoom signal or zoom factor. Furthermore, in some embodiments, the mode signal may be, for example, a signal based on a mode selected by the user.

[0184] When the image generation information is a zoom signal (zoom factor) and camera modules 1100a to 1100c have different fields of view (angles of view), the image generator 1214 can operate differently depending on the type of zoom signal. For example, if the zoom signal is a first signal, the image generator 1214 can merge image data output from camera module 1100a and image data output from camera module 1100c, and then use the merged image signal and image data output from camera module 1100b that was not used in the merging to generate an output image. If the zoom signal is a second signal different from the first signal, the image generator 1214 may not perform such image data merging, and can generate an output image by selecting any one of the image data output from camera modules 1100a to 1100c. However, the embodiments are not limited to this, and the method of processing image data can be modified as needed.

[0185] In some embodiments, the image generator 1214 may receive multiple image data with different exposure times from any one or any combination of sub-image processors 1212a to 1212c, and may generate merged image data with increased dynamic range by performing high dynamic range (HDR) processing on the image data.

[0186] The camera module controller 1216 can provide control signals to each of the camera modules 1100a to 1100c. The control signals generated by the camera module controller 1216 can be provided to the camera modules 1100a to 1100c through corresponding control signal lines CSLa to CSLc that are separated from each other.

[0187] Any one of camera modules 1100a to 1100c (e.g., 1100a) can be designated as the master camera based on image generation information including zoom signals or mode signals, and other camera modules (e.g., 1100b and 1100c) can be designated as slave cameras. This information can be included in control signals and provided to camera modules 1100a to 1100c via corresponding control signal lines CSLa to CSLc that are separated from each other.

[0188] The camera module, operating as both a master and a slave, can change its behavior based on the zoom factor or operating mode signal. For example, when the field of view of camera module 1100a is wider than that of camera module 1100c and the zoom factor indicates a low zoom ratio, camera module 1100c can operate as the master, and camera module 1100a can operate as the slave. Conversely, when the zoom factor indicates a high zoom ratio, camera module 1100a can operate as the master, and camera module 1100c can operate as the slave.

[0189] In some embodiments, the control signals provided from the camera module controller 1216 to each of the camera modules 1100a to 1100c may include a synchronization enable signal. For example, when camera module 1100b is the main camera and camera modules 1100a and 1100c are the slave cameras, the camera module controller 1216 may send a synchronization enable signal to camera module 1100b. Camera module 1100b, receiving the synchronization enable signal, may generate a synchronization signal based on the synchronization enable signal and provide the generated synchronization signal to camera modules 1100a and 1100c via the synchronization signal line SSL. Camera modules 1100b, 1100a, and 1100c may send image data to the application processor 1200 synchronously with the synchronization signal.

[0190] In some embodiments, control signals provided from camera module controller 1216 to camera modules 1100a to 1100c may include mode information based on mode signals. Based on the mode information, camera modules 1100a to 1100c may operate in a first operating mode and a second operating mode in relation to sensing speed.

[0191] In the first operating mode, camera modules 1100a to 1100c can generate image signals at a first speed (e.g., generate image signals at a first frame rate), encode image signals at a second speed higher than the first speed (e.g., encode image signals at a second frame rate higher than the first frame rate), and send the encoded image signals to application processor 1200. Here, the second speed can be 30 times or less than the first speed.

[0192] Application processor 1200 can store the received image signal (in other words, the encoded image signal) in internal memory 1230 included in application processor 1200 or external memory 1400 outside application processor 1200. Then, application processor 1200 can read the encoded image signal from internal memory 1230 or external memory 1400, decode the read image signal, and display image data generated based on the decoded image signal. For example, the corresponding sub-processors among sub-image processors 1212a to 1212c of image processing device 1210 can decode the encoded image signal and perform image processing on the decoded image signal. For example, image data generated based on the decoded image signal can be displayed on display 1500.

[0193] In the second operating mode, camera modules 1100a to 1100c can generate image signals at a third speed lower than the first speed (e.g., generate image signals at a third frame rate lower than the first frame rate) and send the image signals to application processor 1200. The image signals provided to application processor 1200 can be unencoded signals. Application processor 1200 can perform image processing on the received image signals, or it can store the image signals in internal memory 1230 or external memory 1400.

[0194] PMIC 1300 can supply power, for example, to each of camera modules 1100a to 1100c, via a power supply voltage. For example, under the control of application processor 1200, PMIC 1300 can supply a first power to camera module 1100a via power signal line PSLa, a second power to camera module 1100b via power signal line PSLb, and a third power to camera module 1100c via power signal line PSLc.

[0195] The PMIC 1300 can generate power corresponding to each of the camera modules 1100a to 1100c, and also adjusts the power level in response to a power control signal PCON from the application processor 1200. The power control signal PCON can include a power adjustment signal for each operating mode of the camera modules 1100a to 1100c. For example, the operating mode can include a low power mode. Here, the power control signal PCON can include information about the camera module operating in the low power mode and at the set power level. The power levels provided to each of the camera modules 1100a to 1100c can be the same or different. Furthermore, the power levels can be dynamically changed. In some embodiments, the PMIC 1300 can provide an analog signal processing voltage VA, a first digital signal processing voltage VD1, and a second digital signal processing voltage VD2.

[0196] While this disclosure has been shown and described with reference to embodiments thereof, those skilled in the art will understand that various changes in form and detail may be made without departing from the spirit and scope of this disclosure as defined by the appended claims. The embodiments are to be considered merely for descriptive purposes and not for limiting purposes.

Claims

1. An image sensor, comprising: The pixel is configured to generate a pixel signal using analog signal processing voltage; A ramp signal generator is configured to generate a ramp signal using the analog signal processing voltage; A bias voltage generator is configured to generate a bias voltage using the analog signal processing voltage; The noise compensator is configured as follows: The noise component is generated using both the digital signal processing voltage and the analog signal processing voltage. as well as The generated noise component is added to the generated bias voltage; and The conversion circuit is configured as follows: A reference voltage is generated based on the generated ramp signal and the bias voltage to which the noise component has been added; as well as Based on the generated reference voltage, an image signal is generated by performing analog-to-digital conversion on the generated pixel signal, wherein the analog-to-digital conversion is performed using the digital signal processing voltage. A voltage generator is configured to generate the digital signal processing voltage and the analog signal processing voltage.

2. The image sensor of claim 1, wherein, The amplitude of the analog signal processing voltage is greater than the amplitude of the digital signal processing voltage.

3. The image sensor of claim 1, wherein, The analog signal processing voltage includes a first sub-analog signal processing voltage, a second sub-analog signal processing voltage, and a third sub-analog signal processing voltage. The pixel signal is generated using the first sub-analog signal processing voltage. The ramp signal is generated using the second sub-analog signal processing voltage, and The bias voltage is generated using the third sub-analog signal processing voltage.

4. The image sensor of claim 3, wherein, The noise component is generated using the digital signal processing voltage, the first sub-analog signal processing voltage, the second sub-analog signal processing voltage, and the third sub-analog signal processing voltage.

5. The image sensor of claim 1, wherein, The reference voltage is generated using the analog signal processing voltage.

6. The image sensor of claim 1 further includes a memory interface device configured to use the digital signal processing voltage to transmit the generated image signal.

7. The image sensor of claim 1, wherein, The voltage generator is also configured to: The generated analog signal processing voltage is provided to the pixel, the ramp signal generator, the bias voltage generator, and the noise compensator; as well as The generated digital signal processing voltage is provided to the noise compensator and the conversion circuit.

8. The image sensor of claim 1, wherein, The generated noise component corresponds to the noise component of the pixel signal.

9. The image sensor of claim 1, wherein, The pixels are arranged on the upper part of the image sensor. The ramp signal generator, the bias voltage generator, the conversion circuit, and the memory interface are arranged at the bottom of the image sensor, and The noise compensator is further configured to receive the analog signal processing voltage and the digital signal processing voltage from the lower part of the image sensor.

10. The image sensor of claim 1, wherein, The noise compensator includes: The first sub-noise compensator is configured to adjust the analog signal processing voltage; and The second sub-noise compensator is configured to adjust the digital signal processing voltage, and The noise compensator is further configured to use an adjusted analog signal processing voltage and an adjusted digital signal processing voltage to change the noise component.

11. An image sensor, comprising: The pixel is configured to generate a pixel signal using analog signal processing voltage; A ramp signal generator is configured to generate a ramp signal using the analog signal processing voltage; A bias voltage generator is configured to generate a bias voltage using the analog signal processing voltage; The conversion circuit is configured as follows: A reference voltage is generated based on the generated bias voltage and the generated ramp signal; as well as Based on the generated reference voltage, a first digital signal is generated by performing analog-to-digital conversion on the generated pixel signal; The noise compensator is configured as follows: A noise signal is generated using an externally provided digital signal processing voltage and the analog signal processing voltage; as well as Based on the generated ramp signal, a second digital signal is generated by performing analog-to-digital conversion on the generated noise signal; and The subtractor is configured to generate a third digital signal by subtracting a second digital signal from a first digital signal.

12. The image sensor of claim 11, wherein, The amplitude of the analog signal processing voltage is greater than the amplitude of the digital signal processing voltage.

13. The image sensor of claim 11, further comprising a voltage generator configured to generate the digital signal processing voltage and the analog signal processing voltage.

14. The image sensor of claim 13, wherein, The voltage generator is also configured to: The generated analog signal processing voltage is provided to the pixel, the ramp signal generator, the bias voltage generator, and the noise compensator; as well as The generated digital signal processing voltage is provided to the noise compensator and the conversion circuit.

15. An image sensing system, comprising: An image sensor is configured to output an image signal by sensing light incident on a pixel; and The image signal processor is configured to process the output image signal using an externally provided first digital signal processing voltage. The image sensor includes: The pixel is configured to generate a pixel signal using an analog signal processing voltage; A ramp signal generator is configured to generate a ramp signal using the analog signal processing voltage; A bias voltage generator is configured to generate a bias voltage using the analog signal processing voltage; The noise compensator is configured as follows: Noise components are generated using the first digital signal processing voltage, an externally provided second digital signal processing voltage, and the analog signal processing voltage; and The generated noise component is added to the generated bias voltage; and The conversion circuit is configured as follows: A reference voltage is generated based on the generated ramp signal and the bias voltage to which the noise component has been added; and The image signal is generated by performing analog-to-digital conversion on the generated pixel signal based on the generated reference voltage.

16. The image sensing system of claim 15, further comprising an application processor, in, The image signal processor is also configured to provide the processed image signal to the application processor.

17. The image sensing system according to claim 15, wherein, The image sensor and the image signal processor are implemented as semiconductor chips in the camera module, and The semiconductor chip is configured to use the first digital signal processing voltage, the second digital signal processing voltage, and the analog signal processing voltage.

18. The image sensing system according to claim 15, wherein, The image signal processor is included in an application processor configured to process the processed image signal using the first digital signal processing voltage.

Citation Information

Patent Citations

  • Da converter, solid-state imaging device, and camera system

    CN101873137A

  • Image sensing device and method for driving the same

    CN107026991A