Light-controlled image sensor, camera using same, and control method thereof

The light-controlled image sensor addresses the dynamic range limitations of existing sensors by incorporating a light control unit to optimize light levels per pixel or area, achieving a high dynamic range and enhancing image quality across varying light conditions.

WO2025135256A1PCT designated stage expired Publication Date: 2025-06-26KOREA ADVANCED NANO FAB CENT
View PDF 5 Cites 0 Cited by

Patent Information

Application Number
PCT/KR2023/021441
Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
Priority Date
2023-12-22
Filing Date
2023-12-22
Publication Date
2025-06-26

AI Technical Summary

Technical Problem

Existing image sensors and cameras face limitations in dynamic range, struggling to capture high-quality images or videos under varying light conditions, leading to issues like ghost artifacts in videos and limited recognition of objects in bright or dark areas.

Method used

A light-controlled image sensor with a light control unit formed on the image sensor to selectively control the amount of light per pixel or area, using a light detection unit and control unit to optimize light levels, achieving a high dynamic range.

Benefits of technology

The solution enables high-quality imaging with a dynamic range of 180 dB to 240 dB, reducing ghost artifacts and improving object recognition across a wide range of light conditions, suitable for applications like HDR image sensors, autonomous driving, and 3D cameras.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure KR2023021441_26062025_PF_FP_ABST
    Figure KR2023021441_26062025_PF_FP_ABST
Patent Text Reader

Abstract

The present invention relates to an image sensor, specifically a light-controlled image sensor, a camera using same, and a control method thereof, wherein the light-controlled image sensor comprises: a light adjustment unit which is formed on a path on which light is incident, and which selectively adjusts the amount of light for each pixel or for each region; a light detection unit on which light that has passed through the light adjustment unit is incident; and a control unit which selectively controls light adjustment pixels or light adjustment regions of the light adjustment unit, and which controls the light detection unit.
Need to check novelty before this filing date? Find Prior Art

Description

Optical control image sensor, camera using the same, and control method thereof

[0001] The present invention relates to an image sensor and a camera using the same, and more particularly, to a light-controlled image sensor that forms a light control unit on the image sensor to control the amount of light per pixel or area to achieve a high dynamic range, a camera using the same, and a control method therefor.

[0002] The national research and development projects that supported this invention are as follows.

[0003] Assignment ID 1711154893

[0004] Assignment number 2020M3H4A3081731

[0005] Ministry of Science and ICT

[0006] Project Management Agency Name: Research Foundation

[0007] Research Project Name: 2020 Materials Innovation Leading Project

[0008] Research Project Name: Development of superlattice application semiconductor material growth technology using organic metal vapor phase growth.

[0009] Contribution rate 1 / 1

[0010] Name of the project performing organization: Korea Institute of Nanotechnology

[0011] Research period: May 15, 2020 - December 31, 2022

[0012] In general, digital image sensors or cameras can sense under limited illumination, and dynamic range refers to the range of light intensity that can be expressed in an image captured by the sensor or camera.

[0013] The dynamic range of humans is known to be 80 dB, the dynamic range of a CMOS sensor is 54 dB, the dynamic range of the Earth is over 100 dB, and the dynamic range of space is over 180 dB, so images captured by cameras and the like appear to have lower image quality than the actual images seen by humans.

[0014] That is, an image sensor that receives direct sunlight may not be able to collect carriers because too many carriers may be generated to the extent that they offset the electric field inside the sensor. Conversely, in a place that is too dark, the number of incident photons is small, so the carriers generated by the light may be collected well, but if they are smaller than the dark current, light detection becomes difficult.

[0015] Figure 1 is a drawing to illustrate a problem due to the limitation of the dynamic range of an image sensor. As shown, it is impossible to image direct sunlight and starlight simultaneously, so in order to capture them in one screen, images with different shooting conditions must be synthesized.

[0016] Image sensor elements used in autonomous driving, 3D, and mixed reality (XR) cameras also have a limited dynamic range that can be sensed, so if the difference in light intensity in a single frame is too large (typically exceeding 100 dB), it is difficult to recognize objects in bright or dark areas.

[0017] Recently, the demand for high dynamic range (HDR) is increasing to meet the demand for high-definition 3D or video.

[0018] To achieve the existing high dynamic range, various methods are being studied, such as improving the image sensor components, changing the circuit configuration, or utilizing algorithms.

[0019] Conventional high dynamic range imaging involves combining multiple images of the same scene captured at different exposure times, a method known as multiple exposure blending. This can be applied to still images, but suffers from ghost artifacts in video.

[0020] In addition, to implement high dynamic range, the maximum Q is adjusted for a certain period of time (t1) using a circuit-level method (DR for Well Capacity Adjusting). max There is a method to increase the dynamic range by integrating the charge only up to tint and then using the charge integrated again up to tint. However, the error is very large when saturation current is present, and the increase in dynamic range is limited to about 20 dB.

[0021] In this way, the existing method has difficulties in applying high-quality images or videos because the dynamic range of CMOS sensors (CIS) and CCDs (Charge Coupled Devices) is limited to a maximum of 80 dB.

[0022] The present invention was derived to solve the above problem, and its purpose is to provide a light-controlled image sensor that forms a light control unit in an image sensor to control the amount of light per pixel or area to achieve a high dynamic range, a camera using the same, and a control method thereof.

[0023] In order to achieve the above object, the present invention is characterized by a light-controlled image sensor and a camera using the same, which comprises a light-controlled image sensor formed on a path through which light is incident and selectively controls the amount of light for each pixel or region, a light-detecting unit into which light passing through the light-controlled unit is incident, and a control unit that selectively controls a light-controlled pixel or light-controlled region of the light-controlled unit and controls the light-detecting unit.

[0024] In addition, the present invention provides a control method for a light-controlled image sensor, characterized in that the method comprises the steps of selectively controlling the amount of light by pixel or area by a light control unit, the step of detecting the amount of light by causing light passing through the light control unit to be incident on a light detection unit, the step of determining whether the amount of light is attenuated by pixel or area in the previous frame based on the detected amount of light by a control unit and controlling the amount of light, and the step of detecting the amount of light are repeated to induce optimization of the amount of light in the current frame, as another technical point.

[0025] In addition, the light control unit is preferably formed of a liquid crystal polarizer or a light absorber. In addition, the light control unit may include a transparent electrode.

[0026] In addition, the liquid crystal polarizer may include a polarizing plate formed on a common transparent electrode, a black matrix formed on the border of each pixel, and a color filter optionally included on the optical path.

[0027] In addition, the light control unit may be formed and integrated to correspond to each pixel or each predetermined area of ​​the light detection unit. An electric shutter may be applied to the light detection unit.

[0028] In addition, the light control unit receives location, time, weather, exposure time, camera direction, input light pattern and Q max It is desirable to automatically adjust the amount of light in a pixel or area by considering one or more conditions.

[0029] Additionally, the image sensor increases the attenuation of the amount of light according to the light control unit when the photocurrent value measured in the current frame is greater than the photocurrent value measured in the previous frame.

[0030] Additionally, the image sensor adjusts the amount of light according to the light control unit of the corresponding pixel or corresponding area in the next frame when the photocurrent value in the previous frame is 50% to 100% of the saturation current value.

[0031] In addition, the image sensor compares a reference pixel and a surrounding pixel or a reference area and a surrounding area in a previous frame, and if the photocurrent value is 50 to 100% of the saturation current value, adjusts the amount of light according to the light control unit of the corresponding pixel or area in the next frame.

[0032] In addition, it is preferable that the image sensor adjusts the amount of light according to the light control unit based on accumulated data of one or more of location, time, weather, exposure time, camera direction, and input light pattern.

[0033] In addition, on the surface where the light control unit and the light detection unit are bonded, a bonding layer can be formed with a thickness quantized to correspond to an integer multiple of the minimum unit thickness in the growth direction by a CVD method.

[0034] Additionally, the image sensor can have a high dynamic range of 180 dB to 240 dB.

[0035] The present invention integrates a light control unit that is controlled by region or by minimum unit pixel, and can be controlled according to an input light pattern. Therefore, pixel control is possible by location by considering the relationship between the input light pattern, maximum capacitance, and exposure time. Accordingly, in areas where a lot of light is required for attenuation (such as direct sunlight), light attenuation is increased, and in areas where the amount of light is low, light attenuation is decreased, thereby realizing a high dynamic range.

[0036] In addition, by applying this to a video, a pixel capacitor that is saturated in a previous frame can greatly attenuate light in the next frame so that all pixels in the current frame are not saturated and remain within an appropriate expression range, thereby providing a high-quality video.

[0037] In this way, the present invention can obtain higher quality three-dimensional images or videos in various environments and conditions, and can be stably applied to a wide range of fields such as HDR image sensors, cameras, autonomous driving, 3D cameras, XR cameras, and aerial photography.

[0038] In addition, since the size of the light control unit of the present invention is almost the same as that of the image sensor, the capacitance is small and high-speed operation is possible, enabling high-speed imaging.

[0039] Figure 1 - A diagram illustrating a problem due to limitations in the dynamic range of an image sensor.

[0040] FIGS. 2 to 7 - Schematic diagrams of main parts of a light-controlled image sensor according to various embodiments of the present invention.

[0041] Figure 8 - Flowchart of a control method for a light-controlled image sensor according to an embodiment of the present invention.

[0042] FIGS. 9 to 12 - Examples of a control method for a light-controlled image sensor according to various embodiments of the present invention.

[0043] FIG. 13 - An exemplary diagram showing a light-controlled image according to a control method of a light-controlled image sensor according to an embodiment of the present invention.

[0044] The present invention relates to a light-controlled image sensor that forms a light control unit on an image sensor to control the amount of light per pixel or area to achieve a high dynamic range, a camera using the same, and a control method thereof.

[0045] Hereinafter, the present invention will be described in detail with reference to the attached drawings. FIGS. 2 to 7 are schematic diagrams of main parts of a light-controlled image sensor according to various embodiments of the present invention, FIG. 8 is a flowchart for a control method of a light-controlled image sensor according to an embodiment of the present invention, FIGS. 9 to 12 are exemplary diagrams for a control method of a light-controlled image sensor according to various embodiments of the present invention, and FIG. 13 is an exemplary diagram showing a light-controlled image according to a control method of a light-controlled image sensor according to an embodiment of the present invention.

[0046] As illustrated in FIG. 2, a light-controlled image sensor according to an embodiment of the present invention is characterized by including a light-control unit (200) formed on a path through which light is incident on the image sensor and selectively controls the amount of light for each pixel or region, a light detection unit (100) into which light passing through the light-control unit (200) is incident, and a control unit that selectively controls a light-control pixel or light-control region of the light-control unit (200) and controls the light detection unit (100).

[0047] In this way, the present invention aims to provide a light-controlled image sensor having a high dynamic range by forming a light control unit (200) in an image sensor and controlling the amount of light per pixel or area.

[0048] First, the light control unit (200) according to the present invention is formed on the path through which light is incident, and selectively controls the amount of light for each pixel or area.

[0049] The light control unit (200) according to one embodiment of the present invention uses a polarizer or a light absorber (light attenuator) that can reduce the amount of light, and these are formed by being integrated to correspond to a pixel or a predetermined area of ​​the light detection unit (100).

[0050] Here, as needed, the light control unit (200) must be integrated to correspond to a pixel or a predetermined area of ​​the light detection unit (100), so an align key, an align mark, or an align layer may be formed on one or both sides of the light control unit (200) or the light detection unit (100).

[0051] The above light control unit (200) may use a transmissive polarizer, an electrically driven polarizer, or a liquid crystal polarizer (220). The liquid crystal polarizer (220) is a passive matrix LCD, and may use a known TN, STN, DSTN, or FSTN LCD. The polarizer according to this embodiment is known to have a dynamic range of approximately 140 dB.

[0052] In the present invention, the meaning of 'by pixel' is that a light control unit (200) corresponding to each minimum unit pixel of the image sensor is formed, and the meaning of 'by area' may correspond to two or more pixels, or, if necessary, an area where an object with a similar amount of light according to an input light pattern is located. In addition, 'by area' may also refer to each corresponding area divided at predetermined equal intervals horizontally and vertically.

[0053] Accordingly, the light control unit (200) can be controlled according to the input light pattern by area or minimum unit pixel.

[0054] As an embodiment of the present invention, the description will focus on the formation of a light control unit (200) for each pixel, and the drawings of FIGS. 2 to 7 can be said to correspond to each pixel.

[0055] In addition, the light control unit (200) according to one embodiment of the present invention may include a transparent electrode (222). That is, the transparent electrode (222) is formed on the surface where light is incident to ensure good light transmission, and ITO can be preferably used as the transparent electrode (222).

[0056] Figure 3 illustrates that transparent electrodes (222) are formed on the upper and lower sides of the light control unit (200), respectively. If necessary, the upper side can be used as a common transparent electrode (222).

[0057] As an embodiment of the present invention, FIGS. 4 to 7 illustrate a case where a light control unit (200) is formed as a liquid crystal polarizer (220), in which a polarizing plate (224) is formed on a common transparent electrode (222), a black matrix (226) is formed on the border of each pixel, and a color filter (228) can be selectively formed on the optical path. This can be formed basically using an LCoS (Liquid Crystal on Silicon) structure and process technology.

[0058] FIG. 4 shows, from top to bottom, a polarizing plate (224) / common transparent electrode (222) / black matrix for light blocking (226) / liquid crystal / lower electrode (222-1) / light detection unit (100), FIG. 5 shows, from top to bottom, a black matrix for light blocking (226) / polarizing plate (224) / common transparent electrode (222) / liquid crystal / lower electrode (222-1) / light detection unit (100), FIG. 6 shows a case where a color filter (228) is formed on the optical path of the liquid crystal in FIG. 4, and FIG. 7 shows a case where a color filter (228) is formed on the optical path of the liquid crystal in FIG. 5.

[0059] By using a liquid crystal polarizer (220) as an example of a light control unit (200) for controlling the amount of light in this way, fine precision control is possible by an electric signal, and the semiconductor manufacturing process infrastructure can be utilized, making manufacturing easy and reducing manufacturing costs.

[0060] Meanwhile, the light control unit (200) according to the present invention receives location (reception by GPS, if not possible, determines indoors), time (day and night), weather (determines whether there is sunlight), exposure time, camera direction, input light pattern and Q max (maximum charge that can be stored in a capacitor) can be automatically adjusted to control the amount of light in the corresponding pixel or area by considering one or more conditions.

[0061] Additionally, the amount of light can be adjusted by the light control unit based on accumulated data of one or more of location, time, weather, exposure time, camera direction, and input light pattern. In particular, in the case of indoor environments such as offices, the accumulated data can be used to enable optimal light control by the light control unit.

[0062] And, the light detection unit (100) according to the present invention detects the amount of light that passes through the light control unit (200) and converts the light into an electrical signal. Generally, the light detection unit (100) includes a photodiode (photodetector (140)) and a transistor and electrode circuit or a read-out integrated circuit (ROIC) on a substrate (120) such as silicon, and detects light in the photodiode (photodetector (140), photodetector). Basically, the light detection unit (100) follows the structure and operating principle of an image sensor such as a CCD, CIS, or CMOS.

[0063] An electronic shutter may be applied to a light detection unit (100) according to one embodiment of the present invention. In a structure using an electronic shutter, light is blocked, thereby reducing power consumption (standby) due to photogenerated carriers and also reducing parasitic light sensitivity (PLS).

[0064] These electronic shutters operate on the principle that even when light is incident on a pixel, electrons and holes (carriers) are generated, the carriers diffuse and drift through a junction where a reverse voltage is applied, and are then discharged. However, since carriers are generated and current flows in proportion to the amount of light applied, power is consumed equal to the product of the current and the reverse voltage.

[0065] However, the present invention can prevent unnecessary power consumption because the light control unit (polarizer) (200) can remove light applied to the pixel even when no shooting is performed in this structure.

[0066] Additionally, in the case of PLS, carriers generated by the incident light are not 100% emitted, so when the electronic shutter is turned on, some of the stagnant carriers generated by the incident light are read into the frame together with the incident carriers.

[0067] However, in the present invention, the light control unit (polarizer) (200) acts as a shutter, so that the PLS problem is significantly reduced because the light is in a dark state without light.

[0068] Meanwhile, if necessary, the present invention can form an optical isolator made of a material with a different refractive index between pixels to minimize interference between pixels.

[0069] A control unit (not shown) according to an embodiment of the present invention selectively controls the light control pixels or light control areas of the light control unit (200) and controls the light detection unit (100). That is, it applies voltage to the light control unit (200), adjusts the magnitude of the voltage, or controls the light detection unit (100).

[0070] The control unit according to the present invention controls the light control unit (200) according to the input light pattern for each minimum unit pixel or region, and performs control of the light control unit (200) for each pixel or region by considering the relationship between the input light pattern, maximum capacitance, and exposure time. In this way, since the light control unit (200) can be controlled for each pixel or region, a high dynamic range can be implemented by increasing the light attenuation in areas where the amount of light that requires a lot of attenuation is large (such as direct sunlight) and decreasing the light attenuation in areas where the amount of light is low.

[0071] In general, the light detection unit (100) includes a photodiode (light detector (140)) and a transistor and electrode circuit or a read-out integrated circuit (ROIC) on a substrate (120) such as silicon, and the ROIC circuit can be included in the control unit, where it controls the light control unit (200) and the light detection unit (100).

[0072] In this way, the present invention provides a light-controlled image sensor that forms a light control unit (200) on the image sensor to control the amount of light per pixel or area to achieve a high dynamic range. In addition, a camera utilizing such a light-controlled image sensor is provided.

[0073] FIG. 8 illustrates a light control method using such a light control image sensor, comprising: a step of selectively controlling the amount of light by pixel or area by a light control unit (200); a step of detecting the amount of light by allowing light passing through the light control unit (200) to enter a light detection unit (100); a step of determining whether the amount of light has been attenuated by pixel or area in the previous frame based on the detected amount of light by a control unit and controlling the amount of light; and a step of detecting the amount of light are repeated to induce optimization of the amount of light in the current frame.

[0074] That is, it is a process of measuring, detecting, and feeding back the amount of light per pixel or area and attenuating the amount of light through a light control unit (200), thereby controlling a light control image sensor having a high dynamic range.

[0075] In a light control image sensor control method according to an embodiment of the present invention, when the photocurrent value measured in the current frame is greater than the photocurrent value measured in the previous frame, the attenuation of the amount of light according to the light control unit (200) is increased.

[0076] In addition, in a light control image sensor control method according to an embodiment of the present invention, if the photocurrent value in the previous frame is 50% to 100% of the saturation current value, the light amount according to the light control unit (200) of the corresponding pixel or corresponding area is controlled in the next frame.

[0077] In addition, in a light control image sensor control method according to an embodiment of the present invention, if a photocurrent value is 50 to 100% of a saturation current value by comparing a reference pixel and a surrounding pixel or a reference area and a surrounding area in a previous frame, the light amount of the corresponding pixel or area is controlled according to the light control unit (200) in the next frame.

[0078] Conversely, if the photocurrent value in the previous frame is within the range of the dark current value reference setting value, for example, 100% to 10000% of the dark current, the light amount of the corresponding pixel or corresponding area can be adjusted according to the light control unit (200) in the next frame.

[0079] Meanwhile, according to an embodiment of the present invention, a bonding layer is formed on the surface where the light control unit (200) and the light detection unit (100) are bonded, and the bonding layer may be formed with a quantized thickness corresponding to an integer multiple of the minimum unit thickness with respect to the growth direction. In addition, the bonding layer may be deposited by a CVD method for a total process time that is an integer multiple of the unit process time corresponding to the minimum unit thickness and the sum of the no-growth time. Through such a thickness control technology, a uniform thickness is induced and surface roughness is maintained so that the bonding of the light control unit (200) and the light detection unit (100) according to the present invention can be performed well. This can be referred to as "Nano-scale thin film structure and implementation method thereof" (Registration number: 10-2380306) applied for by the present inventor.

[0080] The above bonding layer may be formed of an oxide or a nitride, and specifically, SiO2, Si-LiNbO3, Si-LiTaO3, Si-InP, Si-GaAs, Si-Ge SiO2, Si-LiNbO3, Si-LiTaO3, Si-InP, Si-GaAs, Si-Ge, Si-AlN, Si-GaP, Si-InAs, Si-InSb, Si-AlSb, Si-Ba2NaNb5O5, Si-Pb2KNb5O 15 , Si-PZT, Si-CIGS, or one or more materials can be formed as multilayers.

[0081] FIGS. 9 to 12 are exemplary diagrams of a control method for a light-controlled image sensor according to various embodiments of the present invention.

[0082] Fig. 9 is a schematic diagram of an image sensor showing five pixels on a substrate as an example. In the case of an input light pattern in which the sun (direct sunlight) and a tree exist, the light control unit (200) selectively attenuates the amount of light in the corresponding region of the sun-related input light in the corresponding region where the sun-related input light is incident and the corresponding region where the tree-related input light is incident by controlling the polarizer. That is, when a polarizer or an absorber is used as the light control unit (200), an appropriate voltage is applied to each corresponding region to induce polarization, thereby attenuating the amount of light of the sun-related input light.

[0083] Fig. 10 is a schematic diagram of an image sensor showing five pixels on a substrate as an example. In the case of an input light pattern in which the sun, the earth, the moon, and stars exist, the light control unit (200) selectively attenuates the light quantity in the corresponding pixels of the input light related to the sun, the earth, the moon, and the stars in the order of the sun, the earth, the moon, and the stars by controlling the polarizer. That is, when a polarizer or absorber is used as the light control unit (200), an appropriate voltage is applied to each corresponding pixel to induce appropriate polarization, so that the light quantity of the related input light from the sun to the stars is sequentially attenuated. As a result, a high dynamic range of 180 dB or more is achieved, so that a high-quality image in which everything from the sun to the stars exists together can be provided.

[0084] Fig. 11 illustrates the case where a liquid crystal polarizer (220) is used as a light control unit (200) in the example of Fig. 10, and an appropriate voltage is applied to each pixel to induce appropriate polarization, thereby sequentially attenuating the amount of related input light from the sun to the stars. This achieves a high dynamic range of 180 dB or more, enabling the provision of high-quality images that exist from the sun to the stars.

[0085] Figure 12 shows the control method in the order of each frame in the case of an input light pattern in which the sun and a tree exist in the example of Figure 10. In Figure 12(a), for the first frame, the transmittance of the light control unit is 100% (d), and in Figure 12(b), the Q of the first frame max The transmittance of the reaching pixel is adjusted to 50%(a)*d, and in Fig. 12(c), Q of the second frame max Adjust the reaching pixel transmittance to 50%*50% (b), and at the same time, adjust the Qmin reaching pixel transmittance to twice the current transmittance (c) (e.g., 0.5->1). After that, 0.2~0.8 Q max Increase or decrease the transmittance (increase or decrease the amount of light) as a target, and repeat this 3 times for each pixel. Here, a, b < 1, 1 <c, 0.1<d<1 을 만족한다.

[0086] Here, the method for determining the initial transmittance (d) is determined by determining the location (reception by GPS, if not possible, indoors), time (day or night), weather (determining whether there is sunlight), and total light quantity.

[0087] In addition, when one light controller is formed per pixel, if the photocurrent value is 50 to 100% of the saturation current value by comparing the reference pixel and the surrounding pixels or the reference area and the surrounding area in the previous frame, the light amount of the corresponding pixel or the corresponding area can be controlled according to the light controller (200) in the next frame.

[0088] That is, the transmittance in the first frame is 100%, and the Q of the first frame max The transmittance of the reaching pixel is 10% (a), and the Q of the second frame max Adjust the pixel transparency back to 10% (b), and at the same time, adjust the Qmin pixel transparency to twice the current transparency (c) (e.g., 0.5->1). Here, a,b<1, 1 <c을 만족한다.

[0089] FIG. 13 is an exemplary diagram showing an image controlled by light according to a control method of a light-controlled image sensor according to an embodiment of the present invention.

[0090] Figure 13(a) shows the previous frame when the light attenuation rate per pixel is 0, and saturated pixels exist. Figure 13(b) shows the current frame when the corresponding light attenuation rate per pixel is applied. That is, it can be confirmed that the saturated pixels in the previous frame have large light attenuation, and that in the current frame (after light attenuation rate compensation), all pixels are not saturated and are within an appropriate expression range, and the frame with the light attenuation rate applied in this way provides a high-quality image.

[0091] The present invention integrates polarizers that are controlled by group (region) or by minimum unit pixel, and can be controlled according to an input light pattern, thereby enabling pixel control by location by considering the relationship between the input light pattern, maximum capacitance, and exposure time. Accordingly, areas requiring a lot of attenuation (such as direct sunlight) have high light attenuation, and areas with low light attenuation have low light attenuation, thereby implementing a high dynamic range.

[0092] Additionally, by applying this to video, pixel capacitors that are saturated in the previous frame will have greater light attenuation in the next frame, ensuring that all pixels in the current frame are not saturated and remain within the appropriate expression range.

[0093] At this time, the size can be controlled by various control algorithms, such as attenuating the direct sunlight part by about half of the dynamic range of the image sensor (~50dB) and attenuating other parts by about 10dB, depending on the surrounding environment sensor values, such as time (day / night), outdoor (GPS reception and average illuminance, etc.), and gyro sensor (north / south direction).

[0094] Also, Q of the previous frame max Record the time-to-saturation and apply appropriate light attenuation per pixel in the next frame, t int (integration time) within Q maxYou can make it within the range, and from the second frame in the video, Q max It can remove pixels that exceed the dynamic range (shoot video without pixels exceeding the dynamic range).

[0095] In addition, since the size of the light control unit of the present invention is almost the same as that of the image sensor, the capacitance is small and high-speed operation is possible, enabling high-speed imaging.

Claims

1. In the image sensor, A light control unit formed on a path through which light is incident and selectively controls the amount of light by pixel or area; A light detection unit into which light passing through the above light control unit is incident; A light-controlled image sensor characterized by including a control unit that selectively controls a light-controlled pixel or light-controlled area of ​​the light-controlled unit and controls the light detection unit.

2. In paragraph 1, the light control unit, A light-controlled image sensor characterized by being formed with a liquid crystal polarizer or a light absorber.

3. In the second paragraph, the light control unit, A light-controlled image sensor characterized by including a transparent electrode.

4. In the third paragraph, the liquid crystal polarizer, A polarizing plate is formed on a common transparent electrode, A black matrix is ​​formed around the border of each pixel, An optical control image sensor characterized in that the optical path optionally includes a color filter.

5. In paragraph 1, the light control unit, A light-controlled image sensor characterized in that each pixel or each predetermined area of ​​the above-mentioned light detection unit is formed in an integrated manner.

6. In the first paragraph, the light detection unit comprises: A light-controlled image sensor characterized by an electric shutter.

7. In paragraph 1, the light control unit, Location reception, time, weather, exposure time, camera orientation, input light pattern and Q max A light control image sensor characterized in that it automatically adjusts the amount of light in a corresponding pixel or corresponding area by considering one or more conditions.

8. In the first paragraph, the image sensor, A light-controlled image sensor characterized in that the attenuation of the amount of light according to the light control unit is increased when the photocurrent value measured in the current frame is greater than the photocurrent value measured in the previous frame.

9. In the first paragraph, the image sensor, A light control image sensor characterized in that the amount of light according to the light control unit of the corresponding pixel or corresponding area is controlled in the next frame when the photocurrent value in the previous frame is 50 to 100% of the saturation current value.

10. In the first paragraph, the image sensor, A light control image sensor characterized in that, in a previous frame, a reference pixel and a surrounding pixel or a reference area and a surrounding area are compared, and if the photocurrent value is 50 to 100% of the saturation current value, the light amount of the corresponding pixel or area is controlled according to the light control unit in the next frame.

11. In the first paragraph, the surface on which the light control unit and the light detection unit are bonded is A light-controlled image sensor characterized in that a bonding layer is formed with a quantized thickness corresponding to an integer multiple of the minimum unit thickness in the growth direction by a CVD method.

12. In the first paragraph, the image sensor, A light control image sensor characterized in that it controls the amount of light according to the light control unit based on accumulated data of one or more of location, time, weather, exposure time, camera direction, and input light pattern.

13. A camera characterized by using an image sensor according to any one of claims 1 to 12.

14. A step of selectively controlling the amount of light by pixel or area by a light control unit; A step of detecting the amount of light by causing the light passing through the above light control unit to be incident on the light detection unit; A control method for a light-controlled image sensor, characterized in that the control unit determines whether the amount of light is attenuated for each pixel or area in the previous frame based on the amount of light detected and adjusts the amount of light, and the step of detecting the amount of light is repeated to induce optimization of the amount of light in the current frame.

15. In the 14th paragraph, the initial light quantity is controlled in the first step, Location reception, time, weather, exposure time, camera orientation, input light pattern and Q max A control method for a light-controlled image sensor, characterized in that the control is determined by taking into consideration one or more of the following conditions.

16. In the 14th paragraph, the image sensor, A control method for a light-controlled image sensor, characterized in that the attenuation of the amount of light according to the light control unit is increased when the photocurrent value measured in the current frame is greater than the photocurrent value measured in the previous frame.

17. In the 14th paragraph, the image sensor, A control method for a light-controlled image sensor, characterized in that the amount of light according to the light-controlled unit of a corresponding pixel or corresponding area is controlled in the next frame when the photocurrent value in the previous frame is 50 to 100% of the saturation current value.

18. In the 14th paragraph, the image sensor, A control method for a light-controlled image sensor, characterized in that the light amount of the corresponding pixel or corresponding area is controlled according to the light control unit in the next frame when the saturation current value is 50 to 100% by comparing a reference pixel with a surrounding pixel or a reference area with a surrounding area.

19. In the 14th paragraph, the image sensor, A control method for a light-controlled image sensor, characterized in that the amount of light according to the light control unit is controlled based on accumulated data of at least one of location, time, weather, exposure time, camera direction, and input light pattern.

20. A camera controlled by the control method of an image sensor according to any one of claims 14 to 19.

Citation Information

Patent Citations

  • Liquid crystal luminous quantity adjuster and camera module using the same and camera using liquid crystal luminous quantity adjuster

    KR100708938B1

  • Device and method for controlling quantity of incident light

    KR101097145B1

  • Camera type active filter device, and active filtering method thereof

    KR101639685B1

  • Liquid crystal device

    KR1020090013711A

  • Mucoadhesive-PLGA nanoparticles

    KR102638773B1