Devices in video cameras used to assess ambient light.
By using a variable aperture imaging lens system and light sensor in a video camera, placed in or near the aperture plane of the beam path, the inaccurate light amount evaluation problem of video cameras when switching between day and night modes is solved, reducing image flickering and The equipment wears, improving the user experience and equipment life.
Patent Information
- Application Number
- CN202210194136.5
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Priority Date
- 2021-03-12
- Filing Date
- 2022-03-01
- Publication Date
- 2024-11-22
- Estimated Expiration
- 2042-03-01
AI Technical Summary
When existing video cameras switch between day and night modes, it is easy to flash images due to inaccurate light measurement, and the existence of IR components affects the image color balance, making it difficult to switch between the two modes smoothly, resulting in wear of equipment and user Poor experience.
Using a variable aperture imaging lens system and light sensor, the light sensor is placed on or near the aperture plane of the beam path, and the light intensity is continuously detected by the light sensor to evaluate the amount of ambient light, reduce stray light and distortion, and ensure switching in night and day modes. The light quantity evaluation is accurate.
Effectively reduces image flicker, extends device life, improves user experience, and provides continuous light measurement capabilities when needed, especially when switching between night and day modes.
Smart Images

Figure CN115086513B_ABST
Abstract
Description
Technical Field
[0001] The invention relates to an arrangement in a video camera for evaluating a measurement of ambient light during operation of the video camera. The invention also relates to imaging optics comprising such an arrangement, and to a video camera comprising the arrangement. Background Art
[0002] The use of IR (infrared) filters for cameras (and especially for digital cameras) is well known in the art. In short, the image sensor of a camera has a spectral response with a non-negligible infrared component, which presents both opportunities and challenges. One opportunity is that in low light conditions, the IR component can provide useful additional information about the imaged scene, which can be further enhanced by an IR light source. During daytime imaging, when there is sufficient light to provide color imaging, the presence of the IR component can distort or destroy the color balance in the image.
[0003] One way to keep the beneficial effects while suppressing the less beneficial effects is to add a removable IR cut filter in the beam path in front of the image sensor during day mode operation, thereby removing the IR component. In this way, the IR filter can be used during daylight conditions, enabling the acquisition of color images. During day mode operation, the pixels of the image sensor will operate in a spectrally resolved manner, where the incident light is detected as charge on individual photodetectors. Each photodetector is provided with a filter so as to receive mainly red, mainly green or mainly blue radiation, thereby making color separation possible. This is a well-known technique, and a Bayer filter is an example of such a color filter array that can be used. During night mode operation, for example in low light conditions, the IR cut filter can be removed. This means that the incident light (or radiation) emitted from the IR part of the spectrum will increase, which can be used to improve image quality, but at the expense of rendering color imaging is difficult or impossible because each color channel has a response in the IR region. The addition of unknown factors in each color channel will distort the color information. Therefore, as an alternative to performing color separation in night mode operation, the only parameter maintained is the total intensity of the incident radiation for each pixel, which can be presented as a grayscale intensity image (or in any desired chromaticity). Adding an IR light source can enhance the image even further.
[0004] In a straightforward solution, an IR-cut filter is arranged in front of the sensor and an actuator is used to move the filter between a position in which the filter completely covers the sensor ("day mode") and a position in which the filter is completely removed without obstructing the image sensor ("night mode"). When starting from night mode and retracting the filter, with the IR-cut filter already inserted, the image sensor can infer whether the amount of ambient light is sufficient. If not, the camera switches back to night mode. When switching from night mode to day mode, it is common for the light level to be too low with an IR filter in the beam path and to need to switch back to night mode, resulting in flickering back and forth between night mode and day mode. This results in noticeable flickering of the image and causes considerable wear on the actuator. Switching back and forth is therefore not conducive to the user experience and therefore there may be an assessment before switching in which the imaging unit tries to infer the amount of visible light in the scene in order to determine that switching to day mode is desirable.
[0005] The present invention relates primarily to an apparatus enabling improved assessment of ambient light in a scene. The apparatus can be used in many situations but has particular advantages when operating in night mode and deciding whether a transition to day mode is desirable. Summary of the invention
[0006] In order to eliminate or alleviate the problems existing in the prior art, the present invention is directed to a device for determining the amount of light reaching an image sensor of a video camera. The video camera comprises an imaging lens system directing a light beam path towards the image sensor and having an aperture plane in which a variable aperture is arranged. A light sensor is also provided, and the device is characterized in that the light sensor is arranged to continuously detect the light intensity from a portion of the light beam path, wherein the portion is located in or near the aperture plane of the imaging lens system.
[0007] Having the detection part located in or near the aperture plane leads to some major advantages of the invention. However, the fact that the light sensor is arranged to detect light intensity will also lead to some advantages. The light sensor does not have to detect light intensity continuously, even if it is arranged to be able to perform continuous detection (measurement), and the advantages are related to the fact that it can detect at any time. In particular, it is possible to perform measurements while video is being acquired, which is a great advantage in situations where, for example, surveillance video needs to be recorded continuously. Further effects and advantages of the invention and its embodiments will be discussed in the detailed description.
[0008] In one or more embodiments, detection is configured to be performed on or near the optical axis of the lens system. There are several advantages to performing detection on or near the optical axis of the lens system. First, it will provide a symmetrical position for the measurement, and if the detection causes additional stray light or slight distortion, the risk of these being visible will be reduced. Second, there will always be light on or near the optical axis, unless the variable aperture is completely closed, in which case no light will reach the image sensor anyway. This enables detection to be performed using a statically arranged device (an example of which will be described below). Third, the farther the aperture plane is from the aperture plane (note, not the optical axis) the detection is being performed, the greater the correlation between the position and the position in the image plane. Assuming that the most relevant part of the imaged scene will be located near the center part of the image sensor (i.e., on or near the optical axis), the detected light will be related to the most relevant part of the imaged scene.
[0009] In one or more embodiments, detection is configured to be performed at or near the edge of the variable aperture. Having detection performed at or near the edge of the variable aperture also has some advantages. In fact, the third advantage of the previous embodiment can be restated, but with the conclusion that if the detection affects the image acquired by the image sensor, it will at least not affect the most relevant parts of the imaged scene. Another advantage is that the detection will need to have some overhang, and if the detection is performed at or near the edge of the variable aperture, the effect of the overhang will be minimized.
[0010] In one or several embodiments, the light sensor is configured to perform detection directly by being positioned in the light beam path. This has the advantage of providing a direct measurement of light with maximum collection efficiency. In other embodiments, detection is performed by a light deflector located in a portion of the light beam path. The deflector is obviously configured to direct light from said portion towards the light sensor, which is positioned outside the light beam path. One advantage of using a deflector is that it can be smaller in size than the light sensor and no wiring will be required. In this way, it can be easily arranged as a fixed or movable component. Several examples of this will be given in the detailed description.
[0011] For the purpose of increasing the collection efficiency or improving the collection of light coming from different directions, in one or several embodiments, the deflector may have a concave shape and be tilted relative to the optical axis of the lens system to direct the light coming from the detected part towards the light sensor. In such an embodiment, the light sensor may preferably be positioned outside the beam path for obvious reasons.
[0012] In other embodiments with similar purpose, the deflector may have a flat surface that is inclined relative to the optical axis of the lens system in order to direct light from the detected part towards the light sensor, which is again positioned outside the beam path.
[0013] In one or any embodiments, the light sensor or deflector may be suspended on a transparent substrate. The transparent substrate may be arranged in the beam path without introducing any distortion of the collected image and without affecting the intensity to any significant extent. In embodiments where measurements are performed in night mode, a dummy filter (to be explained in the detailed description) may double as the transparent substrate.
[0014] The deflector may be formed in the transparent substrate, for example by providing an inclined surface, a prismatic shape or a metallized surface in the substrate, rather than being arranged on the transparent substrate. In one such embodiment, the deflector is formed as a recess in the transparent substrate, and in a variation of this embodiment, the deflector is configured to direct a portion of the beam path into the transparent substrate, and the transparent substrate directs the deflected portion toward the light sensor. The multi-purpose use of the transparent substrate (as a deflector, suspension and light guide) may be an effective way to implement the present invention.
[0015] The deflector may have a reflectivity of 90% or more (e.g., 95% or more or 99% or more), wherein the deflector substantially blocks any light directed at it from reaching the image sensor. In embodiments where the deflector is made of metal or has a metallized surface, the reflectivity will be close to 100%. In other embodiments, the deflector may have a reflectivity of less than 90%, although having a deflector that transmits light is not currently a preferred embodiment as there is not much benefit from such a solution.
[0016] According to another aspect, the invention relates to a lens system provided with a device as described above. According to a further aspect, the invention relates to a video camera having a device according to any version described above. BRIEF DESCRIPTION OF THE DRAWINGS
[0017] Figure 1 is a schematic diagram of the camera setup.
[0018] Figure 2 is a schematic diagram illustrating the spectral response of a standard sensor chip.
[0019] Figure 3 is a schematic cross-sectional view of a lens system having a device.
[0020] Figures 4 to 7 is the shear map of the region surrounding the aperture plane.
[0021] Figure 8 This is a cutout diagram of another embodiment of the present invention. DETAILED DESCRIPTION
[0022] Figure 1A camera arrangement according to various embodiments of the invention is illustrated, provided with an apparatus according to one embodiment of the invention. The surveillance camera 10 has an image sensor 12 and an imaging optics 14. At least one spectral filter (IR cut-off filter 16) may be arranged in front of the image sensor 12 and may be switched between a position in which the image sensor is covered by the filter and a position in which the image sensor is not covered by the filter. The phrase "the image sensor is covered by the filter" should be interpreted as the filter being arranged so that it affects all radiation reaching the image sensor. The filter may be arranged directly in front of the image sensor, so that the filter more or less really covers the image sensor, but the filter may also (alternatively) be arranged in other positions in front of the imaging optics 14 (such as arranged within the imaging optics), etc. From a practical point of view, the IR cut-off filter is arranged where there is enough space for the filter and the control mechanism and where it is reasonably well protected from physical interference. In any case, in this way, the spectral region of the light (or radiation in the case of any UV or IR being transmitted) reaching the image sensor 12 can be controlled. Figure 1 Also shown is a dummy filter 18 which replaces the IR cut filter 16 when the IR cut filter 16 is removed.
[0023] Brief reference Figure 2 When an IR cut filter is arranged in front of the image sensor 12 during day mode operation, the entire IR part of the spectrum is removed, which means that the signals measured by the red, green and blue channels respectively can be resolved and converted into a color image. By using a color filter array arranged in front of the image sensor or even combined with the image sensor, the incident light is separated into different color channels. A Bayer filter is a color filter array commonly used for this purpose. Significantly, also as Figure 2 As shown in , each color channel has a spectral response in the NIR spectral region, which means that each color filter in the color filter array (Bayer filter) will have transmission in the IR region, and since the IR cut filter is removed from the image sensor in night mode operation, this part of the spectrum will also be incident on the image sensor. This will significantly increase the amount of collected radiation, at the expense of losing the possibility of reproducing a true color representation of the scene, which is why it is common practice to use a grayscale representation in night mode imaging. In such night mode operation, the image quality can be further improved by arranging an IR illumination source (which provides "invisible" illumination that has the desired effect while being invisible or non-interfering to the human eye). Since the IR cut filter 16 is removed when transferring to night mode imaging, it is common to replace the IR cut filter 16 with a dummy filter 18. The purpose of the dummy filter 18 is to simulate the refraction caused by the IR cut filter so that the same image focus is maintained for day mode and night mode imaging.
[0024] return Figure 1 In accordance with a first embodiment of the present invention, in the beam path toward the image sensor 12, there is a light sensor 20 arranged in or near the aperture plane. The light sensor 20 detects only a small portion of the beam path. In the aperture plane, light rays for every portion of the beam path toward the image sensor 12 are present in every portion of the cross section. This has two beneficial results. 1) Even though the insertion of the light sensor blocks part of the beam path, this will only result in a small reduction in the total intensity reaching the image sensor and will not result in any local shadowing effects on the image sensor. 2) The result is independent of the area of the beam path being detected, but will be proportional to the total intensity reaching the image sensor 12. The light sensor 20 can be configured to measure in different wavelength regions, or by selecting a light sensor 20 with a specific spectral response. For the purposes of the present invention, for several embodiments in which light in the visible spectral region is of particular interest, it is preferred that the light sensor 20 is configured to have a spectral response only in the visible region. There is an additional benefit to having the filter close to the plane of the aperture (sometimes called the aperture plane or aperture stop) because in the normal configuration, the aperture plane represents a location that has no spatial correlation with the plane of the image sensor 12. Sometimes this is called an aperture stop, where the aperture stop limits the amount of light from each point of the object that reaches the conjugate image point (the sensor in our case). The aperture stop therefore defines a plane in the beam path and sometimes the term "aperture plane" is used for the same feature. This plane is characterized, at least ideally, by being a position where a change in the size of the aperture opening will affect the entire image plane equally. For some applications, this may be a suitable location for the invented device. Smaller detection elements can have smaller dimensions, since all light passes through a very small aperture. However, the available space is often very limited. For some lens systems, the movable lens part would in an extreme case almost touch the fixed lens part. For such lens systems, the device may have to be located elsewhere.
[0025] The aperture plane (sometimes called the plane of the aperture or aperture stop) represents a position that has no spatial correlation with the plane of the image sensor. This is sometimes referred to as the aperture stop, where the aperture stop limits the amount of light from each point of the object that reaches the conjugate image point (the sensor in our case). The aperture stop thus defines a plane in the beam path, and hence the term "aperture plane" is used for the same feature. This plane is characterized, at least ideally, by being a position where a change in the size of the aperture aperture will affect the entire image plane equally. Hence, this may be a suitable position for the invented device. In more than one position, it is emphasized that the light sensor (or a light guide that directs or conducts light to the light sensor) is arranged in or near the aperture plane. "Near" may be considered to introduce a certain degree of ambiguity, so it will be defined a little further away. The ideal properties of the aperture plane (that in every point of the aperture plane there is light towards every point of the image plane) are the properties that are used in the present invention. However, these properties may also be good enough in intervals around the aperture plane (i.e. closer to the image plane or closer to the object plane). For the applicant's particular optics, this would correspond to a spacing extending 2mm-3mm on either side of the aperture plane (for an optical length of about 50mm). Now, "2mm-3mm" is very nice because it is easy to verify, and therefore increases sharpness. However, it is a measure that will vary with the properties of the lens system used (such as f-number and focal length). It is always preferred to locate the invented device in the aperture plane, but the definition of nearby becomes relevant in applications where the aperture plane is already occupied by other components (usually a variable aperture or other variable aperture). Another approach would be to consider that the closer the light sensor is moved towards the image sensor, the sharper the shadow it casts. Being in (or near) the aperture plane, even if it only occupies a small part of the aperture plane, affects the uniformity of the light reaching the image plane on the image plane. This can be used to indirectly define what "nearby" is, for example, the light sensor should be close enough to the aperture plane (in front or behind) so as not to produce more than 10% non-uniformity in the image plane. In some embodiments, the threshold can be set to a lower value (such as 5%), or even lower (such as 1%). This metric can be verified in measurements (as much as 2mm-3mm), but it has the added benefit of being independent of the properties of the lens system used.
[0026] With this and other arrangements of embodiments of the invention, the light evaluated will follow any changes in the imaging optics (such as changes in zoom) because it will result in measuring all light heading towards the sensor. In addition to this, it will not include light that is not heading towards the sensor, which is good because such light will not (and should not) affect the exposure setting and the assessment of whether switching from night mode to day mode is desirable. Readers in the art will appreciate that some embodiments of the present apparatus are more suitable for mode switching because the amount of light collected is relatively low. When it comes to controlling exposure, there are more suitable solutions, such as using the image sensor itself.
[0027] If necessary, the integration time (i.e., measurement time or exposure time) of the light sensor can be very long, from a fraction of a second to seconds, seconds or even minutes, depending on the situation. Therefore, it would be advantageous to use a light sensor that can achieve such a long integration time when necessary. For obvious reasons, light sensors with low internal noise are preferred in situations where the amount of light is low (and longer integration times are preferred).
[0028] Figure 3 A more detailed view of the arrangement of the device according to the first embodiment in a lens system 14 having two lens units 14F and 14B is illustrated. In the figure, the aperture (e.g., variable aperture) and the image sensor 12 are illustrated for reference. Dashed rectangles have been added to help explain the following figures. The light sensor 20 is shown as being located on the optical axis, in the middle of the beam path. Notably, two features are not shown. The light sensor 20 must be suspended in something, and a straightforward solution is a thin glass plate, such as an optical flat plate of sufficient quality. In addition, the light sensor will be connected by wiring, and this wiring should preferably be as thin as possible. It can be beneficial for such wiring to follow a curve rather than a straight line when passing through the beam path to eliminate a potential cause of discernible diffraction patterns in the image plane (on the image sensor).
[0029] Figure 4 yes Figure 3 A further close-up of .
[0030] Figure 5 An embodiment is illustrated in which the light sensor 20 is arranged closer to the edge of the aperture opening.
[0031] Figure 6 An embodiment is shown in which the optical sensor 20 is composed of a further guiding device 34 for guiding a small part of the detected light beam (detected light) towards the measuring entity (i.e. the optical sensor 20). Figure 6In the embodiment of the present invention, the guide 34 is a reflective concave surface which serves the dual purpose of directing the detection light towards the light sensor and focusing it on the light sensor. The reflectivity of the guide 34 can be any value of 100% or less, but once it is significantly lower, it must be optically negligible, that is, it should not cause any net refraction of light that affects the light reaching the image sensor 12. This can be done by a corrective lens or by shaping the rear surface of the guide.
[0032] exist Figure 7 In the embodiment of the invention, the guiding device 34 consists of a flat surface arranged to reflect a portion of the light beam towards the light sensor, and due to the use of a flat surface, a collecting optic in the form of a focusing lens 32 is also added to the light sensor 20. The necessity and properties of such a collecting optic may depend on the size of the light sensor or the guiding device and the distance between the two.
[0033] In either embodiment, the guide 34 is designed to ensure that light emitted from every part of the scene is represented in the light reaching the light sensor, and a prominent feature of the aperture plane is that light emitted from every part of the scene is presented in every point of the plane. Therefore, no matter where the guide 34 is arranged (in or near the aperture plane), it will be able to obtain light of the desired characteristics, which means that the selected part is easy to complete. However, it must be noted that due to its shape or other properties, the guide is not conducive to light from a specific direction, because that will bias the measurement. Instead of the exemplary design of the guide, it can have the shape of a curved convex surface, and it can be essentially formed by a metallized sphere. This shape will not guide all the light falling on it towards the light sensor, and will lead to an increase in the amount of scattered light in the lens system, but it emphasizes that the invention is more about the location of the sensor (or guide) in the aperture plane rather than its design. Regardless of the shape, it will be recommended to ensure that the surfaces that are not involved in guiding the light towards the light sensor 20 are either provided with non-reflective properties or minimized to minimize the generation of any unwanted reflections or stray light that affects the image acquired by the image sensor 12.
[0034] The reflective surface can be located anywhere in the beam path and is not limited to being on the optical axis.
[0035] Figure 6 or Figure 7The reflective surface can be attached to a glass plate, as illustrated in the previous embodiment of the light sensor 20, but it can also be shaped as a protrusion or a recess of the actual glass plate or a combination thereof. The reflective element can also be formed inside the glass plate. In any embodiment, the glass plate can be replaced by a plate made of another transparent material (such as fused quartz, polycarbonate, etc.). If the reflective surface is formed by a metallized sphere or the like, it can also be arranged on such a glass plate or a thin rod. The glass plate can be a separate component, but can also be provided by the dummy filter 18 mentioned above.
[0036] Such an embodiment is illustrated in Figure 8 In this embodiment, the glass plate can help direct light from a portion of the beam path to the light sensor 20, and the lens 32 may not even be needed. If desired, it can be provided by a shape formed in the glass plate, rather than as a separate element.
[0037] return Figure 1 The video camera has a housing 10. Figure 1 , the housing is rectangular, but it should be noted that the camera housing may take many different forms, and for the purposes of the present invention any known form may be used (unknown forms are not excluded unless they fail to implement the present invention). Furthermore, the functions performed by the camera may be implemented in different units so that images are collected in one physical location and transmitted via wiring (or wirelessly) to another unit for processing. This approach is not uncommon in applications where it is a benefit to keep the image collection portion of the camera as small as possible. An image processor or video processor 22 (or a combination thereof) is arranged to process the image data collected by the image sensor 12 and feed it forward to an encoder 28. A central processing unit 24 is arranged to control the process and to Figure 1 In the figure, the central processing unit 24 represents all the control units of the camera, although in a practical installation the processing control may be distributed among different units. In most cases, the camera (or one of the units, see above) will also include a network interface 26 for communication beyond the limits of the camera. It will be appreciated that the above description is a very simplified description of a modern video camera and the interested reader is referred to the applicant's product range for more detailed knowledge.
Claims
1. A device for determining the amount of light reaching an image plane on an image sensor (12) of a video camera (10), the video camera (10) comprising an imaging lens system (14) directing a beam path towards the image sensor (12) and having an aperture plane in which a variable aperture (30) is arranged, wherein: The device comprises: a light sensor (20) arranged to continuously detect light intensity from a portion of the light beam path, The invention is characterized in that the light sensor (20) is located in the light beam path and the light sensor is located in or near the aperture plane of the imaging lens system (14) so as not to generate more than 10% inhomogeneity in the image plane.
2. The device according to claim 1, wherein: The light sensor (20) is located on or near the optical axis of the lens system.
3. The device according to claim 1, wherein: The light sensor (20) is located at or near the edge of the variable aperture.
4. A device according to any one of the preceding claims, wherein The light sensor is suspended on a transparent substrate.
5. A lens system comprising a device according to any one of the preceding claims.
6. A video camera comprising a device according to any one of the preceding claims 1 to 4.
