Optoelectronic sensor and focusing method
By determining focusing time based on focal length and temperature changes, the sensor addresses thermal and inertia issues in adaptive lenses, enabling faster and more precise focus adjustments in optoelectronic sensors.
Patent Information
- Application Number
- DE102018132015
- Authority / Receiving Office
- DE · DE
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2018-12-13
- Publication Date
- 2024-11-14
- Estimated Expiration
- 2038-12-13
AI Technical Summary
Existing optoelectronic sensors with adaptive lenses face challenges in compensating for thermal influences and inertia during focus adjustments, leading to slow and imprecise refocusing.
The sensor determines a focusing time based on the change in focal length and temperature, using a control and evaluation unit to ensure the adaptive lens reaches the desired focus position before activating further sensor functions, thereby reducing the influence of inertia and thermal effects.
This approach allows for faster and more precise focus adjustments by considering the variable response times of the adaptive lens, minimizing the impact of thermal fluctuations and ensuring accurate detection.
Smart Images

Figure 00000000_0000_ABST
Abstract
Description
[0001] The invention relates to an optoelectronic sensor and a method for focusing the optics of an optoelectronic sensor according to the preamble of claims 1 and 12, respectively.
[0002] Almost every optical sensor incorporates a transmitting or receiving optic. This optic is often focused to a specific distance or distance range using a focus adjustment mechanism. This involves electromechanically or optomechanically adjusting the position of the lenses and thus the focal length of the transmitting or receiving optics, for example, using stepper motors or moving coils. Such solutions require a significant amount of installation space and also place high demands on the mechanical design for precise adjustment, ensuring that a given focus position is actually maintained.
[0003] An alternative is the use of optics in which not the back focal length, but directly the shape and thus the focal length of the lens itself is varied by means of a voltage control. Gel or liquid lenses are particularly used for this purpose. In a gel lens, a silicone-like liquid is mechanically deformed using piezoelectric or inductive actuators. Liquid lenses, for example, exploit the so-called electrowetting effect by arranging two immiscible liquids, preferably of similar density but with different refractive indices and electrical properties, one on top of the other in a chamber. When a control voltage is applied, the two liquids change their surface tension in different ways, so that the inner interface of the liquids changes its curvature depending on the voltage.
[0004] Liquid lenses have a much higher coefficient of thermal expansion than glass lenses, and therefore thermal influences are particularly significant. Various approaches are known to counteract or compensate for deviations between the desired and actual focus position caused by temperature drift.
[0005] In US Pat. No. 9,575,221 B2, the temperature of the liquid lens is measured and stabilized using a heating element and a control loop. However, this is relatively complex. It is conceivable to at least dispense with the heating element by adjusting the control voltages depending on the measured temperature of the liquid lens using a correction matrix.
[0006] DE 10 2017 119 517 A1 discloses an image processing system with a liquid lens whose temperature-induced drift effects are reduced. For this purpose, temperature control is provided using a heating element or a bias voltage applied to the liquid lens. To adjust the focus distance of the liquid lens, image sharpness is determined over a series of images at different focus distances of the liquid lens. The size of the adjustment step within the series of images can be varied depending on the temperature and various time periods.
[0007] EP 2 924 974 A1 uses a special adaptive lens that is also tiltable, thus varying the direction of the optical axis. An image feature is monitored, and a drift correction is determined by comparing its target and actual position. This is an indirect approach that uses more than just information from the adaptive lens. It requires the ability to tilt the adaptive lens and appropriately capture the image feature.
[0008] There's a second problem with compensating for thermal influences on the set focal length: the inertia of the adaptive lens. If the sensor detects something before the adaptive lens has reached the desired focus position, this also leads to interference, even if the desired focus position is ultimately achieved. Of course, it's always possible to wait a sufficiently long time with a sufficient safety buffer, but this makes the sensor very slow.
[0009] According to US 2011 / 0200314 A1, a camera therefore measures the temperature and waits for a temperature-specific time. While this is faster than allowing a constant time to elapse, it does not sufficiently account for the behavior of the adaptive lens and therefore does not fully exploit the potential for acceleration. WO 2006 / 051437 A1 also prevents image capture while the liquid lens is adjusting a new focal length.
[0010] It is therefore an object of the invention to improve the change of focus positions with an adaptive lens.
[0011] This object is achieved by an optoelectronic sensor and a method for focusing the optics of an optoelectronic sensor according to claims 1 and 12, respectively. The sensor uses optics with an adaptive lens as the transmitting optics of a light transmitter and / or as the receiving optics of a light receiver. The focal length of the adaptive lens is changed by applying a control signal. A control and evaluation unit then sets the desired focus position. It also determines a focusing time, which is how long it takes until the refocusing is completed, i.e., until the adaptive lens has adjusted to the new focal length. After the focusing time, the sensor is fully operational again with the new focus position.
[0012] The invention is based on the basic idea that refocusing takes different lengths of time. Therefore, the focusing time depends on how big the change in focal length is. In other words, the focusing time is a function of the difference between the new and previous focal length. Therefore, a focusing time is determined which is preferably not a constant. If so, then focusing times were determined for the conceivable changes in focal length and estimated as closely as possible in order to obtain this constant. The focusing time is not a measured value; the focal length is not checked for its determination, although this would be conceivable in addition. Rather, the determination of the focusing time is based on assumptions which were derived, for example, from a model or simulation or learned.
[0013] The invention has the advantage that variable response times of the adaptive lens can be taken into account. While this does not eliminate inertia, its influence is reduced to the necessary minimum. Detection with the sensor becomes faster and, because it no longer requires working with a controlled but not yet achieved focus position, also more accurate. The inventive consideration of the focusing time is well-suited for the treatment of temperature effects, as explained below.
[0014] The control and evaluation unit is preferably designed to signal the expiration of the focusing time and / or to delay further sensor function until the focusing time has elapsed. For this purpose, the sensor function can be completely blocked until the focusing time has elapsed, i.e., only then can it be triggered again. Alternatively, the expiration of the focusing time is used as a delayed trigger point for the further sensor function. This ensures that the sensor does not perform its further function before the desired focus position is actually reached. However, the sensor function does not have to be blocked; the sensor then operates, for example, in a mode that assumes larger errors due to insufficient focusing.
[0015] The control signal is preferably a voltage signal. This adjusts the focal length of the adaptive lens by applying the voltage specified by the voltage signal, or in other words, by a voltage jump from the previously applied voltage to the new voltage specified by the voltage signal. The focusing time is thus a function of the voltage jump ΔV.
[0016] The control and evaluation unit is preferably designed to determine the focusing time as a function of the current focal length and the focal length to be set. This is based on the realization that the focusing time depends not only on the extent of the change in focal length, but also on which specific previous focal length is being adjusted to which new focal length. In fact, not two new parameters are introduced, but only one is added: the current focal length or the focal length to be set. By forming the difference with the extent of the change in focal length, which is already taken into account according to the invention, the second parameter, the focal length to be set, or the current focal length, is also determined. The focusing time is therefore now a function of the current and new focal length, or equivalently, of the current focal length and the extent of the change, or of the extent of the change and the new focal length.With a voltage signal as control signal, the focusing time becomes a function of the previous voltage V1 and the new voltage V2, or of V1 and ΔV:=V2-V1 or of ΔV and V2.
[0017] The sensor preferably has a temperature measurement unit for determining the temperature of the adaptive lens. This is used, for example, for temperature compensation of the control signals.
[0018] The control and evaluation unit is preferably designed to determine the focusing time as a function of temperature. The focusing time is thus determined even more precisely and acquires an additional temperature dependency. Accordingly, the focusing time is now a function of the extent of the change in focal length and temperature, or of the previous focal length, the new focal length, and the temperature. With a voltage signal as the control signal, the focusing time becomes a function of ΔV and T, or of V1, V2, and T.
[0019] The sensor preferably has a temperature-changing element. This can be a heater, a cooler, or both, particularly a Peltier element. Together with a temperature measuring unit, this can create a control loop for temperature stabilization, thus eliminating the temperature dependence of both the control signals and the focusing time. However, it may even be useful to simply heat the adaptive lens without control using a fixed or arbitrary, in any case non-regulated, heating power, as it then assumes a new focus position more quickly. The temperature is preferably measured in order to be able to determine and utilize the resulting shorter focusing time.
[0020] The sensor preferably has a memory with a lookup table (LUT) for focusing times. This memory is, for example, part of the control and evaluation unit, which in any case has access to it. During a refocus, the table is then read from the table, depending on the execution unit for the desired change in focal length, the previous and new focal length, and possibly the current temperature, the focusing time, and thus the minimum waiting time until the adaptive lens has actually assumed the desired shape for the new focus position. As an alternative to a lookup table, a function or algorithm can also be stored for the focusing time.
[0021] The dependence of the focusing time on possible changes in focal length is preferably determined in advance by making each change, evaluating the focus position using a quality measure during the change, and determining the associated focusing time as the time until a minimum quality measure is reached. In particular, the quality measure is a contrast measure and / or the minimum quality measure is a percentage of a maximum quality measure after a long waiting time. The possible refocusings are thus performed once or multiple times, possibly even at different temperatures. During the adjustment of the focal length, the intermediate focal length positions are evaluated, preferably based on the contrast.As soon as this evaluation sufficiently approaches an optimal state—preferably, the fully steady-state state after an infinite time can be used as a benchmark for practical purposes—the refocusing is considered complete, and the required time is stored as the associated focusing time. This determination of focusing times for later use during refocusing during operation can be performed once for all sensors of a particular design or individually for each sensor during its production. Another possibility is an automatic procedure implemented in the control and evaluation unit and executed at the operating site, for example, during setup or maintenance.
[0022] The adaptive lens is preferably a liquid or gel lens and, in particular, comprises two immiscible media whose mutual interface exhibits a curvature corresponding to the voltage when a voltage is applied. Such lenses offer the desired adjustment options for the focus position while being very compact and inexpensive. They react relatively strongly to temperature fluctuations and exhibit a rather complex delay behavior during refocusing, making the invention particularly advantageous for this purpose.
[0023] The sensor is preferably designed as a camera with an image sensor as a light receiver, whereby after refocusing by setting a new focal length of the adaptive lens, a picture is only taken after the focusing time has elapsed. The adaptive lens is either integrated into the camera lens or is the lens itself. The camera blocks the triggering of pictures during the focusing time or delays the triggering until after the focusing time has elapsed.
[0024] The method according to the invention can be further developed in a similar manner and thereby exhibits similar advantages. Such advantageous features are described by way of example, but not exhaustively, in the subclaims following the independent claims.
[0025] The invention will be explained in more detail below with regard to further features and advantages, using exemplary embodiments and with reference to the accompanying drawings. The figures of the drawing show: Fig. 1 a schematic sectional view of an optoelectronic sensor with an adaptive lens in the receiving optics; Fig. 2 a schematic sectional view of an optoelectronic sensor with an adaptive lens in the transmitting optics; Fig. 3 a schematic representation of an adaptive lens; Fig. 4 an exemplary representation of a voltage jump for controlling a refocusing; and Fig. 5 a representation of the focusing times of an adaptive lens to a specific focal length as a function of the previous focal length and the temperature.
[0026] Fig. 1 shows a schematic sectional view of an optoelectronic sensor 10 for detecting object information from a surveillance area 12. An image sensor 16, for example a CCD or CMOS chip, generates images of the surveillance area 12 via a receiving optics 14. The image data of these images are forwarded to a control and evaluation unit 18.
[0027] The receiving optics 14 has an adaptive lens whose focal length can be changed by electronic control of the control and evaluation unit 18. Fig. 1 shows an alternative focal length setting with dashed lines, and the functional principle of a conceivable design of the adaptive lens will be explained later with reference to the Fig. 3. The control and evaluation unit 18 is capable of determining the focusing time required by the adaptive lens to set the desired focal length after being controlled with a corresponding voltage. This allows further sensor function to be blocked or delayed until the transient phase of the focal length adjustment is completed. The determination of the focusing time will be explained later with reference to the Fig. 4 and Fig. 5 is explained in more detail.
[0028] A temperature unit 20 is arranged such that it is thermally connected to the adaptive lens. Depending on the embodiment, the temperature unit 20 comprises a temperature sensor for measuring the temperature of the adaptive lens and / or a heating or cooling element for influencing this temperature, for example, a Peltier element, which can be designed as a ring.
[0029] In some applications, such as in a cold storage facility, adaptive lenses designed as liquid lenses do not work reliably; they are then heated. Regardless of the application, this also shortens the response or focusing time until the adaptive lens has assumed a new focal length. An efficient heating element is sufficient for this. A Peltier element, on the other hand, is better suited for temperature control or stabilization, as it changes the temperature in both directions but only over a limited temperature difference.
[0030] Fig. 2 shows a further embodiment of the optoelectronic sensor 10. This embodiment differs from that shown in Fig. 1 by a light transmitter 22 with a transmitting optics 24. The adaptive lens is now part of the transmitting optics 24, and the receiving optics 14 has a fixed focus position. A temperature unit 20 as in Fig. 1 is also in the embodiment of the Fig. 2 for the adaptive lens of the transmitting optics 24. Furthermore, mixed forms of the embodiments according to Fig. 1 and Fig. 2 are conceivable, in which the receiving optics 14 and the transmitting optics 24 have an adaptive lens or a common optics with an adaptive lens is provided for the image sensor 16 and the light transmitter 22, wherein the adaptive lens can in turn have a temperature unit 20. In addition, in Fig. 1, a light transmitter 22 with a transmitting optics without an adaptive lens can also be added, for example to illuminate the monitoring area 12 or to generate a light signal whose light propagation time is determined for distance measurement.
[0031] The Fig. 1 and Fig. 2 are schematic diagrams that represent a variety of sensors. The sensor 10 according to Fig. 1 is, for example, a camera with variable focus, which is suitable, among other things, for a wide variety of applications for the inspection and measurement of objects, preferably in a stationary installation on a conveyor system that moves the objects through the monitoring area 12. The use of known signal or image processing for reading codes results in a barcode scanner or a camera-based code reader. The image sensor 16 can have a line or matrix arrangement of pixels. In further embodiments, another light receiver is used instead of the image sensor 16, for example a photodiode or an APD (avalanche photodiode). The latter is used, for example, in a distance-measuring light scanner or a laser scanner.
[0032] The light transmitter 22 can also perform a variety of functions. For example, the transmitting optics 24 can be used to set a specific illuminated monitoring area 12, project a sharp contrast pattern, a sharp target pattern to identify a recording or reading area, or a sharp light spot at a specific distance. This makes sensors 10 as diverse as a camera-based code reader, a code scanner, or a 3D camera conceivable.
[0033] Fig. Figure 3 shows the adaptive lens of the receiving optics 14 or the transmitting optics 24 in an exemplary embodiment as a liquid lens 26 based on the electrowetting effect. The functionality is explained using this liquid lens 26, but the invention also encompasses other adaptive lenses, for example, those with a liquid chamber and a membrane covering it, the curvature of which is changed by pressure on the liquid, or lenses with a gel-like optically transmissive material that is mechanically deformed by an actuator.
[0034] The actively tunable liquid lens 26 comprises two transparent, immiscible liquids 28, 30 with different refractive indices and the same density. The shape of the liquid boundary layer 32 between the two liquids 28, 30 is used for the optical function. The actuation is based on the principle of electrowetting, which shows a dependence of the surface or interfacial tension on the applied electric field. Therefore, it is possible to change the shape of the boundary layer 32 and thus the optical properties of the liquid lens 26 by electrically actuating a terminal 34, whereby corresponding voltages are applied to an electrode 36. In addition to adjusting the focal length, tilting is also conceivable, for which at least one additional electrode is provided on the liquid lens 26.
[0035] Based on the Fig. 4 and Fig. Figure 5 now describes the determination of the focusing time by the control and evaluation unit 18, i.e., the response time of the liquid lens 26 until it has actually assumed the shape for this focal length after being controlled with a voltage for a desired new focus position. The focusing time is considered here as a function F(V1, V2, T) of the temperature T of the liquid lens 26, the previously applied voltage V1, and the newly applied voltage V2.
[0036] The function F can be stored as such or as a lookup table in a memory of the sensor 10. The control and evaluation unit 18 knows the voltages V1 and V2, as it is responsible for adjusting the liquid lens 26, and determines the temperature via the temperature unit. This allows the corresponding focusing time to be read from the lookup table.
[0037] To obtain the function F(V1, V2, T) in advance, the focusing time F is measured for a large number of tuples (V1, V2, T). Intermediate values can be modeled or interpolated. During operation, it is useful to correct the voltage V2 with a temperature-dependent compensation function. However, for the sake of simplicity, this will not be done in the following.
[0038] Fig. Figure 4 illustrates the measurement of a single focusing time. Initially, the liquid lens 26 has assumed a focal length corresponding to the voltage V1. The liquid lens 26 is now driven with a voltage jump ΔV to V2 and then, after the focusing time, reaches the new focal length at V2. To evaluate when the new focal length is reached, images of a high-contrast object are taken at short time intervals of, for example, 100 µs at a distance corresponding to the new focal length at V2, and the contrast of these images is determined.
[0039] The contrast gradient across the images and thus the time is the one in Fig. 4. The contrast is initially not high, as the liquid lens 26 has not yet reacted quickly enough due to its inertia. The contrast then increases and reaches a maximum after a sufficiently long time. A portion of this maximum, for example, 90%, is marked with a dashed line, and the time required until then is used as the focusing time for this voltage jump. Such measurements are now performed for a large number of tuples (V1, V2, T), whereby multiple measurements with averaging for the same tuple are also possible.
[0040] Fig. Figure 5 shows the result of such measurements for a fixed value of V2, where the numerical value for V2 is 34 V purely as an example. The X-axis shows the varied voltage V1, and the Y-axis shows the varied temperature. The scale is not ordered here, but corresponds to the series of measurements of the temperatures actually set for the measurement. The corresponding Fig. 4 The measured focusing time is color-coded or gray-scale coded. In other words, Fig. 5 a section through the function F(V1, V2, T) for a fixed V2=34 V. The entire function F(V1 V2, T) would have an additional dimension with varying V2 and could not be represented in this way, but can certainly be determined and stored in the memory of the sensor 10.
[0041] The focusing time decreases according to Fig. 5 with temperature. At 6°C, it is still at a maximum of 60 ms, but at 65°C, it is only 20 ms. As V1 and V2 approach each other, the focusing time becomes very short at <5 ms. The voltage V1, at which the response time is minimized, is close to the focusing voltage V2, but exhibits slight temperature dependence. The latter could be an artifact of the partially indirect determination of the voltages and temperatures when obtaining the data for Fig. 5.
[0042] The function F(V1, V2, T) obtained in this way can now be used for a passive system without temperature regulation. After the focusing time has elapsed, it is guaranteed that the inertia of the liquid lens 26 has been overcome and the desired focus position has been set. F(V1, V2, T) ensures that there is no unnecessarily long wait; rather, the sensor 10 is available again as quickly as possible after each individual refocusing. In a somewhat simpler embodiment, a function F(ΔV, T) with ΔV:=V2-V1 is used, in which the focusing time depends only on the extent of the change and not on the specific start or end point. The function F(ΔV, T) can of course also be obtained by simplification from F(V1, V2, T).
[0043] Will be like Fig.If the temperature is additionally controlled or stabilized as described in section 1, the temperature dependence of the focusing time can be eliminated. Since thermal effects no longer occur, the function for the focusing time simplifies from F(V1, V2, T) to F(V1, V2) or from F(ΔV, T) to F(ΔV).
Claims
[1] Optoelectronic sensor (10) with a light transmitter (22) and / or a light receiver (16) and an optic (14, 24) arranged upstream of the light transmitter (22) and / or the light receiver (16), which has an adaptive lens (26) whose focal length is variable, and with a control and evaluation unit (18) which is designed to output a control signal to the adaptive lens (26) in order to set a focal length and to determine a focusing time, wherein the focusing time is a duration until refocusing is completed, ie the adaptive lens (26) has set the new focal length, characterized by that the control and evaluation unit (18) is further designed to determine the focusing time as a function of the change in focal length to be set. [2] Sensor (10) according to claim 1, wherein the control and evaluation unit (18) is designed to signal the expiration of the focusing time and / or to delay the further sensor function until the expiration of the focusing time. [3] Sensor (10) according to claim 1 or 2, wherein the control signal is a voltage signal. [4] Sensor (10) according to one of the preceding claims, wherein the control and evaluation unit (18) is designed to determine the focusing time as a function of the current focal length and the focal length to be set. [5] Sensor (10) according to one of the preceding claims, which has a temperature measuring unit (20) for determining the temperature of the adaptive lens (26). [6] Sensor (10) according to one of the preceding claims, wherein the control and evaluation unit (18) is designed to determine the focusing time as a function of the temperature. [7] Sensor (10) according to one of the preceding claims, which comprises a temperature change element (20). [8] Sensor (10) according to one of the preceding claims, which comprises a memory with a look-up table for focusing times. [9] Sensor (10) according to one of the preceding claims, wherein the dependence of the focusing time on possible changes in the focal length is determined in advance by carrying out a respective change, evaluating the focus position with a quality measure during the change and determining the associated focusing time as the duration until a minimum quality measure is reached, wherein in particular the quality measure is a contrast measure and / or the minimum quality measure is a percentage of a maximum quality measure after a long waiting time. [10] Sensor (10) according to one of the preceding claims, wherein the adaptive lens (26) is a liquid or gel lens and in particular comprises two immiscible media (28, 30) whose mutual interface (32) has a curvature corresponding to the voltage when a voltage is applied. [11] Sensor (10) according to one of the preceding claims, which is designed as a camera with an image sensor as a light receiver (16), wherein after refocusing by setting a new focal length of the adaptive lens (26) a recording is only triggered after the focusing time has elapsed. [12] Method for focusing the optics (14, 24) of an optoelectronic sensor (10), wherein the optics (14, 24) have an adaptive lens (26) whose focal length is changed by a control signal, in particular a voltage signal, wherein a focusing time is determined when adjusting the focal length, wherein the focusing time is a duration until refocusing is completed, ie the adaptive lens (26) has set the new focal length, characterized by that the focusing time is determined depending on the change in focal length to be set. [13] Method according to claim 12, wherein the focusing time is set as a function of the current focal length and the focal length to be set, in particular as a function of a voltage jump between the voltage signals for setting the current focal length and the focal length to be set. [14] Method according to claim 12 or 13, wherein the temperature of the adaptive lens (26) is measured and the focusing time is also determined as a function of the temperature. [15] Method according to one of claims 12 to 14, wherein the dependence of the focusing time on possible changes in the focal length is determined in advance by carrying out a respective change, evaluating the focus position with a quality measure during the change and determining the associated focusing time as the duration until a minimum quality measure is reached, wherein in particular the quality measure is a contrast measure and / or the minimum quality measure is a percentage of a maximum quality measure after a long waiting time.
Citation Information
Patent Citations
Liquid lens with temperature compensated focus time
US20110200314A1
Systems and methods reduce temperature induced drift effects on a liquid lens
US9575221B2
systems and methods for reducing temperature-induced drift effects in a liquid lens
DE102017119517A1
Opto-electronic device and method for capturing sharp images
EP2924974A1
Electronic device having a liquid-based optical device and control method therefor
WO2006051437A1
