OPTICAL SENSOR

DE502019012420D1Active Publication Date: 2024-11-21LEUZE ELECTRONIC GMBH & CO KG
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
DE502019012420
Authority / Receiving Office
DE · DE
Patent Type
Patents
Current Assignee / Owner
Filing Date
2019-03-29
Publication Date
2024-11-21
Estimated Expiration
2039-03-29

AI Technical Summary

Technical Problem

Optical sensors face challenges in detecting fast-moving objects due to the long time required to read out signals from all receiving elements, leading to insufficient camera triggering and the need for additional sensors like light barriers, which are resource-intensive.

Method used

The optical sensor is designed with control means to selectively read out signals from specific sub-areas of the camera, allowing for quick evaluation and generation of control commands for operation adjustments, eliminating the need for external sensors by using the camera's internal components to detect and track objects with short response times.

Benefits of technology

This approach enables rapid detection of fast-moving objects and adjusts the sensor's operation dynamically, achieving reliable detection without external sensors, thus enhancing the sensor's functionality with minimal design effort.

✦ Generated by Eureka AI based on patent content.
Patent Text Reader
Need to check novelty before this filing date? Find Prior Art

Description

[0001] The invention relates to an optical sensor.

[0002] Such optical sensors comprise a camera with an array of receiving elements and an evaluation unit for evaluating received signals from the camera's receiving elements. Typically, the optical sensor also includes an illumination device. The camera is usually formed by a CMOS or CCD array, which has a matrix-like arrangement of receiving elements.

[0003] Such optical sensors can be used to perform various types of object detection. In particular, the optical sensors can be designed as code readers to detect codes, especially barcodes.

[0004] One problem with such optical sensors is the detection of fast-moving objects. If the objects quickly enter the detection range of the optical sensor's camera, the camera's internal triggering is not fast enough to detect the object. A particularly limiting factor here is the relatively long time required to read the received signals from all receiving elements from the camera.

[0005] A common approach to solving this problem is to use additional sensors, such as light barriers, in addition to the optical sensor, whose signals are used to trigger the camera. The disadvantage of this approach is that such additional sensors require considerable effort.

[0006] EP 1 927 867 A1 describes an optoelectronic sensor for detecting objects in a three-dimensional surveillance area, comprising at least one image sensor capable of capturing a pixel image of the surveillance area using a plurality of light-receiving elements, and at least one controller configured to detect an object from image data of the pixel image. A plurality of image sensors is provided, each having at least one pixel row with light-receiving elements. The image sensors are arranged spaced apart from one another so that each image sensor can capture a separate plane of the surveillance area.

[0007] DE 10 2013 100 521 A1 relates to a sensor device for a motor vehicle. The sensor device has a light source and a detection device, wherein the detection device is formed with an array of optical pixels. The light source and the detection device are coupled to a control and evaluation device, which controls the light source to emit light pulses and controls the detection device for detection. The control and evaluation device has several control schemes for different groups of pixels of the detection device, wherein a first control scheme (sleep mode) controls and evaluates a subset of pixels as the first pixel group, and a second control scheme (active mode) controls and evaluates a larger number of pixels as the second pixel group.Depending on the result of the evaluation according to the first control scheme, the control and evaluation device switches to the control according to the second control scheme.

[0008] US 2017 / 005 31 47 A1 concerns a code reader with an image sensor that can be used for multiple functions. The functionality of the image sensor is derived by defining areas of this image sensor for filtering there and for specific filtering for these areas.

[0009] The invention is based on the object of providing an optical sensor which has a high level of functionality with low design effort.

[0010] To achieve this object, the features of claim 1 are provided. Advantageous embodiments and expedient developments of the invention are described in the dependent claims.

[0011] The invention relates to an optical sensor with a camera having a number of receiving elements and with an evaluation unit which is designed to evaluate received signals from receiving elements of the camera. Control means are provided by means of which at least a partial area of ​​the receiving elements can be selected. The camera is designed such that only the received signals of the receiving elements of the selected partial area are read out and then fed to the evaluation unit. In the evaluation unit, a control command for adjusting the operation of the optical sensor can be generated depending on the received signals of the receiving elements of the selected partial area. By evaluating the received signals of the receiving elements of the selected partial area, a stationary or a moving target object can be detected.The optical sensor is designed to detect multiple target objects in the form of multiple reflectors arranged along a straight line, with each reflector being detected with a suitable, selected partial area. The selected partial areas are selectively and simultaneously read from the camera and fed to the evaluation unit. Through time- and spatially resolved detection of object intrusions into the area delimited by the reflectors, the positions, speeds, and sizes of objects are recorded. Control commands for adjusting the operation of the optical sensor are generated based on this data.

[0012] A key aspect of the invention is that the control means configures the camera in such a way that selected sub-areas of the receiving elements are read by the camera. The control means can be used to freely specify the position and size of the selected sub-areas. This allows a sensor function to be specifically implemented with the camera configured in this way, which can, in particular, replace external sensors.

[0013] Since the selected sub-area corresponding to an ROI (region of interest) comprises only a part of the receiving elements, which advantageously comprises only a small part of all receiving elements and in the limiting case even only a single receiving element, the reading of the received signals of the receiving elements of the selected sub-area can be carried out quickly, so that a correspondingly short reaction time is obtained for the evaluation of the received signals of the selected sub-area.

[0014] According to the invention, a control command for adjusting the operation of the optical sensor is generated based on the evaluation of the received signals from the receiving elements of selected sub-areas. The arrangement of the received signals from the receiving elements of the selected sub-areas provides an internal sensor function that allows the operation of the optical sensor to be adjusted with short response times. In particular, this allows image acquisition by the optical sensor to be triggered quickly and without the use of external sensors.

[0015] According to the invention, a target object can be detected by evaluating the received signals of the receiving elements of selected sub-areas.

[0016] The target objects and the selected sub-areas of the receiving elements, preferably adapted to them, thus form a sensor array whose sensor signals are used to control the operating mode of the optical sensor. Since the receiving elements of the camera and the evaluation unit of the optical sensor can be used together, separate units for implementing this sensor function are no longer required.

[0017] The target objects are designed as reflectors, such as retroreflectors. In this case, the optical sensor and the associated reflectors form a reflective light barrier, which can quickly detect the intrusion of an object between the sensor and the optical sensor. Operation is then adjusted depending on whether or not an object has been detected by this reflective light barrier.

[0018] According to an advantageous embodiment, amplitude movements of the received signals of the receiving elements of the selected sub-area are carried out to detect the target object.

[0019] A target object can be detected by thresholding the amplitudes of the received signals of the receiving elements of the selected sub-area.

[0020] According to an advantageous embodiment, a time-variable specification of selected sub-areas is provided.

[0021] Selected sub-areas are specified by parameterization.

[0022] Parameterization can be carried out through teach-in processes or through external units such as Internet interfaces.

[0023] According to an advantageous embodiment, the operating mode can be set by the control command.

[0024] If the optical sensor can be operated in different operating modes, a specific operating mode can be selected using the control command.

[0025] For example, the optical sensor can be operated as a code reader using a control command.

[0026] According to a further advantageous embodiment, an image recording can be released with the control command.

[0027] The control command triggers the image capture with the optical sensor, so that even fast-moving objects can be reliably captured.

[0028] The control command activates different selected sub-areas or all receiving elements of the camera for image recording.

[0029] According to a further advantageous embodiment, this can be parameterized by the control command.

[0030] Parameterization allows you to set parameters of the optical sensor for image acquisition, such as the size of the detection area, definition of different ROIs or parameters for evaluating the received signals of the receiving elements.

[0031] Furthermore, the control command controls communication with an external unit.

[0032] For example, it can be used to specify the type of output signals to an external unit. Furthermore, different interface parameters can be specified for outputting the output signals via different interfaces such as cables, bus systems, and the like.

[0033] Finally, an actuator coupled to the optical sensor is controlled by means of the control commands.

[0034] Since several selected sub-areas are provided, the directions or speeds of target objects can be determined by evaluating these sub-areas, whereby actuators can be controlled depending on such measured variables.

[0035] According to an advantageous embodiment, the control means are formed by program modules assigned to the camera.

[0036] The camera with the program module integrated in a sensor control then forms a compact unit that can be used to specify specific ROIs without any additional components.

[0037] Particularly advantageous is that the camera has a matrix-shaped arrangement of receiving elements.

[0038] The camera thus designed features a multitude of receiving elements, allowing for high image resolution. The camera uses a CMOS or CCD array.

[0039] According to an expedient embodiment of the invention, the optical sensor has an illumination device.

[0040] The illumination device illuminates the area covered by the optical sensor, thereby improving object detection. If the optical sensor is used for distance measurement, the illumination device emits the light rays whose travel times are used to determine the distance of objects. The illumination device can be omitted, especially in cases where target objects themselves serve as light sources.

[0041] The invention is explained below with reference to the drawings. They show: Figure 1: Schematic representation of an embodiment of the optical sensors according to the invention. Figure 2: Optical components of the optical sensor according to Figure 1a) in a top view, b) in a sectional view. Figure 3: Top view of the light-sensitive surface of a camera of the optical sensor according to Figure 1 with a matrix-like arrangement of receiving elements and a selected partial area. Figure 4: Top view of the light-sensitive surface of the camera of the optical sensor according to Figure 1 with five selected sub-areas a) without object intrusion, b) with an intruding object, c) with the object completely captured.

[0042] Figure 1 shows schematically an embodiment of the optical sensor 1 according to the invention. The components of the optical sensor are integrated in a housing 2.

[0043] The optical sensor has a camera 7, which is controlled by a sensor controller 4. A receiving optics 5 is assigned to the camera 3. The camera 3 enables object detection within an image field 6. Furthermore, the optical sensor has, as an optional device, an illumination device formed from a number of individual light sources 7 arranged coaxially with the camera 3 ( Figures 2a, b ).

[0044] In the present case, first polarization means 8a are arranged upstream of the receiving optics 5 and second polarization means 8b are arranged downstream of the individual light sources 7. The polarization directions of the polarization means 8a, 8b are oriented perpendicular to each other, as indicated by the arrows in Figure 2a illustrated.

[0045] The optical sensor further comprises an evaluation unit 9, which can be formed by a microprocessor or the like. The evaluation unit 9 evaluates received signals from the camera 3 for object detection. Furthermore, the evaluation unit 9 serves to control the lighting device. Finally, the sensor controller 4 can be controlled by the evaluation unit 9. Alternatively or additionally, the sensor signals can be controlled by control signals from an external controller (not shown). Cloud-based systems are also particularly possible.

[0046] Light beams 10 are emitted from the individual light sources 7, which illuminate the image field 6 of the camera 3. Figure 1 only the beam axes of these light rays 10 are shown.

[0047] As in Figure 1 As shown, there is a reflector 11 in the image field 6 of the camera 3, which can be detected by the optical sensor.

[0048] Optionally, the light beams 10 can also be used for distance measurement by determining the travel time of the light beams 10, preferably in the form of light pulses, to an object. The optical sensor then forms a distance image camera.

[0049] Figure 3 shows a top view of the light-sensitive surface 7a of the camera 3, which consists of a matrix-like arrangement of receiving elements 12. In principle, a line-like arrangement of receiving elements 12 is also possible. Each receiving element 12 generates received signals that can be evaluated in the evaluation unit 9. The camera 3 can be formed by a CCD or CMOS array.

[0050] According to the invention, a program module in the sensor control 4 can be controlled by control commands generated in the evaluation unit 9 or control commands input by the control unit, for example, which program module forms a control means such that not all receiving elements 12 of the camera 3 are read out, but only one or more selected partial areas 13, which comprise only a preferably very small part of the receiving elements 12 of the camera 3.

[0051] Such a selected sub-area 13, in the present case comprising four receiving elements 12, is in Figure 3 shown.

[0052] When the camera 3 is designed as a CMOS array, the receiving elements 12 can be precisely addressed, so that only these receiving elements 12 of the selected sub-area 13 are read out. When the camera 3 is designed as a CCD array, the columns of the receiving elements 12 of the selected sub-area 13 can be selectively read out, as shown in Figure 3 illustrated. Alternatively, only the lines of the receiving elements 12 of the selected subarea 13 can be read out.

[0053] In any case, by reading out partial areas of the receiving elements 12, the readout lines can be significantly shortened compared to a complete readout of all receiving elements 12 of the camera 3. Furthermore, the frequency of the readout processes can be increased.

[0054] According to the invention, the operation of the optical sensor is adjusted depending on the received signals of the selected sub-area 13.

[0055] The selected sub-area 13 (as in Figure 3 illustrated) is preferably dimensioned so that it can detect a defined target object.

[0056] Such a target object is, for example, the reflector 11 according to Figure 1Alternatively, the target object can be a light source, for example, consisting of one or more light-emitting diodes. Finally, the target object can be a code applied to an object that can be detected and decoded by the optical sensors.

[0057] To detect the target object, the evaluation unit 9 advantageously performs an amplitude evaluation, in particular a threshold evaluation, of the received signals of the receiving elements 12 of the selected subarea 13. Alternatively or additionally, distance measurements can be performed.

[0058] By designing the selected sub-area 13 in such a way that the reflector 11 is detected as the target object, a threshold evaluation of the amplitudes of the received signals can be used to determine whether or not an object has entered the area between the reflector 11 and the optical sensor 1. If an object is detected, the evaluation unit 9 generates a control command with which the operating mode of the optical sensor is set.

[0059] For example, this triggers the image capture of camera 3, allowing it to then detect the intruding object with preferably all of its receiving elements 12. Alternatively, only selected individual areas 13 of the receiving elements 12 can be read during image capture.

[0060] Furthermore, the control command can represent the operating mode of the optical sensor, for example, the optical sensor can be operated as a code reader.

[0061] Furthermore, the optical sensor can be parameterized using the control command.

[0062] Furthermore, the control command can control communication with an external unit.

[0063] Finally, an actuator coupled to the optical sensor can be controlled by means of the control command.

[0064] The Figures 4a - c show an embodiment in which several target objects are provided in the form of several reflectors 11a-e arranged along a straight line. This arrangement can be formed, for example, by placing a template with five holes on a reflector strip.

[0065] For each reflector 11a-e, a corresponding selected partial area 13 is detected on the light-sensitive surface 7a of the camera 3. The five selected partial areas 13 are selectively and simultaneously read out from the camera 3 and fed to the evaluation unit 9.

[0066] Figure 4a shows the situation when there is no object between the reflectors 11a-e and the optical sensor. In this case, all reflectors 11a-e are detected by the optical sensor.

[0067] Figure 4b shows the situation when an object enters the area bounded by reflectors 11a-e. Consequently, the object interrupts the light path to reflector 11a, but not to the remaining reflectors 11b-e.

[0068] Figure 4c shows the situation when the object has completely penetrated the area bounded by reflectors 11a-e. Consequently, the object interrupts the light paths to reflectors 11b, 11c, but not to the remaining reflectors 11a, 11d, 11e.

[0069] By detecting object intrusions with time and location resolution using reflectors 11a-11e, the positions, speeds, and sizes of objects can be recorded. Control commands can be generated to adjust the operation of the optical sensor. List of reference symbols

[0070] (1)Optical sensor (2)Housing (3)Camera (4)Sensor control (5)Receiving optics (6)Image field (7)Single light source (7a)Surface (8a)Polarizing agent (8b)Polarizing agent (9)Evaluation unit (10)Light beam (11)Reflector (11a-e)Reflector (12)Receiving element (13)Selected sub-area

Claims

1. An optical sensor (1) with a camera (3) having a number of receiving elements (12) and with an evaluation unit (9) which is designed to evaluate received signals from receiving elements (12) of the camera (3), wherein control means are provided by means of which at least one partial area (13) of the receiving elements (12) can be selected, wherein the camera (3) is designed in such a way that only the received signals of the receiving elements (12) of the selected partial area (13) are read out and then fed to the evaluation unit (9) and that a control command for setting the operation of the optical sensor (1) can be generated in the evaluation unit (9) as a function of the received signals of the receiving elements (12) of the selected partial area (13), and wherein a stationary or a moving target object can be detected by evaluating the received signals of the receiving elements (12) of the selected sub-region (13), characterised in that the optical sensor is designed to detect a plurality of target objects in the form of a plurality of reflectors (1 1a-e) which are arranged along a straight line, wherein each reflector (11a-e) is detected with a matching, selected sub-region (13), wherein the selected partial areas (13) are selectively and simultaneously read out from the camera (3) and fed to the evaluation unit (9), that positions, speeds and sizes of objects are detected by a time- and location-resolved detection of object interventions in the area delimited by the reflectors (11a-e), wherein control commands for adjusting the operation of the optical sensor (1) are generated as a function thereof.

2. An optical sensor (1) according to claim 1, characterised in that amplitude evaluations of the received signals of the receiving elements (12) of the selected partial area (13) are carried out to detect the target objects.

3. An optical sensor (1) according to one of claims 1 or 2, characterised in that a timevariable presetting of selected partial areas (13) is provided.

4. An optical sensor (1) according to claim 3, characterised in that the specification of selected partial areas (13) is carried out by parameterisation.

5. An optical sensor (1) according to one of claims 1 to 4, characterised in that its operating mode can be set by the control command and / or in that it can be parameterised by the control command and / or in that communication with an external unit is controlled by the control command and / or in that an actuator coupled to the optical sensor (1) is controlled by means of the control command.

6. An optical sensor (1) according to claim 5, characterised in that it is operated as a code reader by the control command.

7. An optical sensor (1) according to one of claims 1 to 6, characterised in that an image recording can be enabled with the control command.

8. An optical sensor (1) according to claim 1 to 7, characterised in that the control means are formed by program modules assigned to the camera (3).

9. An optical sensor (1) according to one of claims 1 to 8, characterised in that the camera (3) has a matrix-shaped arrangement of receiving elements (12).

10. An optical sensor (1) according to one of claims 1 to 9, characterised in that the camera (3) has a CMOS or CCD array, and / or in that it has a illumination device.