A projector for illuminating at least one object
By using VCSELs arrays in the projector to generate unique beam modes, the problem of the midpoint corresponding to the beam of complex objects is solved, and fast and accurate position measurement is achieved.
Patent Information
- Application Number
- JP2022521106
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Priority Date
- 2019-10-07
- Filing Date
- 2020-10-06
- Publication Date
- 2025-04-15
- Estimated Expiration
- 2040-10-06
AI Technical Summary
The prior art is difficult to effectively solve the problem of point and light beam correspondence in 3D measurement of complex objects, resulting in complex and time-consuming measurement process.
Using a projector containing a vertical cavity surface emitting laser diode (VCSELs) array, the beam mode of each VCSEL is ensured uniquely determined in three-dimensional space by generating beam modes with unique beam configurations.
It realizes rapid and accurate position measurement of complex objects, reduces technical difficulty and resource requirements, and improves measurement efficiency and accuracy.
Smart Images

Figure 0007662623000004 
Figure 0007662623000005 
Figure 0007662623000006
Abstract
Description
[Technical field]
[0001] The invention relates to a projector, a detector and a method for determining the position of at least one object. The device, method and use according to the invention can be employed in particular in various fields, for example in everyday life, games, traffic technology, production technology, security technology, photography, such as digital photography or video photography for art, documentation or technical purposes, medical technology, home care, smart living or science. Furthermore, the invention can be used in particular for scanning one or more objects and / or for scanning a scene, such as for generating a depth profile of the object or scene, for example in the fields of architecture, metrology, archaeology, art, medicine, engineering or manufacturing. However, other applications are also possible. [Background technology]
[0002] Many optical devices and methods are known from the prior art using structured light methods for 3D measurements. Typically in these devices and methods a point pattern is projected and the reflected pattern is recorded and evaluated. The pattern is generated, for example, by combining light emitting diodes (LEDs) and diffractive optical elements (DOEs). However, for complex objects it is necessary to solve the so-called correspondence problem, i.e. which points of the object are generated by which light beams. Several methods for solving the correspondence problem are known, but they are complex and time consuming.
[0003] US 2016 / 178915 describes an optoelectronic device that includes a semiconductor substrate, an array of light emitters arranged on the substrate in a two-dimensional pattern, a projection lens, and a diffractive optical element (DOE). The projection lens is mounted on the semiconductor substrate and configured to collect and focus light emitted by the light emitters so as to project a light beam that includes a light pattern corresponding to the two-dimensional pattern of the light emitters. The DOE is mounted on the substrate and configured to generate and project multiple overlapping replicas of the pattern.
[0004] WO2016 / 154218A1 describes a tracking system for generating a structured light pattern in a localized area. The system includes an array of lasers for generating light. The array of lasers includes a plurality of lasers and an optical element. The plurality of lasers are grouped into at least two subsets of lasers, each of the at least two subsets of lasers being independently switchable. The optical element includes a plurality of cells, each aligned with a respective subset of the array of lasers. Each cell receives light from a corresponding laser of the array of lasers, and each cell applies a modulation individually to the received light transmitted through the cell to form a corresponding portion of the structured light pattern projected in the localized area.
[0005] WO2009 / 153446A2 describes an apparatus for projecting structured light in the form of a Flynn or other pattern by means of a laser source, which comprises an optical head comprising three successive elements mounted on a substrate: a laser source comprising a VCSEL, a collimation diffractive optical element and a light structuring diffractive optical element. The laser source comprises at least one VCSEL matrix obtained by combining M bars of N VCSELs to obtain (M×N) VCSELs. The diffractive optical elements are phase diffractive optical elements which convert the light emitted by the laser source into a structured light pattern. They consist of a matrix of (M×N) diffractive optical subelements mounted in front of each VCSEL and connected to the laser source to define an integrated optical head. [Prior art documents] [Patent documents]
[0006] [Patent Document 1] US2016 / 178915 [Patent Document 2] WO2016 / 154218A1 [Patent Document 3] WO2009 / 153446A2 Summary of the Invention [Problem to be solved by the invention]
[0007] It is therefore an object of the present invention to provide an apparatus and method for the above-mentioned technical problems of known apparatus and methods. In particular, it is an object of the present invention to provide an apparatus and method which allows for reliably determining the position of an object in space, preferably with low technical effort and with low demands in terms of technical resources and costs. [Means for solving the problem]
[0008] This problem is solved by the invention with the features of the independent patent claims. Advantageous developments of the invention, which can be realized individually or in combination, are set out in the dependent claims and / or in the following description and detailed embodiments.
[0009] As used herein, the terms "having", "including" or "containing" and their grammatical variants are used in a non-exclusive manner. Thus, these terms can refer to both the situation where there are no further features in the object described in this context, other than the features introduced by these terms, and the situation where there are one or more further features. For example, the terms "A has B", "A comprises B" and "A includes B" can refer to both the situation where there are no other elements in A other than B (i.e., A consists solely and exclusively of B), and the situation where there are one or more further elements in the entity A other than B, such as element C, elements C and D, or even another element.
[0010] Furthermore, it should be noted that the terms "at least one," "one or more," or similar expressions indicating that a feature or element may be present one or more times are usually used only once when introducing each feature or element. In the following, in most cases, when referring to each feature or element, the expressions "at least one" or "one or more" will not be repeated, regardless of the fact that each feature or element may be present one or more times.
[0011] Furthermore, as used below, the terms "preferably", "more preferably", "particularly", "more particularly", "particularly", "more particularly" or similar terms may be used with any feature without limiting alternative possibilities. Thus, features introduced by these terms are optional features and are not intended to limit the scope of the claims in any way. As a person skilled in the art will recognize, the invention may be implemented by using alternative features. Similarly, features introduced by "in an embodiment of the invention" or similar expressions do not impose any restrictions on alternative embodiments of the invention, do not impose any restrictions on the scope of the invention, and do not impose any restrictions on the possibility of combining the feature so introduced with other optional or non-optional features of the invention.
[0012] In a first aspect of the present invention, a projector for illuminating at least one object with at least one illumination pattern is disclosed.
[0013] As used herein, the term "object" may refer to any object, in particular a surface or area, configured to at least partially reflect at least one light beam incident on the object. The light beam may originate from a projector that illuminates the object, which is reflected or scattered by the object. As used herein, the term "projector", also called light projector, may refer to an optical device configured to project at least one illumination pattern onto an object, in particular onto a surface of the object.
[0014] The projector comprises at least one array of vertical cavity surface emitting lasers (VCSELs). Each of the VCSELs is configured to generate at least one light beam. The projector comprises at least one optical system configured to generate a characteristic beam profile for each of the light beams generated by the VCSELs of the array. Periodic or random repetition of the beam profiles in a pattern may be possible. The beam profiles of adjacent VCSELs of the array differ laterally and / or axially such that the light beams of the VCSELs of the array are assigned to corresponding VCSELs in three-dimensional space.
[0015] As used herein, the term "pattern" may refer to any known or pre-determined arrangement including a plurality of any shape features, such as a symbol. A pattern may include a plurality of features. A pattern may include a periodic or non-periodic arrangement of features. As used herein, the term "illumination pattern" refers to a pattern that illuminates an object. In particular, an illumination pattern refers to a single beam and its pattern generated by one of the VCSELs, while the collective or totality of all illumination patterns generated by an array of VCSELs may be referred to as an aggregate illumination pattern. The illumination pattern may include at least one pattern selected from the group consisting of: at least one dot pattern or pseudo-random dot pattern; at least one Sobol pattern; at least one quasi-periodic pattern; at least one pattern including at least one known feature; at least one regular pattern; at least one triangular pattern; at least one hexagonal pattern; at least one rectangular pattern; at least one pattern including a convex uniform tiling; at least one line pattern including at least one line; at least one line pattern including at least two lines, such as parallel lines or crossing lines. For example, the projector may be configured to generate and / or project a point cloud or a non-point feature. For example, the projector may be configured to generate a point cloud or a non-point feature such that the illumination pattern may include a plurality of point features or non-point features. The elementary illumination patterns may include regular and / or regular and / or periodic patterns, such as triangular patterns, rectangular patterns, hexagonal patterns, or patterns further including convex tiling. The illumination pattern may include as many features per area as possible, such that hexagonal patterns are preferred. The distance between two features of each illumination pattern and / or the area of at least one illumination feature may depend on the circle of confusion of the image determined by at least one detector, as described below.
[0016] The projector includes an array of at least one vertical cavity surface emitting laser (VCSEL). As used herein, the term "vertical cavity surface emitting laser" refers to a semiconductor laser diode configured to emit a laser beam perpendicular to a top surface. Examples of VCSELs can be found, for example, at https: / / en.wikipedia.org / wiki / Vertical-cavity_surface-emitting_laser. VCSELs are commonly known to those skilled in the art, such as from WO2017 / 222618A.
[0017] Each of the VCSELs is configured to generate at least one light beam. As used herein, the term "light ray" generally refers to a line perpendicular to the wavefront of the light, pointing in the direction of energy flow. As used herein, the term "beam" generally refers to a collection of light rays. In the following, the terms "light ray" and "beam" are used synonymously. As further used herein, the term "light beam" generally refers to an amount of light, specifically an amount of light traveling in essentially the same direction, including the possibility that the light beam may have an expansion or divergence angle.
[0018] The VCSEL can be configured to emit a light beam in the wavelength range of 800-1000 nm. For example, the VCSEL may be configured to emit a light beam at 808 nm, 850 nm, 940 nm, or 980 nm. Preferably, the VCSEL emits light at 940 nm because terrestrial solar radiation has a local minimum in irradiance at this wavelength, as described, for example, in CIE 085-1989 "Solar Spectral Irradiance".
[0019] The array of VCSELs may be a two-dimensional or one-dimensional array. The array of VCSELs may include a plurality of VCSELs arranged in a matrix. As further used herein, the term "matrix" generally refers to an arrangement of a plurality of elements in a predetermined geometric order. The matrix may specifically be or include a rectangular matrix having one or more rows and one or more columns. The rows and columns may specifically be arranged in a rectangular manner. However, it is explained that other arrangements are possible, such as non-rectangular arrangements. As an example, a circular arrangement is also possible, where the elements are arranged in concentric circles or ellipses around a central point. For example, the matrix may be a single row of pixels. Other arrangements are also possible. The VCSELs may be arranged on a common substrate or on different substrates. The array may include up to 2500 VCSELs. For example, the array may include 38×25 VCSELs, such as a high-power array at 3.5 W. For example, the array may include 10×27 VCSELs at 2.5 W. For example, the array may include 96 VCSELs at 0.9 W. For example, the size of a 2500 element array can be up to 2 mm by 2 mm.
[0020] Arrays of VCSELs can have high radiant power compared to light emitting diodes (LEDs). Additionally, VCSELs can have higher spatial and temporal coherence compared to LEDs, which can improve beam profile shaping and / or modification by optical systems, resulting in increased spectral power density.
[0021] The projector includes at least one optical system configured to generate a characteristic beam profile for each of the light beams generated by the VCSELs of the array. As used herein, the term "optical system" generally refers to at least one optical device including at least two components. The optical system may include at least one array of optical elements. The array of optical elements may include a plurality of optical elements arranged in a matrix. The matrix of optical elements may specifically be or include a rectangular matrix having one or more rows and one or more columns. The rows and columns may specifically be arranged in a rectangular manner. However, it is explained that other arrangements are possible, such as non-rectangular arrangements. As an example, a circular arrangement is also possible, where the elements are arranged in concentric circles or ellipses around a central point. For example, the matrix may be a single row of pixels. Other arrangements are also possible.
[0022] As used herein, the term "beam profile" relates to the spatial distribution of the intensity of a light beam, especially in at least one plane perpendicular to the propagation of the light beam. The beam profile may be the transverse intensity profile of the light beam. The beam profile may be the cross-section of the light beam. The beam profile may be selected from the group consisting of a trapezoidal beam profile; a triangular beam profile; a linear combination of a conical beam profile and a Gaussian beam profile. However, other embodiments are possible. As used herein, the term "characteristic beam profile" relates to the fact that the beam profiles of the VCSELs of the array, especially the beam profiles of adjacent VCSELs, are different. The beam profiles of adjacent VCSELs of the array are different in the transverse and / or axial directions. As used herein, the term "axial direction" refers to the direction along the optical axis of the optical system, especially the longitudinal direction. As used herein, the term "optical axis" refers generally to the axis of mirror or rotational symmetry of the optical system. The optical axis may be the line of symmetry of the optical configuration of the optical system. As used herein, the term "transverse direction" refers to the direction perpendicular to the axial direction, especially the transverse direction. The beam profiles of the VCSELs of the array, in particular the beam profiles of adjacent VCSELs of the array, may differ by one or more of the following: shape, orientation, cross-section. The lateral and axial directions constitute a three-dimensional space. As used herein, the term "shape" generally refers to the spatial distribution of the intensity of the light beam, such as the extension and / or contour, in particular in at least one plane perpendicular to the propagation of the light beam. As used herein, the term "orientation" generally refers to the propagation direction of the light beam relative to the optical axis of the optical system, in particular the angle between the propagation direction of the light beam and the optical axis. As used herein, the term "cross-section" generally refers to the area of the light beam in at least one plane perpendicular to the propagation of the light beam. The different beam profiles allow the allocation of the light beams generated by the VCSELs of the array to the corresponding VCSELs. In particular, when the shapes of adjacent light beams are different, it is possible to determine from the shape of the light beam which VCSEL of the array the light beam was generated from.For example, the light beams may differ in shape and orientation. Preferably, the difference in the beam profiles is as large as possible to allow for easy allocation. The allocation may be easiest if the beam profiles of all VCSELs of the array differ in shape, orientation and cross-section. However, it may be sufficient if the beam profiles of adjacent light beams differ in at least one parameter.
[0023] The light generated by an individual VCSEL cannot overlap or merge with the light of other VCSELs into a common pattern. Conversely, the beam profile of each VCSEL can remain recognizable by itself. This allows the beam profiles of adjacent VCSELs to be different so that they can be distinguished and the beam profile of each generated light beam varies in the light beam propagation direction to improve distance determination. The invention proposes in particular that each VCSEL has an individual optical element. This is in contrast to known devices. For example, WO2016 / 154218A1 describes 3D measurements with structured light, in which it is necessary to perform several images with different patterns in sequence. For this procedure, the lasers of the array proposed in WO2016 / 154218A1 are divided into at least two subgroups that can be switched independently. The lasers of each subgroup share a common optical system. Thus, in contrast to the device proposed in WO2016 / 154218A1, the invention requires only a single image. No temporal modulation of the lasers or patterns is required.
[0024] Each of the optical elements may have a structured surface. The structured surfaces of the optical elements may be different. In particular, the structured surfaces of two adjacent optical elements of the array may be different. As used herein, the term "structured surface" may generally refer to a surface of an optical element having any predefined structure. The structured surface may be an individual printed and / or embossed structure. However, other manufacturing techniques such as molding or injection molding are also possible. The optical elements may be manufactured or produced using three-dimensional holographic lithography as described by J. Gavin in Optics Letters, Vol. 36 (2011), Nr. 13, 2495-2497.
[0025] The optical elements may each be or include at least one lens with a structured surface. The structured surface may be a surface with individual printed and / or embossed structures. However, other manufacturing techniques such as molding or injection molding are also possible. The structured surface may result in that the light beam impinging on the optical element is adjusted to have a non-pointy or non-speckled beam profile. The optical elements may be refractive optical elements. Preferably, the optical elements may be refractive-diffractive hybrid elements. As used herein, the term "refractive optical element" refers to a structured surface with at least one refractive structure. As used herein, the term "refractive-diffractive hybrid element" refers to a structured surface with at least one refractive structure and at least one diffractive structure, or a structure with both refractive and diffractive properties. The refractive elements and / or refractive structures may have a radius, in particular a diameter of, for example, a microlens, depending on the distance between adjacent VCSELs. For example, the distance may be in the range of 40 μm to 70 μm. The diameter may be similar, such as 40 μm. However, the diameter may be more strongly dependent on the optical properties and the refractive index. The diffractive elements and / or structures may be advantageous because they can be manufactured very flat. The diffractive elements may each have at least one base plate, also called substrate. The base plate may be a glass base plate. The base plate may have a thickness of 1 mm. The diffractive elements and / or structures may be:
number
[0026] The optical element may include at least one material including at least one polymer. The material may be a polymer material that may be used for two-photon stimulated polymerization, such as Nanoscribe IP-Dip, OrmoComp., Nanoscribe IP-G, Nanoscribe IP-L, Nanoscribe IP-S. For molding processes such as injection molding or hot embossing, plastics may be used, such as Trogamid myCX, available from Zeonix (https: / / www.zeonex.com / optics.aspx.html) or available from Evonik (https: / / www.campusplastics.com / campus / de / datasheet / TROGAMID%C2%AE+myCX+nc+(nf) / Evonik+Industries+AG / 66 / bf801790). For glass molding, several glass materials may be used, such as those listed in https: / / refractiveindex.info / ?shelf=glass&book=BK7&page=SCHOTT.
[0027] The optical element may be arranged as close as possible to the propagation direction of the light beam in front of the array of VCSELs. For example, the optical element may be designed as a rod lens with a high refractive index. The rod lens may be arranged as close as possible to the propagation direction of the light beam in front of the array of VCSELs. Due to the higher refractive index of the lens material, the convergence angle can be reduced and the optical path length can be increased so that the local coherence can be increased and the shaping of the light beam can be improved.
[0028] The structured surface may be configured such that the cross-section of the beam profile differs depending on the distance between the projector and the object. This may be ensured by using optical elements with a certain predefined and / or predefined geometry. The required geometry may be determined using iterative wave optics calculations. In particular, the desired intensity distribution at different distances to the optical element may be used as a basis for the iterative design. At least one wave optics propagation algorithm may be used between different surfaces, for example between a VCSEL, a projection surface with shape 1, and a projection surface with shape 2 of the optical element, such as Fresnel propagation, or Rayleigh-Sommerfeld diffraction integral. The propagation may be performed from plane to plane and back to the VCSEL. Since VCSELs may emit partially coherent radiation, it is possible to use mutually incoherent point sources in the simulation. The point sources may be weighted with respect to their intensity distribution.
[0029] The present invention distinguishes from conventional stripe projection: the illumination pattern may include distinct, separate features that do not touch or overlap one another. In particular, the illumination pattern may not include closed features created by overlapping or overlaying the emissions of adjacent vertical cavity surface emitting lasers.
[0030] Each VCSEL can generate a closed individual feature. Thus, the number of generated features may correspond to the number of VCSELs. By requiring that the optical system be configured to generate a characteristic beam profile for each of the light beams generated by the VCSELs of the array, it may be possible to identify and / or localize the light emitted by each of the VCSELs. The generated beam profiles of adjacent individual VCSELs are different, in particular the beam profiles of adjacent VCSELs of the array are different in the lateral and / or axial directions. For the study of 3D space with the projection of different features in the lateral and / or axial directions, the light beams of the VCSELs can be assigned to the corresponding VCSELs in the three-dimensional space. Each micro-optical element of the VCSEL can generate not only one pattern, but several patterns, for example displaced in the axial and / or lateral directions.
[0031] The optical system may be configured to generate multiple illumination patterns in the lateral direction. As used herein, the term "lateral" refers to the dimension perpendicular to the axial direction, in particular the transverse direction. For example, the optical system may be configured to generate at least two illumination features with different angles to the optical axis for each of the VCSELs of the array. For example, this can be realized using ray tracing routines enabled by a commercial software package from Zemax®. Additionally or alternatively, it may be possible to use an iterative approach based on at least one wave optics propagation method, such as Rayleigh-Sommerfeld, Fresnel propagation and / or Fraunhofer propagation. The iterative process may then alternate between propagation from the optical system to different lateral projected illumination patterns and back to the optical system. During the update process of the optical system, a number of different lateral illumination patterns may be considered, resulting in each illumination pattern contributing a certain percentage to the updated optical system, for example, if two illumination patterns are generated with the same weight, the corresponding searched wave optics solution in each iteration step will contribute 50% to the wave optics description of the optical system. This process can be repeated until the error measure can be minimized for all projected illumination patterns. The error measure can be obtained from the difference between the desired illumination pattern and the simulated illumination pattern. The projection direction between the at least two illumination patterns should not be too large. The two patterns can be projected on the same plane. Thus, the iterative process will only take place between the optical system and the plane of the at least two desired illumination patterns.
[0032] The optical system may be configured to generate a number of different illumination patterns in the axial direction. As used herein, the term "axial direction" refers to the dimension along the optical axis of the optical system, in particular the longitudinal direction. The optical system may be configured to focus the different illumination patterns of each VCSEL to different depths of field. In particular, the optical system may be configured to focus the illumination patterns in different focal planes, in particular object planes, where the focal planes are planes perpendicular to the optical axis of the optical system having different coordinates along the optical axis. The optical system may be configured such that in each of the focal planes only one of the illumination patterns is focused and the other illumination patterns are unfocused. The optical system may be configured such that in each of the focal planes a different illumination pattern is focused. The optical system may include at least one device for intermediate projection of the illumination patterns. For example, for applications where the distance between the array of VCSELs and the object is several meters, the device for intermediate projection may be designed as telecentric imaging, such that the size of the features of the imaged pattern is invariant for all axial object positions. Additionally or alternatively, the imaging scale may be determined from design data or by calibration. A number of different illumination patterns in the axial direction may allow the use of triangulation methods and / or methods in which the detector and the projector are specifically aligned on a common axis. To this end, the detector may include at least one zoom optical system and / or at least one electro-optical tunable system for traversing the measurement range. By adjusting different illumination patterns for different depths of the VCSELs of the array, it may be possible to increase the number of distinguishable depth steps over the depth of field range of the detector to the number of VCSELs of the array.
[0033] For example, the optical system may be configured to generate a number of different illumination patterns in an axial direction, each of the different illumination patterns may include a number of spots.
[0034] For example, the optical system may be configured to generate a number of different illumination patterns in the axial direction, each of which may be asymmetric and may include multiple spots.
[0035] For example, the optical system may be configured to generate a number of different illumination patterns in the lateral direction, each of the different illumination patterns may include a number of spots.
[0036] For example, the optical system may be configured to generate a number of different illumination patterns in the lateral direction, each of which may be asymmetric and may include multiple spots.
[0037] In a further aspect of the present invention, a detector for determining a position of at least one object is disclosed, the detector comprising at least one projector according to an embodiment according to the present invention, such as according to one or more of the embodiments disclosed above or one or more of the embodiments disclosed in more detail below.
[0038] As used herein, the term "position" refers to at least one item of information relating to the position and / or orientation of an object and / or at least a part of an object in space. The at least one item of information may therefore refer to at least one distance between at least one point of the object and at least one detector. The item of information may in particular refer to the x, y and z coordinates of the point of the object in space. The distance may be a longitudinal coordinate or contribute to determining the longitudinal coordinate of the point of the object. Additionally or alternatively, one or more other items of information relating to the position and / or orientation of the object and / or at least a part of the object may be determined. As an example, furthermore, at least one lateral coordinate of the object and / or at least a part of the object may be determined. Thus, the position of the object may refer to the longitudinal coordinate of the object and / or at least a part of the object. Additionally or alternatively, the position of the object may refer to at least one lateral coordinate of the object and / or at least a part of the object. Additionally or alternatively, the position of the object may refer to at least one orientation information of the object, indicating the orientation of the object in space.
[0039] The detector is: - at least one projector for illuminating an object with at least one illumination pattern according to the invention; - at least one sensor element having a matrix of light sensors, each light sensor having a respective light-sensitive area, each light sensor designed to generate at least one sensor signal in response to illumination of its respective light-sensitive area by a reflected light beam propagating from the object to a detector, said sensor element being configured to determine at least one reflected image; - at least one evaluation device, the evaluation device being configured to select at least one reflection feature of the reflection image and to assign the reflection feature to one of the VCSELs of the array; and Equipped with.
[0040] As used herein, the term "sensor element" generally refers to a device or a combination of devices configured to sense at least one parameter. In this case, the parameter may specifically be an optical parameter, and the sensor element may specifically be an optical sensor element. The sensor element may be formed as an integral single device or as a combination of several devices. As further used herein, the term "matrix" generally refers to an arrangement of multiple elements in a predetermined geometric order. As outlined in more detail below, the matrix may specifically be or include a rectangular matrix having one or more rows and one or more columns. The rows and columns may specifically be arranged in a rectangular manner. However, it is explained that other arrangements are also possible, such as non-rectangular arrangements. As an example, a circular arrangement is also possible, where the elements are arranged in concentric circles or ellipses around a central point. For example, the matrix may be a single row of pixels. Other arrangements are also possible.
[0041] As used herein, "light sensor" generally refers to a light-sensitive device for detecting light beams, for example for detecting illumination and / or light spots generated by at least one light beam. As used herein, "light-sensitive area" generally refers to an area of a light sensor that is externally illuminated by at least one light beam and generates at least one sensor signal in response to said illumination. The light-sensitive area may specifically be located on the surface of the respective light sensor. However, other embodiments are also possible. The light sensors of the matrix may specifically be equal in size, sensitivity, and one or more of other optical, electrical, mechanical properties. The light-sensitive areas of all light sensors of the matrix may specifically be arranged in a common plane, which preferably faces the object, such that a light beam propagating from the object to the detector generates a light spot on said common plane.
[0042] As used herein, the term "light sensor having at least one light-sensitive area" refers to a configuration with a plurality of single light sensors each having one light-sensitive area, as well as a configuration with one combined light sensor having a plurality of light-sensitive areas. Thus, the term "light sensor" further refers to a light-sensitive device configured to generate one output signal, but in this specification a light-sensitive device configured to generate two or more output signals, e.g. at least one CCD and / or CMOS device, is referred to as two or more light sensors. Each light sensor may be embodied by providing, for example, exactly one light-sensitive area that can be illuminated, such that exactly one light-sensitive area is present in each light sensor, to generate exactly one uniform sensor signal for the entire light sensor in response to illumination of said light-sensitive area. Thus, each light sensor may be a single-area light sensor. The use of single-area light sensors, however, makes the construction of the detector particularly simple and efficient. Thus, by way of example, commercially available light sensors, such as commercially available silicon photodiodes, each having exactly one light-sensitive area, may be used in the construction. However, other embodiments are possible. Thus, by way of example, optical devices may be used that include two, three, four or more light-sensitive areas, which in the context of the present invention are considered as two, three, four or more light sensors. As outlined above, the sensor element includes a matrix of light sensors. Thus, by way of example, the light sensor may be part of or constitute a pixelated optical device. By way of example, the light sensor may be part of or constitute at least one CCD and / or CMOS device having a matrix of pixels, each pixel forming a light-sensitive area.
[0043] The light sensor may in particular be or may include a photodetector, preferably an inorganic light detector, more preferably an inorganic semiconductor light detector, most preferably a silicon light detector. In particular, the light sensor may have sensitivity in the infrared spectral range. All of the light sensors of the matrix, or at least a group of the light sensors of the matrix, may in particular be identical. Groups of identical light sensors of the matrix may in particular be provided for different spectral ranges, or all the light sensors may be identical with respect to their spectral sensitivity. Furthermore, the light sensors may be identical with respect to size and / or their electronic or optoelectronic properties.
[0044] In particular, the light sensor may be or may include inorganic photodiodes having sensitivity in the infrared spectral range, preferably in the range of 780 nm to 3.0 micrometers. In particular, the light sensor may be sensitive in the part of the near infrared range, particularly in the range of 700 nm to 1000 nm, where silicon photodiodes are applicable. Infrared light sensors that may be used in the light sensor may be commercially available infrared light sensors, such as, for example, infrared light sensors sold under the brand name Hertzstueck® by trinamiX GmbH, D-67056 Ludwigshafen am Rhein, Germany. Thus, by way of example, the light sensor may include at least one light sensor of the intrinsic photovoltaic type, more preferably at least one semiconductor photodiode selected from the group consisting of Ge photodiodes, InGaAs photodiodes, extended InGaAs photodiodes, InAs photodiodes, InSb photodiodes, HgCdTe photodiodes. Additionally or alternatively, the optical sensor may comprise at least one optical sensor of extrinsic photovoltaic type, more preferably at least one semiconductor photodiode selected from the group consisting of Ge:Au photodiode, Ge:Hg photodiode, Ge:Cu photodiode, Ge:Zn photodiode, Si:Ga photodiode, Si:As photodiode. Additionally or alternatively, the optical sensor may comprise at least one bolometer, preferably selected from the group consisting of VO bolometers and amorphous Si bolometers.
[0045] The matrix may be made of independent light sensors. It may therefore be made of inorganic photodiodes. Alternatively, however, commercially available matrices may be used, for example one or more CCD detectors, such as a CCD detector chip, and / or a CMOS detector, such as a CMOS detector chip.
[0046] Thus, in general, the light sensors of the detector may form a sensor array or may be part of a sensor array, such as the matrix mentioned above. Thus, by way of example, the detector may have a light sensor array, such as a rectangular array having m rows and n columns, where m, n are independently positive integers. Preferably, more than one column and more than one row are provided, i.e. n>1, m>1. Thus, by way of example, n may be 2 to 16 or more, and m may be 2 to 16 or more. Preferably, the ratio of the number of rows to the number of columns is close to 1. By way of example, n and m may be selected such that 0.3≦m / n≦3, such as by selecting m / n=1:1, 4:3, 16:9 or similar. By way of example, the array may be a square array with equal numbers of rows and columns, such as by selecting m=2, n=2 or m=3, n=3, etc.
[0047] The matrix may in particular be a rectangular matrix having at least one row, preferably several rows and several columns. By way of example, the rows and columns may be oriented in a substantially vertical direction, and for the term "substantially vertical" reference may be made to the definition above. Thus, by way of example, a tolerance of less than 20°, in particular less than 10°, or even less than 5° may be tolerated. In order to provide a wide field of view, the matrix may in particular have at least 10 rows, preferably at least 50 rows, more preferably at least 100 rows. Similarly, the matrix may have at least 10 columns, preferably at least 50 columns, more preferably at least 100 columns. The matrix may include at least 50 light sensors, preferably at least 100 light sensors, more preferably at least 500 light sensors. The matrix may include a number of pixels in the range of several megapixels. However, other embodiments are possible. Thus, in configurations where axial rotational symmetry is expected, a circular or concentric arrangement of the light sensors of the matrix, which may also be called pixels, may be preferred.
[0048] Preferably, the sensor element may be oriented substantially perpendicular to the optical axis of the detector. Again, with regard to the term "substantially perpendicular", reference may be made to the definition and tolerances set forth above. The optical axis may be a straight optical axis or may even be refracted or split, such as by using one or more deflection elements and / or by using one or more beam splitters, in which case the substantially perpendicular orientation may refer to the local optical axis of each branch or beam path of the optical configuration.
[0049] The reflected light beam can propagate from the object towards the detector. The reflected light beam can originate from the object. The projector can illuminate the object with at least one illumination pattern, where the light is reflected or scattered by the object and thereby directed at least in part as the reflected light beam towards the detector.
[0050] The reflected light beam may in particular completely illuminate the sensor element with a beam width larger than the light matrix, so that the sensor element is completely located within the light beam. Conversely, preferably, the reflected light beam may generate a light spot smaller than the matrix over the entire matrix, so that the light spot is completely located within the matrix. This situation can be easily adjusted by a person skilled in the art of optics by selecting one or more suitable lenses or elements that have a focusing or defocusing effect on the light beam, such as by using a suitable transfer device as outlined in more detail below.
[0051] As further used herein, a "sensor signal" generally refers to a signal generated by an optical sensor in response to illumination by a light beam. Specifically, the sensor signal may be or include at least one electronic signal, such as at least one analog electronic signal and / or at least one digital electronic signal. More specifically, the sensor signal may be or include at least one voltage signal and / or at least one current signal. More specifically, the sensor signal may include at least one photocurrent. Furthermore, a raw sensor signal may be used, or a detector, optical sensor, or other element may be configured to process or pre-process the sensor signal, such as pre-processing by filtering, thereby generating a secondary sensor signal that may also be used as a sensor signal.
[0052] The light-sensitive areas may be specifically oriented toward the object. As used herein, the term "oriented toward the object" generally refers to a state in which the respective surface of the light-sensitive areas is fully or partially visible from the object. Specifically, at least one interconnection line between at least one point of the object and at least one point of the respective light-sensitive area may form an angle with the surface element of the light-sensitive area different from 0°, for example an angle in the range of 20° to 90°, preferably an angle in the range of 80° to 90°, for example 90°. Thus, when the object is on or near the optical axis, the light beam propagating from the object toward the detector may be substantially parallel to the optical axis. As used herein, the term "substantially vertical" refers to a state of vertical orientation, for example with a tolerance of ±20° or less, preferably a tolerance of ±10° or less, more preferably a tolerance of ±5° or less. Similarly, the term "substantially parallel" refers to a state of parallel orientation, for example with a tolerance of ±20° or less, preferably a tolerance of ±10° or less, more preferably a tolerance of ±5° or less.
[0053] The optical sensor may have sensitivity in one or more of the ultraviolet, visible, or infrared spectral ranges. Specifically, the optical sensor may have sensitivity in the visible spectral range of 500 nm to 780 nm, most preferably 650 nm to 750 nm, or 690 nm to 700 nm. Specifically, the optical sensor may have sensitivity in the near infrared range. Specifically, the optical sensor may have sensitivity in the portion of the near infrared range where silicon photodiodes are applicable, particularly in the range of 700 nm to 1000 nm. The optical sensor may have sensitivity in the infrared spectral range, specifically in the range of 780 nm to 3.0 micrometers. For example, the optical sensors may each independently be or include at least one element selected from the group consisting of a photodiode, a photocell, a photoconductor, a phototransistor, or any combination thereof. For example, the light sensor may be or may include at least one element selected from the group consisting of a CCD sensor element, a CMOS sensor element, a photodiode, a photocell, a photoconductor, a phototransistor, or any combination thereof. Any other type of photosensitive element may be used. As outlined in more detail below, the photosensitive element may generally be made entirely or partially of inorganic materials and / or entirely or partially of organic materials. Most commonly, one or more photodiodes may be used, such as commercially available photodiodes, e.g., inorganic semiconductor photodiodes.
[0054] As used herein, the term "reflected image" refers to an image determined by an optical sensor that includes a plurality of reflective features. As used herein, the term "reflective feature" refers to a feature in an image plane that is generated by an object in response to illumination by at least one illumination feature. The reflected image may include at least one reflective pattern that includes the reflective features. As used herein, the term "determining at least one reflected image" refers to one or more of imaging, recording, and generating a reflected image.
[0055] As used herein, the term "selecting at least one reflectance feature" refers to one or more of identifying, determining, and selecting at least one reflectance feature of the reflectance image. The evaluation device may be configured to perform at least one image analysis and / or image processing to identify the reflectance feature. The image analysis and / or image processing may use at least one feature detection algorithm. The image analysis and / or image processing may include one or more of: filtering; selecting at least one region of interest; forming a difference image between an image generated by the sensor signal and at least one offset; inverting the sensor signal by inverting the image generated by the sensor signal; forming a difference image between images generated by the sensor signal at different times; background correction; decomposition into color channels; decomposition into hue; saturation; and luminance channels; frequency decomposition; singular value decomposition; applying a Canny edge detector; applying a Laplacian of Gaussian filters; applying a difference of Gaussian filters; applying a Sobel operator; applying a Laplace operator; applying a Scharr operator; applying a Prewitt operator; applying a Roberts operator; applying a Kirsch operator; applying a high pass filter; applying a low pass filter; applying a Fourier transform; applying a Radon transform; applying a Hough transform; applying a wavelet transform; thresholding; creating a binary image. The region of interest may be determined manually by a user or automatically, such as by recognizing an object in the image generated by the optical sensor.
[0056] As used herein, the term "assigning said reflection feature to one of the VCSELs of the array" refers to a particularly unambiguous determination of one of the VCSELs of the array that emitted an illumination feature that caused a selected reflection feature. In known 3D sensing devices, such as devices using triangulation or structured light techniques, solving this correspondence problem is complex and time-consuming. The present invention proposes to use a characteristic, particularly distinguishable, beam profile for the illumination feature and thus for the reflection feature, so that it is possible to immediately, easily and unambiguously identify one of the VCSELs of the array that emitted an illumination feature that caused a selected reflection feature.
[0057] The detector may be configured to determine at least one distance information of the object using triangulation techniques and / or depth from photon ratio techniques and / or depth from focus and / or depth from defocus.
[0058] The evaluation device evaluates a combined signal Q from the sensor signals of the sensor elements to determine at least one vertical coordinate z of a selected reflection feature of the reflection image. DPR The term "combined signal Q" as used herein refers to a signal that is generated by combining the sensor signals, in particular by one or more of dividing the sensor signals, dividing a multiple of the sensor signals, or dividing a linear combination of the sensor signals. The evaluation device may be configured to derive the combined signal Q by one or more of dividing the sensor signals, dividing a multiple of the sensor signals, or dividing a linear combination of the sensor signals. The evaluation device may combine the combined signal Q and the vertical coordinate z to determine the vertical coordinate. DPR For example, the evaluation unit may be configured to derive the combined signal Q as follows:
[0059]
number
[0060] where x and y are horizontal coordinates, A1 and A2 are the different areas of at least one beam profile of the reflected light beam at the sensor location, E(x, y, z o ) is the object distance z o The area A1 and the area A2 may be different. In particular, A1 and A2 are not congruent. Thus, A1 and A2 may differ in one or more of their shapes or contents. In general, the beam profile is given by the luminance L(z o ) and beam shape S(x,y;z o), where E(x,y;zo)=L·S. Thus, by deriving the combined signal, it is possible to determine the ordinate coordinate independent of the luminance. Furthermore, by using the combined signal, it is possible to determine the distance z0 independently of the size of the object. In this way, the combined signal makes it possible to determine the distance z0 independently of the material properties and / or the reflecting and / or scattering properties of the object and independently of changes in the light source due to, for example, manufacturing inaccuracies, heat, moisture, dirt, lens damage, etc.
[0061] Each of the sensor signals may include at least one information of at least one area of the beam profile of the light beam. The term "area of the beam profile" as used herein generally refers to any region of the beam profile at the sensor location used to determine the combined signal Q. The light sensitive areas may be arranged such that the first sensor signal includes information of the first area of the beam profile and the second sensor signal includes information of the second area of the beam profile. The first area of the beam profile and the second area of the beam profile may be one or both of adjacent or overlapping areas. The first area of the beam profile and the second area of the beam profile may not exactly match in area.
[0062] The evaluation device may be configured to determine and / or select a first area of the beam profile and a second area of the beam profile. The first area of the beam profile may include substantially edge information of the beam profile and the second area of the beam profile may include substantially central information of the beam profile. The beam profile may have a center, i.e. a maximum of the beam profile and / or a central point of the plateau of the beam profile and / or a geometric center of the light spot, and a falling edge extending from the center. The second area may include an inner area of the cross section and the first area may include an outer area of the cross section. As used herein, the term "substantially central information" generally refers to a low percentage of edge information, i.e. a low percentage of the intensity distribution corresponding to the edge, compared to the percentage of central information, i.e. a percentage of the intensity distribution corresponding to the center. Preferably, the central information has a percentage of edge information of less than 10%, more preferably less than 5%, and most preferably the central information does not include edge content. As used herein, the term "substantially edge information" generally refers to a low percentage of central information, compared to the percentage of edge information. The edge information may include information of the entire beam profile, in particular information from the central and edge areas. The edge information has a percentage of center information less than 10%, preferably less than 5%, and more preferably the edge information does not include center information. If the beam profile is close to or around the center and substantially includes center information, at least one area of the beam profile may be determined and / or selected as the second area of the beam profile. If the beam profile includes at least a portion of the falling edge of the cross section, at least one area of the beam profile may be determined and / or selected as the first area of the beam profile. For example, the entire area of the cross section may be determined as the first area. The first area of the beam profile may be area A2 and the second area of the beam profile may be area A1.
[0063] Other choices of the first area A1 and the second area A2 may be possible. For example, the first area may substantially include the outer area of the beam profile and the second area may substantially include the inner area of the beam profile. For example, in case of a two-dimensional beam profile, the beam profile may be divided into a left part and a right part, and the first area may substantially include the area of the left part of the beam profile and the second area may substantially include the area of the right part of the beam profile.
[0064] The edge information may include information on the number of photons in a first area of the beam profile, and the center information may include information on the number of photons in a second area of the beam profile. The evaluation device may be configured to determine a surface integral of the beam profile. The evaluation device may be configured to determine the edge information by integration and / or summation of the first area. The evaluation device may be configured to determine the center information by integration and / or summation of the second area. For example, the beam profile may be a trapezoidal beam profile and the evaluation device may be configured to determine the integral value of the trapezoid. Furthermore, if a trapezoidal beam profile is assumed, the determination of the edge and center signals may be replaced by an equivalent evaluation that utilizes properties of the trapezoidal beam profile, such as the slope and position of the edges as well as the determination of the height of the central plateau, and derives the edge and center signals by geometrical considerations.
[0065] Additionally or alternatively, the evaluation device may be configured to determine one or both of the center and edge information from at least one slice or cut of the light spot. This can be achieved, for example, by replacing the surface integral of the combined signal Q with a line integral along the slice or cut. To improve accuracy, multiple slices or cuts through the light spot may be used for averaging. In case of an elliptical spot profile, improved distance information may be obtained by averaging over multiple slices or cuts.
[0066] The evaluation device may be configured to derive the combined signal Q by one or more of the following: a division of the edge information and the center information, a division of a multiple of the edge information and the center information, a division of a linear combination of the edge information and the center information. Thus, essentially, a photon ratio can be used as the physical basis of the method.
[0067] For example, the evaluation device a) determining at least one optical sensor having a highest sensor signal and forming at least one center signal; b) evaluating the sensor signals of the light sensors of the matrix and forming at least one sum signal; c) determining at least one combined signal by combining the center signal and the sum signal; and d) determining a vertical coordinate z of at least one of the selected features by evaluating the combined signal; The sensor signal may be evaluated by
[0068] Typically, as explained for example in WO2012 / 110924A1 or WO2014 / 097181A1, there is a predetermined or determinable relationship between the size of the light spot, such as the diameter, beam waist or equivalent diameter of the light spot, and the longitudinal coordinate of the object through which the light beam propagates towards the detector. Without wishing to be bound by this theory, the light spot is characterized by two measurement variables: a measurement signal, also called the central signal, measured at the center of the light spot or at a small measurement patch close to the center, and an integral signal or sum signal, integrated over the light spot with or without the central signal. For a light beam with a certain total power that does not change when the beam expands or focuses, the sum signal should be independent of the spot size of the light spot and therefore independent of the distance between the object and the detector, at least when linear light sensors are used in the respective measurement ranges. However, the central signal depends on the spot size. Thus, the central signal usually increases when the light beam is focused and decreases when the light beam is defocused. Thus, by comparing the centre signal and the sum signal, an item of information can be generated regarding the size of the light spot generated by the light beam and therefore regarding the longitudinal coordinate of the object. The comparison of the centre signal and the sum signal can be carried out, by way of example, by forming a combined signal Q from the centre signal and the sum signal and by using a predetermined or determinable relationship between the longitudinal coordinate and the quotient signal to derive the longitudinal coordinate.
[0069] The use of a matrix of optical sensors offers several advantages and benefits. Thus, the center of the light spot generated by the light beam on the sensor elements, such as the common plane of the light-sensitive areas of the optical sensors of the matrix of sensor elements, may vary depending on the lateral position of the object. By using a matrix of optical sensors, the detector according to the invention is able to adapt to these changes in conditions and thus determine the center of the light spot simply by comparing the sensor signals. As a result, the detector according to the invention is able to select itself a center signal, determine a sum signal and derive from these two signals a combined signal which contains information about the longitudinal coordinate of the object. By evaluating the combined signal, the longitudinal coordinate of the object can thus be determined. The use of a matrix of optical sensors therefore offers great flexibility with regard to the position of the object, in particular the lateral position of the object.
[0070] The lateral position of the light spot on the matrix of light sensors, such as the lateral position of at least one light sensor generating a sensor signal, may be used as an additional item of information from which at least one item of information regarding the lateral position of the object is derived, as for example disclosed in WO 2014 / 198629 A1. Additionally or alternatively, as outlined in more detail below, the detector according to the invention may comprise at least one additional lateral detector for detecting at least one lateral coordinate of the object in addition to the at least one longitudinal coordinate.
[0071] Thus, according to the present invention, the term "central signal" generally refers to at least one sensor signal that contains substantially central information of the beam profile. For example, the central signal may be the signal of at least one optical sensor with the highest sensor signal among a plurality of sensor signals generated by optical sensors of the entire matrix or an area of interest in the matrix, the area of interest may be predetermined or determinable in the image generated by the optical sensors of the matrix. As used herein, the term "highest sensor signal" refers to one or both of the local maxima or maxima of the area of interest. The central signal may originate from a single optical sensor or from a group of optical sensors, as outlined in more detail below, in the latter case, by way of example, the sensor signals of the group of optical sensors may be added, integrated or averaged to determine the central signal. The group of optical sensors from which the central signal originates may be a group of adjacent optical sensors, such as optical sensors that are less than a predetermined distance away from the actual optical sensor with the highest sensor signal, or may be a group of optical sensors that generate sensor signals that are within a predetermined range from the highest sensor signal. The group of optical sensors from which the central signal originates may be selected as large as possible to allow for a maximum dynamic range. The evaluation device may be configured to determine the central signal by integrating a plurality of sensor signals, for example the sensor signals of a plurality of light sensors around a light sensor having a highest sensor signal. For example, the beam profile may be a trapezoidal beam profile and the evaluation device may be configured to determine the integral of the trapezoid, in particular the plateau of the trapezoid.
[0072] As mentioned above, the center signal may generally be a single sensor signal, such as a sensor signal from a light sensor at the center of the light spot, or may be a combination of multiple sensor signals, such as a combination of sensor signals arising from light sensors at the center of the light spot, or may be a secondary sensor signal derived by processing sensor signals derived from one or more of the aforementioned possibilities. The determination of the center signal may be performed electronically, as comparison of sensor signals is fairly easily performed by conventional electronics, or may be performed fully or partially by software. Specifically, the center signal may be selected from the group consisting of: the highest sensor signal; an average of a group of sensor signals that are within a predetermined tolerance from the highest sensor signal; an average of sensor signals from a group of light sensors including the light sensor with the highest sensor signal and a predetermined group of adjacent light sensors; a sum of sensor signals from a group of light sensors including the light sensor with the highest sensor signal and a predetermined group of adjacent light sensors; a sum of a group of sensor signals that are within a predetermined tolerance from the highest sensor signal; an average of a group of sensor signals that exceed a predetermined threshold; a sum of a group of sensor signals that exceed a predetermined threshold; an integral of sensor signals from a group of light sensors with the highest sensor signal and a predetermined group of adjacent light sensors; an integral of a group of sensor signals that are within a predetermined tolerance from the highest sensor signal; an integral of a group of sensor signals that exceed a predetermined threshold.
[0073] Similarly, the term "sum signal" generally refers to a signal that includes substantially edge information of the beam profile. For example, the sum signal can be derived by adding sensor signals, integrating sensor signals, or averaging sensor signals of the entire matrix or of a region of interest in the matrix, the region of interest being pre-determined or determinable in the image generated by the optical sensors of the matrix. When adding, integrating, or averaging sensor signals, the actual optical sensors at which the sensor signals are generated may be excluded from the summation, integration, or averaging, or may be included in the summation, integration, or averaging. The evaluation device may be configured to determine the sum signal by integrating the signals of the entire matrix or of the region of interest in the matrix. For example, the beam profile may be a trapezoidal beam profile, and the evaluation device may be configured to determine the integral of the entire trapezoid. Furthermore, when a trapezoidal beam profile is assumed, the determination of the edge and center signals may be replaced by an equivalent evaluation that utilizes the properties of the trapezoidal beam profile, such as determining the slope and position of the edges and the height of the central plateau, and derives the edge and center signals by geometrical considerations.
[0074] Similarly, the center signal and the edge signal can also be determined by using a segment of the beam profile, such as a circular segment of the beam profile. For example, the beam profile can be divided into two segments by a secant or chord that does not pass through the center of the beam profile. Thus, one segment substantially contains edge information and the other segment substantially contains center information. For example, the edge signal can be further subtracted from the center signal to further reduce the amount of edge information in the center signal.
[0075] Additionally or alternatively, the evaluation device may be configured to determine one or both of center and edge information from at least one slice or cut of the light spot. This may be achieved, for example, by replacing the surface integral of the combined signal Q with a line integral along the slice or cut. To improve accuracy, several slices or cuts through the light spot may be used for averaging. In case of an elliptical spot profile, averaging several slices or cuts may improve the distance information.
[0076] The combined signal may be a signal generated by combining the center signal and the sum signal. In particular, the combining may include one or more of: forming a quotient of the center signal and the sum signal, or forming the inverse quotient; forming a quotient of a multiple of the center signal and a multiple of the sum signal, or forming the inverse quotient; forming a quotient of a linear combination of the center signal and a linear combination of the sum signal, or forming the inverse quotient. Additionally or alternatively, the combined signal may include any signal or combination of signals that includes at least one information regarding the comparison between the center signal and the sum signal.
[0077] The evaluation device uses at least one known, determinable or predetermined relationship between the sensor signals to determine at least one longitudinal coordinate z of the object. DPR In particular, the evaluation device may be configured to determine at least one coordinate z of the object using at least one known, determinable or predetermined relationship between a quotient signal derived from the sensor signals and a longitudinal coordinate. DPR The method is configured to determine:
[0078] The raw sensor signals of the optical sensors may be used for evaluation or derived secondary sensor signals. As used herein, the term "secondary sensor signal" generally refers to a signal, such as an electronic signal, more preferably an analog and / or digital signal, obtained by processing one or more raw signals, such as filtering, averaging, or demodulation. Thus, image processing algorithms may be used for the generation of the secondary sensor signal from the entirety of the sensor signals of the matrix or from an area of interest within the matrix. In particular, a detector, such as an evaluation device, may be configured to convert the sensor signals of the optical sensors and thereby generate the secondary optical sensor signal, and the evaluation device is configured to perform steps a) to d) using the secondary optical sensor signal. The transformation of the sensor signal may specifically include at least one transformation selected from the group consisting of: filtering; selection of at least one region of interest; formation of a difference image between an image generated by the sensor signal and at least one offset; inversion of the sensor signal by inverting the image generated by the sensor signal; formation of a difference image between images generated by the sensor signal at different times; background correction; decomposition into color channels; decomposition into hue; saturation; and luminance channel; frequency decomposition; singular value decomposition; application of a Canny edge detector; application of a Laplacian of Gaussian filters; application of a difference of Gaussian filters; application of a Sobel operator; application of a Laplace operator; application of a Scharr operator; application of a Prewitt operator; application of a Roberts operator; application of a Kirsch operator; application of a high pass filter; application of a low pass filter; application of a Fourier transform; application of a Radon transform; application of a Hough transform; application of a wavelet transform; thresholding; creation of a binary image. The region of interest may be determined manually by a user or automatically, such as by recognizing an object in the image generated by the optical sensor. As an example, a vehicle, a person or another type of predetermined object can be determined by automatic image recognition in the image, i.e. in the total sensor signal generated by the optical sensor, and a region of interest can be selected such that the object is located within said region of interest. In this case, an evaluation, such as determining the vertical coordinate, can be performed only for the region of interest. However, other implementations are also possible.
[0079] As outlined above, the detection of the center of the light spot, i.e. the detection of the center signal and / or of the at least one light sensor from which the center signal originates, may be fully or partially performed electronically or fully or partially performed using one or more software algorithms. In particular, the evaluation device may comprise at least one center detector for detecting the at least one highest sensor signal and / or for forming the center signal. The center detector may in particular be embodied fully or partially in software and / or fully or partially in hardware. The center detector may be fully or partially integrated in the at least one sensor element and / or fully or partially embodied independently from the sensor element.
[0080] As outlined above, the sum signal can be derived from all sensor signals of the matrix, from sensor signals within the region of interest, or from one of these possibilities, with the light sensors contributing to the central signal. In all cases, a reliable sum signal can be generated that can be reliably compared to the central signal to determine the vertical coordinate. In general, the sum signal can be selected from the group consisting of: the average of all sensor signals of the matrix; the sum of all sensor signals of the matrix; the integral of all sensor signals of the matrix; the average of all sensor signals of the matrix, excluding sensor signals from the light sensors contributing to the central signal; the sum of all sensor signals of the matrix, excluding sensor signals from the light sensors contributing to the central signal; the integral of all sensor signals of the matrix, excluding sensor signals from the light sensors contributing to the central signal; the sum of sensor signals of light sensors within a predetermined range from the light sensor with the highest sensor signal; the integral of sensor signals of light sensors within a predetermined range from the light sensor with the highest sensor signal; the sum of sensor signals that exceed a predetermined threshold of light sensors located within a predetermined range from the light sensor with the highest sensor signal; the integral of sensor signals that exceed a predetermined threshold of light sensors that are within a predetermined range from the light sensor with the highest sensor signal. However, other options exist.
[0081] The addition may be performed fully or partly in software and / or fully or partly in hardware. The addition is possible by purely electronic means, which are usually easily implemented in the detector. Thus, in the field of electronics, summing devices are generally known which add two or more electronic signals, both analog and digital signals. The evaluation device may thus comprise at least one summing device for forming a sum signal. The summing device may be fully or partly integrated in the sensor element or may be embodied fully or partly independent of the sensor element. The summing device may be embodied fully or partly in hardware or software or both.
[0082] As outlined above, the comparison between the center signal and the sum signal may in particular be performed by forming one or more quotient signals. Thus, in general, the combined signal may be a quotient signal Q derived by one or more of the following: forming a quotient of the center signal and the sum signal, or forming a quotient of the inverse; forming a quotient of a multiple of the center signal and a multiple of the sum signal, or forming a quotient of the inverse; forming a quotient of a linear combination of the center signals and a linear combination of the sum signal, or forming a quotient of the inverse; forming a quotient of the center signal and a linear combination of the sum signal and the center signal, or forming a quotient of the inverse; forming a quotient of the sum signal and a linear combination of the sum signal and the center signal, or forming a quotient of the inverse; forming a quotient of a power of the center signal and a power of the sum signal, or forming a quotient of the inverse. However, other options exist. The evaluation device may be configured to form one or more quotient signals. The evaluation device may further be configured to determine at least one vertical coordinate by evaluating at least one quotient signal.
[0083] The evaluation device in particular determines at least one vertical coordinate by combining the combined signal Q and the vertical coordinate z DPRThus, for the reasons disclosed above and due to the dependence of the properties of the light spot on the vertical coordinate, the combined signal Q is typically a monotonic function of the vertical coordinate and / or of the size of the light spot, such as the diameter or equivalent diameter of the light spot. Thus, by way of example, in particular when a linear light sensor is used, the sensor signal s center and the sum signal s sum A simple quotient of Q=s center / s sum can be a monotonically decreasing function of distance. Without wishing to be bound by theory, this is because in the preferred configuration above, the central signal s decreases with increasing distance to the light source as the amount of light reaching the detector decreases. center and the sum signal s sum This is believed to be due to the fact that both the central signal s center is that in the optical configuration used in the experiments, the light spot in the image plane increases and thus spreads over a larger area, so the sum signal s sum, which decreases more rapidly than . The quotient of the central signal and the sum signal therefore decreases continuously with an increase in the diameter of the light beam or light spot on the light-sensitive area of the light sensor of the matrix. Moreover, the quotient is usually independent of the total power of the light beam, since the total power of the light beam forms the coefficient of both the central signal and the sum sensor signal. As a result, the combined signal Q may form a secondary signal that provides a unique and unambiguous relationship between the central signal and the sum signal and between the size or diameter of the light beam. On the other hand, since the size or diameter of the light beam depends on the distance between the object through which the light beam propagates towards the detector and the detector itself, i.e., on the longitudinal coordinate of the object, there may be a unique and unambiguous relationship between the central signal and the sum signal on the one hand and the central signal and the longitudinal coordinate on the other hand. For the latter, reference may be made to one or more of the above-mentioned prior art documents, such as, for example, WO2014 / 097181A1. The predetermined relationship can be determined by analytical considerations, for example by assuming a linear combination of Gaussian light beams, and / or by empirical measurements, such as measurements of the combination signal and / or the center signal and the sum signal or secondary signals derived therefrom, as a function of the longitudinal coordinate of the object.
[0084] Thus, in general, the evaluation device can be configured to determine the vertical coordinate by evaluating the combined signal Q. This determination can be a one-step process, for example by directly combining the center signal and the sum signal to derive its vertical coordinate, or it can be a multi-step process, for example firstly deriving the combined signal from the center signal and the sum signal and secondly deriving the vertical coordinate from the combined signal. Both options are intended to be included in the present invention, i.e. the option where steps c) and d) are separate and independent steps and the option where steps c) and d) are fully or partly combined.
[0085] The evaluation device may be configured to use at least one predefined relationship between the combined signal and the vertical coordinate. The predefined relationship may be one or more of an empirical relationship, a semi-empirical relationship, and an analytically derived relationship. The evaluation device may comprise at least one data storage device for storing the predefined relationship, such as, for example, a look-up list or a look-up table.
[0086] The combined signal Q may be determined using various means. As an example, software means for deriving a quotient signal, hardware means for deriving a quotient signal, or both may be used and may be implemented in the evaluation device. The evaluation device may thus include, as an example, at least one divider, where the divider is configured to derive the quotient signal. The divider may be embodied, fully or partially, as one or both of a software divider or a hardware divider. The divider may be embodied, fully or partially, in the response of the sensor element or fully or partially independent of the sensor element.
[0087] The detector may include at least one further optical element selected from the group of a transfer device, such as at least one lens and / or at least one lens system, at least one diffractive optical element. The term "transfer device", also called "transfer system", may generally refer to one or more optical elements configured to modify a light beam, such as by modifying one or more of the beam parameters of the light beam, the width of the light beam, or the direction of the light beam. The transfer device may be configured to direct the light beam to the optical sensor. The transfer device may specifically include one or more of: at least one lens, for example at least one lens selected from the group consisting of at least one adjustable focus lens, at least one aspheric lens, at least one spherical lens, at least one Fresnel lens; at least one diffractive optical element; at least one concave mirror; at least one beam deflection element, preferably at least one mirror; at least one beam splitting element, preferably at least one of a beam splitting cube or a beam splitting mirror; at least one multi-lens system. As used herein, the term "focal length" of a transfer device refers to the distance at which the incident parallel light beams that may impinge on the transfer device are focused to a "focus", also called a "focal point". The focal length therefore constitutes an indication of the transfer device's ability to converge the incident light beam. The transfer device may therefore include one or more imaging elements that may have the effect of a focusing lens. By way of example, the transfer device may have one or more lenses, in particular one or more refractive lenses, and / or one or more convex mirrors. In this example, the focal length may be defined as the distance from the center of the thin refractive lens to the principal focus of the thin lens. In the case of a converging thin refractive lens, such as a convex or biconvex thin lens, the focal length may be considered positive and give the distance at which the parallel light impinging on the thin lens as a transfer device may be focused to a single spot. Furthermore, the transfer device may include at least one wavelength-selective element, for example at least one optical filter.Furthermore, the transfer device can be designed to impose a predefined beam profile on the electromagnetic radiation, for example at the location of the sensor region, in particular at the sensor area. Any of the above-mentioned embodiments of the transfer device can in principle be realised individually or in any desired combination.
[0088] The transfer device may have an optical axis. In particular, the detector and the transfer device have a common optical axis. As used herein, the term "optical axis of the transfer device" generally refers to an axis of mirror or rotational symmetry of a lens or lens system. The optical axis of the detector may be a line of symmetry of the optical configuration of the detector. The detector has at least one transfer device, preferably at least one transfer system with at least one lens. The transfer system may include, as an example, at least one beam path, in which the elements of the transfer system in the beam path are arranged rotationally symmetrically with respect to the optical axis. Furthermore, one or more optical elements arranged in the beam path may be off-centered or tilted with respect to the optical axis. However, in this case, the optical axis may be defined in turn by interconnecting the centers of the optical elements in the beam path, for example by interconnecting the centers of the lenses, and in this context the optical sensor is not considered as an optical element. The optical axis may generally denote a beam path, in which the detector may have a single beam path along which the light beam travels from the object to the optical sensor, or may have multiple beam paths. By way of example, a single beam path may be provided or the beam path may be divided into two or more partial beam paths. In the latter case, each partial beam path may have its own optical axis. The light sensors may be arranged in one and the same beam path or partial beam paths. Alternatively, however, the light sensors may also be arranged in different partial beam paths.
[0089] The transfer device may configure a coordinate system where the longitudinal coordinate l is the coordinate along the optical axis and d is the spatial offset from the optical axis. The coordinate system may be a polar coordinate system where the optical axis of the transfer device forms the z-axis and the distance and polar angle from the z-axis may be used as additional coordinates. Directions parallel or anti-parallel to the z-axis may be considered as longitudinal directions and coordinates along the z-axis may be considered as longitudinal coordinates z. Any direction perpendicular to the z-axis may be considered as transverse directions and the polar coordinates and / or polar angles may be considered as transverse coordinates.
[0090] As further used herein, the term "evaluation device" generally refers to any device configured to perform the recited operations, preferably by using at least one data processing device, more preferably by using at least one processor and / or at least one application specific integrated circuit. Thus, by way of example, at least one evaluation device may include at least one data processing device having software code stored thereon that includes a number of computer commands. The evaluation device may provide one or more hardware elements for performing one or more of the recited operations and / or may provide one or more processors having software executing thereon for performing one or more of the recited operations.
[0091] The above-mentioned operations, including determining at least one longitudinal coordinate of the object, are performed by at least one evaluation device. Thus, by way of example, one or more of the above-mentioned relations may be implemented in software and / or hardware, for example by implementing one or more look-up tables. Thus, by way of example, the evaluation device may comprise one or more programmable devices, such as one or more computers, application specific integrated circuits (ASICs), digital signal processors (DSPs), or field programmable gate arrays (FPGAs), configured to perform the above-mentioned evaluations to determine at least one longitudinal coordinate of the object. However, additionally or alternatively, the evaluation device may also be embodied fully or partially by hardware.
[0092] As mentioned above, by evaluating the central signal and the sum signal, the detector may enable the determination of at least one longitudinal coordinate of the object, including the option of determining the longitudinal coordinate of the entire object or of one or more parts of the object. In addition, however, other coordinates of the object, including one or more lateral and / or rotational coordinates, may be determined by the detector, in particular the evaluation device. Thus, by way of example, one or more lateral sensors may be used to determine at least one lateral coordinate of the object. As mentioned above, the position of at least one optical sensor at which the central signal occurs may provide information about at least one lateral coordinate of the object, where, by way of example, a simple lens equation may be used for the optical transformation and the derivation of the lateral coordinate. Additionally or alternatively, one or more additional lateral sensors may be used and may be included by the detector. Various lateral sensors, for example those disclosed in WO2014 / 097181A1 and / or other position sensing devices (PSDs), such as, for example, quadrant diodes, CCD or CMOS chips, are generally known in the art. Additionally or alternatively, by way of example, the detector according to the invention may comprise one or more PSDs as disclosed in RAStreet (ed.): Technology and Applications of Amorphous Silicon, Springer-Verlag Heidelberg, 2010, pp. 346-349. Other embodiments are possible. These devices may generally be implemented in the detector according to the invention. By way of example, a part of the light beam may be split in the detector by at least one beam splitting element. The split part may be guided towards a lateral sensor, such as, by way of example, a CCD or CMOS chip or a camera sensor, and a lateral position of a light spot generated by the split part on the lateral sensor may be determined, thereby determining at least one lateral coordinate of the object. The detector according to the invention may thus be a one-dimensional detector, such as a simple distance measuring device, or may be embodied as a two-dimensional detector or even as a three-dimensional detector. Also, a three-dimensional image may be generated by scanning a scene or environment one-dimensionally, as described above or in more detail below.The detector according to the invention may therefore in particular be one of a one-dimensional detector, a two-dimensional detector or a three-dimensional detector. The evaluation device may further be configured to determine at least one lateral coordinate x,y of the object. The evaluation device may be configured to combine the information of the lateral coordinate and the lateral coordinate to determine the position of the object in space.
[0093] Additionally or alternatively, a depth from photon ratio technique may be used to obtain the vertical coordinate z DPR To determine , the evaluation device may be configured to select at least one reflection feature of the reflection image and assign said reflection feature to a corresponding VCSEL. The evaluation device may be configured to determine at least one vertical coordinate z triang Additionally, depth from focus or defocus methods can be applied as well. As described in Subbaro, M. and Gopal, S., Depth from Defocus: A Spatial Domain Approach, International Journal of Computer Vision, 13, 3, 271-294, 1994, a focus measurement, typically some kind of high pass filter or a high contrast search algorithm, is used to determine the focus maximum.
[0094] The detector may further include one or more additional elements, such as one or more additional optical elements. Further, the detector may be fully or partially integrated into at least one housing.
[0095] In a further aspect, the present invention discloses a method for determining the position of at least one object by using a detector, such as a detector according to the present invention, such as according to one or more embodiments referring to a detector as disclosed above or as disclosed in more detail below. Nevertheless, other types of detectors can be used. The method comprises the following method steps, where the method steps may be performed in a given order or in a different order. Furthermore, there may be one or more additional method steps not listed. Furthermore, one, more than one or even all of the method steps may be performed repeatedly.
[0096] The method comprises the following method steps: - illuminating the object with at least one illumination pattern generated by at least one projector of the detector; - determining at least one reflected image using at least one sensor element having a matrix of light sensors, each having a light-sensitive area, each light sensor designed to generate at least one sensor signal in response to illumination of the respective light-sensitive area by a reflected light beam propagating from the object to the detector; - selecting at least one reflective feature of the reflective image and assigning the reflective feature of the reflective image to one of the VCSELs of the array; Includes.
[0097] For details, options and definitions, reference can be made to the detectors mentioned above. Thus, in particular, as explained above, the method comprises using a detector according to the invention, such as according to one or more embodiments given above or in more detail below.
[0098] The method further comprises: evaluating a combined signal Q from the sensor signals of the sensor elements to determine a vertical coordinate z of at least one selected reflection feature of the reflection image; DPRThe combined signal Q may be derived by one or more of dividing the sensor signals, dividing a multiple of the sensor signals, or dividing a linear combination of the sensor signals. DPR is the combined signal Q and the vertical coordinate z DPR The at least one predetermined relationship between the
[0099] The method further comprises: determining a vertical coordinate z of a selected reflection feature of a reflection image; triang The selected reflection characteristic may be assigned to a corresponding VCSEL. triang may be determined using at least one triangulation method. Additionally, depth from focus or defocus methods can be applied as well. A focus measurement, typically some kind of high pass filter or a high contrast search algorithm, is used to determine the focus maximum, as described in Subbaro, M. and Gopal, S., Depth from Defocus: A Spatial Domain Approach, International Journal of Computer Vision, 13, 3, 271-294, 1994.
[0100] In a further aspect of the present invention, the use of a detector according to the present invention, such as according to one or more embodiments given above or in more detail below, is proposed for use purposes selected from the group consisting of: localization in traffic technology; entertainment applications; security applications; surveillance applications; safety applications; human-machine interface applications; tracking applications; photography applications; imaging or camera applications; mapping applications for generating a map of at least one space; homing or tracking beacon detectors for vehicles; outdoor applications; mobile applications; communication applications; machine vision applications; robotics applications; quality control applications; manufacturing applications; pedestrian monitoring applications; human body monitoring applications; home care; smart living.
[0101] Regarding further uses of the detectors and devices of the present invention, reference is made to WO2018 / 091649A1, WO2018 / 091638A1 and WO2018 / 091640A1, the contents of which are incorporated by reference.
[0102] Overall, in the context of the present invention, the following embodiments are considered preferred.
[0103] Embodiment 1: A projector for illuminating at least one object with at least one illumination pattern, the projector comprising at least one array of vertical cavity surface emitting lasers (VCSELs), each of the VCSELs configured to generate at least one light beam, the projector comprising at least one optical system configured to generate a characteristic beam profile for each of the light beams generated by the VCSELs of the array, the beam profiles of adjacent VCSELs of the array differing laterally and / or axially such that the light beams of the VCSELs of the array are assigned to corresponding VCSELs in three-dimensional space.
[0104] Embodiment 2: A projector according to the preceding embodiment, wherein the optical system includes at least one array of optical elements, each of the optical elements having a structured surface.
[0105] Embodiment 3: A projector according to the preceding embodiment, wherein the structured surfaces of the optical elements are different.
[0106] Embodiment 4: A projector according to any one of the preceding embodiments, wherein the optical element is a refractive optical element, preferably a refractive-diffractive hybrid element.
[0107] Embodiment 5: A projector according to any one of the preceding embodiments, wherein the beam profiles of adjacent VCSELs of the array differ by one or more of shape, orientation, and cross-section.
[0108] Embodiment 6: A projector according to any one of the preceding embodiments, wherein the optical system is configured to generate different characteristics in a lateral direction.
[0109] Embodiment 7: A projector according to any one of the preceding embodiments, wherein the optical system is configured to generate a plurality of different illumination patterns in an axial direction.
[0110] Embodiment 8: A projector according to the preceding embodiment, wherein the optical system is configured to focus the different illumination patterns of each VCSEL to different depths of field.
[0111] Embodiment 9: A projector according to any one of the preceding embodiments, wherein the VCSEL is configured to emit light in the wavelength range of 800-1000 nm, preferably 940 nm.
[0112] Embodiment 10: A projector according to any one of the preceding embodiments, wherein the array of VCSELs is a two-dimensional or one-dimensional array, the array including up to 2500 VCSELs.
[0113] Embodiment 11: A detector for determining a position of at least one object, comprising: - at least one projector for illuminating the object with at least one illumination pattern according to any one of the preceding embodiments; - at least one sensor element having a matrix of light sensors, each of the light sensors having a light-sensitive area, each of the light sensors designed to generate at least one sensor signal in response to illumination of the respective light-sensitive area by a reflected light beam propagating from the object to the detector, the sensor element being configured to determine at least one reflected image; - at least one evaluation device, the evaluation device being configured to select at least one reflection feature of the reflection image and to assign the reflection feature to one of the VCSELs of the array; and The detector comprises:
[0114]
[0033] Embodiment 12: The evaluation device is adapted to evaluate a combined signal Q from the sensor signals of the sensor elements to determine at least one vertical coordinate z of the selected reflection feature of the reflection image. DPR and the evaluation device is configured to derive the combined signal Q by one or more of dividing the sensor signals, dividing a multiple of the sensor signals, or dividing a linear combination of the sensor signals, and the evaluation device is configured to combine the combined signal Q and the vertical coordinate z to determine the vertical coordinate. DPR 4. A detector according to the preceding embodiment, configured to use at least one predetermined relationship between:
[0115]
[0033] Embodiment 13: The evaluation device is configured to select at least one of the reflection features of the reflection image and assign the reflection feature to a corresponding VCSEL, the evaluation device being configured to select at least one vertical coordinate z using at least one triangulation method. triang 4. A detector according to any one of the preceding embodiments, wherein the detector is configured to determine:
[0116] Embodiment 14: A method for determining a position of at least one object by using at least one detector according to any one of the preceding embodiments referring to a detector, comprising: Method steps as below: - illuminating said object with at least one illumination pattern generated by at least one projector of said detector; - determining at least one reflected image by using at least one sensor element having a matrix of light sensors, each light sensor having a light-sensitive area, each light sensor designed to generate at least one sensor signal in response to illumination of the respective light-sensitive area by a reflected light beam propagating from the object to the detector; - selecting at least one reflective feature of the reflective image and assigning the reflective feature of the reflective image to one of the VCSELs of the array; A method comprising:
[0117] Embodiment 15: The method further comprises: evaluating a combined signal Q from the sensor signals of the sensor elements to determine a vertical coordinate z of at least one of the selected reflection features of the reflection image. DPR wherein the combined signal Q is derived by one or more of dividing the sensor signals, dividing a multiple of the sensor signals, or dividing a linear combination of the sensor signals, and the combined signal Q is determined by the vertical coordinate z DPR is the combination signal Q and the vertical coordinate z DPR 4. The method according to the preceding embodiment, wherein the at least one predetermined relationship between the
[0118]
[0023] Embodiment 16: The method further comprises: assigning the selected reflective feature to a corresponding VCSEL; and determining at least one vertical coordinate z using at least one triangulation method. triang 3. The method of any one of the preceding two embodiments, further comprising:
[0119] Embodiment 17: Use of a detector according to any one of the preceding embodiments referring to a detector, wherein the purpose of use is selected from the group consisting of: position measurement in traffic technology; entertainment applications; security applications; surveillance applications; safety applications; human-machine interface applications; logistics applications; tracking applications; outdoor applications; mobile applications; communication applications; photography applications; machine vision applications; robotics applications; quality control applications; manufacturing applications; pedestrian monitoring applications; human body monitoring applications; home care; and smart living. [Brief description of the drawings]
[0120] Further optional details and features of the invention are evident from the following description of preferred exemplary embodiments in conjunction with the dependent claims. In this context, certain features may be implemented individually or in combination with other features. The invention is not limited to the exemplary embodiments. The exemplary embodiments are illustrated diagrammatically in the figures. Identical references in the individual figures refer to identical elements or elements with identical functions or elements which correspond to each other in terms of their functions.
[0121] Specifically, in the following diagram: [Figure 1] FIG. 1 illustrates an embodiment of a projector according to the present invention. [Diagram 2] FIG. 2 shows an embodiment of a detector according to the present invention. [Diagram 3] FIG. 1 illustrates a further embodiment of a projector. [Figure 4] FIG. 13 shows a further embodiment of a detector. [Diagram 5] FIG. 1 illustrates a further embodiment of a projector. [Figure 6] FIG. 1 illustrates a further embodiment of a projector. [Figure 7] FIG. 1 illustrates a further embodiment of a projector. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0122] 1 very diagrammatically illustrates a first embodiment of a projector 110 for illuminating at least one object 112 with at least one illumination pattern 114. The illumination pattern 114 may include a plurality of features 116. The illumination pattern 114 may include a periodic or non-periodic arrangement of features. The illumination pattern 114 may include at least one pattern selected from the group consisting of: at least one point pattern, in particular a pseudo-random point pattern; a random point pattern or a quasi-random pattern; at least one Sobol pattern; at least one quasi-periodic pattern; at least one pattern including at least one known feature; at least one regular pattern; at least one triangular pattern; at least one hexagonal pattern; at least one rectangular pattern; at least one pattern including a convex uniform tiling; at least one line pattern including at least one line; at least one line pattern including at least two lines, such as parallel or intersecting lines. For example, the projector 110 may be configured to generate and / or project a point cloud or a non-point-like feature. For example, the projector 110 may be configured to generate a point cloud or non-point features such that the illumination pattern 114 may include a plurality of point features or non-point features. The illumination pattern 114 may include a regular and / or regular and / or periodic pattern, such as a triangular pattern, a rectangular pattern, a hexagonal pattern, or a pattern including further convex tiling. The illumination pattern may include as many features per area as possible, such that a hexagonal pattern is preferred. The distance between two features of each illumination pattern 114 and / or the area of at least one illumination feature may depend on the circle of confusion of the image determined by at least one detector, as described below.
[0123] The projector 110 includes at least one array 118 of vertical cavity surface emitting lasers (VCSELs) 120. Each of the VCSELs 120 is configured to generate at least one light beam. The VCSELs 120 can be configured to emit light beams in the wavelength range of 800-1000 nm. For example, the VCSELs 120 may be configured to emit light beams at 808 nm, 850 nm, 940 nm, or 980 nm. Preferably, the VCSELs 120 emit light at 940 nm because terrestrial solar radiation has a local minimum of irradiance at this wavelength, as described, for example, in CIE 085-1989 "Solar Spectral Irradiance".
[0124] The array 118 of VCSELs 120 may be a two-dimensional or one-dimensional array. The array 118 of VCSELs 120 may include a plurality of VCSELs 120 arranged in a matrix. The matrix may be or may include a rectangular matrix, specifically having one or more rows and one or more columns. The rows and columns may be specifically arranged in a rectangular manner. However, it is explained that other arrangements are possible, such as non-rectangular arrangements. As an example, a circular arrangement is also possible, where the elements are arranged in concentric circles or ellipses around a center point. For example, the matrix may be a single row of pixels. Other arrangements are also possible. The VCSELs 120 may be arranged on a common substrate or on different substrates. The array 118 may include up to 2500 VCSELs. For example, the array 118 may include 38×25 VCSELs 120, such as a high-power array at 3.5 W. For example, the array 118 may include 10×27 VCSELs 120 at 2.5 W. For example, the array 118 may include 96 VCSELs 120 of 0.9 W. The size of the array 118, for example a 2500 element array, may be up to 2 mm by 2 mm.
[0125] The array 118 of VCSELs 120 can have high radiant power compared to light emitting diodes (LEDs). Additionally, the VCSELs 120 can have higher spatial and temporal coherence compared to LEDs. This can allow for improved beam profile shaping and / or modification by the optical system, resulting in increased spectral power density.
[0126] The projector 110 includes at least one optical system 122 configured to generate a characteristic beam profile for each of the light beams generated by the VCSELs 120 of the array 118. The optical system 122 may include at least one array of optical elements 124. The array of optical elements 124 may include a plurality of optical elements 124 arranged in a matrix. The matrix of optical elements may specifically be or include a rectangular matrix having one or more rows and one or more columns. The rows and columns may specifically be arranged in a rectangular manner. However, it is explained that other arrangements are also possible, such as non-rectangular arrangements. As an example, a circular arrangement is also possible, where the elements are arranged in concentric circles or ellipses around a central point. For example, the matrix may be a single row of pixels. Other arrangements are also possible.
[0127] The beam profile may be the transverse intensity profile of the light beam. The beam profile may be the cross-section of the light beam. The beam profile may be selected from the group consisting of a trapezoidal beam profile; a triangular beam profile; a linear combination of a conical beam profile and a Gaussian beam profile. However, other embodiments are possible. The beam profiles of adjacent VCSELs of the array are different in the transverse and / or axial direction. The axial direction may be a direction along the optical axis 126 of the optical system 122, in particular the vertical direction. The optical axis 126 may be a line of symmetry of the optical configuration of the optical system 122. The transverse direction may be a direction perpendicular to the axial direction, in particular the horizontal direction. The beam profiles of the VCSELs 120 of the array 118, in particular the beam profiles of adjacent VCSELs of the array, may differ in one or more of the following: shape, orientation, cross-section. The different beam profiles allow for the allocation of the light beams generated by the VCSELs 120 of the array 118 to the corresponding VCSELs. From the shape of the light beam it is possible to determine which VCSEL 120 of the array 118 generated the light beam, especially if the shapes of adjacent light beams are different. For example, the light beams may differ in shape and orientation. Preferably, the difference in the beam profiles is as large as possible to allow easy allocation. The allocation may be easiest if the beam profiles of all VCSELs 120 of the array 118 differ in shape, orientation and cross-section. However, it may be sufficient if the beam profiles of adjacent light beams differ in at least one parameter.
[0128] Each of the optical elements 124 may have a structured surface 128. The structured surfaces 128 of the optical elements 124 may be different. In particular, the structured surfaces 128 of two adjacent optical elements of the array may be different. The optical elements 124 may be manufactured or produced using three-dimensional holographic lithography as described by J. Gavin in Optics Letters, Vol. 36 (2011), Nr. 13, 2495-2497.
[0129] The optical elements 124 may each be or include at least one lens with a structured surface 128, in particular with individual printed and / or embossed structures. However, other manufacturing techniques such as molding or injection molding are also possible. The structured surface 128 may result in that the light beam impinging on the optical element is adjusted to have a non-pointy or non-speckled beam profile. The optical elements 124 may be refractive optical elements. Preferably, the optical elements 124 may be refractive-diffractive hybrid elements. The refractive elements and / or refractive structures may have a radius, in particular a diameter, for example of a microlens, depending on the distance between adjacent VCSELs 120. For example, the distance may be in the range of 40 μm to 70 μm. The diameter may be similar, such as 40 μm. However, the diameter may be more strongly dependent on the optical properties and the refractive index. Diffractive elements and / or diffractive structures may be advantageous because they can be manufactured very flat. The diffractive elements may each have at least one base plate, also called substrate. The base plate may be a glass base plate. The base plate may have a thickness of 1 mm. The refractive element and / or the refractive structure may be:
number
[0130] The optical element 124 may include at least one material including at least one polymer. The material may be a polymer material that may be used for two-photon stimulated polymerization, such as Nanoscribe IP-Dip, OrmoComp., Nanoscribe IP-G, Nanoscribe IP-L, Nanoscribe IP-S. For molding processes such as injection molding or hot embossing, plastics available from Zeonix (https: / / www.zeonex.com / optics.aspx.html) or Trogamid myCX from Evonik (https: / / www.campusplastics.com / campus / de / datasheet / TROGAMID%C2%AE+myCX+nc+(nf) / Evonik+Industries+AG / 66 / bf801790) may be used. For glass molding, several glass materials may be used, such as those listed in https: / / refractiveindex.info / ?shelf=glass&book=BK7&page=SCHOTT.
[0131] The optical element 124 may be placed as close as possible to the propagation direction of the light beam in front of the array 118 of VCSELs 120. For example, the optical element 124 may be designed as a rod lens with a high refractive index. The rod lens may be placed as close as possible to the propagation direction of the light beam in front of the array of VCSELs 120. The higher refractive index of the lens material allows the convergence angle to be small and the optical path length to be long such that the local coherence can be increased and the shaping of the light beam can be improved.
[0132] The structured surface 128 may be configured such that the cross section of the beam profile differs depending on the distance between the projector 110 and the object 112, as shown in FIG. 3. In FIG. 3, two different symbols are shown by way of example to indicate different shape features depending on the distance from the optical element 124. The propagation and change of the beam profile shape is also shown highly schematic. This can be ensured by using an optical element 124 with a certain predefined and / or predefined geometric shape. The required geometric shape can be determined using iterative wave optics calculations, shown by arrows in FIG. 3. In particular, the desired intensity distribution at different distances with respect to the optical element 124 can be used as a basis for iterative design. At least one wave optics propagation algorithm, such as Fresnel propagation or Rayleigh-Sommerfeld diffraction integral, may be used between different surfaces, e.g., the VCSEL 120, the optical element 124, the projection surface with shape 1, shown with reference number 130, and the projection surface with shape 2, shown with reference number 132. The propagation may be performed from plane to plane and back to the VCSEL 120. Since the VCSEL 120 may emit partially coherent radiation, it is possible to use mutually incoherent point sources in the simulation, which may be weighted with respect to their intensity distribution.
[0133] The optical system 122 may be configured to generate multiple illumination patterns 114 in the lateral direction. For example, the optical system 122 may be configured to generate at least two illumination features 116 with different angles relative to the optical axis 126 for each of the VCSELs 120 of the array 118. For example, this can be realized using a ray tracing routine enabled by a commercial software package from Zemax®. Additionally or alternatively, it may be possible to use an iterative approach based on at least one wave optics propagation method, such as Rayleigh-Sommerfeld, Fresnel propagation and / or Fraunhofer propagation. The iterative process can then alternate between propagation from the optical system to different lateral projected illumination patterns and back to the optical system. During the optical system update process, a number of different lateral illumination patterns can be considered, resulting in each illumination pattern contributing to the updated optical system in a certain proportion, for example, if two illumination patterns are generated with the same weight, the corresponding searched wave optics solution in each iteration step will contribute 50% to the wave optics description of the optical system. This process can be repeated until the error measure can be minimized for all projected illumination patterns. The error measure can be obtained from the difference between the desired illumination pattern and the simulated illumination pattern. The projection direction between the at least two illumination patterns should not be too large. The two patterns can be projected in the same plane. Thus, the iterative process will only take place between the optical system and the plane of the at least two desired illumination patterns. Figures 6 and 7 show further embodiments of the projector 110. In Figure 6, a lateral pattern projection of two laterally spaced patterns 114 is shown. In particular, Figure 6 shows a projection plane with patterns of different shapes. Figure 7 shows an embodiment with a lateral pattern projection of three different lateral planes.
[0134] 2 shows in a highly schematic manner a detector 134 for determining the position of at least one object 112. The detector 134 includes at least one projector 110 according to the invention, as described with respect to FIGS.
[0135] The detector 134 comprises at least one sensor element 136 with a matrix of optical sensors 138. The optical sensors 138 each have a light-sensitive area. Each optical sensor 138 is designed to generate at least one sensor signal in response to illumination of the respective light-sensitive area by a reflected light beam propagating from the object 112 to the detector 134. The sensor elements 136 are configured to determine at least one reflected image. The sensor elements 136 may be formed as an integral single device or as a combination of several devices. As outlined in more detail below, the matrix may specifically be or include a rectangular matrix having one or more rows and one or more columns. The rows and columns may specifically be arranged in a rectangular manner. However, it is explained that other arrangements are also possible, such as non-rectangular arrangements. By way of example, a circular arrangement is also possible, where the elements are arranged in concentric circles or ellipses around a central point. For example, the matrix may be a single row of pixels. Other arrangements are also possible. The light-sensitive area may specifically be located on the surface of the respective optical sensor. However, other embodiments are possible. The light sensors 138 of the matrix may in particular be equal in size, sensitivity and / or other optical, electrical and mechanical properties. The light-sensitive areas of all light sensors 138 of the matrix may in particular be arranged in a common plane, which preferably faces the object, such that a light beam propagating from the object to the detector generates a light spot on said common plane.
[0136] The light sensors 138 may in particular be or include photodetectors, preferably inorganic photodetectors, more preferably inorganic semiconductor photodetectors, most preferably silicon photodetectors. In particular, the light sensors 138 may have sensitivity in the infrared spectral range. All of the light sensors 138 of the matrix, or at least a group of the light sensors of the matrix, may in particular be identical. Groups of identical light sensors of the matrix may in particular be provided for different spectral ranges, or all light sensors may be identical with respect to their spectral sensitivity. Furthermore, the light sensors 138 may be identical with respect to size and / or their electronic or optoelectronic properties.
[0137] In particular, the light sensor 138 may be or include an inorganic photodiode having sensitivity in the infrared spectral range, preferably in the range of 780 nm to 3.0 micrometers. In particular, the light sensor 138 may be sensitive in the part of the near infrared range, particularly in the range of 700 nm to 1000 nm, where silicon photodiodes are applicable. Infrared light sensors that may be used for the light sensor may be commercially available infrared light sensors, such as, for example, infrared light sensors available under the brand name Hertzstueck® from trinamiX GmbH, D-67056 Ludwigshafen am Rhein, Germany. Thus, by way of example, the light sensor 138 may include at least one light sensor of the intrinsic photovoltaic type, more preferably at least one semiconductor photodiode selected from the group consisting of Ge photodiodes, InGaAs photodiodes, extended InGaAs photodiodes, InAs photodiodes, InSb photodiodes, and HgCdTe photodiodes. Additionally or alternatively, the light sensor 138 may include at least one light sensor of the extrinsic photovoltaic type, more preferably at least one semiconductor photodiode selected from the group consisting of Ge:Au photodiode, Ge:Hg photodiode, Ge:Cu photodiode, Ge:Zn photodiode, Si:Ga photodiode, Si:As photodiode. Additionally or alternatively, the light sensor 138 may include at least one bolometer, preferably selected from the group consisting of VO bolometers and amorphous Si bolometers.
[0138] The matrix may be made up of independent light sensors 138. The matrix may therefore be made up of inorganic photodiodes. Alternatively, however, commercially available matrices may be used, for example one or more CCD detectors, such as a CCD detector chip, and / or CMOS detectors, such as a CMOS detector chip.
[0139] The detector 134 includes at least one evaluation device 140. The evaluation device 140 is configured to select at least one reflection feature of the reflection image and assign the reflection feature to one of the VCSELs 120 of the array 118. The reflection image may include at least one reflection pattern including the reflection feature. The evaluation device 140 may be configured to perform at least one image analysis and / or image processing to identify the reflection feature. The image analysis and / or image processing may use at least one feature detection algorithm. The image analysis and / or image processing may include one or more of: filtering; selecting at least one region of interest; forming a difference image between an image generated by the sensor signal and at least one offset; inverting the sensor signal by inverting the image generated by the sensor signal; forming a difference image between images generated by the sensor signal at different times; background correction; decomposition into color channels; decomposition into hue; saturation; and luminance channels; frequency decomposition; singular value decomposition; applying a Canny edge detector; applying a Laplacian of Gaussian filters; applying a difference of Gaussian filters; applying a Sobel operator; applying a Laplace operator; applying a Scharr operator; applying a Prewitt operator; applying a Roberts operator; applying a Kirsch operator; applying a high pass filter; applying a low pass filter; applying a Fourier transform; applying a Radon transform; applying a Hough transform; applying a wavelet transform; thresholding; creating a binary image. The region of interest may be determined manually by a user or automatically, such as by recognizing an object in the image generated by the optical sensor.
[0140] The evaluation device 140 may be configured to determine in a particularly unambiguous manner which one VCSEL 120 of the array 118 emitted the illumination feature 116 that caused the selected reflection feature. In known 3D sensing devices, such as devices using triangulation or structured light techniques, solving this correspondence problem is complex and time-consuming. The present invention proposes to use a characteristic, in particular distinguishable, beam profile for the illumination feature, and thus for the reflection feature, so that it is possible to immediately, easily and unambiguously identify which one VCSEL 120 of the array 118 emitted the illumination feature that caused the selected reflection feature.
[0141] The detector 134 may be configured to determine at least one distance information of the object using triangulation and / or depth from photon ratio techniques and / or depth from focus and / or depth from defocus. For example, the evaluation unit 140 may determine at least one vertical coordinate z of a selected reflection feature of the reflection image by evaluating a combined signal Q from the sensor signals of the sensor elements 136. DPR The evaluation unit 140 may be configured to derive the combined signal Q by one or more of dividing the sensor signals, dividing a multiple of the sensor signals, or dividing a linear combination of the sensor signals. To determine the vertical coordinate, the evaluation unit 140 may combine the combined signal Q and the vertical coordinate z DPR The method may be configured to use at least one predetermined relationship between
[0142] The detector 134 may include at least one further optical element 142 selected from the group of a transfer device, such as at least one lens and / or at least one lens system, at least one diffractive optical element. The transfer device may be configured to direct the light beam to the light sensor 138. The transfer device may in particular include one or more of the following: at least one lens, for example at least one lens selected from the group consisting of at least one focusable lens, at least one aspheric lens, at least one spherical lens, at least one Fresnel lens; at least one diffractive optical element; at least one concave mirror; at least one beam deflection element, preferably at least one mirror; at least one beam splitting element, preferably at least one of a beam splitting cube or a beam splitting mirror; at least one multi-lens system. The transfer device may include one or more imaging elements, which may have the effect of a focusing lens. By way of example, the transfer device may have one or more lenses, in particular one or more refractive lenses, and / or one or more convex mirrors. In this example, the focal length may be defined as the distance from the center of the thin refractive lens to the main focus of the thin lens. In the case of a focusing thin refractive lens, such as a convex or biconvex thin lens, the focal length is considered to be positive and can give the distance at which the parallel light impinging on the thin lens as a transfer device can be focused to a single spot. Furthermore, the transfer device can include at least one wavelength-selective element, for example at least one optical filter. Furthermore, the transfer device can be designed to apply a predefined beam profile to the electromagnetic radiation, for example at the location of the sensor region, specifically at the sensor area. Any of the above-mentioned embodiments of the transfer device can in principle be realized individually or in any desired combination.
[0143] The transfer device may have an optical axis. In particular, the detector 134 and the transfer device have a common optical axis. The optical axis of the detector may be a line of symmetry of the optical configuration of the detector 134. The detector 134 has at least one transfer device, preferably at least one transfer system with at least one lens. The transfer system may, by way of example, include at least one beam path, in which the elements of the transfer system in the beam path are arranged rotationally symmetrically with respect to the optical axis. Furthermore, one or more optical elements arranged in the beam path may be off-centered or tilted with respect to the optical axis. However, in this case the optical axis may be defined in turn by interconnecting the centers of the optical elements in the beam path, for example by interconnecting the centers of the lenses, and in this context the optical sensor is not considered as an optical element. The optical axis may generally denote a beam path, in which the detector 134 may have a single beam path along which the light beam travels from the object to the optical sensor, or may have multiple beam paths. As an example, a single beam path may be provided or the beam path may be divided into two or more partial beam paths. In the latter case, each partial beam path may have its own optical axis. The light sensor 138 may be arranged in one and the same beam path or partial beam paths. Alternatively, however, the light sensors may also be arranged in different partial beam paths.
[0144] The transfer device may configure a coordinate system where the longitudinal coordinate l is the coordinate along the optical axis and d is the spatial offset from the optical axis. The coordinate system may be a polar coordinate system where the optical axis of the transfer device forms the z-axis and the distance and polar angle from the z-axis may be used as additional coordinates. Directions parallel or anti-parallel to the z-axis may be considered as longitudinal directions and coordinates along the z-axis may be considered as longitudinal coordinates z. Any direction perpendicular to the z-axis may be considered as transverse directions and the polar coordinates and / or polar angles may be considered as transverse coordinates.
[0145] 2 and 4 show an embodiment of the projector 110 in which the optical system 122 is configured to generate a number of different illumination patterns 114 in the axial direction. In Fig. 2 and Fig. 4, two object planes are shown by way of example. For the object plane close to the detector 134, three different symbols are shown indicating different features 116 of the illumination pattern. For the object plane at a greater distance from the detector 134, one feature 116 is shown by way of example, and the feature 116 changes from the object plane close to the detector 134 to the object plane at a greater distance. The optical system 122 may be configured to focus the different illumination patterns of each VCSEL to different depths of field. In particular, the optical system 122 may be configured to focus the illumination patterns 114 on different focal planes, in particular object planes, which are planes perpendicular to the optical axis 126 of the optical system 122 having different coordinates along the optical axis. The optical system 122 may be configured such that at each focal plane, only one of the illumination patterns 114 is focused, while the other illumination patterns 114 are unfocused. Also shown in FIG. 4 is an embodiment using a beam splitting device 144.
[0146] As shown in FIG. 5, the optical system 122 may be configured such that at each of the focal planes, different illumination patterns 114 are focused. The optical system 122 may include at least one device for intermediate projection of the illumination patterns. For example, for applications with a distance of several meters between the array 118 of VCSELs 120 and the object 112, the device for intermediate projection may be designed as telecentric imaging, so that the size of the features of the imaged pattern is invariant for all axial object positions. Additionally or alternatively, the imaging scale may be determined from design data or by calibration. A plurality of different illumination patterns 114 in the axial direction may make it possible to use triangulation methods and / or methods in which the detector 134 and the projector 110 are specifically aligned on a common axis. For this purpose, the detector 134 may include at least one zoom optical system and / or at least one electro-optical tunable system for traversing the measurement range. By tailoring different illumination patterns to different depths of the VCSELs 120 in the array 118, it may be possible to increase the number of distinguishable depth steps over the depth of field range of the detector 134 to the number of VCSELs 120 in the array 118. [Explanation of symbols]
[0147] 110 Projector 112 Object 114 Irradiation Pattern 116 Irradiation Characteristics 118 Array 120 VCSEL 122 Optical System 124 Optical elements 126 Optical axis 128 Structured Surface 130 Projection plane 132 Projection plane 134 Detector 136 Sensor Element 138 Optical Sensor 140 Evaluation Equipment 142 Further Optical Elements 144 Beam splitter
Claims
1. A projector (110) for illuminating at least one object (112) with at least one illumination pattern (114), the projector (110) comprising at least one array (118) of vertical cavity surface emitting lasers (VCSELs) (120), each of the VCSELs (120) configured to generate at least one light beam, the projector (110) comprising at least one optical system (122) configured to generate a characteristic beam profile for each of the light beams generated by the VCSELs (120) of the array (118), the beam profiles of adjacent VCSELs (120) of the array (118) being independent of each other. the files differ laterally and / or axially such that light beams of the VCSELs (120) of the array (118) are assigned to corresponding VCSELs (120) in three-dimensional space, the optical system (122) is configured to generate a plurality of different illumination patterns (114) in the axial direction, the optical system (122) is configured to focus the different illumination patterns of each VCSEL to different depths of field, and the optical system (122) is configured to focus the illumination patterns (114) onto different focal planes, the focal planes being planes perpendicular to an optical axis of the optical system (122) that have different coordinates along the optical axis.
2. 2. The projector of claim 1, wherein the optical system includes at least one array of optical elements, each of the optical elements having a structured surface.
3. The projector (110) of claim 2, wherein the structured surfaces (128) of the optical elements (124) are different.
4. 4. The projector (110) of claim 2 or 3, wherein the optical element (124) is a refractive optical element.
5. The projector (110) of any one of claims 1 to 4, wherein the beam profiles of adjacent VCSELs (120) of the array (118) differ by one or more of the following: shape, orientation, cross section.
6. The projector (110) of any one of claims 1 to 5, wherein the optical system (122) is configured to generate different characteristics in a lateral direction.
7. The projector (110) of any one of claims 1 to 6, wherein the VCSEL (120) is configured to emit light in the wavelength range of 800 to 1000 nm.
8. A detector (134) for determining a position of at least one object (112), comprising: at least one projector (110) for illuminating said object (112) with at least one illumination pattern (114) according to any one of claims 1 to 7; at least one sensor element (136) having a matrix of optical sensors (138), each of said optical sensors (138) having a photosensitive area, each of said optical sensors (138) designed to generate at least one sensor signal in response to illumination of the respective photosensitive area by a reflected light beam propagating from said object (112) to said detector (134), said sensor element (136) being configured to determine at least one reflected image; at least one evaluation device (140), said evaluation device (140) configured to select at least one reflection feature of said reflection image and to assign said reflection feature to one of the VCSELs (120) of the array (118); A detector (134).
9. The evaluation device (140) evaluates a combined signal Q from the sensor signals of the sensor elements (136) to determine at least one vertical coordinate z of the selected reflection feature of the reflection image. DPR and the evaluation device (140) is configured to derive the combined signal Q by one or more of dividing the sensor signals, dividing a multiple of the sensor signals, or dividing a linear combination of the sensor signals, and the evaluation device (140) is configured to determine the vertical coordinate by combining the combined signal Q and the vertical coordinate z DPR The detector (134) of claim 8, configured to use at least one predetermined relationship between:
10. The evaluation device (140) is configured to select at least one of the reflection features of the reflection image and assign the reflection feature to a corresponding VCSEL (120), and the evaluation device (140) is configured to calculate at least one vertical coordinate z using at least one triangulation method. triang The detector (134) according to claim 8 or 9, which is configured to determine:
11. A method for determining the position of at least one object (112) by using a detector (134) according to any one of claims 8 to 10 with reference to the detector, comprising: The method steps are as follows: - illuminating said object (112) with at least one illumination pattern (114) generated by at least one projector (110) of said detector (134); determining at least one reflected image by using at least one sensor element (136) having a matrix of optical sensors (138), each having a light-sensitive area, each optical sensor (138) designed to generate at least one sensor signal in response to illumination of the respective light-sensitive area by a reflected light beam propagating from the object (112) to the detector (134); - selecting at least one reflection feature of said reflection image and assigning said reflection feature of said reflection image to one of the VCSELs (120) of the array (118); A method comprising:
Citation Information
Patent Citations
Depth Mapping of Objects in Volume Using Intensity Variation of Light Pattern
JP2018508019A
Depth Mapping on Head-Mounted Display Using Stereo Camera and Structured Light
JP2018509632A
A detector for determining the position of at least one object
JP2020531849A
Overlapping pattern projector
US20160178915A1
Device for projecting structured light using vcsels and phase diffractive optical components
WO2009153446A2