Detector for identifying at least one material property

Abstract

To provide a detector for identifying at least one material property.SOLUTION: A detector 110 includes an evaluation device 132 for determining a material property m by evaluating a beam profile of a reflected image. The evaluation device is configured to determine a distance feature φ1z by applying a distance-dependent image filter Φ1 to the reflection image. The distance-dependent image filter is a filter selected from the group consisting of a depth filter from photon ratio, a depth filter from defocus, a linear combination of thereof, etc. The evaluation device is configured to determine the material property φ2m by applying a material-dependent image filter Φ2 to the reflection image. The material-dependent image filter is a filter selected from the group consisting of an intensity filter, a spot shape filter, a squared norm gradient, a standard deviation, etc. The evaluation device is configured to determine longitudinal coordinates z and the material property m by evaluating the distance feature φ1z and the material feature φ2m.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present invention relates to a detector, a detector system and a method for determining at least one material property of at least one object. The present invention further relates to various uses of human-machine interfaces, entertainment devices, tracking systems, cameras, scanning systems and detector devices for exchanging information of at least one item between a user and a machine. The devices, methods and uses according to the invention can be employed in particular in various fields, for example in everyday life, security technology, gaming, traffic technology, production technology, art, photography, such as digital photography or videography for documentary or technical purposes, security technology, information technology, agriculture, crop protection, maintenance, cosmetics, medical technology or science. However, other applications are also possible. [Background technology]

[0002] Numerous methods for material classification and identification are known from the prior art. For example, material identification can be used in machine vision applications, medical applications, security applications, for image classification purposes or in gesture recognition algorithms.

[0003] For example, US2016 / 0206216A1 describes an apparatus, system and method for skin detection, comprising a thermal sensor input for acquiring thermal sensor data of a scene, a light sensor input for acquiring light sensor data of the scene, and an evaluation unit for analyzing the acquired thermal sensor data and the acquired light sensor data and detecting a skin area in the scene based on the analysis. US2016 / 155006A1 describes an apparatus and a corresponding method for skin detection, comprising an illumination unit configured to project a predetermined illumination pattern onto the scene, an imaging unit configured to acquire an image of the scene, and an evaluation unit configured to evaluate the acquired image by analyzing the imaged illumination pattern reproduced in the image to detect a skin area in the image, and to detect and distinguish the skin area in the image from a non-skin area in the image based on the analysis.

[0004] Material classification and identification is usually performed in beam mode, i.e. by shining light through the sample and analyzing the extinction. In addition, material classification and identification can also be performed in reflection mode in a controlled environment. However, in reflection mode, wavelengths greater than 1000 nm are usually required to obtain reliable results. Thus, despite the advantages of known methods for identifying materials, new concepts are desired to reliably identify materials. Specifically, there is a strong desire to identify materials from the profile of the reflected beam. However, most image filters used for beam profile analysis (BPA) produce features that are both distance and material dependent, making it impossible to reliably identify and classify materials. A typical example is the width of the beam profile reflected from a semi-transparent material.

[0005] DE 19846619 A1 describes an apparatus for determining the appearance quality of a structured surface, which evaluates electrical measurement signals from an optical sensor array to derive a structure code which characterizes structure-dependent properties of the measured surface.

[0006] CN108363482A describes a method for controlling a smart TV through a three-dimensional gesture based on binocular structured light, which includes the steps of synchronously acquiring images by a binocular camera, reconstructing a three-dimensional image according to the acquired left and right views, performing pre-processing, recognizing a gesture action after the three-dimensional gesture is segmented, converting the recognized gesture action into an operation instruction of the smart TV, and executing the operation instruction.

[0007] US2018 / 033146A1 describes a system and method for determining a depth map and a reflectance map from a structured light image. The depth map can be determined by capturing a structured light image and then using triangulation to determine the depth map based on the dots in the captured structured light image. The reflectance map can be determined based on the depth map and on performing additional analysis of the dots in the captured structured light image. [Prior art documents] [Patent documents]

[0008] [Patent Document 1] US2016 / 0206216A1 [Patent Document 2] DE19846619A1 [Patent Document 3] CN108363482A [Patent Document 4] US2018 / 033146A1 Summary of the Invention [Problem to be solved by the invention]

[0009] It is therefore an object of the present invention to provide an apparatus and a method which address the above-mentioned technical problems of known apparatuses and methods. In particular, it is an object of the present invention to provide an apparatus and a method which are able to reliably identify at least one material property of an object, preferably with low technical effort and with low demands in terms of technical resources and costs. [Means for solving the problem]

[0010] This problem is solved by the invention with the features of the independent patent claims. Advantageous developments of the invention, which can be realized individually or in combination, are set out in the dependent claims and / or in the following description and detailed embodiments.

[0011] When used below, the terms "having", "comprises" or "including" or any grammatical variants thereof are used in a non-exclusive manner. Thus, these terms may refer both to the situation where, apart from the features introduced by these terms, no further features are present in the entity described in this context, and to the situation where one or more further features are present. As an example, the expressions "A has B", "A comprises B" and "A includes B" may refer both to the situation where no other elements are present in A apart from B (i.e., A solely and exclusively comprises B) and to the situation where, in addition to B, one or more elements are present in entity A, such as element C, elements C and D, or further elements.

[0012] Furthermore, it should be noted that the terms "at least one," "one or more," or similar language indicating that a feature or element may be present more than one time are typically used only once when introducing each feature or element. It should be noted that in most cases hereinafter, when referring to each feature or element, the language "at least one" or "one or more" will not be repeated, despite the fact that those features or elements may appear more than one time.

[0013] Furthermore, when used hereinafter, the terms "preferably", "more preferably", "particularly", "more particularly", "particularly", "more particularly" or similar terms are used in connection with any feature without limiting the possibility of alternatives. Features introduced by these terms are therefore optional features and are not intended to limit the scope of the claims in any way. The invention can be practiced with alternative features, as the skilled artisan will recognize. Similarly, features introduced by "in one embodiment of the invention" or similar expressions are intended to be optional features, without any limitation on alternative embodiments of the invention, without any limitation on the scope of the invention, and without any limitation on the possibility of combining the feature introduced in such a way with other optional or non-optional features of the invention.

[0014] In a first aspect of the present invention, a detector for identifying at least one material property m is disclosed.

[0015] As used herein, the term "material property" refers to at least one any property of a material configured for characterization and / or identification and / or classification of the material. For example, the material property may be a property selected from the group consisting of roughness, penetration depth of light into the material, a property characterizing the material as a biological or non-biological material, reflectance, specular reflectance, diffuse reflectance, surface properties, a measure of translucency, scattering, specifically backscattering behavior, and the like. The at least one material property may be a property selected from the group consisting of scattering coefficient, translucency, transparency, deviation from Lambertian surface reflectance, speckle, and the like. As used herein, the term "identifying at least one material property" refers to one or more of determining a material property, assigning a material property to an object. The detector may include at least one database including a list and / or table, such as a look-up list and / or look-up table, of predefined and / or predetermined material properties. The list and / or table of material properties can be determined and / or generated by performing at least one test measurement using the detector according to the present invention, for example by performing material testing using a sample with known material properties. The lists and / or tables of material properties can be determined and / or generated at the manufacturer site and / or by a user of the detector. The material properties may be further assigned to a material classification such as, for example, one or more of a material name, a material group such as biological or non-biological material, translucent or non-translucent material, metal or non-metal, skin or non-skin, fur or non-fur, carpet or non-carpet, reflective or non-reflective, specular or non-specular, foam or non-foam, hair or non-hair, roughness group, etc. The detector may include at least one database including lists and / or tables including material properties and associated material names and / or material groups.

[0016] In particular, the detector may be configured to detect biological tissue, in particular human skin. As used herein, the term "biological tissue" generally refers to biological material that includes living cells. The detector may be a device that performs detection, in particular optical detection, of biological tissue, in particular human skin. The term "detection of biological tissue" refers to determining and / or verifying whether an object or surface under test is or includes biological tissue, in particular human skin, and / or to distinguish biological tissue, in particular human skin, from other tissue, in particular other surfaces, and / or to distinguish different types of biological tissue, such as distinguishing different types of human tissue, such as muscle, fat, organs, etc. For example, the biological tissue may be or include human tissue or parts thereof, such as skin, hair, muscle, fat, organs, etc. For example, the biological tissue may be or include animal tissue or parts thereof, such as skin, fur, muscle, fat, organs, etc. For example, the biological tissue may be or include plant tissue or parts thereof. The detector can be adapted to distinguish animal tissue or parts thereof from one or more of inorganic tissue, metal surfaces, plastic surfaces, e.g., agricultural machinery or milking machines. The detector can be adapted to distinguish plant tissue or parts thereof from one or more of inorganic tissue, metal surfaces, plastic surfaces, e.g., agricultural machinery. The detector can be adapted to distinguish food and / or beverages from plates and / or glasses. The detector can be adapted to distinguish different types of food, e.g., fruits, meat, fish. The detector can be adapted to distinguish cosmetics and / or applied cosmetics from human skin. The detector can be adapted to distinguish human skin from foam, paper, wood, displays, screens. The detector can be adapted to distinguish human skin from fabrics. The detector can be adapted to distinguish maintenance products from materials of machine parts, e.g., metal parts. The detector can be adapted to distinguish organic from inorganic. The detector can be adapted to distinguish human living tissue from man-made or non-living surfaces. The detector may be used in particular for non-therapeutic and non-diagnostic applications.

[0017] The detector may be a fixed device or a mobile device. Furthermore, the detector may be a stand-alone device or may form part of another device, such as a computer, a vehicle, or any other device. Furthermore, the detector may be a portable device. Other embodiments of the detector are possible.

[0018] a detector for identifying at least one material characteristic m, - at least one sensor element comprising a matrix of light sensors, each of said light sensors having a light-sensitive area, said sensor element being configured to record at least one reflected image of a light beam originating from at least one object; at least one evaluation device configured to determine said material properties by evaluating at least one beam profile of said reflected images, The evaluation device derives at least one distance feature φ by applying at least one distance-dependent image filter Φ1 to the reflection image. 1z and the distance dependent image filter is configured to determine a depth filter from photon ratio; a depth filter from defocus; or a linear combination thereof; or |ρ Ф1other,Фz |≧0.40(Ф z is a further distance-dependent image filter Φ, which is correlated to the depth filter from the photon ratio and / or the depth filter from the defocus or a linear combination thereof by one of the depth filter from the photon ratio and the depth filter from the defocus or a linear combination thereof 1other At least one filter selected from the group consisting of: The evaluation device determines at least one material characteristic φ by applying at least one material-dependent image filter Φ2 to the reflection image. 2m

[0023] The method is configured to determine The evaluation device detects the distance feature φ 1z and the material characteristic φ 2man evaluation device configured to determine the vertical coordinate z and the material property m by evaluating Includes.

[0019] As used herein, the term "sensor element" generally refers to a device or a combination of devices configured to sense at least one parameter. In this case, the parameter may specifically be an optical parameter and the sensor element may specifically be an optical sensor element. The sensor element may be formed as an integral single device or as a combination of several devices. The sensor element comprises a matrix of optical sensors. The sensor element may comprise at least one CMOS sensor. The matrix may be composed of independent pixels, such as independent optical sensors. Thus, a matrix of inorganic photodiodes may be constituted. However, alternatively, commercially available matrices may be used, for example one or more CCD detectors, such as a CCD detector chip, and / or CMOS detectors, such as a CMOS detector chip. Thus, in general, the sensor element may be and / or include at least one CCD device and / or CMOS device, and / or the optical sensor may form a sensor array or be part of a sensor array, such as the matrix mentioned above. Thus, by way of example, the sensor element may comprise an array of pixels, such as a rectangular array having m rows and n columns, where m, n are independently positive integers. Preferably, two or more columns and two or more rows are provided, i.e., n>1, m>1. Thus, by way of example, n may be 2-16 or more, and m may be 2-16 or more. Preferably, the ratio of the number of rows to the number of columns is close to 1. By way of example, n and m may be selected such that 0.3≦m / n≦3, such as by selecting m / n=1:1, 4:3, 16:9 or similar. By way of example, the array may be a square array with equal numbers of rows and columns, such as by selecting m=2, n=2 or m=3, n=3, etc.

[0020] The matrix may specifically be a rectangular matrix having at least one row, preferably multiple rows and multiple columns. By way of example, the rows and columns may be oriented in a substantially perpendicular direction. As used herein, the term "substantially perpendicular" refers to a perpendicular orientation state with a tolerance of ±20° or less, preferably ±10° or less, more preferably ±5° or less. Similarly, the term "substantially parallel" refers to a parallel orientation state with a tolerance of, for example, ±20° or less, preferably ±10° or less, more preferably ±5° or less. Thus, by way of example, a tolerance of less than 20°, particularly less than 10°, or even less than 5° may be tolerated. To provide a wide field of view, the matrix may specifically have at least 10 rows, preferably at least 500 rows, more preferably at least 1000 rows. Similarly, the matrix may have at least 10 columns, preferably at least 500 columns, more preferably at least 1000 columns. The matrix may include at least 50 light sensors, preferably at least 100,000 light sensors, more preferably at least 5,000,000 light sensors. The matrix may include a number of pixels in the range of several megapixels. However, other embodiments are possible. Thus, in configurations where axial rotational symmetry is expected, a circular or concentric arrangement of the photosensors of the matrix, which may also be called pixels, may be preferred.

[0021] Thus, by way of example, the sensor element may be part of or constitute a pixelated optical device. For example, the sensor element may be and / or include at least one CCD and / or CMOS device. By way of example, the sensor element may be part of or constitute at least one CCD and / or CMOS device having a matrix of pixels, each pixel forming a light sensitive area. The sensor element may employ a rolling shutter scheme or a global shutter scheme for reading the matrix of light sensors.

[0022] As used herein, "light sensor" generally refers to a light-sensitive device for detecting a light beam, such as for detecting illumination and / or a light spot generated by at least one light beam. As further used herein, "light-sensitive area" generally refers to an area of ​​a light sensor that is externally illuminated by at least one light beam and generates at least one sensor signal in response to said illumination. The light-sensitive area may specifically be located on the surface of the respective light sensor. However, other embodiments are possible. The detector may include multiple light sensors, each having a light-sensitive area. As used herein, the term "light sensor each having at least one light-sensitive area" refers to a configuration with multiple single light sensors, each having one light-sensitive area, and a configuration with one combined light sensor having multiple light-sensitive areas. Thus, the term "light sensor" further refers to a light-sensitive device configured to generate at least one output signal. If the detector includes multiple light sensors, each light sensor may be embodied by providing exactly one light-sensitive area that can be illuminated, for example, so that exactly one light-sensitive area is present in each light sensor, generating exactly one uniform sensor signal for the entire light sensor in response to illumination of the light-sensitive area. Each light sensor may therefore be a single-area light sensor. The use of a single-area light sensor, however, makes the construction of the detector particularly simple and efficient. Thus, by way of example, commercially available light sensors, such as commercially available silicon photodiodes, each having exactly one light-sensitive area, may be used in the construction. However, other embodiments are possible.

[0023] The light sensor may specifically be or may include at least one photodetector, preferably an inorganic photodetector, more preferably an inorganic semiconductor photodetector, most preferably a silicon photodetector. In particular, the light sensor may have sensitivity in the infrared spectral range. All pixels of the matrix, or at least a group of light sensors of the matrix, may specifically be identical. Groups of identical pixels of the matrix may specifically be provided for different spectral ranges, or all pixels may be identical with respect to their spectral sensitivity. Furthermore, the pixels may be identical with respect to their size and / or their electronic or optoelectronic properties. In particular, the light sensor may be or may include inorganic photodiodes with sensitivity in the infrared spectral range, preferably in the range from 700 nm to 3.0 micrometers. In particular, the light sensor may have sensitivity in the part of the near infrared range, in particular in the range from 700 nm to 1100 nm, where silicon photodiodes are applicable. Infrared light sensors that may be used in the light sensor may be commercially available infrared light sensors, such as, for example, infrared light sensors marketed under the brand name Hertzstueck® by trinamiX GmbH, D-67056 Ludwigshafen am Rhein, Germany. Thus, by way of example, the light sensor may include at least one light sensor of the intrinsic photovoltaic type, more preferably at least one semiconductor photodiode selected from the group consisting of Ge photodiodes, InGaAs photodiodes, extended InGaAs photodiodes, InAs photodiodes, InSb photodiodes, HgCdTe photodiodes. Additionally or alternatively, the light sensor may include at least one light sensor of the extrinsic photovoltaic type, more preferably at least one semiconductor photodiode selected from the group consisting of Ge:Au photodiodes, Ge:Hg photodiodes, Ge:Cu photodiodes, Ge:Zn photodiodes, Si:Ga photodiodes, Si:As photodiodes.Additionally or alternatively, the optical sensor may include at least one photoconductive sensor, such as a PbS or PbSe sensor, a bolometer, preferably a bolometer selected from the group consisting of a VO bolometer and an amorphous Si bolometer.

[0024] The optical sensor may have sensitivity in one or more of the ultraviolet, visible, or infrared spectral ranges. Specifically, the optical sensor may have sensitivity in the visible spectral range of 500 nm to 780 nm, most preferably 650 nm to 750 nm, or 690 nm to 700 nm. Specifically, the optical sensor may have sensitivity in the near infrared range. Specifically, the optical sensor may have sensitivity in the portion of the near infrared range where silicon photodiodes are applicable, particularly in the range of 700 nm to 1000 nm. The optical sensor may have sensitivity in the infrared spectral range, specifically in the range of 780 nm to 3.0 μm. For example, the optical sensors may each independently be or include at least one element selected from the group consisting of a photodiode, a photocell, a photoconductor, a phototransistor, or any combination thereof. For example, the light sensor may be or may include at least one element selected from the group consisting of a CCD sensor element, a CMOS sensor element, a photodiode, a photocell, a photoconductor, a phototransistor, or any combination thereof. Any other type of photosensitive element may be used. As outlined in more detail below, the photosensitive element may generally be made entirely or partially of inorganic materials and / or entirely or partially of organic materials. Most commonly, one or more photodiodes may be used, such as commercially available photodiodes, e.g., inorganic semiconductor photodiodes, as outlined in more detail below.

[0025] Preferably, the light-sensitive area may be oriented substantially perpendicular to the optical axis of the detector, which may be a straight optical axis or may even be refracted or split, such as by using one or more deflection elements and / or one or more beam splitters, in the latter case the substantially perpendicular orientation refers with respect to the local optical axis of each branch or beam path of the optical arrangement.

[0026] The light-sensitive areas may be specifically oriented toward the object. As used herein, the term "oriented toward the object" generally refers to a state in which the surface of each of the light-sensitive areas is fully or partially visible from the object. Specifically, at least one interconnection line between at least one point of the object and at least one point of the respective light-sensitive area may form an angle with the surface element of the light-sensitive area different from 0°, for example an angle in the range of 20° to 90°, preferably an angle in the range of 80° to 90°, for example 90°. Thus, when the object is on or near the optical axis, the light beam propagating from the object toward the detector may be substantially parallel to the optical axis. As used herein, the term "substantially perpendicular" refers to a state of perpendicular orientation, for example with a tolerance of ±20° or less, preferably a tolerance of ±10° or less, more preferably a tolerance of ±5° or less. Similarly, the term "substantially parallel" refers to a state of parallel orientation, for example with a tolerance of ±20° or less, preferably a tolerance of ±10° or less, more preferably a tolerance of ±5° or less.

[0027] The sensor element is configured to record at least one reflected image of the light beam originating from at least one object. As used herein, the term "reflected image" refers to an image determined by the sensor element that includes at least one reflected feature. As used further herein, the term "reflected image" may specifically relate to data recorded using the sensor element, such as a plurality of electronic readings from an imaging device, such as pixels of the sensor element, but is not limited thereto. The reflected image itself may thus include pixels, the pixels of the image being correlated to pixels of the matrix of the sensor element. Thus, when referring to a "pixel", it refers either to a unit of image information generated by a single pixel of the sensor element, or directly to a single pixel of the sensor element. As used further herein, the term "reflected feature" refers to a feature in the image plane, for example, generated by an object in response to illumination with at least one illumination feature. As used herein, the term "determining at least one reflected feature" refers in particular to imaging and / or recording at least one light beam generated by an object in response to illumination with a light beam having at least one illumination feature. In particular, the sensor element may be configured to determine and / or image and / or record at least a reflected image. The reflected image may include at least one reflected pattern that includes at least one reflective feature.

[0028] The detector comprises at least one illumination source. The detector may comprise at least one illumination source configured to illuminate the object with at least one illumination beam. The illumination source may be configured to project at least one illumination pattern including at least one illumination feature onto at least one surface of the object. As used herein, the term "at least one illumination source" refers to at least one any device configured to provide at least one illumination light beam, in particular at least one illumination pattern, for illumination of the object. The illumination source may be adapted to directly or indirectly illuminate the object, where the illumination light beam is reflected or scattered by the object and thereby directed at least partially to the detector. The illumination source may be adapted to illuminate the object, for example, by illuminating the object with a light beam toward the object that reflects the light beam.

[0029] The irradiation source may include at least one light source. The irradiation source may include a plurality of light sources. The irradiation source may include an artificial irradiation source, in particular at least one laser source, and / or at least one incandescent lamp, and / or at least one semiconductor light source, for example at least one light emitting diode, in particular an organic and / or inorganic light emitting diode. By way of example, the light emitted by the irradiation source may have a wavelength of 300 to 1100 nm, in particular 500 to 1100 nm. Additionally or alternatively, light in the infrared spectral range, such as in the range of 780 nm to 3.0 μm, may be used. In particular, light in the near infrared range part, in particular in the range of 700 nm to 1100 nm, where silicon photodiodes are applicable, may be used. Using light in the near infrared range allows light that is not detected or only weakly detected by the human eye, but is detected by a silicon sensor, in particular a standard silicon sensor. The irradiation source may be adapted to emit light at a single wavelength. In other embodiments, the illumination may be adapted to emit light having multiple wavelengths allowing additional measurements in other wavelength channels. The light source may be or include at least one multi-beam light source. For example, the illumination source may include at least one laser source and one or more diffractive optical elements (DOEs).

[0030] Specifically, the illumination source may comprise at least one laser and / or laser source. Various types of lasers may be employed, such as semiconductor lasers, double heterostructure lasers, external cavity lasers, separate confinement heterostructure lasers, quantum cascade lasers, distributed Bragg reflector lasers, polariton lasers, hybrid silicon lasers, extended cavity diode lasers, quantum dot lasers, volume Bragg grating lasers, indium arsenide lasers, transistor lasers, diode pumped lasers, distributed feedback lasers, quantum well lasers, interband cascade lasers, gallium arsenide lasers, semiconductor ring lasers, extended cavity diode lasers, or vertical cavity surface emitting lasers. Additionally or alternatively, non-laser light sources may be used, such as LEDs and / or light bulbs. The illumination source may include one or more diffractive optical elements (DOEs) adapted to generate an illumination pattern. For example, the illumination source may be adapted to generate and / or project the point cloud, for example the illumination source may include one or more of at least one digital light processing projector, at least one LCoS projector, at least one spatial light modulator, at least one diffractive optical element, at least one array of light emitting diodes, at least one array of laser light sources. Considering their generally defined beam profile and other characteristics of handleability, the use of at least one laser source as the illumination source is particularly preferred. The illumination source may be integrated into the housing of the detector.

[0031] The illumination source may be specifically configured to emit light in the infrared spectral range. However, it should be noted that additionally or alternatively, other spectral ranges are possible. Furthermore, the illumination source may be specifically configured to emit modulated or unmodulated light. When using multiple illumination sources, the different illumination sources may have different modulation frequencies, which may be subsequently used to distinguish the light beams, as outlined in more detail below. The detector may be configured to evaluate a single light beam, or multiple light beams. In the case where multiple light beams propagate from the object to the detector, means may be provided to distinguish the light beams. Thus, the light beams may have different spectral characteristics, and the detector may include one or more wavelength-selective elements to distinguish the different light beams. Each of the light beams may thus be evaluated independently. The wavelength-selective elements may be or include, by way of example, one or more filters, one or more prisms, one or more gratings, one or more dichroic mirrors, or any combination thereof. Furthermore, additionally or alternatively, the light beams may be modulated in a particular manner to distinguish between two or more light beams. Thus, by way of example, the light beam may be frequency modulated and the sensor signal may be demodulated in order to partially distinguish the sensor signals emanating from the different light beams according to their demodulation frequency. These techniques are generally known to those skilled in the art of high frequency electronics. In general, the evaluation device may be configured to distinguish between different light beams having different modulations.

[0032] The illuminating light beam may generally be parallel to the optical axis or may be inclined relative to the optical axis, for example, including an angle with the optical axis. The detector may be configured such that the illuminating light beam propagates from the detector towards the object along the optical axis of the detector. For this purpose, the detector may include at least one reflecting element, preferably at least one prism, for deflecting the illuminating light beam onto the optical axis. By way of example, the illuminating light beam, such as a laser light beam, and the optical axis may have an angle of less than 10°, preferably less than 5°, or even less than 2°. However, other embodiments are also feasible. Furthermore, the illuminating light beam may be on the optical axis or off the optical axis. By way of example, the illuminating light beam may be parallel to the optical axis or even coincident with the optical axis, with a distance of less than 10 mm, preferably less than 5 mm, or even less than 1 mm relative to the optical axis.

[0033] In particular, the illumination source and the light sensor may be arranged in a common plane or in different planes. The illumination source and the light sensor may have different spatial orientations. In particular, the illumination source and the sensor elements may be arranged in a staggered configuration.

[0034] The illumination source may be configured to generate at least one illumination pattern for illumination of the object. The illumination pattern may include at least one pattern selected from the group consisting of: at least one dot pattern, in particular a pseudo-random dot pattern; a random dot pattern or a quasi-random pattern; at least one Sobol pattern; at least one quasi-periodic pattern; at least one pattern including at least one known feature; at least one regular pattern; at least one triangular pattern; at least one hexagonal pattern; at least one rectangular pattern; at least one pattern including a convex uniform tiling; at least one line pattern including at least one line; at least one line pattern including at least two lines, such as parallel or intersecting lines. As used herein, the term "pattern" refers to any known or predefined arrangement including at least one feature of any shape. The pattern may include at least one feature, such as a point or a symbol. The pattern may include multiple features. The pattern may include a periodic or non-periodic arrangement of features. As used herein, the term "at least one illumination pattern" refers to at least one any pattern including at least one illumination feature adapted to illuminate at least a portion of an object. As used herein, the term "illumination feature" refers to at least one feature that extends at least partially through the pattern. An illumination pattern may include a single illumination feature. An illumination pattern may include multiple illumination features. For example, an illumination pattern may include at least one line pattern. For example, an illumination pattern may include at least one stripe pattern. For example, an illumination pattern may include at least one checkerboard pattern. For example, an illumination pattern may include at least one pattern that includes a periodic or non-periodic arrangement of features. An illumination pattern may include a regular and / or regular and / or periodic pattern, such as a triangular pattern, a rectangular pattern, a hexagonal pattern, or even a convex tiled pattern.The illumination pattern may exhibit at least one illumination feature selected from the group consisting of at least one point, at least one line, at least two lines, such as parallel or intersecting lines, at least one point and one line, at least one arrangement of periodic or non-periodic features, at least one feature of any shape. For example, the illumination source may be adapted to generate and / or project a point cloud. The distance between two features of the illumination pattern and / or the area of ​​the at least one illumination feature may depend on a circle of confusion in the image. The illumination source may include at least one light source configured to generate the at least one illumination pattern. In particular, to generate and project the illumination pattern, the illumination source may include at least one laser source and at least one diffractive optical element (DOE). The detector may include at least one laser source and at least one point projector, such as a DOE, adapted to project the at least one point pattern. As further used herein, the term "projecting at least one illumination pattern" refers to providing at least one illumination pattern for illuminating at least one object. The projected illumination pattern may be deficient such that there is only a single illumination feature, such as a single point. To increase reliability, the illumination pattern may include several illumination features, such as several points. When the pattern is deficient, a single image can be used for simultaneous detection of biological tissue and facial recognition.

[0035] For example, the illumination source may include at least one line laser. The line laser may be adapted to send a laser line, such as a horizontal or vertical laser line, to the object. The illumination source may include multiple line lasers. For example, the illumination source may include at least two line lasers arranged such that the illumination pattern includes at least two parallel or intersecting lines. The illumination source may include at least one light projector adapted to generate a point cloud such that the illumination pattern may include multiple point patterns. The illumination source may include at least one mask adapted to generate an illumination pattern from at least one light beam generated by the illumination source. The illumination source may be one that is attached to or integrated into a mobile device such as a smartphone. The illumination source may be used for further functions that may be used in determining the image, such as an autofocus function. The illumination device may be attached to the mobile device, such as by using a connector such as a USB or a phone connector such as a headphone jack.

[0036] As used herein, the term "ray" generally refers to a line perpendicular to the wavefront of light, pointing in the direction of energy flow. As used herein, the term "beam" generally refers to a collection of rays. In the following, the terms "ray" and "beam" are used synonymously. As further used herein, the term "light beam" generally refers to a quantity of light, specifically a quantity of light traveling in essentially the same direction, including the possibility that the light beam has an expansion or divergence angle. The light beam can have a spatial spread. Specifically, the light beam can have a non-Gaussian beam profile. The beam profile may be selected from the group consisting of a trapezoidal beam profile; a triangular beam profile; a conical beam lateral intensity profile profile. The trapezoidal beam profile can have a plateau region and at least one edge region. The light beam can specifically be a Gaussian light beam or a linear combination of Gaussian light beams, as outlined in more detail below. However, other embodiments are possible. The transfer device is configured for one or more of adjusting, defining, and determining the beam profile, specifically the shape of the beam profile.

[0037] As used herein, the term "object" refers to a point or area that emits at least one light beam, in particular at least one reflection pattern. For example, the object may be at least one object selected from the group consisting of a scene, a human being such as a person, wood, carpet, foam, an animal such as a cow, a plant, a piece of tissue, metal, a toy, a metal object, a beverage, a food such as a fruit, meat, fish, a dish, a cosmetic product, an applied cosmetic product, a fabric, a fur, a maintenance product, a cream, an oil, a powder, a carpet, a juice, a suspension, a paint, a plant, a body, a body part, an organic material, an inorganic material, a reflective material, a screen, a display, a wall, a paper such as a photo. The object may include at least one surface onto which the illumination pattern is projected. The surface may be adapted to at least partially reflect the illumination pattern towards a detector. For example, without wishing to be bound by this theory, human skin includes a portion produced by retroreflection of the surface, called the surface reflection, and a portion produced by very diffuse reflection from the light penetrating the skin, called the diffuse portion of the retroreflection. For the reflectance profile of human skin, see "Lasertechnik in der Medizin: Grundlagen, Systeme, Anwendungen", "Wirkung von Laserstrahlung auf Gewebe" 1991, pp. 171-266, Juergen Eichler, Theo Seiler, Springer Verlag, ISBN 0939-0979. The surface reflectance of skin can increase as the wavelength increases towards the near infrared. Furthermore, the penetration depth can increase with increasing wavelength from visible light towards the near infrared. The diffuse part of the back reflection can increase with increasing penetration depth of the light. These material properties can be used to distinguish skin from other materials, particularly by analyzing the back scattering profile.

[0038] At least one light beam can propagate from the object towards the detector. The light beam may originate from the object or may originate from an illumination source that directly or indirectly illuminates the object, such that the light beam is reflected or scattered by the object and is thereby directed at least partially towards the detector. The detector may be used in active and / or passive illumination scenarios. For example, at least one illumination source may be adapted to illuminate the object, for example by illuminating the object with a light beam, which is reflected by the object. In addition to or as an alternative to the at least one illumination source, the detector may use radiation already present in the scene, such as at least one ambient light source.

[0039] The sensor element may be configured to record a beam profile of at least one reflection feature of the reflection image. The evaluation device may be configured to identify and / or select at least one reflection feature, in particular at least one light spot, of the reflection image provided by the sensor element. The evaluation device may be configured to perform at least one image analysis and / or image processing to identify the reflection feature. The image analysis and / or image processing may use at least one feature detection algorithm. Image analysis and / or image processing may include: filtering; selecting at least one region of interest; forming a difference image between an image generated by the sensor signal and at least one offset; inverting the sensor signal by inverting the image generated by the sensor signal; forming a difference image between images generated by the sensor signal at different times; background correction; decomposition into color channels; decomposition into hue; saturation; luminance channel; frequency decomposition; singular value decomposition; applying a blob detector; applying a corner detector; applying a determinant of a Hessian filter; applying principal curvature based region detector; applying maximally stable extremum region detector; applying a generalized Hough transform; applying a ridge detector; applying an affine invariant feature detector; applying an affine adaptive interest point operator; applying a Harris affine region detector; applying a Hessian affine region detector; applying a scale invariant feature transform The method may include one or more of: applying a scale-space extremum detector; applying a local feature detector; applying a fast robust feature algorithm; applying a histogram of gradient position and orientation algorithm; applying a histogram of oriented gradient descriptors; applying a Deriche edge detector; applying a differential edge detector; applying a space-time interest point detector; applying a Moravec corner detector; applying a Canny edge detector; applying a Laplace operator of a Gaussian filter; applying a differential Gaussian filter; applying a Sobel operator; applying a Laplace operator; applying a Schall operator; applying a Prewitt operator; applying a Roberts operator; applying a Kirsch operator; applying a high pass filter; applying a low pass filter; applying a Fourier transform; applying a Radon transform; applying a Hough transform; applying a wavelet transform; thresholding; and generating a binary image. Specifically, evaluating the reflectance image includes selecting a region of interest in the reflectance image.The region of interest may be determined manually by a user or automatically, such as by recognizing an object in an image produced by the sensor elements. For example, in the case of a spot-like reflective feature, the region of interest may be selected as the area around the spot profile.

[0040] For example, the illumination source may be adapted to generate and / or project a point cloud such that a plurality of illumination areas are generated on a matrix of light sensors, for example a CMOS detector. Furthermore, disturbances, for example due to speckle and / or extraneous light and / or multiple reflections, may be present on the matrix of light sensors. The evaluation device may be adapted to determine at least one region of interest, for example one or more pixels illuminated by the light beam, which are used to determine the longitudinal coordinate of the object. For example, the evaluation device may be adapted to perform a filtering method, for example a blob analysis and / or an edge filter and / or an object recognition method.

[0041] The evaluation device may be configured to perform at least one image correction. The image correction may include at least one background subtraction. The evaluation device may be adapted to remove contributions from background light from the reflected beam profile, for example by imaging without further illumination.

[0042] The evaluation device may be configured to determine the material property m by evaluating the beam profile of the reflected image. As used herein, the term "beam profile of the reflected image" refers to the intensity distribution of at least one of the reflection features of the reflected image, such as the light spots on the sensor element, as a function of the pixels. The beam profile of the reflected image, also called the reflected beam profile, may be selected from the group consisting of a trapezoidal beam profile; a triangular beam profile; a linear combination of a conical beam profile and a Gaussian beam profile. As used herein, the term "evaluating the beam profile" refers to applying at least one distance-dependent image filter and at least one material-dependent image filter to the beam profile and / or to at least one specific region of the beam profile. As used herein, the term "image" refers to a two-dimensional function f(x,y), where brightness and / or color values ​​are given for any x,y position in the image. The positions may be discretized corresponding to the recording pixels. Also, the brightness and / or color may be discretized corresponding to the bit depth of the light sensor. As used herein, the term "image filter" refers to at least one mathematical operation applied to the beam profile and / or at least one specific region of the beam profile. Specifically, an image filter Φ maps an image f or a region of interest in an image to a real number Φ(f(x,y))=φ, where φ denotes a feature, in particular a distance feature in the case of a distance-dependent image filter or a material feature in the case of a material-dependent image filter. Images may be affected by noise, and the same is true for features. Thus, features may be random variables. Features may follow a normal distribution. If the features do not follow a normal distribution, they may be transformed to follow a normal distribution, such as by Box-Cox-Transformation.

[0043] The evaluation device derives at least one distance feature φ by applying at least one distance-dependent image filter Φ1 to the reflected image. 1zAs used herein, the term "distance" refers to the distance of an object, specifically the distance between the object and the detector. As used herein, the term "distance dependent" image filter refers to an image having a distance dependent output. The output of a distance dependent image filter is referred to herein as a "distance feature φ 1z " or "distance-dependent feature φ 1z ". The distance feature may be or may include at least one measurement of the distance of the object, a distance value, a longitudinal coordinate of the object, or other information about the distance of the object. The distance dependent image filter may be a depth filter from photon ratio; a depth filter from defocus; or a linear combination thereof; or |ρ Ф1other , Фz |≧0.40(Ф z is a depth filter from the photon ratio or a depth filter from the defocus or a linear combination thereof) by a further distance-dependent image filter Φ, which is correlated to the depth filter from the photon ratio and / or the depth filter from the defocus or a linear combination thereof 1other , . . . The further distance-dependent image filter Φ 1other is the distance-dependent image filter Φ z and |ρ Ф1other , Фz |≧0.60, preferably |ρ Ф1other , Фz Two image filters Φ may be correlated by | ≥ 0.80. i and Φ j The similarity of may be evaluated by the correlation of their features, specifically by calculating the Pearson correlation coefficient.

[0044]

number

[0045] where μ and σ are the mean and standard deviation of the obtained features. The test of the correlation of the filters can be performed with a set of random test images, specifically a matrix filled with random numbers. The number of random test images can be selected so that the result of the correlation test is statistically significant. The correlation coefficient takes values ​​between −1 and 1, where 0 means that there is no linear correlation. The correlation coefficient is suitable to determine whether two filters are similar or equivalent. To measure whether the features of the filters are correlated with a given property, such as distance, the test images can be selected such that the correlation filter actually yields that property. As an example, to measure whether the features of the filters are correlated with distance, beam profiles recorded at different distances can be used as test images. To obtain a comparable, transferable and transparent evaluation, a fixed test set of test images can be defined.

[0046] For example, the distance dependent image filter may be a depth from photon ratio filter. The depth from photon ratio filter may include evaluating a combined signal Q from at least two sensor signals of the sensor elements. The evaluation device determines a distance characteristic φ by evaluating the combined signal Q. 1zThe distance characteristic determined by evaluation of the combined signal Q may correspond directly to the longitudinal coordinate of the object. As used herein, a "sensor signal" generally refers to a signal generated by the optical sensor and / or at least one pixel of the optical sensor in response to illumination. In particular, the sensor signal may be or include at least one electrical signal, such as at least one analog electrical signal and / or at least one digital electrical signal. More particularly, the sensor signal may be or include at least one voltage signal and / or at least one current signal. More particularly, the sensor signal may include at least one photocurrent. Furthermore, raw sensor signals may be used or the detector, optical sensor, or other elements may be adapted to process or pre-process the sensor signal, thereby generating a secondary sensor signal that may also be used as the sensor signal. As generally used herein, the term "combining" may generally refer to any operation in which two or more components, such as signals, are mathematically combined to form at least one combined combined signal and / or compared to form at least one comparison signal or comparison result. As used herein, the term "combined signal Q" refers to a signal generated by combining sensor signals, in particular by one or more of dividing the sensor signals, dividing a multiple of the sensor signals, or dividing a linear combination of the sensor signals. In particular, the combined signal may be a quotient signal. The combined signal Q may be determined using various means. As an example, software means for deriving the combined signal, hardware means for deriving the combined signal, or both may be used and may be implemented in the evaluation device. The evaluation device may thus, as an example, include at least one divider, where the divider is configured to derive the quotient signal. The divider may be embodied, fully or partially, as one or both of a software divider or a hardware divider.

[0047] The evaluation unit may be configured to derive the combined signal Q by one or more of dividing the sensor signals, dividing a multiple of the sensor signals, or dividing a linear combination of the sensor signals. The evaluation unit may be configured to derive the combined signal Q by one or more of dividing the sensor signals, dividing a multiple of the sensor signals, or dividing a linear combination of the sensor signals. 1z , and the distance feature φ 1z For example, the evaluation unit may be configured to derive the combined signal Q by:

[0048]

number

[0049] where x and y are lateral coordinates, A1 and A2 are different areas of at least one beam profile of a light beam propagating from an object to a detector at the sensor location, and E(x, y, z o ) is the object distance z o The area A1 and the area A2 may be different. In particular, A1 and A2 are not congruent. Thus, A1 and A2 may differ in one or more of shape or content. The beam profile may be the cross-section of a light beam. The beam profile may be selected from the group consisting of a trapezoidal beam profile; a triangular beam profile; a linear combination of a conical beam profile and a Gaussian beam profile. In general, the beam profile is expressed as a function of the intensity L(z o ) and beam shape S(x,y;z o ) in the image. The combined signal can thus be derived to determine a vertical coordinate that is independent of the luminance. Furthermore, the combined signal can be used to determine the distance z0 independently of the size of the object. In this way, the combined signal allows the distance z0 to be determined independently of the material and / or reflecting and / or scattering properties of the object and independently of changes in the light source due to, for example, manufacturing precision, heat, moisture, dirt, lens damage, etc. As an example, the distance-dependent feature φ 1z is a function of the combined signal Q, φ 1z =φ 1z(Q), where the function may be a first order polynomial, a second order polynomial, or a higher order polynomial of Q. Further, as an example, the object distance z0 may be expressed as a function of the distance-dependent feature φ 1z function, z0=z0(φ 1z ), where the function φ 1z Thus, the object distance z0 may be a function of the coupled signal Q, z0=z0(Q), where the function may be a first order polynomial, a second order polynomial, or a higher order polynomial in Q.

[0050] The light sensitive areas of the at least two light sensors may be arranged such that the first sensor signal includes information of a first area of ​​the beam profile and the second sensor signal includes information of a second area of ​​the beam profile. The first area of ​​the beam profile and the second area of ​​the beam profile are either or both of adjacent or overlapping areas. As used herein, the term "area of ​​the beam profile" generally refers to any area of ​​the beam profile at the sensor location used to determine the combined signal Q.

[0051] The evaluation device may be configured to determine and / or select a first area of ​​the beam profile and a second area of ​​the beam profile. The first area of ​​the beam profile may include substantially edge information of the beam profile and the second area of ​​the beam profile may include substantially central information of the beam profile. The beam profile may have a center, i.e. a maximum of the beam profile and / or a central point of the plateau of the beam profile and / or a geometric center of the light spot, and a falling edge extending from the center. The second area may include an inner area of ​​the cross section and the first area may include an outer area of ​​the cross section. As used herein, the term "substantially central information" generally refers to a low percentage of edge information, i.e. a low percentage of the intensity distribution corresponding to the edge, compared to the percentage of central information, i.e. a percentage of the intensity distribution corresponding to the center. Preferably, the central information has a percentage of edge information of less than 10%, more preferably less than 5%, and most preferably the central information does not include edge content. As used herein, the term "substantially edge information" generally refers to a low percentage of central information, compared to the percentage of edge information. The edge information may include information of the entire beam profile, in particular information from the central and edge areas. The edge information has a percentage of center information less than 10%, preferably less than 5%, and more preferably the edge information does not include center information. If the beam profile is close to or around the center and substantially includes center information, at least one area of ​​the beam profile may be determined and / or selected as the second area of ​​the beam profile. If the beam profile includes at least a portion of the falling edge of the cross section, at least one area of ​​the beam profile may be determined and / or selected as the first area of ​​the beam profile. For example, the entire area of ​​the cross section may be determined as the first area. The first area of ​​the beam profile may be area A2 and the second area of ​​the beam profile may be area A1.

[0052] The edge information may include information on the number of photons in a first area of ​​the beam profile, and the center information may include information on the number of photons in a second area of ​​the beam profile. The evaluation device may be adapted to determine an area integral of the beam profile. The evaluation device may be adapted to determine the edge information by integration and / or summation of the first area. The evaluation device may be adapted to determine the center information by integration and / or summation of the second area. For example, the beam profile may be a trapezoidal beam profile and the evaluation device may be adapted to determine the integral value of the trapezoid. Furthermore, if a trapezoidal beam profile is assumed, the determination of the edge and center signals may be replaced by an equivalent evaluation that utilizes properties of the trapezoidal beam profile, such as the slope and position of the edges as well as the determination of the height of the central plateau, and derives the edge and center signals by geometrical considerations.

[0053] Additionally or alternatively, the evaluation device may be adapted to determine one or both of center and edge information from at least one slice or cut of the light spot. This can be achieved, for example, by replacing the area integral of the combined signal Q with a line integral along the slice or cut. To improve accuracy, multiple slices or cuts through the light spot may be used for averaging. In case of an elliptical spot profile, improved distance information may be obtained by averaging over multiple slices or cuts.

[0054] The evaluation device may be configured to derive the combined signal Q by one or more of dividing the edge information and the center information, dividing a multiple of the edge information and the center information, dividing a linear combination of the edge information and the center information. Thus, in effect, photon ratios may be used as the physical basis of the method.

[0055] The evaluation device may be configured to derive the combined signal Q, in particular by dividing the first and second sensor signals, by dividing a multiple of the first and second sensor signals, or by dividing a linear combination of the first and second sensor signals. As an example, Q may be simply determined as Q=s1 / s2 or Q=s2 / s1, where s1 denotes the first sensor signal and s2 denotes the second sensor signal. Additionally or alternatively, Q may be determined as Q=a·s1 / b·s2 or Q=b·s2 / a·s1, where a and b are, by way of example, predefined or determinable real numbers. Additionally or alternatively, Q may be determined as Q=(a·s1+b·s2) / (c·s1+d·s2), where a, b, c and d are, by way of example, predefined or determinable real numbers. As a simple example of the latter, Q may be determined as Q=s1 / (s1+s2). Other combination or quotient signals are possible.

[0056] Typically, the combined signal Q is a monotonically decreasing function of the longitudinal coordinate of the object and / or the size of the light spot, such as the diameter or equivalent diameter of the light spot. Thus, by way of example, the quotient Q=s1 / s2 is a monotonically decreasing function of the size of the light spot, especially when linear light sensors are used. Without wishing to be bound by this theory, this is believed to be due to the fact that in the above described configuration, both the first signal s1 and the second signal s2 decrease as a square function with increasing distance to the light source, since the amount of light reaching the detector decreases. However, there the first signal s1 decreases more rapidly than the second signal s2, and in an optical configuration such as that used in the experiment, the light spot in the image plane grows and therefore expands over a larger area. Thus, the quotient of the first and second sensor signals decreases continuously as the diameter of the light beam or the diameter of the light spot on the first and second photosensitive areas increases. Moreover, the quotient may be almost independent of the total power of the light beam, since it forms a coefficient in both the first and second sensor signals. As a result, the combined signal Q can form a secondary signal that provides a unique and unambiguous relationship between the first and second sensor signals and the size or diameter of the light beam. On the other hand, since the size or diameter of the light beam depends on the distance between the object through which the incident light beam propagates towards the detector and the detector itself, i.e. on the longitudinal coordinate of the object, there can be a unique and unambiguous relationship between the first and second sensor signals and the longitudinal coordinate. For the latter, reference can be made, for example, to WO2014 / 097181A1. The predetermined relationship can be determined by analytical considerations, for example by assuming a linear combination of Gaussian light beams, by empirical measurements, for example by measuring the first and second sensor signals or a secondary signal derived therefrom as a function of the longitudinal coordinate of the object, or both.

[0057] For the evaluation of the combined signal Q and for further details and embodiments, reference is made to WO2018 / 091640, WO2018 / 091649A1 and WO2018 / 091638A2, the contents of which are incorporated herein by reference.

[0058] For example, the distance dependent image filter may be a depth from defocus filter. As outlined above, the evaluation unit may be configured to determine at least one image of the region of interest from the sensor signals. The evaluation unit may be configured to determine at least one blurring function f a By optimizing the distance feature φ 1z The determined distance feature φ 1z may directly correspond to the vertical coordinate of the object. 1z may be determined using at least one convolution-based algorithm, such as a depth from defocus algorithm. To obtain the distance from the image, the depth from defocus algorithm estimates the defocus of the object. For this estimation, a blurring function is assumed. As used herein, the "blurring function f", also referred to as the blur kernel or point spread function, is a The term "f" refers to the response function of the detector to illumination from an object. Specifically, the blurring function models the blurring of a defocused object. At least one blurring function f a may be a function or a composite function composed of at least one function from the group consisting of Gaussian, sinc function, pillbox function, square function, Lorentz function, radial function, polynomial, Hermite polynomial, Zernike polynomial, Legendre polynomial.

[0059] The blurring function can be optimized by varying at least one parameter of the blurring function. The reflected image is then compared to the blurred image i b The evaluation device may be b and the blurring function f a from the distance feature φ 1z The distance feature φ may be reconstructed. 1z is calculated by varying the parameter σ to obtain at least one further image i′ b Using this, blurred image i b and the blurring function f amay be determined by minimizing the difference between the convolution of

[0060]

number

[0061] σ(z) is a set of distance-dependent blurring parameters. The further images may be blurred (blurred) or sharp. As used herein, the term "sharp" or "sharp image" refers to the blurred image with the greatest contrast. At least one further image is convolved with a known blurring function to obtain the blurred image i b Thus, the depth from defocus algorithm can be generated from the distance feature φ 1z can be used to obtain

[0062] The evaluation device estimates the distance feature φ determined by applying a depth filter from the photon ratio. 1z and the distance feature φ determined by applying the depth from defocus filter. 1z The combined distance information z may be configured to determine at least one combined distance information z based on a distance feature φ determined by applying a depth filter from a photon ratio. 1z and the distance feature φ determined by applying the depth from defocus filter. 1z The joint distance information z may be a real function that depends on and . The joint distance information z may also be a distance feature φ determined by applying a depth filter from the photon ratio. 1z and the distance feature φ determined by applying the depth from defocus filter. 1z The depth from defocus distance measurement can be a rational or irrational polynomial with respect to the photon ratio. Depth from defocus is a complementary method to depth from photon ratio, but uses a similar hardware configuration. Furthermore, the depth from defocus distance measurement can have similar accuracy. Combining both techniques can produce advantageous distance measurement results with high accuracy.

[0063] The evaluation unit may be configured to determine the at least one combined distance information by means of at least one recursive filter. The recursive filter may be at least one Kalman filter or at least one Extended Kalman Filter (EKF). The combined distance information z is a function of a real function z=f(z DPR ,z DFD ), for example, the arithmetic or geometric mean, a polynomial, preferably z DPR and z DFD may be obtained using up to the eighth degree of polynomials, where z DPR is the distance feature φ determined by applying a depth filter from the photon ratio. 1z and z DFD is the distance feature φ determined by applying the depth from defocus filter. 1z The function f may be or may be based on a look-up table of pre-recorded values. For example, the evaluation device may include at least one data storage device configured to store pre-recorded values ​​and / or one or more look-up tables. The function f may be based on a look-up table in combination with an interpolation scheme for interpolating values ​​in the look-up table. The interpolation scheme may be linear interpolation, spline interpolation, etc. DFD and z DPR , z, z DFD and z DPR The model or model function may be used in combination with a model or model function, such as a function f relating to the relationship between the measured distances z, z DFD , and / or the actual distance z real Z around DPR For example, the Gaussian distribution of the distance z, z DFD , and z DPR The statistical assumptions and / or models may include:

[0064] The recursive filter may be configured to determine the combined distance information taking into account further sensor data and / or further parameters. The further parameters may comprise further information from a sensor element, e.g. a CMOS sensor, such as information on the quality and / or noise of the recorded data, and / or information on overexposure, and / or information on underexposure. The detector may comprise at least one further sensor configured to determine the further sensor data. The recursive filter may be configured to determine the combined distance information taking into account the further sensor data. The further sensor may be at least one sensor selected from the group consisting of a temperature sensor, an illumination sensor, e.g. a control sensor for determining illumination information, an inertial measurement unit, a gyroscope. The model and / or the Kalman filter may comprise further input parameters, e.g. further sensor data, e.g. temperature, and / or detector movement from a gyroscope, and / or information from an inertial measurement unit, and / or further parameters, e.g. quality / noise of the recorded data, overexposure, underexposure. The further sensor data can be provided by the sensor element, in particular the at least one CMOS sensor, and / or by further image analysis. The model and / or the Kalman filter may include, as input variables, at least one material characteristic φ 2m may include:

[0065] For example, the distance-dependent image filter may be a structured light filter combined with a depth-from-photon-ratio filter and / or a depth-from-defocus image filter. For example, the detector may include at least two sensor elements, each with a matrix of light sensors. The at least one first sensor element and the at least one second sensor element may be arranged at different spatial positions. The relative distance between the first sensor element and the second element may be fixed. The at least one first sensor element may be adapted to determine at least one first reflection pattern, in particular at least one first reflection feature, and the at least one second sensor element may be adapted to determine at least one second reflection pattern, in particular at least one second reflection feature. The evaluation device may be configured to select at least one image determined by the first or second sensor element as a reflection image, and to select at least one image determined by the other one of the first or second sensor elements as a reference image. As used herein, the term "reference image" refers to an image different from the reflection image, determined at a different spatial position compared to the reflection image. The reference image may be determined by one or more of recording at least one reference feature, imaging at least one reference feature, calculating a reference image. The reference image and the reflected image may be images of the object determined at different spatial positions having a certain distance. The distance may be a relative distance, also called a baseline. The evaluation device may be adapted to select at least one reflected feature in the reflected image and to determine a distance feature φ determined by applying a depth image filter from photon ratio and / or a depth image filter from defocus. 1z and adapted to determine a distance estimate of at least one of the selected reflectance features of the reflectance image given by an error interval ±ε.

[0066] The evaluation device may be adapted to determine at least one reference feature of the at least one reference image that corresponds to the at least one reflection feature. The evaluation device may be adapted to perform an image analysis and to identify features of the reflection image. The evaluation device may be adapted to identify at least one reference feature in the reference image that has substantially the same vertical coordinate as the selected reflection feature. The term "substantially the same" refers to being identical within 10%, preferably within 5%, most preferably within 1%. The reference feature that corresponds to the reflection feature may be determined using epipolar geometry. For a description of epipolar geometry, see for example chapter 2 "Dreidimensionales Computersehen" by X. Jiang, H. Bunke, Springer, Berlin Heidelberg, 1997. Epipolar geometry may assume that the reference image and the reflection image are images of an object determined at different spatial positions and / or spatial orientations with a fixed distance. The evaluation device may be adapted to determine an epipolar line in the reference image. The relative positions of the reference image and the reflection image may be known. For example, the relative positions of the reference image and the reflected image may be stored in at least one storage unit of the evaluation device. The evaluation device may be adapted to determine a straight line extending from a selected reflected feature of the reflected image. The straight line may include a possible object feature corresponding to the selected feature. The straight line and the baseline develop an epipolar plane. Since the reference image is determined at a different relative position than the reflected image, the corresponding possible object feature may be imaged on a straight line, called an epipolar line, in the reference image. Thus, the feature of the reference image corresponding to the selected feature of the reflected image is located on the epipolar line. Due to image distortion or changes in system parameters due to aging, temperature changes, mechanical stress, etc., the epipolar lines may cross or be very close to each other and / or the correspondence between the reference feature and the reflected feature may be unclear. Furthermore, each known position or object in the real world may be projected into the reference image and vice versa. The projection may be known by calibration of the detector, while the calibration corresponds to teaching-in the epipolar geometry of a particular camera.

[0067] The evaluation device may be configured to determine at least one displacement area in the reference image corresponding to the distance estimate. As used herein, the term "displacement area" refers to an area in the reference image where a reference feature corresponding to a selected reflection feature may be imaged. Specifically, the displacement area may be an area in the reference image where a reference feature corresponding to a selected reflection feature is expected to be located in the reference image. Depending on the distance to the object, an image position of the reference feature corresponding to the reflection feature may be displaced in the reference image compared to an image position of the reflection feature in the reflection image. The displacement area may include only one reference feature. The displacement area may also include multiple reference features. The displacement area may include an epipolar line or a portion of an epipolar line. The displacement area may include multiple epipolar lines or multiple portions of multiple epipolar lines. As used herein, the term "reference feature" refers to at least one feature of the reference image. The displacement area may extend along an epipolar line, may extend orthogonal to the epipolar line, or both. The evaluation device may be adapted to determine a reference feature along the epipolar line corresponding to the distance feature, and to determine an extent of a displacement area along the epipolar line or orthogonal to the epipolar line corresponding to an error interval ±ε. Measurement uncertainty of the distance measurement may result in a displacement area that is non-circular, since the measurement uncertainty may vary with direction. In particular, the measurement uncertainty along the epipolar line or lines may be larger than the measurement uncertainty in an orthogonal direction with respect to the epipolar line or lines. The displacement area may include an area extending in an orthogonal direction with respect to the epipolar line or lines. The evaluation device may determine a displacement area around an image location of the reflective feature. The evaluation device is adapted to determine a distance estimate and to determine a displacement area along φ 1z It can be adapted to determine the displacement region along the epipolar line corresponding to ±ε.

[0068] The evaluation device may be configured to match selected features of the reflected pattern with at least one feature of the reference pattern in the displacement region. As used herein, the term "matching" refers to determining and / or evaluating corresponding reference and reflected features. The evaluation device may be configured to match selected features of the reflected image with reference features in the displacement region by using at least one evaluation algorithm taking into account the determined distance estimate. The evaluation algorithm may be a linear scaling algorithm. The evaluation device may be adapted to determine an epipolar line that is closest to and / or within the displacement region. The evaluation device may be adapted to determine an epipolar line that is closest to an image location of the reflected feature. The extent of the displacement region along the epipolar line may be larger than the extent of the displacement region orthogonal to the epipolar line. The evaluation device may be adapted to determine the epipolar line before determining the corresponding reference feature. The evaluation device may determine a displacement region around an image location of each reflected feature. The evaluation device may be adapted to assign an epipolar line to each displacement region of each image position of the reflection feature, such as by assigning an epipolar line closest to the displacement region and / or an epipolar line within the displacement region and / or an epipolar line closest to the displacement region along a direction orthogonal to the epipolar line. The evaluation device may be adapted to determine a reference feature corresponding to the image position of the reflection feature, such as by evaluating a reference feature closest to the assigned displacement region and / or a reference feature within the assigned displacement region and / or a reference feature closest to the assigned displacement region along the assigned epipolar line and / or a reference feature within the assigned displacement region along the assigned epipolar line.

[0069] The evaluation device may be configured to determine the displacement of the matched reference feature and the selected reflected feature. The evaluation device may be configured to determine the vertical information of the matched feature using a predetermined relationship between the vertical coordinate and the displacement. As used herein, the term "displacement" refers to the difference between a position in the reference image and a position in the reflected image. As used herein, the term "vertical information" refers to information about the vertical coordinate. For example, the vertical information may be a distance value. The predetermined relationship may be one or more of an empirical relationship, a semi-empirical relationship, and an analytically derived relationship. The evaluation device may comprise at least one data storage device for storing the predetermined relationship, such as, for example, a look-up list or a look-up table. The evaluation device may be adapted to determine the predetermined relationship by using a triangulation method. If the position of the selected reflected feature in the reflected image and the position of the matched reference feature and / or the relative displacement of the selected reflected feature and the matched reference feature are known, the vertical coordinate of the corresponding object feature may be determined by triangulation. The evaluation device may therefore be adapted to select, for example sequentially and / or row by row, a reflective feature and to determine for each potentially possible position of the reference feature a corresponding distance value using triangulation. The displacements and the corresponding distance values ​​may be stored in at least one storage device of the evaluation device.

[0070] Additionally or alternatively, the evaluation device comprises the steps of: - determining the displacement area for the image location of each reflection feature; - assigning an epipolar line to the displacement region of each reflection feature, such as by assigning an epipolar line closest to the displacement region, and / or an epipolar line within the displacement region, and / or an epipolar line closest to the displacement region along a direction orthogonal to the epipolar line; - assigning and / or determining at least one reference feature to each reflection feature, such as by assigning a reference feature closest to the assigned displacement area and / or a reference feature within the assigned displacement area and / or a reference feature closest to the assigned displacement area along the assigned epipolar line and / or a reference feature within the assigned displacement area along the assigned epipolar line; The method may be configured to perform the following steps:

[0071] Additionally or alternatively, the evaluation device may be adapted to determine among the reference features assigned to the multiple epipolar lines and / or reflection features, e.g. by comparing distances of the reflection features and / or epipolar lines in the reference image and / or by comparing ε-weighted distances of the reflection features and / or error-weighted distances of the epipolar lines and assigning the epipolar line and / or reference feature with a shorter distance and / or ε-weighted distance to the reference feature and / or reflection feature.

[0072] The evaluation device evaluates at least one material characteristic φ by applying at least one material-dependent image filter Φ2 to the reflected image. 2m As used herein, the term "material dependent" image filter refers to an image having a material dependent output. The output of a material dependent image filter is herein referred to as a "material feature φ 2m " or "Material-dependent feature φ 2m The material characteristic may be or may include at least one piece of information regarding at least one material property of the object.

[0073] The material dependent image filter may be a brightness filter; a spot shape filter; a squared norm gradient; a standard deviation; a smoothness filter such as a Gaussian filter or a median filter; a gray level generation based contrast filter; a gray level generation based energy filter; a gray level generation based uniformity filter; a gray level generation based dissimilarity filter; a rho energy filter; a threshold domain filter; or a linear combination thereof; or |ρ Ф2other,Фm |≧0.40 by (Ф m is one of a brightness filter, a spot shape filter, a squared norm gradient, a standard deviation, a smoothness filter, a gray level generation based energy filter, a gray level generation based uniformity filter, a gray level generation based dissimilarity filter, a rho's energy filter, or a threshold domain filter, or a linear combination thereof), a further material dependent image filter Φ that is correlated to a brightness filter, a spot shape filter, a squared norm gradient, a standard deviation, a smoothness filter, a gray level generation based energy filter, a gray level generation based uniformity filter, a gray level generation based dissimilarity filter, a rho's energy filter, or a threshold domain filter, or a linear combination thereof 2other , . . . The further material-dependent image filter Φ 2other is the material-dependent image filter Φ m and |ρ Ф2other,Фm |≧0.60, preferably |ρ Ф2othe,Фm may be correlated by |≧0.80.

[0074] The material-dependent image filter may be at least one any filter Φ that passes hypothesis validation. As used herein, the term "passes hypothesis validation" refers to the fact that the null hypothesis H0 is rejected and an alternative hypothesis H1 is accepted. The hypothesis validation may include validating the material dependency of the image filter by applying the image filter to a predefined data set. The data set may include multiple beam profile images. As used herein, the term "beam profile image" refers to N BRefers to the sum of Gaussian radial basis functions.

[0075]

number

[0076]

number

[0077] In the formula, N B Each Gaussian radial basis function has a center (x lk ,y lk ),, prefactor a lk , and the exponential factor

number

[0078] [Table 1]

[0079] The values ​​of x,y, are

number

[0080] Next, for each image f k , the feature value φ corresponding to the filter Φ k can be calculated,

number

number

number

number

number

number

[0081] Hypothesis testing may include determining the mean sum of squares between:

[0082]

number

[0083] Hypothesis testing may include performing an F-test.

[0084]

number

[0085] Here, I x is the regularized incomplete beta function

number

number

number

[0086] The image filter may pass the hypothesis verification if the p-value, p, is less than or equal to a predefined significance level. The filter may pass the hypothesis verification if p≦0.075, preferably p≦0.05, more preferably p≦0.025, and most preferably p≦0.01. For example, if the predefined significance level is α=0.075, the image filter may pass the hypothesis verification if the p-value is less than α=0.075. In this case, the null hypothesis H0 may be rejected and the alternative hypothesis H1 may be accepted. The image filter thus distinguishes between at least two material classifications. Thus, the image filter passes the hypothesis verification.

[0087] In the following, the image filter is described assuming that the reflection image contains at least one reflection feature, in particular a spot image.

number

[0088] For example, the material dependent image filter may be a luminance filter. The luminance filter may return a luminance measurement of a spot as a material characteristic. The material characteristic may be:

number

number

[0089]

number

[0090] For example, a material dependent image filter may be a filter that has an output that is dependent on the spot shape. The material dependent image filter may return a value as a material characteristic that correlates to the translucency of the material, which affects the shape of the spot. The material characteristic may be:

number

number

[0091] For example, the material dependent image filter may be a squared norm gradient, which may return a value that correlates to a measure of the soft-hard transition and / or roughness of the spot as a material characteristic.

number

number

number

[0092] For example, the material dependent image filter may be a smoothness filter, such as a Gaussian filter or a median filter. In one embodiment of the smoothness filter, the image filter may refer to the observation that volumetric scattering exhibits less speckle contrast compared to diffuse scattering materials. The image filter may quantify the smoothness of the spots corresponding to the speckle contrast as a material characteristic. The material characteristic may be:

number

number

number

number

number

[0093] For example, the image filter may be a gray level generation based contrast filter. The material filter may be a gray level generation matrix

number

[0094] The material characteristics of the gray level generation based contrast filter are:

number

[0095] For example, the image filter may be a grey level generation based energy filter, which is based on the grey level generation matrix defined above.

[0096] The material characteristics of the gray level generation based energy filter are:

number

[0097] For example, the image filter may be a gray level generation based uniformity filter. The material filter is based on the gray level generation matrix defined above. The material characteristics of the gray level generation based uniformity filter are:

number

[0098] For example, the image filter may be a gray level generation based dissimilarity filter. The material filter is based on the gray level generation matrix defined above. The material features of the gray level generation based dissimilarity filter are:

number

[0099] For example, the image filter may be a low energy filter. The material filter is a low vector L5=[1,4,6,4,1] and E5=[-1,-2,0,-2,-1] and a material L5 (E5) T and E5 (L5) T Based on Image f k These matrices:

number

number

[0100] where the material characteristics of the low energy filter are:

number

[0101] For example, the material dependent image filter may be a threshold domain filter. This material feature may relate two areas in the image plane. The first area, Ω1, may be an area where the function f is greater than α times the maximum value of f. The second area, Ω2, may be an area where the function f is less than α times the maximum value of f, but greater than a threshold of α times the maximum value of f. Preferably, α may be 0.5 and ε may be 0.05. Due to speckle or noise, the areas may not simply correspond to an inner and outer circle of the spot center. For example, Ω1 may include speckle or unconnected areas of the outer circle. The material feature may be:

number

[0102] The material property m and / or the vertical coordinate z are expressed as φ 1z , φ 2m The evaluation device may determine the feature φ 2m , φ 1z For example, the evaluation device may be configured to determine the material property m and / or the longitudinal coordinate z of the object by evaluating the distance characteristic φ 1z and a longitudinal coordinate of the object. The evaluation device may be configured to use at least one predetermined relationship between the material characteristic φ and the longitudinal coordinate of the object. 2mand a material property of the object. The predetermined relationship may be one or more of an empirical relationship, a semi-empirical relationship, and an analytically derived relationship. The evaluation device may comprise at least one data storage device for storing the predetermined relationship, such as a look-up list or a look-up table. For example, the material property may be determined based on information about the vertical coordinate z, such as φ 2m After determining the vertical coordinate z, φ 2m Specifically, the material property m and / or the vertical coordinate z may be determined by evaluating the function z(φ 1z ,φ 2m ) and / or function m(φ 1z ,φ 2m ) The function may be predefined and / or pre-determined. For example, the function may be a linear function.

[0103] In the ideal case, the image filters generate features that depend only on distance or material properties. However, image filters used in beam profile analysis may generate features that depend on distance and material properties such as translucency. At least one of the material-dependent or distance-dependent image filters may generate features that depend on at least one other image filter's feature φ 1z Or φ 2m At least the material-dependent image filter or the distance-dependent image filter may be a function of at least one other image filter. The evaluation device determines whether at least one of Φ1 or Φ2 is a function of a feature φ of the other image filter. 1z Or φ 1mand / or whether at least one of Φ1 or Φ2 is a function of at least one other image filter. In particular, the evaluation device may be configured to determine a correlation coefficient between the material-dependent image filter and the distance-dependent image filter. If the correlation coefficient between the material-dependent image filter and the distance-dependent image filter is close to 1 or -1, the distance may be projected by projecting the material feature onto the principal axis with the smallest variance. As an example, the material feature may be projected onto an axis orthogonal to the principal component with which it is correlated. In other words, the material feature can be projected onto a second principal component. This may be done using principal component analysis, as known to those skilled in the art. The evaluation device may be configured to simultaneously apply the distance-dependent image filter and the material-dependent image filter to the reflection image. In particular, the evaluation device may be configured to simultaneously determine features that are strongly correlated with distance and weakly correlated with material properties, and features that are weakly correlated with distance and strongly correlated with material properties. Alternatively, the evaluator may be configured to apply the distance-dependent image filter and the material-dependent image filter sequentially or recursively to the reflected image. 1z and φ 2m The method may be configured to determine at least one of z and / or m by applying at least one further filter to the reflected image that is dependent on at least one of

[0104] As further used herein, the term "evaluation device" generally refers to any device configured to perform the recited operations, preferably by using at least one data processing device, more preferably by using at least one processor and / or at least one application specific integrated circuit. Thus, by way of example, the at least one evaluation device may include at least one data processing device having software code stored thereon that includes a number of computer commands. The evaluation device may provide one or more hardware elements for performing one or more of the recited operations and / or may provide one or more processors having software executing thereon for performing one or more of the recited operations. The above-mentioned operations are performed by the at least one evaluation device, including the analysis of the beam profile. Thus, by way of example, one or more of the above-mentioned relationships may be implemented in software and / or hardware, for example by implementing one or more look-up tables. Thus, the evaluation device may comprise one or more programmable devices, such as one or more computers, application specific integrated circuits (ASICs), digital signal processors (DSPs), or field programmable gate arrays (FPGAs), configured to perform the above-mentioned evaluations. Additionally or alternatively, however, the evaluation device may also be embodied fully or partly in hardware.

[0105] The detector may further include one or more additional elements, such as one or more additional optical elements. Further, the detector may be fully or partially integrated into at least one housing.

[0106] The detector may include at least one optical element selected from the group of at least one lens and / or a transfer device, such as at least one lens system, at least one diffractive optical element. The term "transfer device", also called "transfer system", may generally refer to one or more optical elements adapted to modify a light beam, such as by modifying one or more of the beam parameters of the light beam, the width of the light beam, or the direction of the light beam. The transfer device may be adapted to direct the light beam to a light sensor. The transfer device may specifically include one or more of at least one lens selected from the group consisting of at least one lens, for example at least one lens selected from the group consisting of at least one focusable lens, at least one aspheric lens, at least one spherical lens, at least one Fresnel lens; at least one diffractive optical element; at least one concave mirror; at least one beam deflection element, preferably at least one mirror; at least one beam splitting element, preferably at least one of a beam splitting cube or a beam splitting mirror; at least one multi-lens system. As used herein, the term "focal length" of a transfer device refers to the distance at which the incident parallel light beams that may impinge on the transfer device are focused to a "focus", also called a "focal point". The focal length therefore constitutes an indication of the transfer device's ability to converge the incident light beam. The transfer device may therefore include one or more imaging elements that may have the effect of a focusing lens. By way of example, the transfer device may have one or more lenses, in particular one or more refractive lenses, and / or one or more convex mirrors. In this example, the focal length may be defined as the distance from the center of the thin refractive lens to the principal focus of the thin lens. In the case of a converging thin refractive lens, such as a convex or biconvex thin lens, the focal length may be considered positive and give the distance at which the parallel light impinging on the thin lens as a transfer device may be focused to a single spot. Furthermore, the transfer device may include at least one wavelength-selective element, for example at least one optical filter.Furthermore, the transfer device can be designed to, for example, impose a predefined beam profile on the electromagnetic radiation at the location of the sensor region, in particular at the sensor area. Any of the above-mentioned embodiments of the transfer device can in principle be realised individually or in any desired combination.

[0107] The transfer device may have an optical axis. In particular, the detector and the transfer device have a common optical axis. As used herein, the term "optical axis of the transfer device" generally refers to an axis of mirror symmetry or rotational symmetry of a lens or lens system. The optical axis of the detector may be a line of symmetry of the optical configuration of the detector. The detector has at least one transfer device, preferably at least one transfer system with at least one lens. The transfer system may include, by way of example, at least one beam path, in which the elements of the transfer system in the beam path are arranged rotationally symmetrically with respect to the optical axis. Furthermore, as will also be explained in more detail below, one or more optical elements arranged in the beam path may be off-centered or tilted with respect to the optical axis. However, in this case the optical axis may in turn be defined by interconnecting the centers of the optical elements in the beam path, for example by interconnecting the centers of the lenses, and in this context the optical sensor is not considered as an optical element. The optical axis may generally refer to the beam path. There, the detector may have a single beam path along which the light beam travels from the object to the light sensor, or it may have multiple beam paths. As an example, a single beam path may be provided or the beam path may be divided into two or more partial beam paths. In the latter case, each partial beam path may have its own optical axis. The light sensors may be arranged in one and the same beam path or partial beam paths. Alternatively, however, the light sensors may also be arranged in different partial beam paths.

[0108] The transfer device may configure a coordinate system where the longitudinal coordinate l is the coordinate along the optical axis and d is the spatial offset from the optical axis. The coordinate system may be a polar coordinate system where the optical axis of the transfer device forms the z-axis and the distance and polar angle from the z-axis may be used as additional coordinates. Directions parallel or anti-parallel to the z-axis may be considered as longitudinal directions and the coordinate along the z-axis may be considered as longitudinal coordinate l. Any direction perpendicular to the z-axis may be considered as transverse directions and the polar coordinate and / or polar angle may be considered as transverse coordinates.

[0109] As mentioned above, the detector may allow to determine at least one longitudinal coordinate of the object, including the option of determining the longitudinal coordinate of the entire object or one or more parts of the object. For example, the detector may be configured to determine the longitudinal coordinate of the object by using at least one distance-dependent filter using depth from photon ratio and / or depth from defocus techniques, as outlined above. The detector may be configured to determine the position of the object. As used herein, the term "position" refers to at least one item of information regarding the position and / or orientation of the object and / or at least a part of the object in space. The distance may be a longitudinal coordinate or may contribute to determining the longitudinal coordinate of a point of the object. Additionally or alternatively, one or more other items of information regarding the position and / or orientation of the object and / or at least a part of the object may be determined. As an example, at least one lateral coordinate of the object and / or at least a part of the object may further be determined. The position of the object may therefore refer to the longitudinal coordinate of the object and / or at least a part of the object. Additionally or alternatively, the position of the object may refer to at least one lateral coordinate of the object and / or at least a part of the object. Additionally or alternatively, the position of the object may refer to at least one orientation information of the object, indicating the orientation of the object in space.

[0110] In addition, however, other coordinates of the object, including one or more lateral and / or rotational coordinates, may be determined by the detector, in particular the evaluation device. Thus, by way of example, one or more lateral sensors may be used to determine at least one lateral coordinate of the object. At least one of the optical sensors may determine whether a central signal arises therefrom. This may provide information about at least one lateral coordinate of the object, where, by way of example, a simple lens equation may be used for the optical transformation and derivation of the lateral coordinate. Additionally or alternatively, one or more additional lateral sensors may be used and may be included by the detector. Various lateral sensors, such as those disclosed in WO2014 / 097181A1 and / or other position sensing devices (PSDs), such as, for example, quadrant diodes, CCD or CMOS chips, are generally known in the art. Additionally or alternatively, by way of example, the detector according to the invention may comprise one or more PSDs as disclosed in RAStreet (ed.): Technology and Applications of Amorphous Silicon, Springer-Verlag Heidelberg, 2010, pp. 346-349. Other embodiments are possible. These devices may generally be implemented in the detector according to the invention. By way of example, a part of the light beam may be split in the detector by at least one beam splitting element. The split part may be guided towards a lateral sensor, such as, by way of example, a CCD or CMOS chip or a camera sensor, and a lateral position of a light spot generated by the split part on the lateral sensor may be determined, thereby determining at least one lateral coordinate of the object. The detector according to the invention may thus be a one-dimensional detector, such as a simple distance measuring device, or may be embodied as a two-dimensional detector or even as a three-dimensional detector. Also, a three-dimensional image may be generated by scanning a scene or environment in one dimension, as described above or in more detail below. Thus, the detector according to the invention may in particular be one of a one-dimensional detector, a two-dimensional detector or a three-dimensional detector.The evaluation device may be further configured to determine at least one lateral coordinate x, y of the object. The evaluation device may be adapted to combine the information of the longitudinal and lateral coordinates to determine the position of the object in space.

[0111] The use of a matrix of light sensors offers several advantages and benefits. Thus, the center of the light spot generated by the light beam on the sensor element, for example on the light-sensitive area of ​​the light sensor of the matrix of sensor elements, can vary depending on the lateral position of the object. The use of a matrix of light sensors therefore offers considerable flexibility with respect to the position of the object, in particular with respect to the lateral position of the object. The lateral position of the light spot on the matrix of light sensors, for example the lateral position of at least one light sensor generating a sensor signal, can be used as an additional item of information, from which at least one item of information regarding the lateral position of the object can be derived, for example as disclosed in WO 2014 / 198629 A1. Additionally or alternatively, the detector according to the invention can comprise at least one additional lateral detector for detecting at least one lateral coordinate of the object in addition to the at least one longitudinal coordinate.

[0112] The present invention in a further aspect discloses a detector for identifying at least one material property m, said detector comprising: - at least one sensor element comprising a matrix of light sensors, each of said light sensors having a light-sensitive area, said sensor element being configured to record at least one reflected image of a light beam emanating from at least one object; at least one evaluation device configured to determine material properties by evaluating at least one beam profile of said reflected images, The evaluation device derives at least one distance feature φ by applying at least one distance-dependent image filter Φ1 to the reflection image. 1z

[0023] The method is configured to determine The distance dependent image filter may be a depth filter from photon ratio; a depth filter from defocus; or a linear combination thereof; or |ρ Ф1other,Фz |≧0.40(Ф z is a depth filter from the photon ratio or a depth filter from the defocus or a linear combination thereof) by a further distance-dependent image filter Φ, which is correlated to the depth filter from the photon ratio and / or the depth filter from the defocus or a linear combination thereof 1other , and at least one filter selected from the group consisting of: The evaluation device determines at least one material characteristic φ by applying at least one material-dependent image filter Φ2 to the reflection image. 2m

[0023] The method is configured to determine The material dependent image filter may be a brightness filter; a spot shape filter; a squared norm gradient; a standard deviation; a smoothness filter such as a Gaussian filter or a median filter; a gray level generation based contrast filter; a gray level generation based energy filter; a gray level generation based uniformity filter; a gray level generation based dissimilarity filter; a rho energy filter; a threshold domain filter; or a linear combination thereof; or |ρ Ф2other,Фm |≧0.40(Ф m a further material dependent image filter Φ, which is correlated by one of the following linear combinations: intensity filter, spot shape filter, squared norm gradient, standard deviation, smoothness filter, gray level generation based energy filter, gray level generation based uniformity filter, gray level generation based dissimilarity filter, Rho's energy filter, or threshold domain filter; or a linear combination thereof; to one or more of the following linear combinations: intensity filter, spot shape filter, squared norm gradient, standard deviation, smoothness filter, gray level generation based energy filter, gray level generation based uniformity filter, gray level generation based dissimilarity filter, Rho's energy filter, or threshold domain filter; 2other , and at least one filter selected from the group consisting of: The evaluation device detects the distance feature φ 1zand the material characteristic φ 2m an evaluation device configured to determine the vertical coordinate z and the material property m by evaluating Includes.

[0113] For definitions and embodiments, please refer to the description of the detector described in the first aspect of the invention.

[0114] The present invention in a further aspect discloses a detector for identifying at least one material property m, said detector comprising: - at least one sensor element comprising a matrix of light sensors, each of said light sensors having a light-sensitive area, said sensor element being configured to record at least one reflected image of a light beam emanating from at least one object; at least one evaluation device configured to determine material properties by evaluating at least one beam profile of said reflected images, The evaluation device derives at least one distance feature φ by applying at least one distance-dependent image filter Φ1 to the reflection image. 1z

[0023] The method is configured to determine The distance dependent image filter may be a depth filter from photon ratio; a depth filter from defocus; or a linear combination thereof; or |ρ Ф1other,Фz |≧0.40(Ф z is a depth filter from the photon ratio or a depth filter from the defocus or a linear combination thereof) by a further distance-dependent image filter Φ, which is correlated to the depth filter from the photon ratio and / or the depth filter from the defocus or a linear combination thereof 1other , and at least one filter selected from the group consisting of: The evaluation device determines at least one material characteristic φ by applying at least one material-dependent image filter Φ2 to the reflection image. 2m

[0023] The method is configured to determine the material dependent image filter is at least one filter that passes hypothesis testing; the hypothesis testing uses a null hypothesis that the filter does not distinguish between material classes and an alternative hypothesis that the filter distinguishes between at least two material classes, the filter passes the hypothesis testing if a p-value, p, is less than or equal to a predefined significance level; The evaluation device detects the distance feature φ 1z and the material characteristic φ 2m an evaluation device configured to determine the vertical coordinate z and the material property m by evaluating Includes.

[0115] For definitions and embodiments, please refer to the description of the detector described in the first aspect of the invention.

[0116] In a further aspect of the invention, a detector system for determining the position of at least one object is disclosed. The detector system comprises at least one detector according to the invention, for example according to one or more embodiments disclosed above or according to one or more embodiments disclosed in more detail below. The detector system further comprises at least one beacon device adapted to direct at least one light beam to the detector, the beacon device being at least one of attachable to, holdable by, and integral to the object. Further details regarding the beacon device, including potential embodiments thereof, are described below. Thus, the at least one beacon device may be or may include at least one active beacon device, including one or more illumination sources, such as one or more light sources, such as lasers, LEDs, light bulbs, and the like. By way of example, the light emitted by the illumination source may have a wavelength of 300-500 nm. Alternatively, as mentioned above, the infrared spectral range may be used, for example in the range of 780 nm to 3.0 μm. In particular, the near infrared range may be used, in which silicon photodiodes are applicable, particularly in the range of 700 nm to 1000 nm. The light emitted by the one or more beacon devices may be unmodulated or modulated as described above in order to distinguish between two or more light beams. Additionally or alternatively, at least one beacon device may be adapted to reflect one or more light beams towards a detector, for example by comprising one or more reflecting elements. Furthermore, at least one beacon device may be or include one or more scattering elements adapted to scatter the light beam, where elastic or inelastic scattering can be used. In case at least one beacon device is adapted to reflect and / or scatter a primary light beam towards a detector, the beacon device may be adapted to not affect the spectral characteristics of the light beam, or may be adapted to modify the spectral characteristics of the light beam, for example by modifying the wavelength of the light beam.

[0117] In a further aspect of the invention, a human machine interface for exchanging at least one information item between a user and a machine is disclosed. The human machine interface comprises at least one detector system according to the embodiments disclosed above and / or according to one or more of the embodiments disclosed in more detail below, wherein at least one beacon device is adapted to be directly or indirectly attached to and / or held by the user. The human machine interface is designed to determine at least one position of the user by means of the detector system, the human machine interface being designed to assign at least one information item to said position.

[0118] In a further aspect of the invention, an entertainment device for performing at least one entertainment function is disclosed. The entertainment device comprises at least one human machine interface according to the embodiments disclosed above and / or according to one or more of the embodiments disclosed in more detail below. The entertainment device is configured to allow a player to input at least one piece of information via the human machine interface. The entertainment device is further configured to change the entertainment function in response to the information.

[0119] In a further aspect of the invention, a tracking system for tracking a position of at least one movable object is disclosed. The tracking system comprises at least one detector system according to one or more of the embodiments referring to the detector system as disclosed above and / or disclosed in more detail below. The tracking system further comprises at least one tracking controller. The tracking controller is adapted to track a series of positions of the object at a particular point in time.

[0120] In a further aspect of the invention, a camera for imaging at least one object is disclosed, the camera comprising at least one detector according to any one of the embodiments disclosed above or referring to the detectors disclosed in more detail below.

[0121] In a further aspect of the present invention, a scanning system for determining a depth profile of a scene, which may also mean determining at least one position of at least one object, is provided. The scanning system comprises at least one detector according to the present invention, for example at least one detector as disclosed in one or more of the above embodiments and / or as disclosed in one or more of the following embodiments. The scanning system further comprises at least one illumination source adapted to scan the scene with at least one light beam, called an illumination light beam or a scanning light beam. As used herein, the term "scene" generally refers to a two- or three-dimensional area visible by the detector, such that at least one geometric or spatial characteristic of the two- or three-dimensional area can be evaluated by the detector. As further used herein, the term "scanning" generally refers to successive measurements in different areas. Thus, scanning may specifically mean at least one first measurement with an illumination light beam directed or oriented in a first manner and at least one second measurement with an illumination light beam directed or oriented in a second manner different from the first manner. Scanning may be a continuous scan or a stepwise scan. Thus, in a continuous or stepwise manner, the illuminating light beam can be directed to different areas of the scene, which the detector can detect to generate at least one information item for each area, such as at least one longitudinal coordinate. As an example, to scan an object, one or more illuminating light beams can generate light spots on the surface of the object in a continuous or stepwise manner, for which longitudinal coordinates are generated. However, alternatively, light patterns can be used for scanning. Scanning may be point scanning or line scanning, or even scanning with more complex light patterns. The illumination source of the scanning system may be different from any illumination source of the detector. However, alternatively, the illumination source of the scanning system may be completely or partially identical to or integrated with at least one illumination source of the detector.

[0122] Thus, the scanning system may have at least one illumination source adapted to emit at least one light beam configured to illuminate at least one dot located on at least one surface of at least one object. As used herein, the term "dot" refers to a portion of the surface of an object, particularly a small area, selected for example by a user of the scanning system and illuminated by an illumination source. Preferably, the dot may present, on the one hand, a size as small as possible so that the scanning system can determine as accurately as possible the value of the distance between the illumination source included in the scanning system and the surface portion of the object on which the dot may be located, and, on the other hand, a size as large as possible so that the user of the scanning system or the scanning system itself can detect the presence of the dot on the relevant portion of the surface of the object, particularly by an automatic procedure.

[0123] For this purpose, the irradiation source may comprise an artificial irradiation source, in particular at least one laser source, and / or at least one incandescent lamp, and / or at least one semiconductor light source, for example at least one light emitting diode, in particular an organic and / or inorganic light emitting diode. By way of example, the light emitted by the irradiation source may have a wavelength of 300-500 nm. Additionally or alternatively, light in the infrared spectral range, such as in the range of 780 nm to 3.0 μm, may be used. In particular, light in the near infrared range part, in particular in the range of 700 nm to 1000 nm, for which silicon photodiodes are applicable, may be used. Due to their generally defined beam profile and other characteristics of ease of handling, the use of at least one laser source as irradiation source is particularly preferred. Here, the use of a single laser source may be preferred, in particular when it is important to provide a compact scanning system that can be easily stored and transported by the user. The irradiation source may therefore preferably be a constituent part of the detector and may therefore be integrated in the detector, in particular in the housing of the detector. In a preferred embodiment, the housing of the scanning system, in particular, may comprise at least one display configured to provide distance related information to a user in an easy to read manner. In a further preferred embodiment, the housing of the scanning system, in particular, may further comprise at least one button configured to operate at least one function related to the scanning system, such as setting one or more operation modes. In a further preferred embodiment, the housing of the scanning system, in particular, may further comprise at least one fastening unit that may be configured to fasten the scanning system to a further surface, such as rubber feet, a base plate or a wall holder, such as a base plate or a wall holder comprising a magnetic material, in particular to improve the accuracy of the distance measurement and / or the handling of the scanning system by a user.

[0124] In particular, the illumination source of the scanning system may thus emit a single laser beam configured to illuminate a single dot located on the surface of the object. By using at least one of the detectors according to the invention, at least one item of information regarding the distance between the at least one dot and the scanning system may thus be generated. Thereby, preferably, the distance between the illumination system included by the scanning system and the single dot generated by the illumination source may be determined, for example by using an evaluation device included by the at least one detector. However, the scanning system may further comprise an additional evaluation system, which may be specifically adapted for this purpose. Alternatively or additionally, the size of the scanning system may be taken into account, in particular the size of the housing of the scanning system, and thus the distance between a particular point on the housing of the scanning system, for example the leading edge or the trailing edge of the housing, and the single dot may alternatively be determined. The illumination source may be adapted to generate and / or project the point cloud, for example the illumination source may comprise one or more of at least one digital light processing projector, at least one LCoS projector, at least one spatial light modulator; at least one diffractive optical element; at least one array of light emitting diodes; at least one array of laser light sources.

[0125] Alternatively, the illumination source of the scanning system can emit two separate laser beams configured to provide a respective angle, such as a right angle, between the emission directions of the beams, so that two separate dots located on the surface of the same object or on two different surfaces of two different objects can be illuminated. However, other values ​​of the respective angles between the two separate laser beams can also be possible. This feature can be employed in particular for indirect measurement functions, such as for deriving an indirect distance, for example when direct access is not possible due to the presence of one or more obstacles between the scanning system and the dot, or when it is otherwise difficult to reach. By way of example, it may thus be possible to determine a value for the height of an object by measuring two separate distances and deriving the height using the Pythagorean formula. In particular, in order to be able to maintain a predetermined level with respect to the object, the scanning system can further comprise at least one level unit, in particular an integrated bubble vial, which can be used by the user to maintain the predetermined level.

[0126] As a further alternative, the illumination source of the scanning system can emit a plurality of individual laser beams, such as an array of laser beams that can exhibit a respective pitch, in particular a regular pitch relative to one another, and an array of laser beams arranged to generate an array of dots located on at least one surface of at least one object. For this purpose, specially adapted optical elements such as beam splitters and mirrors may be provided, which may allow the generation of the described array of laser beams. In particular, the illumination source can be directed to scan an area or volume by redirecting the light beam in a periodic or aperiodic manner using one or more movable mirrors.

[0127] In this way, the scanning system may provide a static arrangement of one or more dots arranged on one or more surfaces of one or more objects. Alternatively, the illumination source of the scanning system, in particular one or more laser beams such as the array of laser beams mentioned above, may be configured to provide one or more light beams that can exhibit a time-varying intensity and / or whose emission direction can be alternatingly changed over time by moving one or more mirrors, such as the micromirrors included in the array of micromirrors mentioned in particular. As a result, the illumination source may be configured to image-scan a portion of at least one surface of at least one object by using one or more light beams with alternating characteristics generated by at least one illumination source of the scanning system. In particular, the scanning system may thus use at least one row scan and / or line scan to sequentially or simultaneously scan one or more surfaces of one or more objects. The scanning system may thus be adapted to measure angles by measuring three or more dots, or the scanning system may be adapted to measure corners or narrow areas, such as roof gables, that are difficult to access using a conventional measuring stick. By way of non-limiting example, the scanning system may be used in a safety laser scanner, for example in a production environment, and / or in a three-dimensional scanning device used to determine the shape of an object, for example in connection with 3D printing, body scanning, quality control, etc., in construction applications, for example as a range finder, in logistics applications, for example to determine the size or volume of a package, in household applications, for example as a robotic vacuum cleaner or lawn mower, or in other types of applications that may include a scanning step. By way of non-limiting example, the scanning system may be used in industrial safety curtain applications. By way of non-limiting example, the scanning system may be used to perform wiping, vacuuming, mopping, or waxing functions, or yard or garden care functions, such as mowing or raking.As a non-limiting example, the scanning system can use an LED illumination source with collimated optics and can be adapted to shift the frequency of the illumination source to a different frequency for more accurate results and / or use filters to attenuate certain frequencies while transmitting others. As a non-limiting example, the scanning system and / or illumination source can be rotated as a whole using dedicated motors, or only certain optical packages such as mirrors, beam splitters, etc., can be rotated so that the scanning system can have a full 360 degree field of view during operation, or can move or rotate out of plane to further expand the scanning range. Furthermore, the illumination source can be actively pointed in a predetermined direction. Furthermore, slip rings, optical data transmission, or inductive coupling can be used to enable rotation of the wired electrical system.

[0128] As a non-limiting example, the scanning system may be mounted on a tripod and pointed at an object or area having several corners and surfaces. One or more flexibly movable laser sources are mounted on the scanning system. The one or more laser sources are moved so that they illuminate the points of interest. The positions of the illumination points relative to the scanning system are measured upon pressing a designated button on the scanning system, and the position information is transmitted to the mobile phone via a wireless interface. The position information is stored in an application on the mobile phone. The laser source is moved to illuminate further points of interest, and their positions are measured and transmitted to the mobile phone application. The mobile phone application can convert the set of points into a 3D model by connecting adjacent points with planes. The 3D model can be stored and further processed. Distances and / or angles between the measured points or surfaces may be displayed on a display mounted on the scanning system or on the mobile phone to which the position information is transmitted.

[0129] As a non-limiting example, the scanning system may comprise two or more flexibly movable laser sources for projecting points and one more movable laser source for projecting a line. The line may be used to position two or more laser spots along the line, and the display of the scanning system may display the distance between the two or more laser spots, which may be positioned, for example, equidistant along the line. In the case of two laser spots, a single laser source may be used, and the distance of the projected points is changed using one or more beam splitters or prisms, where the beam splitters or prisms can be moved so that the projected spots move apart or closer together. Furthermore, the scanning system may be adapted to project further patterns, such as right angles, circles, squares, triangles, etc., along which measurements can be made by projecting laser spots and measuring their positions.

[0130] As a non-limiting example, the scanning system can be adapted as a line scanning device. In particular, the scanning system can have at least one line or row of sensors. Triangulation systems require a sufficient baseline since detection becomes impossible in the near field. Near field detection can be possible if the laser spot is tilted towards the transfer device. However, tilting causes the light spot to move out of the field of view limiting detection in the far field region. Such near field and far field problems can be solved by using a detector according to the invention. In particular, the detector can include a CMOS line of light sensors. The scanning system can be adapted to detect multiple light beams propagating from the object to the detector on the CMOS line. The light beams can be generated at different positions on the object or can be generated by the movement of the illumination source. The scanning system can be adapted to determine at least one longitudinal coordinate for each of the light points, as described above and in more detail below.

[0131] As a non-limiting example, the scanning system may be adapted to support operations using tools such as wood or metal working tools such as saws, drills, etc. The scanning system may thus be adapted to measure distances in two opposite directions and display the two measured distances or the sum of the distances on the display. Furthermore, the scanning system may be adapted to measure the distance to the edge of the surface such that when the scanning system is placed on the surface, the laser point is automatically moved away from the scanning system along the surface until the distance measurement shows an abrupt change due to a corner or edge of the surface. This allows measuring the distance to the end of the board with the scanning device placed on the board but away from its edge. Furthermore, the scanning system may measure the distance to the end of the board in one direction and project a line or circle or point at a specified distance in the opposite direction. The scanning system may be adapted to project a line or circle or point at a distance depending on the measured distance in the opposite direction, for example depending on a predetermined total distance. This allows operating a tool such as a saw or drill at the projected position while placing the scanning system at a safe distance from the tool and at the same time carrying out processing with the tool at a predetermined distance to the end of the board. Furthermore, the scanning system may be adapted to project a point or a line etc. in two opposite directions at a given distance: when the sum of the distances is changed, only one of the projected distances is changed.

[0132] As a non-limiting example, the scanning system may be adapted to be placed on a surface, such as a surface on which a task such as cutting, sawing, drilling, etc. is to be performed, and to project a line onto the surface at a predetermined distance that is adjustable, such as by a button on the scanning system.

[0133] By way of non-limiting examples, the scanning system may be used in, for example, safety laser scanners in production environments, and / or in three-dimensional scanning devices used to determine the shape of objects, for example in connection with 3D printing, body scanning, quality control, etc., in construction applications, for example as a range finder, in logistics applications, for example to determine the size or volume of a package, in household applications, for example as a robotic vacuum cleaner or lawn mower, or in other types of applications that may include a scanning step.

[0134] The transfer device can be designed to provide the light propagating from the object to the detector, preferably continuously, to the light sensor. This can be done optionally by imaging or by non-imaging properties of the transfer device. In particular, the transfer device can be designed to collect the electromagnetic radiation before it is provided to the light sensor. The transfer device can be a component part of at least one arbitrary light illumination source, in whole or in part, for example by an illumination source designed to provide a light beam with defined optical properties, for example a light beam with a defined or precisely known beam profile, for example at least one linear combination of Gaussian beams, in particular at least one laser beam with a known beam profile.

[0135] For potential embodiments of any irradiation source, reference can be made to WO2012 / 110924A1. Furthermore, other embodiments are possible. The light leaving the object can originate from the object itself, but can optionally have another origin and propagate from this origin to the object and then towards the lateral and / or longitudinal light sensor. The latter case is realized, for example, by the at least one irradiation source being used. This irradiation source can be, or include, for example, an ambient irradiation source and / or can be, or include, an artificial irradiation source. By way of example, the detector itself can include at least one irradiation source, for example at least one laser and / or at least one incandescent lamp and / or at least one semiconductor irradiation source, for example at least one light emitting diode, in particular organic and / or inorganic light emitting diode. Due to their generally defined beam profile and other properties of handleability, the use of one or more lasers as the irradiation source or part thereof is particularly preferred. The irradiation source itself can be a constituent part of the detector or can be formed independently of the detector. The irradiation source can in particular be integrated into the detector, for example into the housing of the detector. Alternatively or additionally, the at least one illumination source may also be integrated into at least one beacon device, or one or more beacon devices, and / or the object, or may be connected or spatially coupled to the object.

[0136] The light leaving any one or more beacon devices can therefore leave the illumination source and / or be excited by the illumination source, instead of or in addition to the option that said light originates from the respective beacon device itself. By way of example, the electromagnetic light leaving the beacon device can be emitted by the beacon device itself and / or reflected by the beacon device and / or scattered by the beacon device before it is fed to the detector. In this case, the emission and / or scattering of the electromagnetic radiation can take place without or with influence of the spectrum of the electromagnetic radiation. Thus, by way of example, a wavelength shift can occur during scattering, for example by Stokes or Raman. Furthermore, the emission of light can be excited, for example, by a primary illumination source, for example an object or a partial area of ​​the object that is excited to produce luminescence, in particular phosphorescence and / or fluorescence. In principle, other emission processes are also possible. If reflection occurs, the object can have, for example, at least one reflection area, in particular at least one reflection surface. The reflective surface may be part of the object itself, but may also be, for example, a reflector connected or spatially coupled to the object, e.g., a reflector plate connected to the object. If at least one reflector is used, it may also be considered as part of the detector connected to the object, e.g., independently of other components of the detector.

[0137] The beacon device and / or at least one optional irradiation source can generally emit light in at least one of the following: ultraviolet spectral range, preferably in the range of 200 nm to 380 nm; visible spectral range (380 nm to 780 nm); infrared spectral range, preferably in the range of 780 nm to 3.0 micrometers, more preferably in the part of the near infrared range applicable to silicon photodiodes, specifically in the range of 700 nm to 1000 nm. For thermal imaging applications, the target can emit light in the far infrared spectral range, preferably in the range of 3.0 micrometers to 20 micrometers. For example, the at least one irradiation source is adapted to emit light in the visible spectral range, preferably in the range of 500 nm to 780 nm, most preferably in the range of 650 nm to 750 nm, or in the range of 690 nm to 700 nm. For example, the at least one irradiation source is adapted to emit light in the infrared spectral range. However, other options are possible.

[0138] The supply of the light beam to the light sensor can be carried out in particular such that a light spot, for example having a circular, elliptical or differently shaped cross section, is generated on any sensor area of ​​the light sensor. By way of example, the detector can have a visual range, in particular a solid angle range and / or a spatial range, in which an object can be detected. Preferably, the transfer device can be designed in such a way that the light spot is located on the sensor region and / or on the sensor area of ​​the light sensor, for example when an object is located within the visual range of the detector. By way of example, the sensor area can be selected to have a corresponding size to ensure this condition.

[0139] In a further aspect, the present invention discloses a method for determining at least one material property of at least one object by using at least one detector according to the present invention, the method comprising the following steps: a) determining at least one reflected image of an object by using at least one sensor element having a matrix of optical sensors, each optical sensor having a light-sensitive area; b) determining material properties by evaluating at least one beam profile of said reflected image by using at least one evaluation device, said evaluation comprising: b1) applying at least one distance-dependent image filter Φ1 to the reflection image to obtain at least one distance feature φ 1z and determining |ρ|, wherein the distance dependent image filter is a depth filter from photon ratio; a depth filter from defocus; or a linear combination thereof; or Ф1other,Фz |≧0.40(Ф z is a depth filter from the photon ratio or a depth filter from the defocus or a linear combination thereof) by a further distance-dependent image filter Φ, which is correlated to the depth filter from the photon ratio and / or the depth filter from the defocus or a linear combination thereof 1other , at least one distance feature φ, which is at least one filter selected from the group consisting of 1z and determining b2) applying at least one material-dependent image filter Φ2 to the reflection image to obtain at least one material characteristic φ 2m and determining |ρ|, wherein the material dependent image filter is a brightness filter; a spot shape filter; a squared norm gradient; a standard deviation; a smoothness filter such as a Gaussian filter or a median filter; a gray level generation based contrast filter; a gray level generation based energy filter; a gray level generation based uniformity filter; a gray level generation based dissimilarity filter; a rho energy filter; a threshold domain filter; or a linear combination thereof; or |ρ Ф2other,Фm |≧0.40(Ф ma further material dependent image filter Φ, which is correlated by one of the following linear combinations: intensity filter, spot shape filter, squared norm gradient, standard deviation, smoothness filter, gray level generation based energy filter, gray level generation based uniformity filter, gray level generation based dissimilarity filter, Rho's energy filter, or threshold domain filter; or a linear combination thereof; to one or more of the following linear combinations: intensity filter, spot shape filter, squared norm gradient, standard deviation, smoothness filter, gray level generation based energy filter, gray level generation based uniformity filter, gray level generation based dissimilarity filter, Rho's energy filter, or threshold domain filter; 2other At least one material characteristic φ, which is at least one filter selected from the group consisting of 2m and determining b3) the distance feature φ 1z and the material characteristic φ 2m determining the vertical coordinate z and the material property m by evaluating Includes.

[0140] The method steps may be performed in a given order or in a different order. Furthermore, there may be one or more additional method steps not listed. Furthermore, one, more than one, or even all of the method steps may be performed repeatedly. For details, options, and definitions, reference may be made to the detectors described above. Thus, in particular, as described above, the method may include the use of a detector according to the invention, such as according to one or more embodiments given above or in more detail below.

[0141] In a further aspect, the present invention discloses a method for determining at least one material property of at least one object by using at least one detector according to the present invention, said method comprising the following steps: a) determining at least one reflected image of an object by using at least one sensor element having a matrix of optical sensors, each optical sensor having a light-sensitive area; b) determining material properties by evaluating at least one beam profile of said reflected image by using at least one evaluation device, said evaluation comprising: b1) applying at least one distance-dependent image filter Φ1 to the reflection image to obtain at least one distance feature φ 1z and determining |ρ Ф1other,Фz |≧0.40(Ф z is a depth filter from the photon ratio or a depth filter from the defocus or a linear combination thereof) by a further distance-dependent image filter Φ, which is correlated to the depth filter from the photon ratio and / or the depth filter from the defocus or a linear combination thereof 1other , at least one distance feature φ, which is at least one filter selected from the group consisting of 1z and determining b2) applying at least one material-dependent image filter Φ2 to the reflection image to obtain at least one material characteristic φ 2m and determining at least one material feature φ, the material dependent image filter comprising at least one filter that passes hypothesis testing using a null hypothesis in which the filter does not distinguish between material classes and an alternative hypothesis in which the filter distinguishes between at least two material classes, the filter passing the hypothesis testing if a p-value p is less than or equal to a predefined significance level. 2m and determining b3) the distance feature φ 1z and the material characteristic φ 2m determining the vertical coordinate z and the material property m by evaluating Includes.

[0142] The method steps may be performed in a given order or in a different order. Furthermore, there may be one or more additional method steps not listed. Furthermore, one, more than one, or even all of the method steps may be performed repeatedly. For details, options, and definitions, reference may be made to the detectors described above. Thus, in particular, as described above, the method may include the use of a detector according to the invention, such as according to one or more embodiments given above or in more detail below.

[0143] In a further aspect, the present invention discloses a method for determining at least one material property of at least one object using at least one detector according to the present invention, the method comprising the following steps: a) determining at least one reflected image of an object by using at least one sensor element having a matrix of optical sensors, each optical sensor having a light-sensitive area; b) determining material properties by evaluating at least one beam profile of said reflected image by using at least one evaluation device, said evaluation comprising: b1) applying at least one distance-dependent image filter Φ1 to the reflection image to obtain at least one distance feature φ 1z and determining |ρ Ф1other,Фz |≧0.40(Ф z is a depth filter from the photon ratio or a depth filter from the defocus or a linear combination thereof) by a further distance-dependent image filter Φ, which is correlated to the depth filter from the photon ratio and / or the depth filter from the defocus or a linear combination thereof 1other , at least one distance feature φ, which is at least one filter selected from the group consisting of 1z and determining b2) applying at least one material-dependent image filter Φ2 to the reflection image to obtain at least one material characteristic φ 2m and determining b3) the distance feature φ 1z and the material characteristic φ 2m determining the vertical coordinate z and the material property m by evaluating Includes.

[0144] The method steps may be performed in a given order or in a different order. Furthermore, there may be one or more additional method steps not listed. Furthermore, one, more than one, or even all of the method steps may be performed repeatedly. For details, options, and definitions, reference may be made to the detectors described above. Thus, in particular, as described above, the method may include the use of a detector according to the invention, such as according to one or more embodiments given above or in more detail below.

[0145] In a further aspect of the invention, the use of a detector according to the invention, such as according to one or more embodiments given above or in more detail below, is proposed for use purposes selected from the group consisting of: position measurement in traffic technology; entertainment applications; security applications; surveillance applications; safety applications; human-machine interface applications; tracking applications; photography applications; imaging or camera applications; mapping applications for generating at least one spatial map; homing or tracking beacon detectors for vehicles; outdoor applications; mobile applications; communication applications; machine vision applications; robotics applications; quality control applications; manufacturing applications.

[0146] The object may generally be animate or non-animate. The detector or detector system may include at least one object, whereby the object forms part of the detector system. However, preferably, the object is capable of moving independently of the detector in at least one spatial dimension. The object may generally be any object. In one embodiment, the object may be a rigid object. Other embodiments are possible, for example, the object is a non-rigid object or an object that can change its shape.

[0147] Regarding further uses of the detectors and devices of the present invention, reference is made to WO2018 / 091649A1, WO2018 / 091638A1 and WO2018 / 091640A1, the contents of which are incorporated by reference.

[0148] In particular, the present application may be applied to the field of photography. Thus, the detector may be part of a photography device, in particular a digital camera. In particular, the detector may be used for 3D photography, in particular digital 3D photography. Thus, the detector may form or be part of a digital 3D camera. As used herein, the term "photography" generally refers to a technique for acquiring image information of at least one object. As further used herein, a "camera" generally refers to a device configured to perform photography. As further used herein, the term "digital photography" generally refers to a technique for acquiring image information of at least one object by using a plurality of photosensitive elements configured to generate electrical signals, preferably digital electrical signals, indicative of the intensity and / or color of illumination. As further used herein, the term "3D photography" generally refers to a technique for acquiring image information of at least one object in a three-dimensional space. Thus, a 3D camera is a device configured to perform 3D photography. A camera may generally be configured to acquire a single image, e.g. a single 3D image, or may be configured to acquire a plurality of images, e.g. a series of images. Thus, the camera may be a video camera configured for video applications, such as for acquiring digital video sequences.

[0149] Thus, in general, the present invention further refers to a camera, in particular a digital camera, more particularly a 3D camera or a digital 3D camera, for imaging at least one object. As outlined above, the term "imaging", as used herein, generally refers to acquiring image information of at least one object. The camera comprises at least one detector according to the present invention. The camera may be configured to acquire a single image, as outlined above, or may be configured to acquire a plurality of images, such as an image sequence, preferably a digital video sequence. Thus, by way of example, the camera may be or include a video camera. In the latter case, the camera preferably comprises a data memory for storing the image sequence.

[0150] As used in the present invention, the expression "position" generally refers to at least one item of information relating to the absolute position and orientation of one or more points of an object. In particular, the position may therefore be determined in the coordinate system of the detector, for example a Cartesian coordinate system. However, additionally or alternatively, other types of coordinate systems may also be used, for example a polar coordinate system and / or a spherical coordinate system.

[0151] As outlined above and in more detail below, the present invention may preferably be applied in the field of human-machine interfaces, in the field of sports and / or in the field of computer games. Preferably, the object may therefore be selected from the group consisting of sports equipment, preferably selected from the group consisting of rackets, clubs and bats, clothing, hats and shoes. Other embodiments are also possible.

[0152] With regard to a coordinate system for determining the object position, which may be the coordinate system of the detector, the detector may constitute a coordinate system in which the optical axis of the detector forms the z-axis and in addition x- and y-axes may be provided which are orthogonal to the z-axis and mutually orthogonal. As an example, the detector and / or a part of the detector may be located at a certain point in this coordinate system, such as the origin of this coordinate system. In this coordinate system, a direction parallel or anti-parallel to the z-axis may be considered as a vertical direction and a coordinate along the z-axis may be considered as a vertical coordinate. Any direction perpendicular to the vertical direction may be considered as a horizontal direction and the x- and / or y-coordinates may be considered as horizontal coordinates.

[0153] Alternatively, other types of coordinate systems may be used. Thus, as an example, a polar coordinate system may be used in which the optical axis forms the z-axis and the distance from the z-axis and the polar angle may be used as additional coordinates. Similarly, directions parallel or anti-parallel to the z-axis may be considered as longitudinal directions, and coordinates along the z-axis may be considered as longitudinal coordinates. Any direction perpendicular to the z-axis may be considered as transverse, and polar coordinates and / or polar angles may be considered as transverse coordinates.

[0154] A detector may be a device configured to provide at least one item of information relating to the position of at least one object and / or part thereof. A position may therefore refer to an item of information completely describing the position of an object or part of an object, preferably in the coordinate system of the detector, or to partial information only partially describing the position. A detector may generally be a device configured to detect a light beam, such as a light beam propagating from a beacon device to the detector.

[0155] The evaluation device and the detector may be fully or partially integrated in a single device. Thus, in general, the evaluation device may also form part of the detector. Alternatively, the evaluation device and the detector may be fully or partially embodied as separate devices. The detector may include further components.

[0156] The detector may be a fixed device or a mobile device. Furthermore, the detector may be a stand-alone device or may form part of another device, such as a computer, a vehicle, or any other device. Furthermore, the detector may be a portable device. Other embodiments of the detector are possible.

[0157] The evaluation device may be or include one or more integrated circuits, such as one or more application specific integrated circuits (ASICs), and / or one or more computers, preferably one or more microcomputers, and / or one or more data processing devices, such as a microcontroller, a field compiler array, or a digital signal processor. Additional components may be included, for example one or more processing devices, and / or data acquisition devices, such as one or more devices for receiving and / or pre-processing the sensor signals, such as one or more analog-to-digital converters and / or one or more filters. Furthermore, the evaluation device may comprise one or more measurement devices, such as one or more measurement devices for measuring current and / or voltage. Furthermore, the evaluation device may include one or more data storage devices. Furthermore, the evaluation device may include one or more interfaces, for example one or more wireless interfaces and / or one or more wired interfaces.

[0158] The at least one evaluation device may be configured to execute at least one computer program, such as at least one computer program configured to execute or support one or more or even all of the method steps of the method according to the invention. By way of example, one or more algorithms may be implemented for determining the position of the object by using the sensor signals as input variables.

[0159] The evaluation device can be connected to or can include at least one further data processing device that can be used for one or more of displaying, visualizing, analyzing, disseminating, communicating, or further processing information, such as information obtained by the optical sensor and / or the evaluation device. The data processing device can be connected to or can incorporate at least one of a display, a projector, a monitor, an LCD, a TFT, a loudspeaker, a multi-channel sound system, an LED pattern, or a further visualization device, as examples. It can further be connected to or can incorporate at least one of a communication device or communication interface, connector, or port, which can send encrypted or unencrypted information using one or more of an email, text message, phone, Bluetooth, Wi-Fi, infrared, or Internet interface, port, or connection. It may further be connected to or incorporate at least one of the following: a processor, a graphics processor, a CPU, an Open Multimedia Applications Platform (OMAP®), an integrated circuit, a system on a chip such as an Apple A-series or Samsung S3C2 series product, a microcontroller or microprocessor, one or more memory blocks such as a ROM, a RAM, an EEPROM or a flash memory, a timing source such as an oscillator or a phase locked loop, a counter timer, a real time timer or a power-on-reset-generator, a voltage regulator, a power management circuit or a DMA controller. The individual units may further be connected to or integrated into an Internet of Things or Industry 4.0 type network by a bus such as an AMBA bus.

[0160] The evaluation device and / or the data processing device may be connected by or have an external interface or port such as one or more of a serial or parallel interface or port, USB, Centronics Port, FireWire®, HDMI®, Ethernet®, Bluetooth®, RFID, Wi-Fi, USART or SPI, or an analog interface or port such as one or more of a standardized interface or port to a further device such as a 2D camera device using an ADC or DAC or an RGB interface such as CameraLink. Furthermore, the evaluation device and / or the data processing device may be further connected by one or more of a processor-to-processor interface or port, an FPGA-FPGA-interface or a serial or parallel interface port. Furthermore, the evaluation device and the data processing device may be further connected to one or more of an optical disk drive, a CD-RW drive, a DVD+RW drive, a flash drive, a memory card, a disk drive, a hard disk drive, a solid state disk or a solid state hard disk.

[0161] The evaluation device and / or the data processing device may be connected by or may have one or more further external connectors, such as one or more of the following: phone connector, RCA connector, VGA connector, hermaphroditic connector, USB connector, HDMI® connector, 8P8C connector, BCN connector, IEC60320 C14 connector, optical fiber connector, D-subminiature connector, RF connector, coaxial connector, SCART connector, XLR connector, and / or may incorporate at least one suitable socket for one or more of these connectors.

[0162] Possible embodiments of a single device incorporating one or more of the detectors, evaluation devices, or data processing devices according to the present invention, such as an optical sensor, an optical system, an evaluation device, a communication device, a data processing device, an interface, a system on chip, a display device, or a further electronic device, are a mobile phone, a personal computer, a tablet PC, a television, a game console, or a further entertainment device. In a further embodiment, the 3D camera function outlined in more detail below can be integrated into an available device with a conventional 2D digital camera without any significant difference in the housing or appearance of the device, where the only noticeable difference for the user can be the function of acquiring and / or processing 3D information. Furthermore, the device according to the present invention can be used for a 360-degree digital camera or a surround view camera.

[0163] In particular, embodiments incorporating the detector and / or parts thereof such as an evaluation device and / or a data processing device may be a mobile phone incorporating a display device, a data processing device, a light sensor, any sensor optics, and an evaluation device for the functionality of a 3D camera. The detector according to the invention may be particularly suitable for integration into entertainment devices and / or communication devices such as a mobile phone.

[0164] The human machine interface may include a plurality of beacon devices configured to be directly or indirectly attached to and / or held by a user. Thus, each of the beacon devices may be independently attached to the user by any suitable means, such as by a suitable fastening device. Additionally or alternatively, the user may hold and / or carry the at least one beacon device or one or more of the beacon devices by holding them in his / her hand and / or by wearing at least one beacon device and / or clothing including the beacon device on a body part.

[0165] A beacon device may generally be any device that can be detected by at least one detector and / or any device that facilitates detection by at least one detector. Thus, as outlined above or further below, a beacon device may be an active beacon device configured to generate at least one light beam detected by a detector by having one or more illumination sources for generating at least one light beam. Additionally or alternatively, a beacon device may be designed as a fully or partially passive beacon device, such as by providing one or more reflective elements configured to reflect a light beam generated by a separate illumination source. At least one beacon device may be permanently or temporarily attached to a user in a direct or indirect manner and / or carried or held by the user. Attachment may be performed by the user himself, for example, by using one or more attachment means and / or by holding at least one beacon device in the hand of the user and / or by the user wearing the beacon device.

[0166] Additionally or alternatively, the beacon device is at least one of those attached to an object and those integrated into an object held by a user, which should be included in the option of the user holding the beacon device in the sense of the present invention. Thus, as outlined in more detail below, the beacon device may be part of a human-machine interface and may be held or carried by a user and may be attached to or integrated into a control element, the orientation of which may be recognized by a detector device. Thus, in general, the present invention also refers to a detector system that includes at least one detector device according to the present invention and may further include at least one object, where the beacon device is at least one of those attached to an object, held by the object, and integrated into the object. As an example, the object may preferably form a control element, the orientation of which may be recognized by a user. Thus, the detector system may be part of a human-machine interface, as outlined above or as outlined in more detail below. As an example, the user may handle the control element in a certain way in order to transmit one or more information to the machine, such as to transmit one or more commands to the machine.

[0167] Alternatively, the detector system may be used in other ways. Thus, by way of example, the object of the detector system may be different from the user or a part of the user's body, and may be, by way of example, an object that moves independently of the user. By way of example, the detector system may be used to control an apparatus and / or an industrial process, such as a manufacturing process and / or a robotics process. Thus, by way of example, the object may be a machine and / or a machine part, such as a robot arm, whose orientation may be detected by using the detector system.

[0168] The human machine interface may be configured such that the detector device generates at least one item of information related to the position of the user or to the position of at least one body part of the user. In particular, by evaluating the position of at least one beacon device, if the manner in which said beacon device is attached to the user is known, at least one item of information related to the position and / or orientation of the user or of the body part of the user may be obtained.

[0169] The beacon device is preferably one of a beacon device that can be attached to a user's body or a body part of a user and a beacon device that can be held by a user. As outlined above, the beacon device can be designed as a fully or partially active beacon device. Thus, the beacon device can include at least one illumination source configured to generate at least one light beam, preferably at least one light beam with known beam characteristics, that is transmitted to the detector. Additionally or alternatively, the beacon device can include at least one reflector configured to reflect the light generated by the illumination source and thereby generate a reflected light beam that is transmitted to the detector.

[0170] The object that may form part of the detector system may generally have any shape. Preferably, the object that is part of the detector system may be a control element that may be handled by a user, such as manually, as described above. By way of example, the control element may be or include at least one element selected from the group consisting of gloves, jackets, hats, shoes, trousers and suits, hand-held sticks, bats, clubs, rackets, whips, toys such as toy guns. Thus, by way of example, the detector system may be part of a human machine interface and / or entertainment device.

[0171] As used herein, an entertainment device is a device capable of serving the leisure and / or entertainment purposes of one or more users, hereinafter also referred to as one or more players. As an example, an entertainment device may serve the purpose of gaming, preferably computer gaming. Thus, an entertainment device may be implemented in a computer, computer network, or computer system, or may include a computer, computer network, or computer system that executes one or more gaming software programs.

[0172] The entertainment device includes at least one human-machine interface according to the invention, such as according to one or more embodiments disclosed above and / or according to one or more embodiments disclosed below. The entertainment device is designed to allow at least one information item to be input by a player using the human-machine interface. The at least one information item can be transmitted to and / or used by a controller and / or computer of the entertainment device. The at least one information item can preferably include at least one command configured to influence the progress of a game. Thus, by way of example, the at least one information item can include at least one item of information regarding at least one orientation of the player and / or one or more body parts of the player, thereby allowing the player to simulate a specific position and / or orientation and / or action required for gaming. By way of example, one or more of the following movements can be simulated and transmitted to the controller and / or computer of the entertainment device: dancing; running; jumping; swinging a racket; swinging a bat; swinging a club; aiming an object at another object, such as aiming a toy gun at a target.

[0173] The entertainment device is preferably designed such that the controller and / or the computer of the entertainment device are partly or entirely designed to modify the entertainment functions in response to the information. Thus, as described above, the progress of the game can be influenced in response to at least one item of information. The entertainment device may thus comprise one or more controllers separate from the evaluation device of the at least one detector and / or one or more controllers which are completely or partly identical to the at least one evaluation device or which may even comprise the at least one evaluation device. Preferably, the at least one controller comprises one or more data processing devices, such as one or more computers and / or microcontrollers.

[0174] Further as used herein, a "tracking system" is a device configured to collect information on a series of past positions of at least one object and / or at least a part of an object. Furthermore, the tracking system may be configured to provide information on at least one predicted future position and / or orientation of at least one object or at least a part of an object. The tracking system comprises at least one tracking controller, which may be fully or partially embodied as an electronic device, preferably as at least one data processing device, more preferably as at least one computer or microcontroller. Again, the at least one tracking controller may comprise fully or partially at least one evaluation device and / or may be part of at least one evaluation device and / or may be fully or partially identical to at least one evaluation device.

[0175] The tracking system includes at least one detector according to the present invention, such as at least one detector as disclosed in one or more embodiments listed above and / or as disclosed in one or more embodiments below. The tracking system further includes at least one tracking controller. The tracking controller is configured to track a series of positions of the object at a particular point in time, such as by recording data or groups of data pairs, each of which includes at least one positional information and at least one time information.

[0176] The tracking system may further comprise at least one detector system according to the invention. Thus, in addition to the at least one detector and the at least one evaluation device and optionally at least one beacon device, the tracking system may further comprise the object itself or a part thereof, for example at least one control element comprising a beacon device or at least one beacon device, which control element may be directly or indirectly attached to or integrated into the tracked object.

[0177] The tracking system may be configured to initiate one or more actions of the tracking system itself and / or of one or more separate devices. For the latter purpose, the tracking system, preferably the tracking controller, may have one or more wireless and / or wired connection interfaces and / or other types of control connections for initiating at least one action. Preferably, at least one tracking controller may be configured to initiate at least one action according to at least one actual position of the object. By way of example, the action may be selected from the group consisting of: predicting the future position of the object; pointing at least one device to the object; pointing at least one device to the detector; illuminating the object; illuminating the detector.

[0178] As an example of an application of the tracking system, the tracking system can be used to continuously direct at least one first object to at least one second object even if the first object and / or the second object are moving. Also possible examples can be found in industrial applications such as robotics and / or continuous operations on objects even if they are moving, such as during production in a manufacturing or assembly line. Additionally or alternatively, the tracking system can be used for illumination purposes, such as continuously illuminating an object by continuously directing an illumination source at the object, even though the object may be moving. Further applications can be found in communication systems, such as for continuously transmitting information to a moving object by directing a transmitter at the moving object.

[0179] In a further aspect of the invention, an inertial measurement unit for use in an electronic device is disclosed. The inertial measurement unit is adapted to receive data determined by at least one detector according to the invention. The inertial measurement unit is further adapted to receive data determined by at least one further sensor selected from the group consisting of: wheel speed sensor, rotational speed sensor, tilt sensor, orientation sensor, motion sensor, magnetohydrodynamic sensor, force sensor, angle sensor, angular velocity sensor, magnetic field sensor, magnetometer, accelerometer; gyroscope. The inertial measurement unit is adapted to determine at least one characteristic of the electronic device selected from the group consisting of position in space, relative or absolute motion in space, rotation, acceleration, direction, angular position, tilt, rate of rotation, speed by evaluating the data from the detector and the at least one further sensor.

[0180] The inertial measurement unit may include a detector according to the invention and / or may be connected to said detector via at least one data connection. The evaluation device and / or the at least one processing device of the inertial measurement unit may be configured to determine at least one combined distance information, in particular by using at least one recursive filter. The recursive filter may be configured to determine the combined distance information taking into account further sensor data, such as further sensor data from further sensors of the inertial measurement unit, and / or further parameters. For the definition and embodiments of the inertial measurement unit, please refer to the description of the detector.

[0181] Overall, in the context of the present invention, the following embodiments are considered preferred.

[0182] Embodiment 1: A detector for identifying at least one material property m, comprising: - at least one sensor element comprising a matrix of light sensors, each of said light sensors having a light-sensitive area, said sensor element being configured to record at least one reflected image of a light beam originating from at least one object; at least one evaluation device configured to determine said material properties by evaluating at least one beam profile of said reflected images, The evaluation device derives at least one distance feature φ by applying at least one distance-dependent image filter Φ1 to the reflection image. 1z and the distance dependent image filter is configured to determine a depth filter from photon ratio; a depth filter from defocus; or a linear combination thereof; or |ρ Ф1other,Фz a further distance-dependent image filter Φ correlated to the depth filter from photon ratio and / or the depth filter from defocus by |≧0.40 or a linear combination thereof 1other , where Φ zis one of the depth filter from photon ratio or the depth filter from defocus or a linear combination thereof, The evaluation device determines at least one material characteristic φ by applying at least one material-dependent image filter Φ2 to the reflection image. 2m the material dependent image filter being configured to determine |ρ Ф2other,Фm a further material dependent image filter Φ correlated by |≧0.40 to one or more of the intensity filter, spot shape filter, squared norm gradient, standard deviation, smoothness filter, gray level generation based energy filter, gray level generation based uniformity filter, gray level generation based dissimilarity filter, low energy filter, or threshold area filter, or linear combinations thereof; 2other , where Φ m is one of a brightness filter, a spot shape filter, a squared norm gradient, a standard deviation, a smoothness filter, a gray level generation based energy filter, a gray level generation based uniformity filter, a gray level generation based dissimilarity filter, a rho energy filter, or a threshold domain filter, or a linear combination thereof; The evaluation device detects the distance feature φ 1z and the material characteristic φ 2m an evaluation device configured to determine the vertical coordinate z and the material property m by evaluating a detector.

[0183] Embodiment 2: A detector according to the preceding embodiment, wherein the material dependent image filter is at least one filter that passes hypothesis testing using a null hypothesis where the filter does not distinguish between material classifications and an alternative hypothesis where the filter distinguishes between at least two material classifications, and the filter passes hypothesis testing if a p-value, p, is less than or equal to a predefined significance level.

[0184] Embodiment 3: A detector according to the preceding embodiments, wherein p≦0.075, preferably p≦0.05, more preferably p≦0.025, and most preferably p≦0.01.

[0185] Embodiment 4: A detector according to any one of the preceding embodiments, wherein the at least one material property is a property selected from the group consisting of scattering coefficient, translucency, transparency, deviation from Lambertian surface reflectance, speckle, and the like.

[0186] Embodiment 5: The further distance-dependent image filter Φ 1other is |ρ Ф1other,Фz |≧0.60, preferably |ρ Ф1other,Фz | ≧ 0.80, the distance-dependent image filter Φ z 4. A detector according to any one of the preceding embodiments, wherein the detector is correlated with one or more of the following:

[0187] Embodiment 6: The further material-dependent image filter Φ 2other is |ρ Ф2other,Фm |≧0.60, preferably |ρ Ф2othe,Фm | 0.80, the material dependent image filter Φ m 4. A detector according to any one of the preceding embodiments, wherein the detector is correlated with one or more of the following:

[0188] Embodiment 7: The material property m and / or the vertical coordinate z are determined by φ 1z , φ 2m 4. A detector according to any one of the preceding embodiments, wherein the a,b,c,d,e,i,j ...i,j,i,

[0189] Embodiment 8: The material property m and / or the vertical coordinate z are determined by a function z(φ 1z ,φ 2m ) and / or function m(φ 1z ,φ 2m 3. A detector according to any one of the preceding embodiments, wherein the detector is determined by:

[0190] Embodiment 9: A detector according to any one of the preceding embodiments, wherein the evaluation device is configured to simultaneously apply a distance-dependent image filter and the material-dependent image filter to the reflected image.

[0191] Embodiment 10: The evaluation device is configured to evaluate whether at least one of Φ1 or Φ2 is a feature of another image filter, φ 1z Or φ 1m or whether at least one of Φ1 or Φ2 is a function of at least one other image filter, and the evaluation device is configured to sequentially or recursively apply the distance-dependent image filter and the material-dependent image filter to the reflected image.

[0192] Embodiment 11: The evaluation device is φ 1z and / or φ 2m 4. A detector according to any preceding embodiment, configured to determine at least one of z and / or m by applying at least one further filter to the reflected image, the filter being dependent on at least one of

[0193]

[0036] Embodiment 12: The depth filter from photon ratios comprises evaluating a combined signal Q from at least two sensor signals of the sensor elements, the evaluation device being configured to derive the combined signal Q by one or more of dividing the sensor signals, dividing a multiple of the sensor signals, or dividing a linear combination of the sensor signals, and the evaluation device is configured to calculate the combined signal Q and the distance feature φ. 1z At least one predetermined relationship between the distance feature φ 1z4. A detector according to any one of the preceding embodiments, configured for use in determining

[0194] Embodiment 13: The evaluation device is configured to derive a combined signal Q according to the following formula:

[0195]

number

[0196] Embodiment 14: A detector according to the preceding embodiment, wherein the photosensitive area is configured such that a first sensor signal has information of a first area of ​​a beam profile and a second sensor signal has information of a second area of ​​a beam profile, and the first area of ​​the beam profile and the second area of ​​the beam profile are one or both of adjacent areas or overlapping areas.

[0197] Embodiment 15: A detector according to the preceding embodiment, wherein the evaluation device is configured to determine the first area of ​​the beam profile and the second area of ​​the beam profile, the first area of ​​the beam profile having substantially edge information of the beam profile and the second area of ​​the beam profile having substantially center information of the beam profile, the edge information including information related to the number of photons in the first area of ​​the beam profile and the center information including information related to the number of photons in the second area of ​​the beam profile.

[0198]

[0041] Embodiment 16: The depth from defocus filter includes using at least one convolution-based algorithm, such as a depth from defocus algorithm, and the evaluation unit is configured to evaluate at least one blurring function f a By optimizing the distance feature φ 1z 4. A detector according to any one of the preceding embodiments, configured to determine a blurring function, the blurring function being optimized by varying parameters of the at least one blurring function.

[0199] Embodiment 17: The reflected image is a blurred image i b and the evaluation device evaluates the blurred image i b and the blurring function f a from the distance feature φ 1z and configured to reconstruct the distance feature φ 1z is at least one further image i' b The blurred image i is obtained by varying the parameter σ of the blurring function using b and the blurring function f a Minimize the difference between the convolutions of

number

[0200] Embodiment 18: The at least one blurring function f a 4. A detector according to any one of the two preceding embodiments, wherein x is a function or a composite function composed of at least one function from the group consisting of a Gaussian function, a Sinc function, a pillbox function, a square function, a Lorentz function, a radial function, a polynomial, a Hermite polynomial, a Zernike polynomial, a Legendre polynomial.

[0201] Embodiment 19: A detector according to any one of the preceding embodiments, wherein the sensor element includes at least one CMOS sensor.

[0202] Embodiment 20: A detector according to any one of the preceding embodiments, wherein the detector has at least one illumination source configured to generate at least one illumination pattern for illumination of the object, the illumination pattern comprising at least one pattern selected from the group consisting of at least one dot pattern, in particular a pseudo-random dot pattern; a random dot pattern or a quasi-random pattern; at least one Sobol pattern; at least one quasi-periodic pattern; at least one pattern having at least one a priori known feature; at least one regular pattern; at least one triangular pattern; at least one hexagonal pattern; at least one rectangular pattern; at least one pattern having a convex uniform tiling; at least one line pattern having at least one line; at least one line pattern having at least two lines, such as parallel or intersecting lines.

[0203] Embodiment 21: A detector according to the preceding embodiment, wherein the illumination source comprises at least one laser source and at least one diffractive optical element.

[0204] Embodiment 22: A detector according to any one of the previous two embodiments, wherein the detector comprises at least two sensor elements each having a matrix of light sensors, at least one first sensor element and at least one second sensor element being arranged at different spatial positions, and the evaluation device is configured to select at least one image determined by the first sensor element or the second sensor element as a reflected image and to select at least one image determined by the other one of the first sensor element or the second sensor element as a reference image.

[0205]

[0046] Embodiment 23: The evaluation device is configured to select at least one reflectance feature of the reflectance image, the evaluation device selecting a distance feature φ 1zand an error interval ±ε, the evaluation device is configured to determine at least one distance estimate of the selected reflection feature of the reflection image given by ε, the evaluation device is configured to determine at least one displacement region in the reference image corresponding to the distance estimate, the evaluation device is configured to match the selected reflection feature with at least one reference feature within the displacement region, the evaluation device is configured to determine a displacement of the matched reference feature and the selected reflection feature, and the evaluation device is configured to determine a vertical coordinate of the matched feature using a predetermined relationship between the vertical coordinate and the displacement.

[0206] Embodiment 24: The reference image and the reflected image are images of an object determined at different spatial positions having a certain distance, the evaluation device is adapted to determine an epipolar line in the reference image, the displacement region extends along the epipolar line, and the evaluation device is adapted to determine the distance feature φ 1z and determining an extent of the displacement region along the epipolar line corresponding to the error interval ±ε.

[0207] Embodiment 25: A detector for identifying at least one material property m, comprising: - at least one sensor element comprising a matrix of light sensors, each of said light sensors having a light-sensitive area, said sensor element being configured to record at least one reflected image of a light beam originating from at least one object; at least one evaluation device configured to determine said material properties by evaluating at least one beam profile of said reflected images, The evaluation device derives at least one distance feature φ by applying at least one distance-dependent image filter Φ1 to the reflection image. 1zand the distance dependent image filter is configured to determine a depth filter from photon ratio; a depth filter from defocus; or a linear combination thereof; or |ρ Ф1other,Фz a further distance-dependent image filter Φ correlated to the depth filter from photon ratio and / or the depth filter from defocus by |≧0.40 or a linear combination thereof 1other , where Φ z is one of the depth filter from photon ratio or the depth filter from defocus or a linear combination thereof, The evaluation device determines at least one material characteristic φ by applying at least one material-dependent image filter Φ2 to the reflection image. 2m the material dependent image filter is configured to determine at least one filter that passes hypothesis testing using a null hypothesis where the filter does not distinguish between material classes and an alternative hypothesis where the filter distinguishes between at least two material classes, the filter passes the hypothesis testing if a p-value p is less than or equal to a predefined significance level; The evaluation device detects the distance feature φ 1z and the material characteristic φ 2m an evaluation device configured to determine the vertical coordinate z and the material property m by evaluating a detector.

[0208] Embodiment 26: A detector according to any preceding embodiment, wherein the hypothesis validation is based on a dataset of beam profile images, each beam profile image corresponding to a material classification and a distance.

[0209] Embodiment 27: A detector according to any one of embodiments 25 and 26, wherein p≦0.075, preferably p≦0.05, more preferably p≦0.025, most preferably p≦0.01.

[0210] Embodiment 28: A detector according to any one of embodiments 25 to 27, wherein the at least one material property is a property selected from the group consisting of scattering coefficient, translucency, transparency, deviation from Lambertian surface reflection, speckle, etc.

[0211] Embodiment 29: The further distance-dependent image filter Φ 1other is |ρ Ф1other,Фz |≧0.60, preferably |ρ Ф1other,Фz | ≧ 0.80, the distance-dependent image filter Φ z 29. The detector according to any one of embodiments 25 to 28, wherein the detector is correlated with one or more of the following:

[0212] Embodiment 30: The further material-dependent image filter Φ 2other is |ρ Ф2other,Фm |≧0.60, preferably |ρ Ф2othe,Фm Material-dependent image filter Φ | ≧ 0.80 m 30. The detector according to any one of embodiments 25 to 29, wherein the detector is correlated with one or more of the following:

[0213] Embodiment 31: The material dependent image filter is a brightness filter; a spot shape filter; a squared norm gradient; a standard deviation; a smoothness filter such as a Gaussian filter or a median filter; a gray level generation based contrast filter; a gray level generation based energy filter; a gray level generation based uniformity filter; a gray level generation based dissimilarity filter; a rho energy filter; a threshold domain filter; or a linear combination thereof; or |ρ Ф2other,Фm a further material dependent image filter Φ correlated by |≧0.40 to one or more of a brightness filter, a spot shape filter, a squared norm gradient, a standard deviation, a smoothness filter, a gray level generation based energy filter, a gray level generation based uniformity filter, a gray level generation based dissimilarity filter, a low energy filter, or a threshold area filter, or a linear combination thereof; 2other , where Φ mA detector according to any one of embodiments 25 to 30, wherein is a brightness filter, a spot shape filter, a squared norm gradient, a standard deviation, a smoothness filter, a gray level generation based energy filter, a gray level generation based uniformity filter, a gray level generation based dissimilarity filter, a low energy filter, or a threshold region filter, or a linear combination thereof.

[0214]

[0046] Embodiment 32: The material property m and / or the vertical coordinate z are determined by φ 1z , φ 2m 32. A detector according to any one of embodiments 25 to 31, wherein the x, y, and z are determined using a predetermined relationship between the x, y, and z.

[0215]

[0046] Embodiment 33: The material property m and / or the vertical coordinate z are determined by a function z(φ 1z ,φ 2m ) and / or function m(φ 1z ,φ 2m 33. A detector according to any one of embodiments 25 to 32, wherein the detector is determined by:

[0216] Embodiment 34: A detector according to any one of embodiments 25 to 33, wherein the evaluation device is configured to simultaneously apply a distance-dependent image filter and the material-dependent image filter to the reflected image.

[0217]

[0046] Embodiment 35: The evaluation device is configured to evaluate whether at least one of Φ1 or Φ2 is a feature of another image filter, φ 1z Or φ 1m or whether at least one of Φ1 or Φ2 is a function of at least one other image filter, and the evaluation device is configured to apply the distance-dependent image filter and the material-dependent image filter sequentially or recursively to the reflected image.

[0218] Embodiment 36: The evaluation device is φ 1z and φ 2m4. A detector according to any preceding embodiment, configured to determine at least one of z and / or m by applying at least one further filter to the reflected image, the filter being dependent on at least one of

[0219]

[0046] Embodiment 37: The depth filter from photon ratios comprises evaluating a combined signal Q from at least two sensor signals of the sensor elements, the evaluation device being configured to derive the combined signal Q by one or more of dividing the sensor signals, dividing a multiple of the sensor signals, dividing a linear combination of the sensor signals, and the evaluation device is configured to calculate the distance feature φ. 1z To determine 1z 37. A detector according to any one of embodiments 25 to 36, configured to use at least one predetermined relationship between.

[0220] Embodiment 38: The evaluation device is configured to derive the combined signal Q according to the following formula:

number

[0221] Embodiment 39: A detector according to the preceding embodiment, wherein the photosensitive area is configured such that the first sensor signal has information of a first area of ​​a beam profile and the second sensor signal has information of a second area of ​​a beam profile, and the first area of ​​the beam profile and the second area of ​​the beam profile are one or both of adjacent areas or overlapping areas.

[0222] Embodiment 40: A detector according to the preceding embodiment, wherein the evaluation device is configured to determine the first area of ​​the beam profile and the second area of ​​the beam profile, the first area of ​​the beam profile having substantially edge information of the beam profile and the second area of ​​the beam profile having substantially center information of the beam profile, the edge information including information related to the number of photons in the first area of ​​the beam profile and the center information including information related to the number of photons in the second area of ​​the beam profile.

[0223]

[0081] Embodiment 41: The depth from defocus filter includes using at least one convolution-based algorithm, such as a depth from defocus algorithm, and the evaluation unit is configured to calculate at least one blurring function f a By optimizing the distance feature φ 1z 41. A detector according to any one of embodiments 25 to 40, configured to determine a blurring function, the blurring function being optimized by varying parameters of the at least one blurring function.

[0224]

[0081] Embodiment 42: The reflected image is a blurred image i b and the evaluation device evaluates the blurred image i b and the blurring function f a from the distance feature φ 1z and configured to reconstruct the distance feature φ 1z is at least one further image i' b The blurred image i is obtained by varying the parameter σ of the blurring function using b and the blurring function f a Minimize the difference between the convolutions of

number

[0225] Embodiment 43: The at least one blurring function f a 43. A detector according to any one of embodiments 25 to 42, wherein is a function or a composite function composed of at least one function from the group consisting of a Gaussian function, a sinc function, a pillbox function, a square function, a Lorentz function, a radial function, a polynomial, a Hermite polynomial, a Zernike polynomial, a Legendre polynomial.

[0226] Embodiment 44: A detector according to any one of embodiments 25 to 43, wherein the sensor element includes at least one CMOS sensor.

[0227] Embodiment 45: A detector according to any one of embodiments 25 to 44, wherein the detector has at least one illumination source configured to generate at least one illumination pattern for illumination of the object, the illumination pattern comprising at least one pattern selected from the group consisting of at least one dot pattern, in particular a pseudo-random dot pattern; a random dot pattern or a quasi-random pattern; at least one Sobol pattern; at least one quasi-periodic pattern; at least one pattern having at least one a priori known feature; at least one regular pattern; at least one triangular pattern; at least one hexagonal pattern; at least one rectangular pattern; at least one pattern having a convex uniform tiling; at least one line pattern having at least one line; at least one line pattern having at least two lines, such as parallel or intersecting lines.

[0228] Embodiment 46: A detector according to the preceding embodiment, wherein the illumination source comprises at least one laser source and at least one diffractive optical element.

[0229] Embodiment 47: A detector according to any one of the previous two embodiments, wherein the detector comprises at least two sensor elements each having a matrix of light sensors, at least one first sensor element and at least one second sensor element being arranged at different spatial positions, and the evaluation device is configured to select at least one image determined by the first sensor element or the second sensor element as a reflected image and to select at least one image determined by the other one of the first sensor element or the second sensor element as a reference image.

[0230]

[0081] Embodiment 48: The evaluation device is configured to select at least one reflectance feature of the reflectance image, the evaluation device selecting a distance feature φ 1z and an error interval ±ε, the evaluation device is configured to determine at least one distance estimate of the selected reflection feature of the reflection image given by ε, the evaluation device is configured to determine at least one displacement region in the reference image corresponding to the distance estimate, the evaluation device is configured to match the selected reflection feature with the at least one reference feature within the displacement region, the evaluation device is configured to determine a displacement of the matched reference feature and the selected reflection feature, and the evaluation device is configured to determine a vertical coordinate of the matched feature using a predetermined relationship between vertical coordinate and displacement.

[0231] Embodiment 49: The reference image and the reflected image are images of an object determined at different spatial positions having a certain distance, the evaluation device is adapted to determine an epipolar line in the reference image, the displacement region extends along the epipolar line, and the evaluation device is adapted to determine the distance feature φ 1z and determining an extent of the displacement region along the epipolar line corresponding to the error interval ±ε.

[0232] Embodiment 50: A detector for identifying at least one material property m, comprising: - at least one sensor element comprising a matrix of light sensors, each of said light sensors having a light-sensitive area, said sensor element being configured to record at least one reflected image of a light beam originating from at least one object; at least one evaluation device configured to determine said material properties by evaluating at least one beam profile of said reflected images, The evaluation device derives at least one distance feature φ by applying at least one distance-dependent image filter Φ1 to the reflection image. 1z and the distance dependent image filter is configured to determine a depth filter from photon ratio; a depth filter from defocus; or a linear combination thereof; or |ρ Ф1other,Фz a further distance-dependent image filter Φ correlated to the depth filter from photon ratio and / or the depth filter from defocus by |≧0.40 or a linear combination thereof 1other , where Φ z is one of the depth filter from photon ratio or the depth filter from defocus or a linear combination thereof, The evaluation device determines at least one material characteristic φ by applying at least one material-dependent image filter Φ2 to the reflection image. 2m

[0023] The method is configured to determine The evaluation device detects the distance feature φ 1z and the material characteristic φ 2m an evaluation device configured to determine the vertical coordinate z and the material property m by evaluating a detector.

[0233] Embodiment 51: A detector according to the preceding embodiment, wherein the material dependent image filter is at least one filter that passes the hypothesis testing using a null hypothesis in which the filter does not distinguish between material classifications and an alternative hypothesis in which the filter distinguishes between at least two material classifications, and the filter passes the hypothesis testing if a p-value p is less than or equal to a predefined significance level.

[0234] Embodiment 52: A detector according to the preceding embodiment, wherein the hypothesis validation is based on a dataset of beam profile images, each beam profile image corresponding to a material classification and a distance.

[0235] Embodiment 53: A detector according to any one of embodiments 50 and 52, wherein p≦0.075, preferably p≦0.05, more preferably p≦0.025, most preferably p≦0.01.

[0236] Embodiment 54: A detector according to any one of embodiments 50 to 53, wherein the at least one material property is a property selected from the group consisting of scattering coefficient, translucency, transparency, deviation from Lambertian surface reflection, speckle, etc.

[0237] Embodiment 55: The further distance-dependent image filter Φ 1other is |ρ Ф1other,Фz |≧0.60, preferably |ρ Ф1other,Фz | ≧ 0.80, the distance-dependent image filter Φ z 55. A detector according to any one of embodiments 50 to 54, which is correlated with one or more of the following:

[0238] Embodiment 56: The further material-dependent image filter Φ 2other is |ρ Ф2other,Фm |≧0.60, preferably |ρ Ф2othe,Фm | 0.80, the material dependent image filter Φ m 56. A detector according to any one of embodiments 50 to 55, which is correlated with one or more of the following:

[0239] Embodiment 57: The material dependent image filter is a brightness filter; a spot shape filter; a squared norm gradient; a standard deviation; a smoothness filter such as a Gaussian filter or a median filter; a gray level generation based contrast filter; a gray level generation based energy filter; a gray level generation based uniformity filter; a gray level generation based dissimilarity filter; a rho energy filter; a threshold domain filter; or a linear combination thereof; or |ρ Ф2other,Фm a further material dependent image filter Φ correlated by |≧0.40 to one or more of a brightness filter, a spot shape filter, a squared norm gradient, a standard deviation, a smoothness filter, a gray level generation based energy filter, a gray level generation based uniformity filter, a gray level generation based dissimilarity filter, a low energy filter, or a threshold area filter, or a linear combination thereof; 2other , where Φ m A detector according to any one of embodiments 50 to 56, wherein is a brightness filter, a spot shape filter, a squared norm gradient, a standard deviation, a smoothness filter, a gray level generation based energy filter, a gray level generation based uniformity filter, a gray level generation based dissimilarity filter, a low energy filter, or a threshold region filter, or a linear combination thereof.

[0240]

[0046] Embodiment 58: The material property m and / or the vertical coordinate z are determined by φ 1z , φ 2m 58. A detector according to any one of embodiments 50 to 57, wherein the a, b and c are determined using a predetermined relationship between a, b, and c.

[0241]

[0046] Embodiment 59: The material property m and / or the vertical coordinate z are determined by a function z(φ 1z ,φ 2m ) and / or function m(φ 1z ,φ 2m 59. A detector according to any one of embodiments 50 to 58, wherein the detector is determined by:

[0242] Embodiment 60: A detector according to any one of embodiments 50 to 59, wherein the evaluation device is configured to simultaneously apply the distance-dependent image filter and the material-dependent image filter to the reflected image.

[0243]

[0081] Embodiment 61: The evaluation device is configured to evaluate whether at least one of Φ1 or Φ2 is a feature of another image filter, φ 1z Or φ 1m 61. A detector according to any one of embodiments 50 to 60, wherein the evaluation device is configured to determine whether Φ1 or Φ2 is a function of at least one other image filter, and the evaluation device is configured to sequentially or recursively apply the distance-dependent image filter and the material-dependent image filter to the reflected image.

[0244] Embodiment 62: The evaluation device is φ 1z and φ 2m 4. A detector according to any preceding embodiment, configured to determine at least one of z and / or m by applying at least one further filter to the reflected image, the filter being dependent on at least one of

[0245]

[0081] Embodiment 63: The depth filter from photon ratios comprises evaluating a combined signal Q from at least two sensor signals of the sensor elements, the evaluation device being configured to derive the combined signal Q by one or more of dividing the sensor signals, dividing a multiple of the sensor signals, or dividing a linear combination of the sensor signals, and the evaluation device is configured to calculate the combined signal Q and the distance feature φ. 1z At least one predetermined relationship between the distance feature φ 1z 63. A detector according to any one of embodiments 50 to 62, configured for use in determining

[0246] Embodiment 64: The evaluation device is configured to derive the combined signal Q according to the following formula:

number

[0247] Embodiment 65: A detector according to the preceding embodiment, wherein the photosensitive area is configured such that a first sensor signal has information of a first area of ​​a beam profile and a second sensor signal has information of a second area of ​​a beam profile, and the first area of ​​the beam profile and the second area of ​​the beam profile are one or both of adjacent areas or overlapping areas.

[0248] Embodiment 66: A detector according to the preceding embodiment, wherein the evaluation device is configured to determine the first area of ​​the beam profile and the second area of ​​the beam profile, the first area of ​​the beam profile having substantially edge information of the beam profile and the second area of ​​the beam profile having substantially center information of the beam profile, the edge information including information related to the number of photons in the first area of ​​the beam profile and the center information including information related to the number of photons in the second area of ​​the beam profile.

[0249]

[0063] Embodiment 67: The depth from defocus filter includes using at least one convolution-based algorithm, such as a depth from defocus algorithm, and the evaluation unit is configured to calculate at least one blurring function f a By optimizing the distance feature φ 1z 67. A detector according to any one of embodiments 50 to 66, configured to determine a blurring function, the blurring function being optimized by varying parameters of the at least one blurring function.

[0250]

[0068] The reflected image is a blurred image i b and the evaluation device evaluates the blurred image i b and the blurring function f a from the distance feature φ 1z and configured to reconstruct the distance feature φ 1z is at least one further image i' b The blurred image i is obtained by varying the parameter σ of the blurring function using b and the blurring function f a Minimize the difference between the convolutions of

number

[0251] Embodiment 69: The at least one blurring function f a 69. A detector according to any one of embodiments 50 to 68, wherein is a function or a composite function composed of at least one function from the group consisting of a Gaussian function, a sinc function, a pillbox function, a square function, a Lorentz function, a radial function, a polynomial, a Hermite polynomial, a Zernike polynomial, and a Legendre polynomial.

[0252] Embodiment 70: A detector according to any one of embodiments 50 to 69, wherein the sensor element includes at least one CMOS sensor.

[0253] Embodiment 71: A detector according to any one of embodiments 50 to 70, wherein the detector has at least one illumination source configured to generate at least one illumination pattern for illumination of the object, the illumination pattern comprising at least one pattern selected from the group consisting of at least one dot pattern, in particular a pseudo-random dot pattern; a random dot pattern or a quasi-random pattern; at least one Sobol pattern; at least one quasi-periodic pattern; at least one pattern having at least one a priori known feature; at least one regular pattern; at least one triangular pattern; at least one hexagonal pattern; at least one rectangular pattern; at least one pattern having a convex uniform tiling body; at least one line pattern having at least one line; at least one line pattern having at least two lines, such as parallel or intersecting lines.

[0254] Embodiment 72: A detector according to the preceding embodiment, wherein the illumination source comprises at least one laser source and at least one diffractive optical element.

[0255] Embodiment 73: A detector according to any one of the previous two embodiments, wherein the detector comprises at least two sensor elements each having a matrix of light sensors, at least one first sensor element and at least one second sensor element being arranged at different spatial positions, and the evaluation device is configured to select at least one image determined by the first sensor element or the second sensor element as a reflected image and to select at least one image determined by the other one of the first sensor element or the second sensor element as a reference image.

[0256]

[0081] Embodiment 74: The evaluation device is configured to select at least one reflectance feature of the reflectance image, the evaluation device selecting a distance feature φ 1zand an error interval ±ε, the evaluation device is configured to determine at least one distance estimate of the selected reflection feature of the reflection image given by ε, the evaluation device is configured to determine at least one displacement region in the reference image corresponding to the distance estimate, the evaluation device is configured to match the selected reflection feature with at least one reference feature within the displacement region, the evaluation device is configured to determine a displacement of the matched reference feature and the selected reflection feature, and the evaluation device is configured to determine a vertical coordinate of the matched feature using a predetermined relationship between the vertical coordinate and the displacement.

[0257] Embodiment 75: The reference image and the reflected image are images of an object determined at different spatial positions having a certain distance, the evaluation device is adapted to determine an epipolar line in the reference image, the displacement region extends along the epipolar line, and the evaluation device is adapted to determine the distance feature φ 1z and determining an extent of the displacement region along the epipolar line corresponding to the error interval ±ε.

[0258] Embodiment 76: A detector system comprising at least one detector according to any one of embodiments 1 to 24, 25 to 49, or 50 to 75, and further comprising at least one beacon device adapted to direct at least one light beam to the detector, wherein the beacon device is at least one of attachable to an object, holdable by the object, and integral to the object.

[0259] Embodiment 77: A human-machine interface for exchanging at least one item of information between a user and a machine, the human-machine interface comprising at least one detector system according to the preceding embodiment, the at least one beacon device adapted to be at least one of attached directly or indirectly to a user and held by a user, the human-machine interface designed to determine at least one position of the user by means of the detector system, and the human-machine interface designed to assign at least one item of information to the position.

[0260] Embodiment 78: An entertainment device for performing at least one entertainment function, the entertainment device comprising at least one human-machine interface according to the preceding embodiment, the entertainment device designed to enable at least one item of information to be input by a player using the human-machine interface, the entertainment device designed to vary the entertainment function in response to the information.

[0261] Embodiment 79: A tracking system for tracking a position of at least one movable object, the tracking system including at least one detector system according to any one of the preceding embodiments referring to a detector system, the tracking system further including at least one tracking controller, the tracking controller adapted to track a series of positions of the object at a particular point in time.

[0262] Embodiment 80: A scanning system for determining a depth profile of a scene, the scanning system comprising at least one detector according to any one of embodiments 1 to 24, 25 to 49, or 50 to 75, the scanning system further having at least one illumination source adapted to scan the scene with at least one light beam.

[0263] Embodiment 81: A camera for imaging at least one object, comprising at least one detector according to any one of embodiments 1 to 24, 25 to 49, or 50 to 75.

[0264] Embodiment 82: An inertial measurement unit for use in an electronic device, the inertial measurement unit being adapted to receive data determined by at least one detector according to any one of embodiments 1 to 24, 25 to 49, or 50 to 75, the inertial measurement unit being further adapted to receive data determined by at least one further sensor selected from the group consisting of wheel speed sensors, rotational speed sensors, inclination sensors, orientation sensors, motion sensors, magnetohydrodynamic sensors, force sensors, angle sensors, angular velocity sensors, magnetic field sensors, magnetometers, accelerometers; and gyroscopes, the inertial measurement unit being adapted to determine at least one characteristic of the electronic device selected from the group consisting of position in space, relative or absolute motion in space, rotation, acceleration, direction, angular position, tilt, rate of rotation, and speed by evaluating data from the detector and the at least one further sensor.

[0265] Embodiment 83: A method for determining at least one material property of at least one object by using at least one detector according to any one of embodiments 1 to 24, comprising the following steps: a) determining at least one reflected image of the object by using at least one sensor element having a matrix of optical sensors, each optical sensor having a light-sensitive area; b) determining said material properties by evaluating at least one beam profile of said reflected image by using at least one evaluation device, said evaluation comprising: b1) applying at least one distance-dependent image filter Φ1 to the reflection image to obtain at least one distance feature φ 1zand determining |ρ Ф1other,Фz Further distance-dependent image filters Φ correlated to the depth filter from the photon ratio and / or the depth filter from the defocus or a linear combination thereof by |≧0.40 1other , where Φ z is at least one distance feature φ, which is one of a depth filter from photon ratio or a depth filter from defocus or a linear combination thereof; 1z and determining b2) applying at least one material-dependent image filter Φ2 to the reflection image to obtain at least one material characteristic φ 2m and determining |ρ|, wherein the material dependent image filter is a brightness filter; a spot shape filter; a squared norm gradient; a standard deviation; a smoothness filter such as a Gaussian filter or a median filter; a gray level generation based contrast filter; a gray level generation based energy filter; a gray level generation based uniformity filter; a gray level generation based dissimilarity filter; a rho energy filter; a threshold domain filter; or a linear combination thereof; or |ρ| Ф2other,Фm a further material dependent image filter Φ correlated by |≧0.40 to one or more of a brightness filter, a spot shape filter, a squared norm gradient, a standard deviation, a smoothness filter, a gray level generation based energy filter, a gray level generation based uniformity filter, a gray level generation based dissimilarity filter, a low energy filter, or a threshold area filter, or a linear combination thereof; 2other , where Φ mis one of a brightness filter, a spot shape filter, a squared norm gradient, a standard deviation, a smoothness filter, a gray level generation based energy filter, a gray level generation based uniformity filter, a gray level generation based dissimilarity filter, a low energy filter, or a threshold area filter, or a linear combination thereof; 2m and determining b3) the distance feature φ 1z and the material characteristic φ 2m determining the vertical coordinate z and the material property m by evaluating A method comprising:

[0266] Embodiment 84: A method for determining at least one material property of at least one object by using at least one detector according to any one of embodiments 25 to 49, comprising the following steps: a) determining at least one reflected image of the object by using at least one sensor element having a matrix of optical sensors, each optical sensor having a light-sensitive area; b) determining said material properties by evaluating at least one beam profile of said reflected image by using at least one evaluation device, said evaluation comprising: b1) applying at least one distance-dependent image filter Φ1 to the reflection image to obtain at least one distance feature φ 1z and determining |ρ Ф1other,Фz Further distance-dependent image filters Φ correlated to the depth filter from the photon ratio and / or the depth filter from the defocus or a linear combination thereof by |≧0.40 1other , where Φ zis at least one distance feature φ, which is one of a depth filter from photon ratio or a depth filter from defocus or a linear combination thereof; 1z and determining b2) applying at least one material-dependent image filter Φ2 to the reflection image to obtain at least one material characteristic φ 2m and determining at least one material feature φ, the material dependent image filter comprising at least one filter that passes hypothesis testing using a null hypothesis that the filter does not distinguish between material classes and an alternative hypothesis that the filter distinguishes between at least two material classes, the filter passing the hypothesis testing if a p-value p is less than or equal to a predefined significance level. 2m and determining b3) the distance feature φ 1z and the material characteristic φ 2m determining the vertical coordinate z and the material property m by evaluating A method comprising:

[0267] Embodiment 85: A method for determining at least one material property of at least one object by using at least one detector according to any one of embodiments 50 to 75, comprising the following steps: a) determining at least one reflected image of the object by using at least one sensor element having a matrix of optical sensors, each optical sensor having a light-sensitive area; b) determining said material properties by evaluating at least one beam profile of said reflected image by using at least one evaluation device, said evaluation comprising: b1) applying at least one distance-dependent image filter Φ1 to the reflection image to obtain at least one distance feature φ 1z and determining |ρФ1other,Фz Further distance-dependent image filters Φ correlated to the depth filter from the photon ratio and / or the depth filter from the defocus or a linear combination thereof by |≧0.40 1other , where Φ z is at least one distance feature φ, which is one of a depth filter from photon ratio or a depth filter from defocus or a linear combination thereof; 1z and determining b2) applying at least one material-dependent image filter Φ2 to the reflection image to obtain at least one material characteristic φ 2m and determining b3) the distance feature φ 1z and the material characteristic φ 2m determining the vertical coordinate z and the material property m by evaluating A method comprising:

[0268] Embodiment 86: Use of at least one detector according to any one of embodiments 1 to 24, 25 to 49, or 50 to 75, wherein the purpose of use is selected from the group consisting of position measurement in traffic technology, entertainment applications, security applications, surveillance applications, safety applications, human-machine interface applications, logistics applications, tracking applications, outdoor applications, mobile applications, communication applications, photography applications, machine vision applications, robotics applications, quality control applications, manufacturing applications. [Brief description of the drawings]

[0269] Further optional details and features of the invention are evident from the following description of preferred exemplary embodiments in conjunction with the dependent claims. In this context, certain features may be implemented individually or in combination with other features. The invention is not limited to the exemplary embodiments. The exemplary embodiments are illustrated diagrammatically in the figures. Identical references in the individual figures refer to identical elements or elements with identical functions or elements which correspond to each other in terms of their functions.

[0270] Specifically, in the following diagram: [Figure 1] FIG. 1 illustrates an embodiment of a detector according to the present invention. [Diagram 2] FIG. 13 shows statistics of material signatures resulting from a spot-shaped material dependent image filter applied to a dataset. [Diagram 3] FIG. 13 shows a beam profile image. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0271] 1 shows in a highly schematic manner an embodiment of a detector 110 for identifying at least one material property m of at least one object 112. The detector 110 comprises at least one sensor element 116 having a matrix 118 of light sensors 120. Each of the light sensors 120 has a light-sensitive area 122.

[0272] The sensor elements 116 may be formed as an integral single device or as a combination of several devices. The matrix 118 may be or include a rectangular matrix, in particular having one or more rows and one or more columns. The rows and columns may be arranged in a rectangular manner. However, other arrangements are possible, such as non-rectangular arrangements. As an example, a circular arrangement is also possible, where the elements are arranged in concentric circles or ellipses around a central point. For example, the matrix 118 may be a single row of pixels. Other arrangements are possible.

[0273] The light sensors 120 of the matrix 118 may in particular be equal in size, sensitivity, and / or other optical, electrical and mechanical properties. The light-sensitive areas 122 of all light sensors 120 of the matrix 118 may in particular be arranged in a common plane, which preferably faces the object 112 such that a light beam propagating from the object to the detector 110 generates a light spot on said common plane. The light-sensitive areas 122 may in particular be located on the surface of each light sensor 120. However, other embodiments are also feasible. The light sensors 120 may, for example, comprise at least one CCD and / or CMOS device. By way of example, the light sensors 120 may be part of or constitute a pixelated optical device. By way of example, the light sensors 120 may be part of or constitute at least one CCD and / or CMOS device having a matrix of pixels, each pixel forming a light-sensitive area 122.

[0274] The light sensor 120 may in particular be or include a light detector, preferably an inorganic light detector, more preferably an inorganic semiconductor light detector, most preferably a silicon light detector. In particular, the light sensor 120 may have sensitivity in the infrared spectral range. All of the light sensors 120 of the matrix 118, or at least a group of the light sensors 120 of the matrix 118, may in particular be identical. A group of identical light sensors 120 of the matrix 118 may in particular be provided for different spectral ranges, or all light sensors may be identical in terms of their spectral sensitivity. Furthermore, the light sensors 120 may be identical in terms of size and / or their electronic or optoelectronic properties. The matrix 118 may be composed of independent light sensors 120. Thus, a matrix 118 of inorganic photodiodes may be composed. However, alternatively, commercially available matrices may be used, such as one or more of CCD detectors, such as CCD detector chips, and / or CMOS detectors, such as CMOS detector chips.

[0275] The light sensors 120 may form a sensor array or may be part of a sensor array such as the matrix mentioned above. Thus, by way of example, the detector 110 may comprise an array of light sensors 120, such as a rectangular array having m rows and n columns, where m, n are independently positive integers. Preferably, two or more columns and two or more rows are provided, i.e. n>1, m>1. Thus, by way of example, n may be between 2 and 16 or more, and m may be between 2 and 16 or more. Preferably, the ratio of the number of rows to the number of columns is close to 1. By way of example, n and m may be selected such that 0.3≦m / n≦3, such as by choosing m / n=1:1, 4:3, 16:9 or the like. By way of example, the array may be a square array with equal numbers of rows and columns, such as by choosing m=2, n=2 or m=3, n=3, etc.

[0276] The matrix 118 may specifically be a rectangular matrix having at least one row, preferably multiple rows and multiple columns. By way of example, the rows and columns may be oriented in a substantially perpendicular direction. To provide a wide field of view, the matrix 118 may specifically have at least 10 rows, preferably at least 50 rows, more preferably at least 100 rows. Similarly, the matrix may have at least 10 columns, preferably at least 50 columns, more preferably at least 100 columns. The matrix 118 may have at least 50 photosensors 120, preferably at least 100 photosensors 120, more preferably at least 500 photosensors 120. The matrix 118 may include a number of pixels in the range of several megapixels. However, other embodiments are also possible.

[0277] The detector 110 further comprises an illumination source 124. By way of example, the illumination source 124 may be configured to generate an illumination light beam 126 for illuminating the object 112. The detector 110 may be configured such that the illumination light beam 126 propagates from the detector 110 towards the object 112 along an optical axis 128 of the detector 110. To this end, the detector 110 may include at least one reflective element, preferably at least one prism, for deflecting the illumination light beam onto the optical axis 128.

[0278] The illumination source 124 may include at least one light source. The illumination source 124 may include multiple light sources. The illumination source 124 may include an artificial illumination source, in particular at least one laser source, and / or at least one incandescent lamp, and / or at least one semiconductor light source, for example at least one light emitting diode, in particular an organic and / or inorganic light emitting diode. By way of example, the light emitted by the illumination source 124 may have a wavelength of 300 to 1100 nm, in particular 500 to 1100 nm. Additionally or alternatively, light in the infrared spectral range, such as in the range of 780 nm to 3.0 μm, may be used. In particular, light in the near infrared range part, in particular in the range of 700 nm to 1100 nm, where silicon photodiodes are applicable, may be used. Using light in the near infrared range allows light to be undetectable or only weakly detectable by the human eye, but detectable by silicon sensors, in particular standard silicon sensors. The illumination source 124 may be adapted to emit light at a single wavelength. In other embodiments, the illumination may be adapted to emit light having multiple wavelengths allowing additional measurements in other wavelength channels. The light source may be or include at least one multi-beam light source. For example, the illumination source may include at least one laser source and one or more diffractive optical elements (DOEs).

[0279] In particular, the illumination source 124 may comprise at least one laser and / or laser source. Various types of lasers may be employed, such as semiconductor lasers, double heterostructure lasers, external cavity lasers, separate confinement heterostructure lasers, quantum cascade lasers, distributed Bragg reflector lasers, polariton lasers, hybrid silicon lasers, extended cavity diode lasers, quantum dot lasers, volume Bragg grating lasers, indium arsenide lasers, transistor lasers, diode pumped lasers, distributed feedback lasers, quantum well lasers, interband cascade lasers, gallium arsenide lasers, semiconductor ring lasers, extended cavity diode lasers, or vertical cavity surface emitting lasers. Additionally or alternatively, non-laser light sources, such as LEDs and / or light bulbs, may be used. The illumination source 124 may include one or more diffractive optical elements (DOEs) adapted to generate an illumination pattern. For example, the illumination source may be adapted to generate and / or project a point cloud, for example, the illumination source 124 may include one or more of at least one digital light processing projector, at least one LCoS projector, at least one spatial light modulator, at least one diffractive optical element, at least one array of light emitting diodes, at least one array of laser light sources. Considering their generally defined beam profile and other characteristics of handleability, the use of at least one laser source as the illumination source is particularly preferred. The illumination source 124 may be integrated into the housing of the detector 110.

[0280] The illumination light beam 126 can propagate from the object 112 towards the detector 110. The detector may be used in active and / or passive illumination scenarios. For example, the at least one illumination source 124 may be adapted to illuminate the object 112, for example, by shining a light beam towards the object 112, which reflects the light beam. In addition to or as an alternative to the at least one illumination source 124, the detector 110 may use radiation already present in the scene, such as from at least one ambient light source.

[0281] The illumination source 124 may illuminate the at least one object 112 with at least one illumination pattern. The illumination pattern may include a number of points as image features. These points are shown as light beams 126 emerging from the illumination source 124.

[0282] The detector 110 may include a transfer device 129 including one or more of at least one lens selected from the group consisting of at least one adjustable focus lens, at least one aspheric lens, at least one spherical lens, at least one Fresnel lens, at least one diffractive optical element, at least one concave mirror, at least one beam deflecting element, preferably at least one mirror, at least one beam splitting element, preferably at least one of a beam splitting cube or a beam splitting mirror, at least one multi-lens system, for example. In particular, the transfer device 129 may include at least one collimating lens adapted to focus at least one object point in the image plane.

[0283] Each optical sensor 120 may be designed to generate at least one sensor signal in response to illumination of the respective photosensitive area 122 by a reflected light beam 130 propagating from the object 112 to the detector 110. The sensor elements 116 may be configured to determine at least one reflected image of at least one reflective feature generated by the reflected light beam 130 on the optical sensor 120. The reflected image may be data recorded using the sensor elements 116, such as a number of electronic readings from an imaging device, such as the pixels of the sensor elements 116. The reflected image itself may include pixels of the image that correlate with the pixels of the matrix 118 of the sensor elements 116. The matrix 118 may include the reflected image 126. For example, in case of illumination by a point pattern, the reflected image may include points as reflective features. These points may be due to the reflected light beam 130 emanating from at least one object 112.

[0284] The sensor element 116 may be configured to record a beam profile of at least one reflection feature of the reflection image. The detector 110 comprises at least one evaluation device 132. The evaluation device 132 may be configured to identify and / or select at least one reflection feature, in particular at least one light spot, of the reflection image provided by the sensor element 116. The evaluation device 132 may be configured to perform at least one image analysis and / or image processing in order to identify the reflection feature. The image analysis and / or image processing may use at least one feature detection algorithm. Image analysis and / or image processing may include: filtering; selecting at least one region of interest; forming a difference image between an image generated by the sensor signal and at least one offset; inverting the sensor signal by inverting the image generated by the sensor signal; forming a difference image between images generated by the sensor signal at different times; background correction; decomposition into color channels; decomposition into hue; saturation; luminance channel; frequency decomposition; singular value decomposition; applying a blob detector; applying a corner detector; applying a determinant of a Hessian filter; applying principal curvature based region detector; applying maximally stable extremum region detector; applying a generalized Hough transform; applying a ridge detector; applying an affine invariant feature detector; applying an affine adaptive interest point operator; applying a Harris affine region detector; applying a Hessian affine region detector; applying a scale invariant feature transform ; applying a scale space extremum detector; applying a local feature detector; applying a fast robust feature algorithm; applying a histogram of gradient position and orientation algorithm; applying a histogram of oriented gradient descriptors; applying a Deriche edge detector; applying a differential edge detector; applying a space-time interest point detector; applying a Moravec corner detector; applying a Canny edge detector; applying a Laplace operator of a Gaussian filter; applying a differential Gaussian filter; applying a Sobel operator; applying a Laplace operator; applying a Schall operator; applying a Prewitt operator; applying a Roberts operator; applying a Kirsch operator; applying a high pass filter; applying a low pass filter; applying a Fourier transform; applying a Radon transform; applying a Hough transform; applying a wavelet transform; thresholding; and generating a binary image.In particular, evaluating the reflected image includes selecting a region of interest in the reflected image, which may be determined manually by a user or automatically, such as by recognizing an object in the image generated by the sensor elements 116. For example, in the case of a spot-like reflective feature, the region of interest may be selected as the area around the spot profile.

[0285] The evaluation unit 132 may be configured to determine the material property m by evaluating the beam profile of the reflected image. The beam profile of the reflected image may be selected from the group consisting of a trapezoidal beam profile; a triangular beam profile; a linear combination of a conical beam profile and a Gaussian beam profile. The evaluation unit 132 may be configured to apply at least one distance-dependent image filter and at least one material-dependent image filter to the beam profile and / or to at least one specific region of the beam profile. In particular, the image filter Φ maps the image f or a region of interest in the image to a real number Φ(f(x,y))=φ, where φ denotes a feature, in particular a distance feature in the case of a distance-dependent image filter or a material feature in the case of a material-dependent image filter. Images may be affected by noise, and the same is true for the features. Thus, the features may be random variables. The features may follow a normal distribution. If the features do not follow a normal distribution, they may be transformed to follow a normal distribution, for example by a Box-Cox transformation.

[0286] The evaluation unit 132 derives at least one distance feature φ by applying at least one distance-dependent image filter Φ1 to the reflected image. 1z The distance feature may be or may include at least one measurement of the distance of the object 112, a distance value, a longitudinal coordinate of the object, etc. The distance dependent image filter may be a depth filter from photon ratio; a depth filter from defocus; or a linear combination thereof; or |ρ Ф1other , Фz |≧0.40(Ф zis a depth filter from the photon ratio or a depth filter from the defocus or a linear combination thereof) by a further distance-dependent image filter Φ, which is correlated to the depth filter from the photon ratio and / or the depth filter from the defocus or a linear combination thereof 1other , . . . The further distance-dependent image filter Φ 1other is the distance-dependent image filter Φ z and |ρ Ф1other , Фz |≧0.60, preferably |ρ Ф1other , Фz Two image filters Φ may be correlated by | ≥ 0.80. i and Φ j The similarity of may be evaluated by the correlation of their features, specifically by calculating the Pearson correlation coefficient.

[0287]

number

[0288] where μ and σ are the mean and standard deviation of the obtained features. The test of the correlation of the filters can be performed with a set of random test images, specifically a matrix filled with random numbers. The number of random test images can be selected so that the result of the correlation test is statistically significant. The correlation coefficient takes values ​​between −1 and 1, where 0 means that there is no linear correlation. The correlation coefficient is suitable to determine whether two filters are similar or equivalent. To measure whether the features of the filters are correlated with a given property, such as distance, the test images can be selected such that the correlation filter actually yields that property. As an example, to measure whether the features of the filters are correlated with distance, beam profiles recorded at different distances can be used as test images. To obtain a comparable, transferable and transparent evaluation, a fixed test set of test images can be defined.

[0289] For example, the distance dependent image filter may be a depth from photon ratio filter. The depth from photon ratio filter may include evaluating a combined signal Q from at least two sensor signals of the sensor elements. The evaluation device determines a distance characteristic φ by evaluating the combined signal Q. 1z The distance characteristic determined by evaluation of the combined signal Q may correspond directly to the longitudinal coordinate of the object. The combined signal Q may be determined using various means. By way of example, software means for deriving the combined signal, hardware means for deriving the combined signal, or both may be used and may be implemented in the evaluation device. Thus, the evaluation device 132 may by way of example include at least one divider 134, where the divider 134 is configured to derive a quotient signal. The divider 134 may be embodied fully or partially as a software divider or a hardware divider or both.

[0290] The evaluation unit 132 may be configured to derive the combined signal Q by one or more of dividing the sensor signals, dividing a multiple of the sensor signals, or dividing a linear combination of the sensor signals. The evaluation unit 132 may be configured to derive the combined signal Q by one or more of dividing the sensor signals, dividing a multiple of the sensor signals, or dividing a linear combination of the sensor signals. 1z , and the distance feature φ 1z For example, the evaluation unit may be configured to derive the combined signal Q by:

[0291]

number

[0292] where x and y are lateral coordinates, A1 and A2 are different areas of at least one beam profile of a light beam propagating from an object to a detector at the sensor location, and E(x, y, z o ) is the object distance z oThe area A1 and the area A2 may be different. In particular, A1 and A2 are not congruent. Thus, A1 and A2 may differ in one or more of shape or content. The beam profile may be the cross-section of a light beam. The beam profile may be selected from the group consisting of a trapezoidal beam profile; a triangular beam profile; a linear combination of a conical beam profile and a Gaussian beam profile. In general, the beam profile is expressed as a function of the intensity L(z o ) and beam shape S(x,y;z o ) in the image. The combined signal can thus be derived to determine a vertical coordinate that is independent of the brightness. Furthermore, the combined signal can be used to determine the distance z0 independently of the size of the object. In this way, the combined signal allows the distance z0 to be determined independently of the material and / or reflecting and / or scattering properties of the object 112 and independently of changes in the light source due to, for example, manufacturing precision, heat, moisture, dirt, lens damage, etc. As an example, the distance-dependent feature φ 1z is a function of the combined signal Q, φ 1z =φ 1z (Q), where the function may be a first order polynomial, a second order polynomial, or a higher order polynomial of Q. Further, as an example, the object distance z0 may be expressed as a function of the distance-dependent feature φ 1z function, z0=z0(φ 1z ), where the function φ 1z Thus, the object distance z0 may be a function of the coupled signal Q, z0=z0(Q), where the function may be a first order polynomial, a second order polynomial, or a higher order polynomial in Q.

[0293] The light sensitive areas 122 of the at least two light sensors 120 may be arranged such that the first sensor signal contains information of a first area of ​​the beam profile and the second sensor signal contains information of a second area of ​​the beam profile, the first area of ​​the beam profile and the second area of ​​the beam profile being either adjacent or overlapping or both.

[0294] The evaluation device 132 may be configured to determine and / or select a first area of ​​the beam profile and a second area of ​​the beam profile. The first area of ​​the beam profile may include substantially edge information of the beam profile and the second area of ​​the beam profile may include substantially center information of the beam profile. The beam profile may have a center, i.e. a maximum of the beam profile and / or a center point of the plateau of the beam profile and / or a geometric center of the light spot, and a falling edge extending from the center. The second area may include an inner area of ​​the cross section and the first area may include an outer area of ​​the cross section. Preferably, the center information has a percentage of edge information of less than 10%, more preferably less than 5%, and most preferably the center information does not include edge content. The edge information may include information of the entire beam profile, in particular information from the center and edge areas. The edge information has a percentage of center information of less than 10%, preferably less than 5%, and more preferably the edge information does not include center information. If the beam profile is close to or around the center and contains substantially central information, then at least one area of ​​the beam profile may be determined and / or selected as the second area of ​​the beam profile. If the beam profile contains at least a portion of the falling edge of the cross section, then at least one area of ​​the beam profile may be determined and / or selected as the first area of ​​the beam profile. For example, the entire area of ​​the cross section may be determined as the first area. The first area of ​​the beam profile may be area A2 and the second area of ​​the beam profile may be area A1.

[0295] The edge information may include information on the number of photons in a first area of ​​the beam profile, and the center information may include information on the number of photons in a second area of ​​the beam profile. The evaluation device 132 may be adapted to determine the area integral of the beam profile. The evaluation device 132 may be adapted to determine the edge information by integration and / or summation of the first area. The evaluation device 132 may be adapted to determine the center information by integration and / or summation of the second area. For example, the beam profile may be a trapezoidal beam profile and the evaluation device may be adapted to determine the integral value of the trapezoid. Furthermore, if a trapezoidal beam profile is assumed, the determination of the edge and center signals may be replaced by an equivalent evaluation that utilizes properties of the trapezoidal beam profile, such as the slope and position of the edges as well as the determination of the height of the central plateau, and derives the edge and center signals by geometrical considerations.

[0296] Additionally or alternatively, the evaluation device may be adapted to determine one or both of center and edge information from at least one slice or cut of the light spot. This can be achieved, for example, by replacing the area integral of the combined signal Q with a line integral along the slice or cut. To improve accuracy, multiple slices or cuts through the light spot may be used for averaging. In case of an elliptical spot profile, improved distance information may be obtained by averaging over multiple slices or cuts.

[0297] The evaluation unit 132 may be configured to derive the combined signal Q by one or more of dividing the edge information and the center information, dividing a multiple of the edge information and the center information, dividing a linear combination of the edge information and the center information, etc. Thus, in effect, photon ratios may be used as the physical basis of the method.

[0298] The evaluation device 132 may be configured to derive the combined signal Q, in particular by dividing the first and second sensor signals, by dividing a multiple of the first and second sensor signals, or by dividing a linear combination of the first and second sensor signals. As an example, Q may be simply determined as Q=s1 / s2 or Q=s2 / s1, where s1 denotes the first sensor signal and s2 denotes the second sensor signal. Additionally or alternatively, Q may be determined as Q=a·s1 / b·s2 or Q=b·s2 / a·s1, where a and b are, by way of example, predefined or determinable real numbers. Additionally or alternatively, Q may be determined as Q=(a·s1+b·s2) / (c·s1+d·s2), where a, b, c and d are, by way of example, predefined or determinable real numbers. As a simple example of the latter, Q may be determined as Q=s1 / (s1+s2). Other combination or quotient signals are possible.

[0299] For further details and embodiments of the evaluation of the combined signal Q and the determination of the vertical coordinate z, reference is made, for example, to WO 2018 / 091640, WO 2018 / 091649 A1 and WO 2018 / 091638 A2, the contents of which are incorporated herein by reference.

[0300] For example, the distance-dependent image filter may be a depth-from-defocus filter. As outlined above, the evaluation unit 132 may be configured to determine at least one image of the region of interest from the sensor signals. The evaluation unit 132 may be configured to determine at least one blurring function f a By optimizing the distance feature φ 1z The determined distance feature φ 1z may directly correspond to the vertical coordinate of the object. 1zmay be determined using at least one convolution-based algorithm, such as a depth from defocus algorithm. To obtain the distance from the image, the depth from defocus algorithm estimates the defocus of the object. For this estimation, a blurring function is assumed. In particular, the blurring function models the blur of the defocused object. At least one blurring function f a may be a function or a composite function composed of at least one function from the group consisting of Gaussian, sinc function, pillbox function, square function, Lorentz function, radial function, polynomial, Hermite polynomial, Zernike polynomial, Legendre polynomial.

[0301] The blurring function can be optimized by varying at least one parameter of the blurring function. The reflected image is then compared to the blurred image i b The evaluation device may be b and the blurring function f a from the distance feature φ 1z The distance feature φ may be reconstructed. 1z is calculated by varying the parameter σ to obtain at least one further image i′ b Using this, blurred image i b and the blurring function f a may be determined by minimizing the difference between the convolution of

[0302]

number

[0303] σ(z) is a set of distance-dependent blurring parameters. The further images may be blurred or sharp. At least one further image is convolved with a known blurring function to produce a blurred image i b Thus, the depth from defocus algorithm can be generated from the distance feature φ 1z can be used to obtain

[0304] The evaluation unit 132 evaluates the distance feature φ determined by applying a depth filter from the photon ratio. 1z and the distance feature φ determined by applying the depth from defocus filter. 1z The combined distance information z may be configured to determine at least one combined distance information z based on a distance feature φ determined by applying a depth filter from a photon ratio. 1z and the distance feature φ determined by applying the depth from defocus filter. 1z The joint distance information z may be a real function that depends on and . The joint distance information z may also be a distance feature φ determined by applying a depth filter from the photon ratio. 1z and the distance feature φ determined by applying the depth from defocus filter. 1z The depth from defocus distance measurement can be a rational or irrational polynomial with respect to the photon ratio. Depth from defocus is a complementary method to depth from photon ratio, but uses a similar hardware configuration. Furthermore, the depth from defocus distance measurement can have similar accuracy. Combining both techniques can produce advantageous distance measurement results with high accuracy.

[0305] For example, the distance-dependent image filter may be a structured light filter combined with a depth-from-photon-ratio filter and / or a depth-from-defocus image filter. The detector 110 may include at least two sensor elements 116, each with a matrix 118 of light sensors 120. The at least one first sensor element and the at least one second sensor element may be arranged at different spatial positions. The relative distance between the first and second sensor elements may be fixed. The at least one first sensor element may be adapted to determine at least one first reflection pattern, in particular at least one first reflection feature, and the at least one second sensor element may be adapted to determine at least one second reflection pattern, in particular at least one second reflection feature. The evaluation device 132 may be configured to select at least one image determined by the first or second sensor element as a reflection image and to select at least one image determined by the other one of the first or second sensor elements as a reference image. The reference image may be determined by one or more of recording at least one reference feature, imaging at least one reference feature, calculating a reference image. The reference image and the reflected image may be images of the object determined at different spatial positions having a certain distance. The distance may be a relative distance, also called a baseline. The evaluation unit 132 may be adapted to select at least one reflected feature in the reflected image and to determine a distance feature φ determined by applying a depth image filter from photon ratio and / or a depth image filter from defocus. 1z and adapted to determine a distance estimate of at least one of the selected reflectance features of the reflectance image given by an error interval ±ε.

[0306] The evaluation device 132 may be adapted to determine at least one reference feature of the at least one reference image that corresponds to the at least one reflection feature. The evaluation device 132 may be adapted to perform an image analysis and to identify features of the reflection image. The evaluation device 132 may be adapted to identify at least one reference feature in the reference image that has substantially the same vertical coordinate as the selected reflection feature. The evaluation device 132 may be adapted to determine an epipolar line in the reference image. The relative positions of the reference image and the reflection image may be known. For example, the relative positions of the reference image and the reflection image may be stored in at least one storage unit of the evaluation device. The evaluation device 132 may be adapted to determine a straight line extending from the selected reflection feature of the reflection image. The straight line may include a possible object feature that corresponds to the selected feature. The straight line and the baseline develop an epipolar plane. Since the reference image is determined at a different relative position than the reflection image, the corresponding possible object feature may be imaged on a straight line, called an epipolar line, in the reference image. Thus, the feature of the reference image that corresponds to the selected feature of the reflection image is located on the epipolar line. Due to image distortions or changes in system parameters due to aging, temperature changes, mechanical stress, etc., the epipolar lines may cross or be very close to each other and / or the correspondence between reference and reflected features may be unclear. Furthermore, each known location or object in the real world may be projected onto the reference image and vice versa. The projection may be known by detector calibration, while the calibration corresponds to teaching-in the epipolar geometry of a particular camera.

[0307] The evaluation unit 132 may be configured to determine at least one displacement area in the reference image corresponding to the distance estimate. In particular, the displacement area may be an area in the reference image where a reference feature corresponding to the selected reflection feature is expected to be located in the reference image. Depending on the distance to the object 112, an image position of the reference feature corresponding to the reflection feature may be displaced in the reference image compared to an image position of the reflection feature in the reflection image. The displacement area may include only one reference feature. The displacement area may also include multiple reference features. The displacement area may include an epipolar line or a part of an epipolar line. The displacement area may include multiple epipolar lines or multiple parts of multiple epipolar lines. The displacement area may extend along the epipolar line, or may extend orthogonally to the epipolar line, or both. The evaluation unit 132 may be adapted to determine a reference feature along the epipolar line corresponding to the distance feature, and to determine a range of the displacement area along the epipolar line or orthogonal to the epipolar line corresponding to an error interval ±ε. The measurement uncertainty of the distance measurement may result in a displacement region that is non-circular because the measurement uncertainty may vary with direction. In particular, the measurement uncertainty along the epipolar line or lines may be larger than the measurement uncertainty in the orthogonal direction with respect to the epipolar line or lines. The displacement region may include a region that extends in the orthogonal direction with respect to the epipolar line or lines. The estimator 132 may determine the displacement region around the image location of the reflective feature. The estimator 132 may determine a distance estimate and may estimate φ 1z It can be adapted to determine the displacement region along the epipolar line corresponding to ±ε.

[0308] The evaluation device 132 may be configured to match selected features of the reflected pattern with at least one feature of the reference pattern in the displacement region. The evaluation device 132 may be configured to match selected features of the reflected image with reference features in the displacement region by using at least one evaluation algorithm taking into account the determined distance estimate. The evaluation algorithm may be a linear scaling algorithm. The evaluation device 132 may be adapted to determine an epipolar line that is closest to and / or within the displacement region. The evaluation device 132 may be adapted to determine an epipolar line that is closest to an image position of the reflected feature. The extent of the displacement region along the epipolar line may be larger than the extent of the displacement region orthogonal to the epipolar line. The evaluation device may be adapted to determine the epipolar line before determining the corresponding reference feature. The evaluation device 132 may determine a displacement region around an image position of each reflected feature. The evaluation unit 132 may be adapted to assign an epipolar line to each displacement region of each image position of the reflection feature, such as by assigning an epipolar line closest to the displacement region and / or an epipolar line within the displacement region and / or an epipolar line closest to the displacement region along a direction orthogonal to the epipolar line. The evaluation unit 132 may be adapted to determine a reference feature corresponding to the image position of the reflection feature, such as by evaluating a reference feature closest to the assigned displacement region and / or a reference feature within the assigned displacement region and / or a reference feature closest to the assigned displacement region along the assigned epipolar line and / or a reference feature within the assigned displacement region along the assigned epipolar line.

[0309] The evaluation device 132 may be configured to determine the displacement of the matched reference feature and the selected reflection feature. The evaluation device may be configured to determine the longitudinal information of the matched feature using a predefined relationship between the longitudinal coordinate and the displacement. For example, the longitudinal information may be a distance value. The predefined relationship may be one or more of an empirical relationship, a semi-empirical relationship, and an analytically derived relationship. The evaluation device 132 may comprise at least one data storage device for storing the predefined relationship, such as for example a look-up list or a look-up table. The evaluation device 132 may be adapted to determine the predefined relationship by using a triangulation method. If the position of the selected reflection feature in the reflection image and the position of the matched reference feature and / or the relative displacement of the selected reflection feature and the matched reference feature are known, the longitudinal coordinate of the corresponding object feature may be determined by triangulation. Thus, the evaluation device 132 may be adapted to select a reflection feature, for example sequentially and / or row by row, and to determine the corresponding distance value using triangulation for each potentially possible position of the reference feature. The displacements and corresponding distance values ​​may be stored in at least one storage device of the evaluation device 132 .

[0310] Additionally or alternatively, the evaluation device 132 performs the following steps: - determining the displacement area for the image location of each reflection feature; - assigning an epipolar line to the displacement region of each reflection feature, such as by assigning an epipolar line closest to the displacement region, and / or an epipolar line within the displacement region, and / or an epipolar line closest to the displacement region along a direction orthogonal to the epipolar line; - assigning and / or determining at least one reference feature to each reflection feature, such as by assigning a reference feature closest to the assigned displacement area and / or a reference feature within the assigned displacement area and / or a reference feature closest to the assigned displacement area along the assigned epipolar line and / or a reference feature within the assigned displacement area along the assigned epipolar line; The method may be configured to perform the following steps:

[0311] The evaluation unit 132 evaluates at least one material characteristic φ by applying at least one material-dependent image filter Φ2 to the reflected image. 2m The material characteristic may be or may include at least one information regarding at least one material property of the object 112.

[0312] The material dependent image filter may be a brightness filter; a spot shape filter; a squared norm gradient; a standard deviation; a smoothness filter such as a Gaussian filter or a median filter; a gray level generation based contrast filter; a gray level generation based energy filter; a gray level generation based uniformity filter; a gray level generation based dissimilarity filter; a rho energy filter; a threshold domain filter; or a linear combination thereof; or |ρ Ф2other,Фm |≧0.40 by (Ф m is one of a brightness filter, a spot shape filter, a squared norm gradient, a standard deviation, a smoothness filter, a gray level generation based energy filter, a gray level generation based uniformity filter, a gray level generation based dissimilarity filter, a rho's energy filter, or a threshold domain filter, or a linear combination thereof), a further material dependent image filter Φ that is correlated to a brightness filter, a spot shape filter, a squared norm gradient, a standard deviation, a smoothness filter, a gray level generation based energy filter, a gray level generation based uniformity filter, a gray level generation based dissimilarity filter, a rho's energy filter, or a threshold domain filter, or a linear combination thereof 2other , . . . The further material-dependent image filter Φ 2other is the material-dependent image filter Φ m and |ρ Ф2other,Фm |≧0.60, preferably |ρ Ф2othe,ФmFor a description of exemplary material dependent image filters, see the descriptions above of brightness filter, spot shape filter, smoothness filter such as squared norm gradient, standard deviation, Gaussian filter or median filter, gray level generation based contrast filter, gray level generation based energy filter, gray level generation based uniformity filter, gray level generation based dissimilarity filter, low energy filter, threshold area filter.

[0313] The material-dependent image filter may be at least one arbitrary filter Φ that passes hypothesis validation. The hypothesis validation may include validating the material dependency of the image filter by applying the image filter to a predefined data set. The data set may include a plurality of beam profile images. The beam profile images may include N B is given by a sum of Gaussian radial basis functions.

[0314]

number

[0315]

number

[0316] In the formula, N B Each Gaussian radial basis function has a center (x lk ,y lk ), prefactor a lk , and the exponential factor

number

[0317] [Table 2]

[0318] The values ​​of x,y, are

number

[0319] An example dataset is shown below. The following parameter table shows all images f k All Gaussian functions of g lk Center position x lk =x l , y lk =y l Shown:

[0320] [Table 3]

[0321] The following parameter table shows the material classification, specifically a white Teflon target (denoted as control), cloth, black skin (denoted as dark_skin), white skin (denoted as pale_skin), highly translucent skin (denoted as trans), and each image f referenced by image index k. k This shows the distance z.

[0322] [Table 4]

[0323] [Table 5]

[0324] The following parameter table describes the function for each image f referenced by image index k and Gaussian index l. k The Gaussian function g lk Prefactor a of lk This shows that.

[0325] [Table 6]

[0326] [Table 7]

[0327] [Table 8]

[0328] [Table 9]

[0329] [Table 10]

[0330]

Table 11

[0331]

Table 12

[0332]

Table 13

[0333]

Table 14

[0334]

Table 15

[0335]

Table 16

[0336]

Table 17

[0337]

Table 18

[0338]

Table 19

[0339]

Table 20

[0340]

Table 21

[0341]

Table 22

[0342]

Table 23

[0343]

Table 24

[0344]

Table 25

[0345]

Table 26

[0346]

Table 27

[0347]

Table 28

[0348]

Table 29

[0349]

Table 30

[0350]

Table 31

[0351]

Table 32

[0352]

Table 33

[0353]

Table 34

[0354]

Table 35

[0355]

Table 36

[0356]

Table 37

[0357]

Table 38

[0358]

Table 39

[0359]

Table 40

[0360]

Table 41

[0361]

Table 42

[0362]

Table 43

[0363]

Table 44

[0364]

Table 45

[0365]

Table 46

[0366]

Table 47

[0367]

Table 48

[0368]

Table 49

[0369]

Table 50

[0370]

Table 51

[0371]

Table 52

[0372] [Table 53]

[0373] All images k All Gaussian functions g for lk For the exponential factor

number

[0374] Next, for each image f k For the feature value φ corresponding to the filter Φ k can be calculated,

number

number

number

number

number

number

number

number

[0375] where I is the regularized incomplete beta function

number

number

number

[0376] Figure 2 shows the experimental results of calculating the material features of different materials using the spot shape filter. Specifically, the material feature φ 2m is shown for different materials, namely, from left to right, wooden board denoted as board, cloth, black skin, white skin, and highly translucent skin denoted as trans, showing the separation of skin material (right) from other materials (left). The spot shape filter passes the hypothesis test. The p-value calculated from the F-test is 0.0076. Hence, the null hypothesis H0 can be rejected with respect to the significance level of 0.01. Furthermore, the alternative hypothesis H1 can be accepted with respect to the significance level of 0.01. Thus, the image filter is able to identify at least two material classifications. Furthermore, Figure 2 shows the average feature values ​​per material. TIFF2025063111000121.tif623 are shown as lines within the respective boxes. The vertical bars indicate the interquartile range (IQR) of Q1-1.5 and the IQR of Q3+1.5, where IQR=Q3-Q1, and Q1 and Q3 are the first and third quartiles. The boxes indicate the quartiles of Q1 and Q3. The outliers are plotted as points. Figure 2 shows that this material feature separates all skin samples from non-skin samples. In other words, the expected values ​​of the skin feature for skin and non-skin materials are different.

[0377] FIG. 1 further shows, in a highly schematic illustration, an exemplary embodiment of a detector 110, which may in particular be embodied as and / or be part of a camera 136. The camera 136 may be made for imaging, in particular for 3D imaging, and for acquiring still images and / or image sequences, such as digital video clips. Other embodiments are possible. FIG. 1 further shows an embodiment of a detector system 138, which, besides at least one detector 110, in this example includes one or more beacon devices 140, which may be attached and / or integrated in the object 112 and whose position is detected using the detector 110. FIG. 1 further shows a schematic embodiment of a human machine interface 142 and, further, of an entertainment device 154, which comprises at least one detector system 138 and which includes the human machine interface 142. The figure further illustrates one embodiment of a tracking system 146 for tracking the position of the object 112, including the detector system 138. The components of the apparatus and system are described in further detail below.

[0378] 1 further shows an exemplary embodiment of a scanning system 148 for scanning a scene including an object 112, such as for scanning the object 112 and / or for determining at least one position of the at least one object 112. The scanning system 148 comprises at least one detector 110 and, optionally, at least one illumination source 124 and, also optionally, at least one further illumination source not shown here. The illumination source 124 is generally configured to emit at least one illumination light beam, such as for illuminating at least one dot, for example a dot located on one or more positions of the beacon device 140 and / or on the surface of the object 112. The scanning system 148 may be designed to generate a profile of the scene including the object 112 and / or a profile of the object 112 and / or to generate, using the at least one detector 110, at least one item of information regarding the distance between the at least one dot and the scanning system 148, in particular the detector 110.

[0379] Besides the light sensor 120, the detector 110 comprises at least one evaluation device 132, which comprises, for example, at least one image analysis device 150 and / or at least one position evaluation device 152, as symbolically shown in FIG. 1. The components of the evaluation device 132 may be fully or partially integrated in separate devices and may also be fully or partially integrated in other components of the detector 110. In addition to the possibility of fully or partially combining two or more components, one or more of the light sensors 120 and one or more components of the evaluation device 132 may be interconnected by one or more connectors 154 and / or by one or more interfaces, as symbolically shown in FIG. 3. Furthermore, the one or more connectors 154 may comprise one or more drivers and / or one or more devices for modifying or pre-processing the sensor signal. Furthermore, instead of using at least one optional connector 154, the evaluation device 132 may be fully or partially integrated in one or both of the light sensors 120 and / or in the housing 156 of the detector 110. Additionally or alternatively, the evaluation device 132 may be designed as a separate device, completely or partially.

[0380] In this exemplary embodiment, the object 112 whose position can be detected may be designed as a sporting item and / or may form a control element or control device 158 whose position can be manipulated by the user 160. By way of example, the object 112 may be or include a bat, a racket, a club, or other item of sporting equipment and / or fake sporting equipment. Other types of object 112 are possible. Furthermore, the user 160 himself may be considered as the object 112 whose position can be detected.

[0381] As outlined above, the detector 110 includes a light sensor 120. The light sensor 120 may be disposed inside a housing 156. Furthermore, the detector 110 may include at least one transfer device 129, such as one or more optics, preferably including one or more lenses. An opening 162 inside the housing 156 is preferably disposed concentrically with respect to an optical axis 128 of the detector 110 and preferably defines a line of sight direction 164 of the detector 110. A coordinate system 166 may be defined in which a direction parallel or anti-parallel to the optical axis 128 may be defined as a vertical direction, while a direction perpendicular to the optical axis 128 may be defined as a horizontal direction. In the coordinate system 166, which is symbolically shown in FIG. 1, the vertical direction is indicated by z and the horizontal directions are indicated by x and y, respectively. Other types of coordinate systems, such as non-Cartesian coordinate systems, are also feasible.

[0382] Determining the position of the object 112 and / or parts thereof by using the detector 110, as outlined above, may be used to provide a human-machine interface 142 in order to provide at least one item of information to a machine 168. In the embodiment shown diagrammatically in Fig. 1, the machine 168 may be and / or include a computer. Other embodiments are possible. The evaluation device 132 may be fully or partially integrated into the machine 168, such as a computer.

[0383] As outlined above, Fig. 1 also shows an example of a tracking system 146 configured to track the position of at least one object 112 and / or parts thereof. The tracking system 146 comprises a detector 110 and at least one tracking controller 170. The tracking controller 170 may be adapted to track a series of positions of the object 112 at a particular point in time. The tracking controller 170 may be a stand-alone device and / or may be fully or partially integrated into the machine 168, in particular the computer, and / or into the evaluation device 132, as shown in Fig. 1.

[0384] Similarly, as outlined above, the human machine interface 142 may form part of the entertainment device 144. A machine 168, in particular a computer, may form part of the entertainment device 144. Thus, by a user 160 acting as the object 112 and / or by a user 160 manipulating a control device acting as the object 112, the user 160 may input at least one item of information, such as at least one control command, into the computer, thereby varying the entertainment function, such as controlling the course of the computer.

[0385] 1 also shows an example of an inertial measurement unit 172 for use in an electronic device. The inertial measurement unit 172 is adapted to receive data determined by the detector 110. The inertial measurement unit is further adapted to receive data determined by at least one further sensor selected from the group consisting of: wheel speed sensor, rotation speed sensor, tilt sensor, orientation sensor, motion sensor, magnetohydrodynamic sensor, force sensor, angle sensor, angular velocity sensor, magnetic field sensor, magnetometer, accelerometer; gyroscope, and the inertial measurement unit is adapted to determine at least one characteristic of the electronic device selected from the group consisting of position in space, relative or absolute motion in space, rotation, acceleration, direction, angular position, tilt, rate of rotation, speed by evaluating the data from the detector and the at least one further sensor.

[0386] The inertial measurement unit 172 may include the detector 110 and / or may be connected to the detector 110 via at least one data connection. The evaluation device 132 and / or the at least one processing device of the inertial measurement unit 172 may be configured to determine at least one combined distance information, in particular using at least one recursive filter. The recursive filter may be configured to determine the combined distance information taking into account further parameters, such as further sensor data and / or further sensor data from further sensors of the inertial measurement unit 172. [Explanation of symbols]

[0387] 110 Detector 112 Object 116 Sensor Element 118 Matrix 120 Light Sensor 122 Photosensitive area 124 Irradiation source 126 Irradiation Light Beam 128 Optical axis 129 Teleporter 130 Reflected Light Beam 132 Evaluation Equipment 134 Divider 136 Cameras 138 Detector System 140 Beacon Device 142 Human Machine Interface 144 Entertainment Devices 146 Tracking System 148 Scanning System 150 Image analysis device 152 Position evaluation device 154 Connector 156 Housing 158 Control Device 160 users 162 Opening 164 Viewing Direction 166 Coordinate Systems 168 Machines 170 Tracking Controller 172 Inertial Measurement Unit

[0388] References US2016 / 0206216A1 US2016 / 155006A1 "Lasertechnikinder Medizin: Grundlagen, Systeme, Anwendungen", "Wirkungvon Laserstrahlung auf Gewebe" 1991, pp. 171-266, Juergen Eichler, Theo Seiler, Springer Verlag, ISBN 0939-0979 WO2014 / 097181A1 WO2018 / 091640A1 WO2018 / 091649A1 and WO2018 / 091638A2 X. Jiang, H. Bunke, "Dreidimensionales Computersehen", Springer, Berlin Heidelberg, 1997. RAStreet (ed.): Technology and Applications of Amorphous Silicon, Springer-Verlag Heidelberg, 2010, pp. 346-349. WO2012 / 110924A1 DE19846619A1 CN108363482A US2018 / 033146A1

Claims

1. A detector (110) for identifying at least one material characteristic m, at least one sensor element (116) comprising a matrix (118) of optical sensors (120), said optical sensors (120) each having a light-sensitive area (122), said sensor element (116) being configured to record at least one reflected image of a light beam originating from at least one object (112); at least one evaluation device (132) configured to determine said material properties by evaluating at least one beam profile of said reflected image, The evaluation unit (132) evaluates at least one distance-dependent image filter Φ １ to the reflection image to obtain at least one distance feature φ １ｚ and the distance dependent image filter is configured to determine a depth filter from photon ratio; a depth filter from defocus; or a linear combination thereof; or |ρ Ф１ｏｔｈｅｒ，Фｚ a further distance-dependent image filter Φ correlated to the depth filter from photon ratio and / or the depth filter from defocus by |≧0.40 or a linear combination thereof １ｏｔｈｅｒ , where Φ ｚ is one of the depth filter from photon ratio or the depth filter from defocus or a linear combination thereof, The evaluation unit (132) evaluates at least one material-dependent image filter Φ ２ to the reflection image to obtain at least one material feature φ ２ｍ the material dependent image filter being configured to determine |ρ Ф２ｏｔｈｅｒ，Фｍ a further material dependent image filter Φ correlated by |≧0.40 to one or more of the brightness filter, spot shape filter, squared norm gradient, standard deviation, smoothness filter, gray level generation based energy filter, gray level generation based uniformity filter, gray level generation based dissimilarity filter, low energy filter, or threshold area filter, or linear combinations thereof; ２ｏｔｈｅｒ , where Φ ｍ is one of a brightness filter, a spot shape filter, a squared norm gradient, a standard deviation, a smoothness filter, a gray level generation based energy filter, a gray level generation based uniformity filter, a gray level generation based dissimilarity filter, a rho energy filter, or a threshold domain filter, or a linear combination thereof; The evaluation device (132) evaluates the distance feature φ １ｚ and the material characteristic φ ２ｍ an evaluation device configured to determine the vertical coordinate z and the material characteristic m by evaluating A detector (110).

2. 2. The detector (110) of claim 1, wherein the material dependent image filter is at least one filter that passes hypothesis testing using a null hypothesis where the filter does not distinguish between material classes and an alternative hypothesis where the filter distinguishes between at least two material classes, and the filter passes hypothesis testing if a p-value, p, is less than or equal to a predefined significance level.

3. Detector (110) according to claim 2, wherein p≦0.075, preferably p≦0.05, more preferably p≦0.025, most preferably p≦0.

01.

4. The detector (110) of any one of claims 1 to 3, wherein the at least one material property is a property selected from the group consisting of scattering coefficient, translucency, transparency, deviation from Lambertian surface reflectance, speckle, and the like.

5. The further distance-dependent image filter Φ １ｏｔｈｅｒ is |ρ Ф１ｏｔｈｅｒ，Фｚ |≧0.60, preferably |ρ Ф１ｏｔｈｅｒ，Фｚ |≧0.80, the distance-dependent image filter Φ ｚ The detector (110) of any one of claims 1 to 4, wherein the detector (110) is correlated with one or more of the following:

6. The further material dependent image filter Φ ２ｏｔｈｅｒ is |ρ Ф２ｏｔｈｅｒ，Фｍ |≧0.60, preferably |ρ Ф２ｏｔｈｅ，Фｍ |≧0.80, the material-dependent image filter Φ ｍ The detector (110) of any one of claims 1 to 5, wherein the detector (110) is correlated with one or more of the following:

7. The material property m and / or the vertical coordinate z may be expressed as φ １ｚ , φ ２ｍ 7. The detector (110) of claim 1, wherein the x, y, and z are determined using a predetermined relationship between the y, y, and z.

8. The material property m and / or the vertical coordinate z are determined by a function z(φ １ｚ , φ ２ｍ ) and / or function m(φ １ｚ , φ ２ｍ The detector (110) of any one of claims 1 to 7, wherein the signal intensity is determined by the signal intensity.

9. The detector (110) of any one of claims 1 to 8, wherein the evaluation device (132) is configured to simultaneously apply the distance-dependent image filter and the material-dependent image filter to the reflected image.

10. The evaluation device (132) is １ Or Φ ２ At least one of the features of other image filters φ １ｚ Or φ １ｍ Whether it is a function of Φ or Φ １ Or Φ ２ 10. The detector (110) of claim 1, further comprising: an evaluation unit (132) configured to determine whether at least one of the distance-dependent image filter and the material-dependent image filter is a function of at least one other image filter, and the evaluation unit (132) is configured to sequentially or recursively apply the distance-dependent image filter and the material-dependent image filter to the reflected image.

11. The evaluation device (132) is １ｚ and / or φ ２ｍ 11. The detector (110) of claim 10, configured to determine at least one of z and / or m by applying at least one further filter to the reflected image, the filter being dependent on at least one of:

12. The depth filter from photon ratio comprises evaluating a combined signal Q from at least two sensor signals of the sensor elements (116), the evaluation unit (132) being configured to derive the combined signal Q by one or more of dividing the sensor signals, dividing a multiple of the sensor signals, or dividing a linear combination of the sensor signals, and the evaluation unit (132) is configured to calculate the combined signal Q by a function of the combined signal Q and the distance feature φ. １ｚ At least one predetermined relationship between the distance feature φ １ｚ The detector (110) according to any one of claims 1 to 11, configured for use in determining

13. The depth from defocus filter includes using at least one convolution-based algorithm, such as a depth from defocus algorithm, and the evaluation unit is configured to calculate at least one blurring function f ａ By optimizing the distance feature φ １ｚ The detector (110) according to any one of claims 1 to 12, configured to determine a blurring function (114) of the at least one blurring function (102) and wherein said blurring function (102) is optimized by varying parameters of said at least one blurring function.

14. The detector (110) of any one of claims 1 to 13, wherein the sensor element (116) comprises at least one CMOS sensor.

15. The detector (110) according to any one of claims 1 to 14, wherein the detector (110) has at least one illumination source (124) configured to generate at least one illumination pattern for illumination of the object, the illumination pattern comprising at least one pattern selected from the group consisting of at least one dot pattern, in particular a pseudo-random dot pattern; a random dot pattern or a quasi-random pattern; at least one Sobol pattern; at least one quasi-periodic pattern; at least one pattern with at least one a priori known feature; at least one regular pattern; at least one triangular pattern; at least one hexagonal pattern; at least one rectangular pattern; at least one pattern with convex uniform tiling; at least one line pattern with at least one line; at least one line pattern with at least two lines, such as parallel or intersecting lines.

16. The detector (110) of claim 15, wherein the illumination source (124) comprises at least one laser source and at least one diffractive optical element.

17. A detector system (138) comprising at least one detector (110) according to any one of claims 1 to 16, and further comprising at least one beacon device (140) adapted to direct at least one light beam towards said detector (110), said beacon device (140) being at least one of attachable to said object (112), holdable by said object (112), and integral to said object (112).

18. A human machine interface (142) for exchanging at least one item of information between a user (160) and a machine (168), said human machine interface (142) comprising at least one detector system (138) as claimed in claim 17, said at least one beacon device (140) adapted to be at least one of attached directly or indirectly to said user (160) and held by said user (160), said human machine interface (142) designed to determine at least one position of said user (160) by means of said detector system (138), said human machine interface (142) designed to assign at least one item of information to said position.

19. 20. An entertainment device (144) for performing at least one entertainment function, said entertainment device (144) comprising at least one human-machine interface (142) as described in claim 18, said entertainment device (144) designed to enable at least one item of information to be input by a player by means of said human-machine interface (142), said entertainment device (144) designed to vary said entertainment function in response to said information.

20. A tracking system (146) for tracking a position of at least one movable object, said tracking system (146) comprising at least one detector system (138) according to any one of claims 1 to 19 referring to a detector system, said tracking system (146) further comprising at least one tracking controller (170), said tracking controller (170) adapted to track a series of positions of said object (112) at a particular point in time.

21. A scanning system (148) for determining a depth profile of a scene, said scanning system (148) comprising at least one detector (110) according to any one of claims 1 to 20, referring to a detector, said scanning system (148) further comprising at least one illumination source adapted to scan the scene with at least one light beam.

22. A camera (136) for imaging at least one object (112), comprising at least one detector (110) according to any one of claims 1 to 21, referred to as a detector.

23. An inertial measurement unit (172) for use in an electronic device, the inertial measurement unit (172) being adapted to receive data determined by at least one detector (110) according to any one of claims 1 to 22 referring to a detector, the inertial measurement unit (172) being further adapted to receive data determined by at least one further sensor selected from the group consisting of: wheel speed sensors, rotational speed sensors, tilt sensors, orientation sensors, motion sensors, magnetohydrodynamic sensors, force sensors, angle sensors, angular velocity sensors, magnetic field sensors, magnetometers, accelerometers; gyroscopes, the inertial measurement unit (172) being adapted to determine at least one characteristic of the electronic device selected from the group consisting of: position in space, relative or absolute movement in space, rotation, acceleration, orientation, angular position, tilt, rate of rotation, speed by evaluating data from the detector and the at least one further sensor.

24. A method for determining at least one material property of at least one object (112) by using at least one detector (110) according to any one of claims 1 to 23 referring to a detector, comprising the following steps: a) determining at least one reflected image of said object (112) by using at least one sensor element (116) having a matrix (118) of optical sensors (120), each optical sensor (120) having a light-sensitive area (122); b) determining said material properties by evaluating at least one beam profile of said reflected image by using at least one evaluation device (132), said evaluation comprising: b1) at least one distance-dependent image filter Φ １ to the reflection image to obtain at least one distance feature φ １ｚ and determining |ρ Ф１ｏｔｈｅｒ，Фｚ |≧0.40, a further distance-dependent image filter Φ correlated to the depth filter from the photon ratio and / or the depth filter from the defocus or a linear combination thereof １ｏｔｈｅｒ , where Φ ｚ is at least one distance feature φ, which is one of a depth filter from photon ratio or a depth filter from defocus or a linear combination thereof; １ｚ and determining b2) at least one material-dependent image filter Φ ２ to the reflection image to obtain at least one material feature φ ２ｍ and determining |ρ|, wherein the material dependent image filter is a brightness filter; a spot shape filter; a squared norm gradient; a standard deviation; a smoothness filter such as a Gaussian filter or a median filter; a gray level generation based contrast filter; a gray level generation based energy filter; a gray level generation based uniformity filter; a gray level generation based dissimilarity filter; a rho energy filter; a threshold domain filter; or a linear combination thereof; or |ρ| Ф２ｏｔｈｅｒ，Фｍ a further material dependent image filter Φ correlated with one or more of a brightness filter, a spot shape filter, a squared norm gradient, a standard deviation, a smoothness filter, a gray level generation based energy filter, a gray level generation based uniformity filter, a gray level generation based dissimilarity filter, a low energy filter, or a threshold area filter, or a linear combination thereof, by |≧0.40; ２ｏｔｈｅｒ , where Φ ｍ is at least one material feature φ, which is one of a brightness filter, a spot shape filter, a squared norm gradient, a standard deviation, a smoothness filter, a gray level generation based energy filter, a gray level generation based uniformity filter, a gray level generation based dissimilarity filter, a low energy filter, or a threshold area filter, or a linear combination thereof; ２ｍ and determining b3) the distance feature φ １ｚ and the material characteristic φ ２ｍ determining the vertical coordinate z and the material property m by evaluating A method comprising:

25. Use of at least one detector (110) according to any one of claims 1 to 24 in a detector, the use being selected from the group consisting of position determination in traffic technology, entertainment applications, security applications, surveillance applications, safety applications, human machine interface applications, logistics applications, tracking applications, outdoor applications, mobile applications, communication applications, photography applications, machine vision applications, robotics applications, quality control applications, manufacturing applications.

Images