8-bit conversion

By employing nonlinear grayscale transformation and beam profile analysis, the signal quality and resolution loss issues associated with image data compression in beam profile analysis were resolved, enabling low-cost and reliable 3D imaging and material detection.

CN118984949APending Publication Date: 2024-11-19TRINAMIX GMBH
View PDF 8 Cites 0 Cited by

Patent Information

Application Number
CN202380025903.2
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Priority Date
2022-03-09
Filing Date
2023-03-08
Publication Date
2024-11-19

AI Technical Summary

Technical Problem

Existing beam profiling analysis methods suffer from signal quality, resolution, and contrast loss during image data compression, making it difficult to achieve reliable 3D imaging and material detection in terms of technical resources, time, and cost.

Method used

The reflected image is compressed using a nonlinear grayscale transformation method, and the beam profile is analyzed by an evaluation device to determine the ordinate of the reflection features and material properties. The image is compressed from high bit depth to low bit depth using a nonlinear grayscale transformation method while maintaining signal quality and resolution.

Benefits of technology

It achieves the maintenance of signal quality and resolution of image data with low cost and low resource consumption, ensuring the reliability and accuracy of beam profile analysis.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118984949A_ABST
    Figure CN118984949A_ABST
Patent Text Reader

Abstract

A method for beam profile analysis using at least one camera (110) is disclosed. The method comprises the following steps: a) (120) at least one data acquisition step wherein the data acquisition step comprises illuminating at least one object (112) with at least one illumination pattern (122) comprising at least one illumination feature by using at least one projector (124), the projector (124) comprises at least one emitter (126) configured to generate at least one light beam, where the data acquisition step further comprises imaging at least one reflected image by using the camera (110), the at least one reflected image comprising at least one reflected feature generated by the object in response to illumination by the illumination feature, wherein the reflection feature comprises at least one beam profile, and wherein the reflection image has a first bit depth; b) (128) at least one image compression step, where the image compression step comprises compressing the reflected image into a compressed reflected image having a second bit depth lower than the first bit depth by using at least one evaluation device (130), where the compression comprises applying a non-linear grayscale value transformation to the sensor signals; c) (132) at least one evaluation step, where the evaluation step comprises evaluating the compressed reflection image by using the evaluation device (130), where the evaluation comprises determining at least one ordinate of the reflection feature by analyzing a respective beam profile of the reflection feature.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to a method for beam profile analysis, a detector for determining the position of at least one object and a mobile device. The present invention further relates to various uses of the detector. The device, method and use can be used in various fields, such as daily life, games, traffic technology, production technology, security technology, photography (such as digital photography or video photography for art, documentation or technical purposes), medical technology or science. Further, the device and method can be used in particular for scanning one or more objects and / or scanning landscapes, such as for generating depth profiles of objects or landscapes, for example in the fields of architecture, metrology, archeology, art, medicine, engineering or manufacturing. However, other applications are also possible. Background Art

[0002] 3D imaging and / or material detection using beam profile analysis (BPA), also referred to as depth-by-photon ratio (DPR), is described in WO 2018 / 091649 A1; WO 2018 / 091638 A1; WO 2018 / 091640 A1; and in C. Lennartz, F. Schick, S. Metz, “Whitepaper - Beam Profile Analysis for 3D imaging and material detection”, April 28, 2021, Ludwigshafen, Germany, the entire contents of which are hereby incorporated by reference. The processing devices, imagers, etc. used for the evaluation typically require a data volume of 8 bits, so that the image signal is compressed from 10 bits to 8 bits.

[0003] However, known compression methods result in a loss of signal quality, resolution, contrast and dynamic range. In addition, for beam profiling it is desirable to preserve the imaged image data as well as possible in order to ensure reliable measurement results.

[0004] Compression of image data is known for other specific applications, for example from EP 3 820 150 A1, EP 3 185 555 A1, or Wolfgang "Image Preprocessing for Feature Extraction in Digital Intensity, Color and Range Images", Proceedings of the International Summer School on Data Analysis and the Statistical Foundations of Geomatics, Chania, Crete, Greece, May 25-30, 1998, Springer, Notes on Earth Sciences. However, for 3D imaging and / or material inspection using beam profiling, appropriate compression of image data remains an unsolved problem.

[0005] Problem to be solved

[0006] Therefore, the object of the present invention is to provide a method and a detector for beam profiling that address the above technical challenges of known devices and methods. In particular, the object of the present invention is to provide a device and a method that enable reliable 3D imaging and / or material detection using beam profiling with low requirements in terms of technical resources, time and cost. Summary of the invention

[0007] This problem is solved by a method and a detector for beam profiling having the features of the independent claims. Advantageous embodiments which can be realized individually or in any arbitrary combination are listed in the dependent claims as well as in the entire description.

[0008] In a first aspect of the invention, a method for beam profiling using at least one camera is disclosed.

[0009] The camera has at least one sensor element having an optical sensor matrix. The optical sensors each have a photosensitive area. Each optical sensor is designed to generate at least one sensor signal in response to the illumination of a corresponding photosensitive area of ​​the optical sensor by a reflected light beam propagating from an object to the camera.

[0010] These method steps may be performed in a given order or may be performed in a different order. Further, there may be one or more additional method steps not listed. Further, one, more than one or even all method steps may be repeated.

[0011] The method comprises the following steps:

[0012] a) at least one data acquisition step, wherein the data acquisition step comprises illuminating at least one object with at least one illumination pattern comprising at least one illumination feature by using at least one projector, wherein the projector comprises at least one emitter configured to generate at least one light beam, wherein the data acquisition step further comprises imaging at least one reflection image by using the camera, the at least one reflection image comprising at least one reflection feature generated by the object in response to illumination by the illumination feature, wherein the reflection feature comprises at least one beam profile, wherein the reflection image has a first bit depth;

[0013] b) at least one image compression step, wherein the image compression step comprises compressing the reflectance image into a compressed reflectance image having a second bit depth lower than the first bit depth by using at least one evaluation device, wherein the compression comprises applying a non-linear grey value transformation to the sensor signals;

[0014] c) at least one evaluation step, wherein the evaluation step comprises evaluating the compressed reflection image by using the evaluation device, wherein the evaluation comprises determining at least one longitudinal coordinate of the reflection feature by analyzing a corresponding beam profile of the reflection feature.

[0015] The method may be computer-implemented. The term "computer-implemented" as used herein is a broad term and will be given its ordinary and conventional meaning for a person of ordinary skill in the art and is not limited to a special or custom meaning. The term may specifically refer to, but is not limited to, the fact that the method involves at least one computer and / or at least one computer network. The computer and / or computer network may include at least one processor that may be configured to perform at least one method step of the method according to the present invention. Specifically, each of these method steps is performed by a computer and / or a computer network. The method may be performed fully automatically, specifically without user interaction.

[0016] The term "beam profile analysis" (also expressed as depth of photon ratio (DPR)) as used herein is a broad term and shall be given its ordinary and customary meaning to a person of ordinary skill in the art and shall not be limited to a special or custom meaning. The term may specifically refer to, but is not limited to, a method for determining at least one physical quantity or property of an object (such as a ordinate and / or material property) by using a beam profile of a reflected light beam originating from the object. For beam profile analysis, please refer to the following documents: WO 2018 / 091649A1; WO 2018 / 091638A1; WO 2018 / 091640A1; and C. Lennartz, F. Schick, S. Metz, "Whitepaper-Beam Profile Analysis for 3D imagingand material detection", April 28, 2021, Ludwigshafen, Germany, the entire contents of which are incorporated herein by reference. The beam profile analysis can be performed by illuminating the object to be measured by emitting an illumination pattern such as a dot by a projector. The reflection of each spot (i.e., a reflection feature) can be captured by a camera and then its beam profile can be analyzed. From its specific beam profile, information about the ordinate and / or material of the measured object can be determined.

[0017] As used herein, the term "ray" is a broad term and will be given its common and conventional meaning for ordinary technicians in the field and is not limited to special or custom meanings. The term can specifically refer to, but is not limited to, a line perpendicular to the wavefront of light, pointing to the direction of energy flow. As used herein, the term "beam" is a broad term and will be given its common and conventional meaning for ordinary technicians in the field and is not limited to special or custom meanings. The term can specifically refer to, but is not limited to, a collection of rays. In the following, the terms "ray" and "beam" will be used as synonyms. As used herein, the term "beam" is a broad term and will be given its common and conventional meaning for ordinary technicians in the field and is not limited to special or custom meanings. The term can specifically refer to, but is not limited to, a certain amount of light, specifically a certain amount of light that travels substantially in the same direction, including the possibility that the beam has an expansion angle or a widening angle. As used herein, the term "beam profile" is a broad term and will be given its common and conventional meaning for ordinary technicians in the field and is not limited to special or custom meanings. The term may specifically refer to, but is not limited to, the spatial distribution of the intensity of the beam, in particular the spatial distribution in at least one plane perpendicular to the propagation of the beam. A beam profile may be a transverse intensity profile of the beam. A beam profile may be a cross section of the beam. The beam profile may be selected from the group consisting of: a trapezoidal beam profile; a triangular beam profile; a conical beam profile, and a linear combination of Gaussian beam profiles. However, other embodiments are also possible. The beam profile may also be expressed as a reflection profile or a spot profile.

[0018] As used herein, the term "object" is a broad term and will be given its ordinary and conventional meaning to a person of ordinary skill in the art and is not limited to a special or custom meaning. The term may specifically refer to, but is not limited to, any object to be measured, particularly a surface or area, that is configured to at least partially reflect at least one light beam impinging on the object. For example, the object may be a person, particularly skin. The object may include a surface or area that is configured to at least partially perform one or more of the following in response to at least one light beam impinging on the object: reflection and / or scattering and / or emission. The light beam may originate from a projector that illuminates the object, wherein the light beam is reflected and / or scattered by the object. The object may be part of a scene that includes the object and additional surroundings.

[0019] Projectors, cameras and evaluation devices can be elements of detectors. As used herein, the term "detector" is a broad term and will be given its common and conventional meaning for those of ordinary skill in the art and is not limited to special or custom meanings. The term specifically may refer to but is not limited to any sensor device configured to determine and / or detect and / or sense an object. The detector may be a fixed device or a mobile device. Further, the detector may be an independent device or may form a part of another device (e.g., a computer, a vehicle or any other device). Further, the detector may be a handheld device. Other embodiments of the detector are also feasible. The detector may be one attached to or integrated in a mobile device (e.g., a mobile phone or a smart phone). The detector may be integrated in a mobile device, such as in a housing of the mobile device. Additionally or alternatively, the detector or at least one component of the detector may be attached to the mobile device, such as by using a connector such as a USB or a telephone connector such as a headphone jack.

[0020] The data acquisition step includes illuminating at least one object using at least one illumination pattern including at least one illumination feature by using at least one projector. The projector includes at least one emitter configured to generate at least one light beam.

[0021] As used herein, the term "projector", also denoted as light projector, is a broad term and shall be given its ordinary and customary meaning to one of ordinary skill in the art and shall not be limited to a special or custom meaning. The term may specifically refer to, but is not limited to, an optical device configured to project at least one illumination pattern onto an object, particularly onto a surface of an object. The projector is configured to illuminate the object using at least one illumination pattern comprising a plurality of illumination features.

[0022] As used herein, the term "pattern" is a broad term and will be given its ordinary and conventional meaning to a person of ordinary skill in the art and is not limited to a special or custom meaning. The term may specifically refer to, but is not limited to, any known or predetermined arrangement of features (e.g., symbols) of multiple arbitrary shapes. A pattern may include multiple features. A pattern may include an arrangement of periodic or non-periodic features. As used herein, the term "at least one illumination pattern" is a broad term and will be given its ordinary and conventional meaning to a person of ordinary skill in the art and is not limited to a special or custom meaning. The term may specifically refer to, but is not limited to, at least one arbitrary pattern of illumination features that includes at least a portion of an irradiated object.

[0023] As used herein, the term "illumination feature" is a broad term and is to be given its ordinary and customary meaning to one of ordinary skill in the art and is not limited to a special or custom meaning. The term may specifically refer to, but is not limited to, at least one at least partially extending feature of a pattern. The illumination pattern includes a plurality of illumination features. For example, the illumination pattern includes at least 10, 20, 100, 1000, or even more illumination features.

[0024] The illumination pattern may include at least one pattern selected from the group consisting of: at least one quasi-random pattern; at least one Sobol pattern; at least one quasi-periodic pattern; at least one dot pattern, in particular a pseudo-random dot pattern; at least one line pattern; at least one stripe pattern; at least one checkerboard pattern; at least one triangular pattern; at least one rectangular pattern; at least one hexagonal pattern or a pattern comprising a further convex tessellation. The illumination pattern may exhibit at least one illumination feature selected from the group consisting of: at least one dot; at least one line; at least two lines, such as parallel lines or crossing lines; at least one dot and one line; at least one arrangement of periodic features; at least one feature pattern of arbitrary shape. For example, the illumination pattern includes at least one pattern, the at least one pattern including at least one predicted feature. For example, the illumination pattern includes at least one line pattern, the at least one line pattern including at least one line. For example, the illumination pattern includes at least one line pattern, the at least one line pattern including at least two lines such as parallel lines or crossing lines. For example, the projector may be configured to generate and / or project a point cloud or a non-point feature. For example, the projector may be configured to generate a point cloud or a non-point feature so that the illumination pattern may include a plurality of point features or non-point features. As further used herein, the term "illuminating an object with at least one illumination pattern" may refer to providing at least one illumination pattern for illuminating at least one object.

[0025] The projector includes at least one emitter configured to generate at least one light beam. The projector may include at least one emitter array. Each of these emitters may be configured to emit at least one light beam.

[0026] The light beam generated by the emitter can generally propagate parallel to the optical axis or propagate obliquely relative to the optical axis (e.g., including at an angle to the optical axis). The projector can be configured so that the light beam propagates from the detector to the object along the optical axis of the projector. For this purpose, the detector may include at least one reflective element for deflecting the light beam onto the optical axis, preferably deflecting at least one prism. As an example, the light beam may include an angle of less than 10°, preferably less than 5° or even less than 2° with the optical axis. However, other embodiments are also feasible. Further, the light beam may be located on the optical axis or outside the optical axis. As an example, one or more light beams may be parallel to the optical axis and have a distance less than 10 mm from the optical axis, preferably less than 5 mm from the optical axis or even less than 1 mm from the optical axis, or may even coincide with the optical axis.

[0027] As used herein, the term "emitter" is a broad term and will be given its ordinary and conventional meaning to a person of ordinary skill in the art and is not limited to a special or custom meaning. The term may specifically refer to, but is not limited to, at least one arbitrary device configured to provide at least one light beam for irradiating the object. Each of these emitters may be and / or may include at least one element selected from the group consisting of at least one laser source and at least one non-laser light source, such as at least one semiconductor laser, at least one double heterostructure laser, at least one external cavity laser, at least one separated confined heterostructure laser, at least one quantum cascade laser, at least one distributed Bragg reflector laser, at least one polariton laser, at least one hybrid silicon laser, at least one extended cavity diode laser, at least one quantum dot laser, at least one volume Bragg grating laser, at least one indium arsenide laser, at least one gallium arsenide laser, at least one transistor laser, at least one diode pump laser, at least one distributed feedback laser, at least one quantum well laser, at least one interband cascade laser, at least one semiconductor ring laser, at least one vertical cavity surface emitting laser (VCSEL); the at least one non-laser light source is, for example, at least one LED or at least one light bulb.

[0028] The array of emitters may be a two-dimensional or one-dimensional array. The array may include a plurality of emitters arranged in a matrix. As used herein, the term "matrix" is a broad term and will be given its ordinary and conventional meaning to a person of ordinary skill in the art and is not limited to a special or custom meaning. The term may specifically refer to, but is not limited to, the arrangement of a plurality of elements in a predetermined geometric order. Specifically, the matrix may be or may include a rectangular matrix having one or more rows and one or more columns. Specifically, the rows and columns may be arranged in a rectangular manner. However, other arrangements are also feasible, such as non-rectangular arrangements. As an example, a circular arrangement is also feasible, in which the elements are arranged in concentric circles or ellipses around a center point.

[0029] For example, the emitter may be a VCSEL array. As used herein, the term "vertical cavity surface emitting laser" is a broad term and will be given its ordinary and conventional meaning to a person of ordinary skill in the art and is not limited to a special or custom meaning. The term may specifically refer to, but is not limited to, a semiconductor laser diode configured to emit a laser beam vertically relative to a top surface. Examples of VCSELs can be found, for example, in en.wikipedia.org / wiki / Vertical-cavity_surface-emitting_laser. VCSELs are generally known to technicians, such as from WO 2017 / 222618A. Each of the VCSELs is configured to generate at least one light beam. The VCSELs may be arranged on a common substrate or on different substrates. The array may include up to 2500 VCSELs. For example, the array may include 38×25 VCSELs, such as a high-power array with 3.5W. For example, the array may include 10×27 VCSELs with 2.5W. For example, the array may include 96 VCSELs with 0.9W. For example, an array with 2500 elements may have a size of at most 2 mm x 2 mm.

[0030] The light beam emitted by the corresponding emitter may have a wavelength of 300 to 1100nm, preferably 500 to 1100nm. For example, the light beam may have a wavelength of 940nm. For example, light in the infrared spectrum, such as light in the range of 780nm to 3.0μm, may be used. Specifically, light in a portion of the near-infrared region (specifically in the range of 700nm to 1100nm) for which a silicon photodiode is applicable may be used. The emitter may be configured to generate at least one illumination pattern in the infrared region, particularly in the near-infrared region. Using light in the near-infrared region may allow the light to be undetectable or only weakly detected by the human eye, and still be detectable by a silicon sensor, particularly a standard silicon sensor. For example, the emitter may be a VCSEL array. The VCSEL may be configured to emit a light beam having a wavelength range of 800 to 1000nm. For example, the VCSEL may be configured to emit a light beam of 808nm, 850nm, 940nm or 980nm. Preferably, the VCSEL emits light at 940 nm, since terrestrial solar radiation has a local minimum in irradiance at this wavelength, as described, for example, in CIE 085-1989 "Solar spectral irradiance".

[0031] The projector may include at least one transfer device configured to generate an illumination feature from a light beam impinging on the transfer device. The term "transfer device" (also denoted "transfer system") may generally refer to one or more optical elements suitable for changing a light beam (such as by changing one or more of the beam parameters of the light beam, the width of the light beam, or the direction of the light beam). The transfer device may include at least one imaging optical device. The transfer device may specifically include one or more of the following: at least one lens, for example, at least one lens selected from the group consisting of at least one adjustable focus lens, at least one aspherical lens, at least one spherical lens, at least one Fresnel lens; at least one diffractive optical element; at least one concave mirror; at least one beam deflection element, preferably at least one reflector; at least one beam splitting element, preferably at least one of a beam splitting cube or a beam splitter; at least one multi-lens system; at least one holographic optical element; at least one meta-optical element. In particular, the transfer device includes at least one refractive optical lens module. Therefore, the transfer device may include a multi-lens system with refractive properties.

[0032] The projector may include at least one diffractive optical element (DOE) configured to generate an illumination pattern. The DOE may be configured to generate multiple beams from a single incident beam.

[0033] The data acquisition step further includes imaging at least one reflected image using a camera, the at least one reflected image including at least one reflected feature generated by the object in response to illumination by the illumination feature. The term "camera" as used herein is a broad term and will be given its ordinary and conventional meaning to a person of ordinary skill in the art and is not limited to a special or custom meaning. The term may specifically refer to, but is not limited to, a device having at least one imaging element configured to record or capture spatially resolved one-dimensional, two-dimensional or even three-dimensional optical data or information. The camera may be a digital camera. As an example, the camera may include at least one camera chip, such as at least one CCD chip and / or at least one CMOS chip configured to record images. The camera may be or may include at least one near infrared camera.

[0034] As used herein, without limitation, the term "image" may specifically relate to data recorded using a camera, such as a plurality of electronic readings from a camera, such as pixels of a camera chip. The image itself may include pixels, the pixels of the image being associated with the pixels of a matrix of sensor elements. Thus, when "pixel" is mentioned, either a unit of image information generated by a single pixel of a sensor element is referred to, or a single pixel of a sensor element is referred to directly. The image may be at least one two-dimensional image. As used herein, the term "two-dimensional image" may generally refer to an image having information about abscissas (such as dimensions of height and width). The image may be an RGB (red, green, blue) image. However, other embodiments are also feasible.

[0035] In addition to at least one camera chip or imaging chip, the camera may include further elements, such as one or more optical elements, for example one or more lenses. As an example, the camera may be a fixed focal length camera, at least one of whose lenses is fixed relative to the adjustment of the camera. However, alternatively, the camera may also include one or more variable lenses that can be adjusted automatically or manually.

[0036] The camera may be a camera of a mobile device, such as a notebook computer, a tablet computer, or in particular a cellular phone (such as a smart phone). Thus, in particular, the camera may be part of a mobile device, which in addition to the camera includes one or more data processing devices, such as one or more data processors. However, other cameras are also feasible. The term "mobile device" as used herein is a broad term and will be given its ordinary and conventional meaning to a person of ordinary skill in the art and is not limited to a special or custom meaning. The term may specifically refer to, but is not limited to, a mobile electronic device, and more specifically to a mobile communication device such as a cellular phone or a smart phone. Additionally or alternatively, a mobile device may also refer to a tablet computer or other type of portable computer.

[0037] The term "sensor element" as used herein is a broad term and will be given its ordinary and conventional meaning for a person of ordinary skill in the art and is not limited to a special or custom meaning. The term may specifically refer to, but is not limited to, a device or a combination of multiple devices configured to sense at least one parameter. In this case, the parameter may specifically be an optical parameter, and the sensor element may specifically be an optical sensor element. The sensor element may be formed as a single device as a whole or as a combination of several devices. Specifically, the matrix may be or may include a rectangular matrix having one or more rows and one or more columns. Specifically, the rows and columns may be arranged in a rectangular manner. However, other arrangements are also feasible, such as non-rectangular arrangements. As an example, a circular arrangement is also feasible, in which the elements are arranged in concentric circles or ellipses around a center point. For example, the matrix may be a single row of pixels. Other arrangements are also feasible.

[0038] The term "optical sensor" as used herein is a broad term and will be given its ordinary and conventional meaning to a person of ordinary skill in the art and is not limited to a special or custom meaning. The term may specifically refer to, but is not limited to, a photosensitive device for detecting a light beam (such as for detecting an illumination and / or a light spot generated by at least one light beam). As further used herein, a "photosensitive area" generally refers to an area of ​​an optical sensor that can be illuminated from the outside by at least one light beam, and in response to the illumination, the at least one sensor signal is generated. The photosensitive area may specifically be located on the surface of the corresponding optical sensor. However, other embodiments are also feasible. Specifically, the optical sensors of the matrix may be identical in size, sensitivity, and one or more of other optical, electrical, and mechanical properties. Specifically, the photosensitive areas of all optical sensors of the matrix may be located in a common plane, which is preferably oriented toward the object so that the light beam propagating from the object to the camera may generate a light spot on the common plane.

[0039] As used herein, the term "optical sensor each having at least one photosensitive area" may refer to a configuration of multiple single optical sensors each having one photosensitive area as well as a configuration of a combined optical sensor having multiple photosensitive areas. Thus, the term "optical sensor" also refers to a photosensitive device configured to generate one output signal, while in this document, a photosensitive device (e.g., at least one CCD and / or CMOS device) configured to generate two or more output signals is referred to as two or more optical sensors. Each optical sensor may be implemented such that there is exactly one photosensitive area in the respective optical sensor, such as by providing exactly one photosensitive area that can be irradiated, in response to which irradiation, generating exactly one unified sensor signal for the entire optical sensor. Thus, each optical sensor may be a single-area optical sensor. However, the use of a single-area optical sensor makes the arrangement of the detector particularly simple and efficient. Thus, as an example, commercially available photosensors, such as commercially available silicon photodiodes, each having only one sensitive area may be used in the arrangement. However, other embodiments are also possible. Thus, as an example, an optical device comprising two, three, four or more than four photosensitive areas may be used, which optical device is regarded in the context of the present invention as two, three, four or more than four optical sensors. As described above, the sensor element comprises an optical sensor matrix. Thus, as an example, the optical sensor may be part of or constitute a pixelated optical device. As an example, the optical sensor may be part of or constitute at least one CCD and / or CMOS device having a matrix of pixels, each pixel forming a photosensitive area.

[0040] In particular, the optical sensor may be or may comprise a photodetector, preferably an inorganic photodetector, more preferably an inorganic semiconductor photodetector, most preferably a silicon photodetector. In particular, the optical sensor may be sensitive in the infrared spectral range. In particular, all optical sensors of the matrix or at least one group of optical sensors of the matrix may be identical. In particular, multiple groups of identical optical sensors in the matrix may be provided for different spectral ranges, or all optical sensors may be identical in terms of spectral sensitivity. Further, the optical sensors may be identical in size and / or in terms of their electronic or optoelectronic properties.

[0041] In particular, the optical sensor may be or may include an inorganic photodiode having sensitivity in the infrared spectral range, preferably in the range of 780 nm to 3.0 micrometers. In particular, the optical sensor may be sensitive in a part of the near infrared region for which silicon photodiodes are applicable, in particular in the range of 700 nm to 1000 nm. The infrared optical sensor that can be used for the optical sensor may be a commercially available infrared optical sensor, such as the one available from trinamiX GmbH, Ludwigshafen am Rhein, Germany (D-67056), under the trade name Hertzstueck TM Commercially available infrared optical sensors. Thus, as an example, the optical sensor may comprise at least one optical sensor of the intrinsic photovoltaic type, more preferably at least one semiconductor photodiode selected from the group consisting of: Ge photodiode, InGaAs photodiode, extended InGaAs photodiode, InAs photodiode, InSb photodiode, HgCdTe photodiode. Additionally or alternatively, the optical sensor may comprise at least one optical sensor of the extrinsic photovoltaic type, more preferably at least one semiconductor photodiode selected from the group consisting of: Ge:Au photodiode, Ge:Hg photodiode, Ge:Cu photodiode, Ge:Zn photodiode, Si:Ga photodiode, Si:As photodiode. Additionally or alternatively, the optical sensor may comprise at least one bolometer, preferably a bolometer selected from the group consisting of VO bolometers and amorphous Si bolometers.

[0042] The matrix may consist of independent optical sensors. Thus, the matrix may consist of inorganic photodiodes. However, alternatively, commercially available matrices such as one or more of a CCD detector (such as a CCD detector chip) and / or a CMOS detector (such as a CMOS detector chip) may be used.

[0043] The optical sensors of the sensor element may form a sensor array, or may be part of a sensor array, such as the above-mentioned matrix. Thus, as an example, the sensor element may comprise an optical sensor array, such as a rectangular array with m rows and n columns, wherein m and n are respectively positive integers. Preferably there are more than one column and more than one row, i.e. n>1, m>1. Thus, as an example, n may be 2 to 16 or higher, and m may be 2 to 16 or higher. Preferably, the ratio of the number of rows to the number of columns is close to 1. As an example, n and m may be selected such that 0.3≤m / n≤3, such as by selecting m / n=1:1, 4:3, 16:9, etc. As an example, the array may be a square array with the same number of rows and columns, such as by selecting m=2, n=2 or m=3, n=3, etc.

[0044] Specifically, the matrix can be a rectangular matrix with at least one row (preferably multiple rows) and multiple columns. As an example, the rows and columns can be oriented substantially vertically. As used herein, the term "substantially vertical" refers to a condition of vertical orientation, with a tolerance of, for example, ±20° or less, preferably a tolerance of ±10° or less, and more preferably a tolerance of ±5° or less. Similarly, the term "substantially parallel" refers to a condition of parallel orientation, with a tolerance of, for example, ±20° or less, preferably a tolerance of ±10° or less, and more preferably a tolerance of ±5° or less. In order to provide a wide range of visual fields, the matrix can specifically have at least 10 rows, preferably at least 50 rows, and more preferably at least 100 rows. Similarly, the matrix can have at least 10 columns, preferably at least 50 columns, and more preferably at least 100 columns. The matrix can include at least 50 optical sensors, preferably at least 100 optical sensors, and more preferably at least 500 optical sensors. The matrix can include a number of pixels in the range of millions of pixels. However, other embodiments are also feasible. Therefore, in an arrangement intended to have axial rotational symmetry, a circular or concentric arrangement of the optical sensors (which may also be referred to as pixels) of the matrix may be preferred.

[0045] The reflected light beam may propagate from the object towards the camera. The reflected light beam may originate from the object. The projector may illuminate the object with at least one illumination pattern, and the light is at least partially re-emitted, reflected and / or scattered by the object and thereby at least partially directed to the camera as a reflected light beam.

[0046] The optical sensor may be sensitive in one or more spectral ranges in the ultraviolet spectral range, the visible spectral range or the infrared spectral range. Specifically, the optical sensor may be sensitive in the visible spectral range of 500nm to 780nm, most preferably in the range of 650nm to 750nm or in the range of 690nm to 700nm. Specifically, the optical sensor may be sensitive in the near infrared region. Specifically, the optical sensor may be sensitive in a part of the near infrared region applicable to silicon photodiodes (specifically in the range of 700nm to 1000nm). Specifically, the optical sensor may be sensitive in the infrared spectral range, specifically in the range of 780nm to 3.0 microns. For example, the optical sensors may each independently be or may include at least one element selected from the group consisting of a photodiode, a photocell, a photoconductor, a phototransistor or any combination of the above. For example, the optical sensor may be or may include at least one element selected from the group consisting of a CCD sensor element, a CMOS sensor element, a photodiode, a photocell, a photoconductor, a phototransistor or any combination of the above. Any other type of photosensitive element may be used. The photosensitive element may generally be made wholly or partly of inorganic materials and / or may be made wholly or partly of organic materials. Most commonly, one or more photodiodes may be used, such as commercially available photodiodes, for example inorganic semiconductor photodiodes.

[0047] As used herein, the term "sensor signal" is a broad term and will be given its ordinary and conventional meaning to a person of ordinary skill in the art and is not limited to a special or custom meaning. The term may specifically refer to, but is not limited to, a signal generated by an optical sensor in response to the illumination of a light beam. Specifically, the sensor signal may be or may include at least one electrical signal, such as at least one analog electrical signal and / or at least one digital electrical signal. More specifically, the sensor signal may be or may include at least one voltage signal and / or at least one current signal. More specifically, the sensor signal may include at least one photocurrent. Further, the raw sensor signal may be used, or the imaging device, optical sensor or any other element may be configured to process or pre-process the sensor signal (such as by filtering, etc.) to generate secondary sensor signals, which may also be used as sensor signals.

[0048] In particular, the light beam generated by the object (also indicated as reflected light beam) may completely illuminate the sensor element, such that the sensor element is completely within the light beam, wherein the width of the light beam is greater than the matrix. Conversely, preferably, the reflected light beam may specifically produce a light spot smaller than the matrix over the entire matrix, such that the light spot is completely within the matrix. This situation can be easily adjusted by a person skilled in the art of optics by selecting one or more suitable lenses or elements that have a focusing or defocusing effect on the light beam (for example by using a suitable transfer device).

[0049] The camera may include a transfer device configured to direct the light beam onto the optical sensors and to form the reflected image on the sensor element. The detector may include an optical axis. For example, the transfer device may constitute a coordinate system, wherein the ordinate z is a coordinate along the optical axis of the transfer device. The coordinate system may be a polar coordinate system, wherein the optical axis of the transfer device forms the z axis, and wherein the distance from the z axis, and the polar angle may be used as additional coordinates. For example, the transfer device may constitute a coordinate system, wherein the optical axis of the detector forms the z axis, and wherein, in addition, an x ​​axis and a y axis perpendicular to the z axis and perpendicular to each other may be provided. As an example, the detector may stay at a specific point in the coordinate system, such as the origin of the coordinate system. A direction parallel to or antiparallel to the z axis may be considered as a longitudinal direction, and a coordinate along the z axis may be considered as a ordinate. Any direction perpendicular to the z axis may be considered as a transverse direction, and the polar coordinates and / or the polar angle may be considered as a transverse coordinate. Alternatively, other types of coordinate systems may be used. Thus, as an example, a polar coordinate system may be used, wherein the optical axis forms the z-axis, and wherein the distance from the z-axis, and the polar angle may be used as additional coordinates. Directions parallel or antiparallel to the z-axis may be considered longitudinal directions, and coordinates along the z-axis may be considered ordinates. Any direction perpendicular to the z-axis may be considered transverse directions, and polar coordinates and / or polar angles may be considered abscissas.

[0050] The camera may include a global shutter and / or may be operated in a global shutter mode. As used herein, the term "global shutter" is a broad term and will be given its ordinary and customary meaning to one of ordinary skill in the art and is not limited to a special or custom meaning. The term may specifically refer to, but is not limited to, an electronic shutter configured to quantize the exposure time of a sensor element. The global shutter may be configured such that exposure of each pixel of the sensor element starts and ends simultaneously.

[0051] As used herein, the term "reflected image" is a broad term and will be given its ordinary and conventional meaning to a person of ordinary skill in the art and will not be limited to a special or custom meaning. The term may specifically refer to, but is not limited to, an image including a plurality of reflective features determined by a camera. As used herein, the term "reflected features" is a broad term and will be given its ordinary and conventional meaning to a person of ordinary skill in the art and will not be limited to a special or custom meaning. The term may specifically refer to, but is not limited to, features in an image plane generated by an object in response to illumination with at least one illumination feature. A reflected image may include at least one reflection pattern including a reflective feature. As used herein, the term "imaging at least one reflected image" is a broad term and will be given its ordinary and conventional meaning to a person of ordinary skill in the art and will not be limited to a special or custom meaning. The term may specifically refer to, but is not limited to, one or more of: capturing, recording, and generating a reflected image.

[0052] The reflection feature includes at least one beam profile. Each of these reflection features includes at least one beam profile. As used herein, the term "beam profile" is a broad term and will be given its ordinary and conventional meaning to a person of ordinary skill in the art and is not limited to a special or custom meaning. The term may specifically refer to, but is not limited to, the spatial distribution of beam intensity, particularly in at least one plane perpendicular to the propagation of the beam. The beam profile may be a transverse intensity profile of the beam. The beam profile may be a cross-section of the beam. The beam profile may be selected from the group consisting of: a trapezoidal beam profile; a triangular beam profile; a conical beam profile, and a linear combination of Gaussian beam profiles. However, other embodiments are also feasible.

[0053] The reflected image has a first bit depth. The term "bit depth" (also denoted as digitization depth) as used herein is a broad term and will be given its ordinary and conventional meaning to a person of ordinary skill in the art and is not limited to a special or custom meaning. The term may specifically refer to, but is not limited to, the number of bits per pixel in an image. The higher the first bit depth, the more information that can be stored. For example, the first bit depth is at least one bit depth selected from a range consisting of 9 to 16. For example, the first bit depth may be 10 bits. However, even higher first bit depths are possible, such as 32 bits.

[0054] For example, for storage and / or transmission and / or further analysis, it may be necessary to compress the first bit depth. As used herein, the term "compression" is a broad term and will be given its ordinary and conventional meaning to one of ordinary skill in the art and is not limited to a special or custom meaning. The term may specifically refer to, but is not limited to, transforming information using fewer bits than the original representation. Compression may include quantization by compressing a range of values ​​into a single quantum value. Quantization may be performed using a limited number of quantization levels.

[0055] As outlined above, the method comprises in step b) at least one image compression step. The image compression step comprises compressing the reflectance image into a compressed reflectance image having a second bit depth lower than the first bit depth by using at least one evaluation device. The second bit depth may be the number of bits per pixel of the compressed reflectance image. The second bit depth is lower than the first bit depth. For example, the second bit depth is 8 to 15 bits.

[0056] Typically, compression is lossy and may in particular result in a loss of signal range, resolution and / or contrast. However, in order to use reliable results for beam profile analysis, the signal may need to be as "physical" as possible. A further known technique uses equidistant quantization for image sensors. However, in the case of a linear camera with low dark noise, equidistant quantization may be inappropriate. The camera may have low dark noise. Therefore, the variance of the temporal noise may increase linearly with the sensor signal. In order to be able to resolve the low noise in the dark parts of the picture, many quantization levels will be required. However, as a result, in the bright parts, the quantization may become too fine, so that the standard deviation of the temporal noise greatly exceeds the standard deviation of the quantization levels. This means that general equidistant quantization of image sensors may be suboptimal.

[0057] The compression comprises applying a non-linear gray value transformation to the sensor signal. The non-linear gray value transformation can be configured as described in: B. and Schwarzbauer, M., “Noise equalisation and quasi loss-less image data compression–or how many bits needs an imagesensor?” tm–Technisches Messen, 83, 16–24, doi:10.1515 / teme-2015-0093, published online December 17, 2015, 2016. Nonlinear grayscale value transformations can allow image compression from a first bit depth (e.g., 10 bits) to a lower second bit depth (e.g., 8 bits) while minimizing information losses, in particular in terms of signal range, resolution and / or contrast.

[0058] The term "gray value" (also denoted gray level) as used herein is a broad term and is to be given its ordinary and customary meaning to one of ordinary skill in the art and is not limited to a special or custom meaning. The term may specifically refer to, but is not limited to, an indication of the brightness of a pixel. The maximum gray value may depend on the bit depth.

[0059] Not bound by this theory, the variance of the temporal noise σ 2 g (g) may depend strongly on the gray value g. The relationship between the variance and the mean of the gray values ​​can be described by the so-called photon transfer curve. With the help of nonlinear gray value transformation, the temporal noise can be modified in such a way that the standard deviation of the temporal noise becomes independent of the gray value, thus producing a noise-equalized signal. As in B.: Digitale Bildverarbeitung [Digital Image Processing], Springer, Berlin, 6th edition, doi:10.1007 / b138991, 2005, from the law governing error propagation, it is known that the variance of the nonlinear function h(g) is, to first order,

[0060]

[0061] If σ 2 h is a constant value, then formula (1) can be transformed into

[0062]

[0063] And the points are generated

[0064]

[0065] The integration constant can be chosen so that h(0) = 0. Equation (2) indicates that for each function σ 2 g (g) has an analytical solution and can be integrated. Otherwise, numerical integration can be performed.

[0066] With a linear camera, the variance of temporal noise increases linearly with the grayscale value g:

[0067]

[0068] Here, the variance of the dark noise is (in DN), K is the magnification of the camera (in DN / electron), see EMVA Standard 1288-Standard for Characterization of Image Sensors and Cameras, Version 3.1, Open Standard, European Machine Vision Association, doi:10.5281 / zenodo.235942, 2016. Using the linear variance function (3), the integral in (2) is calculated as

[0069]

[0070] The free parameter σ in the nonlinear transformation signal h(g) can be used h and a constant standard deviation of temporal noise in order to determine the signal range [0, h max ] and / or the number of bits necessary to compress the signal.

[0071]

[0072] Equation (3) can be rewritten as follows

[0073]

[0074] Among them, g max is the maximum gray value. This yields the condition h(g max )=h max ,then

[0075] and

[0076] Therefore, we can calculate how many bits are needed for proper quantization of the noise-equalized signal:

[0077]

[0078] The right-hand side approximation can be used because σ max >>σ0. Therefore, the maximum (signal-to-noise ratio) SNR of the camera determines how many bits are needed for adequate quantization independent of dark noise. From this equation, it can be found how many bits are needed to quantize the equalized signal h. This is given by h max The value of σ is given. h Can be between 0.5 and 1. This allows for optimal quantization, see: B. and Schwarzbauer, M., “Noise equalisation and quasi loss-less image data compression–or how many bits needs an image sensor?” tm–Technisches Messen, 83, 16–24, doi:10.1515 / teme-2015-0093, published online 17 December 2015, 2016.

[0079] These considerations show that it is possible to compress the image data of a camera, in particular a linear camera, using a nonlinear grayscale value transformation, whose maximum SNR is < 126 and with the aid of a nonlinear grayscale value transformation. h = 1. In this way, the entire signal range of the camera can be covered.

[0080] The non-linear gray value transformation h(g) may be applied using at least one predetermined lookup table of non-linear gray value transformation h as a function of gray value g, where g is the gray value of a pixel with a higher bit depth. For example, in case of compression to 8 bits, the lookup table may have 2 at 8 bit resolution, depending on the resolution of the camera. 10 or 2 12 value.

[0081] For example, the nonlinear grayscale value transformation may include applying a nonlinear grayscale value transformation as described in equation (4) to the grayscale value g. Using this formula may be advantageous because the required parameters can be directly obtained from measurements of EMVA Standard 1288-(Standard for Characterization of Image Sensors and Cameras, Version 3.1, Open Standard, European Machine Vision Association, doi:10.5281 / zenodo.235942, 2016), namely the dark noise σ0 in DN (in the EMVA 1288 standard, it is referred to as σ y.dark) and the magnification K. Both parameters arise from the offset and gradient of the photon transfer curve. For the photon transfer curve, absolute radiometric measurements may not be required because the variance of the temporal noise is plotted as a function of the photoinduced mean gray value.

[0082] In particular, the nonlinear grayscale value transformation may include applying a nonlinear grayscale value transformation to the grayscale value g

[0083]

[0084] Among them, σ g is the standard deviation of the sensor signal, K is the camera system gain, σ0 2 is the dark noise, g off is a predetermined offset of g, and h0 is a predetermined offset of h. Using this formula ensures the correct choice of the offsets of g and h, since values ​​lower than the average dark value may be obtained due to temporal noise. g0 may be chosen in such a way that the average dark value μ of the camera is first considered. g.dark , and then subtract the additional value g0, which produces g offs =μ g.dark +g0.

[0085] The term "evaluation device" as used herein is a broad term and will be given its ordinary and conventional meaning for a person of ordinary skill in the art and is not limited to a special or custom meaning. The term may specifically refer to, but is not limited to, any device suitable for performing a specified operation, preferably by using at least one data processing device, more preferably by using at least one processor and / or at least one application-specific integrated circuit. Thus, as an example, the at least one evaluation device may include at least one data processing device having software code stored thereon, the software code including a plurality of computer commands. The evaluation device may provide one or more hardware elements for performing one or more of the specified operations and / or may provide one or more processors on which software is run to perform one or more of the specified operations. The operation includes evaluating an image. Specifically, determining a beam profile and an indication of a surface may be performed by the at least one evaluation device. Thus, as an example, one or more instructions may be implemented in software and / or hardware. Thus, as an example, the evaluation device may include one or more programmable devices, such as one or more computers, application-specific integrated circuits (ASICs), digital signal processors (DSPs) or field programmable gate arrays (FPGAs) configured to perform the above-mentioned evaluation. However, additionally or alternatively, the evaluation device may also be implemented in whole or in part by hardware.

[0086] The evaluation device may be or may include one or more integrated circuits (such as one or more application specific integrated circuits (ASICs)), and / or one or more data processing devices (such as one or more computers, preferably one or more microcomputers and / or microcontrollers), field programmable arrays or digital signal processors. Additional components may be included, such as one or more pre-processing devices and / or data acquisition devices, such as one or more devices for receiving and / or pre-processing sensor signals, such as one or more AD converters and / or one or more filters. Further, the evaluation device may include one or more measuring devices, such as one or more measuring devices for measuring current and / or voltage. Further, the evaluation device may include one or more data storage devices. Further, the evaluation device may include one or more interfaces, such as one or more wireless interfaces and / or one or more wired interfaces.

[0087] The evaluation device may be connected to or may include at least one further data processing device, which may be used to display, visualize, analyze, distribute, transmit or further process one or more of the information (such as information obtained by the optical sensor and / or the evaluation device). As an example, the data processing device may be connected to or incorporate at least one of a display, a projector, a monitor, an LCD, a TFT, a loudspeaker, a multi-channel sound system, an LED pattern, or another visualization device. The data processing device may further be connected to or incorporate at least one of a communication device or a communication interface, connector or port, capable of sending encrypted or unencrypted information using one or more of email, text messaging, telephone, Bluetooth, Wi-Fi, infrared or Internet interfaces, ports or connectors. The data processing device may further be connected to or incorporate at least one of the following: a processor, a graphics processor, a CPU, an Open Multimedia Application Platform (OMAP) TM ), integrated circuits, systems on chips (such as those from Apple's A series or Samsung's S3C2 series), microcontrollers or microprocessors, one or more memory blocks (such as ROM, RAM, EEPROM or flash memory), timing sources such as oscillators or phase-locked loops, counter-timers, real-time timers, or power-on reset generators, voltage regulators, power management circuits, or DMA controllers. The individual units can be further connected via a bus (such as an AMBA bus) or integrated into a network of the Internet of Things or Industry 4.0 type.

[0088] The evaluation device and / or the data processing device may be connected to or have additional external interfaces or ports, such as one or more of a serial or parallel interface or port, USB, Centronics port, FireWire, HDMI, Ethernet, Bluetooth, RFID, Wi-Fi, USART or SPI, or an analog interface or port, such as one or more of an ADC or DAC, or a standardized interface or port to other devices, such as a 2D camera device using an RGB interface such as CameraLink. The evaluation device and / or the data processing device may further be connected to one or more of an inter-processor interface or port, an FPGA-FPGA interface, or a serial or parallel interface port. The evaluation device and the data processing device may further be connected to one or more of an optical drive, a CD-RW drive, a DVD+RW drive, a flash drive, a memory card, a magnetic disk drive, a hard disk drive, a solid state drive, or a solid state hard disk.

[0089] The evaluation device and / or the data processing device may be connected via or have one or more further external connectors, such as one or more of a telephone connector, an RCA connector, a VGA connector, a hermaphroditic connector, a USB connector, an HDMI connector, an 8P8C connector, a BCN connector, an IEC 60320C14 connector, a fiber optic connector, a D-subminiature connector, an RF connector, a coaxial connector, a SCART connector, an XLR connector, and / or may incorporate at least one suitable socket for one or more of these connectors.

[0090] In step c), the evaluation step comprises evaluating the compressed reflection image by using the evaluation device. The evaluation comprises determining at least one longitudinal coordinate of the reflection feature by analyzing a corresponding beam profile of the reflection feature.

[0091] The analysis of the beam profile may include determining at least one first region and at least one second region of the beam profile. The analysis of the beam profile may further include deriving a combined signal Q by one or more of: dividing the first region by the second region, dividing a multiple of the first region by the second region, dividing a linear combination of the first region by the second region. The analysis of the beam profile may further include determining the ordinate using at least one predetermined relationship between the combined signal Q and the ordinate.

[0092] The evaluation device may be configured to identify and / or select reflective features in the compressed reflective image. The evaluation device may be configured to perform at least one image analysis and / or image processing in order to identify and / or select reflective features. The image analysis and / or image processing may use at least one feature detection algorithm. The image analysis and / or image processing may include one or more of the following: filtering; selecting at least one region of interest; forming a difference image between an image created by a sensor signal and at least one offset; inverting a sensor signal by inverting an image created by the sensor signal; forming a difference image between images created by the sensor signal at different times; background correction; decomposition into color channels; decomposition into hue; saturation; and brightness channels; frequency decomposition; singular value decomposition; applying a blob detector; applying a corner detector; applying a Hessian determinant filter; applying a region detector based on principal curvature; applying a maximum stable extremum region detector; applying a generalized Hough transform; applying a ridge detector; applying an affine invariant feature detector; applying an affine adaptive interest point operator; applying a Harris affine region detector; applying a Hessian affine region detector detector; apply scale invariant feature transform; apply scale space extremum detector; apply local feature detector; apply accelerated robust feature algorithm; apply gradient position and orientation histogram algorithm; apply directional gradient histogram descriptor; apply Delitzsch edge detector; apply differential edge detector; apply spatiotemporal interest point detector; apply Moravec corner detector; apply Canny edge detector; apply Gaussian Laplacian filter; apply Gaussian difference filter; apply Sobel operator; apply Laplacian operator; apply Scharr operator; apply Prewitt operator; apply Roberts operator; apply Kirsch operator; apply high pass filter; apply low pass filter; apply Fourier transform; apply Radon transform; apply Hough transform; apply wavelet transform; thresholding; create binary image. Specifically, the evaluation of the compressed reflection image may include selecting at least one region of interest in the reflection image. The region of interest may be manually determined by a user or may be automatically determined, such as by identifying an object within an image generated by a sensor element. For example, in the case of a spot-like reflection feature, the region of interest may be selected as an area around the spot profile.

[0093] The evaluation device may be configured to perform at least one image correction. The image correction may include at least one background subtraction. The evaluation device may be adapted to remove the influence of background light from the respective beam profile, for example by imaging without further illumination.

[0094] The evaluation device is configured to determine the ordinate of the reflection feature by analyzing the beam profile of the reflection feature (e.g., each of the reflection features) of the compressed reflection image. As used herein, the term "analysis of the beam profile" may generally refer to the evaluation of the beam profile and may include at least one mathematical operation and / or at least one comparison and / or at least one symmetrization and / or at least one filtering and / or at least one normalization. For example, the analysis of the beam profile may include at least one of a histogram analysis step, calculation of a difference measure, application of a neural network, application of a machine learning algorithm. The evaluation device may be configured to symmetrize and / or normalize and / or filter the beam profile, in particular to remove noise or asymmetry from recording at larger angles, recording edges, etc. The evaluation device may filter the beam profile by removing high spatial frequencies (such as by spatial frequency analysis and / or median filtering, etc.). The summing may be performed by averaging all intensities at the same distance from the center by the intensity center of the spot. The evaluation device may be configured to normalize the beam profile to the maximum intensity, in particular to take into account the intensity differences due to the recorded distances. The evaluation device can be configured to remove the influence of background light from the beam profile, for example by imaging without illumination.

[0095] The reflective feature may cover at least one pixel of the image or may extend thereon. For example, the reflective feature may cover a plurality of pixels or may extend thereon. The evaluation device may be configured to determine and / or select all pixels connected to and / or belonging to the reflective feature (e.g., light spot). The evaluation device may be configured to determine the intensity center by the following formula:

[0096]

[0097] Among them, R coi is the position of the intensity center, r pixel is the pixel position, and l = ∑ j I total , where j is the number of pixels connected to and / or belonging to the reflectance feature, and I total is the total intensity.

[0098] The evaluation device can be configured to determine the ordinate of the reflection feature by using a depth-by-photon ratio technique (also denoted beam profile analysis). For the depth-by-photon ratio (DPR) technique, reference is made to the following documents: WO 2018 / 091649A1; WO 2018 / 091638A1; WO 2018 / 091640A1; and C. Lennartz, F. Schick, S. Metz, “Whitepaper-Beam Profile Analysis for 3D imaging and material detection”, April 28, 2021, Ludwigshafen, Germany, the entire contents of which are incorporated herein by reference.

[0099] The evaluation device can be configured to determine a beam profile of a reflective feature. As used herein, the term "determining a beam profile" refers to identifying and / or selecting at least one reflective feature within a compressed reflective image and evaluating at least one intensity distribution of the reflective feature. As an example, a certain area of ​​the compressed reflective image can be used and evaluated to determine an intensity distribution, such as a three-dimensional intensity distribution or a two-dimensional intensity distribution, such as along an axis or line passing through the compressed reflective image. As an example, the illumination center of the light beam can be determined, such as by determining at least one pixel with the highest illumination, and the cross-sectional axis can be selected by the illumination center. The intensity distribution can be an intensity distribution that varies with the coordinates along the cross-sectional axis passing through the illumination center. Other evaluation algorithms are also feasible.

[0100] The analysis of the beam profile may include determining at least one first region and at least one second region of the beam profile. The first region of the beam profile may be region A1 and the second region of the beam profile may be region A2. The evaluation device may be configured to integrate the first region and the second region. The evaluation device may be configured to derive the combined signal Q (also denoted as quotient Q) by one or more of the following: dividing the integrated first region by the integrated second region, dividing the integrated first region by a multiple of the integrated second region, dividing the integrated first region by a linear combination of the integrated second region.

[0101] The evaluation device may be configured to determine at least two regions of the beam profile and / or to segment the beam profile into at least two sections including different regions of the beam profile, wherein, as long as the regions are not congruent, an overlap of the regions may be possible. For example, the evaluation device may be configured to determine a plurality of regions, such as two, three, four, five or up to ten regions. The evaluation device may be configured to segment the light spot into at least two regions of the beam profile and / or to segment the beam profile into at least two sections including different regions of the beam profile. The evaluation device may be configured to determine the integral of the beam profile over the corresponding region for at least two of the regions. The evaluation device may be configured to compare at least two of the determined integrals. Specifically, the evaluation device may be configured to determine at least one first region and at least one second region of the beam profile. As used herein, the term "region of a beam profile" generally refers to any region of the beam profile at the location of the optical sensor used to determine the combined signal. The first region of the beam profile and the second region of the beam profile may be one or both of adjacent or overlapping regions. The first area of ​​the beam profile and the second area of ​​the beam profile may not be congruent in area. For example, the evaluation device may be configured to divide the sensor area of ​​the first sensor element into at least two sub-areas, wherein the evaluation device may be configured to divide the sensor area of ​​the first sensor element into at least one left portion and at least one right portion and / or at least one upper portion and at least one lower portion and / or at least one inner portion and at least one outer portion. The evaluation device may be adapted to integrate the first area and the second area.

[0102] The first region of the beam profile may include substantially edge information of the beam profile, and the second region of the beam profile includes substantially center information of the beam profile, and / or the first region of the beam profile may include information substantially about a left portion of the beam profile, and the second region of the beam profile includes information substantially about a right portion of the beam profile. The beam profile may have a center (i.e., a maximum of the beam profile and / or a center point of a plateau of the beam profile and / or a geometric center of the spot), and a descending edge extending from the center. The second region may include an inner region of the cross section and the first region may include an outer region of the cross section. As used herein, the term "substantially center information" generally refers to a low proportion of edge information (i.e., a proportion of the intensity distribution corresponding to the edge) compared to a proportion of center information (i.e., a proportion of the intensity distribution corresponding to the center). Preferably, the center information has a proportion of edge information of less than 10%, more preferably less than 5%, and most preferably the center information does not include edge content. As used herein, the term "substantially edge information" generally refers to a low proportion of center information compared to a proportion of edge information. The edge information may include information of the entire beam profile, in particular information from the center and edge regions. The edge information may have a proportion of less than 10%, preferably less than 5% of the center information, more preferably the edge information does not include center content. If at least one area of ​​the beam profile is close to or around the center and includes substantially center information, this area may be determined and / or selected as a second area of ​​the beam profile. If at least one area of ​​the beam profile includes at least parts of a descending edge of the cross section, this area may be determined and / or selected as a first area of ​​the beam profile. For example, the entire area of ​​the cross section may be determined as the first area.

[0103] Other choices of the first area A1 and the second area A2 may also be feasible. For example, the first area may include a substantially outer area of ​​the beam profile, and the second area may include a substantially inner area of ​​the beam profile. For example, in the case of a two-dimensional beam profile, the beam profile may be divided into a left portion and a right portion, wherein the first area may include an area substantially of the left portion of the beam profile, and the second area may include an area substantially of the right portion of the beam profile.

[0104] The edge information may comprise information about the number of photons in a first region of the beam profile, and the center information may comprise information about the number of photons in a second region of the beam profile. The evaluation device may be configured to determine an area integral of the beam profile. The evaluation device may be configured to determine the edge information by integrating and / or summing the first region. The evaluation device may be configured to determine the center information by integrating and / or summing the second region. For example, the beam profile may be a trapezoidal beam profile, and the evaluation device may be configured to determine the integral of the trapezoid. Further, when a trapezoidal beam profile may be assumed, the determination of the edge signal and the center signal may be replaced by an equivalent evaluation using characteristics of the trapezoidal beam profile, such as determining the slope and position of the edge and the height of the center plateau and deriving the edge signal and the center signal by geometric considerations.

[0105] In one embodiment, A1 may correspond to the entire or complete area of ​​the feature point. A2 may be the central area of ​​the feature point. The central area may be a constant value. The central area may be smaller than the entire area of ​​the feature point. For example, in the case of a circular feature point, the radius of the central area may be 0.1 to 0.9 of the full radius of the feature point, preferably 0.4 to 0.6 of the full radius.

[0106] In one embodiment, the illumination pattern may include at least a dot pattern. A1 may correspond to an area of ​​the dot pattern at a full radius of a dot on the optical sensor. A2 may be a central area of ​​a dot on the optical sensor in the dot pattern. The central area may be a constant value. The central area may have a radius compared to the full radius. For example, the radius of the central area may be 0.1 to 0.9 of the full radius, preferably 0.4 to 0.6 of the full radius.

[0107] The evaluation device may be configured to obtain the quotient Q by one or more of the following: dividing the first area by the second area, dividing a multiple of the first area by the second area, and dividing a linear combination of the first area and the second area. The evaluation device may be configured to obtain the quotient Q by the following formula:

[0108]

[0109] Wherein, x and y are horizontal coordinates, A1 and A2 are the first area and the second area of ​​the beam profile, respectively, and E(x, y) represents the beam profile.

[0110] Additionally or alternatively, the evaluation device may be adapted to determine one or both of the center information or the edge information from at least one slice or cut of the light spot. This may be achieved, for example, by replacing the area integral in the quotient Q with a line integral along the slice or cut. To improve accuracy, several slices or cuts of the light spot may be used and averaged. In the case of an elliptical light spot profile, averaging several slices or cuts may result in improved distance information.

[0111] For example, the evaluation device may be configured to evaluate the beam profile by:

[0112] - determining the pixel with the highest sensor signal and forming at least one center signal;

[0113] - evaluating the sensor signals of the matrix and forming at least one sum signal;

[0114] - determining the quotient Q by combining the center signal with the sum signal; and

[0115] By evaluating the quotient Q, at least one longitudinal coordinate z of the object is determined.

[0116] The sensor signal may be a signal generated by an optical sensor and / or at least one pixel of the optical sensor in response to illumination. Specifically, the sensor signal may be or may include at least one electrical signal, such as at least one analog electrical signal and / or at least one digital electrical signal. More specifically, the sensor signal may be or may include at least one voltage signal and / or at least one current signal. More specifically, the sensor signal may include at least one photocurrent. Further, the raw sensor signal may be used, or the detector, optical sensor or any other element may be adapted to process or preprocess the sensor signal (such as by filtering, etc.) to generate secondary sensor signals, which may also be used as sensor signals. The term "center signal" generally refers to at least one sensor signal that includes substantially central information of a beam profile. As used herein, the term "highest sensor signal" refers to one or both of a local maximum or a maximum in a region of interest. For example, the center signal may be a signal of a pixel having a highest sensor signal among a plurality of sensor signals generated by pixels in a region of interest in the entire matrix or in a matrix, wherein the region of interest may be predetermined or may be determined within an image generated by pixels of the matrix. The center signal may originate from a single pixel or from a group of optical sensors, wherein, in the latter case, as an example, the sensor signals of the group of pixels may be added, integrated or averaged in order to determine the center signal. The group of pixels generating the center signal may be a group of adjacent pixels, such as pixels that are less than a predetermined distance from the actual pixel with the highest sensor signal, or a group of pixels whose generated sensor signals are within a predetermined range of the highest sensor signal. The group of pixels generating the center signal may be selected in as large a manner as possible in order to allow for a maximum dynamic range. The evaluation device may be adapted to determine the center signal by integrating a plurality of sensor signals, such as a plurality of pixels around the pixel with the highest sensor signal. For example, the beam profile may be a trapezoidal beam profile, and the evaluation device may be adapted to determine the integral of the trapezoid, in particular the integral of the plateau of the trapezoid.

[0117] As mentioned above, the center signal can generally be a single sensor signal, such as a sensor signal from a pixel at the center of the light spot, or a combination of multiple sensor signals, such as a combination of sensor signals generated by pixels at the center of the light spot, or a secondary sensor signal derived by processing sensor signals derived from one or more of the above possibilities. Since conventional electronic devices can implement the comparison of sensor signals quite simply, the determination of the center signal can be performed electronically, or it can be performed completely or partially by software. Specifically, the center signal can be selected from the group consisting of: the highest sensor signal; the average value of a group of sensor signals within a predetermined tolerance range with the highest sensor signal; the average value of sensor signals from a group of pixels (which includes a pixel with the highest sensor signal and a predetermined group of adjacent pixels); the sum of sensor signals from a group of pixels (which includes a pixel with the highest sensor signal and a predetermined group of adjacent pixels); the sum of a group of sensor signals within a predetermined tolerance range with the highest sensor signal; the average value of a group of sensor signals above a predetermined threshold; the sum of a group of sensor signals above a predetermined threshold; the integration of sensor signals from a group of optical sensors (which includes an optical sensor with the highest sensor signal and a predetermined group of adjacent pixels); the integration of a group of sensor signals within a predetermined tolerance range with the highest sensor signal; the integration of a group of sensor signals above a predetermined threshold.

[0118] Similarly, the term "sum signal" generally refers to a signal comprising essentially edge information of the beam profile. For example, the sum signal may be derived by adding the sensor signals, integrating the sensor signals or averaging the sensor signals in the entire matrix or in a region of interest within the matrix, wherein the region of interest may be predetermined or may be determined within an image generated by the optical sensors of the matrix. When the sensor signals are added, integrated or averaged, the actual optical sensors generating the sensor signals may be excluded from the addition, integration or averaging, alternatively they may also be included in the addition, integration or averaging. The evaluation device may be adapted to determine the sum signal by integrating the signals in the entire matrix or in the region of interest within the matrix. For example, the beam profile may be a trapezoidal beam profile and the evaluation device may be adapted to determine the integral of the entire trapezoid. Further, when a trapezoidal beam profile may be assumed, the determination of the edge signal and the center signal may be replaced by an equivalent evaluation using properties of the trapezoidal beam profile, such as determining the slope and position of the edge and the height of the center plateau and deriving the edge signal and the center signal by geometric considerations.

[0119] Similarly, the center signal and the edge signal may also be determined by using segments of the beam profile, such as circular segments of the beam profile. For example, the beam profile may be divided into two segments by a secant or chord that does not pass through the center of the beam profile. Thus, one segment will contain substantially edge information, while the other segment will contain substantially center information. For example, in order to further reduce the amount of edge information in the center signal, the edge signal may be further subtracted from the center signal.

[0120] The combined signal Q, also denoted as quotient Q, may be a signal generated by combining the center signal and the sum signal. Specifically, the determination may include one or more of the following: forming a quotient of the center signal and the sum signal, or vice versa; forming a quotient of a multiple of the center signal and a multiple of the sum signal, or vice versa; forming a quotient of a linear combination of the center signal and a linear combination of the sum signal, or vice versa. Additionally or alternatively, the quotient Q may include any signal or combination of signals containing at least one item of information about the comparison between the center signal and the sum signal.

[0121] As used herein, the term "ordinate of the reflection feature" is a broad term and will be given its ordinary and conventional meaning to a person of ordinary skill in the art and is not limited to a special or custom meaning. The term may specifically refer to, but is not limited to, the distance between the camera and the object. The evaluation device may be configured to determine the ordinate using at least one predetermined relationship between the combined signal and the ordinate. The predetermined relationship may be one or more of an empirical relationship, a semi-empirical relationship, and an analytically derived relationship. The evaluation device may include at least one data storage device for storing the predetermined relationship, such as a lookup list or a lookup table.

[0122] The evaluation device may be configured to execute at least one photon ratio depth algorithm which calculates distances having zero-order and higher-order reflection features.

[0123] The evaluating step may further comprise determining at least one material property of the object by analyzing the beam profile of the reflection feature.

[0124] The term "material property" as used herein is a broad term and will be given its ordinary and conventional meaning to a person of ordinary skill in the art and is not limited to a special or custom meaning. The term may specifically refer to, but is not limited to, at least one arbitrary property of a material that is configured for characterization and / or identification and / or classification of the material. For example, the material property may be a property selected from the group consisting of: roughness, penetration depth of light into the material, a property that characterizes the material as a biological or non-biological material, reflectivity, specular reflectivity, diffuse reflectivity, surface properties, a measure of translucency, scattering behavior, specifically backscattering behavior, and the like. At least one material property may be a property selected from the group consisting of: scattering coefficient, translucency, transparency, deviation from Lambertian surface reflection, speckle, and the like.

[0125] The term "determining at least one material property" as used herein is a broad term and will be given its ordinary and conventional meaning to a person of ordinary skill in the art and is not limited to a special or custom meaning. The term may specifically refer to, but is not limited to, one or more of the following: identifying, characterizing, and specifying material properties of an object. The detector may include at least one database including a list and / or table of predefined and / or predetermined material properties, such as a lookup list or a lookup table. The list and / or table of material properties may be determined and / or generated by performing at least one test measurement using the detector, such as by performing a material test using a sample with known material properties. The list and / or table of material properties may be determined and / or generated at the manufacturer's location and / or by a user of the detector. The material properties may be additionally assigned to a material classifier, such as one or more of the following: a material name, a material group, such as a biological or non-biological material, a translucent or non-translucent material, a metal or a non-metal, skin or non-skin, fur or non-fur, carpet or non-carpet, reflective or non-reflective, specular or non-specular, foam or non-foam, hair or non-hair, a roughness group, etc. The detector may comprise at least one database comprising a list and / or table comprising material properties and associated material names and / or material groups.

[0126] The object may include at least one surface onto which the illumination pattern is projected. The surface may be adapted to at least partially reflect the illumination pattern back to the detector. For example, without wishing to be bound by theory, human skin may have a reflection profile (also denoted as a backscattering profile) comprising a portion generated by back reflection of the surface (denoted as surface reflection) and a portion generated by very diffuse reflection of light penetrating the skin (denoted as diffuse reflection portion of back reflection). For the reflection profile of human skin, reference may be made to "Lasertechnik in der Medizin: Grundlagen, Systeme, Anwendungen [Laser Technology in Medicine: Foundations, Systems, Applications]", "Wirkung von Laserstrahlung auf Gewebe [Effects of Laser Radiation on Tissues]", 1991, pp. 171-266, Jürgen Eichler, Theo Seiler, Springer Verlag, ISBN 0939-0979. The surface reflection of the skin increases as the wavelength increases toward the near infrared. Further, the penetration depth increases as the wavelength increases from visible light to the near infrared. The diffuse part of the back reflection increases with the penetration depth of the light. These material properties can be used to distinguish skin from other materials, in particular by analyzing the backscattering profile.

[0127] The determination of material properties can be performed using beam profile analysis. Specifically, beam profile analysis uses the reflection characteristics of coherent light projected onto the surface of an object to classify materials. The determination of material properties can be performed as described in one of WO 2020 / 187719, WO 2021 / 170791A1 and / or WO 2021 / 152070, the full contents of which are included herein by reference. Specifically, the analysis of the beam profile of the reflection characteristics can be performed by a feature-based method. Additionally or alternatively, a machine learning method can be used. The feature-based method can be used in combination with a machine learning method that can allow the classification model to be parameterized. Alternatively or in combination, a convolutional neural network can be used to classify materials by using a reflection image as input.

[0128] For example, the evaluation device may be configured to characterize the reflection feature as being generated by a material (e.g., human skin) when the reflected beam profile of the material satisfies at least one predetermined or predefined criterion. As used herein, the term "at least one predetermined or predefined criterion" refers to at least one characteristic and / or value suitable for distinguishing biological tissue, in particular human skin, from other materials. The predetermined or predefined criterion may be or may include at least one predetermined or predefined value and / or threshold and / or a threshold range involving material properties. In the case where the reflected beam profile meets at least one predetermined or predefined criterion, the reflection feature may be indicated as being generated by a material (e.g., human skin). Otherwise, the evaluation device may be configured to characterize the reflection feature as non-skin. For example, the object may be a biological tissue, such as skin. As used herein, the term "biological tissue" generally refers to a biological material including living cells. Specifically, the evaluation device may be configured for skin detection. The evaluation device may be configured to characterize the object as being generated by a biological tissue, in particular human skin. The term "characterizing" whether it is generated by biological tissue, in particular human skin, may refer to determining and / or verifying whether the surface to be inspected or tested is or comprises biological tissue, in particular human skin, and / or distinguishing biological tissue, in particular human skin from other tissues, in particular other surfaces. The evaluation device may be configured to distinguish human skin from one or more of inorganic tissue, metal surface, plastic surface, foam, paper, wood, display, screen, cloth. The evaluation device may be configured to distinguish human biological tissue from the surface of an artificial object or an inanimate object.

[0129] The reflection properties of the skin can be characterized as the simultaneous occurrence of direct reflection at the surface (Lambertian-like) and subsurface scattering (volumetric scattering). This may result in a wider laser spot on the skin compared to the materials mentioned above. For example, without wishing to be bound by theory, an object (e.g., human skin) may have a reflection profile, also denoted as a backscattering profile. The reflection profile may include a portion generated by back reflection of the surface (denoted as surface reflection) and a portion generated by very diffuse reflection of light penetrating the skin (denoted as diffuse reflection portion of back reflection). For the reflection profile of human skin, reference may be made to "Lasertechnikin der Medizin: Grundlagen, Systeme, Anwendungen [Laser technology in medicine: foundations, systems, applications]", "Wirkung von Laserstrahlung auf Gewebe [Effects of laser radiation on tissues]", 1991, pp. 171 to 266, Jürgen Eichler, Theo Seiler, Springer Verlag, ISBN 0939-0979. The surface reflectance of skin increases as the wavelength increases toward the near infrared. Furthermore, the penetration depth increases as the wavelength increases from visible light to the near infrared. The diffuse portion of the back reflection increases with the penetration depth of the light. These characteristics can be used to distinguish skin from other materials by analyzing the backscattering profile.

[0130] In particular, the evaluation device may be configured to compare the reflected beam profile with at least one predetermined and / or pre-recorded and / or predefined beam profile. The predetermined and / or pre-recorded and / or pre-defined beam profile may be stored in a table or a look-up table and may be determined, for example, empirically and, as an example, may be stored in at least one data storage device of the imaging device. For example, the predetermined and / or pre-recorded and / or pre-defined beam profile may be determined during an initial startup of the device performing the method according to the invention. For example, the predetermined and / or pre-recorded and / or pre-defined beam profile may be stored in at least one data storage device of the evaluation device, for example by software, in particular by an application downloaded from an application store or the like. In case the reflected beam profile is identical to the predetermined and / or pre-recorded and / or pre-defined beam profile, the reflection feature may be identified as being generated by a material, for example, a biological tissue. The comparison may comprise overlapping the reflected beam profile and the predetermined or pre-defined beam profile such that their intensity centers match. The comparison may comprise determining the deviation between the reflected beam profile and the predetermined and / or pre-recorded and / or pre-defined beam profile, for example the sum of the squares of the point-to-point distances. The evaluation device may be adapted to compare the determined deviation with at least one threshold value, wherein, in case the determined deviation is below and / or equal to the threshold value, the surface is indicated as biological tissue and / or the detection of biological tissue is confirmed. The threshold value may be stored in a table or a look-up table and may be determined, for example, empirically and, as an example, may be stored in at least one data storage device of the evaluation device.

[0131] Additionally or alternatively, material properties can be determined by applying at least one image filter to an image of the reflectance feature. As further used herein, the term "image" refers to a two-dimensional function f(x,y) where brightness and / or color values ​​are given for any x,y position in the image. The position can be discretized corresponding to the recorded pixels. The brightness and / or color can be discretized corresponding to the bit depth of the optical sensor. As used herein, the term "image filter" refers to at least one mathematical operation applied to a beam profile and / or at least one specific region of a beam profile. Specifically, the image filter Φ maps the image f or a region of interest in the image to a real number On, among them, Represents features, especially material features. Images may be affected by noise, and so may features. Therefore, features may be random variables. Features may be normally distributed. If features are not normally distributed, they may be transformed to be normally distributed, such as by a Box-Cox transformation.

[0132] The evaluation device can be configured to determine at least one material characteristic by applying at least one material-dependent image filter Φ2 to the image. As used herein, the term "material-dependent" image filter refers to an image having a material-dependent output. The output of a material-dependent image filter is denoted herein as "material feature or "Material Related Characteristics The material feature may be or may include at least one information about at least one material property of the surface of the scene that has generated the reflection feature.

[0133] The material-related image filter can be at least one filter selected from the group consisting of: brightness filter; spot shape filter; square norm gradient; standard deviation; smoothing filter, such as Gaussian filter or median filter; contrast filter based on grayscale; energy filter based on grayscale; homogeneity filter based on grayscale; dissimilarity filter based on grayscale; Laws energy filter; threshold area filter; or a linear combination thereof; or another material-related image filter Φ 2other ,according to ≥0.40, the material-related image filter is related to one or more of the following: brightness filter, spot shape filter, square norm gradient, standard deviation, smoothing filter, energy filter based on grayscale, homogeneity filter based on grayscale, dissimilarity filter based on grayscale, Laws energy filter, or threshold area filter or a linear combination thereof, where Ф m is one of the following: brightness filter, spot shape filter, square norm gradient, standard deviation, smoothing filter, energy filter based on gray level, homogeneity filter based on gray level, dissimilarity filter based on gray level, Laws energy filter, or threshold area filter or a linear combination thereof. Another material-related image filter Φ 2other Can be based on Preferably according to Image filter associated with one or more materials Ф m Related.

[0134] The material-dependent image filter may be at least one arbitrary filter Φ that passes hypothesis testing. As used herein, the term "passes hypothesis testing" refers to the fact that the null hypothesis H0 is rejected and the alternative hypothesis H1 is accepted. Hypothesis testing may include testing the material dependence of an image filter by applying the image filter to a predefined data set. The data set may include a plurality of beam profile images. As used herein, the term "beam profile image" refers to N B The sum of Gaussian radial basis functions,

[0135]

[0136] Among them, N B Each of the Gaussian radial basis functions is centered at (x lk ,y lk ), pre-factor a lk and an exponential factor α = 1 / ∈ is defined. The exponential factor is the same for all Gaussian functions in all images. The center position x lk ,y lk For all images f k : are the same. Each beam profile image in the dataset can correspond to a material classifier and distance. The material classifier can be a label such as 'Material A', 'Material B', etc. The above f can be used in conjunction with the following parameter table k (x, y) formula to generate beam profile images:

[0137]

[0138] The values ​​of x and y correspond to The pixel size of the image can be 32×32. The dataset of beam profile images can be obtained by combining the parameter set using the above f k Formula to obtain f k The value of each pixel in the 32×32 image can be generated by k (x, y) is obtained by inserting the integer values ​​of 0, ..., 31 into x and y. For example, for the pixel (6, 9), the value f can be calculated k (6, 9).

[0139] Then, for each image f k , the eigenvalue corresponding to the filter Φ can be calculated Among them, z k is the image f corresponding to a predefined dataset k This produces a distance value with the corresponding generated eigenvalue The hypothesis test can use the null hypothesis that the filter does not distinguish between material classifiers. The null hypothesis can be expressed by H0: μ1 = μ2 = ... = μ J Given, where μ m is the eigenvalue corresponding to The expected value of each material group is m. The index m denotes the material group. The hypothesis test can use the alternative hypothesis that the filter distinguishes between at least two material classifiers. The alternative hypothesis can be expressed by H1: μ m ≠μ m′given. As used herein, the term "indistinguishing material classifier" means that the expected values ​​of the material classifiers are the same. As used herein, the term "distinguishing material classifiers" means that at least two expected values ​​of the material classifiers are different. As used herein, "distinguishing at least two material classifiers" is synonymous with "suitable material classifier". The hypothesis test may include at least one analysis of variance (ANOVA) on the generated eigenvalues. In particular, the hypothesis test may include determining the mean of the eigenvalues ​​for each of the J materials, i.e., among the total J means, for m∈[0, 1, ..., J-1], Among them, N m The number of eigenvalues ​​for each of the J materials in the predefined data set is given. The hypothesis test can include determining the The hypothesis test can include determining the mean of the sum of squares in the following formula:

[0140]

[0141] Hypothesis testing can include determining the mean sum of squares between:

[0142]

[0143] Hypothesis testing can include performing an F-test:

[0144] ○ Among them, d1==NJ, d2=J-1,

[0145] ○F(x)=1–CDF(x)

[0146] ○p=F(mssb / mssw)

[0147] In this article, I x is the regularized incomplete beta function Among them, the Euler beta function and is an incomplete beta function. If the p-value p is less than or equal to a predefined significance level, the image filter can pass the hypothesis test. If p≤0.075, preferably p≤0.05, more preferably p≤0.025, and most preferably p≤0.01, the filter can pass the hypothesis test. For example, in the case where the predefined significance level is α=0.075, if the p-value is less than α=0.075, the image filter can pass the hypothesis test. In this case, the null hypothesis H0 can be rejected and the alternative hypothesis H1 can be accepted. The image filter thus distinguishes at least two material classifiers. Therefore, the image filter passes the hypothesis test.

[0148] In the following, it is assumed that the reflection image includes at least one reflection feature (particularly a light spot image) to describe the image filter. The light spot image f can be represented by the function Given, where the background of image f may have been subtracted. However, other reflectance features may also be possible.

[0149] For example, the material-dependent image filter may be a brightness filter. The brightness filter may return a measure of the brightness of a light spot as a material characteristic. The material characteristic may be determined by the following formula:

[0150]

[0151] Where f is the spot image. The distance of the spot is represented by z, where z can be obtained, for example, by using a depth from defocus or photon ratio depth technique and / or by using a triangulation technique. The surface normal of the material is obtained by is given and can be obtained as the normal to the surface spanned by at least three measurement points. The vector is the direction vector of the light source. Since the position of the light spot is known by using the defocus depth or photon ratio depth technique and / or by using the triangulation technique (where the position of the light source is known as a parameter of the imaging device), d ray is the difference vector between the light spot and the light source position.

[0152] For example, a material-dependent image filter may be a filter whose output depends on the shape of the light spot. The material-dependent image filter may return a value related to the translucency of the material as a material feature. The translucency of the material affects the shape of the light spot. The material feature may be given by:

[0153]

[0154] Where 0<α, β<1 is the weight of the spot height h, and H represents the Heaviside function, that is, H(x)=1:x≥0, H(x)=0:x<0. The spot height h can be determined by the following formula:

[0155]

[0156] Among them, B r is the inner circle of the light spot with radius r.

[0157] For example, the material-dependent image filter may be a squared norm gradient. The material-dependent image filter may return a value related to a measure of the soft and hard transition and / or roughness of the light spot as a material feature. The material feature may be defined by the following formula:

[0158]

[0159] For example, the material-dependent image filter can be the standard deviation. The standard deviation of the spot can be determined by the following formula:

[0160]

[0161] where μ is the mean given by μ = ∫(f(x))dx.

[0162] For example, the material-dependent image filter may be a smoothing filter, such as a Gaussian filter or a median filter. In one embodiment of a smoothing filter, the image filter may refer to the observation that volume scattering exhibits less spot contrast than diffuse reflective materials. The image filter may quantify the smoothness of the spot corresponding to the spot contrast as a material characteristic. The material characteristic may be determined by the following formula:

[0163]

[0164] in, is a smoothing function, such as a median filter or a Gaussian filter. The image filter may include dividing by the distance z, as described in the above formula. The distance z may be determined, for example, using a defocus depth or photon ratio depth technique and / or by using triangulation techniques. This may allow the filter to be insensitive to distance. In one embodiment of the smoothing filter, the smoothing filter may be based on the standard deviation of the extracted speckle noise pattern. The speckle noise pattern N may be described empirically by the following formula:

[0165] f(x)=(f o (x)·(N(X)+1),

[0166] Among them, f o is the despeckled image of the light spot. N(X) is a noise term that models the speckle pattern. The computation of the despeckled image can be difficult. Therefore, the despeckled image can be approximated by a smoothed version of f, i.e. in, is a smoothing operator, such as a Gaussian filter or a median filter. Therefore, an approximation of the speckle pattern can be given by:

[0167]

[0168] The material characteristics of the filter can be determined by the following formula:

[0169]

[0170] Among them, Var represents the variance function.

[0171] For example, the image filter can be a contrast filter based on grayscale appearance. The material filter can be based on the grayscale appearance matrix Mf,ρ (g1g2)=[p g1,g2 ], and p g1,g2 is the occurrence rate of the grayscale combination (g1,g2) = [f(x1,y1),f(x2,y2)], and the relationship ρ defines the distance between (x1,y1) and (x2,y2), that is, ρ(x,y) = (x+a,y+b), where a and b are selected from 0 and 1.

[0172] The material characteristics of the contrast filter based on the gray level appearance can be given by the following equation:

[0173]

[0174] For example, the image filter may be an energy filter based on gray level occurrence. The material filter is based on the gray level occurrence matrix defined above.

[0175] The material characteristics of the energy filter based on the gray level appearance can be given by the following equation:

[0176]

[0177] For example, the image filter may be a homogeneity filter based on gray level occurrence. The material filter is based on the gray level occurrence matrix defined above.

[0178] The material characteristics of the homogeneity filter based on the gray level appearance can be given by the following formula:

[0179]

[0180] For example, the image filter may be a dissimilarity filter based on gray level occurrence. The material filter is based on the gray level occurrence matrix defined above.

[0181] The material characteristics of the dissimilarity filter based on the gray level can be given by the following formula:

[0182]

[0183] For example, the image filter may be a Laws energy filter. The material filter may be based on the laws vectors L5 = [1, 4, 6, 4, 1] and E5 = [-1, -2, 0, -2, -1] and the matrix L5 (E5) T and E5(L5) T .

[0184] Image f k Convolution with these matrices:

[0185]

[0186] as well as

[0187]

[0188] The material characteristics of the Laws energy filter can be determined by the following formula:

[0189]

[0190] For example, the material-dependent image filter may be a threshold area filter. The material feature may involve two regions in the image plane. The first region Ω1 may be a region where the function f is greater than α times the maximum value of f. The second region Ω2 may be a region where the function f is less than α times the maximum value of f but greater than a threshold ε times the maximum value of f. Preferably, α may be 0.5 and ε may be 0.05. Due to speckles or noise, these regions may not just correspond to the inner and outer circles around the center of the spot. As an example, Ω1 may include spots or unconnected areas in the outer circle. The material feature may be determined by the following formula:

[0191]

[0192] Where Ω1 = {x|f(x)>α·max(f(x))} and Ω2 = {x|ε·max(f(x)) <f(x)<α-max(f(x))}。

[0193] The evaluation device can be configured to use material characteristics The evaluation device may include at least one data storage device for storing the predetermined relationship, such as a lookup list or a lookup table.

[0194] Additionally or alternatively, the determination of the material properties of the reflectance features may be performed using artificial intelligence, in particular convolutional neural networks. Using the reflectance image as input to the convolutional neural network may enable the generation of a classification model to distinguish materials with sufficient accuracy, for example to distinguish between skin and other volume scattering materials. Since only physically valid information is passed to the network by selecting important areas in the reflectance image, only a compact training data set may be required. Additionally, a very compact network architecture may be generated.

[0195] Specifically, at least one parameterized classification model can be used. The parameterized classification model can be configured to classify materials by using a reflection image as input. The classification model can be parameterized by using one or more of machine learning, deep learning, neural networks or other forms of artificial intelligence. As used herein, the term "machine learning" is a broad term and will be given its ordinary and conventional meaning for ordinary technicians in the field and is not limited to special or custom meanings. The term specifically refers to but is not limited to the method of using artificial intelligence (AI) to automatically build a model, especially a parameterized model. The term "classification model" may refer to a model configured to distinguish a material (e.g., human skin) from other materials. The characteristic features of the corresponding material can be determined by applying an optimization algorithm for at least one optimization target on the classification model. Machine learning can be based on at least one neural network, especially a convolutional neural network. The weights and / or topological structure of the neural network can be predetermined and / or predefined. Specifically, the training of the classification model can be performed using machine learning. The classification model can include at least one machine learning architecture, and model parameters. For example, the machine learning architecture may be or may include one or more of the following: linear regression, logistic regression, random forest, naive Bayes classification, nearest neighbor, neural network, convolutional neural network, generative adversarial network, support vector machine or gradient boosting algorithm, etc. As used herein, the term "training", also meaning learning, is a broad term and will be given its ordinary and conventional meaning to ordinary technicians in the field and is not limited to special or custom meanings. The term may specifically refer to, but is not limited to, the process of building a classification model, in particular determining and / or updating the parameters of the classification model. The classification model may be at least partially data-driven. For example, the classification model may be based on experimental data, such as data determined by illuminating multiple people and man-made objects (such as masks) and recording reflection patterns. For example, training may include using at least one training data set, wherein the training data set includes images of, for example, multiple people and man-made objects with known material properties, in particular reflection images.

[0196] In another aspect, a detector for determining the position of at least one object is disclosed. The detector includes at least one projector for illuminating at least one object with at least one illumination pattern including at least one illumination feature. The projector includes at least one emitter configured to generate at least one light beam. The detector further includes at least one camera having at least one sensor element having a matrix of optical sensors, each of which has a photosensitive area. Each optical sensor is designed to generate at least one sensor signal in response to illumination of a corresponding photosensitive area of ​​the optical sensor by a reflected light beam propagating from the object to the camera. The camera is configured to image at least one reflection image, the at least one reflection image including at least one reflection feature generated by the object in response to illumination of the illumination feature. The reflection feature includes at least one beam profile. The detector further includes at least one evaluation device configured to perform the following steps:

[0197] - at least one image compression step, wherein the image compression step comprises compressing the reflectance image into a compressed reflectance image having a second bit depth lower than the first bit depth, wherein the compression comprises applying a non-linear grey value transformation to the sensor signals;

[0198] - at least one evaluation step, wherein the evaluation step comprises evaluating the compressed reflection image, wherein the evaluation comprises determining at least one longitudinal coordinate of the reflection feature by analyzing a corresponding beam profile of the reflection feature.

[0199] The detector may be configured to perform a method according to the invention (such as according to one or more embodiments disclosed above or according to one or more embodiments disclosed in further detail below). For details, options and definitions, reference may be made to the method discussed above.

[0200] In another aspect, a mobile device configured to determine the position of at least one object is disclosed. The mobile device includes at least one detector according to the present invention (such as according to one or more embodiments disclosed above or according to one or more embodiments disclosed in further detail below). Details, options and definitions can refer to the detectors and methods discussed above. The mobile device is one or more of a mobile communication device (such as a cellular phone or smart phone), a tablet computer, a portable computer.

[0201] This article further discloses and proposes a computer program, which includes computer executable instructions for executing the method according to the present invention in one or more embodiments contained in this article when the program is executed on a computer or computer network. Specifically, the computer program can be stored on a computer readable data carrier and / or a computer readable storage medium.

[0202] As used herein, the terms "computer-readable data carrier" and "computer-readable storage medium" may specifically refer to a non-transitory data storage device, such as a hardware storage medium on which computer-executable instructions are stored. A computer-readable data carrier or storage medium may specifically be or may include a storage medium such as a random access memory (RAM) and / or a read-only memory (ROM).

[0203] Thus, in particular, one, more than one or even all of the method steps a) to c) as indicated above may be performed by using a computer or a computer network, preferably by using a computer program.

[0204] This article further discloses and proposes a computer program product with program code means, so that when the program is executed on a computer or a computer network, the method according to the present invention in one or more embodiments contained in this article is performed. Specifically, the program code means can be stored on a computer-readable data carrier and / or a computer-readable storage medium.

[0205] This document further discloses and proposes a data carrier having a data structure stored thereon, which, after being loaded into a computer or a computer network (such as loaded into a working memory or a main memory of a computer or a computer network), can execute a method according to one or more embodiments disclosed herein.

[0206] This article further discloses and proposes a computer program product having program code means stored on a machine-readable carrier so that when the program is executed on a computer or computer network, a method according to one or more embodiments disclosed herein is performed. As used herein, a computer program product refers to a program that is a tradable product. The product can generally exist in any format, such as in paper format, or on a computer-readable data carrier and / or a computer-readable storage medium. In particular, the computer program product can be distributed via a data network.

[0207] Finally, a modulated data signal containing instructions readable by a computer system or a computer network for executing a method according to one or more embodiments disclosed herein is disclosed and proposed herein.

[0208] With reference to the computer-implemented aspects of the present invention, one or more or even all of the method steps of the methods according to one or more of the embodiments disclosed herein may be performed using a computer or a computer network. Thus, typically, any of the method steps including the provision and / or manipulation of data may be performed using a computer or a computer network. Typically, these method steps may include any method steps, except for method steps that typically require manual work, such as providing samples and / or performing certain aspects of the actual measurement.

[0209] Specifically, this article further discloses:

[0210] - a computer or a computer network comprising at least one processor, wherein the processor is adapted to execute the method according to one of the embodiments described in this specification,

[0211] - a computer-loadable data structure, which is suitable for performing a method according to one of the embodiments described in this specification when the data structure is executed on a computer,

[0212] - a computer program, wherein the computer program is adapted to perform a method according to one of the embodiments described in this specification when the program is executed on a computer,

[0213] - a computer program comprising program means for executing a method according to one of the embodiments described in the present description when the computer program is executed on a computer or on a computer network,

[0214] - a computer program comprising a program device according to the preceding embodiment, wherein the program device is stored on a computer-readable storage medium,

[0215] - a storage medium, on which a data structure is stored, and wherein the data structure is suitable for executing a method according to one of the embodiments described in the present description after being loaded into a main storage device and / or a working storage device of a computer or a computer network, and

[0216] A computer program product having program code means, wherein the program code means can be stored or stored on a storage medium for performing a method according to one of the embodiments described in the present description when the program code means is executed on a computer or a computer network.

[0217] In another aspect of the present invention, the use of a detector according to the present invention (for example according to one or more embodiments given above or in further detail below) for a purpose of use selected from the group consisting of: position measurement in traffic technology; entertainment applications; security applications; surveillance applications; safety applications; human-machine interface applications; logistics applications; tracking applications; outdoor applications; mobile applications; communication applications; photography applications; machine vision applications; robotics applications; quality control applications; manufacturing applications; gait monitoring applications; human body monitoring applications; home care; smart life, automotive applications.

[0218] For further uses of the detector, reference is made to WO 2018 / 091649A1, WO 2018 / 091638A1 and WO 2018 / 091640A1, the contents of which are incorporated herein by reference.

[0219] As used herein, the terms "having", "including" or "comprising" or any of their arbitrary grammatical variations are used in a non-exclusive manner. Therefore, these terms can refer to the situation where there are no further features in the entity described in this context in addition to the features introduced by these terms, and can also refer to the situation where one or more further features are present. As an example, the expressions "A has B", "A includes B" and "A contains B" can refer to the situation where there are no other elements in A besides B (that is, the situation where A only and solely consists of B), and can also refer to the situation where there are one or more further elements in entity A in addition to B (such as element C, elements C and D or even further elements).

[0220] Further, it should be noted that the terms "at least one", "one or more", or similar expressions indicating that a feature or element may occur once or more than once are typically used only once when introducing the corresponding feature or element. In most cases, when referring to the corresponding feature or element, the expression "at least one" or "one or more" is not repeated, although the corresponding feature or element may occur once or more than once.

[0221] Further, as used herein, the terms "preferably", "more preferably", "particularly", "more particularly", "specifically", "more specifically" or similar terms are used in conjunction with optional features without limiting the possibilities of alternatives. Therefore, the features introduced by these terms are optional features and are not intended to limit the scope of the claims in any way. As the skilled person will recognize, the present invention can be implemented by using alternative features. Similarly, the features introduced by "in an embodiment of the present invention" or similar expressions are intended to be optional features, without any limitation on alternative embodiments of the present invention, without any limitation on the scope of the present invention, and without any limitation on the possibility of combining the features introduced in this manner with other optional or non-optional features of the present invention.

[0222] Summarizing and without excluding further possible embodiments, the following embodiments may be envisaged:

[0223] Embodiment 1. A method for beam profiling using at least one camera, wherein the camera has at least one sensor element, the at least one sensor element having a matrix of optical sensors, the optical sensors each having a photosensitive area, wherein each optical sensor is designed to generate at least one sensor signal in response to the illumination of a corresponding photosensitive area of ​​the optical sensor by a reflected light beam propagating from the object to the camera, the method comprising the following steps:

[0224] a) at least one data acquisition step, wherein the data acquisition step comprises illuminating at least one object with at least one illumination pattern comprising at least one illumination feature by using at least one projector, wherein the projector comprises at least one emitter configured to generate at least one light beam, wherein the data acquisition step further comprises imaging at least one reflection image by using the camera, the at least one reflection image comprising at least one reflection feature generated by the object in response to illumination by the illumination feature, wherein the reflection feature comprises at least one beam profile, wherein the reflection image has a first bit depth;

[0225] b) at least one image compression step, wherein the image compression step comprises compressing the reflectance image into a compressed reflectance image having a second bit depth lower than the first bit depth by using at least one evaluation device, wherein the compression comprises applying a non-linear grey value transformation to the sensor signals;

[0226] c) at least one evaluation step, wherein the evaluation step comprises evaluating the compressed reflection image by using the evaluation device, wherein the evaluation comprises determining at least one longitudinal coordinate of the reflection feature by analyzing a corresponding beam profile of the reflection feature.

[0227] Embodiment 2. The method according to the previous embodiment, wherein the first bit depth is the number of bits per pixel of the reflected image, and the second bit depth is the number of bits per pixel of the compressed reflected image.

[0228] Embodiment 3. The method according to the preceding embodiment, wherein the first bit depth is at least one bit depth selected from the range consisting of 9 to 16 bits, and the second bit depth is 8 to 15 bits.

[0229] Embodiment 4. A method according to any one of the preceding embodiments, wherein the nonlinear grayscale value transformation h(g) is applied using at least one predetermined lookup table of the nonlinear grayscale value transformation h as a function of the grayscale value g, wherein g is the grayscale value of a pixel with a higher bit depth.

[0230] Embodiment 5. The method according to the previous embodiment, wherein the nonlinear grayscale value transformation comprises applying the nonlinear grayscale value transformation to the grayscale value g.

[0231]

[0232] Among them, σ g is the standard deviation of the sensor signal, K is the camera system gain, σ0 2 is the dark noise, g off is the predetermined offset of g, and h0 is the predetermined offset of h.

[0233] Embodiment 6. A method according to any one of the preceding embodiments, wherein the analysis of the beam profile includes determining at least one first region and at least one second region of the beam profile, wherein the analysis of the beam profile further includes deriving a combined signal Q by one or more of the following items: division of the first region and the second region, division of multiples of the first region and the second region, division of a linear combination of the first region and the second region, wherein the analysis of the beam profile further includes determining the ordinate using at least one predetermined relationship between the combined signal Q and the ordinate.

[0234] Embodiment 7. The method according to any one of the preceding embodiments, wherein the camera comprises at least one CCD sensor or at least one CMOS sensor.

[0235] Embodiment 8. A method according to any of the preceding embodiments, wherein the projector comprises at least one array of emitters, wherein each of these emitters is configured to generate at least one light beam.

[0236] Embodiment 9. A method according to the previous embodiment, wherein each of these emitters is and / or includes at least one element selected from the group consisting of at least one laser source and at least one non-laser light source, the at least one laser source is, for example, at least one semiconductor laser, at least one double heterostructure laser, at least one external cavity laser, at least one separated confined heterostructure laser, at least one quantum cascade laser, at least one distributed Bragg reflector laser, at least one polariton laser, at least one hybrid silicon laser, at least one extended cavity diode laser, at least one quantum dot laser, at least one volume Bragg grating laser, at least one indium arsenide laser, at least one gallium arsenide laser, at least one transistor laser, at least one diode pump laser, at least one distributed feedback laser, at least one quantum well laser, at least one interband cascade laser, at least one semiconductor ring laser, at least one vertical cavity surface emitting laser; the at least one non-laser light source is, for example, at least one LED or at least one light bulb.

[0237] Embodiment 10. A method according to any of the preceding embodiments, wherein the light beam generated by the emitter has a wavelength in the near infrared (NIR) range, wherein the light beam is generated by the emitter in a wavelength range from 800nm ​​to 1000nm, preferably in a wavelength range of about 940nm.

[0238] Embodiment 11. A method according to any one of the preceding method embodiments, wherein the method is computer-implemented.

[0239] Embodiment 12. A detector for determining a position of at least one object,

[0240] wherein the detector comprises at least one projector for illuminating at least one object with at least one illumination pattern comprising at least one illumination feature, wherein the projector comprises at least one emitter configured to generate at least one light beam;

[0241] wherein the detector further comprises at least one camera, the at least one camera having at least one sensor element, the at least one sensor element having a matrix of optical sensors, the optical sensors each having a photosensitive area, wherein each optical sensor is designed to generate at least one sensor signal in response to illumination of a corresponding photosensitive area of ​​the optical sensor by a reflected light beam propagating from the object to the camera, wherein the camera is configured to image at least one reflection image, the at least one reflection image comprising at least one reflection feature generated by the object in response to illumination by the illumination feature, wherein the reflection feature comprises at least one beam profile;

[0242] The detector further comprises at least one evaluation device, which is configured to perform the following steps:

[0243] - at least one image compression step, wherein the image compression step comprises compressing the reflectance image into a compressed reflectance image having a second bit depth lower than the first bit depth, wherein the compression comprises applying a non-linear grey value transformation to the sensor signals;

[0244] - at least one evaluation step, wherein the evaluation step comprises evaluating the compressed reflection image, wherein the evaluation comprises determining at least one longitudinal coordinate of the reflection feature by analyzing a corresponding beam profile of the reflection feature.

[0245] Embodiment 13. The detector according to the preceding embodiment, wherein the detector is configured to perform a method according to any one of the preceding method-related embodiments.

[0246] Embodiment 14. A mobile device, comprising at least one detector according to any one of the above embodiments involving detectors, wherein the mobile device is one or more of a mobile communication device, a tablet computer, and a portable computer.

[0247] Embodiment 15. A computer program comprising instructions, which, when a detector according to any one of the above embodiments relating to detectors executes the program, cause the detector to execute a method according to any one of the above embodiments relating to methods.

[0248] Embodiment 16. A computer-readable storage medium comprising instructions, which, when executed by a detector according to any one of the preceding embodiments relating to detectors, cause the detector to perform a method according to any one of the preceding embodiments relating to methods.

[0249] Embodiment 17. A non-transitory computer-readable medium comprising instructions that, when executed by one or more processors, cause the one or more processors to perform a method according to any one of the preceding method-related embodiments.

[0250] Embodiment 18. Use of a detector according to any one of the aforementioned embodiments involving detectors for a purpose of use selected from the group consisting of: position measurement in traffic technology; entertainment applications; security applications; surveillance applications; safety applications; human-machine interface applications; logistics applications; tracking applications; outdoor applications; mobile applications; communication applications; photography applications; machine vision applications; robotics applications; quality control applications; manufacturing applications; gait monitoring applications; human body monitoring applications; home care; smart life, automotive applications. BRIEF DESCRIPTION OF THE DRAWINGS

[0251] Other optional features and embodiments are preferably disclosed in more detail in the subsequent description of the embodiments in conjunction with the dependent claims. Wherein, as the skilled person will recognize, the corresponding optional features can be implemented in an independent manner and in any arbitrary feasible combination. The scope of the present invention is not limited by the preferred embodiments. The embodiments are schematically depicted in the accompanying drawings. Wherein, the same reference numerals in these drawings represent the same or functionally equivalent elements.

[0252] In the attached picture:

[0253] Figure 1 A flow chart showing an embodiment of a method for beam profiling using at least one camera according to the present invention;

[0254] Figure 2 An embodiment of a detector according to the present invention is shown;

[0255] Figure 3 The experimental results, in particular the photon transfer curve of the camera, are shown; and

[0256] Figure 4 An embodiment of a look-up table is shown. DETAILED DESCRIPTION

[0257] Figure 1 A flow chart of an embodiment of a method for beam profiling using at least one camera 110 is shown.

[0258] The method may be computer-implemented. The method may involve at least one computer and / or at least one computer network. The computer and / or computer network may include at least one processor, which may be configured to perform at least one method step of the method according to the invention. In particular, each of these method steps is performed by a computer and / or a computer network. The method may be performed fully automatically, in particular without user interaction.

[0259] Beam profile analysis may include and / or may be a method for determining at least one physical quantity or property of object 112 (such as a longitudinal coordinate and / or a material property) by using a beam profile of a reflected light beam originating from object 112. For beam profile analysis, please refer to the following documents: WO 2018 / 091649A1; WO 2018 / 091638A1; WO 2018 / 091640A1; and C. Lennartz, F. Schick, S. Metz, "Whitepaper-Beam Profile Analysisfor 3D imaging and material detection", April 28, 2021, Ludwigshafen, Germany, the entire contents of which are included herein by reference. The beam profile may be the spatial distribution of the intensity of the beam, in particular the spatial distribution in at least one plane perpendicular to the propagation of the beam. The beam profile may be a transverse intensity profile of the beam. The beam profile may be a cross-section of the beam. The beam profile may be selected from the group consisting of: a trapezoidal beam profile; a triangular beam profile; a conical beam profile, and a linear combination of Gaussian beam profiles. However, other embodiments are possible.

[0260] The object 112 may be any object 112 to be measured, in particular a surface or region, configured to at least partially reflect at least one light beam incident on the object 112. For example, the object 112 may be a person, in particular skin. The object 112 may include a surface or region configured to at least partially perform one or more of the following in response to at least one light beam impinging on the object 112: reflection and / or scattering and / or emission. The object 112 may be part of a scene including the object 112 and further surroundings.

[0261] The camera 110 may be an element of the detector 114 . Figure 2An embodiment of a detector is shown. The detector 114 can be any sensor device configured to determine and / or detect and / or sense an object. The detector 114 can be a fixed device or a mobile device. Further, the detector 114 can be an independent device or can form a part of another device (e.g., a computer, a vehicle, or any other device). Further, the detector 114 can be a handheld device. Other embodiments of the detector are also feasible. The detector 114 can be one attached to or integrated in a mobile device 116 (e.g., a mobile phone or a smart phone). The detector 114 can be integrated in the mobile device 116, for example, in the housing of the mobile device. Additionally or alternatively, the detector 114 or at least one component of the detector can be attached to the mobile device 116, such as by using a connector such as a USB or a telephone connector such as a headphone jack.

[0262] The camera 110 has at least one sensor element 118 having an optical sensor matrix. The optical sensors each have a photosensitive area. Each optical sensor is designed to generate at least one sensor signal in response to the illumination of the corresponding photosensitive area of ​​the optical sensor by a reflected light beam propagating from the object 112 to the camera 110.

[0263] like Figure 1 As shown, the method comprises the following steps:

[0264] a) (120) at least one data acquisition step, wherein the data acquisition step comprises illuminating at least one object 112 using at least one illumination pattern 122 comprising at least one illumination feature using at least one projector 124, wherein the projector 124 comprises at least one emitter 126 configured to generate at least one light beam, wherein the data acquisition step further comprises imaging at least one reflection image using the camera 110, the at least one reflection image comprising at least one reflection feature generated by the object 112 in response to illumination of the illumination feature, wherein the reflection feature comprises at least one beam profile, wherein the reflection image has a first bit depth;

[0265] b) (128) at least one image compression step, wherein the image compression step comprises compressing the reflectance image into a compressed reflectance image having a second bit depth lower than the first bit depth by using at least one evaluation device 130, wherein the compression comprises applying a non-linear gray value transformation to the sensor signals;

[0266] c) (132) at least one evaluation step, wherein the evaluation step comprises evaluating the compressed reflection image by using the evaluation device 130, wherein the evaluation comprises determining at least one longitudinal coordinate of the reflection feature by analyzing a corresponding beam profile of the reflection feature.

[0267] like Figure 2 The projector 124 shown may be an optical device configured to project at least one illumination pattern onto an object, in particular onto a surface of the object. The projector 124 is configured to illuminate the object 112 with at least one illumination pattern 122 comprising a plurality of illumination features. An illumination feature may be at least one at least partially extending feature of the illumination pattern 122. The illumination pattern 122 may include at least one pattern selected from the group consisting of: at least one quasi-random pattern; at least one Sobol pattern; at least one quasi-periodic pattern; at least one dot pattern, in particular a pseudo-random dot pattern; at least one line pattern; at least one stripe pattern; at least one checkerboard pattern; at least one triangular pattern; at least one rectangular pattern; at least one hexagonal pattern or a pattern comprising further convex tessellation. The illumination pattern 122 may exhibit at least one illumination feature selected from the group consisting of: at least one dot; at least one line; at least two lines, such as parallel lines or crossing lines; at least one dot and one line; at least one arrangement of periodic features; at least one feature pattern of arbitrary shape. For example, the illumination pattern 122 includes at least one pattern, the at least one pattern including at least one predicted feature. For example, the illumination pattern 122 includes at least one line pattern, the at least one line pattern including at least one line. For example, the illumination pattern 122 includes at least one line pattern, the at least one line pattern including at least two lines such as parallel lines or crossing lines. For example, the projector 124 can be configured to generate and / or project a point cloud or non-point features. For example, the projector 124 can be configured to generate a point cloud or non-point features, so that the illumination pattern 122 can include a plurality of point features or non-point features. For example, the illumination pattern 122 includes at least 10, 20, 100, 1000 or even more illumination features.

[0268] The projector 124 includes at least one emitter 126 configured to generate at least one light beam. The projector 124 may include at least one array of emitters 126. Each of these emitters 126 may be configured to emit at least one light beam. The emitter 126 may be at least one arbitrary device configured to provide at least one light beam for illuminating the object 112. Each of the emitters 126 may be and / or may include at least one element selected from the group consisting of at least one laser source and at least one non-laser light source, such as at least one semiconductor laser, at least one double heterostructure laser, at least one external cavity laser, at least one separated confined heterostructure laser, at least one quantum cascade laser, at least one distributed Bragg reflector laser, at least one polariton laser, at least one hybrid silicon laser, at least one extended cavity diode laser, at least one quantum dot laser, at least one volume Bragg grating laser, at least one indium arsenide laser, at least one gallium arsenide laser, at least one transistor laser, at least one diode pumped laser, at least one distributed feedback laser, at least one quantum well laser, at least one interband cascade laser, at least one semiconductor ring laser, at least one vertical cavity surface emitting laser (VCSEL); the at least one non-laser light source is such as at least one LED or at least one light bulb. For example, the emitter 126 may be a VCSEL array. Each of the VCSELs is configured to generate at least one light beam. The VCSELs may be arranged on a common substrate or on different substrates. The array may include up to 2500 VCSELs. For example, an array may include 38×25 VCSELs, such as a high power array with 3.5 W. For example, an array may include 10×27 VCSELs, with 2.5 W. For example, an array may include 96 VCSELs, with 0.9 W. The size of an array with, for example, 2500 elements may be at most 2 mm×2 mm.

[0269] The light beam emitted by the corresponding emitter 126 may have a wavelength of 300 to 1100nm, preferably 500 to 1100nm. For example, the light beam may have a wavelength of 940nm. For example, light in the infrared spectrum, such as light in the range of 780nm to 3.0μm, may be used. Specifically, light in a portion of the near-infrared region (specifically in the range of 700nm to 1100nm) for which a silicon photodiode is applicable may be used. The emitter 126 may be configured to generate at least one illumination pattern in the infrared region, particularly in the near-infrared region. Using light in the near-infrared region may allow the light to be undetectable or only weakly detected by the human eye, and still be detectable by a silicon sensor, particularly a standard silicon sensor. For example, the emitter 126 may be a VCSEL array. The VCSEL may be configured to emit a light beam having a wavelength range of 800 to 1000nm. For example, the VCSEL may be configured to emit a light beam of 808nm, 850nm, 940nm, or 980nm. Preferably, the VCSEL emits light at 940 nm, since terrestrial solar radiation has a local minimum in irradiance at this wavelength, for example as described in CIE 085-1989 "Solar spectral irradiance".

[0270] Projector 124 may include at least one delivery device (not shown here) configured to generate an illumination signature from a light beam impinging on the delivery device.

[0271] The data acquisition step 120 further includes imaging at least one reflected image using a camera 110, the at least one reflected image including at least one reflected feature generated by the object 112 in response to illumination by the illumination feature. The camera 110 may be a device having at least one imaging element configured to record or capture spatially resolved one-dimensional, two-dimensional or even three-dimensional optical data or information. The camera 110 may be a digital camera. As an example, the camera 110 may include at least one camera chip, such as at least one CCD chip and / or at least one CMOS chip configured to record images. The camera 110 may be or may include at least one near-infrared camera. In addition to at least one camera chip or imaging chip, the camera 110 may include additional elements, such as one or more optical elements, such as one or more lenses. As an example, the camera 110 may be a fixed-focus camera, at least one lens of which is fixed relative to the adjustment of the camera. However, alternatively, the camera 110 may also include one or more variable lenses that can be adjusted automatically or manually.

[0272] The camera 110 may be a camera of a mobile device, such as a notebook computer, a tablet computer, or in particular a cellular phone (such as a smartphone), etc. Thus, in particular, the camera 110 may be part of a mobile device 116, which in addition to the camera 110 comprises one or more data processing devices, such as one or more data processors. However, other cameras are also feasible.

[0273] The optical sensor of the camera 110 may be sensitive in one or more spectral ranges of the ultraviolet spectral range, the visible spectral range, or the infrared spectral range. Specifically, the optical sensor may be sensitive in the visible spectral range of 500nm to 780nm, most preferably in the range of 650nm to 750nm or in the range of 690nm to 700nm. Specifically, the optical sensor may be sensitive in the near infrared region. Specifically, the optical sensor may be sensitive in a portion of the near infrared region for which silicon photodiodes are applicable, specifically in the range of 700nm to 1000nm. Specifically, the optical sensor may be sensitive in the infrared spectral range, specifically in the range of 780nm to 3.0 microns. For example, the optical sensors may each independently be or may include at least one element selected from the group consisting of a photodiode, a photocell, a photoconductor, a phototransistor, or any combination thereof. For example, the optical sensor may be or may include at least one element selected from the group consisting of a CCD sensor element, a CMOS sensor element, a photodiode, a photocell, a photoconductor, a phototransistor, or any combination thereof. Any other type of photosensitive element may be used. The photosensitive element may generally be made wholly or partly of inorganic materials and / or may be made wholly or partly of organic materials. Most commonly, one or more photodiodes may be used, such as commercially available photodiodes, for example inorganic semiconductor photodiodes.

[0274] The camera 110 may include a global shutter (not shown here) and / or may operate in a global shutter mode. The global shutter may be an electronic shutter configured to quantize the exposure time of the sensor element. The global shutter may be configured so that the exposure of each pixel of the sensor element starts and ends at the same time.

[0275] The camera 110 may comprise a transfer device (not shown here) which is configured for directing the light beam onto the optical sensors and for forming the reflected image on the sensor element 118. The detector 114 may comprise an optical axis. For example, the transfer device may constitute a coordinate system, wherein the ordinate z is a coordinate along the optical axis of the transfer device. The coordinate system may be a polar coordinate system, wherein the optical axis of the transfer device forms the z-axis, and wherein the distance from the z-axis, and the polar angle may be used as additional coordinates. For example, the transfer device may constitute a coordinate system, wherein the optical axis of the detector forms the z-axis, and wherein, in addition, an x-axis and a y-axis may be provided which are perpendicular to the z-axis and perpendicular to each other. Figure 2 An exemplary coordinate system is shown in .

[0276] The reflected image may be an image determined by the camera 110 that includes a plurality of reflected features. The reflected features may be features in an image plane generated by the object 112 in response to, for example, illumination with at least one illumination feature. The reflected image may include at least one reflection pattern including the reflected features. Imaging at least one reflected image may include one or more of: capturing, recording, and generating a reflected image. The reflected features include at least one beam profile. Each of the reflected features includes at least one beam profile.

[0277] The reflected image has a first bit depth. The bit depth defines the number of bits per pixel in the image. The higher the first bit depth, the more information can be stored. For example, the first bit depth is at least one bit depth selected from the range consisting of 9 to 16. For example, the first bit depth can be 10 bits. However, even higher first bit depths are possible, such as 32 bits.

[0278] For example, for storage and / or transmission and / or further analysis, it may be necessary to compress the first bit depth. Compression may include transforming information using fewer bits than the original representation. Compression may include quantizing by compressing a range of values ​​into a single quantum value. Quantization may be performed using a limited number of quantization levels.

[0279] As outlined above, the method comprises at least one image compression step in step b) 128. The image compression step 128 comprises compressing the reflectance image into a compressed reflectance image having a second bit depth lower than the first bit depth by using at least one evaluation device. The second bit depth may be the number of bits per pixel of the compressed reflectance image. The second bit depth is lower than the first bit depth. For example, the second bit depth is 8 to 15 bits.

[0280] Typically, compression is lossy and may in particular result in a loss of signal range, resolution and / or contrast. However, in order to use reliable results for beam profile analysis, the signal may need to be as "physical" as possible. A further known technique uses equidistant quantization for image sensors. However, in the case of a linear camera with low dark noise, equidistant quantization may be inappropriate. The camera 110 may have low dark noise. Therefore, the variance of the temporal noise may increase linearly with the sensor signal. In order to be able to resolve the low noise in the dark parts of the picture, many quantization levels will be required. However, as a result, in the bright parts, the quantization may become too fine, so that the standard deviation of the temporal noise greatly exceeds the standard deviation of the quantization levels. This means that general equidistant quantization of image sensors may be suboptimal.

[0281] The compression comprises applying a non-linear gray value transformation to the sensor signal. The non-linear gray value transformation can be configured as described in: B. and Schwarzbauer, M., “Noise equalisation and quasi loss-less image data compression–or how many bits needs an imagesensor?” tm–Technisches Messen, 83, 16–24, doi:10.1515 / teme-2015-0093, published online December 17, 2015, 2016. Nonlinear grayscale value transformations can allow image compression from a first bit depth (e.g., 10 bits) to a lower second bit depth (e.g., 8 bits) while minimizing information losses, in particular in terms of signal range, resolution and / or contrast.

[0282] Not bound by this theory, the variance of the temporal noise σ 2 g (g) may depend strongly on the gray value g. The relationship between the variance and the mean of the gray values ​​can be described by the so-called photon transfer curve.

[0283] By means of a nonlinear grayscale value transformation, the temporal noise can be modified in such a way that the standard deviation of the temporal noise becomes independent of the grayscale value, thereby generating a noise-equalized signal. B.: Digitale Bildverarbeitung [Digital Image Processing], Springer, Berlin, 6th edition, doi:10.1007 / b138991, 2005, from the law governing error propagation, it is known that the variance of the nonlinear function h(g) is, to first order,

[0284]

[0285] If σ 2 h is a constant value, then formula (1) can be transformed into

[0286]

[0287] And the points are generated

[0288]

[0289] The integration constant can be chosen so that h(0) = 0. Equation (2) indicates that for each function σ 2 g (g) has an analytical solution and can be integrated. Otherwise, numerical integration can be performed.

[0290] With a linear camera, the variance of temporal noise increases linearly with the grayscale value g:

[0291]

[0292] Here, the variance of the dark noise is (in DN), K is the magnification of the camera (in DN / electron), see EMVA Standard 1288-Standard for Characterization of Image Sensors and Cameras, Version 3.1, Open Standard, European Machine Vision Association, doi:10.5281 / zenodo.235942, 2016. Using the linear variance function (3), the integral in (2) is calculated as

[0293]

[0294] The free parameter σ in the nonlinear transformation signal h(g) can be used h and a constant standard deviation of temporal noise in order to determine the signal range [0, h max ] and / or the number of bits necessary to compress the signal.

[0295]

[0296] Equation (3) can be rewritten as follows

[0297]

[0298] Among them, g max is the maximum gray value. This yields the condition h(g max )=h max ,then

[0299] and

[0300] Therefore, we can calculate how many bits are needed for proper quantization of the noise-equalized signal:

[0301]

[0302] The right-hand side approximation can be used because σ max >>σ0. Therefore, the maximum (signal-to-noise ratio) SNR of the camera determines how many bits are needed for adequate quantization independent of dark noise. From this equation, it can be found how many bits are needed to quantize the equalized signal h. This is given by h max The value of σ is given. h Can be between 0.5 and 1. This allows for optimal quantization, see: B. and Schwarzbauer, M., “Noise equalisation and quasi loss-less image data compression–or how many bits needs an image sensor?” tm–Technisches Messen, 83, 16–24, doi:10.1515 / teme-2015-0093, published online December 17, 2016.

[0303] These considerations show that it is possible to compress the image data of a camera, in particular a linear camera, using a nonlinear grayscale value transformation, whose maximum SNR is < 126 and with the aid of a nonlinear grayscale value transformation. h = 1. In this way, the entire signal range of the camera can be covered.

[0304] Table 1 includes camera characteristics of five different cameras 110:

[0305]

[0306]

[0307] The table shows that none of the cameras 110 has an SNR of more than 103. Therefore, all cameras 110 can operate within their entire dynamic range with 8 bits. If these cameras 110 were to operate with linear characteristics and 8 bits, the dynamics of the sensor would never be fully deployed, but would be limited by quantization. For example, for OV9282, if it is assumed that the signal processing is optimal 256 and 8-bit linear, this will be about 5.3 times worse than the signal range of the camera itself. For other cameras 110 with even larger signal ranges, the benefits of using nonlinear grayscale value transformations will be considerable. For example. In the case of IMX392, the signal range can be increased by nearly 20 times by nonlinear transformations. Therefore, in all cases, the use of nonlinear grayscale value transformations can result in considerable improvements in the signal range, which is reflected in the extended depth range for determining the ordinate.

[0308] The non-linear gray value transformation h(g) may be applied using at least one predetermined lookup table of non-linear gray value transformation h as a function of gray value g, where g is the gray value of a pixel with a higher bit depth. For example, in case of compression to 8 bits, the lookup table may have 2 at 8 bit resolution, depending on the resolution of the camera. 10 or 2 12 value.

[0309] For example, the nonlinear grayscale value transformation may include applying a nonlinear grayscale value transformation as described in equation (4) to the grayscale value g. Using this formula may be advantageous because the required parameters can be directly obtained from measurements of EMVA Standard 1288-(Standard for Characterization of Image Sensors and Cameras, Version 3.1, Open Standard, European Machine Vision Association, doi:10.5281 / zenodo.235942, 2016), namely the dark noise σ0 in DN (in the EMVA 1288 standard, it is referred to as σ y.dark ) and the magnification K. Both parameters arise from the offset and gradient of the photon transfer curve. For the photon transfer curve, absolute radiometric measurements may not be required because the variance of the temporal noise is plotted as a function of the photoinduced mean gray value. Figure 3 Shows OMNIVISION TM Example photon transfer curve for the OV9282 camera.

[0310] In particular, the nonlinear grayscale value transformation may include applying a nonlinear grayscale value transformation to the grayscale value g

[0311]

[0312] Among them, σ g is the standard deviation of the sensor signal, K is the camera system gain, σ0 2 is the dark noise, g off is a predetermined offset of g, and h0 is a predetermined offset of h. Using this formula ensures the correct choice of the offsets of g and h, since values ​​lower than the average dark value may be obtained due to temporal noise. g0 may be chosen in such a way that the average dark value μ of the camera is first considered. g.dark , and then subtract the additional value g0, which produces g offs =μ g.dark +g0. Figure 4 shows the use of OMNIVISION TM Example lookup table for the OV9282 camera with nonlinear transformation from 10-bit to 8-bit compression while fully preserving the signal dynamics, with σ h =1 and for the measured values ​​of σ0=0.67, K=0.185, h0=8 and g0=3 (see Table 1). It can be seen from the stepped shape of the lookup table that at high grayscale values ​​g, many values ​​fall on the same value h, because there the temporal noise is much larger than the quantization. At smaller grayscale values, the steps become narrower and narrower as the temporal noise decreases. The lookup table is similar to but not identical to the square root function or the gamma value of 0.5.

[0313] The detector 114 further comprises an evaluation device 130 which is configured to determine at least one longitudinal coordinate of the reflection feature by analyzing the corresponding beam profile of the reflection feature.

[0314] The evaluation device 130 may be configured to select a reflective feature of the reflective image. The selection may include one or more of identifying, determining, and selecting at least one reflective feature of the reflective image. The evaluation device 130 may be configured to perform at least one image analysis and / or image processing to identify the reflective feature. The image analysis and / or image processing may use at least one feature detection algorithm. Image analysis and / or image processing may include one or more of: filtering; selecting at least one region of interest; forming a difference image between an image created by a sensor signal and at least one offset; inverting a sensor signal by inverting an image created by the sensor signal; forming a difference image between images created by the sensor signal at different times; background correction; decomposition into color channels; decomposition into hue; saturation; and brightness channels; frequency decomposition; singular value decomposition; applying a Canny edge detector; applying a Laplacian of Gaussian filter; applying a Difference of Gaussian filter; applying a Sobel operator; applying a Laplacian operator; applying a Scharr operator; applying a Prewitt operator; applying a Roberts operator; applying a Kirsch operator; applying a high pass filter; applying a low pass filter; applying a Fourier transform; applying a Radon transform; applying a Hough transform; applying a wavelet transform; thresholding; creating a binary image. The region of interest may be manually determined by a user or may be automatically determined, such as by identifying an object within an image generated by the optical sensor.

[0315] The evaluation device 130 is configured to determine at least one ordinate of the reflection features, also denoted z, by analyzing the beam profile of these reflection features. DPR . The analysis of the beam profile may include an evaluation of the beam profile and may include at least one mathematical operation and / or at least one comparison and / or at least one symmetrization and / or at least one filtering and / or at least one normalization. For example, the analysis of the beam profile may include at least one of a histogram analysis step, a calculation of a difference measure, an application of a neural network, an application of a machine learning algorithm. The evaluation device 130 may be configured to symmetrize and / or normalize and / or filter the beam profile, in particular to remove noise or asymmetry from recordings at larger angles, recording edges, etc. The evaluation device 130 may filter the beam profile by removing high spatial frequencies, such as by spatial frequency analysis and / or median filtering, etc. The summing may be performed by the intensity center of the spot and averaging all intensities at the same distance from the center. The evaluation device 130 may be configured to normalize the beam profile to a maximum intensity, in particular to take into account intensity differences due to the recorded distances. The evaluation device 130 may be configured to remove the influence of background light from the beam profile, for example by imaging without illumination.

[0316] The reflective feature may cover at least one pixel of the image or may extend thereon. For example, the reflective feature may cover a plurality of pixels or may extend thereon. The evaluation device 130 may be configured to determine and / or select all pixels connected to and / or belonging to the reflective feature (e.g., light spot). The evaluation device 130 may be configured to determine the intensity center by the following formula:

[0317]

[0318] Among them, R coi is the position of the intensity center, r pixel is the pixel position, and l = ∑ j I total , where j is the number of pixels connected to and / or belonging to the reflectance feature, and I total is the total intensity.

[0319] The evaluation device 130 can be configured to determine the ordinate of each of these reflection features by using a depth-by-photon ratio technique (also denoted beam profile analysis). For the depth-by-photon ratio (DPR) technique, reference is made to the following documents: WO 2018 / 091649A1; WO 2018 / 091638A1; WO 2018 / 091640A1; and C. Lennartz, F. Schick, S. Metz, “Whitepaper-Beam Profile Analysis for 3D imaging and material detection”, April 28, 2021, Ludwigshafen, Germany, the entire contents of which are incorporated herein by reference.

[0320] The evaluation device 130 can be further configured to determine the material properties of the object by using beam profile analysis. Specifically, the beam profile analysis uses the reflection properties of coherent light projected onto the surface of the object to classify the material. The determination of material properties can be performed as described in one of WO 2020 / 187719, WO 2021 / 170791A1 and / or WO 2021 / 152070, the full contents of which are included herein by reference. Specifically, the analysis of the beam profile of the reflection feature can be performed by a feature-based method. Additionally or alternatively, a machine learning method can be used. The feature-based method can be used in combination with a machine learning method that can allow the classification model to be parameterized. Alternatively or in combination, a convolutional neural network can be used to classify the material by using a reflection image as input.

[0321] List of Reference Numerals

[0322] 110 Camera

[0323] 112 Objects

[0324] 114 Detector

[0325] 116 Mobile Devices

[0326] 118 Sensor element

[0327] 120 Step a)

[0328] 122 Irradiation Pattern

[0329] 124 Projector

[0330] 126 Transmitter

[0331] 128 Step b)

[0332] 130 Evaluation Device

[0333] 132 Step c)

Claims

1. A method for beam profiling using at least one camera (110), wherein: The camera (110) has at least one sensor element (118), the at least one sensor element having a matrix of optical sensors, each of the optical sensors having a photosensitive area, wherein each optical sensor is designed to generate at least one sensor signal in response to the illumination of a corresponding photosensitive area of ​​the optical sensor by a reflected light beam propagating from the object to the camera (110), the method comprising the following steps: a) (120) at least one data acquisition step, wherein the data acquisition step comprises illuminating at least one object (112) using at least one projector (124) with at least one illumination pattern (122) comprising at least one illumination feature, wherein the projector (124) comprises at least one emitter (126) configured to generate at least one light beam, wherein the data acquisition step further comprises imaging at least one reflection image using the camera (110), the at least one reflection image comprising at least one reflection feature generated by the object in response to illumination by the illumination feature, wherein the reflection feature comprises at least one beam profile, and wherein the reflection image has a first bit depth; b) (128) at least one image compression step, wherein the image compression step comprises compressing the reflectance image into a compressed reflectance image having a second bit depth lower than the first bit depth by using at least one evaluation device (130), wherein the compression comprises applying a non-linear gray value transformation to the sensor signals; c) (132) at least one evaluation step, wherein the evaluation step comprises evaluating the compressed reflection image by using the evaluation device (130), wherein the evaluation comprises determining at least one longitudinal coordinate of the reflection feature by analyzing a corresponding beam profile of the reflection feature.

2. The method according to the preceding claim, wherein: The first bit depth is the number of bits per pixel of the reflected image, and the second bit depth is the number of bits per pixel of the compressed reflected image.

3. The method according to the preceding claim, wherein: The first bit depth is at least one bit depth selected from the range consisting of 9 to 16 bits, and the second bit depth is 8 to 15 bits.

4. A method according to any one of the preceding claims, wherein: The non-linear gray value transformation h(g) is applied using at least one predetermined look-up table of non-linear gray value transformations h as a function of the gray value g, wherein g is the gray value of the pixel having the higher bit depth.

5. The method according to the preceding claim, wherein: The nonlinear grayscale value transformation includes applying the nonlinear grayscale value transformation to the grayscale value g. Among them, σ g is the standard deviation of the sensor signal, K is the camera system gain, σ0 2 is the dark noise, g off is the predetermined offset of g, and h0 is the predetermined offset of h.

6. A method according to any one of the preceding claims, wherein: The analysis of the beam profile includes determining at least one first region and at least one second region of the beam profile, wherein the analysis of the beam profile further includes deriving a combined signal Q by one or more of the following: dividing the first region by the second region, dividing the first region by a multiple of the second region, dividing the first region by a linear combination of the second region, wherein the analysis of the beam profile further includes determining the ordinate using at least one predetermined relationship between the combined signal Q and the ordinate.

7. A method according to any one of the preceding claims, wherein: The camera (110) includes at least one CCD sensor or at least one CMOS sensor.

8. A method according to any one of the preceding claims, wherein: The projector (124) includes at least one array of emitters (126), wherein each of the emitters is configured to generate at least one light beam.

9. A method according to any one of the preceding claims, wherein: The light beam generated by the emitter (126) has a wavelength in the near infrared (NIR) range, wherein the light beam is generated by the emitter in a wavelength range from 800 nm to 1000 nm, preferably in a wavelength range of about 940 nm.

10. The method according to any one of the preceding method claims, wherein: The method is computer implemented.

11. A detector (114) for determining a position of at least one object (112), in, The detector comprises at least one projector (124) for illuminating at least one object (112) with at least one illumination pattern (122) comprising at least one illumination feature, wherein the projector (124) comprises at least one emitter (126) configured to generate at least one light beam; wherein the detector (114) further comprises at least one camera (110), the at least one camera having at least one sensor element (118), the at least one sensor element having a matrix of optical sensors, the optical sensors each having a photosensitive area, wherein each optical sensor is designed to generate at least one sensor signal in response to illumination of a corresponding photosensitive area of ​​the optical sensor by a reflected light beam propagating from the object to the camera (110), wherein the camera (110) is configured to image at least one reflection image, the at least one reflection image comprising at least one reflection feature generated by the object in response to illumination by the illumination feature, wherein the reflection feature comprises at least one beam profile; The detector (114) further comprises at least one evaluation device (130), wherein the at least one evaluation device is configured to perform the following steps: - at least one image compression step, wherein the image compression step comprises compressing the reflectance image into a compressed reflectance image having a second bit depth lower than the first bit depth, wherein the compression comprises applying a non-linear grey value transformation to the sensor signals; - at least one evaluation step, wherein the evaluation step comprises evaluating the compressed reflection image, wherein the evaluation comprises determining at least one longitudinal coordinate of the reflection feature by analyzing a corresponding beam profile of the reflection feature.

12. A mobile device (116) comprising at least one detector (114) according to the preceding claim, wherein: The mobile device (116) is one or more of a mobile communication device, a tablet computer, and a portable computer.

13. A computer program comprising instructions which, when executed by a detector (114) as claimed in claim 11, cause the detector (114) to perform a method according to any of the preceding method-related claims.

14. A non-transitory computer readable medium comprising instructions which, when executed by one or more processors, cause the one or more processors to perform a method according to any one of the preceding method-related claims.

15. The use of the detector (114) according to claim 11 for a purpose of use selected from the group consisting of: position measurement in traffic technology; entertainment applications; security applications; surveillance applications; safety applications; human-machine interface applications; logistics applications; tracking applications; outdoor applications; mobile applications; communication applications; photography applications; machine vision applications; robotics applications; quality control applications; manufacturing applications; gait monitoring applications; human body monitoring applications; home care; smart life, automotive applications.

Citation Information

Patent Citations

  • Image compression method with negligible and quantifiable information loss and high compression ratio

    EP3185555A1

  • Method and device for steganographic processing and compression of image data

    EP3820150A1

  • Top-emission vcsel-array with integrated diffuser

    WO2017222618A1

  • Detector for optically detecting at least one object

    WO2018091638A1

  • Detector for optically detecting at least one object

    WO2018091649A1