Determining device for determining a surface shape

A compact determination device with collimation and line generation optics, a beam splitter, and a pivotable mirror uses pulsed illumination to determine surface shapes efficiently in limited spaces, addressing the space constraints of mobile devices.

DE102016110444B4Active Publication Date: 2024-12-05JABIL OPTICS GERMANY GMBH
View PDF 3 Cites 0 Cited by

Patent Information

Application Number
DE102016110444
Authority / Receiving Office
DE · DE
Patent Type
Patents
Current Assignee / Owner
Filing Date
2016-06-06
Publication Date
2024-12-05
Estimated Expiration
2036-06-06

AI Technical Summary

Technical Problem

Existing methods for determining surface shapes require significant installation space, particularly in compact devices like mobile computers and smartphones, limiting their applicability.

Method used

A compact determination device with an illumination device comprising collimation and line generation optics, a beam splitter, and a pivotable mirror, utilizing a line sensor and pulsed illumination to determine surface shapes with minimal space.

Benefits of technology

Enables accurate surface shape determination with reduced installation space, allowing for compact construction and efficient detection of surface changes and movements using a one-dimensional sensor line.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 00000000_0000_ABST
    Figure 00000000_0000_ABST
Patent Text Reader

Abstract

Determination device for determining the surface shape of an object (18), with a lighting device (10), wherein a lighting line (14) can be generated with the lighting device (10) and distance information can be determined via the lighting line (14), wherein the determining device comprises a sensor line (23) and an optical element (16), wherein the optical element (16) is configured to direct the illumination line (14) reflected from the object (18) arranged in the detection area (17) of the optical element (16) onto the sensor line (23), and wherein the sensor line (23) is a time-of-flight sensor, and wherein the optical element (16) is a mirror mounted to tilt or pivot about at least one axis and directs the illumination line (14) to the detection area (17) and / or the illumination line (14) reflected from the object (18) to the sensor line (23), characterized by the fact that the illumination device (10) comprises an imaging device (13) forming the illumination line (14) with a collimation optic and a line-generating optic, wherein a beam splitter (30) is arranged between the collimation optics and the line generation optics, and wherein The collimation optics together with the beam splitter (30) form a single, handleable component, wherein a side of the component facing away from the detection area (17) along an illumination axis (12) of the illumination device (10) has a collimation side (28) forming the collimation optics, and / or The line generation optics together with the beam splitter (30) form a single-piece, handleable component, wherein a side of the component facing the detection area (17) along an illumination axis (12) of the illumination device (10) has a line generation side (29) providing the line generation optics.
Need to check novelty before this filing date? Find Prior Art

Description

[0001] The invention relates to a determination device for determining a surface shape of an object, comprising an illumination device and a recording device, wherein an illumination line can be generated with the illumination device and distance information can be determined via the illumination line, wherein the determination device has a sensor line and an optical element, wherein the optical element is designed to guide the illumination line reflected by the object arranged in a detection zone of the optical element to the sensor line, and wherein the sensor line is a time-of-flight sensor. The optical element is a mirror mounted so as to be tiltable or pivotable about at least one axis and guides the illumination line to the detection zone and / or the illumination line reflected by the object to the sensor line.

[0002] Methods and determination devices for determining surface shapes are generally known, for example, from DE 10 2014 104 027 A1, DE 11 2011 101 667 T5, and US 2006 / 0227317 A1. Particularly when surface shapes of objects are to be determined using small devices, such as a mobile computer, a tablet PC, a mobile phone, or other mobile and possibly battery-operated devices, the installation space for the determination device is limited. In particular, for various devices (tablet PCs, mobile phones, etc.), the height of the device in the direction of the surface to be determined is severely limited. However, known methods and determination devices for determining surface shapes require a lot of installation space.

[0003] The invention is therefore based on the object of providing a determination device for determining surface shapes, wherein the surface shape can be determined simply and with a determination device requiring little installation space.

[0004] This object is achieved for the determination device mentioned above in that the illumination device comprises an imaging device that forms the illumination line and has collimating optics and line-generating optics. A beam splitter is arranged between the collimating optics and the line-generating optics. The collimating optics form a one-piece, handleable component with the beam splitter, wherein a side of the component facing away from the detection area along an illumination axis of the illumination device has a collimating side that forms the collimating optics. Alternatively or additionally, the line-generating optics form a one-piece, handleable component with the beam splitter, wherein a side of the component facing toward the detection area along an illumination axis of the illumination device has a line-generating side that provides the line-generating optics.

[0005] The solution according to the invention allows the surface shape to be determined with a particularly compact line sensor, so that the determination device can be constructed in a particularly compact manner.

[0006] The solution according to the invention can be further improved by various embodiments, each of which is advantageous in itself and, unless otherwise stated, can be combined with one another in any desired way. These embodiments and their associated advantages are discussed below.

[0007] The method described below serves to facilitate understanding of the claimed invention, but is not part of it. The device according to the invention can be used to implement a method for determining the surface shape of an object, in which the object is illuminated with the illumination line. Illumination light from the illumination line reflected by the object can be directed onto the sensor line, whereby the surface shape is determined from the time-of-flight differences between different sections of the illumination line.

[0008] In a first advantageous embodiment, the illumination line can be moved at least once across the object, and illumination light reflected from different sections of the object can be directed onto the sensor line. This allows the surface shape of a larger area of ​​the object to be determined, even though only a one-dimensional sensor line and not a two-dimensional sensor arrangement is used to determine the surface shape.

[0009] To also detect movement of the object, the object can be illuminated twice at two identical beam angles, offset in time. The reflected illuminating light can then be redirected to the line sensor. Based on the illuminating light emitted and / or received at a different time, a change in the position of the object and thus the movement of the object and / or even a change in the surface shape of the object can be determined. The beam angles can be the beam angle of the illuminating light and / or the irradiation angle of the illuminating light relative to an optical axis, such as the illuminating device, or to an element of the illuminating device, the device, or the object.

[0010] Alternatively or in addition to the time-shifted illumination of the object with the illumination light, the illumination line can be moved several times over the object in order to determine changes in the surface shape and / or the position of the object.

[0011] For example, due to the temporally offset illumination and / or the movement of the illumination line across the object, gestures performed by the hand of a user of an electronic device can be recognized. The device can be operated based on the gesture. Alternatively, the device can generate control signals for another device based on the gesture and possibly output them to it.

[0012] Pulsed illumination light can be used to generate the illumination line, which makes it easier to determine the time-of-flight differences.

[0013] In a first advantageous embodiment of the detection device, the optical element can be configured to guide the illumination line to the object located in the detection zone and the illumination line reflected by the object to the line sensor. Particularly for objects that diffusely reflect the illumination light, the reflected illumination line can be easily guided to the line sensor. Because the optical element is configured to both guide the illumination line into the detection zone and guide light reflected from the detection zone to the line sensor, it is not necessary to provide additional optical elements for this purpose, allowing the detection device to be designed even more compactly.

[0014] To scan the surface shape of the object as simply and evenly as possible, the optical element can have a mirror that can be tilted or pivoted about at least one axis, for example, a micromirror actuator, i.e., a microelectromechanical component for dynamic light modulation, which directs the illumination line to the object and / or the illumination line reflected from the object to the sensor line. The pivoting mirror can be part of a microscanner or area light modulator, or it can be a single mirror.

[0015] The detection device, and in particular the illumination device, can be configured to emit pulsed illumination light. For example, the light source of the illumination device can be a pulsed laser or a vertical-cavity surface-emitting laser (VCSEL). Alternatively or additionally, the detection device can comprise a light valve, for example, a liquid crystal light valve or a mechanical light valve, through which the illumination light passes on its path from the light source to the detection area. Using the pulsed illumination light, changes in the surface shape and / or movements of the object can be quickly detected, particularly when the pulsed illumination light is pulsed at a high frequency of more than 50 kHz, more than 1 MHz, up to 50 MHz, or even up to 1 GHz or higher.

[0016] The determination device can have an evaluation unit that is connected at least to the sensor line in a signal-transmitting manner. Additionally, the evaluation unit can also be connected to the illumination light source and / or the light valve in a signal-transmitting manner. The evaluation unit can be designed to determine the surface shape based on time-of-flight differences between different sections of the illumination line. The time-of-flight differences arise from the reflection of the illumination line on the object when parts of the object's surface partially illuminated by the illumination line are further away from the sensor line than other illuminated parts of the object's surface. The sections of the illumination line can be defined by sensor elements of the sensor line. Each of the sensor elements can define a section of the illumination line. Such an evaluation unit can be constructed simply and compactly when using the line sensor.Alternatively, the evaluation unit can also be part of the device and, for example, implemented as software that can run on a processor of the device.

[0017] The determination device has an imaging device that forms the illumination line. The imaging device can be designed to form the illumination line between the optical element and the imaging device and at a distance of up to ten times, up to five times, or up to three times the diameter of the illumination line from the optical element. With an imaging device designed in this way, the pivotable mirror can be arranged close to the focal point of the imaging device and, in particular, from the perspective of the imaging device, behind its focal point or focal line. For example, the distance between the pivotable mirror and the focal point can be arranged at a distance from the focal point that can be less than ten times, less than five times, and, for example, less than three times the diameter of the illumination line. The diameter of the illumination line is to be measured transversely to its length.This further reduces the space required by the illumination device. The imaging device imprints angular information on the illumination light, creating a linear focus just behind the imaging device. The illumination line is created by the angular information about the distance.

[0018] The imaging device comprises collimating optics, for example with a rotationally symmetrical refractive surface, and line-generating optics, for example a cylindrical refractive surface, with a beam splitter arranged between the collimating optics and the line-generating optics. The beam splitter can transmit or reflect the illuminating light on its path from the illuminating light source to the detection zone. The beam splitter can reflect or transmit the illuminating light returning from the detection zone and, in particular, reflected from the object. The beam splitter can be a polarizing beam splitter, such as a pole plate, a plane plate, or a pole cube. In particular, the line-generating optics imparts angular information to the illuminating light, creating a linear focus shortly behind the line-generating optics. The illuminating line is created by the angular information about the distance.

[0019] The collimation optics and / or the line generation optics are designed together with the beam splitter as a single, manageable component, which not only simplifies the assembly of the illumination device but also reduces the space required for the detection device. The collimation optics are referred to as the collimation side, and the line generation optics are referred to as the line generation side.

[0020] The detection device can be configured to direct the illumination line scattered back from the object located in the detection zone to the sensor line via or through the line generation optics, the beam splitter, and the optical element. This further reduces the required installation space.

[0021] A polarization-optical element can be arranged between the line-generation optics and the optical element, or at the location where the line-generation optics generates the illumination line, or behind the optical element from the perspective of the imaging device. The polarization-optical element guides the illumination light on its path to the detection area and from the detection area back to the imaging device. The polarization-optical element is, for example, a λ / 4 plate.

[0022] The polarization-optical element has no polarizing effect; it merely changes the polarization properties. The illuminating light is thus polarized twice (transmitter and receiver principle). If the illuminating light is passed through the polarization-optical element, the polarization direction is rotated by 90°, and the beam splitter can effectively function as a polarization beam splitter. The light from the illuminating light source can already be relatively well polarized. If highly polarized light is required, a polarizer could be added between the illuminating light source and the beam splitter.

[0023] The sensor line can be the sensor line of a line sensor, whereby line sensors are designed more compactly than area sensors even with comparable resolution, so that the determination device can in turn be designed more compactly than known determination devices.

[0024] The line sensor is preferably a so-called time-of-flight sensor, i.e., a sensor designed to detect time-of-flight differences of illumination light. A line sensor can also be referred to as a line sensor. All or at least selected components of the detection device, and in particular all optical elements and sensors of the illumination device, can be arranged in a common plane during operation of the detection device, so that, in particular, the overall height required for the illumination device is low. The detection device can, in particular, be designed to carry out the described method.

[0025] The invention is explained below by way of example using exemplary embodiments with reference to the drawings. The different features of the embodiments can be combined independently of one another, as already explained for the individual advantageous embodiments.

[0026] They show: Fig. 1 a schematic representation of an embodiment of a method that can be carried out with the device according to the invention, and Fig. 2 a schematic representation of an embodiment of the determination device according to the invention.

[0027] Fig. 1 schematically shows an embodiment of the method for determining a surface shape of an object as a flowchart. Method 1 starts with a first method step 2, in which, for example, an illumination device for determining a surface shape is put into operation. In method step 3 following method step 2, an illumination line is generated. In particular, exactly one and no more than one illumination line can be generated. The illumination line can be generated as a temporally permanent or as a pulsed illumination line, with at least one illumination line pulse being generated.

[0028] Process step 3 can be followed by process step 4, in which an object whose surface shape is to be determined is illuminated with the illumination line. In the subsequent process step 5, the illumination line reflected by the object can be directed to a line sensor. If the illumination line is only partially reflected by the object, the portion of the illumination line reflected by the object can be directed to the line sensor.

[0029] In the following method step 6, the surface shape of at least the part of the object illuminated by the illumination line can be determined based on differences in the time of flight of different sections of the illumination line, which may be caused by different distances between sections of the object and the sensor line.

[0030] Between method step 5 and method step 6, at least one of method steps 7 and 8 can be additionally performed. In method step 7, the illumination line can be moved across the object at least once or even multiple times in order to scan a larger portion of the object's surface. For this purpose, a relative movement between the illumination device and the object can be used, for example. Alternatively, the illumination line can be guided across the object using an optical element, even if the illumination device remains stationary relative to the object.In method step 8, the object can be illuminated with the illumination line multiple times, for example, twice at different times with identical radiation angles—for example, the radiation angles at which the illumination light is emitted by the illumination device or the irradiation angles at which the illumination light strikes the object. For this purpose, the illumination line can be emitted in pulsed form, for example. Alternatively, the object can be illuminated successively with identical radiation angles at different times if the illumination line is passed over the object multiple times.

[0031] Following process step 7 or process step 8, the surface shape can be determined in process step 6. Process steps 7 and 8 can be performed individually, sequentially, or both in parallel.

[0032] Fig. Figure 2 schematically shows an embodiment of a determination device according to the invention. The determination device comprises an illumination device 10 with an illumination light source 11, for example a laser diode or another suitable light source. During operation of the illumination device 10, the illumination light source 11 emits illumination light along an optical axis, which is referred to below as illumination axis 12. An imaging device 13 can follow the illumination light source 11 along the illumination axis 12. With the aid of the imaging device 13, the illumination light emitted by the illumination light source 11 is converted into an illumination line 14. In the embodiment of the Fig. 2, the illumination line 14 would be located within the drawing plane and would therefore be represented as a point on the illumination axis 12.

[0033] However, to make the illumination line 14 more visible in the figure, it is shown in perspective as running perpendicular to the illumination axis. The imaging device 13 imprints angular information onto the illumination light, creating a linear focus shortly behind the imaging device 13. The illumination line is created by the angular information about the distance.

[0034] For example, to collimate the illumination light emitted by the illumination light source 11, for example a laser diode, optical elements can be arranged along the illumination axis 12 between the illumination light source 11 and the imaging device 13; however, these elements are not shown for the sake of simplicity. Furthermore, a light valve 15 can be provided along the illumination axis 12 between the illumination light source 11 and the imaging device 13. With the aid of the light valve 15, the illumination light emitted continuously by the illumination light source 11 can be converted into pulsed illumination light. If the illumination light source 11 itself is capable of emitting pulsed illumination light, the light valve 15 is not necessary.

[0035] An optical element 16 can be arranged along the illumination axis 12 behind the imaging device 13, which is designed to guide the illumination line into a detection area 17 of the determination device. The surface shape of an object 18 arranged in the detection area 17 can be scanned using the determination device. The optical element 16 can be a reflective optical element, for example a prism or a mirror. The optical element 16 can be mounted so that it can be tilted or pivoted about at least one axis in order to be able to pivot the illumination line 14 over the detection area 17. In order to be able to construct the illumination device in a compact manner, the optical element 16 can have a micromirror actuator, also called a microscanner or scanning micromirror. The micromirror actuator can have several rows of micromirrors and can be a so-called DMD (digital micromirror device).Alternatively, it may be sufficient if the optical element 16 has only one pivotable micromirror or a row of pivotable micromirrors, which further reduces the installation space required for the optical element 16.

[0036] A polarization-optical element 19, for example a λ / 4 plate, can be provided along the illumination axis 12 behind the imaging device 13. The polarization-optical element 19 can be arranged between the imaging device 13 and the illumination line 14, between the illumination line 14 and the optical element 16, or along the illumination axis 12 behind the optical element 16 and in front of the detection area 17. If the polarization-optical element 19 is arranged behind the optical element 16, the illumination line 14 can be formed very close to the optical element 16, so that the installation space required for the detection device along the illumination axis 12 is even smaller.

[0037] If the linear illumination light strikes the object 18 arranged in the detection area 17, the illumination light is at least partially scattered by the object 18 and reflected back to the determination device as measurement light along a measurement light axis 20. At least between the imaging device 13 and the detection area 17, the illumination axis 12 and the measurement light axis 20 can coincide, so that the illumination light propagates toward the detection area 17 and the measurement light propagates away from the detection area 17 along an identical path. The measurement light reflected by the object 18 in turn passes through the polarization-optical element 19 and is guided back to the imaging device 13 by the optical element 16.The multiple use of at least the optical element 16 and the polarization-optical element 19 enables an even more compact design of the illumination device 10, since no separate components are required to guide the reflected measuring light.

[0038] The measuring light can be guided to a sensor line of a line sensor 21 using an additional reflective optical element. However, to make the determination device even more compact, the determination device can have a beam splitter through which the illumination axis 12 and the measuring light axis 20 extend. The beam splitter can even be provided by the imaging device 13, so that the imaging device 13 not only forms the illumination line 14 but also guides the reflected measuring light to the line sensor 21. In the beam splitter, for example, in the imaging device 13, the measuring light axis 20 can be separated from the illumination axis 12. In particular, the beam splitter can be designed as a polarization beam splitter.

[0039] At least one additional optical element 22 can be provided along the measuring light axis 20 between the imaging device 13 and the line sensor 21, by means of which the reflected illumination light - i.e. the measuring light - is directed to the line sensor 21.

[0040] The line sensor 21 can have a sensor line 23 with several sensor elements 24.

[0041] For example, the line sensor 21 is a so-called time-of-flight sensor.

[0042] The determination device can have an evaluation unit 25 in which the surface shape of the object 18 is determined based on sensor signals from the line sensor 21. In particular, the surface shape is determined from time-of-flight differences of the measuring light reflected by the object 18. Different parts of the surface of the object 18 can be at different distances from the individual sensor elements 24 along the measuring light axis 20. If the illumination light reflected by the object 18 strikes different sensor elements 24 at different times, the surface shape can be determined in the evaluation unit 25 based on these time-of-flight differences. For this purpose, the evaluation unit 25 transmits signals and is connected to the line sensor 21, for example, by means of a signal conductor 26.Optionally, the evaluation unit 25 can be connected to the illumination light source 11 and / or the light valve 15 via a further signal conductor 27 in a signal-transmitting manner, wherein in the exemplary embodiment the . Fig. 2, the optional signal conductor 27 leads to the illumination light source 11. Times at which an illumination light pulse is emitted can be transmitted to the evaluation device 25 via the signal conductor 27. Thus, time-of-flight differences between the illumination light source 11 or the light valve 15 and the different parts of the surface of the object 18 can also be taken into account when determining the surface shape of the object 18.

[0043] The imaging device 13 has a collimation side 28 facing the illumination light source 11 along the measurement light axis 20, with which the illumination light emitted by the illumination source 11 is expanded. The collimation side 28 can be designed as a rotationally symmetrical, curved surface. On the side of the illumination device 13 opposite the collimation side 28, the illumination device 13 can have a line generation side 29. The line generation side 29 can be cylindrical and, for example, wedge-shaped in order to generate the illumination line 14. Between the collimation side 28 and the line generation side 29, the imaging device 13 can have an element, in particular the beam splitter 30, that reflects the illumination light and / or the measurement light reflected by the object 18.The beam splitter 30 may be a polarizing beam splitter that transmits the illumination light emitted by the illumination light source 11 and reflects the measurement light reflected by the object 18, which has a different polarity than the illumination light emitted by the illumination light source 11. Alternatively, the beam splitter 30 may reflect the illumination light emitted by the illumination light source 11 and transmit the measurement light reflected by the object 18.

[0044] The imaging device 13 can be designed in several parts and with a separate collimation optics, a separate beam splitter 30 and / or a separate line generation optics. In the embodiment of the Fig. 2, however, the imaging device 13 is shown as being handleable in one piece, wherein the beam splitter 30 can be arranged between two segments of the imaging device 13 and can be glued to them, for example. Reference symbol 1 procedure 2 Start 3 Create lighting line 4 Illuminate object with lighting line 5 Direct the measuring light reflected from the object to the line sensor 6 Determine surface shape 7 Move lighting line over object 8 Illuminate the object multiple times at identical beam angles 10 Lighting equipment 11 Illumination light source 12 lighting axis 13 Imaging device 14 lighting line 15 Light valve 16 optical element 17 Detection range 18 objects 19 polarization optical element 20 measuring light axis 21 Line sensor 22 optical element 23 Sensor line 24 Sensor element 25 Evaluation unit 26, 27 Signal conductor 28 Collimation side 29 Line generation page 30 beam splitters

Claims

[1] Determination device for determining a surface shape of an object (18), with an illumination device (10), wherein an illumination line (14) can be generated with the illumination device (10) and distance information can be determined via the illumination line (14), wherein the determination device comprises a sensor line (23) and an optical element (16), wherein the optical element (16) is designed to guide the illumination line (14) reflected by the object (18) arranged in the detection area (17) of the optical element (16) onto the sensor line (23), and wherein the sensor line (23) is a time-of-flight sensor, and wherein the optical element (16) is a mirror mounted so as to be tiltable or pivotable about at least one axis and directs the illumination line (14) to the detection area (17) and / or the illumination line (14) reflected by the object (18) to the sensor line (23), characterized by , that the illumination device (10) comprises an imaging device (13) forming the illumination line (14) with a collimation optics and a line generation optics, wherein a beam splitter (30) is arranged between the collimation optics and the line generation optics, and wherein the collimation optics form a one-piece, manageable component with the beam splitter (30), wherein a side of the component facing away from the detection area (17) along an illumination axis (12) of the illumination device (10) has a collimation side (28) forming the collimation optics, and / or the line-generating optics form a one-piece, manageable component with the beam splitter (30), wherein a side of the component facing the detection area (17) along an illumination axis (12) of the illumination device (10) has a line-generating side (29) providing the line-generating optics. [2] Determination device according to claim 1, characterized by that the optical element (16) is designed to guide the illumination line (14) to the detection area (17) and the illumination line (14) reflected by the object (18) arranged in the detection area (17) to the line sensor (21). [3] Determining device according to claim 1 or 2, characterized by that the illumination device (10) is arranged to emit pulsed illumination light. [4] Determination device according to one of claims 1 to 3, characterized by that the determination device has an evaluation unit (25) which is connected to at least the sensor line (23) in a signal-transmitting manner and is designed to determine the surface shape on the basis of propagation time differences of sections of the illumination line (14). [5] Determination device according to claim 1 characterized bythat the determining device is designed to guide the illumination line (14) scattered back from the object (18) arranged in the detection area (17) through the line generation optics, the beam splitter (30) and the optical element (22) onto the sensor line (23). [6] Determining device according to claim 1 or 5, characterized by that a polarization-optical element (19) is arranged between the imaging device (13) and the detection area (17). [7] Determination device according to one of claims 1 to 6, characterized by that the sensor line (23) is the sensor line of a line sensor.

Citation Information

Patent Citations

  • Optoelectronic device and method for acquiring object information

    DE102014104027A1

  • Scanning 3D image sensor

    DE112011101667T5

  • Efficient lidar with flexible target interrogation pattern

    US20060227317A1