Time-of-flight camera system with switchable diffuser

DE102020133599B4Active Publication Date: 2024-11-28IFM ELECTRONIC GMBH
View PDF 6 Cites 0 Cited by

Patent Information

Application Number
DE102020133599
Authority / Receiving Office
DE · DE
Patent Type
Patents
Current Assignee / Owner
Filing Date
2020-12-15
Publication Date
2024-11-28
Estimated Expiration
2040-12-15

Smart Images

  • Figure 00000000_0000_ABST
    Figure 00000000_0000_ABST
Patent Text Reader

Abstract

Time-of-flight camera system with an illumination module 10 for emitting intensity-modulated light and with a receiver unit (20) for receiving the emitted light and the light reflected from a scene, wherein the time-of-flight camera system is designed for distance determination based on a phase shift of the emitted and received light, wherein the illumination module (10) has a diffuser (18) with adjustable scattering behavior, so that the light of a light source (12) of the illumination module (10) can be emitted with different scattering angles, wherein the time-of-flight camera system is designed such that the scattering angle is automatically adjusted based on depth information of a detected scene.
Need to check novelty before this filing date? Find Prior Art

Description

[0001] The invention relates to a time-of-flight camera system according to claim 1.

[0002] Such time-of-flight camera systems particularly relate to all time-of-flight or 3D-TOF camera systems that obtain time-of-flight information from the phase shift of emitted and received radiation. PMD cameras with photonic mixer detectors (PMD), such as those described in DE 197 04 496 C2, are particularly suitable as time-of-flight or 3D-TOF cameras. The PMD camera allows, in particular, a flexible arrangement of the light source and detector, which can be arranged both in one housing or separately. Of course, the term "camera" or "camera system" also includes cameras or devices with at least one receiving pixel.

[0003] Furthermore, WO 2017 / 041 167 A1 discloses a liquid crystal beam former that provides different scattering angles by changing the applied voltage.

[0004] WO 2020 / 064 674 A1 also shows a time-of-flight camera system according to an indirect TOF principle, wherein the received light is imaged onto a detector device via a holographic or diffractive optical element or a diffuser in order, for example, to achieve a homogeneous light distribution.

[0005] WO 2021 / 022 379 A1 shows a LIDAR system for emitting intensity-modulated light, whereby the light can be emitted at different scattering angles.

[0006] DE 10 2019 216 666 A1 also deals with a LIDAR system in which the illumination of the scene is adapted to the field of view of the LIDAR sensor with the help of light signal shaping optics.

[0007] The object of the invention is to improve a time-of-flight camera system for use in different distance ranges.

[0008] The object is advantageously achieved by the time-of-flight camera system according to the invention of the independent claim.

[0009] The invention is explained in more detail below using exemplary embodiments with reference to the drawings.

[0010] They show schematically: Fig. 1 a time-of-flight camera system, Fig. 2 a modulated integration of photogenerated charge carriers, Fig. 3 a time-of-flight camera system according to the invention.

[0011] In the following description of the preferred embodiments, like reference numerals designate like or comparable components.

[0012] Fig. 1 shows a measuring situation for an optical distance measurement with a time-of-flight camera, as known, for example, from DE 197 04 496 A1.

[0013] The time-of-flight camera system 1 comprises a transmitting unit or an illumination module 10 with a light source 12 and an associated beam-shaping optics 15, as well as a receiving unit or time-of-flight camera 20 with a receiving optics 25 and a time-of-flight sensor 22.

[0014] The time-of-flight sensor 22 has at least one time-of-flight pixel, preferably also a pixel array, and is designed in particular as a PMD sensor. The receiving optics 25 typically consist of several optical elements to improve the imaging properties. The beam-shaping optics or light shaper 15 of the transmitting unit 10 can be designed, for example, as a reflector or lens optics.

[0015] The measuring principle of this arrangement is essentially based on the fact that, based on the phase shift of the emitted and received light, the transit time and thus the distance traveled by the received light can be determined. For this purpose, the light source 12 and the transit time sensor 22 are jointly modulated via a modulator 30 with a specific modulation signal M o with a base phase position φ0. In the example shown, a phase shifter 35 is also provided between the modulator 30 and the light source 12, with which the base phase φ0 of the modulation signal M0 of the light source 12 can be shifted by defined phase positions φ var For typical phase measurements, phase positions of φ var = 0°, 90°, 180°, 270°.

[0016] According to the set modulation signal, the light source 12 sends an intensity-modulated signal S p1with the first phase position p1 or p1 = φ0 + φ var This signal S p1 or the electromagnetic radiation is reflected by an object 40 in the case shown and, due to the distance travelled, arrives with a phase shift Δφ(t L ) with a second phase position p2 = φ0 + φ var + Δφ(t L ) as received signal S p2 to the time-of-flight sensor 22. In the time-of-flight sensor 22, the modulation signal M0 is combined with the received signal S p2 mixed, whereby the phase shift or the object distance d is determined from the resulting signal.

[0017] Infrared light-emitting diodes / VCSELs are preferably suitable as light sources 12. Of course, other radiation sources, particularly those in other frequency ranges, are also conceivable; in particular, light sources in the visible frequency range are also considered.

[0018] The basic principle of phase measurement is shown schematically in Fig. 2. The upper curve shows the time course of the modulation signal M0 with which the light source 12 and the time-of-flight sensor 22 are controlled. The light reflected by the object 40 arrives as the received signal S p2 according to its light travel time t L phase shifted Δφ(t L ) to the time-of-flight sensor 22. The time-of-flight sensor 22 collects the photonically generated charges q over several modulation periods in the phase position of the modulation signal M0 in a first accumulation gate Ga and in a phase position M0 + 180° shifted by 180° in a second accumulation gate Gb. From the ratio of the charges qa, qb collected in the first and second gates Ga, Gb, the phase shift Δφ(t L ) and thus determine a distance d of the object.

[0019] According to the invention, as in Fig.3, a switchable diffuser 18 for a dynamic illumination control of a time-of-flight camera or time-of-flight camera system is proposed.

[0020] To illuminate a scene for an active 3D measurement method, LEDs or VCSELs are typically used as light sources 12. CPCs are usually used as light shapers 15 for LEDs and DOEs for VCSELs.

[0021] The light distribution in the scene directly influences the sensitivity and range of the measurement. Depending on the application, different illumination levels are required. If there are many possible applications, the choice of illumination is a compromise. Desirable illumination levels depending on the measurement distance and application would be: a) Close-range illumination: uniform illumination, distributed over the largest possible angular range (at short distances there is more than enough signal, overexposure is a bigger problem). b) Medium distance: homogeneous illumination in the angular range. c) Center-centered far field: Only an inner area is illuminated to allow maximum range in the center.

[0022] To enable this, a switchable diffuser 18 is proposed, which is connected downstream of the light source 12 and the beam-shaping optics 15. According to the invention, the diffuser 18 is controlled and constructed in such a way that a scattering angle can be adjusted from non-scattering to scattering in the entire half-space (2π).

[0023] For example, it would be possible to illuminate a long-distance area according to variant c) with the diffuser deactivated, so that the complete optical power is emitted in a small angular range.

[0024] For near-field illumination according to variant a), the diffuser 18 is activated to its maximum so that the emitted light preferably illuminates the entire half-space (2π).

[0025] Depending on requirements, intermediate settings can also be set for the medium-distance range. In particular, the diffuser's dispersion can be adjusted to the camera's field of view (FOV). Depending on the design, this can be combined with a second engineered diffuser, which provides basic illumination and allows for adjustment / smearing by switching on a diffuser.

[0026] The main advantage is the redistribution of light by the switchable diffuser 18, which requires no mechanically moving parts. This redistribution also improves the light output, so that only a small amount of optical power is lost as useful light. The redistribution or the scattering angle of the diffuser 18 can be adjusted statically or dynamically using software. This can, for example, be controlled dynamically depending on a detected scene or statically predefined for a specific application.

[0027] Such a diffuser 18 is advantageously designed as an electrically switchable liquid crystal diffuser. Liquid crystals are typically long-chain polar molecules that align in an electric field. Depending on the applied voltage, the properties of the liquid crystals can be changed. In particular, the phase and diffusion properties of the liquid crystal arrangement can be changed. The effect of the liquid crystal typically correlates with the order or orientation of the liquid crystal molecules.

[0028] In a further embodiment, several light sources 12 and / or additional lighting modules 10 can be provided, each having its own diffusers 18. Such an arrangement allows for individual adjustment of the scattering angles of the individual light sources 12 and thus also for individual adjustment of the light profile or scattering angle profile emitted by the light sources 12 as a whole. List of reference symbols 1 time-of-flight camera system 10 lighting module 12 Lighting 15 light shapers, 18 switchable diffuser 20 receivers, time-of-flight camera 22 Light transit time sensor 30 Modulator 35 phase shifters, lighting phase shifters 40 objects φ, Δφ(t L ) runtime-related phase shift φ var Phase position φ0 base phase M0 modulation signal p1 first phase p2 second phase Sp1 transmit signal with first phase Sp2 Receive signal with second phase

Claims

[1] Time-of-flight camera system with an illumination module 10 for emitting an intensity-modulated light and with a receiving unit (20) for receiving the light emitted and reflected from a scenery, wherein the time-of-flight camera system is designed to determine distances based on a phase shift of the emitted and received light, wherein the illumination module (10) has a diffuser (18) whose scattering behavior can be adjusted so that the light of a light source (12) of the illumination module (10) can be emitted with different scattering angles, wherein the time-of-flight camera system is designed such that the scattering angle is automatically set based on depth information of a detected scenery. [2] Time-of-flight camera system according to claim 1, wherein the scattering angle of the diffuser is set to a maximum for a near range and a minimum for a far range. [3] Time-of-flight camera system according to one of the preceding claims, in which the light source (12) has beam-shaping optics (15). [4] Time-of-flight camera system according to one of the preceding claims, comprising a plurality of light sources (12), each light source (12) having its own diffuser (18) which can be controlled individually. [5] Time-of-flight camera system according to one of the preceding claims, which is designed such that different beam or scattering angle profiles can be set by individually controlling the diffusers (18).

Citation Information

Patent Citations

  • Method and device for determining the phase and / or amplitude information of an electromagnetic wave

    DE19704496A1

  • Method and device for determining the phase and / or amplitude information of an electromagnetic wave

    DE19704496C2

  • LiDAR sensor, especially high-way pilot sensor

    DE102019216666A1

  • Liquid crystal beam control device and manufacture

    WO2017041167A1

  • Sensor assembly for detecting an environment of a device, method for operating a sensor assembly for detecting an environment of a device, and device having the sensor assembly

    WO2020064674A1