Time of flight independent of object reflectivity

By illuminating with two power levels and correlating return times using a lookup table, the method addresses reflectance-induced inaccuracies in time-of-flight systems, ensuring accurate distance measurement.

JP7588489B2Active Publication Date: 2024-11-22SENSORS UNLIMITED INC
View PDF 7 Cites 0 Cited by

Patent Information

Application Number
JP2020161608
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Priority Date
2019-09-27
Filing Date
2020-09-28
Publication Date
2024-11-22
Estimated Expiration
2040-09-28

AI Technical Summary

Technical Problem

Existing time-of-flight depth sensing systems face inaccuracies in determining distance due to variations in object reflectance, causing objects with high reflectance to appear closer than those with low reflectance at the same distance.

Method used

Illuminating an object with two different power levels of illumination pulses and using a lookup table to correlate the return times of these pulses to determine distance independently of reflectance, employing a Gaussian time profile and sub-tables to calculate the actual travel time.

Benefits of technology

Enables accurate distance measurement to objects regardless of their reflectance by integrating return pulses at different power levels and using a lookup table to determine the actual travel time, thereby improving depth accuracy.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007588489000001
    Figure 0007588489000001
  • Figure 0007588489000002
    Figure 0007588489000002
  • Figure 0007588489000003
    Figure 0007588489000003
Patent Text Reader

Abstract

To provide an improved system and method for determining the time-of-flight.SOLUTION: A method comprises: illuminating 114 an object with a first illumination pulse at a first illumination power level; illuminating 116 the object with a second illumination pulse at a second illumination power level different from the first illumination power level; integrating 118 at least a portion of a first return pulse which is the first illumination pulse returning from the object to determine a first return time; integrating 120 at least a portion of a second return pulse which is the second illumination pulse returning from the object to determine a second return time; and determining 122 the distance to the object independently of reflectivity of the object by using the first and second return times.SELECTED DRAWING: Figure 2
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] (Statement regarding federally sponsored research or development) This invention was made with Government support under Contract No. 40010791 awarded by the "NIGHT VISION LAB AND ELECTRONIC SENSOR DIRECTORATE" (U.S. Army). The Government has certain rights in this invention.

[0002] The present disclosure relates to imaging, and more particularly to time-of-flight imaging, such as optical parallax range finder and LIDAR systems. [Background technology]

[0003] In luminescent time-of-flight (ToF) depth sensing applications, depth or distance information is calculated based on the travel time of a light pulse. When the realigned pulse is integrated and exceeds a threshold, the receiving pixel marks the receipt of the returned light. Objects with unknown reflectivity can significantly impair the depth accuracy of the system. Highly reflective objects appear closer than less reflective objects at the same distance. Summary of the Invention [Problem to be solved by the invention]

[0004] The prior art has been believed to meet its intended purposes. However, there is a continuing need for improved systems and methods for determining time-of-flight. The present disclosure provides a solution to this need. [Means for solving the problem]

[0005] The method includes illuminating the object with a first illumination pulse at a first illumination power level, illuminating the object with a second illumination pulse at a second illumination power level different from the first illumination power level, integrating at least a portion of the first illumination pulse returning from the object to determine a first return time, and integrating at least a portion of the second illumination pulse returning from the object to determine a second return time. The method includes using the first return time and the second return time to determine a distance to the object independent of a reflectivity of the object.

[0006] Determining the distance to the object using the time difference may include correlating the first return time and the second return time to the distance to the object using a look-up table (LUT), where the LUT may be limited to an operating space, such as an operating space ranging from 5 meters to 10 meters.

[0007] The second illumination power level may be 80% of the first illumination power level. The first illumination pulse and the second illumination pulse may each fit a Gaussian time profile. Using the LUT may include using two sub-tables, one for each pulse, each sub-table correlating each measured travel time to a predefined actual travel time, and using the LUT may include identifying a predefined actual travel time in each of the sub-tables that best matches each other, and the actual travel time may be used to calculate an actual distance to the object. The method may include updating a distance to the object by repeatedly illuminating the object with the first illumination source and the second illumination source, integrating the first return pulse and the second return pulse, determining a time difference, and determining a distance to the object.

[0008] The system includes an illuminator configured to illuminate a scene at two different levels of illumination power and a sensor to sense illumination from the illuminator. A controller is operatively connected to the illuminator and the sensor. The controller is configured to use the sensor and the illuminator at the two different levels of illumination power to gauge range to an object independent of the object's reflectance. The controller may include machine readable instructions configured to use the illuminator and the sensor to implement the methods disclosed above.

[0009] These and other features of the subject disclosed systems and methods will become more readily apparent to those skilled in the art from the following detailed description of the preferred embodiments taken in conjunction with the drawings.

[0010] So that those skilled in the art to which the subject disclosure pertains can readily understand, without undue experimentation, how to make and use the devices and methods of the subject disclosure, preferred embodiments thereof are described in detail herein below with reference to certain figures. [Brief description of the drawings]

[0011] [Figure 1] FIG. 1 is a schematic perspective view of an embodiment of a system structured in accordance with the present disclosure, showing an illuminator, a sensor, and a controller. [Diagram 2] FIG. 2 illustrates a method according to the present disclosure, showing a process using the system of FIG. 1. [Diagram 3] FIG. 3 illustrates in more detail the LUT procedure shown in FIG. 2. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0012] Reference is now made to the drawings, in which like reference numerals identify like structural features or aspects of the subject disclosure. For purposes of explanation and illustration, and not limitation, a partial view of an embodiment of a system according to the present disclosure is shown in FIG. 1 and generally designated by reference character 100. Other embodiments of systems or aspects thereof according to the present disclosure are provided in FIGS. 2-3 as illustrated. The systems and methods described herein can be used to measure distances to objects without relying on the reflectivity of the objects, such as with laser based ranging or LIDAR (Light Detection and Ranging).

[0013] The system 100 includes an illuminator 102 configured to illuminate a scene at two different levels of illumination power. A cone of light 106 in FIG. 2 illustrates illumination from the illuminator 102. The system 100 also includes a sensor 104 that senses illumination from the illuminator 102. As illustrated by the dashed line in FIG. 1, the sensor can detect a return of an illumination pulse from the illuminator 102 that is reflected from an object 110. The timing of the return of the reflected pulse is used to determine the range between the object 110 and the system 100. A controller 108 is operatively connected to the illuminator 102 and the sensor 104. The controller 108 is configured to use the sensor 104 and the illuminator 102 at two different levels of illumination power to gauge the range to the object 110 independent of the reflectivity of the object 110. The controller 108 may include machine-readable instructions configured to implement the methods disclosed herein using the illuminator 102 and the sensor 104.

[0014] 2, method 112 includes illuminating the object with a first illumination pulse at a first illumination power level, as indicated by box 114. Method 112 also includes illuminating the object with a second illumination pulse at a second illumination power level lower than the first illumination power level, as indicated by box 116 of FIG. 2, where it is noted that the pulses are represented as Gaussian time profile curves as a function of time, and the peak illumination power level of the second pulse (box 116) is 80% of the peak power level of the first pulse (box 114). One skilled in the art will readily recognize that any other suitable power ratio between the two pulses may be used without departing from the scope of the present disclosure.

[0015] The method 112 includes at least partially integrating a first return pulse, which is a first illumination pulse returning from the object, to determine a first return time, as indicated by the integration in box 118. A second illumination pulse, which is a return pulse returning from the object, can similarly be integrated (at least partially) to determine a second return time, as indicated in box 120. Each of these integrals may include integrating up to a predetermined threshold, for example, if the same threshold is used for both pulses. The method includes using the first return time and the second return time to determine a distance to the object, as indicated in box 122, independent of the reflectivity of the object.

[0016] Determining the distance to the object using the first and second return times may include correlating the first and second return times to the distance to the object using a look-up table (LUT) 124. The LUT 124 can provide an actual time 126 to the object (i.e., the time it would take for a pulse to return from the object if the object had 100% reflectivity). This actual time 126 can be used to calculate the actual distance to the object independent of the reflectivity of the object. The LUT 124 can be limited to an operating space, such as an operating space ranging from 5 meters to 10 meters, or any other suitable range for a given application.

[0017] 3, using a LUT may include using two sub-tables 128 and 130, one for each pulse. Each of the sub-tables 128, 130 correlates each measured travel time on the vertical axis with a predefined actual travel time, which is located along the horizontal axis. The sub-tables 128 and 130 may be generated for a Gaussian time profile using the following equation: Val = 1 + erf(B 0.5 (t i -Δt) where Val is t i is the subtable value for a given combination of (measured or recorded travel time) and Δt (actual travel time counted from the first start pulse centered at zero), where erf() refers to the Gaussian error function and B is given by the following equation, B=(4 ln(2)) / (w 2 ) where w is the full width at half maximum of a given Gaussian time profile. Using the equation for calculating Val above, the two-dimensional array is i This can be done at two different power levels to be used in the pulse, creating two sub-tables 128 and 130.

[0018] To use the two sub-tables 128, 130, the method 112 of FIG. 2 takes as input a first measured return time and a second measured return time. Each of the rows 132, 134 of the respective sub-tables 128, 130 (as indicated by the double-headed arrows in FIG. 3) is analyzed to determine the vertical position 136 along the row 132, 134 where the value of the table (Val from the above equation) is as close as possible to the two sub-tables 128, 130. The vertical position 136 from either the sub-table 128 or 130 is the actual time calculated for use in the distance measurement. Using the LUT 124 allows the controller 108 (shown in FIG. 1) to avoid having to perform an error function, thus saving computational expense. Those skilled in the art will readily recognize that other pulse shapes can be used without departing from the scope of the present disclosure, with the LUT 124 appropriately modified. The method may include updating the distance to the object, for example, by repeating the process shown in FIGS. 2-3. Those skilled in the art will readily recognize that LUT 124 and related processes can be used in imaging platforms where it is desirable to avoid requiring hardware to perform the erf error function, but that erfs can simply be used where hardware permits without departing from the scope of this disclosure.

[0019] As described above and shown in the drawings, the method and system of the present disclosure provide distance measurements that are not dependent on surface reflectance. Although the apparatus and method of the present subject disclosure have been shown and described with reference to preferred embodiments, those skilled in the art will readily recognize that changes and / or modifications may be made to the present embodiments without departing from the scope of the present subject disclosure.

Claims

1. Illuminating the object with a first illumination pulse at a first illumination power level; illuminating the object with a second illumination pulse at a second illumination power level lower than the first illumination power level; integrating at least a portion of the first illumination pulse returning from the object up to a predetermined threshold to determine a first return time; integrating at least a portion of the second illumination pulse returning from the object up to the predetermined threshold to determine a second return time; correlating the first return time and the second return time to a distance to the object in a look-up table (LUT); determining a distance to the object using the first return time and the second return time and the look-up table (LUT) independent of the reflectivity of the object; A method comprising:

2. The method of claim 1 , wherein the LUT is limited to a working space.

3. The method of claim 2 , wherein the LUT is limited to an operating space ranging from 5 meters to 10 meters.

4. The method of claim 1 , wherein the second illumination power level is 80% of the first illumination power level.

5. The method of claim 1 , wherein the first illumination pulse and the second illumination pulse each fit a Gaussian temporal profile.

6. 2. The method of claim 1, wherein using the LUT includes using two sub-tables, one for each pulse, each sub-table correlating a respective measured travel time to a predefined actual travel time, and using the LUT includes identifying a predefined actual travel time in each of the sub-tables that best matches each other, and the actual travel times can be used to calculate an actual distance to the object.

7. 2. The method of claim 1, further comprising: updating a distance to the object by repeatedly illuminating the object with a first illumination source and a second illumination source; integrating the first return pulse and the second return pulse; and determining a distance to the object.

8. an illuminator configured to illuminate the scene with two different levels of illumination power; a sensor for sensing illumination from the illuminator; a controller operatively connected to the illuminator and the sensor, the controller being configured to use the sensor and the illuminator at the two different levels of illumination power to gauge range to the object independent of object reflectivity; The controller includes machine-readable instructions that cause the controller to: using the illuminator to illuminate an object with a first illumination pulse at a first illumination power level; using the illuminator to illuminate the object with a second illumination pulse at a second illumination power level lower than the first illumination power level; using the sensor to integrate at least a portion of the first illumination pulse returning from the object, the first return pulse, up to a predetermined threshold to determine a first return time; using the sensor to integrate at least a portion of the second illumination pulse returning from the object up to the predetermined threshold to determine a second return time; correlating the first return time and the second return time to a distance to the object in a look-up table (LUT); and determining a distance to the object using the first return time and the second return time and the look-up table (LUT) independent of the reflectivity of the object.

9. The system of claim 8 , wherein the LUT is limited to a working space.

10. The system of claim 9 , wherein the LUT is limited to an operating space ranging from 5 meters to 10 meters.

11. The system of claim 8 , wherein the second lighting power level is 80% of the first lighting power level.

12. The system of claim 8 , wherein the first illumination pulse and the second illumination pulse each conform to a Gaussian temporal profile.

13. 9. The system of claim 8, wherein using the LUT includes using two sub-tables, one for each pulse, each sub-table correlating a respective measured travel time to a predefined actual travel time, and using the LUT includes identifying a predefined actual travel time in each of the sub-tables that best matches each other, and the actual travel time can be used to calculate an actual distance to the object.

Citation Information

Patent Citations

  • distance measuring device and method for determining a distance

    DE102014117097B3

  • distance measuring device

    JP1993087583U

  • Optical distance measuring equipment

    JP1994331744A

  • Correction device, correction method, and distance measuring device

    JP2017053833A

  • Displacement sensor

    JP2019082331A