Distance measuring device
By emitting pulsed light multiple times and analyzing reflected light intensity, the device improves accuracy in distance measurements by distinguishing between valid reflections and noise, effectively addressing clutter and flare issues.
Patent Information
- Application Number
- JP2021043155
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Priority Date
- 2020-03-24
- Filing Date
- 2021-03-17
- Publication Date
- 2024-11-06
- Estimated Expiration
- 2041-03-17
AI Technical Summary
Distance measuring devices face accuracy issues due to reflected light from windows and high-reflectance objects, which can cause clutter and flare, leading to incorrect distance measurements.
The device emits pulsed light multiple times, receives and analyzes reflected light intensity, and calculates distance using peak detection and signal-to-noise ratio to distinguish between valid and noise reflections, thereby improving measurement accuracy.
This approach enhances the accuracy of distance measurements by suppressing the impact of clutter and flare, allowing for precise detection of objects near and far from the device.
Smart Images

Figure 0007578031000001 
Figure 0007578031000002 
Figure 0007578031000003
Abstract
Description
[Technical field]
[0001] The present disclosure relates to a distance measuring device. [Background technology]
[0002] Distance measuring devices are known that detect the presence or absence of an object and measure the distance to the object by emitting pulsed light such as laser light from an emitting unit, detecting the reflected light from the object with a light receiving unit, and measuring the time of flight (TOF) of the light from irradiation to reception (see Patent Document 1 below). Distance measuring devices emit pulsed light in various directions (bearings) and measure the time of flight of the reflected light, measure the distance to the object, and generate a distance image consisting of the position and distance of the object. Such distance images are used, for example, to detect the position and speed of obstacles during automatic driving of a vehicle. [Prior art documents] [Patent documents]
[0003] [Patent Document 1] JP 2016-176721 A Summary of the Invention [Problem to be solved by the invention]
[0004] In general, in a distance measuring device, the emission of pulsed light and the reception of reflected light are performed through a window having the transparency of the light. The pulsed light is also partially reflected by the window, and the reflected light is received by the light receiving unit. Therefore, when the reflected light from an object located near the distance measuring device and the reflected light from the window (so-called clutter) are received after the emission of the pulsed light, the flight times of these lights are close to each other, and the measurement accuracy of the distance to the object may decrease. Such a problem may also occur due to factors other than clutter. Specifically, when the object has a part with high reflectance, the intensity of the reflected light from the part is very large, so that reflected light with a higher intensity than the actual reflection, so-called flare, may be measured at a position near the part. In such a case, the distance to the object at the position corresponding to the flare may be erroneously measured. For this reason, a technology capable of suppressing the decrease in measurement accuracy caused by reflected light (noise) different from the expected reflected light such as clutter and flare is desired. [Means for solving the problem]
[0005] As one aspect of the present disclosure, a distance measuring device (10, 10a) is provided. The distance measuring device includes a light emitting unit (40) that emits pulsed light, the light emitting unit emitting the pulsed light a plurality of times in each emission direction, a light receiving unit (60) that receives reflected light of the pulsed light, a calculation unit (200) that uses the flight time of the reflected light received by the light receiving unit to calculate a measurement target distance, which is the distance to a reflecting object (OBJ) that reflects the pulsed light and outputs the reflected light, and Departureand a control unit (270) that controls at least one of the intensity of the pulsed light emitted from the light unit, the light receiving sensitivity of the reflected light in the light receiving unit, and the position of a region of interest (ROI1, ROI2) in which the light receiving intensity is specified in the light receiving unit. The calculation unit has a received light intensity specifying unit (210) that specifies each received light intensity at a plurality of times of flight, a peak detection unit (240) that detects a peak time of flight among the received light intensities at each of the plurality of times of flight, a distance calculation unit (250) that calculates a distance from the detected peak time of flight, and a distance specification unit (510) that specifies the measurement target distance using the distance calculated by the distance calculation unit. At least one of the intensity of the pulsed light emitted from the light emitting unit and the light receiving sensitivity of the reflected light in the light receiving unit is controlled so that a first received light intensity is specified by the received light intensity specifying unit as each of the received light intensities in the multiple flight times at least once among the multiple emission times, and a second received light intensity having a higher S / N ratio than the first received light intensity is specified by the received light intensity specifying unit as each of the received light intensities in the multiple flight times at least once among the multiple emission times, and the distance specifying unit specifies the measurement target distance using a first distance, which is the distance calculated based on the first received light intensity, and a second distance, which is the distance calculated based on the second received light intensity. do.
[0006] According to the distance measuring device of this embodiment, the first light receiving intensity is specified by the light receiving intensity specifying unit as the light receiving intensity in each of the multiple flight times at least once among the multiple emission times, and the second light receiving intensity with a higher SN ratio than the first light receiving intensity is specified by the light receiving intensity specifying unit as the light receiving intensity in each of the multiple flight times at least once among the multiple emission times, and further, the measurement target distance is specified using the first distance calculated based on the first light receiving intensity and the second distance calculated based on the second light receiving intensity, so that it is possible to suppress a decrease in measurement accuracy caused by reflected light (noise) different from expected reflected light such as clutter and flare. In general, clutter is detected as light with a lower intensity than reflected light from a reflecting object (object), and reflected light from a part present in a range hidden by flare can be detected as light with a lower intensity than reflected light from a part with high reflectivity in a situation where a light receiving intensity (second light receiving intensity) with a low SN ratio is specified. Therefore, a distance that does not include noise such as clutter or flare can be generated as the first distance, and a decrease in accuracy of the measurement target distance determined using the first distance and the second distance can be suppressed. [Brief description of the drawings]
[0007] [Figure 1] 1 is a schematic configuration diagram of a distance measuring device according to an embodiment of the present disclosure. [Diagram 2] FIG. 2 is an explanatory diagram illustrating a schematic configuration of a light receiving array. [Diagram 3] FIG. 1 is a circuit diagram showing a schematic configuration of a SPAD circuit. [Figure 4] FIG. 2 is a block diagram showing the functional configuration of the distance measuring device according to the first embodiment. [Diagram 5] 5 is a flowchart showing the procedure of distance measurement processing according to the first embodiment. [Figure 6] FIG. 4 is an explanatory diagram showing an example of a change in a histogram in the first embodiment. [Figure 7] FIG. 4 is an explanatory diagram showing an example of a change in a histogram in the first embodiment. [Figure 8] 5 is a flowchart showing the procedure of distance image generation processing according to the first embodiment. [Figure 9]FIG. 4 is an explanatory diagram illustrating a process of generating an integrated range image. [Figure 10] 10 is a flowchart showing the procedure of distance measurement processing according to a second embodiment. [Figure 11] FIG. 11 is an explanatory diagram showing an example of a change in a histogram in the second embodiment. [Figure 12] FIG. 11 is an explanatory diagram showing an example of a change in a histogram in the second embodiment. [Figure 13] FIG. 11 is a block diagram showing the functional configuration of a distance measuring device according to a second embodiment. [Figure 14] 13 is a flowchart showing the procedure of distance measurement processing according to a third embodiment. [Figure 15] 13 is a flowchart showing the procedure of distance image generation processing according to the fourth embodiment. [Figure 16] FIG. 1 is an explanatory diagram showing an example of an image in which flare occurs. [Figure 17] FIG. 13 is an explanatory diagram showing an example of a change in a histogram in the fourth embodiment. [Figure 18] FIG. 13 is an explanatory diagram showing an example of a change in a histogram in the fourth embodiment. [Figure 19] FIG. 13 is an explanatory diagram showing a first distance image in the fourth embodiment. [Figure 20] FIG. 13 is an explanatory diagram illustrating a schematic configuration of a light receiving array according to a fifth embodiment. [Figure 21] 13 is a flowchart showing the procedure of distance measurement processing according to the fifth embodiment. [Figure 22] 13 is a flowchart showing the procedure of distance measurement processing according to the sixth embodiment. [Diagram 23] FIG. 23 is an explanatory diagram showing an example of a change in a histogram for a high reflection direction in the sixth embodiment. [Figure 24] FIG. 23 is an explanatory diagram illustrating a schematic view of how an integrated distance image is generated in the seventh embodiment. [Diagram 25] 23 is a flowchart showing a detailed procedure of step S225 in the seventh embodiment. [Figure 26] FIG. 13 is a schematic configuration diagram of a distance measuring device according to an eighth embodiment. [Figure 27] FIG. 13 is a block diagram showing an example of a connection configuration between a light-emitting element and a drive circuit in another embodiment. [Figure 28] FIG. 13 is a block diagram showing an example of a connection configuration between a light-emitting element and a drive circuit in another embodiment. [Figure 29] FIG. 13 is a block diagram showing an example of a connection configuration between a light-emitting element and a drive circuit in another embodiment. [Diagram 30] FIG. 13 is a block diagram showing an example of a connection configuration between a light-emitting element and a drive circuit in another embodiment. [Diagram 31] FIG. 11 is an explanatory diagram illustrating a configuration of a light receiving array according to another embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0008] A. First embodiment: A1. Equipment configuration: The distance measuring device 10 shown in FIG. 1 includes an optical system 30 that emits pulsed light for distance measurement and receives reflected light from an external object, a calculation and determination unit 20 that processes a signal obtained from the optical system 30, and an ECU 500. The external object is also called a "reflecting object." The optical system 30 includes a light emitting unit 40 that emits a laser beam as a pulsed light, a scanning unit 50 that scans the laser beam within a predetermined field of view 80, and a light receiving unit 60 that receives incident light including reflected light from an external object and disturbance light. The distance measuring device 10 is housed in a case 90 having a window 92 on the front. The window 92 transmits most of the pulsed light emitted from the light emitting unit 40 and reflects a part of it.
[0009] The distance measuring device 10 is, for example, an in-vehicle LiDAR (Laser Imaging Detection and Ranging) mounted on a vehicle such as an automobile. When the vehicle is traveling on a horizontal road surface, the horizontal direction of the field of view 80 coincides with the horizontal direction X, and the vertical direction coincides with the vertical direction Y.
[0010] The light emitting unit 40 includes a semiconductor laser element (hereinafter also simply referred to as a laser element) 41 that emits laser light including pulsed light, a circuit board 43 incorporating a drive circuit for the laser element 41, and a collimator lens 45 that converts the laser light emitted from the laser element 41 into parallel light. The laser element 41 is a laser diode capable of oscillating a so-called short pulse laser. In this embodiment, the laser element 41 forms a rectangular laser emission region by arranging a plurality of laser diodes along the vertical direction. The intensity of the laser light output by the laser element 41 is configured to be adjustable according to the voltage supplied to the laser element 41.
[0011] The scanning unit 50 is configured by a so-called one-dimensional scanner. The scanning unit 50 is configured by a mirror 54, a rotary solenoid 58, and a rotating unit 56. The mirror 54 reflects the laser light that has been collimated by the collimating lens 45. The rotary solenoid 58 receives a control signal from the calculation and judgment unit 20 and repeats normal and reverse rotation within a predetermined angle range. The rotating unit 56 is driven by the rotary solenoid 58 and repeats normal and reverse rotation on a rotation axis whose axial direction is the vertical direction, causing the mirror 54 to scan in one direction along the horizontal direction. The laser light emitted from the laser element 41 through the collimating lens 45 is reflected by the mirror 54 and scanned along the horizontal direction by the rotation of the mirror 54. The field of view 80 shown in FIG. 1 corresponds to the entire scanning range of this laser light. Since the received light intensity is obtained at each pixel position within the field of view 80, the distribution of the received light intensity within the field of view 80 constitutes a kind of image. Therefore, the field of view 80 can also be called an "image area." In this embodiment, the pulsed light is irradiated four times onto each position within the scanning range, in other words, onto each pixel position within the field of view 80. When the pulsed light is irradiated four times, the laser light is scanned and the irradiation position of the laser light moves to an adjacent pixel position within the field of view 80. Then, the pulsed light is irradiated four times onto that position. Note that the scanning unit 50 may be omitted and the pulsed light may be emitted from the light-emitting unit 40 over the entire field of view 80 and the reflected light may be received by the light-receiving unit 60 over the entire field of view 80.
[0012] When an external object (reflecting object) such as a person or a car is present, the laser light output from the light-emitting unit 40 is diffusely reflected by the surface of the object, and a part of the reflected light returns to the mirror 54 of the scanning unit 50. This reflected light is reflected by the mirror 54 and enters the light-receiving lens 61 of the light-receiving unit 60 as incident light together with the external light, and is collected by the light-receiving lens 61 and enters the light-receiving array 65. The laser light output from the distance measuring device 10 is diffusely reflected not only by external objects but also by objects inside the distance measuring device 10, such as a window 92, and a part of the reflected light enters the light-receiving array 65.
[0013] As shown in FIG. 2, the light receiving array 65 is composed of a plurality of pixels 66 arranged two-dimensionally. Each pixel 66 is composed of a plurality of SPAD (Single Photon Avalanche Diode) circuits 68 arranged so that H pixels are arranged in the horizontal direction and V pixels are arranged in the vertical direction. H and V are each an integer of 1 or more. In this embodiment, H=V=5, and five SPAD circuits 68 are arranged in each of the horizontal and vertical directions. However, the pixel 66 can be composed of any number of SPAD circuits 68, and the pixel 66 may be composed of one SPAD circuit 68. The light receiving result of one pixel 66 is the light receiving intensity at one pixel position within the field of view range 80.
[0014] As shown in FIG. 3, the SPAD circuit 68 connects an avalanche diode Da and a quench resistor Rq in series between a power supply Vcc and a ground line, and inputs the voltage at the connection point to an inverting element INV, which is one of the logic operation elements, and converts it into a digital signal with an inverted voltage level. The output signal Sout of the inverting element INV is output directly to the outside. In this embodiment, the quench resistor Rq is configured as a FET, and when the selection signal SC is active, its on-resistance functions as the quench resistor Rq. When the selection signal SC becomes inactive, the quench resistor Rq becomes in a high impedance state, so that even if light is incident on the avalanche diode Da, no quench current flows, and as a result, the SPAD circuit 68 does not operate. The selection signal SC is output collectively to the 5×5 SPAD circuits 68 in the pixel 66, and is used to specify whether or not to read out a signal from each pixel 66. In this embodiment, the avalanche diode Da is operated in the Geiger mode, but the avalanche diode Da may be used in the linear mode and its output may be treated as an analog signal. Also, a PIN photodiode may be used instead of the avalanche diode Da.
[0015] If no light is incident on the SPAD circuit 68, the avalanche diode Da is kept in a non-conducting state. Therefore, the input side of the inverting element INV is pulled up through the quench resistor Rq, that is, kept at a high level H. Therefore, the output of the inverting element INV is kept at a low level L. When light is incident on each SPAD circuit 68 from the outside, the avalanche diode Da is turned on by the incident light (photons). As a result, a large current flows through the quench resistor Rq, the input side of the inverting element INV temporarily becomes a low level L, and the output of the inverting element INV is inverted to a high level H. As a result of the large current flowing through the quench resistor Rq, the voltage applied to the avalanche diode Da decreases, so the power supply to the avalanche diode Da stops and the avalanche diode Da returns to a non-conducting state. As a result, the output signal of the inverting element INV is also inverted and returns to a low level L. As a result, when light (photons) is incident on each SPAD circuit 68, the inverting element INV outputs a pulse signal that is at a high level for a very short time. Therefore, if the selection signal SC is set to a high level H in accordance with the timing at which each SPAD circuit 68 receives light, the output signal of the inverting element INV, that is, the output signal Sout from each SPAD circuit 68, becomes a digital signal that reflects the state of the avalanche diode Da. This output signal Sout corresponds to a pulse signal generated by receiving incident light including reflected light that is irradiated light reflected and returned by external objects or windows 92 present in the scanning range and incident light including disturbance light.
[0016] As shown in FIG. 4, the calculation / determination unit 20 includes a calculation unit 200, a memory 260, a first distance image memory 261, a second distance image memory 262, and a control unit 270. The calculation unit 200 uses the flight time of the reflected light received by the light receiving unit 60 to calculate the distance to a reflecting object that reflects the pulsed light and outputs the reflected light. The outline of the method of calculating the distance is as follows. As shown in FIG. 4, the pulsed light P1 emitted from the light emitting unit 40 is reflected by a reflecting object OBJ, which is an external object. In other words, the reflecting object OBJ outputs a reflected light P2 of the pulsed light P1. The pulsed light P1 is also reflected by the inner surface of the window 92, and a reflected light P3 is output. As a result, the reflected lights P2 and P3 reach the light receiving unit 60. At this time, the time from the emission of the pulsed light P1 to the reception of the reflected lights P2 and P3 is specified as the flight time Tf of light. The calculation section 200 uses this time of flight Tf to calculate the distance from the distance measuring device 10 (the light emitting section 40 and the light receiving section 60) to the reflecting object OJB.
[0017] The calculation section 200 includes a received light intensity specifying section 210 , a peak detecting section 240 , and a distance calculation section 250 .
[0018] The light receiving intensity specifying unit 210 specifies the light receiving intensity at each of the light receiving units 60 at a plurality of flight times. In addition to the reflected light of the pulsed light emitted from the light emitting unit 40, the light receiving unit 60 receives various disturbance light such as sunlight, reflected light of sunlight on an external object, and light from a street lamp. The timing at which these disturbance lights are received varies, and they are detected as different flight times. For this reason, the light receiving intensity is specified for each of the plurality of flight times. The light receiving intensity specifying unit 210 includes an adder 220 and a histogram generator 230.
[0019] The adder 220 adds the outputs of the SPAD circuits 68 included in the pixels 66 constituting the light receiving array 65. When an incident light pulse is incident on one pixel 66, the SPAD circuit 68 included in the pixel 66 operates. The SPAD circuit 68 is capable of detecting only one incident photon. However, the detection of the limited light output from the reflecting object OBJ in the SPAD circuit 68 is inevitably probabilistic. Therefore, the adder 220 is configured to more reliably detect the reflected light from the reflecting object OBJ in each pixel 66 by adding the output signals Sout from the SPAD circuits 68 that can only detect light that is incident probabilistically, for all the SPAD circuits 68 included in each pixel 66.
[0020] The histogram generating unit 230 generates a histogram of the light receiving intensity by acquiring the addition result of the adding unit 220 in a time series manner, stores it in the memory 260, and outputs it to the peak detecting unit 240. As described later, the histogram generating unit 230 generates a new histogram by integrating the newly generated histogram with the histogram already stored in the memory 260. The histogram generated by the histogram generating unit 230 can be said to be a graph representing the light receiving intensity at each of a plurality of flight times. The light receiving intensity is the total number of SPAD circuits 68 that have received light in one pixel 66. The plurality of flight times are set at regular time intervals. As described above, the light emitting unit 40 emits pulsed light four times in succession. When the histogram generating unit 230 generates a histogram representing the light receiving intensity within a predetermined time including the flight time of the first pulse, the memory 260 is cleared by the control unit 270. Thereafter, when a histogram showing the reception intensity within a predetermined time including the flight times of the second to fourth pulsed light is generated and integrated, the memory 260 is cleared by the control unit 270. Details of the integration and storage of the histogram and clearing of the memory 260 will be described later.
[0021] The peak detection unit 240 detects the time of flight of a peak in the histogram generated by the histogram generation unit 230. Specifically, the peak detection unit 240 analyzes the received light intensity of the histogram input from the histogram generation unit 230, detects a peak in the received light intensity, and determines the time of flight of the detected peak. The time of flight of the detected peak corresponds to the time of flight Tf of light reflected by the reflecting object OBJ, the window 92, etc.
[0022] The distance calculation unit 250 calculates the distance to the reflecting object OBJ from the time of flight Tf of the light identified by the peak detection unit 240.
[0023] Memory 260 is used to generate and integrate a histogram of received light intensity, which will be described later. First distance image memory 261 stores the distance to a reflecting object OBJ for each pixel, which is calculated in step S135 of a distance measurement process, which will be described later. Second distance image memory 262 stores the distance to a reflecting object OBJ for each pixel, which is calculated in step S170 of a distance measurement process, which will be described later.
[0024] The control unit 270 controls the entire distance measuring device 10. For example, the control unit 270 controls the intensity of the pulsed light by controlling the voltage supplied to the laser element 41 of the light emitting unit 40. In addition, for example, the control unit 270 clears the memory 260.
[0025] The ECU 500 includes an MPU (Micro Processor Unit) and a memory. By executing a control program stored in advance in the memory, the MPU functions as a distance determination unit 510 and a distance image generation unit 520. The distance image generation unit 520 uses the distance calculated by the distance calculation unit 250 to determine the distance to the reflecting object OBJ at each pixel (hereinafter referred to as the "measurement target distance"). The distance image generation unit 520 uses the measurement target distance determined by the distance determination unit 510 to generate an image indicating the measurement target distance at each pixel (hereinafter referred to as the "distance image"). The position of each pixel means the position (direction) of the reflecting object as seen from the distance measuring device 10. Therefore, the distance image can be said to be an image representing the position of the reflecting object OBJ and the distance to the reflecting object OBJ. The distance image generation unit 520 combines two distance images to generate one distance image (integrated distance image) in a distance image generation process described later. The integrated distance image generated in this manner is used, for example, in a configuration in which the distance measuring device 10 is installed in an autonomous vehicle, to detect obstacles around the vehicle and to perform driving control to avoid detected obstacles.
[0026] As described above, the light reflected from the window 92 (clutter) is incident on the light receiving unit 60 in the same manner as the light reflected from the reflecting object OBJ. For this reason, generally, such clutter may cause an error in measuring the distance to a reflecting object OBJ located close to the distance measuring device 10. However, by executing a distance measuring process and a distance image generating process described below, the distance measuring device 10 can accurately calculate the distance to a reflecting object OBJ located close to the distance measuring device 10 (measurement target distance) while suppressing the effects of clutter, and generate a highly accurate integrated distance image.
[0027] A2.Distance measurement processing: 5 means a process for calculating the distance (measurement target distance) from the distance measuring device 10 to a reflecting object OBJ. When the electronic eye of the distance measuring device 10 is turned on, the distance measuring process is executed. Then, this distance measuring process is executed for each pixel position.
[0028] The control unit 270 clears the memory 260 (step S105). The histogram generation unit 230 accumulates the histogram (step S110). When step S110 is executed for the first time after the memory 260 is cleared, the light-emitting unit 40 has not yet emitted the pulsed light, and the light-receiving unit 60 has not yet received the reflected light, so no histogram is generated. Therefore, in this case, no histogram is accumulated in the memory 260.
[0029] The control unit 270 determines the number of integrations n (step S115). In this embodiment, the number of integrations n means the number of integrations (how many times) when integrating a histogram that will be obtained by emitting pulsed light and receiving reflected light. When step S115 is executed for the first time after step S105 is executed, the number of integrations n is 1. As described above, pulsed light is emitted four times in succession at a predetermined time interval at each pixel position. Then, as described later, the histogram is integrated each time (step S110).
[0030] If it is determined that the number of integration times is the first time, the control unit 270 controls the light emitting unit 40 to emit a pulsed light with a low intensity (hereinafter referred to as "first pulsed light") and causes the light receiving unit 60 to receive the light within a predetermined time including the expected flight time of the pulsed light (step S120). The intensity of the first pulsed light is set in advance by experiments or the like so that the intensity is such that the reflected light (clutter) generated by the first pulsed light being reflected by the window 92 does not operate more than a predetermined number of the SPAD circuits 68 constituting each pixel 66, while the reflected light from a reflecting object of an external object operates more than the predetermined number of the SPAD circuits 68 constituting the pixel 66, and the intensity is equal to or greater than the predetermined received light intensity. Since this first pulse light is set to a small intensity such that clutter cannot be detected by the light receiving unit 60, only reflected light from reflecting objects located within a threshold distance from the distance measuring device 10 is received and detected, while reflected light from reflecting objects located at a distance from the distance measuring device 10 that is longer than the threshold distance cannot be received and detected.
[0031] When the light receiving unit 60 receives the reflected light, the adder 220 adds the outputs of the SPAD circuits 68 included in each pixel 66, and the histogram generating unit 230 generates a histogram for each pixel and stores it in the memory 260, while outputting it to the peak detecting unit 240 (step S125). Note that in this embodiment, storing the histogram corresponding to the first pulsed light in the memory 260 is referred to as accumulating the first histogram. In this embodiment, this first histogram (received light intensity for each flight time) corresponds to the first received light intensity in this disclosure.
[0032] Peak detection unit 240 detects a peak in the input histogram and identifies its time of flight (step S130). Distance calculation unit 250 calculates the distance based on the time of flight of the peak identified in step S130 (step S135). The calculated distance is stored in first distance image memory 261 in association with each pixel position. After completion of step S135, the process returns to step S105. Therefore, in this case, the first histogram data stored in memory 260 is erased by step S105.
[0033] When step S110 is executed for the second time after the start of the distance measurement process, the data of the first histogram is erased, so that the histogram is not integrated. In step S115 executed thereafter, the number of integrations is determined to be 2. In this case, the control unit 270 controls the light emitting unit 40 to emit a pulsed light with a high intensity (hereinafter referred to as "second pulsed light"), and causes the light receiving unit 60 to receive the light within a predetermined time including the expected flight time of the pulsed light (step S140). The intensity of the second pulsed light is determined in advance by experiments or the like as an intensity that operates a predetermined number or more of the SPAD circuits 68 constituting each pixel 66 by the reflected light from a reflecting object (external object) existing within a predetermined distance from the distance measuring device 10, and is equal to or greater than a predetermined received light intensity. The "predetermined distance" is greater than the "threshold distance" previously described for the first pulsed light. This second pulsed light is reflected by both an external object present within a predetermined distance and the window 92 , and is received and detected by the light receiving unit 60 .
[0034] After completion of step S140, the adder 220 adds the output of the SPAD circuit 68 included in each pixel 66, and the histogram generator 230 generates a histogram for each pixel (step S145). After completion of step S145, the process returns to step S110. Therefore, in this case, in step S110, the histogram generated in step S145 is integrated and stored in the memory 260. In step S115 executed thereafter, it is determined that the number of integrations is 3. In this case, the above-mentioned steps S140 and S145 are executed, and the process returns to step S110. In this case, in step S110, the histogram corresponding to the third pulsed light is integrated and stored in the memory 260. That is, the histogram corresponding to the second pulsed light is integrated with the histogram corresponding to the third pulsed light.
[0035] In step S115, which is executed next, it is determined that the number of integrations is 4. In this case, the control unit 270 controls the light emitting unit 40 to emit the second pulsed light, and also controls the light receiving unit 60 to receive the light within a predetermined time including the expected flight time of the pulsed light (step S150). The adder 220 adds the output of the SPAD circuit 68 included in each pixel 66, and the histogram generating unit 230 generates a histogram for each pixel (step S155). The histogram generating unit 230 integrates and stores the histogram corresponding to the fourth pulsed light in the memory 260 (step S160). In this case, the histogram corresponding to the fourth pulsed light is integrated with the histograms corresponding to the second and third pulsed lights. The histogram obtained by integrating the second to fourth histograms (received light intensity for each flight time) corresponds to the second received light intensity in this disclosure.
[0036] Peak detection unit 240 detects a peak in the histogram stored in memory 260 and identifies its time of flight (step S165). Distance calculation unit 250 calculates the distance based on the time of flight of the peak identified in step S165 (step S170). The calculated distance is stored in second distance image memory 262 in association with each pixel position. After completion of step S170, the distance measurement process for that pixel position ends. Thereafter, the laser light is scanned at an adjacent pixel position, and distance measurement process is performed at another pixel position.
[0037] Examples of histograms stored in memory 260 as a result of the above-mentioned distance measurement process will be described with reference to Fig. 6 and Fig. 7. Fig. 6 shows an example of a histogram when a reflecting object exists within a range within a threshold distance (hereinafter referred to as a "short distance range"). Fig. 7 shows an example of a histogram when a reflecting object exists in a range farther than the threshold distance (hereinafter referred to as a "long distance range").
[0038] When a reflecting object other than the window 92, i.e., an external object, is present in a short distance range at a certain pixel position, when the first pulsed light is emitted and the reflected light is received, as shown in FIG. 6, a peak appears in the first histogram H1 at a flight time t2 shorter than the flight time ta. The flight time ta is the flight time corresponding to the above-mentioned threshold distance. This peak is due to the reflected light output from the reflecting object. On the other hand, the reflected light output from the window 92 may appear as a peak at a flight time t1 shorter than the flight time t2. However, as described above, the intensity of the first pulsed light is such that clutter cannot be detected by the light receiving unit 60, so no peak corresponding to clutter appears. Therefore, since there is no other peak in the vicinity of the flight time t2, the flight time t2 is detected with high accuracy. Specifically, a range of flight times in which the received light intensity is greater than the first threshold intensity Ith1 is identified, and the flight time t2 of the peak is detected as the median value.
[0039] In this embodiment, after the flight time of the peak corresponding to the first pulsed light is calculated, the memory 260 is cleared, and the histogram is again integrated and stored in the memory 260. In the second and subsequent emission of the pulsed light, the second pulsed light is emitted, so that, as shown in FIG. 6, in the second histogram H2, a peak appears not only at the flight time t2 but also at the flight time t1 corresponding to the flight time of the clutter. This flight time t1 is close to the flight time t2. Since the histograms H3 and H4 generated corresponding to the third and fourth emission and reception of the second pulsed light, respectively, are integrated, the light receiving intensity of each flight time increases with each iteration. By integrating the histograms in this way, the ratio of the reflected light to the disturbance light, that is, the S / N ratio, is increased, and the peak of the reflected light from the reflecting object is detected with high accuracy. In the example of FIG. 6, the peak of the flight time t1 and the peak of the flight time t2 can be distinguished, and in this case, two peaks and two flight times t1 and t2 are detected. In the fourth histogram H4, a range greater than the second threshold intensity Ith2 is identified, and from there, the above-mentioned two peaks and the times of flight t1 and t2 are identified.
[0040] As shown in FIG. 7, when an external object is present in the long distance range at a certain pixel position, when the first pulsed light is emitted and its reflected wave is received, the first histogram H1a does not show a peak at the flight time t1, as in the example of FIG. 6. In addition, since the reflector is present in the long distance range, the reflected light of the first pulsed light is not detected by the light receiving unit 60, and therefore, the first histogram H1a does not show a peak corresponding to the reflector. On the other hand, the second histogram H2a, the third histogram H3a, and the fourth histogram H4a show a peak at the flight time t1 and a peak at the flight time t3. The peak at the flight time t3 corresponds to the reflected light output from the reflector. Then, as a result of integrating the second to fourth histograms H2a to H4a, the received light intensity of the two peaks at the flight times t1 and t3 exceeds the second threshold intensity Ith2, and these two peaks and the two flight times t1 and t3 are detected.
[0041] A3.Distance image generation processing: 8 means processing for generating a distance image. After the above-described distance measurement processing has been performed for all pixel positions in field of view 80, distance determination section 510 and distance image generation section 520 perform distance image generation processing.
[0042] Distance determination unit 510 acquires first distance image data from first distance image memory 261 (step S205). The first distance image is an image consisting of distances calculated for each pixel based on the flight time of the peak obtained from a histogram corresponding to the emission of the first pulsed light. In other words, it means distance data for each pixel stored in first distance image memory 261. Distance determination unit 510 uses the first distance image data acquired in step S205 to cut out a close-distance area from the first distance image to acquire a first partial image (step S210). The close-distance area means an area within the above-mentioned threshold distance from distance measuring device 10. This step S210 corresponds to a process of identifying the distance indicated by the first distance image data as the measurement target distance in the close-distance area. In parallel with the above-mentioned steps S205 and S210, distance image generation unit 520 executes steps S215 and S220 described later.
[0043] Distance determination unit 510 acquires second distance image data from second distance image memory 262 (step S215). The second distance image is an image consisting of distances calculated based on the flight times of peaks obtained from a histogram resulting from integrating histograms corresponding to the emission of the second pulsed light for each pixel. In other words, it means distance data for each pixel stored in second distance image memory 262. Distance determination unit 510 uses the second distance image data acquired in step S215 to cut out a long distance area from the second distance image to acquire a second partial image (step S220). The long distance area means an area farther from distance measuring device 10 than the above-mentioned threshold distance. This step S220 corresponds to a process of identifying the distance indicated by the second distance image data as the measurement target distance in the long distance area.
[0044] After completing the above-mentioned steps S210 and S220, distance image generation unit 520 combines the first partial image acquired in step S210 and the second partial image acquired in step S220 to generate an integrated distance image (step S225), and the distance image generation process ends. The first, second distance images and integrated distance image generated in the above-mentioned distance image generation process will be described in detail with reference to FIG. 9.
[0045] In FIG. 9, the top row shows an image I1 showing an example of the positional relationship between two reflecting objects OJBJ1, OBJ2 and a window 92. In FIG. 9, the middle row shows a first distance image IL1 and a second distance image IL2. In FIG. 9, the bottom row shows an integrated distance image I10. Each image in FIG. 9 shows a state viewed in a vertical plane. In the first distance image IL1, the first partial image Ip1 is surrounded by a thick solid line. Similarly, in the second distance image IL2, the second partial image Ip2 is surrounded by a thick solid line. The X-axis and Y-axis in FIG. 9 are both axes parallel to the horizontal direction, with the center of gravity of the distance measuring device 10 as the origin O.
[0046] As shown in image I1 of FIG. 9, in region R1 within the threshold distance La from the distance measuring device 10, a reflector OBJ1 exists as an external object in addition to a window 92. Also, a reflector OBJ2 exists at a position longer than the threshold distance La from the distance measuring device 10. In such a situation, as shown in the middle left of FIG. 9, in the first partial image Ip1 cut out from the first distance image IL1, distance data exists only for the reflector OBJ1 existing in region R1, and distance data does not exist for other objects, for example, the window 92 (clutter). Also, as shown in the middle right of FIG. 9, in the second partial image Ip2 cut out from the second distance image IL2, distance data exists only for the reflector OBJ2 existing in a region outside region R1, and distance data does not exist for other objects, for example, the reflector OBJ1 and the window 92. By integrating these two partial images Ip1 and Ip2, as shown in the bottom of FIG. 9, in the integrated distance image I10, only the distance data for the reflector OBJ1 and the reflector OBJ2 exists, and the window 92 (clutter) does not exist. This makes it possible to prevent the vehicle from making a sudden evasive maneuver due to the presence of the window 92 (clutter), for example.
[0047] According to the distance measuring device 10 of the first embodiment described above, at each pixel position, one of the four total pulsed light beams is emitted as a first pulsed light beam with a low intensity, so that the first distance (first distance image) acquired in this case does not include the distance to the window 92 determined by the reflected light (clutter) from the window 92. Therefore, the peak of a reflector located at a position close to the distance measuring device 10 can be detected with high accuracy while suppressing the influence of clutter, and the distance to the reflector (measurement target distance) can be measured with high accuracy. In addition, three of the four total pulsed light beams are emitted as a second pulsed light beam with a higher intensity, and the histogram obtained in this case is integrated to detect the peak, so that the peak can be identified with a high S / N ratio. Therefore, the distance (second distance) of each pixel of the second distance image can be obtained with high accuracy.
[0048] In addition, an integrated distance image is generated by combining a first partial image of a reflector that is within a threshold distance from the ranging device, from the first distance image, and a second partial image of a reflector that is located at a distance greater than the threshold distance from the ranging device, from the second distance image.This makes it possible to generate a distance image (integrated distance image) in which the positions and distances of reflectors that are within the threshold distance from the ranging device and reflectors that are located at a distance greater than the threshold distance are accurately determined.
[0049] In addition, the peak detection unit 240 identifies a range of times of flight in the histogram where the received light intensity is higher than the intensity thresholds Ith1 and Ith2, and detects the peak times of flight of the received light intensity in the identified range, so that the peak times of flight can be detected with high accuracy.
[0050] B. Second embodiment: The device configuration of the distance measuring device 10 of the second embodiment is the same as that of the first embodiment, so the same components are given the same reference numerals and detailed descriptions thereof will be omitted. The distance measuring process of the second embodiment shown in Fig. 10 differs from that of the first embodiment in that step S108 is added and executed, and in that step S112 is executed instead of step S115. The other steps of the distance measuring process of the second embodiment and the distance image generation process are the same as those of the first embodiment, so the same steps are given the same reference numerals and detailed descriptions thereof will be omitted.
[0051] As shown in FIG. 10, after completion of step S105, the control unit 270 judges whether the number of integrations is the first time or not (step S108). If it is judged to be the first time (step S108: YES), the above-mentioned steps S120 to S135 are executed. Therefore, when the distance measurement process is started at a certain pixel position and step S108 is executed for the first time, the number of integrations is judged to be the first time, and steps S120 to S135 are executed. After completion of step S135, the process returns to step S108. Therefore, in this embodiment, step S105 is not executed in this case.
[0052] If it is determined that it is not the first time (step S108: NO), the above-mentioned step S110 is executed, and the histogram is accumulated and stored in memory 260. After completion of step S110, control unit 270 determines the accumulation count n (step S112). This step S112 differs from step S115 of the first embodiment in that the accumulation count is determined (specified) to be 2, 3, or 4, and is not determined to be 1.
[0053] If the number of integration times is the second or third, the above-mentioned steps S140 to S145 are executed. After step S145 is completed, the process returns to step S110, as in the first embodiment. Here, after the first histogram is stored in memory 260, in the second embodiment, memory 260 is not cleared. Therefore, the histogram corresponding to the second light emission is integrated with the first histogram already stored in memory 260, and is stored in memory 260.
[0054] If the number of integration times is the fourth, the above-mentioned steps S150 to S170 are executed. Here, the histogram obtained after the completion of step S160 is obtained by integrating all the histograms from the first to fourth times. After the completion of step S170, the distance measurement process at the corresponding pixel position ends.
[0055] As shown in FIG. 11, when a reflector is present in the short distance range, only a peak at flight time t2 indicating the reflector appears in the first histogram H1b, and no peak at flight time t1 caused by clutter appears, as in the first embodiment. Then, a peak at flight time t1 appears in the histogram H2b obtained by integrating the histograms in the second histogram. The received light intensity increases at each flight time in the order of the histogram H3b obtained by integrating the histograms in the third histogram and the histogram H4b obtained by integrating the histograms in the fourth histogram. Then, two peaks in the range of the threshold intensity Ith2 or more are detected in the finally obtained histogram H4b.
[0056] As shown in Fig. 12, when a reflecting object exists in the long distance range, no peak appears in the first histogram H1c, as in the first embodiment. Then, in the histogram H2c obtained by integrating the second histogram, a peak appears at the flight time t1 and a peak appears at the flight time t3. In the histogram H3c obtained by integrating the third histogram, and in the histogram H4c obtained by integrating the fourth histogram, the received light intensity increases at each flight time. Then, in the finally obtained histogram H4c, two peaks are detected in the range equal to or greater than the threshold intensity Ith2.
[0057] The distance measuring device 10 of the second embodiment described above has the same effects as the distance measuring device 10 of the first embodiment. In addition, the first to fourth histograms are all integrated and peaks are detected from the obtained histograms, which improves the S / N ratio and further improves the detection accuracy of the peak and the detection accuracy of the position of the reflecting object and the distance to the reflecting object.
[0058] C. Third embodiment: 13 differs from the distance measuring device 10 of the first embodiment in that the calculation and determination unit 20 includes two memories 263 and 264 instead of the memory 260, but the other configurations are similar. For this reason, the same components are denoted by the same reference numerals, and detailed description thereof will be omitted.
[0059] Both memories 263 and 264 are accessible from the control unit 270, the histogram generating unit 230, and the peak detecting unit 240. In the memory 263, only the light receiving intensity within a predetermined time and the flight time during which the light receiving intensity was recorded are overwritten and stored. In the memory 264, the histogram generated by the histogram generating unit 230 is stored without being integrated each time. The memory 263 corresponds to the first storage unit of the present disclosure. Also, the memory 264 corresponds to the second storage unit of the present disclosure.
[0060] The distance measurement process of the third embodiment shown in Fig. 14 differs from the distance measurement process of the first embodiment shown in Fig. 5 in that step S110 is omitted, step S115a is executed instead of step S115, step S125a is executed instead of step S125, steps S130 and S135 are omitted, step S165a is executed instead of step S165, and step S170a is executed instead of step S170. Since the other steps of the distance measurement process of the third embodiment are the same as those of the first embodiment, the same steps are denoted by the same reference numerals and detailed description thereof will be omitted.
[0061] After completing step S105, the control unit 270 determines the number of times the pulsed light is emitted at the pixel position (step S115a). If it is determined that the number of times the light is emitted is the first time, the control unit 270 executes the above-mentioned step S120 to emit and receive the first pulsed light. After completing step S120, the histogram generating unit 230 sequentially stores the added received light intensity for each flight time within a predetermined time in the memory 263. At this time, if the received light intensity (the output addition number of the SPAD circuit 68) is larger, the received light intensity and the flight time at that time are overwritten and stored in the memory 263. In other words, if the received light intensity at a certain flight time is larger than the received light intensity already stored in the memory 263, the flight time and the received light intensity are overwritten and stored in the memory 263. After completing step S125a, the process returns to step S115a.
[0062] In step S115a, if it is determined that the number of times of light emission is the second or third, the above-mentioned steps S140 and S145 are executed as in the first embodiment. In step S145, the histograms generated for each time are stored as they are in the memory 264. After step S145 is completed, the process returns to step S115a. At this time, unlike the first embodiment, the histograms are not integrated.
[0063] If it is determined in step S115a that the number of times of light emission is the fourth, steps S150 to S160 are executed as in the first embodiment. Here, in step S160 in the third embodiment, the second to fourth histograms stored separately from each other in the memory 264 are integrated.
[0064] Peak detector 240 detects a peak in the integrated histogram obtained in step S160 and identifies its time of flight, and also reads out the time of flight stored in memory 263 and identifies it as the time of flight of the peak (step S165a).
[0065] Distance calculation section 250 calculates the distance to the reflector based on the time of flight of the two peaks identified in step S165a (step S170a). In this step S170a, the position and distance of the reflector identified by emitting the first pulsed light are identified, and the position and distance of the reflector identified by emitting the second pulsed light a total of three times and receiving the reflected light are identified. Then, the positions and distances of the reflectors are stored as distance images in first distance image memory 261 and second distance image memory 262, respectively.
[0066] The distance measuring device 10a of the third embodiment described above has the same effects as the distance measuring device 10 of the first embodiment. In addition, when emitting the first pulsed light, when sequentially identifying the respective light receiving intensities at a plurality of flight times, the flight time corresponding to the greater light receiving intensity is updated and stored in the memory 263, and the flight time stored in the memory 263 is detected as the peak flight time, so that it is possible to prevent the storage area for detecting the peak flight time, i.e., the storage area of the memory 263, from becoming excessively large.
[0067] D. Fourth embodiment: The device configuration of the distance measuring device 10 of the fourth embodiment is the same as that of the first embodiment, so the same components are given the same reference numerals and detailed description thereof will be omitted. The distance measuring device 10 of the fourth embodiment differs from the distance measuring device 10 of the first embodiment in the detailed procedure of the distance image generation process. The distance measuring process of the fourth embodiment is the same as that of the first embodiment, so the same procedures are given the same reference numerals and detailed description thereof will be omitted. However, in this embodiment, in step S135, in addition to the calculated distance, the peak light receiving intensity is also stored in the first distance image memory 261. In addition, in step S170, in addition to the calculated distance, the peak light receiving intensity is also stored in the second distance image memory 262. The distance image (integrated distance image) obtained by the distance image generation process of the fourth embodiment is an image in which the influence of flare is suppressed. This flare will be described with reference to FIG. 16.
[0068] Image I2 in FIG. 16 shows flares FL1 and FL2, indicated by thick solid lines, occurring on the left and right sides of the lower rear of vehicle C1. These flares FL1 and FL2 occur around reflectors Rf1 and Rf2, which have very high reflectance. Because the reflectance of reflectors Rf1 and Rf2 is very high, when pulsed light or sunlight emitted from distance measuring device 10 hits reflectors Rf1 and Rf2, reflected light with very high intensity is output. When such reflected light with very high intensity is received by light receiving unit 60, light is also incident on pixels 66 in the vicinity of pixel 66 that receives reflected light from reflectors Rf1 and Rf2 in light receiving unit 60, and the received light is counted. As a result, there is a risk that the distance will be calculated erroneously for a portion that would have been specified as the correct distance if there was no flare, for example, a portion in the vicinity of the rear tires of vehicle C1. However, in the distance measuring device 10 of the fourth embodiment, by executing a distance image generating process described below, it is possible to accurately calculate the distance to the reflecting object OBJ while suppressing the effects of flare.
[0069] In the fourth embodiment, the intensity of the first pulsed light used in the distance measurement process is determined in advance through experiments or the like and set as an intensity that does not cause flare when the first pulsed light is reflected by an external object having a reflectance equal to or greater than a predetermined value and present within a range of a predetermined distance from the distance measuring device 10 and the reflected light is received by the light receiving unit 60. When a vehicle C1 as shown in Fig. 16 is present in the field of view range 80, histograms as shown in Figs. 17 and 18 are generated in the distance measurement process.
[0070] FIG. 17 shows histograms obtained at pixel positions including regions of objects having very high reflectance such as reflectors Rf1 and Rf2 (hereinafter referred to as "high reflectance regions"). When the first pulsed light is emitted, reflected light occurs in the high reflectance regions, and no reflected light occurs in other regions. For this reason, in the first histogram H1d, a peak occurs at the flight time t4 corresponding to the high reflectance region (region where reflectors Rf1 and Rf2 exist). Since this peak exceeds the first threshold intensity Ith1, such a peak is detected. Thereafter, as in the first embodiment, a peak at the flight time t4 also appears in the second histogram H2d, and the received light intensity increases at each flight time in the order of the histogram H3d obtained by integrating the third histogram and the histogram H4d obtained by integrating the fourth histogram, and the peak at the flight time t4 is detected in the finally obtained histogram H4d as a peak in a range equal to or greater than the second threshold intensity Ith2.
[0071] FIG. 18 shows histograms obtained at pixel positions including a region in the vicinity of the reflectors Rf1 and Rf2 where a flare occurs (hereinafter referred to as a "flare region"), in other words, a region that is hidden by a flare when a flare occurs. When the first pulse light is emitted, the flare region does not have a high reflectance to begin with, so the reflected light of the first pulse light is not detected by the light receiving unit 60. Therefore, no peak is detected in the first histogram H1e. In contrast, when the second pulse light is irradiated, a flare occurs, so the received light intensity becomes very high. Therefore, in the second histogram H2e, a peak at the flight time t5, which is a peak representing the flare region, appears. Similarly, a peak at the flight time t5 appears in both the histogram H3e obtained by integrating the third histogram and the histogram H4e obtained by integrating the fourth histogram.
[0072] Of the distance images represented by the distances calculated from these histograms, the first distance image is generated as an image I3 in which distances (reflecting objects) exist only in two areas A1, A2 corresponding to the two reflectors Rf1, Rf2, as shown in Fig. 19. Moreover, the second distance image is generated as an image I2 shown in Fig. 16 that includes two flares FL1, FL2.
[0073] As shown in FIG. 15, the distance image generating unit 520 acquires the first distance image data (step S305). Step S305 is the same as step S205 shown in FIG. 8, so a detailed description will be omitted. However, in the fourth embodiment, in addition to the distance of each pixel position, the received light intensity is also acquired as the first distance image data. The distance image generating unit 520 identifies an area where the received light intensity is equal to or greater than a threshold intensity (hereinafter referred to as a "high intensity area") in the first distance image acquired in step S305 (step S310). Note that the high intensity area identified in step S310 is referred to as a first high intensity area. Also, the threshold intensity used in identifying the first high intensity area is also referred to as a first threshold intensity. When the first distance image shown in FIG. 19 is obtained, two areas A1 and A2 are identified as the first high intensity area. Note that in FIG. 15, one of the two identified first high intensity areas A1 and A2, the first high intensity area A1, is shown to facilitate understanding. The distance image generating unit 520 executes steps S315 and S320, which will be described later, in parallel with steps S305 and S310.
[0074] The distance image generating unit 520 acquires the second distance data (step S315). Step S315 is similar to step S215 shown in FIG. 8, so detailed description will be omitted. However, in the fourth embodiment, in addition to the distance of each pixel position, the received light intensity is also acquired as the second distance image data. The distance image generating unit 520 identifies a high intensity region in the second distance image acquired in step S315 (step S320). The high intensity region identified in step S320 is called the second high intensity region. The threshold intensity used in identifying the second high intensity region is also called the second threshold intensity. For example, when an image such as the image I2 shown in FIG. 16 is acquired as the second distance image, two regions corresponding to the two reflectors Rf1, Rf2 and the two flares FL1, FL2 are identified as the second high intensity region. In FIG. 15, of the two regions corresponding to the two reflectors Rf1, Rf2 and the two flares FL1, FL2, only the second high intensity region A10 corresponding to the reflector Rf1 and the flare FL1 is shown for ease of understanding.
[0075] The distance image generating unit 520 uses the first high intensity region identified in step S310 and the second high intensity region identified in step S330 to identify a region of an object with a very high reflectance (hereinafter referred to as a "strong reflector region") in the second distance image (step S325). Specifically, of the second high intensity region identified in step S320, a region at the same position as the first high intensity region identified in step S310 is identified as a strong reflector region. In FIG. 15, a strong reflector region Ar1 is shown to facilitate understanding. This strong reflector region Ar1 is a strong reflector region identified as a region at the same position as the high intensity region A1 in the high intensity region A10.
[0076] In parallel with step S325 described above, distance image generating unit 520 uses the first high intensity region identified in step S310 and the second high intensity region identified in step S320 to identify a region corresponding to a flare (hereinafter referred to as a "flare region") in the second distance image (step S330). Specifically, the region other than the first high intensity region identified in step S310 among the second high intensity region identified in step S320 is identified as a flare region. In FIG. 15, flare region Af1 is shown to facilitate understanding. This flare region Af1 is a flare region identified as a region other than the high intensity region A1 among the high intensity region A10.
[0077] Distance image generator 520 generates an integrated distance image by deleting the data of the flare region from the second distance image data (step S335). By deleting the data of the flare region, i.e., the distance and light receiving intensity data of the pixel positions in the flare region, data of the portion where the distance was calculated with low accuracy due to the influence of flares FL1 and FL2 is deleted, so that low-accuracy distance data can be prevented from remaining in the distance image.
[0078] The ranging device 10 of the fourth embodiment described above has the same effects as the ranging device 10 of the first embodiment. In addition, the second high intensity region in the second distance image, except for the region corresponding to the first high intensity region, is identified as a flare region, and an image in the second distance image excluding the flare region is generated as an integrated distance image, so that it is possible to prevent regions (pixels) whose positions and distances are identified with low accuracy due to flare from being included in the integrated distance image.
[0079] E. Fifth embodiment: The configuration of the distance measuring device 10 of the fifth embodiment differs from that of the distance measuring device 10 of the first embodiment in that the light receiving unit 60 includes a light receiving array 65a shown in Fig. 20 instead of the light receiving array 65. Since the other configurations of the distance measuring device 10 of the fifth embodiment are the same as those of the distance measuring device 10 of the first embodiment, the same components are denoted by the same reference numerals and detailed descriptions thereof will be omitted.
[0080] As shown in Fig. 20, the light receiving array 65a of the fifth embodiment has a larger number of pixels 66 in the lateral direction (horizontal direction) than the light receiving array 65 of the first embodiment shown in Fig. 2. The lower part of Fig. 20 shows an example of the light receiving intensity for each lateral position (horizontal position) of the pixels 66 constituting the light receiving array 65a. In this embodiment, by controlling the angle of the mirror 54 of the scanning unit 50, the light receiving intensity is set to be greater as the lateral position of the light receiving array 65a approaches the center.
[0081] In the fifth embodiment, when a histogram is generated, the histogram is generated not for all pixels 66 of the light receiving array 65a, but for only a part of the pixel group. In other words, in the fifth embodiment, the light receiving intensity is specified only in a part of the region of the light receiving unit 60. The region in the light receiving unit 60 in which the light receiving intensity is specified is called a "region of interest (ROI: Region Of Interest)". In the fifth embodiment, two regions (a first region of interest ROI1 and a second region of interest ROI2) shown in FIG. 20 can be set as the region of interest. The first region of interest ROI1 is a region including a pixel row consisting of a plurality of pixels 66 adjacent in the vertical direction at a position shifted from the center of the horizontal position of the light receiving array 65a toward the end side. On the other hand, the second region of interest ROI2 is a region including a pixel row consisting of a plurality of pixels 66 adjacent in the vertical direction at the center of the horizontal position of the light receiving array 65a. The number of pixels 66 included in the two regions of interest ROI1 and ROI2 is equal to each other. However, due to the difference in lateral position described above, even if the same reflected light of pulsed light is received, the received light intensity identified in the second region of interest ROI2 is greater than the received light intensity identified in the first region of interest ROI1.
[0082] The distance measurement process of the fifth embodiment shown in Fig. 21 differs from the distance measurement process of the first embodiment shown in Fig. 5 in that step S120b is executed instead of step S120, step S145b is executed instead of step S145, and step S150b is executed instead of step S150. Since the other steps of the distance measurement process of the fifth embodiment are the same as those of the first embodiment, the same steps are denoted by the same reference numerals and detailed description thereof will be omitted.
[0083] In step S115, if it is determined that the number of integrations is the first time, the control unit 270 controls the light emitting unit 40 to emit the second pulsed light and also controls the light receiving unit 60 to receive light (step S120b). In step S120 in the first embodiment, the first pulsed light is emitted, but in step S120b in the fifth embodiment, the second pulsed light, that is, the pulsed light with a high intensity, is emitted instead of the first pulsed light. In this way, in the fifth embodiment, the second pulsed light is emitted regardless of the number of integrations. After completion of step S120b, when the light receiving unit 60 receives the reflected light, the adder 220 adds the output of the SPAD circuit 68 included in the first region of interest ROI1, and the histogram generating unit 230 generates a histogram of each pixel in the first region of interest ROI1, stores it in the memory 260, and outputs it to the peak detecting unit 240 (step S125b). As described above, the received light intensity specified in the first region of interest ROI1 is small, so that, similarly to the first embodiment, the histogram generated in step S125b does not show a peak corresponding to the reflected light (clutter) from the window 92.
[0084] In step S115, if it is determined that the number of integrations is the second or third, the above-mentioned step S140 is executed, and then a histogram of the second region of interest ROI2 is generated (step S145b). As described above, the received light intensity specified in the second region of interest ROI2 is large. Therefore, as in the first embodiment, a peak corresponding to the reflected light (clutter) of the window 92 appears in the histogram generated in step S145b.
[0085] If it is determined in step S115 that the number of integrations is the fourth, the above-mentioned step S150 is executed, and then a histogram of the second region of interest ROI2 is generated (step S155b). In the histogram generated at this time, a peak corresponding to the reflected light (clutter) of the window 92 appears, similar to the histogram generated in the above-mentioned step S145b. After the completion of step S155b, the above-mentioned step S160 is executed.
[0086] The distance measuring device 10 of the fifth embodiment described above has the same effects as the distance measuring device 10 of the first embodiment. In addition, by changing the region for generating a histogram, in other words, the region for specifying the received light intensity, according to the number of integrations, the intensity of the pulsed light is not changed, which has the effect of suppressing deterioration over time of the light emitting unit 40 caused by frequently changing the light emission intensity, and eliminating the need for complicated processing in the control unit 270.
[0087] F. Sixth embodiment: The device configuration of the distance measuring device 10 of the sixth embodiment is the same as that of the first embodiment, so the same components are given the same reference numerals and detailed descriptions thereof will be omitted. In the distance measuring process of the sixth embodiment shown in Fig. 22, the same steps as those in the distance measuring process of the first embodiment shown in Fig. 5 are given the same reference numerals and detailed descriptions thereof will be omitted.
[0088] As shown in FIG. 22, in the distance measurement process of the sixth embodiment, the above-mentioned steps S120 to S135 are first executed. That is, the first pulsed light is emitted, the reflected light is received, a histogram is generated, a peak is detected, and a distance is calculated. After the completion of step S135, the control unit 270 identifies a high reflection direction. The "high reflection direction" means a direction of an area of a predetermined size including an object having a reflectance higher than a predetermined value (hereinafter referred to as a "high reflectance object"), and refers to a direction based on the distance measurement device 10. The high reflectance object is estimated to be present at a position where a time of flight Tf with a received light intensity higher than a predetermined value is recorded in the histogram generated in step S125. Then, in step S136, the direction in which the area of the predetermined size including the high reflectance object exists is identified. Specifically, in the example of the fourth embodiment, the direction of flares FL1 and FL2 resulting from the reflection of the pulsed light at the reflectors Rf1 and Rf2 is identified. The size of the flare occurring around the highly reflective object is previously obtained in relation to the size of the highly reflective object through experiments, simulations, etc., and in step S135, the high reflection direction is specified as the direction of the area corresponding to the size of the flare. After completing step S136, control unit 270 clears memory 260 (step S137).
[0089] The control unit 270 determines whether the emission direction of the second pulsed light to be emitted thereafter corresponds to the high reflection direction (step S138). As described above, the laser light is scanned, and the control unit 270 determines whether the emission direction at the irradiation timing of the next pulsed light (second pulsed light) corresponds to the high reflection direction specified in step S136.
[0090] If it is determined that the emission direction of the second pulsed light does not correspond to the high reflection direction (step S138: NO), the histogram generating unit 230 generates a histogram of each pixel, stores it in the memory 260, and outputs it to the peak detecting unit 240 (step S110d). The procedure of this step S110d is the same as the procedure of the above-mentioned step S110. The control unit 270 determines whether the number of times of integration of the histogram reaches N (step S180d). "N" in step S180d is a positive integer and is a number larger than "M" described later. In this embodiment, N is "3". That is, in step S180d, it is determined whether the number of times of integration of the histogram reaches three.
[0091] If it is determined that the number of times the histogram has been accumulated has not reached N (3) (step S180d: NO), the second pulsed light is emitted and its reflected light is received (step S140d), and a histogram is generated (step S145d). The procedures of steps S140d and S145d are the same as those of steps S140 and S145 described above. After completion of step S145d, the process returns to step S110d.
[0092] On the other hand, if it is determined that the number of times the histogram has been accumulated has reached N (3) (step S180d: YES), the above steps S165 and S170 are executed and the process ends. That is, a peak is detected based on the histogram obtained by a total of three accumulations, and the distance is calculated. Therefore, when the above steps S110d, S180d, S140d, and S145d are executed, the second pulsed light is irradiated a total of three times, as in the first embodiment, and the distance is calculated based on the histogram accumulated by the light reception corresponding to these three irradiations.
[0093] In the above-mentioned step S138, if it is determined that the emission direction of the second pulsed light corresponds to the high reflection direction (step S138: YES), the histogram generating unit 230 generates a histogram of each pixel, stores it in the memory 260, and outputs it to the peak detecting unit 240 (step S110c). The procedure of this step S110c is the same as the procedure of the above-mentioned steps S110 and S110d. The control unit 270 determines whether the number of integration times of the histogram reaches M (step S180c). "M" in step S180c is a positive integer and is a number smaller than the above-mentioned "N". In this embodiment, M is "2". That is, in step S180c, it is determined whether the number of integration times of the histogram reaches two.
[0094] If it is determined that the number of times the histogram has been accumulated has not reached N (2) (step S180c: NO), the second pulsed light is emitted and its reflected light is received (step S140c), and a histogram is generated (step S145c). The procedures of steps S140c and S145c are the same as those of steps S140 and S145 described above. After completion of step S145c, the process returns to step S110c.
[0095] On the other hand, if it is determined that the number of times of integration of the histogram has reached N(2) (step S180c: YES), the above-mentioned steps S165 and S170 are executed. That is, a peak is detected based on the histogram obtained by a total of two integrations, and the distance is calculated. Therefore, unlike the first embodiment, when the above-mentioned steps S110c, S180c, S140c, and S145c are executed, the second pulsed light is irradiated a total of two times, and the distance is calculated based on the histogram integrated by the light reception corresponding to the two irradiations.
[0096] As described above, in the sixth embodiment, the reason why the number of integration times of the histogram corresponding to the second pulsed light is varied depending on whether the azimuth is high reflection or not will be described with reference to FIG.
[0097] FIG. 23 shows the change in the histogram when a first pulsed light (first pulsed light), a second and a third pulsed light (second pulsed light) are irradiated in a high reflection direction, and then a fourth pulsed light (second pulsed light) is irradiated.
[0098] As in the first embodiment, the received light intensity increases at each time of flight in the first histogram H1f, the second histogram H2f, and the third histogram H3f. A peak appears at the time of flight t6 in the first to third histograms H1f to H3f. However, in the fourth histogram H4f, the received light intensity becomes excessively large at the time of flight near the time of flight t6, exceeding the upper limit UL of the measurable range of the received light intensity in the light receiving unit 60. For this reason, there is a problem that the detection accuracy is reduced when the peak is detected based on the histogram H4f. However, in this embodiment, for the high reflection azimuth, the second pulse light is irradiated up to two times, that is, a total of three times including the first pulse light, and the peak is detected from the integration results of the histograms corresponding to the second and third second pulse lights. For this reason, the peak is detected from the histogram H3f in which the received light intensity is not saturated, so that the decrease in the detection accuracy of the distance to the reflecting object can be suppressed.
[0099] The distance measuring device 10 of the sixth embodiment described above has the same effect as the distance measuring device 10 of the first embodiment. In addition, for the high reflection azimuth, a peak is detected based on a histogram that has been integrated a smaller number of times than other azimuths different from the high reflection azimuth, so that the peak can be detected based on a histogram in a state before the received light intensity is saturated. This makes it possible to suppress a decrease in the detection accuracy of the distance to the reflecting object. On the other hand, for other azimuths different from the high reflection azimuth, a peak is detected based on a histogram that has been integrated a larger number of times than the high reflection azimuth, so that the peak can be detected based on a histogram in a state in which the peak is more prominent, and in this case, too, it is possible to suppress a decrease in the detection accuracy of the distance to the reflecting object. Note that the number of integrations M and N is not limited to 2 and 3, and may be any number that satisfies N>M. The sixth embodiment may also be applied to the second embodiment. That is, even in a configuration in which both the received light intensity of the reflected light of the first pulse light and the received light intensity of the reflected light of the second pulse light are integrated, the number of integrations may be less for the high reflection azimuth than for the other azimuths.
[0100] G. Seventh embodiment: Since the device configuration of the distance measuring device 10 of the seventh embodiment is the same as that of the first embodiment, the same components are denoted by the same reference numerals, and detailed description thereof will be omitted. The upper, middle, and lower parts of FIG. 24 correspond to the upper, middle, and lower parts of FIG. 9, respectively. In the first embodiment, the first partial image Ip1 and the second partial image Ip2 do not overlap with each other. In contrast, in the seventh embodiment, the first partial image Ip10 and the second partial image Ip20 overlap with each other. For reference, in FIG. 24, the region R1 in FIG. 9 is represented by a dashed line. In the seventh embodiment, each partial image includes information on the light receiving intensity at each pixel position in addition to the distance.
[0101] As shown in the middle left of FIG. 24, in the seventh embodiment, a distance image of an area within the first threshold distance Lb from the distance measuring device 10 is cut out as a first partial image Ip10 from the first distance image IL1. Also, as shown in the middle right of FIG. 24, a distance image of an area farther than the second threshold distance Lc from the distance measuring device 10 is cut out as a second partial image Ip20 from the second distance image IL2. Then, these two partial images Ip10 and Ip20 are combined to generate an integrated distance image I30. Here, the above-mentioned first threshold distance Lb is longer than the threshold distance La in the first embodiment. On the other hand, the above-mentioned second threshold distance Lc is shorter than the threshold distance La. In other words, the first threshold distance Lb is longer than the second threshold distance Lc. As a result, the first partial image Ip10 and the second partial image Ip20 have an overlapping area (hereinafter referred to as an "overlapping area") MA.
[0102] 25, step S225 of the distance image generation process in the seventh embodiment includes two steps S226 and S227 in addition to combining the first and second partial images as in the first embodiment. In step S226, the distance image generation unit 520 calculates the light receiving intensity of the overlap region MA by taking a weighted average of the light receiving intensities in the two partial images Ip10 and Ip20. Specifically, for each position (pixel) in the overlap region MA, the closer to the radially inner boundary B1 of the overlap region MA, the greater the influence of the light receiving intensity of the first partial image Ip10 and the smaller the influence of the light receiving intensity of the second partial image Ip20. The weights are multiplied by the light receiving intensities of the respective partial images and added together to calculate the average value. In other words, the closer to the radially outer boundary B2 of the overlap area MA, the smaller the influence of the light intensity of the first partial image Ip10 and the greater the influence of the light intensity of the second partial image Ip20.The light intensity of each partial image is multiplied by a weighting factor and added together to calculate the average value.
[0103] As shown in FIG. 25, in step S227, the distance image generating unit 520 selectively sets the received light intensity in the first partial image Ip10 or the second partial image Ip20 for each position (pixel) in the areas other than the overlap area MA.
[0104] The distance measuring device 10 of the seventh embodiment described above has the same effect as the distance measuring device 10 of the first embodiment. In addition, since the first threshold distance Lb is longer than the second threshold distance Lc, the first partial image Ip10 and the second partial image Ip20 can be overlapped with each other to generate an overlap area MA. This makes it possible to prevent the occurrence of an area that does not belong to either the first partial image Ip10 or the second partial image Ip20, and to prevent the occurrence of a position (pixel) where the distance or the received light intensity is not calculated. Furthermore, for each position (pixel) within the overlap area MA, the light receiving intensity of each partial image is weighted so that the closer to the radially inner boundary B1 of the overlap area MA, the greater the influence of the light receiving intensity of the first partial image Ip10 and the smaller the influence of the light receiving intensity of the second partial image Ip20.Therefore, for example, in a situation where a single object gradually moves away in the overlap area MA, excessive changes in the distance and light receiving intensity of the object can be suppressed, and erroneous recognition of the object and a decrease in the detection accuracy of the distance to the object can be suppressed.
[0105] H. Eighth embodiment: The distance measuring device 10b of the eighth embodiment shown in Fig. 26 differs from the distance measuring device 10 of the first embodiment shown in Fig. 1 in that the light emitting unit 40b includes a first light emitting unit 40 corresponding to the light emitting unit 40 of the first embodiment, and a second light emitting unit 40a. The other configurations of the distance measuring device 10b of the eighth embodiment are the same as those of the distance measuring device 10 of the first embodiment, so the same components are given the same reference numerals and detailed descriptions thereof will be omitted. The configuration of the first light emitting unit 40 is the same as that of the light emitting unit 40 of the first embodiment, so the same reference numerals are given and detailed descriptions thereof will be omitted.
[0106] The second light-emitting unit 40b simultaneously irradiates (surface irradiates) the entire scanning range of the laser light, that is, the field of view range 80. In this embodiment, the second light-emitting unit 40b includes a VCEL (Vertical Cavity Surface Emitting LASER) and an optical system that diffuses the laser light output from the VCEL.
[0107] The light-emitting unit 40b has an operating mode (hereinafter referred to as the "first irradiation mode") in which pulsed light is emitted from the first light-emitting unit 40 while scanning, as in the first embodiment, and an operating mode (hereinafter referred to as the "second irradiation mode") in which pulsed light is irradiated from the second light-emitting unit 40a to the entire field of view 80 at once.
[0108] The control unit 270 causes the first pulsed light to be emitted in the second irradiation mode, and causes the second pulsed light to be emitted in the first irradiation mode. Therefore, in step S120 shown in Fig. 5, the second light-emitting unit 40a emits the first pulsed light, and in steps S140 and S150, the first light-emitting unit 40 emits the second pulsed light.
[0109] The distance measuring device 10 of the eighth embodiment described above has the same effect as the distance measuring device 10 of the first embodiment. In addition, since the second light emitting unit 40a irradiates the field of view 80 at one time (surface irradiation) with the first pulsed light having a relatively low intensity, the output light amount from the VCEL can be suppressed, which contributes to power saving. The area 80a that can be irradiated at one time by the first light emitting unit 40 in the first irradiation mode corresponds to the "first irradiation area" in this disclosure. Also, the field of view 80, which is the area that can be irradiated at one time by the second light emitting unit 40a in the second irradiation mode, corresponds to the "second irradiation area" in this disclosure. The above-mentioned "relatively low intensity" does not mean the emission intensity of the laser element 41, but means that the intensity of light per unit area on the light receiving surface is relatively low. Similarly, "relatively high intensity" means that the intensity of light per unit area on the light receiving surface is relatively high.
[0110] I. Other embodiments: I1. Alternative embodiment 1: In the first to fourth embodiments, two types of pulsed light, a first pulsed light having a relatively low intensity and a second pulsed light having a relatively high intensity, are emitted, but the present disclosure is not limited thereto. As in the fifth embodiment, the first pulsed light may be omitted and only the second pulsed light may be emitted four times. However, in such a configuration, the light receiving sensitivity of the light receiving unit 60 may be lowered during a predetermined period in which the first pulsed light is emitted and its reflected light is received, and the light receiving sensitivity of the light receiving unit 60 may be increased during a period in which the second to fourth pulsed lights are emitted and their reflected light is received. The light receiving sensitivity of the light receiving unit 60 can be realized, for example, by adjusting the voltage supplied to the avalanche diode Da. Specifically, the light receiving sensitivity can be increased by increasing the voltage of the power supply Vcc, and the light receiving sensitivity can be decreased by decreasing the voltage of the power supply Vcc. During the period corresponding to the emission of the first pulsed light, the light receiving sensitivity of the light receiving unit 60 is adjusted to a level at which clutter is not sensed. During the period corresponding to the emission of the second to fourth pulsed light, the sensitivity is adjusted to a level at which a predetermined number or more of the SPAD circuits 68 constituting each pixel 66 are operated by the reflected light from a reflecting object (external object) existing within a predetermined distance from the distance measuring device 10 when the second pulsed light is emitted, and the light receiving sensitivity is adjusted to a level at which the received light intensity is equal to or greater than a predetermined level. With this control, a histogram consisting of received light intensities with a relatively small S / N ratio is specified at each flight time by the emission of the first pulsed light, and a histogram consisting of received light intensities with a relatively large S / N ratio is specified at each flight time by the emission of the second to fourth pulsed light, so that the same effect as each embodiment can be achieved. In this configuration, the histogram specified by the emission of the first pulsed light corresponds to the first received light intensity in this disclosure. The histogram determined by the second to fourth emission of pulsed light corresponds to the second received light intensity in the present disclosure. Note that the emission of the first and second pulsed light and the sensitivity adjustment of the light receiving unit 60 may be performed in combination.
[0111] As can be understood from this other embodiment 1 and each embodiment, a configuration may be applied to the distance measuring device of the present disclosure that controls at least one of the intensity of the pulsed light emitted from the light emitting unit 40, the light receiving sensitivity of the reflected light at the light receiving unit 60, and the position of the area of interest at the light receiving unit 60 so that, in response to the first emission of pulsed light, a light receiving intensity (first light receiving intensity) with a relatively small S / N ratio is identified as the light receiving intensity at each of multiple flight times, and, in response to the second to fourth emissions of pulsed light, a light receiving intensity (second light receiving intensity) with a higher S / N ratio than the first light receiving intensity is identified as the light receiving intensity at each of multiple flight times.
[0112] I2. Alternative embodiment 2: In the first to third embodiments, the first pulse light is emitted at the first time, and the second pulse light is emitted at the second to fourth times, but the present disclosure is not limited thereto. The first pulse light may be emitted only at the fourth time, and the second pulse light may be emitted at the first to third times. For example, the second pulse light may be emitted at the first, third, and fourth times, and the first pulse light may be emitted at the second time. Furthermore, the number of times that the second pulse light is emitted may be one, or any multiple times, such as three or more. The first pulse light may be emitted multiple times. In such a configuration, a peak (first distance image) may be obtained by integrating histograms obtained by emitting the first pulse light multiple times.
[0113] Similarly, in the above-mentioned other embodiment 1, the light receiving sensitivity may be increased during the period when the first to third pulsed light is emitted and the reflected light is received, and the light receiving sensitivity may be decreased during the period when the fourth pulsed light is emitted and the reflected light is received. Also, the light receiving sensitivity may be increased during the period when the first, third and fourth pulsed light is emitted and the reflected light is received, and the light receiving sensitivity may be decreased during the period when the second pulsed light is emitted and the reflected light is received. Also, the number of times that the light receiving sensitivity is increased may be one. Also, the number of times that the light receiving sensitivity is decreased may be multiple.
[0114] As can be understood from this other embodiment 2 and each embodiment, a configuration may be applied to the distance measuring device of the present disclosure that controls at least one of the intensity of the pulsed light emitted from the light emitting unit 40 and the light receiving sensitivity of the reflected light at the light receiving unit 60 so that a received light intensity (first received light intensity) with a relatively small S / N ratio is identified as the received light intensity at each of the multiple flight times corresponding to at least one of the multiple emissions of the pulsed light, and a received light intensity (second received light intensity) with a higher S / N ratio than the first received light intensity is identified as the received light intensity at each of the multiple flight times corresponding to at least one of the multiple emissions of the pulsed light.
[0115] I3. Alternative embodiment 3: The configuration of the distance measuring device 10, 10a in each embodiment is merely an example, and can be modified in various ways. For example, the distance image generating unit 520 is provided in the ECU 500 different from the calculation and determination unit 20, but the distance image generating unit 520 may be provided in the calculation and determination unit 20 instead of the ECU 500. Also, for example, in the fourth embodiment, the distance measuring device 10 can achieve a predetermined effect even in a configuration in which the calculation and determination unit 20 and the optical system 30 are housed in a case in which only an opening is formed. Also, for example, the distance measuring device 10, 10a is a LiDAR for vehicle use, but instead of a vehicle, it may be mounted on any moving body such as a ship or an airplane. Or, it may be fixedly installed and used for security purposes.
[0116] I4. Alternative embodiment 4: In each embodiment, the distance image generation process may be omitted. Even in such a configuration, the distance measurement process is performed to specify the measurement target distance for each pixel. Also, in such a configuration, in addition to specifying the measurement target distance for all pixels in the field of view range 80, the measurement target distance may be specified for only a single pixel. Even in such a configuration, as in each embodiment, either the first distance based on the first received light intensity or the second distance based on the second received light distance is specified as the measurement target distance for the pixel.
[0117] I5. Alternative embodiment 5: The control unit 270, the calculation unit 200, the distance image generating unit 520, and the methods described herein may be realized by a dedicated computer provided by configuring a processor and a memory programmed to execute one or more functions embodied in a computer program. Alternatively, the control unit 270, the calculation unit 200, the distance image generating unit 520, and the methods described herein may be realized by a dedicated computer provided by configuring a processor with one or more dedicated hardware logic circuits. Alternatively, the control unit 270, the calculation unit 200, the distance image generating unit 520, and the methods described herein may be realized by one or more dedicated computers configured by a combination of a processor and a memory programmed to execute one or more functions and a processor configured with one or more hardware logic circuits. The computer program may also be stored in a computer-readable non-transitory tangible recording medium as instructions executed by a computer.
[0118] I6. Other embodiment 6: The configurations of the laser elements and their driving circuits in each of the above-mentioned embodiments are merely examples and can be modified in various ways. For example, in the example of the light emitting unit 40c shown in FIG. 27, four laser elements 41a, 41b, 41c, and 41d and one driving circuit 46 are arranged. The four laser elements 41a to 41d irradiate different ranges in the field of view 80 with pulsed light. Specifically, the laser element 41a irradiates the uppermost range of the field of view 80 divided vertically into four equal parts with pulsed light. The laser element 41b irradiates the second range from the top with pulsed light. The laser element 41c irradiates the third range from the top with pulsed light. The laser element 41d irradiates the fourth range from the top with pulsed light. The driving circuit 46 is connected to the four laser elements 41a to 41d and outputs the same signal to these four laser elements 41a to 41d at the same time. As a result, in the example of FIG. 27, the four laser elements 41a to 41d simultaneously irradiate pulsed light in the same horizontal direction.
[0119] Also, for example, the light-emitting unit 40d shown in Fig. 28 includes a weak light-emitting unit 42a and a normal light-emitting unit 42b. The weak light-emitting unit 42a includes a laser element 41e and a driving element 46e thereof. The normal light-emitting unit 42b includes a laser element 41f and a driving element 46f thereof. The weak light-emitting unit 42a irradiates the entire range of the field of view 80 with the first pulsed light while scanning the field of view 80. The normal light-emitting unit 42b irradiates the entire range of the field of view 80 with the second pulsed light while scanning the field of view 80.
[0120] Also, for example, the light emitting unit 40e shown in FIG. 29 includes one laser element 41, two driving circuits 46g and 46h, and a line selector 47. The driving circuit 46g is a driving circuit for emitting a first pulsed light. The driving circuit 46h is a driving circuit for emitting a second pulsed light. The line selector 47 selectively connects one of the two driving circuits 46g and 46h to the laser element 41. The line selector 47 switches the connection in response to a command from the control unit 270.
[0121] Also, for example, the light emitting unit 40f shown in FIG. 30 includes two laser elements 41i and 41j, one driving circuit 46, and a line selector 47i. The laser element 41i is a laser element for emitting a first pulsed light. The laser element 41j is a laser element for emitting a second pulsed light. The line selector 47i selectively connects one of the two laser elements 41i and 41j to the driving circuit 46. The line selector 47i switches the connection in response to a command from the control unit 270. The configurations described above also provide the same effects as the respective embodiments.
[0122] I7. Alternative embodiment 7: In the fifth embodiment, when the region for generating the histogram, in other words, the region for specifying the light receiving intensity, is changed according to the number of integrations, the region of interest is selectively changed between the center of the horizontal position and a position shifted from the center in the horizontal direction, but the present disclosure is not limited thereto. In the example of FIG. 31, four regions of interest ROI31, ROI32, ROI33, and ROI34 having the same vertical size are set in the center of the horizontal position of the light receiving array 65a. In this example, the distance measuring device 10 includes a light emitting unit having the same configuration as the light emitting unit 40c shown in FIG. 27. However, the four laser elements 41a to 41d irradiate pulsed light to ranges having different horizontal positions at the same time. In this example, none of the four laser elements 41a to 41d irradiates the first pulsed light, but only the second pulsed light. For example, in the second to fourth irradiations of pulsed light in the first embodiment, a histogram is generated only for the pixel group of the attention area corresponding to the irradiation position of the pulsed light among the four attention areas POI31 to POI34. For example, when the area corresponding to the attention area POI31 is irradiated with pulsed light, the peak of the received light intensity in the vertical position is the position of the attention area POI31 as shown in FIG. 31. In contrast, in the first irradiation of pulsed light in the first embodiment, a histogram is generated only for the pixel group of the attention area adjacent to the attention area corresponding to the irradiation position of the pulsed light. For example, as described above, when the area corresponding to the attention area POI31 is irradiated with pulsed light, a histogram is generated only for the pixel group of the attention area POI32 adjacent to the attention area POI31. In the attention area adjacent to the attention area corresponding to the irradiation position of the pulsed light, the received light intensity is shifted from the peak and is low as shown in FIG. For this reason, it is possible to achieve the same effect as when the first pulsed light is irradiated.
[0123] I8. Alternative embodiment 8: In each embodiment, the integrated distance image is generated for the entire range of the field of view 80, but the present disclosure is not limited to this. For example, the distance image may be generated for each unit of a predetermined angle range in the horizontal direction (predetermined azimuth range). Also, for example, in the fourth embodiment, the first high intensity region and the second high intensity region, and the strong reflector region and the flare region may be specified for each unit of a predetermined angle range in the horizontal direction (predetermined azimuth range).
[0124] I9. Other embodiment 9: In each embodiment, a total of two types of pulsed light, a first pulsed light and a second pulsed light, which have different intensities from each other, are irradiated, but the present disclosure is not limited to this. Three or more types of pulsed light, which have different intensities from each other, may be irradiated. In the fourth embodiment, the distance from the distance measuring device 10 to the reflectors Rf1 and Rf2 may change depending on the position of the vehicle C1. In this way, when the distance from the distance measuring device 10 to the reflectors Rf1 and Rf2 changes, the intensity of the reflected light from the first high intensity areas A1 and A2 may also change, so that depending on the position of the vehicle C1, the first pulsed light may not be able to identify the first high intensity areas A1 and A2. However, as described above, by irradiating three or more types of pulsed light, which have different intensities from each other, the possibility of identifying the first high intensity areas A1 and A2 can be increased regardless of the position of the vehicle C1.
[0125] I10. Other embodiment 10: In each embodiment, ECU 500 is housed inside case 90, but it may be disposed outside case 90. Even in such a configuration, the same effects as those of each embodiment are achieved.
[0126] I11. Other embodiment 11: In the eighth embodiment, the first light-emitting unit 40 may be omitted, and the pulsed light may be emitted only from the second light-emitting unit 40a. In such a configuration, control is performed to adjust the intensity of the output laser so that not only the first pulsed light but also the second pulsed light is emitted from the second light-emitting unit 40a.
[0127] The present disclosure may be realized in various forms, such as a distance measuring system, a moving object equipped with a distance measuring device, a distance measuring method, a computer program for implementing these devices and methods, a non-transitory recording medium on which such a computer program is recorded, and the like.
[0128] The present disclosure is not limited to the above-mentioned embodiment, and can be realized in various configurations without departing from the spirit of the present disclosure. For example, the technical features in each embodiment corresponding to the technical features in the form described in the Summary of the Invention column can be appropriately replaced or combined in order to solve some or all of the above-mentioned problems or to achieve some or all of the above-mentioned effects. Furthermore, if the technical feature is not described as essential in this specification, it can be appropriately deleted. [Explanation of symbols]
[0129] 10, 10a... distance measuring device, 40... light emitting unit, 60... light receiving unit, 200... calculation unit, OBJ... reflecting object, 510... distance image generating unit, 270... control unit, 210... received light intensity determining unit, 240... peak detecting unit, 250... distance calculation unit
Claims
1. A distance measuring device (10, 10a), A light emitting unit (40) that emits pulsed light, the light emitting unit emitting the pulsed light a plurality of times in each emission direction; a light receiving unit (60) that receives reflected light of the pulsed light; a calculation unit (200) that uses a time of flight of the reflected light received by the light receiving unit to calculate a measurement target distance, which is a distance to a reflecting object (OBJ) that reflects the pulsed light and outputs the reflected light; A control unit (270) that controls at least one of the intensity of the pulsed light emitted from the light emitting unit, the light receiving sensitivity of the reflected light at the light receiving unit, and the position of a region of interest (ROI1, ROI2) in which the light receiving intensity is specified at the light receiving unit; Equipped with The calculation unit is a light receiving intensity specifying unit (210) that specifies each of the light receiving intensities at a plurality of times of flight; a peak detection unit (240) for detecting a peak time of flight among the light receiving intensities at the plurality of times of flight; A distance calculation unit (250) that calculates a distance from the flight time of the detected peak; A distance determination unit (510) that determines the measurement target distance by using the distance calculated by the distance calculation unit; having The control unit controls at least one of the intensity of the pulsed light emitted from the light emitting unit, the light receiving sensitivity of the reflected light in the light receiving unit, and the position of the region of interest so that a first light receiving intensity is specified by the light receiving intensity specifying unit as the light receiving intensity in the multiple flight times at least once among the multiple emission times, and a second light receiving intensity having a higher S / N ratio than the first light receiving intensity is specified by the light receiving intensity specifying unit as the light receiving intensity in the multiple flight times at least once among the multiple emission times, the distance determination unit determines the measurement target distance by using a first distance calculated based on the first received light intensity and a second distance calculated based on the second received light intensity. Ranging device.
2. 2. The distance measuring device according to claim 1, The control unit causes the light emitting unit to emit a first pulsed light, thereby causing the received light intensity determining unit to determine the first received light intensity, and causes the light emitting unit to emit a second pulsed light, the second pulsed light having an intensity greater than that of the first pulsed light, thereby causing the received light intensity determining unit to determine the second received light intensity.
3. 3. The distance measuring device according to claim 2, The present invention further includes a case (90) for housing the light emitting unit and the light receiving unit, the case having a window (92) for transmitting the pulsed light and the reflected light, A distance measuring device, wherein the first pulsed light is emitted as light of such an intensity that the reflected light of the first pulsed light at the window cannot be recognized as received by the light receiving unit.
4. 2. The distance measuring device according to claim 1, The light receiving unit is configured so that the light receiving sensitivity is adjustable, A distance measuring device in which the control unit causes the first received light intensity to be determined by the received light intensity determination unit by adjusting the light sensitivity to a low level, and causes the second received light intensity to be determined by the received light intensity determination unit by adjusting the light sensitivity to a high level.
5. 5. The distance measuring device according to claim 1, The apparatus further includes a distance image generating unit (520) for generating a distance image which is an image showing the position of the reflecting object and the measurement target distance, A ranging device in which the distance image generation unit generates an integrated distance image by combining a first distance image consisting of the first distances specified for each of the emission directions and a second distance image consisting of the second distances specified for each of the emission directions.
6. 6. The distance measuring device according to claim 5, The device further includes a first storage unit (263) that stores a time of flight corresponding to a maximum light receiving intensity, and a second storage unit (264) that stores a histogram representing the light receiving intensity at each of a plurality of times of flight, The received light intensity specifying unit is When sequentially identifying the first received light intensities at the plurality of times of flight, a time of flight corresponding to a larger received light intensity is updated and stored in the first storage unit; sequentially identifying the second received light intensities for the plurality of times of flight, creating the histograms, and storing the histograms in the second storage unit, The peak detection unit detects the flight time stored in the first storage unit as a first flight time that is the flight time of the peak, and detects a second flight time that is the flight time of the peak from a histogram obtained by integrating the histogram stored in the second storage unit, The distance image generating unit generating the first distance image using the first distance calculated based on the first time-of-flight; A distance measuring device that generates the second distance image using the second distance calculated based on the second time of flight.
7. A distance measuring device according to claim 5 dependent on claim 3, The distance image generating unit A first partial image (Ip1) showing a position and a distance to a reflector, the position being within a threshold distance from the distance measuring device, of the first distance image; a second partial image (Ip2) showing a position and a distance to a reflector that is present at a distance from the distance measuring device that is longer than the threshold distance in the second distance image; and generating the integrated distance image by combining the above.
8. 8. The distance measuring device according to claim 7, The light receiving intensity specifying unit has a histogram generating unit (230) that creates a histogram representing the light receiving intensity at each of a plurality of flight times, The peak detection unit identifies a range of time-of-flight in the histogram where the received light intensity is higher than an intensity threshold, and detects the time-of-flight of the peak of the received light intensity in the identified range.
9. 9. The distance measuring device according to claim 8, A memory unit (260) that stores the received light intensity at each of the plurality of flight times, the light emitting unit emits the first pulsed light as the first emission of the pulsed light, and emits the second pulsed light as the second or subsequent emission of the pulsed light, The histogram generation unit generating the histogram by storing in the storage unit the received light intensity within a predetermined time period including a time of flight of the reflected light corresponding to the first pulse light of the first time; and clearing the storage unit when the peak detection unit detects a first time of flight, which is the time of flight of the peak, using the histogram; the light receiving intensity within the predetermined time including the flight time of the reflected light corresponding to the second pulse light from the second to the final emission is sequentially integrated for each emission and stored in the storage unit to generate the histogram, and when the peak detection unit detects a second flight time, which is the flight time of the peak, using the histogram, the storage unit is cleared; The distance image generating unit generating the first distance image using the first distance calculated based on the first time-of-flight; A distance measuring device that generates the second distance image using the second distance calculated based on the second time of flight.
10. 9. The distance measuring device according to claim 8, A memory unit (260) that stores the received light intensity at each of the plurality of flight times, the light emitting unit emits the first pulsed light as a first emission of the pulsed light, and emits the second pulsed light as second to final emissions of the pulsed light, the histogram generation unit sequentially integrates the received light intensities within a predetermined time period including a flight time of the reflected light corresponding to the first to final emitted pulsed light for each emission, and stores the integrated light intensities in the storage unit to generate the histogram; The peak detection unit When the received light intensity within the predetermined time period including the time of flight of the reflected light corresponding to the first pulse light is stored in the storage unit and the histogram is generated, the histogram is used to detect the first time of flight of the peak, the received light intensity within the predetermined time including the flight time of the reflected light corresponding to the first pulsed light or the second pulsed light from the first to the final emission is sequentially integrated for each emission and stored in the storage unit to generate the histogram, the histogram is used to detect the second flight time of the peak, The distance image generating unit generating the first distance image using the first distance calculated based on the first time-of-flight; A distance measuring device that generates the second distance image using the second distance calculated based on the second time of flight.
11. 6. The distance measuring device according to claim 5, The distance image generating unit A first high intensity region (A1) in which the received light intensity is equal to or greater than a first threshold intensity is identified in the first distance image; A second high intensity region (A10) in which the received light intensity is equal to or greater than a second threshold intensity is identified in the second distance image; identifying a region other than a region (Ar1) corresponding to the first high intensity region in the second high intensity region in the second distance image as a flare region (Af1) that represents a flare; A distance measuring device that obtains an image of the second distance image excluding the flare region as the integrated distance image.
12. 10. The distance measuring device according to claim 9, the control unit, after a first emission of the first pulsed light and before a second emission of the second pulsed light, uses the first distance calculated based on the first time-of-flight to identify a high-reflection orientation, which is an orientation based on the distance measuring device of an area of a predetermined size including a highly reflective object having a reflectance higher than a predetermined value; The histogram generation unit For directions other than the high reflection direction, the received light intensity within the predetermined time period including the flight time of the reflected light corresponding to the second pulse light from the second pulse light to the final pulse light is sequentially integrated for each emission, and the histogram is generated by storing the integrated light intensity in the storage unit; For the high reflection orientation, the distance measuring device sequentially accumulates the received light intensity within the specified time, including the flight time of the reflected light corresponding to the second pulse light from the second emission to the emission before the final emission, for each emission, and stores the intensity in the memory unit to generate the histogram.
13. 11. The distance measuring device according to claim 10, the control unit, after a first emission of the first pulsed light and before a second emission of the second pulsed light, uses the first distance calculated based on the first time-of-flight to identify a high-reflection orientation, which is an orientation based on the distance measuring device of an area of a predetermined size including a highly reflective object having a reflectance higher than a predetermined value; The histogram generation unit For other orientations different from the high reflection orientation, the received light intensities within the predetermined time period including the flight times of the reflected light corresponding to the first pulsed light or the second pulsed light from the first to the final emission are sequentially integrated for each emission and stored in the storage unit to generate the histogram, and the histogram is used to detect the second flight time of the peak, For the high reflection orientation, the received light intensity within the specified time, including the flight time of the reflected light corresponding to the first pulse light or the second pulse light from the first emission to the emission before the final emission, is sequentially accumulated for each emission and stored in the memory unit to generate the histogram, and the ranging device detects the second flight time of the peak using the histogram.
14. A distance measuring device according to claim 5 dependent on claim 3, The distance image generating unit a first partial image showing a position and a distance to a reflector, the position being within a first threshold distance from the distance measuring device, of the first distance image; a second partial image showing a position and a distance to a reflector that is present at a distance from the distance measuring device that is longer than a second threshold distance in the second distance image; generating the integrated range image by combining A distance measuring device, wherein the first threshold distance is greater than the second threshold distance.
15. A distance measuring device according to claim 2, the light-emitting unit has a first irradiation mode in which a first irradiation region of a predetermined size is irradiated with the second pulsed light while scanning the first irradiation region, and a second irradiation mode in which the first pulsed light is irradiated to a second irradiation region corresponding to a scanning range in the first irradiation mode, The control unit causes the light emitting unit to irradiate the first pulsed light by operating in the second irradiation mode, and causes the light emitting unit to irradiate the second pulsed light by operating in the first irradiation mode.
Citation Information
Patent Citations
Distance measurement device
JP2014163884A
Object detection device, sensing device, and movable body device
JP2016176721A
Time measuring device, distance measuring device, mobile entity, time measurement method, and distance measurement method
JP2019039715A
Optical distance measuring device and method therefor
JP2019211358A
Accurate photo detector measurements for lidar
US20180259645A1
