Distance measuring imaging device

Abstract

A distance measurement and imaging device (10), wherein: a drive control unit (3) generates an exposure control signal including a first exposure control pulse, second exposure control pulse, and third exposure control pulse that are based on the timing of a light emission control pulse; the time difference between the third exposure control pulse and the light emission control pulse is larger than the time difference between the second exposure control pulse and the light emission control pulse; the time difference between the second exposure control pulse and the light emission control pulse is larger than the time difference between the first exposure control pulse and the light emission control pulse; and an imaging unit (2) outputs a first exposure signal indicating the signal charge amount generated from the exposure caused by the first exposure control pulse, a second exposure signal indicating the signal charge amount generated from the exposure caused by the second exposure control pulse, and a third exposure signal indicating the signal charge amount generated from the exposure caused by the third exposure control pulse.

Description

[Technical field]

[0001] The present disclosure relates to a distance measuring imaging device. [Background technology]

[0002] Patent Document 1 discloses a distance measuring imaging device that measures the distance to an object by irradiating the object with pulsed light and receiving the light reflected from the object. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] International Publication No. 2017 / 150246 Summary of the Invention [Problem to be solved by the invention]

[0004] According to the conventional technology, there is a problem that the distance measurement accuracy deteriorates in a multipath environment that includes not only direct reflected light from the target object but also indirect reflected light.

[0005] The present disclosure provides a ranging imaging device that reduces degradation of ranging accuracy in a multipath environment. [Means for solving the problem]

[0006] A distance measuring imaging device according to one aspect of the present disclosure is a distance measuring imaging device that measures a distance to an object by irradiating a pulsed light and receiving reflected light from the object, and includes a drive control unit that outputs an emission control signal including an emission control pulse that instructs emission of light and an exposure control signal including an exposure control pulse that instructs exposure of light, a light source unit that irradiates the pulsed light at the timing of the emission control pulse, an imaging unit that exposes the reflected light from the object of the irradiated pulsed light at the timing of the exposure control pulse and outputs an exposure signal indicating an amount of signal charge generated by the exposure, and a calculation unit that uses the exposure signal as an input to perform distance calculation and output a distance image, and the drive control unit controls the timing of the emission control pulse to an exposure control signal including a first exposure control pulse, a second exposure control pulse, and a third exposure control pulse based on timing, a time difference between the third exposure control pulse and the light-emitting control pulse is larger than a time difference between the second exposure control pulse and the light-emitting control pulse, and a time difference between the second exposure control pulse and the light-emitting control pulse is larger than a time difference between the first exposure control pulse and the light-emitting control pulse, and the imaging unit outputs a first exposure signal indicating an amount of signal charge generated by exposure using the first exposure control pulse, a second exposure signal indicating an amount of signal charge generated by exposure using the second exposure control pulse, and a third exposure signal indicating an amount of signal charge generated by exposure using the third exposure control pulse. Effect of the Invention

[0007] According to the distance measuring imaging device according to the present disclosure, it is possible to reduce degradation of distance measuring accuracy in a multipath environment. [Brief description of the drawings]

[0008] [Figure 1] FIG. 1 is a block diagram showing an example of the configuration of a distance measuring imaging device according to the first embodiment. [Figure 2A] FIG. 2A is a timing chart showing an example of signal waveforms of a light emission control signal and an exposure control signal of the distance measuring image pickup device according to the first embodiment. [Figure 2B] FIG. 2B is a timing chart showing other example signal waveforms of the light emission control signal and the exposure control signal of the distance measuring image pickup device according to the first embodiment. [Diagram 3] FIG. 3 is a diagram showing an example of signal waveforms of the light emission control signal and the exposure control signal in FIG. 2A during the A0 period, the A1 period, and the BG period. [Figure 4] FIG. 4 is a diagram showing the relationship between the light emission control signal and the exposure control signal of the distance measuring image pickup device according to the first embodiment and the measured distance D. In FIG. [Diagram 5] FIG. 5 is a block diagram showing an example of the configuration of a distance measuring imaging device according to the second embodiment. [Figure 6A] FIG. 6A is a timing chart showing an example of the operation of the distance measuring imaging device according to the second embodiment. [Figure 6B] FIG. 6B is a timing chart showing another operation example of the distance measuring imaging device according to the second embodiment. [Figure 7] FIG. 7 is a diagram showing signal waveforms of the light emission control signal and the exposure control signal in FIG. 6A according to the second embodiment in the A0 period, the A1 period, and the BG period of frame A. In FIG. [Figure 8] FIG. 8 is a diagram showing signal waveforms of the light emission control signal and the exposure control signal in FIG. 6A according to the second embodiment in the bA0 period, the bA1 period, and the bBG period of frame B. In FIG. [Figure 9A] FIG. 9A is a diagram showing the time relationship between direct reflected light and indirect reflected light from a target object and the A0 and A1 exposure control signals, and the relationship between the actual distance and measured distance D in frame A of the distance measuring image pickup device according to the second embodiment. [Figure 9B] 9B is a diagram showing the time relationship between the accommodated reflected light and indirect reflected light from the target object and the A0 and A1 exposure control signals, and the relationship between the actual distance and the measured distance D in frame B of the distance measuring imaging device according to the second embodiment. [Figure 9C] Figure 9C is a diagram showing the time relationship between direct reflected light and indirect reflected light and the A0 and A1 exposure control signals from another target object in frame B of the distance measuring imaging device of embodiment 2, and another relationship between the actual distance and measured distance D. [Figure 10] FIG. 10 is a timing chart showing another driving of the distance measuring image pickup devices according to the first and second embodiments, showing outputs in the A0 period, the A1 period, and the BG period. [Figure 11]FIG. 11 is a timing chart showing the driving of the distance measuring imaging devices according to the first and second embodiments, and shows other outputs in the A0 period, the A1 period, and the BG period. [Figure 12] FIG. 12 is a timing chart showing the driving of the distance measuring imaging devices according to the first and second embodiments, and shows other outputs in the A0 period, the A1 period, and the BG period. [Figure 13A] FIG. 13A is an explanatory diagram showing pixel identification signals of the distance measuring imaging device according to the embodiment. [Figure 13B] FIG. 13B is an explanatory diagram showing pixel identification signals of the distance measuring imaging device according to the embodiment. [Figure 14] FIG. 14 is a timing chart showing the driving of the distance measuring image pickup devices according to the first and second embodiments. [Figure 15] FIG. 15 is a timing chart showing the driving of the distance measuring image pickup devices according to the first and second embodiments. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0009] (Findings on which this disclosure is based) The present inventor has found that the following problems occur with the distance measuring imaging device described in the "Background Art" section.

[0010] In the conventional TOF distance measurement method, the irradiation light emitted from the light source usually has a spread of about 20 degrees to 150 degrees. When there is a reflective object such as a wall, ceiling, or obstacle near the target object and the distance measurement imaging device, a part of the spread irradiation light passes through the reflective object and is reflected by the target object, and returns to the distance measurement imaging device as indirect reflected light. As a result, the intensity of the reflected light observed by the distance measurement imaging device is exposed as a mixture of both high-intensity direct reflected light and low-intensity indirect reflected light. Since the indirect reflected light has a longer flight distance than the direct reflected light, it returns to the distance measurement imaging device later than the direct reflected light. At this time, the observed distance between the distance measurement imaging device and the target object is observed to be farther than the actual distance derived by the direct reflected light due to the indirect reflected light being mixed. Thus, in a multipath environment, the indirect reflected light causes measurement errors, and there is a problem that the measured distance is greater than the actual distance.

[0011] In order to solve such problems, a distance measuring imaging device according to one aspect of the present disclosure is a distance measuring imaging device that measures the distance to an object by irradiating a pulsed light and receiving reflected light from the object, and includes a drive control unit that outputs an emission control signal including an emission control pulse that instructs emission of light and an exposure control signal including an exposure control pulse that instructs exposure of light, a light source unit that irradiates the pulsed light at the timing of the emission control pulse, an imaging unit that exposes the reflected light from the object of the irradiated pulsed light at the timing of the exposure control pulse and outputs an exposure signal indicating an amount of signal charge generated by the exposure, and a calculation unit that performs distance calculation using the exposure signal as an input and outputs a distance image, and the drive control unit an exposure control signal including a first exposure control pulse, a second exposure control pulse, and a third exposure control pulse based on the timing of an emission control pulse is generated, a time difference between the third exposure control pulse and the emission control pulse is greater than a time difference between the second exposure control pulse and the emission control pulse, and a time difference between the second exposure control pulse and the emission control pulse is greater than a time difference between the first exposure control pulse and the emission control pulse, and the imaging unit outputs a first exposure signal indicating an amount of signal charge generated by exposure using the first exposure control pulse, a second exposure signal indicating an amount of signal charge generated by exposure using the second exposure control pulse, and a third exposure signal indicating an amount of signal charge generated by exposure using the third exposure control pulse.

[0012] As a result, within a predetermined distance measurement range, the first exposure signal and the second exposure signal can contain signal charges mainly corresponding to direct reflected light, and the third exposure signal can contain signal charges mainly corresponding to indirect reflected light. Therefore, if the distance measuring imaging device calculates the distance using not only the first exposure signal and the second exposure signal, but also the third exposure signal, it is possible to reduce deterioration of distance measurement accuracy in a multipath environment.

[0013] For example, the calculation section may output distance information based on a ratio of a signal charge amount of the second exposure signal to a total of signal charge amounts of the first exposure signal, the second exposure signal, and the third exposure signal.

[0014] This results in the above for the total of Based on the ratio, distance information with reduced degradation in distance measurement accuracy can be easily calculated.

[0015] For example, the drive control section may generate the first exposure control pulse and the third exposure control pulse in correspondence with the single common light emission control pulse.

[0016] This allows the first and third exposure signals to be obtained by performing two exposures for one light emission. At this time, the signal charge of the indirectly reflected light can be obtained from the third exposure signal.

[0017] For example, the drive control unit may generate the first exposure control pulse in correspondence with one of the light emission control pulses, generate the second exposure control pulse in correspondence with one of the light emission control pulses, and generate the third exposure control pulse in correspondence with one of the light emission control pulses.

[0018] As a result, a first exposure signal can be obtained by exposing once for one light emission. Similarly, a second exposure signal can be obtained by exposing once for one light emission. Also, a third exposure signal can be obtained by exposing once for one light emission. In this way, the first exposure signal, the second exposure signal, and the third exposure signal can be obtained by simple control of exposing once for one light emission. Since the third exposure signal mainly contains signal charges corresponding to indirect reflected light, it is possible to reduce deterioration of distance measurement accuracy in a multipath environment.

[0019] For example, the exposure control signal may include a fourth exposure control pulse, a time difference between the fourth exposure control pulse and the light emission control pulse being greater than a time difference between the third exposure control pulse and the light emission control pulse, and the drive control unit may generate the first exposure control pulse and the third exposure control pulse so as to correspond to a common single light emission control pulse, and generate the second exposure control pulse and the fourth exposure control pulse so as to correspond to a common single light emission control pulse.

[0020] In this way, by performing two exposures for one emission of light, a first exposure signal and a third exposure signal can be obtained. Similarly, by performing two exposures for one emission of light, a second exposure signal and a fourth exposure signal can be obtained. The operation of obtaining the first exposure signal and the third exposure signal and the operation of obtaining the second exposure signal and the fourth exposure signal result in: Two flashes for one flash Since the two operations described above use the same control sequence, ie, exposure, there is no significant difference in, for example, fluctuations in the power supply voltage, and the like, it is possible to further reduce deterioration of distance measurement accuracy.

[0021] For example, the calculation unit may output the distance information based on a ratio of a second sum obtained by adding up the signal charge amounts of the second exposure signal and the fourth exposure signal to a first sum obtained by adding up the signal charge amounts of the first exposure signal, the second exposure signal, the third exposure signal, and the fourth exposure signal.

[0022] This makes it possible to obtain distance information with reduced degradation in distance measurement accuracy by using the first exposure signal, the second exposure signal, the third exposure signal, and the fourth exposure signal.

[0023] For example, the calculation unit may output the distance information based on a ratio of the signal charge amount of the second exposure signal to a total obtained by adding up the signal charge amounts of the first exposure signal, the second exposure signal, the third exposure signal and the fourth exposure signal.

[0024] This allows the signal charge amount of the second exposure signal to be used instead of the second sum obtained by adding up the signal charge amounts of the second exposure signal and the fourth exposure signal, thereby also allowing distance information to be obtained with reduced degradation in distance measurement accuracy.

[0025] For example, the drive control unit may input an identification signal that specifies one of a plurality of operating modes including a first operating mode and a second operating mode, and when the identification signal specifies the first operating mode, control distance measurement by a first operation using the exposure control signal including the first exposure control pulse to a third exposure control pulse, and when the identification signal specifies the second operating mode, control distance measurement by a second operation different from the first operation.

[0026] With this, distance measurements are performed in both the first operation mode and the second operation mode, so that distance information with smaller measurement error can be selected.

[0027] For example, the distance image generation unit may generate a multipath detection signal indicating the presence or absence of multipath based on first distance information obtained in the first operation and second distance information obtained in the second operation, and further output the multipath detection signal indicating the magnitude of error contained in the first distance information or the second distance information based on the difference between the first distance information and the second distance information.

[0028] This makes it possible to detect the presence or absence of multipath and the magnitude of error due to multipath.

[0029] For example, the distance image generating unit may generate a multipath detection signal indicating the presence or absence of multipath based on first distance information obtained in the first operation and second distance information obtained in the second operation.

[0030] This makes it possible to detect the presence or absence of multipath.

[0031] For example, the distance image generation unit may output the multipath detection signal indicating the magnitude of an error contained in the first distance information or the second distance information based on a difference between the first distance information and the second distance information.

[0032] This makes it possible to detect the magnitude of the error due to multipath.

[0033] For example, in the second operating mode, the drive control unit may generate the exposure control signal including a first pulse and a second pulse as the exposure control pulse, and the time difference between the second pulse and the light emission control pulse may be greater than the time difference between the first pulse and the light emission control pulse.

[0034] Thereby, the second operation mode may be, for example, a distance measurement operation similar to the conventional one.

[0035] For example, the imaging section may output a preceding exposure signal indicating an amount of signal charge generated by exposure with the first pulse, and a following exposure signal indicating an amount of signal charge generated by exposure with the second pulse.

[0036] This makes it possible to calculate the distance from the leading exposure signal and the trailing exposure signal in the second operation mode.

[0037] For example, the calculation section may output the distance information based on a ratio of a signal charge amount of the trailing exposure signal to a sum of signal charge amounts of the preceding exposure signal and the trailing exposure signal.

[0038] As a result, in the second operation mode, distance information is calculated based on the above ratio. By combining the second operation mode and the first operation mode, distance information with reduced degradation in distance measurement accuracy can be derived.

[0039] For example, the distance image generation unit may generate the distance image based on adding a distance value indicated by first distance information obtained in the first action and a distance value indicated by second distance information obtained in the second action.

[0040] In this way, the average may be calculated from the sum of the first distance information and the second distance information.

[0041] For example, the drive control unit may repeatedly execute an exposure process in which the first exposure control pulse and the third exposure control pulse are generated in correspondence with a common single light emission control pulse, and thin out the first exposure control pulse or the third exposure control pulse in a predetermined number of the multiple exposure processes.

[0042] As a result, when the first exposure control pulse is thinned out for a predetermined number of operations among multiple repetitions of the operation of exposing twice for one light emission, more indirect reflected light can be exposed, thereby improving the accuracy of multi-path detection.

[0043] For example, the drive control unit may repeatedly execute a first exposure process in which the first exposure control pulse and the third exposure control pulse are generated to correspond to a common single light-emission control pulse, and repeatedly execute a second exposure process in which the second exposure control pulse and the fourth exposure control pulse are generated to correspond to a common single light-emission control pulse, and may thin out the first exposure control pulse and the second exposure control pulse, or the third exposure control pulse and the fourth exposure control pulse, in a predetermined number of corresponding first exposure processes and second exposure processes among the multiple times.

[0044] As a result, when the first exposure control pulse or the second exposure control pulse is thinned out after a predetermined number of operations out of multiple repetitions of the operation of exposing twice for one light emission, the load on the drive control unit 3 that generates the exposure control pulse is reduced, making it possible to supply a steeper exposure control pulse and improve the distance measurement accuracy.

[0045] For example, the drive control unit may generate the light emission control signal so that a duty ratio corresponding to a light emission pulse period is 33% or less.

[0046] This allows the pulsed light to have a high intensity relative to the background light, and improves light resistance, which is a distance measurement performance.

[0047] For example, the calculation unit may calculate and output the distance information using the TOF principle.

[0048] This outputs distance information based on the TOF principle.

[0049] These comprehensive or specific aspects may be realized by a system, a method, an integrated circuit, or a computer program, or may be realized by any combination of a system, a method, an integrated circuit, and a computer program.

[0050] Hereinafter, the embodiments will be described in detail with reference to the drawings. Note that each of the embodiments described below shows a specific example of the present disclosure. The numerical values, shapes, materials, components, arrangement positions and connection forms of the components, drive timing, etc. shown in the following embodiments are examples and are not intended to limit the present disclosure. In addition, among the components in the following embodiments, components that are not described in the independent claims showing the highest concept of the present disclosure will be described as optional components. In addition, each figure is not necessarily a strict illustration. In each figure, duplicated explanations of substantially the same configuration are omitted or simplified.

[0051] (Embodiment 1) FIG. 1 is a block diagram showing an example of the configuration of a distance measuring image-taking device 10 according to the first embodiment. In addition to the distance measuring image-taking device 10, a target object and a reflecting object are also shown in the figure. The target object is an example of an object for distance measurement. The reflecting object generates indirect reflected light and is an example of a multipath environment. The distance measuring image-taking device 10 includes a light source unit 1 The time of flight (TOF) of the light from the imaging unit 2 until the light is directly reflected by the target object and returns to the imaging unit 2 as directly reflected light is defined as the time of flight (TOF) of the light from the imaging unit 2. 2 The distance is calculated from the amount of signal exposed by the light source 1, and then multiplied by an appropriate coefficient to derive the distance. For this purpose, the distance measuring imaging device 10 includes a light source unit 1, an imaging unit 2, a drive control unit 3, and a calculation unit 5.

[0052] The light source unit 1 irradiates pulsed light at the timing of a light emission control pulse included in a light emission control signal from the drive control unit 3. When there are people around, it is preferable that the pulsed light be infrared light, but if not, light other than infrared light may be used.

[0053] The imaging unit 2 exposes the object irradiated with the pulsed light to the reflected light at the timing of the exposure control pulse, and outputs an exposure signal indicating the amount of signal charge generated by the exposure. The imaging unit 2 includes a solid-state imaging element called an image sensor. The imaging unit 2 captures an image with a resolution of, for example, about 20,000 pixels to 2 million pixels.

[0054] The drive control unit 3 outputs a light emission control signal including a light emission control pulse that indicates the timing of light emission, and an exposure control signal including an exposure control pulse that indicates the timing of exposure. FIG. 2A is a timing diagram showing an example of signal waveforms of the light emission control signal and the exposure control signal of the distance measuring imaging device 10 according to the first embodiment. In the example of FIG. 2A, the light emission control signal includes a light emission control pulse of positive logic. The light emission control pulse causes the light source 1 to emit light when it is at a high level. The exposure control signal includes an exposure control pulse of negative logic. The exposure control pulse causes the imaging unit 2 to be exposed when it is at a low level. In the figure, exposure processing is performed in each of the A0 period, the A1 period, and the BG period. The timing of combining light emission and exposure is different between the A0 period and the A1 period. The BG period is a period for exposing to background light, and only exposure is performed without light emission. In the A0 period, the light emission control signal is a signal having a light emission control pulse that is repeated n times. Therefore, the combination of light emission and exposure is also repeated n times. The number n may be an integer of 2 or more, for example, several tens to several tens of thousands of times. The same applies to the light emission control signal in the A1 period. The drive control unit 3 may generate the light emission control signal and the exposure control signal as shown in Fig. 2B instead of Fig. 2A. In Fig. 2B, the unit process repeated n times is not consecutive, and the unit process in the A0 period, the unit process in the A1 period, and the unit process in the B period are each performed once, and are repeated m times.

[0055] The drive control unit 3 generates an exposure control signal including a first exposure control pulse, a second exposure control pulse, a third exposure control pulse, and a fourth exposure control pulse based on the timing of the light emission control pulse. Here, the time difference between the fourth exposure control pulse and the light emission control pulse is greater than the time difference between the third exposure control pulse and the light emission control pulse. The time difference between the third exposure control pulse and the light emission control pulse is greater than the time difference between the second exposure control pulse and the light emission control pulse. The time difference between the second exposure control pulse and the light emission control pulse is greater than the time difference between the first exposure control pulse and the light emission control pulse. The first exposure control pulse and the third exposure control pulse are included in the unit processing of the A0 period. The second exposure control pulse and the fourth exposure control pulse are included in the unit processing of the A1 period.

[0056] The imaging unit 2 outputs a first exposure signal indicating the amount of signal charge generated by exposure using the first exposure control pulse, a second exposure signal indicating the amount of signal charge generated by exposure using the second exposure control pulse, and a third exposure signal indicating the amount of signal charge generated by exposure using the third exposure control pulse.

[0057] The calculation unit 5 outputs distance information based on the ratio of the signal charge amount of the second exposure signal to the total signal charge amount of each of the first exposure signal, the second exposure signal, and the third exposure signal. This makes it possible to suppress deterioration of accuracy of the distance information due to multipath. This is because part of the indirectly reflected light in a multipath environment is included in the third exposure signal, thereby suppressing errors.

[0058] In addition, the first exposure signal Number O The signal charge amount of the first and second exposure signals is the sum of the signal charge amounts of the first and second exposure signals, and is expressed as A0, which is the signal charge amount obtained by repeating unit processing in the A0 period. The signal charge amount of the second exposure signal is expressed as A1, which is the signal charge amount obtained by repeating unit processing in the A1 period. The calculation unit 5 calculates distance information based on A1 / (A0+A1). However, the signal charge amounts of A0 and A1 in this formula are those from which the signal charge amount of the background light obtained in the BG period has been subtracted. The signal charge amount A in this formula 0In the present disclosure, since the third exposure signal corresponding to a portion of the indirectly reflected light is included, deterioration in accuracy due to multipath can be suppressed compared to the conventional technology.

[0059] The pulsed light is emitted intermittently at a low frequency. For example, the duty ratio of the pulsed light emission may be 33% or less. This allows the pulsed light to have a high intensity relative to background light from the surrounding sun or lighting, improving light resistance, which is a feature of distance measurement performance.

[0060] The calculation unit 5 receives the exposure signal as an input and outputs distance information by TOF calculation.

[0061] Next, the operation of the distance measuring imaging device 10 according to the first embodiment will be described.

[0062] FIG. 2A is a timing chart showing an example of the operation of the distance measuring imaging device according to the first embodiment.

[0063] As shown in FIG. 2A, the drive control unit 3 outputs a light emission control signal and an exposure control signal, and the light source unit 1 outputs pulsed light when the light emission control signal is at a high level.

[0064] The order of the exposure periods A0, A1, and BG may be interchanged, or as shown in FIG. 2B, each exposure period may be shortened to 1 / m, which corresponds to a unit process, and a unit process set of A0 period / m, A1 period / m, and BG period / m may be repeated m times. Here, n is an integer of 2 or more. m is an integer of 2 or more and n or less. In this case, the time difference between the three exposure signals A0, A1, and BG used in the distance measurement calculation is shortened to 1 / m, which has the effect of enabling accurate distance measurement calculation even if the target object is moving.

[0065] Note that the exposure signals A0 and A1 contain BG, and the components obtained by subtracting BG are the net signal amounts of the irradiated light.

[0066] The calculation unit 5 also outputs the measured distance D for each pixel by the formula: measured distance D=(A1-BG) / [(A0-BG)+(A1-BG)]. The measured distance D indicates a normalized distance value that ranges from 0 to 1.

[0067] FIG. 3 shows in detail a part of the outputs of the light emission control signal and the exposure control signal in the A0 period, the A1 period, and the BG period in FIG. 2A and FIG. 2B.

[0068] The exposure control signal has three phase relationships with the light emission control signal. Dew Light control signals A0e, A1e, and BGe are output. During the A0 and A1 periods, light emission control Pulse Basically, two exposure control pulses are output for one. During the BG period, the light emission control signal is always at low level (no light emission). Hereinafter, low level may be abbreviated as L and high level as H.

[0069] A major difference from the driving method of the conventional distance measuring imaging device is that each of the exposure control signals A0e, A1e, and BGe is composed of two consecutive exposure control pulses (A0e0, A0e1, A1e0, A1e1, BGe0, BGe1). The exposure control pulse A0e0 is a specific example of a first exposure control pulse. The exposure control pulse A1e0 is a specific example of a second exposure control pulse. The exposure control pulse A0e1 is a specific example of a third exposure control pulse. The exposure control pulse A1e1 is a specific example of a fourth exposure control pulse.

[0070] FIG. 4 is a distance measuring imaging device according to the first embodiment. 104 shows the relationship between the light emission control signal and the measured distance D. FIG. 4 shows a case where a reflective object is present between the light source unit 1 and the target object, and not only direct reflected light but also indirect reflected light is irradiated onto the imaging unit 2, causing a multipath problem. This is a diagram showing the time relationship between the direct reflected light pulse DP and the indirect reflected light pulse MP from the target object and the exposure control signals A0e and A1e, as well as the relationship between the actual distance and the measured distance D. In FIG. 4, the exposure control signals A0e and A1e are shown together for ease of understanding, but in the A0 period, a unit process is carried out that combines the light emission control signal and the exposure control signal A0e. In the A1 period, the light emission control signal and the exposure control signal A 1 A unit process is performed in which the distance DDP is combined with the distance e. In the figure, the distance DDP indicates an example of the actual distance of the object when it can be measured using only direct reflected light. The distance D1MP indicates an example of the distance measured in this embodiment when direct reflected light and indirect reflected light are mixed. The distance DMP indicates an example of the distance measured by the conventional technology when direct reflected light and indirect reflected light are mixed.

[0071] The light pulse emitted from the light source unit 1 is divided into direct reflected light DP, which is directly reflected by the target object, and indirect reflected light MP, which is reflected by the target object via surrounding reflecting objects, and is then incident on the imaging unit 2. At this time, the indirect reflected light MP has a longer flight time than the direct reflected light DP due to the longer round-trip optical path length, and the light intensity decreases due to multiple scattered reflections.

[0072] For these reflected light pulses DP and MP, the imaging unit 2 measures the exposure signal A0DP mainly due to direct reflected light DP when the first pulse A0e0 of the exposure control signal A0e is L, and measures the exposure signal A0MP mainly due to indirect reflected light MP when the second pulse A0e1 of the exposure control signal A0e is L. In addition, when the first pulse A1e0 of the exposure control signal A1e is L, it measures both the exposure signal A1DP due to direct reflected light DP and the exposure signal A1MP due to indirect reflected light MP.

[0073] In this case, A0DP, A0MP, A1DP, and A1MP are all net exposure signals after subtracting BG. Based on these exposure signals, the measurement distance D1MP for each pixel when multipath exists is output by (A1DP+A1MP) / [(A0DP+A0MP)+(A1DP+A1MP)].

[0074] When the directly reflected light DP flies for the same time as the L period of the first pulse A0e0 of the exposure control signal A0e, the exposure signal A0DP=0 and the measured distance D1MP=1, and when it flies for a longer time, D1MP decreases again from 1 to 0. Therefore, in the first embodiment, when the L period of the first pulse A0e0 of the exposure control signal A0e is 10 nsec, for example, the round trip flight distance of light from 0 to 1 when D1MP is 1 is about 3 m (=speed of light 3.0E8 m / s × 10 nsec), so the measurable range is about 1.5 m for that one way trip, the same as in the conventional example.

[0075] In the distance measurement method of this embodiment, the exposure signal A1MP due to the indirect reflected light MP is added to the exposure signal A1DP due to the direct reflected light DP, and at the same time, the exposure signal A0MP due to the indirect reflected light MP is added to the exposure signal A0DP due to the direct reflected light DP. By adding this exposure signal A0MP to A0DP, the denominator of the measured distance D1MP becomes larger, and the target object is observed closer than the measured distance DMP in the conventional example, and it is possible to reduce the error of the conventional distance measurement method in which the target object is observed far away due to multipath.

[0076] It should be noted that the second pulses A1e1, BGe1 of the exposure control signals A1e and BGe are applied to align the exposure control signal A0e and BG signal amounts to improve the calculation accuracy of the measured distance D1, but this is not essential. Even if the second pulses A1e1, BGe1 are eliminated to simplify the exposure control, the errors in the distance measurement method of the conventional example can be reduced.

[0077] The first pulse A0e0 of the exposure control signal A0e is a specific example of a first exposure control pulse, and the second pulse A0e1 is a specific example of a third exposure control pulse. The first pulse A1e0 of the exposure control signal A1e is a specific example of a second exposure control pulse, and the second pulse A1e1 is a specific example of a fourth exposure control pulse.

[0078] (Embodiment 2) In this embodiment, a distance measuring imaging device 10 will be described which performs distance measurement in each of a first operation mode and a second operation mode, and obtains distance information with small measurement error by combining or selecting the two pieces of distance information.

[0079] FIG. 5 is a diagram showing the configuration of a distance measuring imaging device 10 according to the second embodiment.

[0080] A distance measuring imaging device 10 in the figure differs from the configuration in Figure 1 in that a frame control unit 4 and a frame synthesis unit (distance image generation unit) 6 are added. The following mainly describes the differences.

[0081] The frame control unit 4 outputs L as a frame identification signal for the Nth frame and H for the (N+1)th frame. The frame corresponding to the frame identification signal of L is called frame A. The frame corresponding to the frame identification signal of H is called frame B. In frame A, the first operation mode, that is, the same operation as in embodiment 1, is performed. In frame B, the second operation mode is performed.

[0082] The distance image generating unit 6 generates distance information with small measurement error by combining or selecting the distance information measured in the first operation mode and the distance information measured in the second operation mode.

[0083] From the imaging unit 2, three types of exposure signals (A0DP+A0MP), (A1DP+A1MP), and BG, in which an exposure signal due to direct reflected light is superimposed on an exposure signal due to indirect reflected light, are output to the calculation unit 5. Next, the operation of the distance measuring imaging device 10 according to the second embodiment will be described.

[0084] As shown in FIG. 6A, the frame control unit 4 outputs a frame identification signal of L for the Nth frame (frame A) and H for the N+1th frame (frame B). The drive control unit 3 receives the frame identification signal as input and outputs a light emission control signal and an exposure control signal. The light source unit 1 outputs irradiation light when the light emission control signal is H.

[0085] The L and H of the frame identification signal may be reversed, and the light emission control signal includes several tens to several tens of thousands of light emission control pulses. The irradiated light corresponding to the light emission control pulses may be pulsed light.

[0086] It is more preferable that the pulsed light be a low-frequency intermittent light emission, which makes it possible to make the irradiated light (pulsed light) stronger than the background constant light coming from the surrounding sun or lighting, thereby improving the light resistance, which is the distance measurement performance.

[0087] Furthermore, the imaging unit 2 has an image sensor (a solid-state imaging element that captures images with a resolution of, for example, about 20,000 to 2 million pixels) and performs exposure to reflected light, which is light that is irradiated light reflected by the target object, only during the period when the exposure control signal is L. The total amount of exposure during the L period is photoelectrically converted by the imaging unit 2 and exposure signals A0, A1, and BG are output for each pixel.

[0088] The order of the exposure periods A0, A1, and BG may be interchanged, or the exposure period may be shortened to 1 / m, and a set of A0 period / m, A1 period / m, and BG period / m may be repeated m times, as shown in Fig. 6B. In this case, the time difference between the three exposure signals A0, A1, and BG used in the distance measurement calculation is shortened to 1 / m, which has the effect of enabling accurate distance measurement calculation even if the target object is moving.

[0089] Note that the exposure signals A0 and A1 contain BG, and the components obtained by subtracting BG are the net signal amounts of the irradiated light.

[0090] Moreover, the calculation unit 5 outputs the measured distance D for each pixel by the measured distance D=(A1-BG) / [(A0-BG)+(A1-BG)].

[0091] In addition, the frame synthesis unit 6 sets the threshold T of the measured distance D to approximately 0.3, and when the measured distance of frame B is less than the threshold T, multiplies the measured distance of frame A by a specific coefficient (for example, La = approximately 1500 mm) for each pixel, and outputs it as a distance image.

[0092] Furthermore, when the measured distance of frame B is greater than or equal to the threshold value T, the measured distance of frame B is multiplied by a specific coefficient (for example, Lb=approximately 4500 mm) and output as a distance image.

[0093] Also, the difference between the result of multiplying the measured distance in frame A by a specific coefficient La and the result of multiplying the measured distance in frame B by a specific coefficient Lb is output as a multipath detection signal.

[0094] FIG. 7 shows in detail a part of the outputs of the light emission control signals and exposure control signals in FIGS. 6A and 6B during the A0 period, the A1 period, and the BG period of frame A. In FIG.

[0095] The exposure control signal is output as exposure control signals A0e, A1e, and BGe in three patterns of phase relationship with respect to the light emission control signal. Pulse Two exposure controls versus one Pulse The light emission control signal during the BG period is always L (no light emission).

[0096] The major difference from the driving method of conventional distance measuring imaging devices is that, similar to embodiment 1, the exposure control signals A0e, A1e, and BGe are each composed of two consecutive exposure control pulses (A0e0 and A0e1, A1e0 and A1e1, and BGe0 and BGe1).

[0097] Next, Fig. 8 shows in detail a part of the outputs of the light emission control signals and the exposure control signals in Fig. 6A and Fig. 6B during the bA0 period, the bA1 period, and the bBG period of frame B. Fig. 8 corresponds to the second operation mode.

[0098] The exposure control signal shown in Fig. 8 outputs exposure control signals bA0e, bA1e, and bBGe0 in three patterns of phase relationship with respect to the light emission control signal. In the bA0 period and the bA1 period, one exposure control pulse is output for one light emission control pulse. In the BG period, the light emission control signal is always L (no light emission).

[0099] Next, multipath detection will be described in detail.

[0100] 9A and 9B show a case where a reflecting object exists between the light source unit 1 and the target object, and not only the direct reflected light but also the indirect reflected light is irradiated to the imaging unit 2, causing a multipath problem. The figures show the time relationship between the direct reflected light pulses DP and bDP from the target object, the reflected light pulses MP and bMP, and the A0e, A1e, bA0e, and bA1e exposure control signals, and the relationship between the actual distance and the measured distance D, for each of frames A and B. The distance DDP in the figure shows an example of the actual distance of the target object when it can be measured only with the direct reflected light. The distance D1MP shows an example of the distance measured in frame A of this embodiment when the direct reflected light and the indirect reflected light are mixed. The distance DMP shows an example of the distance measured by the conventional technology when the direct reflected light and the indirect reflected light are mixed. The distance D2MP shows an example of the distance measured in frame B of this embodiment when the direct reflected light and the indirect reflected light are mixed.

[0101] The light pulse emitted from the light source unit 1 is divided into direct reflected light DP and bDP that is directly reflected by the target object, and indirect reflected light MP and bMP that is reflected by the target object via surrounding reflecting objects, and is then incident on the imaging unit 2. At this time, the indirect reflected light MP and bMP have a longer flight time than the direct reflected light DP and bDP due to the longer round-trip optical path length, and the light intensity decreases due to multiple scattered reflections.

[0102] 9A, for the reflected light pulses DP and MP in frame A, the imaging unit 2 measures an exposure signal A0DP due to direct reflected light DP when the first pulse A0e0 of the exposure control signal A0e is L, and measures an exposure signal A0MP due to indirect reflected light MP when the second pulse A0e1 of the exposure control signal A0e is L, as in the first embodiment. Also, when the first pulse A1e0 of the exposure control signal A1e is L, the imaging unit 2 measures both the exposure signal A1DP due to direct reflected light DP and the exposure signal A1MP due to indirect reflected light MP.

[0103] In this case, A0DP, A0MP, A1DP, and A1MP are all net exposure signals after subtracting BG. Based on these exposure signals, the measurement distance D1MP for each pixel when multipath exists is output by (A1DP+A1MP) / [(A0DP+A0MP)+(A1DP+A1MP)].

[0104] 9B, for the reflected light pulses bDP and bMP in frame B, the imaging unit 2 measures the exposure signal bA0DP due to direct reflected light bDP and the exposure signal bA0MP due to indirect reflected light bMP when the exposure control signal bA0e is L. Also, when the exposure control signal bA1e is L, it measures both the exposure signal bA1DP due to direct reflected light DP and the exposure signal bA1MP due to indirect reflected light bMP.

[0105] Here, bA0DP, bA0MP, bA1DP, and bA1MP are all net exposure signals after subtracting BG. Based on these exposure signals, the measured distance D2MP for each pixel when multipath exists is output by (bA1DP+bA1MP) / [(bA0DP+bA0MP)+(bA1DP+bA1MP)]. From the relationship between the actual distance and the measured distance D of each of frames A and B, when the lower limit of the actual distance is in the range of about 0 m to the upper limit of the actual measurement value of about 1.5 m, the measured distance D of both frames increases monotonically with respect to the actual distance, whereas when the lower limit of the actual distance is in the range of about 1.5 m to about 3 m, the measured distance D of frame B increases monotonically with respect to the actual distance, whereas the measured distance D of frame A decreases monotonically.

[0106] Here, if the target object is in the range from a lower limit of the actual distance of approximately 0 m to an upper limit of the actual measurement value of approximately 1.5 m, and indirect reflected light MP and bMP due to multipath is incident on the imaging unit 2 in each frame along a path of approximately 1.5 m or more (i.e., approximately the upper limit of the actual measurement value or more), the measured distance D2MP of frame B will be output as larger, and the measured distance D1MP of frame A will be output as smaller than the measured distance D2MP of frame B.

[0107] It is possible to detect multipath components by subtracting the measured distance D1MP of frame A from the measured distance D2MP of frame B. In other words, the larger (D2MP-D1MP) is, the more likely it is that a large multipath component is occurring.

[0108] As described above, according to the distance measuring imaging device 10 of the second embodiment, when the target object is located in the range from the lower limit of the actual distance of about 0 m to the upper limit of the actual measurement value of about 1.5 m, and the indirect reflected light MP and bMP due to multipath enter in frames A and B, respectively, on a path of about 1.5 m or more (i.e., about the upper limit of the actual measurement value or more), it is possible to detect the magnitude of the multipath component mixed in for each pixel. Also, in the distance measuring method of the second embodiment, in frame A, the exposure signal A1MP due to the indirect reflected light MP is added to the exposure signal A1DP due to the direct reflected light DP as in the first embodiment, and at the same time, the exposure signal A0MP due to the indirect reflected light MP is added to the exposure signal A0DP due to the direct reflected light DP. By adding this exposure signal A0MP to A0DP, the denominator of the measured distance D1MP becomes large, and the target object is observed closer than the measured distance DMP of the conventional example, and it is possible to reduce the error of the conventional distance measuring method in which the target object is observed far away due to multipath.

[0109] Furthermore, by combining the measured distance generated by the distance measurement drive of frame A shown in Fig. 9A with the measured distance generated by the distance measurement drive of Fig. 9B or Fig. 9C, distance measurement is possible while suppressing distance errors due to multipath even in the case of a distance of about 1.5m or more. That is, in frame A shown in Fig. 9A, D1MP increases from 0 to 1 simply when the actual distance is about 0 to 1.5m (short distance range), D1MP decreases from 1 to 0 simply when the actual distance is about 1.5m to 3.0m (medium distance range), and D1MP decreases again from 0 to 1 simply when the actual distance is about 3.0m to 4.5m (long distance range). It is not possible to determine whether the actual distance of the target object is in the short, medium, or long distance range only based on the measured distance D1MP obtained from frame A (the same problem as in the first embodiment). However, by combining in frame B the measured distance D to the target object obtained by the distance measurement drive shown in Figures 9B and 9C, it becomes possible to distinguish whether the target object is in the short, medium, or long distance range of frame A, and it becomes possible to significantly expand the distance measurement range while suppressing distance deviation due to multipath, as in embodiment 1.

[0110] In the second embodiment, two types of frame identification signals, frame A and frame B, are output, but three or more types of frame identification signals may be output.

[0111] In addition, in the second embodiment, the threshold value T is set to about 0.3, a specific coefficient (La=about 1500), and a specific coefficient (Lb=about 4500), but these values ​​may be set arbitrarily.

[0112] The frame synthesis unit 6 may also average the result of multiplying the measured distance in frame A by a specific coefficient La and the result of multiplying the measured distance in frame B by a specific coefficient Lb, and output the average result as the distance image.

[0113] Furthermore, the ratio of the average of the result of multiplying the measured distance in frame A by a specific coefficient La and the result of multiplying the measured distance in frame B by a specific coefficient Lb may be changed according to the measured distance and output as a distance image.

[0114] 10, it is also possible to use frames other than frame A with only the phase difference between the light emission control signal and the exposure control signal changed from that of frame A. In this case, by changing the phase difference, it is possible to slide the shortest and longest measurable distances.

[0115] 11, two exposure control pulses (A0e0 and A0e1, A1e0 and A1e1, BGe0 and BGe1) and one exposure control pulse (A0e1, A1e1, BGe1) may be mixed for one light emission control pulse of frame A. In this case, the number of exposures by the exposure control pulses A0e1, A1e1, and BGe1, which contain more multi-path information, increases, making it possible to obtain multi-path information with higher accuracy.

[0116] 12, there may be two types of exposure control pulses (A0e0 and A0e1, A1e0 and A1e1, BGe0 and BGe1) for one light emission control pulse of frame A. In this case, it is sufficient to apply one exposure control pulse for one light emission control pulse, which reduces the load on the drive control unit 3 that generates the exposure control pulses and allows a steeper exposure control pulse to be supplied, thereby improving distance measurement accuracy.

[0117] As shown in FIG. 13A, the frame identification signal may be switched not on a frame-by-frame basis, but on a pixel-by-pixel basis, such as between odd-numbered pixels and even-numbered pixels, or on a line-by-line basis, such as between odd-numbered lines and even-numbered lines, as shown in FIG. 13B.

[0118] As shown in FIG. 14, exposure signals A0, A1, and A2 may be generated based on exposure control signals A0e, A1e, and A2e, respectively, and the measured distance D may be calculated by adding A2 to A0.

[0119] Also, as shown in FIG. 15, exposure signals A0, A1, A2, and A3 may be generated based on exposure control signals A0e, A1e, A2e, and A3e, respectively, and the measured distance D may be calculated by adding A2 to A0 and adding A3 to A1.

[0120] In addition, as shown in Figure 9B, as shown in Figure 9C, the pulse width of the light emission control signal and the exposure control signal for frame B may be narrowed and the exposure control pulse may be delayed to perform area determination of the short distance range, medium distance range, and long distance range for frame A.

[0121] 6A or 6B may have the same value as n or may have a different value. Also, m in frame A and m in frame B in FIG. 6B may have the same value or may have different values.

[0122] As described above with reference to the drawings, the distance measuring imaging device 10 according to the embodiment is a distance measuring imaging device that measures the distance to an object by irradiating a pulsed light and receiving reflected light from the object, and includes a drive control unit that outputs an emission control signal including an emission control pulse that instructs emission of light and an exposure control signal including an exposure control pulse that instructs exposure, a light source unit that irradiates the pulsed light at the timing of the emission control pulse, an imaging unit that exposes the reflected light from the object of the irradiated pulsed light at the timing of the exposure control pulse and outputs an exposure signal indicating the amount of signal charge generated by the exposure, and a calculation unit that performs distance calculation using the exposure signal as an input and outputs a distance image. The drive control unit an exposure control signal including a first exposure control pulse, a second exposure control pulse, and a third exposure control pulse based on the timing of an emission control pulse is generated, a time difference between the third exposure control pulse and the emission control pulse is greater than a time difference between the second exposure control pulse and the emission control pulse, and a time difference between the second exposure control pulse and the emission control pulse is greater than a time difference between the first exposure control pulse and the emission control pulse, and the imaging unit outputs a first exposure signal indicating an amount of signal charge generated by exposure using the first exposure control pulse, a second exposure signal indicating an amount of signal charge generated by exposure using the second exposure control pulse, and a third exposure signal indicating an amount of signal charge generated by exposure using the third exposure control pulse.

[0123] As a result, within a predetermined distance measurement range, the first exposure signal and the second exposure signal can contain signal charges mainly corresponding to direct reflected light, and the third exposure signal can contain signal charges mainly corresponding to indirect reflected light. Therefore, if the distance measuring imaging device calculates the distance using not only the first exposure signal and the second exposure signal, but also the third exposure signal, it is possible to reduce deterioration of distance measurement accuracy in a multipath environment. but can.

[0124] For example, the calculation section may output the distance information based on a ratio of a signal charge amount of the second exposure signal to a total of signal charge amounts of the first exposure signal, the second exposure signal, and the third exposure signal.

[0125] This makes it possible to easily calculate distance information with reduced degradation in distance measurement accuracy based on the above ratio to the above total.

[0126] For example, the drive control section may generate the first exposure control pulse and the third exposure control pulse in correspondence with the single common light emission control pulse.

[0127] This allows the first and third exposure signals to be obtained by performing two exposures for one light emission. At this time, the signal charge of the indirectly reflected light can be obtained from the third exposure signal.

[0128] For example, the drive control unit may generate the first exposure control pulse in correspondence with one of the light emission control pulses, generate the second exposure control pulse in correspondence with one of the light emission control pulses, and generate the third exposure control pulse in correspondence with one of the light emission control pulses.

[0129] As a result, a first exposure signal can be obtained by exposing once for one light emission. Similarly, a second exposure signal can be obtained by exposing once for one light emission. Also, a third exposure signal can be obtained by exposing once for one light emission. In this way, the first exposure signal, the second exposure signal, and the third exposure signal can be obtained by simple control of exposing once for one light emission. Since the third exposure signal mainly contains signal charges corresponding to indirect reflected light, it is possible to reduce deterioration of distance measurement accuracy in a multipath environment.

[0130] For example, the exposure control signal may include a fourth exposure control pulse, a time difference between the fourth exposure control pulse and the light emission control pulse being greater than a time difference between the third exposure control pulse and the light emission control pulse, and the drive control unit may generate the first exposure control pulse and the third exposure control pulse so as to correspond to a common single light emission control pulse, and generate the second exposure control pulse and the fourth exposure control pulse so as to correspond to a common single light emission control pulse.

[0131] As a result, the first exposure signal and the third exposure signal can be obtained by exposing twice for one emission of light. Similarly, the second exposure signal and the fourth exposure signal can be obtained by exposing twice for one emission of light. The operation for obtaining the first exposure signal and the third exposure signal and the operation for obtaining the second exposure signal and the fourth exposure signal use the same control sequence of one emission and two exposures. Therefore, in the above two operations, there is no significant difference in, for example, fluctuations in the power supply voltage, and the like, so that deterioration of distance measurement accuracy can be further reduced.

[0132] For example, the calculation unit may output the distance information based on a ratio of a second sum obtained by adding up the signal charge amounts of the second exposure signal and the fourth exposure signal to a first sum obtained by adding up the signal charge amounts of the first exposure signal, the second exposure signal, the third exposure signal, and the fourth exposure signal.

[0133] This makes it possible to obtain distance information with reduced degradation in distance measurement accuracy by using the first exposure signal, the second exposure signal, the third exposure signal, and the fourth exposure signal.

[0134] For example, the calculation unit may output the distance information based on a ratio of the signal charge amount of the second exposure signal to a total obtained by adding up the signal charge amounts of the first exposure signal, the second exposure signal, the third exposure signal and the fourth exposure signal.

[0135] This allows the signal charge amount of the second exposure signal to be used instead of the second sum obtained by adding up the signal charge amounts of the second exposure signal and the fourth exposure signal, thereby also allowing distance information to be obtained with reduced degradation in distance measurement accuracy.

[0136] For example, the drive control unit may input an identification signal that specifies one of a plurality of operating modes including a first operating mode and a second operating mode, and when the identification signal specifies the first operating mode, control distance measurement by a first operation using the exposure control signal including the first exposure control pulse to a third exposure control pulse, and when the identification signal specifies the second operating mode, control distance measurement by a second operation different from the first operation.

[0137] With this, distance measurements are performed in both the first operation mode and the second operation mode, so that distance information with smaller measurement error can be selected.

[0138] For example, the distance image generation unit may generate a multipath detection signal indicating the presence or absence of multipath based on first distance information obtained in the first operation and second distance information obtained in the second operation, and further output the multipath detection signal indicating the magnitude of error contained in the first distance information or the second distance information based on the difference between the first distance information and the second distance information.

[0139] This makes it possible to detect the presence or absence of multipath and the magnitude of error due to multipath.

[0140] For example, the distance image generating unit may generate a multipath detection signal indicating the presence or absence of multipath based on first distance information obtained in the first operation and second distance information obtained in the second operation.

[0141] This makes it possible to detect the presence or absence of multipath.

[0142] For example, the distance image generation unit may output the multipath detection signal indicating the magnitude of an error contained in the first distance information or the second distance information based on a difference between the first distance information and the second distance information.

[0143] This makes it possible to detect the magnitude of the error due to multipath.

[0144] For example, in the second operating mode, the drive control unit may generate the exposure control signal including a first pulse and a second pulse as the exposure control pulse, and the time difference between the second pulse and the light emission control pulse may be greater than the time difference between the first pulse and the light emission control pulse.

[0145] Thereby, the second operation mode may be, for example, a distance measurement operation similar to the conventional one.

[0146] For example, the imaging section may output a preceding exposure signal indicating an amount of signal charge generated by exposure with the first pulse, and a following exposure signal indicating an amount of signal charge generated by exposure with the second pulse.

[0147] This makes it possible to calculate the distance from the leading exposure signal and the trailing exposure signal in the second operation mode.

[0148] For example, the calculation section may output the distance information based on a ratio of a signal charge amount of the trailing exposure signal to a sum of signal charge amounts of the preceding exposure signal and the trailing exposure signal.

[0149] As a result, in the second operation mode, distance information is calculated based on the above ratio. By combining the second operation mode and the first operation mode, distance information with reduced degradation in distance measurement accuracy can be derived.

[0150] For example, the distance image generation unit may generate the distance image based on adding a distance value indicated by first distance information obtained in the first action and a distance value indicated by second distance information obtained in the second action.

[0151] In this way, the average may be calculated from the sum of the first distance information and the second distance information.

[0152] For example, the drive control unit may repeatedly execute an exposure process in which the first exposure control pulse and the third exposure control pulse are generated in correspondence with a common single light emission control pulse, and may thin out the first exposure control pulse or the third exposure control pulse in a predetermined number of the multiple exposure processes.

[0153] As a result, when, for example, the first exposure control pulse is thinned out in a predetermined number of operations among multiple repetitions of the operation of exposing twice for one light emission, more indirect reflected light can be exposed, thereby improving the accuracy of multi-path detection.

[0154] For example, the drive control unit may repeatedly execute a first exposure process in which the first exposure control pulse and the third exposure control pulse are generated to correspond to a common single light-emission control pulse, and repeatedly execute a second exposure process in which the second exposure control pulse and the fourth exposure control pulse are generated to correspond to a common single light-emission control pulse, and may thin out the first exposure control pulse and the second exposure control pulse, or the third exposure control pulse and the fourth exposure control pulse, in a predetermined number of corresponding first exposure processes and second exposure processes among the multiple times.

[0155] As a result, when, for example, the first exposure control pulse or the second exposure control pulse is thinned out in a predetermined number of operations among multiple repetitions of the operation of exposing twice for one light emission, the load on the drive control unit 3 that generates the exposure control pulse is reduced, and a steeper exposure control pulse can be supplied, thereby improving the distance measurement accuracy.

[0156] For example, the drive control unit may generate the light emission control signal so that a duty ratio corresponding to a light emission pulse period is 33% or less.

[0157] This allows the pulsed light to have a high intensity relative to the background light, and improves light resistance, which is a distance measurement performance.

[0158] For example, the calculation unit may calculate and output the distance information using the TOF principle.

[0159] This outputs distance information based on the TOF principle. [Industrial Applicability]

[0160] The distance measuring imaging device according to the present disclosure can be used in, for example, a camera. [Explanation of symbols]

[0161] 1 Light source section 2. Imaging unit 3 Drive control section 4 Frame control section 5 Calculation section (TOF calculation section) 6 Frame synthesis unit (distance image generation unit) 10. Distance measuring imaging device

Claims

1. A distance measuring imaging device that measures a distance to an object by irradiating a pulsed light and receiving reflected light from the object, comprising: a drive control unit that outputs a light emission control signal including a light emission control pulse that instructs light emission and an exposure control signal including an exposure control pulse that instructs exposure; a light source unit that irradiates the pulsed light in accordance with the timing of the light emission control pulse; an imaging unit that exposes a target object to reflected light of the irradiated pulsed light at the timing of the exposure control pulse and outputs an exposure signal indicating an amount of signal charge generated by the exposure; a calculation unit that receives the exposure signal, performs distance calculation, and outputs distance information; the drive control unit generates an exposure control signal including a first exposure control pulse, a second exposure control pulse, and a third exposure control pulse based on the timing of the light emission control pulse; a time difference between the third exposure control pulse and the light emission control pulse is greater than a time difference between the second exposure control pulse and the light emission control pulse; a time difference between the second exposure control pulse and the light emission control pulse is greater than a time difference between the first exposure control pulse and the light emission control pulse, the imaging section outputs a first exposure signal indicating an amount of signal charge generated by exposure using the first exposure control pulse, a second exposure signal indicating an amount of signal charge generated by exposure using the second exposure control pulse, and a third exposure signal indicating an amount of signal charge generated by exposure using the third exposure control pulse; the drive control unit receives an identification signal specifying one of a plurality of operation modes including a first operation mode and a second operation mode, and when the identification signal specifies the first operation mode, controls distance measurement by a first operation using the exposure control signal including the first exposure control pulse to the third exposure control pulse; When the identification signal designates the second operation mode, distance measurement is controlled by a second operation in which the pattern of the exposure control pulse in the exposure control signal is different from that of the first operation. Distance measuring imaging device.

2. The pulse width of the light emission control pulse in the second operation is longer than the pulse width of the light emission control pulse in the first operation.

2. A distance measuring imaging device according to claim 1.

3. A distance measuring imaging device that measures a distance to an object by irradiating a pulsed light and receiving reflected light from the object, comprising: a drive control unit that outputs a light emission control signal including a light emission control pulse that instructs light emission and an exposure control signal including an exposure control pulse that instructs exposure; a light source unit that irradiates the pulsed light in accordance with the timing of the light emission control pulse; an imaging unit that exposes a target object to reflected light of the irradiated pulsed light at the timing of the exposure control pulse and outputs an exposure signal indicating an amount of signal charge generated by the exposure; a calculation unit that receives the exposure signal, performs distance calculation, and outputs distance information; the drive control unit generates an exposure control signal including a first exposure control pulse, a second exposure control pulse, and a third exposure control pulse based on the timing of the light emission control pulse; a time difference between the third exposure control pulse and the light emission control pulse is greater than a time difference between the second exposure control pulse and the light emission control pulse; a time difference between the second exposure control pulse and the light emission control pulse is greater than a time difference between the first exposure control pulse and the light emission control pulse, the imaging section outputs a first exposure signal indicating an amount of signal charge generated by exposure using the first exposure control pulse, a second exposure signal indicating an amount of signal charge generated by exposure using the second exposure control pulse, and a third exposure signal indicating an amount of signal charge generated by exposure using the third exposure control pulse; The calculation unit outputs the distance information based on a ratio of a signal charge amount of the second exposure signal to a total of a signal charge amount of each of the first exposure signal, the second exposure signal, and the third exposure signal. Distance measuring imaging device.

4. The drive control unit generates the first exposure control pulse and the third exposure control pulse in correspondence with a common light emission control pulse.

4. The distance measuring imaging device according to claim 3.

5. The drive control unit is generating the first exposure control pulse in correspondence with one of the light emission control pulses; generating the second exposure control pulse in correspondence with one of the light emission control pulses; The third exposure control pulse is generated in correspondence with one of the light emission control pulses.

4. The distance measuring imaging device according to claim 3.

6. the exposure control signal includes a fourth exposure control pulse, a time difference between the fourth exposure control pulse and the light emission control pulse is greater than a time difference between the third exposure control pulse and the light emission control pulse; The drive control unit is generating the first exposure control pulse and the third exposure control pulse in correspondence with a common light emission control pulse; The second exposure control pulse and the fourth exposure control pulse are generated in correspondence with a common light emission control pulse.

3. A distance measuring imaging device according to claim 1.

7. A distance measuring imaging device that measures a distance to an object by irradiating a pulsed light and receiving reflected light from the object, comprising: a drive control unit that outputs a light emission control signal including a light emission control pulse that instructs light emission and an exposure control signal including an exposure control pulse that instructs exposure; a light source unit that irradiates the pulsed light in accordance with the timing of the light emission control pulse; an imaging unit that exposes a target object to reflected light of the irradiated pulsed light at the timing of the exposure control pulse and outputs an exposure signal indicating an amount of signal charge generated by the exposure; a calculation unit that receives the exposure signal, performs distance calculation, and outputs distance information; the drive control unit generates an exposure control signal including a first exposure control pulse, a second exposure control pulse, and a third exposure control pulse based on the timing of the light emission control pulse; a time difference between the third exposure control pulse and the light emission control pulse is greater than a time difference between the second exposure control pulse and the light emission control pulse; a time difference between the second exposure control pulse and the light emission control pulse is greater than a time difference between the first exposure control pulse and the light emission control pulse, the imaging section outputs a first exposure signal indicating an amount of signal charge generated by exposure using the first exposure control pulse, a second exposure signal indicating an amount of signal charge generated by exposure using the second exposure control pulse, and a third exposure signal indicating an amount of signal charge generated by exposure using the third exposure control pulse; the exposure control signal includes a fourth exposure control pulse, a time difference between the fourth exposure control pulse and the light emission control pulse is greater than a time difference between the third exposure control pulse and the light emission control pulse; The drive control unit is generating the first exposure control pulse and the third exposure control pulse in correspondence with a common light emission control pulse; generating the second exposure control pulse and the fourth exposure control pulse in correspondence with a common light emission control pulse; The calculation unit outputs the distance information based on a ratio of a second sum obtained by adding up the signal charge amounts of the second exposure signal and the fourth exposure signal to a first sum obtained by adding up the signal charge amounts of the first exposure signal, the second exposure signal, the third exposure signal, and the fourth exposure signal. Distance measuring imaging device.

8. A distance measuring imaging device that measures a distance to an object by irradiating a pulsed light and receiving reflected light from the object, comprising: a drive control unit that outputs a light emission control signal including a light emission control pulse that instructs light emission and an exposure control signal including an exposure control pulse that instructs exposure; a light source unit that irradiates the pulsed light in accordance with the timing of the light emission control pulse; an imaging unit that exposes a target object to reflected light of the irradiated pulsed light at the timing of the exposure control pulse and outputs an exposure signal indicating an amount of signal charge generated by the exposure; a calculation unit that receives the exposure signal, performs distance calculation, and outputs distance information; the drive control unit generates an exposure control signal including a first exposure control pulse, a second exposure control pulse, and a third exposure control pulse based on the timing of the light emission control pulse; a time difference between the third exposure control pulse and the light emission control pulse is greater than a time difference between the second exposure control pulse and the light emission control pulse; a time difference between the second exposure control pulse and the light emission control pulse is greater than a time difference between the first exposure control pulse and the light emission control pulse, the imaging section outputs a first exposure signal indicating an amount of signal charge generated by exposure using the first exposure control pulse, a second exposure signal indicating an amount of signal charge generated by exposure using the second exposure control pulse, and a third exposure signal indicating an amount of signal charge generated by exposure using the third exposure control pulse; the exposure control signal includes a fourth exposure control pulse, a time difference between the fourth exposure control pulse and the light emission control pulse is greater than a time difference between the third exposure control pulse and the light emission control pulse; The drive control unit is generating the first exposure control pulse and the third exposure control pulse in correspondence with a common light emission control pulse; generating the second exposure control pulse and the fourth exposure control pulse in correspondence with a common light emission control pulse; The calculation unit outputs the distance information based on a ratio of a signal charge amount of the second exposure signal to a total obtained by adding up the signal charge amounts of the first exposure signal, the second exposure signal, the third exposure signal, and the fourth exposure signal. Distance measuring imaging device.

9. A distance measuring imaging device that measures a distance to an object by irradiating a pulsed light and receiving reflected light from the object, comprising: a drive control unit that outputs a light emission control signal including a light emission control pulse that instructs light emission and an exposure control signal including an exposure control pulse that instructs exposure; a light source unit that irradiates the pulsed light in accordance with the timing of the light emission control pulse; an imaging unit that exposes a target object to reflected light of the irradiated pulsed light at the timing of the exposure control pulse and outputs an exposure signal indicating an amount of signal charge generated by the exposure; a calculation unit that receives the exposure signal, performs distance calculation, and outputs distance information; the drive control unit generates an exposure control signal including a first exposure control pulse, a second exposure control pulse, and a third exposure control pulse based on the timing of the light emission control pulse; a time difference between the third exposure control pulse and the light emission control pulse is greater than a time difference between the second exposure control pulse and the light emission control pulse; a time difference between the second exposure control pulse and the light emission control pulse is greater than a time difference between the first exposure control pulse and the light emission control pulse, the imaging section outputs a first exposure signal indicating an amount of signal charge generated by exposure using the first exposure control pulse, a second exposure signal indicating an amount of signal charge generated by exposure using the second exposure control pulse, and a third exposure signal indicating an amount of signal charge generated by exposure using the third exposure control pulse; the drive control unit receives an identification signal specifying one of a plurality of operation modes including a first operation mode and a second operation mode, and when the identification signal specifies the first operation mode, controls distance measurement by a first operation using the exposure control signal including the first exposure control pulse to the third exposure control pulse; When the identification signal designates the second operation mode, the distance measurement is controlled by a second operation different from the first operation; The distance measuring imaging device includes: a distance image generating unit that generates a distance image based on the distance information, the distance image generating unit generating a multipath detection signal indicating the presence or absence of multipath based on first distance information obtained in the first operation and second distance information obtained in the second operation; Furthermore, a distance image generating unit that outputs the multipath detection signal indicating a magnitude of an error included in the first distance information or the second distance information based on a difference between the first distance information and the second distance information. Distance measuring imaging device.

10. A distance measuring imaging device that measures a distance to an object by irradiating a pulsed light and receiving reflected light from the object, comprising: a drive control unit that outputs a light emission control signal including a light emission control pulse that instructs light emission and an exposure control signal including an exposure control pulse that instructs exposure; a light source unit that irradiates the pulsed light in accordance with the timing of the light emission control pulse; an imaging unit that exposes a target object to reflected light of the irradiated pulsed light at the timing of the exposure control pulse and outputs an exposure signal indicating an amount of signal charge generated by the exposure; a calculation unit that receives the exposure signal, performs distance calculation, and outputs distance information; the drive control unit generates an exposure control signal including a first exposure control pulse, a second exposure control pulse, and a third exposure control pulse based on the timing of the light emission control pulse; a time difference between the third exposure control pulse and the light emission control pulse is greater than a time difference between the second exposure control pulse and the light emission control pulse; a time difference between the second exposure control pulse and the light emission control pulse is greater than a time difference between the first exposure control pulse and the light emission control pulse, the imaging section outputs a first exposure signal indicating an amount of signal charge generated by exposure using the first exposure control pulse, a second exposure signal indicating an amount of signal charge generated by exposure using the second exposure control pulse, and a third exposure signal indicating an amount of signal charge generated by exposure using the third exposure control pulse; the drive control unit receives an identification signal specifying one of a plurality of operation modes including a first operation mode and a second operation mode, and when the identification signal specifies the first operation mode, controls distance measurement by a first operation using the exposure control signal including the first exposure control pulse to the third exposure control pulse; When the identification signal designates the second operation mode, the distance measurement is controlled by a second operation different from the first operation; The distance measuring imaging device includes: a distance image generating unit that generates a distance image based on the distance information, the distance image generating unit generating a multipath detection signal indicating the presence or absence of multipath based on first distance information obtained in the first operation and second distance information obtained in the second operation Distance measuring imaging device.

11. A distance measuring imaging device that measures a distance to an object by irradiating a pulsed light and receiving reflected light from the object, comprising: a drive control unit that outputs a light emission control signal including a light emission control pulse that instructs light emission and an exposure control signal including an exposure control pulse that instructs exposure; a light source unit that irradiates the pulsed light in accordance with the timing of the light emission control pulse; an imaging unit that exposes a target object to reflected light of the irradiated pulsed light at the timing of the exposure control pulse and outputs an exposure signal indicating an amount of signal charge generated by the exposure; a calculation unit that receives the exposure signal, performs distance calculation, and outputs distance information; the drive control unit generates an exposure control signal including a first exposure control pulse, a second exposure control pulse, and a third exposure control pulse based on the timing of the light emission control pulse; a time difference between the third exposure control pulse and the light emission control pulse is greater than a time difference between the second exposure control pulse and the light emission control pulse; a time difference between the second exposure control pulse and the light emission control pulse is greater than a time difference between the first exposure control pulse and the light emission control pulse, the imaging section outputs a first exposure signal indicating an amount of signal charge generated by exposure using the first exposure control pulse, a second exposure signal indicating an amount of signal charge generated by exposure using the second exposure control pulse, and a third exposure signal indicating an amount of signal charge generated by exposure using the third exposure control pulse; the drive control unit receives an identification signal specifying one of a plurality of operation modes including a first operation mode and a second operation mode, and when the identification signal specifies the first operation mode, controls distance measurement by a first operation using the exposure control signal including the first exposure control pulse to the third exposure control pulse; When the identification signal designates the second operation mode, the distance measurement is controlled by a second operation different from the first operation; The distance measuring imaging device includes: a distance image generating unit that generates a distance image based on the distance information, the distance image generating unit outputting a multipath detection signal indicating a magnitude of an error included in the first distance information or the second distance information based on a difference between first distance information obtained in the first operation and second distance information obtained in the second operation. Distance measuring imaging device.

12. the drive control unit generates the exposure control signal including a first pulse and a second pulse as the exposure control pulse in the second operation mode; A time difference between the second pulse and the light emission control pulse is greater than a time difference between the first pulse and the light emission control pulse.

12. A distance measuring imaging device according to claim 1, 2 or 9 to 11.

13. The imaging section outputs a preceding exposure signal indicating an amount of signal charge generated by exposure using the first pulse, and a following exposure signal indicating an amount of signal charge generated by exposure using the second pulse. The distance measuring imaging device according to claim 12.

14. The calculation unit outputs the distance information based on a ratio of a signal charge amount of the trailing exposure signal to a sum of a signal charge amount of the leading exposure signal and a trailing exposure signal. The distance measuring imaging device according to claim 13.

15. a distance image generating unit that generates a distance image based on an addition of a distance value indicated by first distance information obtained in the first operation and a distance value indicated by second distance information obtained in the second operation; 3. A distance measuring imaging device according to claim 1.

16. the drive control unit repeatedly executes an exposure process for generating the first exposure control pulse and the third exposure control pulse in correspondence with a common light emission control pulse a plurality of times; The first exposure control pulse or the third exposure control pulse is thinned out in a predetermined number of exposure processes among the plurality of times.

9. A distance measuring imaging device according to claim 4, wherein the distance measuring device is a distance measuring lens.

17. the drive control unit repeatedly executes a first exposure process a plurality of times, in which the first exposure control pulse and the third exposure control pulse are generated in correspondence with a common single light emission control pulse; a second exposure process for generating the second exposure control pulse and the fourth exposure control pulse in correspondence with a common light emission control pulse is repeatedly performed a plurality of times; In a predetermined number of corresponding first exposure processes and second exposure processes among the plurality of times, the first exposure control pulse and the second exposure control pulse, or the third exposure control pulse and the fourth exposure control pulse are thinned out.

9. The distance measuring imaging device according to claim 6.

18. The drive control unit generates the light emission control signal so that a duty ratio corresponding to a light emission pulse period is 33% or less. The distance measuring imaging device according to any one of claims 1 to 17.

19. The calculation unit calculates and outputs the distance information using the TOF principle. The distance measuring imaging device according to any one of claims 1 to 18.

Images