Distance measuring device, distance measuring method and procedure

By switching the phase and timing of the light emission mode in the TOF sensor, the interference problem between multiple sensors is solved, enabling high-precision distance measurement in autonomous vehicles.

CN113196104BActive Publication Date: 2024-11-15SONY SEMICON SOLUTIONS CORP
View PDF 12 Cites 0 Cited by

Patent Information

Application Number
CN202080007043.6
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Priority Date
2019-02-25
Filing Date
2020-01-15
Publication Date
2024-11-15
Estimated Expiration
2040-01-15

AI Technical Summary

Technical Problem

In autonomous vehicles, interference between multiple Time-of-Flight (TOF) sensors reduces distance measurement accuracy, and existing technologies struggle to effectively suppress interference and maintain measurement accuracy.

Method used

The light emission of the light-emitting unit is controlled by switching between the first light emission mode and the second light emission mode within a predetermined frame. The mode switching unit and the light emission control unit transmit and receive light signals at different phases to reduce interference.

Benefits of technology

It effectively suppresses interference between multiple TOF sensors, ensuring the accuracy and sensitivity of distance measurement, and enabling correct distance measurement when multiple sensors are operating simultaneously.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN113196104B_ABST
    Figure CN113196104B_ABST
Patent Text Reader

Abstract

The present technology relates to a distance measuring device, a distance measuring method and a program, which can reduce the influence of interference and can accurately perform distance measurement. The distance measuring device includes: a light emitting unit that emits irradiation light; a light receiving unit that receives reflected light generated by the reflection of the irradiation light on a target object; a calculation unit that calculates the distance to the target object based on the time from the emission of the irradiation light to the reception of the reflected light; and a light emitting control unit that controls the light emitting unit, wherein the light emitting control unit controls the light emission of the light emitting unit by switching a first light emitting mode and a second light emitting mode different from the first light emitting mode within a predetermined frame. For example, the present technology can be applied to a distance measuring device that performs distance measurement.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present technology relates to a distance measuring device, a distance measuring method, and a program, and more particularly, for example, to a distance measuring device, a distance measuring method, and a program capable of suppressing interference. Background Art

[0002] In recent years, the progress of semiconductor technology has led to the miniaturization of distance measuring devices that measure the distance to an object. For example, this can be installed in a so-called mobile terminal such as a smartphone, which is a small information processing device with a communication function.

[0003] Examples of a distance measuring device (sensor) that measures the distance to a target object include a time-of-flight (TOF) sensor (eg, see Patent Document 1).

[0004] The TOF sensor emits an illumination light to illuminate the target object, and receives the reflected light generated by the reflection of the illumination light on the target object, thereby obtaining the time from the emission of the illumination light to the reception of the reflected light, that is, the time Δt until the illumination light is reflected by the target object and returns. Then, using the time Δt and the speed of light c [m / s], the distance L to the target object is obtained according to the formula L = c × Δt / 2.

[0005] Citation list

[0006] Patent Literature

[0007] Patent Document 1: Japanese Patent Application Publication No. 2016-090268

[0008] Patent Document 2: Japanese Patent Application Publication No. 2017-191042

[0009] Patent Document 3: Japanese Patent Application Publication No. 2013-076645 Summary of the invention

[0010] Problem that the invention aims to solve

[0011] In recent years, the practical application of autonomous driving has been required, and in autonomous driving, distance measurement for measuring the distance to objects existing around the vehicle is indispensable. In the case where a TOF sensor is used for such distance measurement, it is presumed that a plurality of TOF sensors are mounted on the vehicle to measure the distance to objects existing in various directions of the vehicle.

[0012] In this case, it is presumed that interference occurs in which illumination light (illumination light itself or reflected light of illumination light) emitted from one of a plurality of TOF sensors mounted on the vehicle is received by other TOF sensors.

[0013] Furthermore, if the number of vehicles that perform autonomous driving increases, it is presumed that interference occurs in which illumination light emitted by a TOF sensor mounted on one vehicle is received by a TOF sensor mounted on another vehicle.

[0014] If interference occurs between TOF sensors, the accuracy of the distance measurement will be reduced.

[0015] In order to suppress interference, Patent Document 2 proposes to delay the time of the pulse pattern of irradiation light by the time calculated by the pseudo-random number for each model so that the timing of emission does not overlap between the models. In addition, Patent Document 3 proposes a method of extending the pulse width of irradiation light to the time calculated by the pseudo-random number.

[0016] However, according to Patent Document 2 or Patent Document 3, attention is paid to the distance measurement operation of each model, but the non-light emitting time increases so that the total amount of received light decreases, and thus the distance measurement sensitivity may deteriorate.

[0017] The present technology has been proposed in view of the above circumstances, and aims to suppress interference and maintain the accuracy of distance measurement.

[0018] Solution to the problem

[0019] According to one aspect of the present technology, a distance measuring device includes: a light emitting unit that emits irradiation light; a light receiving unit that receives reflected light generated by reflection of the irradiation light on a target object; a calculation unit that calculates the distance to the target object based on a time from the emission of the irradiation light to the reception of the reflected light; and a light emission control unit that controls the light emitting unit, wherein the light emission control unit controls the light emission of the light emitting unit by switching a first light emission mode and a second light emission mode different from the first light emission mode within a predetermined frame.

[0020] A distance measurement method according to one aspect of the present technology includes the following steps implemented by a distance measurement device that performs distance measurement processing: emitting illumination light; receiving reflected light generated by reflection of the illumination light on a target object; calculating the distance to the target object based on the time from the emission of the illumination light to the reception of the reflected light; and controlling the emission of the illumination light, wherein in the emission control, a first light emission mode and a second light emission mode different from the first light emission mode are switched within a predetermined frame to control the light emission.

[0021] A program according to one aspect of the present technology causes a computer of a distance measuring device that performs distance measurement processing to implement processing, including: emitting illumination light; receiving reflected light generated by reflection of the illumination light on a target object; calculating the distance to the target object based on the time from the emission of the illumination light to the reception of the reflected light; and controlling the emission of the illumination light, the processing including switching a first light emission mode and a second light emission mode different from the first light emission mode within a predetermined frame to control the light emission during the emission control.

[0022] In a distance measuring device, a distance measuring method and a program according to one aspect of the present technology, irradiation light is emitted; reflected light generated by reflection of the irradiation light on a target object is received; and the distance to the target object is calculated based on the time from the emission of the irradiation light to the reception of the reflected light. The emission of the irradiation light is controlled by switching a first irradiation mode and a second irradiation mode different from the first irradiation mode within a predetermined frame.

[0023] Note that the distance measuring device may be an independent device or an internal block constituting one device.

[0024] In addition, the program can be provided by being transmitted via a transmission medium or by being recorded on a recording medium. BRIEF DESCRIPTION OF THE DRAWINGS

[0025] Figure 1 This is a diagram showing the structure of an embodiment of a distance measuring device to which the present technology is applied.

[0026] Figure 2 It is a diagram showing a configuration example of a light receiving unit.

[0027] Figure 3 A diagram showing an example of the configuration of a pixel.

[0028] Figure 4 A diagram for explaining charge distribution in a pixel.

[0029] Figure 5 It is a diagram for explaining conventional light irradiation.

[0030] Figure 6 This is a diagram for explaining interference light.

[0031] Figure 7 It is a diagram for explaining the light emission pattern.

[0032] Figure 8 It is a diagram for explaining the light emission pattern.

[0033] Fig. 9 This is a diagram for explaining the influence of interfering light.

[0034] Fig.10It is a diagram used to explain other light emission modes.

[0035] Fig.11 It is a diagram for explaining another reading method.

[0036] Fig.12 It is a diagram for explaining a recording medium.

[0037] Fig.13 is a block diagram showing an example of a schematic configuration of a vehicle control system.

[0038] Fig.14 1 is an explanatory diagram showing an example of the installation positions of the vehicle exterior information detection unit and the imaging portion. DETAILED DESCRIPTION

[0039] A form for carrying out the present technology (hereinafter, referred to as an embodiment) will be described.

[0040] For example, the present technology can be applied to a light-receiving element constituting a distance-measuring system that measures distance using an indirect TOF method, an imaging device having such a light-receiving element, and the like.

[0041] For example, the distance measuring system may be applied to an in-vehicle system that is mounted on a vehicle and measures the distance to a target object outside the vehicle, a system for gesture recognition that measures the distance to a target object such as a user's hand and recognizes a user's gesture based on the measurement result, etc. In this case, for example, the result of the gesture recognition may be used to operate an in-vehicle navigation system, etc.

[0042] <Configuration Example of Distance Measuring Device>

[0043] Figure 1 A configuration example of an implementation scheme of a distance measuring device to which the present technology is applied is shown.

[0044] The distance measuring device 10 includes a lens 11, a light receiving unit 12, a signal processing unit 13, a light emitting unit 14, and a light emission control unit 15. The signal processing unit 13 includes a mode switching unit 21 and a distance image generating unit 22. Figure 1 The distance measuring device 10 in the embodiment measures the distance to an object by irradiating light to the object and receiving light (reflected light) generated by reflection of the light (irradiated light) on the object.

[0045] The light emitting system of the distance measuring device 10 includes a light emitting unit 14 and a light emitting control unit 15. In the light emitting system, the light emitting control unit 15 causes the light emitting unit 14 to emit infrared light (IR) according to the control from the signal processing unit 13. An IR bandpass filter may be provided between the lens 11 and the light receiving unit 12, and the light emitting unit 14 may emit infrared light corresponding to a transmission wavelength band of the IR bandpass filter.

[0046] The light emitting unit 14 may be provided inside the housing of the distance measuring device 10, or may be provided outside the housing of the distance measuring device 10. As described later, the light emission control unit 15 causes the light emitting unit 14 to emit light in a predetermined mode. The mode is set by the mode switching unit 21 and can be switched at a predetermined timing.

[0047] For example, the signal processing unit 13 functions as a calculation unit that calculates the distance from the distance measuring device 10 to the object based on the image signal supplied from the light receiving unit 12. When the calculated distance is output as an image, the distance image generating unit 22 of the signal processing unit 13 generates and outputs a distance image that indicates the distance to the object for each pixel.

[0048] <Constitution of Imaging Element>

[0049] Figure 2 2 is a block diagram showing a configuration example of the light receiving unit 12. The light receiving unit 12 may be a complementary metal oxide semiconductor (CMOS) image sensor.

[0050] The light receiving section 12 includes a pixel array section 41, a vertical drive section 42, a column processing section 43, a horizontal drive section 44, and a system control section 45. The pixel array section 41, the vertical drive section 42, the column processing section 43, the horizontal drive section 44, and the system control section 45 are formed on a semiconductor substrate (chip) not shown.

[0051] In the pixel array section 41, unit pixels (eg, Figure 3 The pixels 50 in the image processing unit are arranged two-dimensionally in a matrix shape, and each unit pixel has a photoelectric conversion element that generates a photoelectric charge corresponding to the amount of incident light and stores the generated photoelectric charge inside it. Note that in the following, the photoelectric charge corresponding to the amount of incident light may be simply referred to as "charge", and the unit pixel may be simply referred to as "pixel".

[0052] The pixel array section 41 is further provided with a pixel drive line 46 and a vertical signal line 47 for the pixels arranged in a matrix. The pixel drive line 46 is formed for each row along the horizontal direction in the figure (the arrangement direction of the pixels in each pixel row), and the vertical signal line 47 is formed for each column along the vertical direction in the figure (the arrangement direction of the pixels in each column). One end of the pixel drive line 46 is connected to the output end of the vertical drive section 42 corresponding to each row.

[0053] The vertical drive section 42 is a pixel drive section including a shift register, an address decoder, and the like, and drives all pixels in the pixel array section 41 at the same time or, for example, drives each pixel in the pixel array section 41 row by row. Pixel signals output by each unit pixel in a pixel row selectively scanned by the vertical drive section 42 are supplied to the column processing section 43 through the corresponding vertical signal line 47. The column processing section 43 performs predetermined signal processing on the pixel signals output from the unit pixels in the selected row through the vertical signal line 47 for each pixel column of the pixel array section 41, and temporarily stores the pixel signals that have been subjected to the predetermined signal processing.

[0054] Specifically, the column processing section 43 performs at least noise removal processing as signal processing, for example, correlated double sampling (CDS) processing. Due to the correlated double sampling performed by the column processing section 43, fixed pattern noise inherent to pixels such as reset noise and threshold variation of the amplifier transistor is removed. Note that, for example, in addition to the noise removal function, the column processing section 43 may also have an analog-to-digital (AD) conversion function and output a signal level in digital form.

[0055] The horizontal drive section 44 includes a shift register, an address decoder, etc., and sequentially selects unit circuits corresponding to each pixel column in the column processing section 43. Due to the selective scanning of the horizontal drive section 44, the pixel signals subjected to signal processing by the column processing section 43 are sequentially output to the signal processing section 48.

[0056] The system control section 45 includes a timing generator that generates various types of timing signals and the like, and controls driving of the vertical driving section 42 , the column processing section 43 , the horizontal driving section 44 and the like based on the various types of timing signals generated by the timing generator.

[0057] In the pixel array section 41, with respect to the pixel array matrix, the pixel drive line 46 extends in the row direction for each pixel row, and two vertical signal lines 47 extend in the column direction for each pixel column. For example, the pixel drive line 46 transmits a drive signal for performing drive to read out a signal from a pixel. Note that although Figure 2 One wiring of the pixel driving line 46 is shown, but the number of wirings of the pixel driving line 46 is not limited to one. One end of the pixel driving line 46 is connected to the output end of the vertical driving section 42 corresponding to each row.

[0058] <Unit Pixel Structure>

[0059] Next, a specific structure of each of the unit pixels 50 arranged in a matrix in the pixel array section 41 will be described.

[0060] The pixel 50 is configured so that the charge generated by one photodiode 61 is distributed to taps 51-1 and 51-2. Then, among the charges generated by the photodiode 61, the charge distributed to the tap 51-1 is read out from the vertical signal line 47-1 and output as the detection signal SIG1. In addition, the charge distributed to the tap 51-2 is read out from the vertical signal line 47-2 and output as the detection signal SIG2.

[0061] The tap 51-1 includes a transfer transistor 62-1, a floating diffusion (FD) portion 63-1, a selection transistor 64-1, and a reset transistor 65-1. Similarly, the tap 51-2 includes a transfer transistor 62-2, an FD portion 63-2, a selection transistor 64-2, and a reset transistor 65-2.

[0062] Will refer to Figure 4 The following describes the distribution of the electric charge in the pixel 50. Here, the distribution means reading out the electric charge accumulated in the pixel 50 (photodiode 61) at different timings so as to read out the electric charge for each tap.

[0063] like Figure 4 As shown, the irradiation light modulated (1 cycle = Tp) by repeating the on / off of the irradiation within the irradiation time T is output from the light emitting section 14, and the reflected light is received by the photodiode 61 after being delayed by the delay time Td according to the distance from the object. In addition, the transmission control signal TRT1 controls the on / off of the transmission transistor 62-1, and the transmission control signal TRT2 controls the on / off of the transmission transistor 62-2. As shown in the figure, the transmission control signal TRT1 has the same phase as the irradiation light, and the transmission control signal TRT2 has a phase obtained by reversing the phase of the transmission control signal TRT1.

[0064] Therefore, while the transfer transistor 62-1 is turned on according to the transfer control signal TRT1, the charge generated when the photodiode 61 receives the reflected light is transferred to the FD portion 63-1. In addition, while the transfer transistor 62-2 is turned on according to the transfer control signal TRT2, the charge is transferred to the FD portion 63-2. Therefore, during a predetermined period in which the irradiation of the irradiation light for the irradiation time T is periodically performed, the charge transferred via the transfer transistor 62-1 is sequentially accumulated in the FD portion 63-1, and the charge transferred via the transfer transistor 62-2 is sequentially accumulated in the FD portion 63-2.

[0065] Then, when the selection transistor 64-1 is turned on according to the selection signal SELm1 after the period in which the charge is accumulated ends, the charge accumulated in the FD portion 63-1 is read out via the vertical signal line 47-1, and a detection signal SIG1 corresponding to the charge amount is output from the light receiving portion 12. Similarly, when the selection transistor 64-2 is turned on according to the selection signal SELm2, the charge accumulated in the FD portion 63-2 is read out via the vertical signal line 47-2, and a detection signal SIG2 corresponding to the charge amount is output from the light receiving portion 12.

[0066] When the reset transistor 65-1 is turned on according to the reset signal RST_A, the charge accumulated in the FD portion 63-1 is discharged. When the reset transistor 65-2 is turned on according to the reset signal RST_B, the charge accumulated in the FD portion 63-2 is discharged.

[0067] In this way, the pixel 50 can distribute the charge generated by the reflected light received by the photodiode 61 to the taps 51-1 and 51-2 according to the delay time Td, and output the detection signal SIG1 and the detection signal SIG2. Then, the delay time Td corresponds to the time required for the light emitted from the light emitting portion 14 to fly to the object and return to the light receiving portion 12 after being reflected by the object, that is, corresponds to the distance to the object. Therefore, the distance measuring device 10 can obtain the distance (depth) to the object based on the detection signal SIG1 and the detection signal SIG2 according to the delay time Td.

[0068] <Indirect TOF ranging method>

[0069] As mentioned above, reference will be made to Figure 5 The calculation of the distance using the indirect TOF method in a dual-tap structure in which the charges accumulated in one photodiode 61 are read out using two taps 51 is described. Figure 6 Compared with the distance measurement method applicable to the present technology described in the subsequent figures, the reference Figure 5 The conventional distance measurement method is described. Figure 5 In the description, the 2-tap / 4-phase method, which is a detection method using two taps and four phases (Phase), will be described as an example.

[0070] One frame period for generating a distance image is divided into two signal detection periods of frame A and frame B. For example, one frame period for generating a distance image is set to about 1 / 30 s (seconds). Therefore, the period of frame A and the period of frame B are about 1 / 60 s, respectively.

[0071] Light emitting unit 14( Figure 1) outputs irradiation light that is modulated (1 cycle = Tp) by repeatedly turning on / off irradiation within the irradiation time Tp. For example, the irradiation time Tp can be set to about 10ns. The light receiving unit 12 receives the reflected light with a delay time Td according to the distance from the object.

[0072] In the 4-phase method, the light receiving unit 12 receives light through the tap 51-1 or the tap 51-2 at four times, which are a time when the phase is the same as the irradiation light (phase 0), a time when the phase is shifted by 90 degrees (phase 90), a time when the phase is shifted by 180 degrees (phase 180), and a time when the phase is shifted by 270 degrees (phase 270). Note that the light reception here includes a process of transferring the charge generated in the photodiode 61 to the FD unit 63 by turning on the transfer transistor 62.

[0073] exist Figure 5 In the A frame, the transmission control signal TRT1 is turned on at a timing when the phase is the same as the irradiation light (phase 0), and light reception starts through the tap 51-1. In addition, in the A frame, the transmission control signal TRT2 is turned on at a timing when the phase is shifted by 180 degrees (phase 180) from the phase of the irradiation light, and light reception starts through the tap 51-2.

[0074] In addition, in the B frame, the transmission control signal TRT1 is turned on at a timing when the phase is shifted by 90 degrees (phase 90) from the phase of the irradiated light, and light reception starts through the tap 51-1. In addition, in the B frame, the transmission control signal TRT2 is turned on at a timing when the phase is shifted by 270 degrees (phase 270) from the phase of the irradiated light, and light reception starts through the tap 51-2.

[0075] In this case, the taps 51-1 and 51-2 are exposed to light at a timing of 180 degrees of phase reversal. Assuming that the charge accumulated in the FD 63-1 of the tap 51-1 at the timing of phase 0 within the irradiation time Tp during the A frame is defined as the charge Q1, the charge Q1' according to the accumulation time of the irradiation time Tp during the A frame is accumulated in the FD 63-1 during the A frame. Then, during the readout period, the charge Q1' accumulated in the FD 63-1 is read out from the FD 63-1 as a signal corresponding to the detection signal SIG1. The signal value of the detection signal SIG1 corresponding to the charge Q1' is defined as the signal value I1.

[0076] Assuming that the charge accumulated in the FD 63-2 of the tap 51-2 at the timing of the phase 180 within the irradiation time Tp during the A frame is defined as the charge Q2, the charge Q2' according to the accumulation time of the irradiation time Tp during the A frame is accumulated in the FD 63-2 during the A frame. Then, during the readout period, the charge Q2' accumulated in the FD 63-2 is read out from the FD 63-2 as a signal corresponding to the detection signal SIG2. The signal value of the detection signal SIG2 corresponding to the charge Q2' is defined as the signal value I2.

[0077] Assuming that the charge accumulated in the FD 63-1 of the tap 51-1 at the timing of the phase 90 within the irradiation time Tp during the B frame is defined as the charge Q3, the charge Q3' according to the accumulation time of the irradiation time Tp during the B frame is accumulated in the FD 63-1 during the B frame. Then, during the readout period, the charge Q3' accumulated in the FD 63-1 is read out from the FD 63-1 as a signal corresponding to the detection signal SIG1. The signal value of the detection signal SIG1 corresponding to the charge Q3' is defined as the signal value I3.

[0078] Assuming that the charge accumulated in the FD 63-2 of the tap 51-2 at the timing of the phase 270 within the irradiation time Tp during the B frame is defined as the charge Q4, the charge Q4' according to the accumulation time of the irradiation time Tp during the B frame is accumulated in the FD 63-2 during the B frame. Then, during the readout period, the charge Q4' accumulated in the FD 63-2 is read out from the FD 63-2 as a signal corresponding to the detection signal SIG2. The signal value of the detection signal SIG2 corresponding to the charge Q4' is defined as the signal value I4.

[0079] The shift amount θ corresponding to the delay time Td can be detected based on the distribution ratio of the signal values ​​I1, I2, I3, and I4. That is, since the delay time Td is obtained based on the phase shift amount θ, the distance to the target object is obtained from the delay time Td.

[0080] The phase shift amount θ is obtained by the following equation (1), and the distance D from the target object is calculated by the following equation (2). In equation (2), C is the speed of light, and Tp is the pulse width.

[0081] [Formula 1]

[0082]

[0083] [Formula 2]

[0084]

[0085] In this way, the distance to the predetermined target object can be calculated. According to this distance measurement method, distance measurement that is less affected by ambient light can be performed. In the above and following descriptions, it is assumed that only the reflected light of the emitted pulse light is received, but in fact, various ambient lights other than the emitted pulse light are also received at the same time. Therefore, the charge accumulated in the photodiode 61 is caused by the emitted pulse light and the ambient light.

[0086] However, relative to the pulse period, the ambient light can be considered to be fixed, and in the case where the ambient light is fixed, the ambient light can be considered to be equally superimposed on the signal value I1, the signal value I2, the signal value I3, and the signal value I4 as a cancellation. Therefore, in the calculation of formula (1), the component caused by the ambient light (cancellation component) is canceled out and does not affect the distance measurement result.

[0087] On the other hand, when there is a Figure 5 When the distance measurement method described above is performed by multiple distance measuring devices 10, there is a possibility that the distance measurement may be affected by light emitted from other distance measuring devices. Figure 6 As shown in FIG. 1 , consider a case where the distance measuring device 10A and the distance measuring device 10B measure the distance to the object 81 at the same time.

[0088] The distance measuring device 10A illuminates the object 81 with the illumination light La and receives the reflected light Ra. The distance measuring device 10B illuminates the object 81 with the illumination light Lb and receives the reflected light Rb. The reflected light Ra received by the distance measuring device 10A includes the reflected light of the illumination light La emitted by the distance measuring device 10A and the reflected light of the illumination light Lb emitted by the distance measuring device 10B.

[0089] Refer again Figure 5 For example, the charge Q1 is a charge accumulated as a result of irradiating the object 81 with the irradiation light La from the distance measuring device 10A and the irradiation light Lb from the distance measuring device 10B. Both the irradiation light La and the irradiation light Lb are pulsed light. Therefore, unlike the above-mentioned ambient light, it is not cancelled out as a cancellation component. Therefore, the distance measuring device 10A is affected by the irradiation light Lb of the distance measuring device 10B, so that correct distance measurement may not be performed. This may also occur in the distance measuring device 10B.

[0090] As described above, when multiple distance measuring devices that emit high-speed flashing pulse light and perform distance measurement by light receiving operations synchronized with the pulse light operate simultaneously, the patterns of the emitted pulse light interfere with each other, which may increase the possibility that correct distance measurement cannot be performed due to the influence of the interfering light.

[0091] In view of this, a distance measuring method to which the present technology is applied will be described that enables accurate distance measurement so that each distance measuring device is not affected by interference light even if a plurality of distance measuring devices operate simultaneously.

[0092] <Distance measurement method applicable to this technology>

[0093] Figures 1 to 3 The configuration of a distance measuring device for measuring distance by a distance measuring method to which the present technology is applied is shown. Figure 7 and Figure 8 Description Figures 1 to 3 A distance measurement method to which the present technique is applied in the distance measurement device 10 having the structure shown.

[0094] With reference Figure 5 Similar to the above case, the distance measurement method will be described below by taking the 2-tap / 4-phase method as a detection method using four phases as an example, in which the charges accumulated in one photodiode 61 are read out using two taps 51.

[0095] One frame period for generating a range image includes two frames, ie, an A frame and a B frame. Figure 7 is a diagram for explaining a distance measurement method in the A frame, and Figure 8 This is a diagram for explaining the distance measurement method in the case of B frame.

[0096] The A frame and the B frame are further divided into sub-frames. One sub-frame means one period when the exposure period of the A frame (B frame) is divided into a plurality of parts.

[0097] When frame A is divided into n subframes, frame B is also divided into n subframes. That is, the number of subframes in frame A is the same as the number of subframes in frame B. The number n of subframes in frame A (frame B) is 2 or more.

[0098] The number of subframes may be fixed or variable. In the case where the number is variable, the number may be changed for each unit of generating a range image, or may be changed every predetermined time.

[0099] The period of one subframe is defined as period Tm. Period Tm is an integer multiple of the irradiation time Tp of the irradiation light. The minimum value of period Tm may be the irradiation time Tp. In addition, the maximum value of period Tm may be half of the exposure period of frame A. That is, period Tm may be set to Tm=period Tp at the minimum and may be set to period Tm=(exposure period of frame A) / 2 at the maximum. In the case where the number of subframes is variable, the number is set within a range in which these conditions regarding period Tm are satisfied.

[0100] During one subframe period, the light from the light emitting unit 14 ( Figure 1) outputs irradiation light modulated by repeatedly turning on / off irradiation within the irradiation time Tp. Two phases are set as the time to turn on irradiation. During a subframe, light is emitted multiple times, and the timing of the initial irradiation turn-on during the subframe is controlled based on the set phase.

[0101] As the phases, phase 0 and phase 1 are set. Phase 0 is a phase in which illumination is turned on at a timing without a phase shift (hereinafter, appropriately referred to as a phase 0 lighting mode or simply as phase 0), and phase 1 is a phase in which illumination is turned on at a timing with a 180-degree shift (hereinafter, appropriately referred to as a phase 1 lighting mode or simply as phase 1). Here, the description will continue by taking the case where both lighting modes are set as phase lighting modes as an example.

[0102] In the case where the phase 0 light emission mode is set, the light emitting section 14 emits light from the beginning of the subframe. In other words, in the subframe in which the phase 0 light emission mode is set, the light emitting section 14 emits irradiation light in the light emission mode with a phase of 0 degrees. The transmission control signal TRT1 is turned on in accordance with this light emission. The transmission control signal TRT2 is turned on at a timing where the phase is shifted by 180 degrees relative to the transmission control signal TRT1. In the case of phase 0, the same operation as the reference is performed. Figure 5 The operation is the same as described.

[0103] In the case where the phase 1 light emission mode is set, the light emitting section 14 emits light at a moment when the phase advances 180 degrees from the beginning of the subframe. In other words, in the subframe in which the phase 1 light emission mode is set, the light emitting section 14 emits irradiation light in a light emission mode with a phase of 180 degrees. In phase 1, the phase of the pulse of light emission is reversed relative to the phase of phase 0, that is, delayed by 180 degrees. As in the case of the phase 0 light emission mode, the transmission control signal TRT1 is turned on at the moment of starting light emission, and the transmission control signal TRT2 is turned on at a timing when the phase is shifted by 180 degrees.

[0104] Reference Figure 7 In frame A, subframe period Tm1 is set to phase 0 light emitting mode, subframe period Tm2 is set to phase 1 light emitting mode, subframe period Tm3 is set to phase 1 light emitting mode, and subframe period Tm4 is set to phase 0 light emitting mode.

[0105] Since the subframe period Tm1 is set to the phase 0 light emission mode, the irradiation of the irradiation light is turned on without any phase shift at the moment of starting the subframe period Tm1. In addition, in the subframe period Tm1, at the timing when the phase is the same as the phase of the irradiation light (phase 0), the transmission control signal TRT1 is turned on, and light reception starts through the tap 51-1. In addition, at the timing when the phase is shifted by 180 degrees (phase 180) from the phase of the irradiation light, the transmission control signal TRT2 is turned on, and light reception starts through the tap 51-2.

[0106] Since the subframe period Tm2 is set to the phase 1 light-emitting mode, the irradiation of the irradiation light is turned on at a time when the phase is shifted by 180 degrees from the start time of the subframe period Tm2. In addition, in the subframe period Tm2, ​​at a time when the phase is the same as the phase of the irradiation light (phase 0), the transmission control signal TRT1 is turned on, so that it is turned on at a time when the phase is shifted by 180 degrees from the start time of the subframe period Tm2, ​​and light reception starts through the tap 51-1. In addition, since the transmission control signal TRT2 is turned on at a time when the phase is shifted by 180 degrees (phase 180) from the phase of the irradiation light, it is turned on at a time when the phase is shifted by 360 degrees from the start time of the subframe period Tm2, ​​and light reception starts through the tap 51-2.

[0107] Since the subframe period Tm3 is set to the phase 1 light emission mode, the operation similar to that of the subframe period Tm2 is performed. Since the subframe period Tm4 is set to the phase 0 light emission mode, the operation similar to that of the subframe period Tm1 is performed.

[0108] In this way, during the A frame period, the phase 0 light emission mode or the phase 1 light emission mode is set for each subframe period, and the timing for the light emitting section 14 to start emitting light is controlled based on the set phase.

[0109] The same phase as in the A frame period is also set in the B frame period. Figure 8 , as in the A frame period, in the B frame period, subframe period Tm1' (the subframe period in the B frame period is given with a prime sign to distinguish it from the subframe period in the A frame period) is set to the phase 0 light-emitting mode, subframe period Tm2' is set to the phase 1 light-emitting mode, subframe period Tm3' is set to the phase 1 light-emitting mode, and subframe period Tm4' is set to the phase 0 light-emitting mode.

[0110] Since the subframe period Tm1' is set to the phase 0 light emission mode, the irradiation of the irradiation light is turned on without any phase shift at the moment of starting the subframe period Tm1'. In addition, in the subframe period Tm1', at the time when the phase is shifted by 90 degrees (phase 90) from the phase of the irradiation light, the transmission control signal TRT1 is turned on, and light reception starts through the tap 51-1. In addition, at the time when the phase is shifted by 270 degrees (phase 270) from the phase of the irradiation light, the transmission control signal TRT2 is turned on, and light reception starts through the tap 51-2.

[0111] Since the subframe period Tm2' is set to the phase 1 light-emitting mode, the irradiation of the irradiation light is turned on at a time when the phase is shifted by 180 degrees from the start time of the subframe period Tm2'. In addition, in the subframe period Tm2', the transmission control signal TRT1 is turned on at a time when the phase is shifted by 90 degrees (phase 90) from the phase of the irradiation light, so that it is turned on at a time when the phase is shifted by 270 degrees from the start time of the subframe period Tm2', and light reception starts through the tap 51-1. In addition, since the transmission control signal TRT2 is turned on at a time when the phase is shifted by 270 degrees (phase 270) from the phase of the irradiation light, it is turned on at a time when its phase is shifted by 450 degrees from the start time of the subframe period Tm2', and light reception starts through the tap 51-2.

[0112] Since the subframe period Tm3' is set to the phase 1 light emission mode, the operation similar to that of the subframe period Tm2' is performed. Since the subframe period Tm4' is set to the phase 0 light emission mode, the operation similar to that of the subframe period Tm1' is performed.

[0113] In this way, control is performed so that the timing (in other words, the phase) at which the light emitting section 14 starts emitting light is different for each subframe. Figure 5 , conventionally, the timing of starting light emission by the light emitting section 14 is the same. For example, during the A frame period, the irradiation light modulated by repeating on / off of irradiation within the irradiation time Tp with a phase of 0 degrees is output.

[0114] On the other hand, referring again Figure 7 For example, during the A frame period, the exposure period during the A frame period is divided into a plurality of subframes, and the phase of the start of the on / off of repeated irradiation within the irradiation time Tp is set for each subframe. The phase setting is the same between the A frame period and the B frame period.

[0115] By the mode switching unit 21 ( Figure 1 ) sets which of phase 0 and phase 1 is used to start light emission, and the light emission control unit 15 controls the light emission unit 14 based on the set mode, thereby controlling the light emission in the light emission mode under phase 0 or the light emission in the light emission mode under phase 1.

[0116] The mode switching section 21 sets the order of the phase 0 light emitting mode or the phase 1 light emitting mode. For example, as described above, the order of the phases is set, such as the order of phase 0, phase 1, phase 1, and phase 0. In the case of being represented by a digital string, it is 0110. In the case where such a digital sequence is represented as a mode, the mode switching section 21 performs a process for switching the mode at a predetermined timing.

[0117] The mode switching section 21 randomly switches between the light emission mode in the phase 0 light emission mode and the light emission mode in the phase 1 light emission mode.

[0118] A predetermined timing at which the mode switching section 21 switches the mode is set for each unit of generating a distance image, and the mode may be switched every time an A frame and a B frame for generating one distance image are acquired.

[0119] Alternatively, the mode may be switched after a predetermined time has passed. For example, the mode may be switched every time a predetermined number of range images are generated.

[0120] Alternatively, the mode may be set when the distance measuring device 10 starts distance measurement, for example, when the power of the distance measuring device 10 is turned on.

[0121] Alternatively, the mode switching section 21 may store information (pattern) about the order of light emission patterns generated during manufacturing, etc., and read out the stored pattern at the timing of switching the pattern. When the mode switching section 21 is configured to store the pattern, a different pattern is stored for each distance measuring device 10.

[0122] The stored mode may be a digital string indicating a phase 0 light emission mode or a phase 1 light emission mode, and the number of digits in the digital string may be equal to or greater than the number of divisions of the A frame (B frame) (the number of subframes included in one frame). For example, in the case where one frame includes 10 subframes, the digital string may be a string of 10 digits or a string of more than 10 digits.

[0123] In addition, in the case of storing a string of numbers equal to or greater than the number of subframes included in one frame, a string including the same number of numbers as the number of subframes is read out from the stored number string, and the position of the read string can be randomly selected.

[0124] For example, in the case where one frame includes 10 subframes and a digital string including 100 digits is stored as a digital string, a string including 10 digits among the 100 digits is read out. The starting position of the string to be read out is randomly set. For example, a string including 10 digits from the 10th digit at the head can be read out, or a string including 10 digits from the 30th digit at the head can be read out.

[0125] In the case where the mode switching section 21 generates a mode, it includes a random number generating section (not shown) that generates a random number, and the mode is randomly set by a pseudo-random number generated by the random number generating section.

[0126] In this way, the phase of the emitted pulse is set according to the instruction of the mode switching unit 21 .

[0127] The set mode is common to both A and B frames. Figure 7As shown, in the case where the phase 0, phase 1, phase 1, phase 0 pattern (the pattern of 0110 represented by the digital string) is set in the A frame, as Figure 8 As shown, a pattern of phase 0, phase 1, phase 1, and phase 0 (a pattern of 0110 represented by a digital string) is also set in the B frame.

[0128] As described above, the timing at which the light emitting unit 14 starts emitting light varies within one frame. In addition, the readout timing is set based on the timing at which the light emitting unit 14 starts emitting light.

[0129] When control is performed to change the timing of emitting the irradiation light, Figure 5 As in the case described above, the distance to the target object is also calculated by detecting the offset θ corresponding to the delay time Td using the distribution ratio of the signal value I1 , the signal value I2 , the signal value I3 , and the signal value I4 .

[0130] During the A frame ( Figure 7 ), the charge Q1 is accumulated in the FD63-1 of the tap 51-1 at the timing of phase 0 in the irradiation time Tp. During the A frame period, the charge Q1' corresponding to the accumulation time of the irradiation time Tp in the A frame period is accumulated in the FD63-1. Then, during the readout period, the signal value I1 of the detection signal SIG1 corresponding to the charge Q1' accumulated in the FD63-1 is read out from the FD63-1.

[0131] During the A frame period, the charge Q2 is accumulated in the FD 63-2 of the tap 51-2 at the timing of the phase 180 in the irradiation time Tp. During the A frame period, the charge Q2' corresponding to the accumulation time of the irradiation time Tp in the A frame period is accumulated in the FD 63-2. Then, during the readout period, the signal value I2 of the detection signal SIG2 corresponding to the charge Q2' accumulated in the FD 63-2 is read out from the FD 63-2.

[0132] During the B frame, the charge Q3 is accumulated in the FD 63-1 of the tap 51-1 at the timing of the phase 90 in the irradiation time Tp. During the B frame, the charge Q3' corresponding to the accumulation time of the irradiation time Tp in the B frame period is accumulated in the FD 63-1. Then, during the readout period, the signal value I3 of the detection signal SIG1 corresponding to the charge Q3' accumulated in the FD 63-1 is read out from the FD 63-1.

[0133] During the B frame, the charge Q4 is accumulated in the FD 63-2 of the tap 51-2 at the timing of the phase 270 in the irradiation time Tp. During the B frame, the charge Q4' corresponding to the accumulation time of the irradiation time Tp in the B frame period is accumulated in the FD 63-2. Then, during the readout period, the signal value I4 of the detection signal SIG2 corresponding to the charge Q4' accumulated in the FD 63-2 is read out from the FD 63-2.

[0134] The shift amount θ corresponding to the delay time Td can be detected based on the distribution ratio of the signal values ​​I1, I2, I3, and I4. That is, since the delay time Td is obtained based on the phase shift amount θ, the distance to the target object is obtained from the delay time Td.

[0135] The phase shift θ is obtained by the above equation (1), and the distance D from the target object is calculated by the above equation (2).

[0136] In this way, the distance to the predetermined target object can be calculated. According to this distance measurement method, distance measurement that is less affected by ambient light can be performed. Figure 7 and Figure 8 As described above, even if a plurality of distance measuring devices are operated simultaneously, the timing (phase) of starting emission of irradiation light can be set for each subframe to prevent the patterns of pulsed light emitted therein from interfering with each other, thereby enabling accurate distance measurement.

[0137] In other words, even when a plurality of distance measuring devices that emit high-speed flash pulse light and perform distance measurement by light receiving operation synchronized with the pulse light are operated simultaneously, each distance measuring device can perform correct distance measurement without being affected by interference light. This will be described further.

[0138] Fig. 9 This is a diagram used to illustrate that the influence of other equipment on this equipment can be eliminated, in other words, the influence of interference light can be removed. Figure 7 The same situation is shown, Fig. 9 The above figure in is used to illustrate the ranging operation in the A frame, and Fig. 9 The following figure is used to illustrate the ranging operation in the B frame. Fig. 9 Not only reflected light generated by the irradiation light emitted by the present device but also reflected light generated by the irradiation light emitted by other devices is shown as interference light.

[0139] Assume that the present device is the distance measuring device 10A, the other device is the distance measuring device 10B, and Figure 6 The illustrated situation is the same, that is, the distance measuring device 10A and the distance measuring device 10B are placed close to each other to measure the distance to the object 81.

[0140] In reference Figure 7 and Figure 8 The distance measuring device 10A emits the illumination light while changing the phase as described, while the distance measuring device 10B emits the illumination light without changing the phase. Fig. 9 In the example shown, the distance measuring device 10A emits light by alternately changing the phase 0 light emission mode and the phase 1 light emission mode. The distance measuring device 10B continuously emits light in the phase 0 light emission mode. In other words, the distance measuring device 10B is the same as the conventional distance measuring device. Figure 5 The described light emission, or light emission when a mode in which phase 0 is continuous is set as the phase mode.

[0141] When light emission is performed in phase 0 of the A frame, charge Q1-0 is accumulated in FD 63-1 of tap 51-1 of distance measuring device 10A by receiving reflected light due to light emitted by distance measuring device 10A. In addition, charge R1-0 is accumulated in FD 63-1 of tap 51-1 of distance measuring device 10A by receiving interference light due to light emitted by distance measuring device 10B.

[0142] When light emission is performed in phase 0 of the A frame, charge Q2-0 is accumulated in FD 63-2 of tap 51-2 of the ranging device 10A by receiving reflected light due to the light emitted by the ranging device 10A. In addition, charge R2-0 is accumulated in FD 63-2 of tap 51-2 of the ranging device 10A by receiving interference light due to the light emitted by the ranging device 10B.

[0143] When light emission is performed in Phase 1 of the A frame, charge Q1-1 is accumulated in FD 63-1 of tap 51-1 of distance measuring device 10A by receiving reflected light due to light emitted by distance measuring device 10A. In addition, charge R1-1 is accumulated in FD 63-1 of tap 51-1 of distance measuring device 10A by receiving interference light due to light emitted by distance measuring device 10B.

[0144] When light emission is performed in Phase 1 of the A frame, charge Q2-1 is accumulated in the FD 63-2 of the tap 51-2 of the ranging device 10A by receiving reflected light due to the light emitted by the ranging device 10A. In addition, charge R2-1 is accumulated in the FD 63-2 of the tap 51-2 of the ranging device 10A by receiving interference light due to the light emitted by the ranging device 10B.

[0145] When light emission is performed in phase 0 of the B frame, charge Q3-0 is accumulated in FD 63-1 of tap 51-1 of distance measuring device 10A by receiving reflected light due to light emitted by distance measuring device 10A. In addition, charge R3-0 is accumulated in FD 63-1 of tap 51-1 of distance measuring device 10A by receiving interference light due to light emitted by distance measuring device 10B.

[0146] When light emission is performed in phase 0 of the B frame, charge Q4-0 is accumulated in FD 63-2 of tap 51-2 of distance measuring device 10A by receiving reflected light due to light emitted by distance measuring device 10A. In addition, charge R4-0 is accumulated in FD 63-2 of tap 51-2 of distance measuring device 10A by receiving interference light due to light emitted by distance measuring device 10B.

[0147] When light emission is performed in Phase 1 of the B frame, charge Q3-1 is accumulated in FD 63-1 of tap 51-1 of ranging device 10A by receiving reflected light due to light emitted by ranging device 10A. In addition, charge R3-1 is accumulated in FD 63-1 of tap 51-1 of ranging device 10A by receiving interference light due to light emitted by ranging device 10B.

[0148] When light emission is performed in Phase 1 of the B frame, charge Q4-1 is accumulated in FD 63-2 of tap 51-2 of distance measuring device 10A by receiving reflected light due to light emitted by distance measuring device 10A. In addition, charge R4-1 is accumulated in FD 63-2 of tap 51-2 of distance measuring device 10A by receiving interference light due to light emitted by distance measuring device 10B.

[0149] As described above, the distance measuring device 10A is affected by the interference light of the distance measuring device 10B. For example, when light emission is performed in phase 0 of the A frame, the charge Q1-0 and the charge R1-0 are accumulated in the FD 63-1 of the distance measuring device 10A, and the charge Q2-0 and the charge R2-0 are accumulated in the FD 63-2. In addition, when light emission is performed in phase 1 of the A frame, the charge Q1-1 and the charge R1-1 are accumulated in the FD 63-1 of the distance measuring device 10A, and the charge Q2-1 and the charge R2-1 are accumulated in the FD 63-2.

[0150] The value obtained by adding the charge R1-0 accumulated due to the influence of the interference light during the irradiation of phase 0 to the charge R1-1 accumulated due to the influence of the interference light during the irradiation of phase 1 is defined as the value R1. The value obtained by adding the charge R2-0 accumulated due to the influence of the interference light during the irradiation of phase 0 to the charge R2-1 accumulated due to the influence of the interference light during the irradiation of phase 1 is defined as the value R2.

[0151] The value R1 and the value R2 are the same (basically the same). Therefore, in the above formula (1) for obtaining the phase, the value R1 corresponding to the value I1 and the value R2 corresponding to the value I2 are subtracted to cancel the light receiving component of the interference light, thereby eliminating the influence of the interference light during position detection.

[0152] In this way, in frame A, the influence of the light-receiving component of the interference light can be removed, thereby preventing the accuracy of position detection from being reduced. In addition, in frame B, as in frame A, the light-receiving component of the interference light can be offset, thereby reducing the influence of the interference light during position detection.

[0153] That is, in a B frame, Fig. 9 As shown in the figure below, the value obtained by adding the charge R3-0 accumulated due to the influence of the interference light during the irradiation of phase 0 and the charge R3-1 accumulated due to the influence of the interference light during the irradiation of phase 1 is also defined as the value R3. The value obtained by adding the charge R4-0 accumulated due to the influence of the interference light during the irradiation of phase 0 and the charge R4-2 accumulated due to the influence of the interference light during the irradiation of phase 1 is defined as the value R4.

[0154] The value R3 and the value R4 are the same (basically the same). Therefore, in the above formula (1) for obtaining the phase, the value R3 corresponding to the value I3 and the value R4 corresponding to the value I4 are subtracted to cancel the light-receiving component of the interference light, thereby eliminating the influence of the interference light during position detection.

[0155] This can be expressed by the following formula (3) obtained by substituting numerical values ​​into formula (1).

[0156] [Formula 3]

[0157]

[0158] In the formula (3), R1=R2 and R3=R4, so the formula (3) is ultimately the same as the formula (1). As described above, it can be confirmed from the formula that the influence of interference light can be eliminated by applying this technology.

[0159] Due to the configuration as described above (in which the order of the phase light emission patterns is determined by a unique random number pattern in each ranging device 10), even if a plurality of ranging devices 10 are placed close to each other and are affected by other ranging devices 10A, the light emission patterns of other ranging devices 10 can be set to have no correlation with the readout timing of the present ranging device 10. Therefore, the light receiving components of other ranging devices 10 can be equally distributed to the tap 51-1 and the tap 51-2.

[0160] Therefore, in the above equation (1) as a phase detection equation, the light reception components of other distance measuring devices 10 are cancelled out, so that distance detection can be performed without being interfered by the light emission patterns of other distance measuring devices 10 .

[0161] Note that in reference Fig. 9 In the illustrated example, two ranging devices, i.e., the ranging device 10A and the ranging device 10B, are close to each other, and the ranging device 10B continuously emits light in phase 0. However, even in a case where a plurality of ranging devices 10 to which the present technology is applied are placed close to each other, distance detection can be performed without being interfered by the light emission patterns of light emitted from other ranging devices 10.

[0162] Each of the plurality of distance measuring devices 10 is set to a mode having a phase 0 light emission mode and a phase 1 light emission mode, and irradiation control is performed based on the set mode. Focusing on one of the plurality of distance measuring devices 10, the correlation between the light emission mode of the other distance measuring devices 10 and the readout phase of the present distance measuring device 10 (in the above example, the four phases of Q1 to Q4 are read out) is low. When the correlation decreases, the light receiving signals from the other distance measuring devices 10 are distributed approximately equally to each phase. Therefore, in the above formula (1) as a phase detection formula, the components generated by the light receiving signals from the other distance measuring devices 10 are canceled.

[0163] Therefore, when the pattern of light emission is set for each of the plurality of distance measuring devices 10 , each distance measuring device 10 can detect the distance without being affected by other distance measuring devices 10 .

[0164] Furthermore, even if the plurality of distance measuring devices 10 include a distance measuring device 10 to which the present technology is not applicable, the distance can be detected without being affected by the light emitted from the distance measuring device 10. For example, even in a case such as Fig. 9 The distance measuring device 10B shown in the figure continuously emits light in phase 0 without changing the light emission mode and is placed close to the distance measuring device 10A. The distance measuring device 10A can also be placed as shown in FIG. Fig. 9 The description is made that the distance detection is performed without being affected by the distance measuring device 10B.

[0165] By applying the present technology, reflected light due to light emitted by other distance measuring devices 10 can be treated equally with fixed ambient light, so distance measurement can be performed more accurately.

[0166] Even in the case where there is a device that causes light to flicker but does not perform distance measurement and the distance measuring device to which the present technology is applied is interfered with and affected by the flickering light of the device, the distance measuring device 10 can cancel the interference caused by the flickering light in the same manner as described above, thereby being able to detect the distance with high accuracy. That is, according to the present technology, the influence (interference) of various types of light flicker noise can be reduced, and the distance can be detected more accurately.

[0167] In addition, since phase modulation is performed within the pulse period Tp in the light emission according to the present technology, light emission can be performed without changing the total time of light emission. For example, Patent Documents 2 and 3 propose setting a period in which no light is emitted to prevent interference. However, by setting a period in which no light is emitted, for example, the total light emission time within a period (one frame) for generating a distance image is reduced, and thus the detection sensitivity may be reduced. Alternatively, in order to make the total light emission time equal to the total light emission time in a case where the present technology is applicable, the pulse period Tp is increased because there is a period in which no light is emitted. Therefore, the exposure sensitivity may be reduced.

[0168] However, since phase modulation is performed within the pulse period Tp in the light emission according to the present technology as described above, light emission can be performed without changing the total light irradiation time. Therefore, interference with other devices can be avoided without reducing exposure sensitivity.

[0169] The above embodiment illustrates an example in which the phase lighting mode includes a phase 0 (=0 degree) lighting mode and a phase 1 (=180 degree) lighting mode. However, any other lighting mode may be set. For example, Fig.10 As shown, four phase lighting modes can be set, and these phase lighting modes can be changed by generating pseudo-random numbers.

[0170] Reference Fig.10 , the phase 0 light emission mode, the phase 1 light emission mode, the phase 2 light emission mode, and the phase 3 light emission mode are set as phase light emission modes. In the phase 0 light emission mode, the light emission is turned on at a time when there is no phase shift. In the phase 1 light emission mode, the light emission is turned on at a time when there is a 90 degree shift.

[0171] In the phase 2 lighting mode, the illumination is turned on at a timing that is offset by 180 degrees. In the phase 3 lighting mode, the illumination is turned on at a timing that is offset by 270 degrees.

[0172] When the phase 0 light emission mode is set, the light emitting unit 14 emits light from the beginning of the subframe. When the phase 1 light emission mode is set, the light emitting unit 14 emits light when the phase advances 90 degrees from the beginning of the subframe.

[0173] When the phase 2 emission mode is set, the light emitting unit 14 emits light when the phase advances 180 degrees from the beginning of the subframe. When the phase 3 emission mode is set, the light emitting unit 14 emits light when the phase advances 270 degrees from the beginning of the subframe.

[0174] In this way, four types of phase light-emitting modes can be set, and as in the above-mentioned embodiment, a pseudo-random number can be generated, and the light-emitting mode can be set according to the pseudo-random number. The present technology can be applicable to the case where two types of phase light-emitting modes, three types of phase light-emitting modes, or four types of phase light-emitting modes are set. In addition, for example, in the case where two types of phase light-emitting modes are set, in the above example, they are phase 0 (= 0 degrees) light-emitting mode and phase 1 (= 180 degrees) light-emitting mode. However, the combination is not limited to this. For example, the present technology can be applicable to the case where phase light-emitting modes of 0 degrees and 90 degrees are set, or the case where phase light-emitting modes of 90 degrees and 270 degrees are set.

[0175] In addition, the present technology can also be applied to the case where four or more phase light emission modes are set. The phase can be set to 0 to 359 degrees. If the phase is set at 1 degree intervals, light emission modes of phases 0 to 359 corresponding to 0 to 359 degrees are set, and light emission modes of combinations of light emission modes of phases 0 to 359 are set.

[0176] Even if the phase is set at 10-degree intervals instead of 1-degree intervals, light emission patterns of phases 0 to 35 corresponding to 0 to 350 degrees are set, and light emission patterns are set according to a combination of light emission patterns of phases 0 to 35. Therefore, the possibility of overlapping with light emission patterns of other devices can be reduced.

[0177] As described above, the phase lighting pattern may be a discrete phase modulation such as 0 degrees or 90 degrees, or may be finely set to be a modulation that is regarded as continuous phase modulation. In the case where the phase lighting pattern is set so that it can be regarded as continuous phase modulation, a numerical value generated as a pseudo-random number may be used as the phase. For example, if the generated pseudo-random number is 50, 50 degrees may be set as the phase.

[0178] The present technology can be applied to the above-mentioned indirect TOF method. The present technology can also be applied to the direct TOF method. For example, the present technology can be applied to a LIDAR system using the direct TOF method. That is, the present technology can be applied to the direct TOF method that performs measurement in the direct time domain, and to the indirect TOF method that performs measurement using a change in a physical quantity that depends on TOF and a time reference for converting the change into a change in time.

[0179] Furthermore, the present technology can be applied not only to devices related to distance measurement but also to devices that synchronously receive reflected light due to irradiated pulse light.

[0180] In addition, although the above embodiment describes a 2-tap / 4-phase TOF sensor as an example, the present technology can also be applied to other types of TOF sensors. For example, the present technology can be applied to Fig.11 The 4-tap / 4-phase TOF sensor shown.

[0181] For example, something like Figure 7 , Fig.11 This is a diagram for explaining a distance measurement method to which the present technique is applied in the distance measurement device 10 and a distance measurement method using a 4-tap / 4-phase method.

[0182] The 4-tap / 4-phase TOF sensor is a sensor having four readout sections corresponding to the taps 51 described above. Fig.11 In the example shown, a tap controlled by a transmission control signal TRT1 (referred to as tap TRT1), a tap controlled by a transmission control signal TRT2 (referred to as tap TRT2), a tap controlled by a transmission control signal TRT3 (referred to as tap TRT3), and a tap controlled by a transmission control signal TRT4 (referred to as tap TRT4) correspond to four taps.

[0183] In one frame as a unit for generating a distance image, readout of the same phase as that of the irradiation light (phase 0) is performed by the tap TRT1, and readout of a phase shifted by 180 degrees from that of the irradiation light (phase 180) is performed by the tap TRT2.

[0184] Furthermore, readout of a phase shifted by 90 degrees (phase 90) from the phase of the irradiation light is performed by the tap TRT3, and readout of a phase shifted by 270 degrees (phase 270) from the phase of the irradiation light is performed by the tap TRT4.

[0185] As described above, according to the 4-tap / 4-phase TOF sensor, processing equivalent to the 2-tap / 4-phase method can be performed in one frame without using two frames such as frame A and frame B. That is, the present technology can be applied to a case where one frame is divided into a plurality of subframes and the phase of the irradiation light is changed for each subframe, and the present technology can be applied to both the 2-tap / 4-phase TOF sensor and the 4-tap / 4-phase TOF sensor.

[0186] In the above-described embodiment, the length of the subframe period Tm is fixed, but the length of the subframe period Tm may be further changed to prevent interference.

[0187] Refer again Figure 7. A frame is divided into n subframes, and the periods Tm1, Tm2 to Tmn of the n subframes are set to the same length. The length of the subframe period Tm can be changed. Figure 7 In the example shown, the lengths of the periods Tm1 and Tm2 to Tmn may be different from each other.

[0188] In the case where the length of the period Tm is changed, the phase pattern can be set by generating a pseudo-random number, or the phase pattern can be stored in advance and read out as needed, as in the above-mentioned phase pattern. Due to the configuration in which both the pattern of the subframe period Tm and the light emission pattern in the subframe are changed, the possibility of overlapping with the pattern of pulse light from other devices can be reduced, so that distance measurement can be performed with less influence of interference light.

[0189] <Recording Medium>

[0190] The above series of processes can be implemented by hardware or software. In the case of implementing a series of processes by software, the program constituting the software is installed on a computer. Here, the computer includes a computer embedded in special hardware, and a general-purpose personal computer capable of implementing various functions by installing various programs, for example.

[0191] Fig.12 2 is a block diagram showing a configuration example of the hardware of a computer that implements the above-mentioned series of processes in a programmable manner. In the computer, a central processing unit (CPU) 201, a read-only memory (ROM) 202, and a random access memory (RAM) 203 are connected to each other via a bus 204. An input / output interface 205 is further connected to the bus 204. An input section 206, an output section 207, a storage section 208, a communication section 209, and a drive 210 are connected to the input / output interface 205.

[0192] The input unit 206 includes a keyboard, a mouse, a microphone, etc. The output unit 207 includes a display, a speaker, etc. The memory 208 includes a hard disk, a nonvolatile memory, etc. The communication unit 209 includes a network interface, etc. The drive 210 drives a removable medium 211 such as a magnetic disk, an optical disk, a magneto-optical disk, or a semiconductor memory.

[0193] In the computer configured as described above, for example, the CPU 201 loads a program stored in the storage 208 into the RAM 203 via the input / output interface 205 and the bus 204 and implements the program, thereby executing the above-described series of processing.

[0194] For example, the program implemented by the computer (CPU 201) can be recorded and provided on the removable medium 211 as a package medium or the like. In addition, the program can also be provided via a wired or wireless transmission medium such as a local area network, the Internet, and digital satellite broadcasting.

[0195] In the computer, by loading the removable medium 211 into the drive 210, the program can be installed in the memory 208 via the input / output interface 205. In addition, the program can be received by the communication section 209 and installed in the memory 208 via a wired or wireless transmission medium. In addition, the program can be pre-installed in the ROM 202 or the memory 208.

[0196] Note that the program implemented by a computer may be a program in which the processes are executed in time series in the order described in this specification, or may be a program in which the processes are executed in parallel or at necessary timing such as when the processes are called.

[0197] <Application example of mobile object>

[0198] The technology according to the present disclosure (the present technology) can be applied to various products. For example, the technology according to the present disclosure can be implemented as a device installed on any type of mobile body such as a car, an electric car, a hybrid electric car, a motorcycle, a bicycle, a personal mobile device, an airplane, an unmanned aerial vehicle, a ship, and a robot.

[0199] Fig.13 This is a block diagram showing a schematic configuration example of a vehicle control system as an example of a mobile object control system to which the technology according to the present disclosure can be applied.

[0200] The vehicle control system 12000 includes a plurality of electronic control units connected to each other via a communication network 12001. Fig.13 In the example shown, the vehicle control system 12000 includes a drive system control unit 12010, a main system control unit 12020, an external information detection unit 12030, an internal information detection unit 12040, and an integrated control unit 12050. In addition, as a functional configuration of the integrated control unit 12050, a microcomputer 12051, a sound / image output unit 12052, and an in-vehicle network interface (I / F) 12053 are shown.

[0201] The drive system control unit 12010 controls the operation of devices related to the drive system of the vehicle according to various programs. For example, the drive system control unit 12010 serves as a control device on a drive force generating device such as an internal combustion engine or a drive motor for generating the drive force of the vehicle, a drive force transmission mechanism for transmitting the drive force to the wheels, a steering mechanism for adjusting the steering angle of the vehicle, and a braking device for generating the braking force of the vehicle.

[0202] The main system control unit 12020 controls the operation of various devices installed to the vehicle body according to various programs. For example, the main system control unit 12020 is used as a control device for a keyless entry system, a smart key system, a power window device, or various lights such as a headlight, a taillight, a brake light, a turn signal light, or a fog light. In this case, the main system control unit 12020 can receive radio waves transmitted from a portable device or signals from various switches instead of keys. The main system control unit 12020 receives input of these radio waves or signals and controls the door lock device, the power window device, the lights, etc. of the vehicle.

[0203] The vehicle exterior information detection unit 12030 detects information related to the exterior of the vehicle equipped with the vehicle control system 12000. For example, the vehicle exterior information detection unit 12030 is connected to the imaging unit 12031. The vehicle exterior information detection unit 12030 causes the imaging unit 12031 to capture an image of the exterior of the vehicle and receives the captured image. The vehicle exterior information detection unit 12030 can detect objects such as people, cars, obstacles, road signs, text on the road surface, etc. based on the received image, or detect the distance thereto.

[0204] The imaging unit 12031 is an optical sensor that receives light and outputs an electrical signal corresponding to the amount of light received. The imaging unit 12031 can output the electrical signal as an image or as information for distance measurement. In addition, the light received by the imaging unit 12031 can be visible light or invisible light such as infrared rays.

[0205] The in-vehicle information detection unit 12040 detects information related to the interior of the vehicle. For example, the in-vehicle information detection unit 12040 is connected to a driver state detection unit 12041 for detecting the state of the driver. For example, the driver state detection unit 12041 may include a camera that captures an image of the driver. Based on the detection information input from the driver state detection unit 12041, the in-vehicle information detection unit 12040 may calculate the driver's fatigue or the driver's concentration, or may determine whether the driver has fallen asleep.

[0206] For example, the microcomputer 12051 may calculate a control target value of a driving force generating device, a steering mechanism, or a braking device based on information about the interior and exterior of the vehicle obtained by the exterior information detection unit 12030 or the interior information detection unit 12040, and may output a control instruction to the drive system control unit 12010. For example, the microcomputer 12051 may perform coordinated control to achieve functions of an advanced driver assistance system (ADAS) including collision avoidance or collision mitigation for vehicles, tracking driving based on a distance between vehicles, vehicle speed maintenance driving, collision warning of vehicles, lane departure warning of vehicles, and the like.

[0207] In addition, the microcomputer 12051 can coordinate control by controlling the driving force generating device, steering mechanism, braking device, etc. based on the information about the vehicle's surrounding conditions obtained by the external information detection unit 12030 or the internal information detection unit 12040, so that the vehicle can drive autonomously without relying on automatic driving, etc.

[0208] In addition, the microcomputer 12051 can output a control instruction to the main system control unit 12020 based on the information about the outside of the vehicle obtained by the vehicle outside information detection unit 12030. For example, the microcomputer 12051 performs coordinated control based on the position of the leading vehicle or the oncoming vehicle detected by the vehicle outside information detection unit 12030, for example, the coordinated control includes controlling the headlights and such as changing the high beam to the low beam to prevent glare.

[0209] The sound / image output unit 12052 transmits an output signal of at least one of sound or image to an output device capable of visually or auditorily notifying the occupants of the vehicle or information outside the vehicle. Fig.13 In the example of FIG. 1 , as output devices, an audio speaker 12061, a display portion 12062, and an instrument panel 12063 are shown. For example, the display portion 12062 may include at least one of an in-vehicle display or a head-up display.

[0210] Fig.14 12031 is a diagram showing an example of the installation position of the imaging unit 12031.

[0211] exist Fig.14 In the figure, vehicle 12100 includes imaging units 12101, 12102, 12103, 12104 and 12105 as imaging unit 12031.

[0212] For example, the imaging units 12101, 12102, 12103, 12104, and 12105 are arranged in locations such as the front of the vehicle 12100, the side mirrors, the rear bumper or the rear door, and the upper side of the windshield in the compartment of the vehicle 12100. The imaging unit 12101 arranged in the front of the vehicle and the imaging unit 12105 arranged on the upper side of the windshield in the compartment of the vehicle mainly obtain images of the environment in front of the vehicle 12100. The imaging units 12102 and 12103 arranged on the side mirrors of the vehicle 12100 mainly obtain images of the side environment of the vehicle 12100. The imaging unit 12104 arranged in the rear bumper or the rear door of the vehicle 12100 mainly obtains images of the rear environment of the vehicle 12100. The imaging unit 12105 arranged on the upper side of the windshield in the compartment of the vehicle is mainly used to detect the front vehicle, pedestrians, obstacles, traffic signals, traffic signs, lanes, etc.

[0213] Notice, Fig.14 An example of the imaging ranges of the imaging units 12101 to 12104 is shown. The imaging range 12111 represents the imaging range of the imaging unit 12101 in the front of the vehicle, the imaging ranges 12112 and 12113 represent the imaging ranges of the imaging units 12102 and 12103 in the side mirrors, respectively, and the imaging range 12114 represents the imaging range of the imaging unit 12104 in the rear bumper or the rear door. For example, a bird's-eye view image of the vehicle 12100 seen from above can be obtained by superimposing the image data captured by the imaging units 12101 to 12104.

[0214] At least one of the imaging units 12101 to 12104 may have a function of acquiring distance information. For example, at least one of the imaging units 12101 to 12104 may be a stereo camera including a plurality of imaging elements, or may be an imaging element including pixels for phase difference detection.

[0215] For example, based on the distance information obtained from the imaging units 12101 to 12104, the microcomputer 12051 obtains the distance between the vehicle 12100 and each solid object within the imaging ranges 12111 to 12114 and the time change of the distance (relative speed relative to the vehicle 12100), and can extract the solid object located on the driving route of the vehicle 12100, especially the solid object closest to the vehicle 12100 and traveling at a predetermined speed (for example, 0 km / h or more) in the direction substantially the same as the driving direction of the vehicle 12100 as the front vehicle. In addition, the microcomputer 12051 can perform automatic braking control (including tracking driving stop control), automatic acceleration control (including tracking driving start control), etc. by presetting the distance to be maintained between the vehicle 12100 and the front vehicle. In this way, coordinated control such as automatic driving that aims to achieve autonomous driving of the vehicle without relying on the operation of the driver can be performed.

[0216] For example, based on the distance information obtained from the imaging units 12101 to 12104, the microcomputer 12051 can classify the three-dimensional object data of the three-dimensional object into two-wheeled vehicles, ordinary vehicles, large vehicles, pedestrians, and other three-dimensional objects such as electric poles, extract data, and automatically avoid obstacles using the data. For example, the microcomputer 12051 classifies the obstacles around the vehicle 12100 into obstacles that can be seen by the driver of the vehicle 12100 and obstacles that are difficult for the driver to see. Then, the microcomputer 12051 determines the collision risk indicating the degree of danger of collision with each obstacle. When the collision risk is equal to or higher than the set value and therefore there is a possibility of collision, the microcomputer 12051 can perform driving assistance for collision avoidance by outputting a warning to the driver via the audio speaker 12061 or the display unit 12062 or by performing forced deceleration or evasive steering via the drive system control unit 12010.

[0217] At least one of the imaging units 12101 to 12104 may be an infrared camera that detects infrared rays. For example, the microcomputer 12051 may determine whether the image captured by the imaging units 12101 to 12104 includes a pedestrian, and identify the pedestrian. For example, the method for identifying a pedestrian includes the steps of extracting feature points in the image captured by the imaging units 12101 to 12104 as infrared cameras and performing pattern matching processing on a series of feature points indicating the outline of the object to determine whether the object is a pedestrian. When the microcomputer 12051 determines that the image captured by the imaging units 12101 to 12104 includes a pedestrian, and identifies the pedestrian, the sound / image output unit 12052 controls the display unit 12062 so that a superimposed quadrilateral outline is displayed on the identified pedestrian to emphasize the pedestrian. In addition, the sound / image output unit 12052 may control the display unit 12062 so that an icon indicating a pedestrian is displayed at a desired position, etc.

[0218] Furthermore, in this specification, a system represents the entire device composed of a plurality of devices.

[0219] It should be noted that the effects described in this specification are merely exemplary and non-limiting, and there may be other effects.

[0220] It should be noted that the embodiments of the present technology are not limited to the above-described embodiments, and various changes can be made without departing from the gist of the present technology.

[0221] Note that the present technology may also have the following configurations.

[0222] (1) A distance measuring device comprising:

[0223] a light emitting portion that emits irradiation light;

[0224] a light receiving portion that receives reflected light generated by reflection of the irradiated light on the target object;

[0225] a calculation section that calculates a distance to the target object based on a time from emission of the irradiation light to reception of the reflected light; and

[0226] a light emitting control unit, which controls the light emitting unit,

[0227] The light emission control section controls the light emission of the light emitting section by switching between a first light emission mode and a second light emission mode different from the first light emission mode within a predetermined frame.

[0228] (2) The distance measuring device according to (1), wherein

[0229] The light emission control section randomly switches between the first light emission mode and the second light emission mode.

[0230] (3) The distance measuring device according to (1) or (2), wherein

[0231] The predetermined frame has a first subframe and a second subframe, and

[0232] The light emission control section applies a first light emission mode in a first subframe and applies a second light emission mode in a second subframe.

[0233] (4) The distance measuring device according to any one of (1) to (3), wherein

[0234] The light emitting portion emits pulse light, and

[0235] The first light emission mode and the second light emission mode are different in phase of the pulse light.

[0236] (5) The distance measuring device according to (4), wherein

[0237] The phase is set discretely or continuously.

[0238] (6) The distance measuring device according to (4), wherein

[0239] The phase is any one of 0 degrees, 90 degrees, 180 degrees, and 270 degrees.

[0240] (7) The distance measuring device according to any one of (1) to (3),

[0241] The light emitting portion emits pulse light, and

[0242] The first light emission pattern and the second light emission pattern differ in the timing of starting emission of the pulse light.

[0243] (8) The distance measuring device according to (3), wherein

[0244] The first subframe and the second subframe have different period lengths.

[0245] (9) The distance measuring device according to any one of (1) to (8),

[0246] The light emission control section switches the first light emission mode and the second light emission mode based on the stored information on the order of the light emission modes.

[0247] (10) The distance measuring device according to any one of (1) to (9),

[0248] In the predetermined frame, the distance measuring device distributes the charge generated by the light receiving section receiving the reflected light to a first tap and a second tap, and detects a first detection signal according to the charge accumulated in the first tap and a second detection signal according to the charge accumulated in the second tap;

[0249] In a frame following the predetermined frame, the distance measuring device distributes the charge generated by the light receiving portion receiving the reflected light to a first tap and a second tap, and detects a third detection signal based on the charge accumulated in the first tap and detects a fourth detection signal based on the charge accumulated in the second tap; and

[0250] The calculation section calculates a distance to the target object using the first to fourth detection signals.

[0251] (11) The distance measuring device according to any one of (1) to (9),

[0252] In the predetermined frame, the distance measuring device distributes the charge generated by receiving the reflected light by the light receiving section to the first to fourth taps, and detects a first detection signal according to the charge accumulated in the first tap, a second detection signal according to the charge accumulated in the second tap, a third detection signal according to the charge accumulated in the third tap, and a fourth detection signal according to the charge accumulated in the fourth tap, and

[0253] The calculation section calculates a distance to the target object using the first to fourth detection signals.

[0254] (12) The distance measuring device according to any one of (1) to (11),

[0255] The distance measuring device is an indirect type time-of-flight (TOF) sensor.

[0256] (13) The distance measuring device according to any one of (1) to (11),

[0257] The distance measuring device is a direct time-of-flight (TOF) sensor.

[0258] (14) The distance measuring device according to any one of (1) to (13),

[0259] The light emission control section controls light emission of the light emitting section by switching a first light emission mode, a second light emission mode, a third light emission mode different from the first and second light emission modes, and a fourth light emission mode different from the first to third light emission modes within the predetermined frame.

[0260] (15) The distance measuring device according to (14), wherein

[0261] The second light-emitting mode is 90 degrees out of phase with the first light-emitting mode.

[0262] The third light emitting mode is 180 degrees out of phase with the first light emitting mode, and

[0263] The fourth light emitting mode is 270 degrees out of phase with the first light emitting mode.

[0264] (16) A distance measurement method, comprising the following steps performed by a distance measurement device that performs distance measurement processing:

[0265] emit irradiating light;

[0266] receiving reflected light generated by reflection of the illumination light on a target object;

[0267] calculating a distance to the target object based on a time from emission of the illumination light to reception of the reflected light; and

[0268] controlling the emission of the irradiation light,

[0269] In the emission control, a first emission mode and a second emission mode different from the first emission mode are switched within a predetermined frame to control the emission.

[0270] (17) A program for causing a computer of a distance measuring device to perform distance measurement processing to execute processing, comprising:

[0271] emit irradiating light;

[0272] receiving reflected light generated by reflection of the illumination light on a target object;

[0273] calculating a distance to the target object based on a time from emission of the illumination light to reception of the reflected light; and

[0274] controlling the emission of the irradiation light,

[0275] The processing includes switching a first light emission mode and a second light emission mode different from the first light emission mode within a predetermined frame to control light emission during the emission control.

[0276] Reference numerals list

[0277] 10 Distance measuring device

[0278] 11. Lens

[0279] 12 Light receiving part

[0280] 13 Signal Processing Unit

[0281] 14. Light-emitting part

[0282] 15 Lighting control unit

[0283] 21 Mode switching unit

[0284] 22. Range image generation unit

[0285] 41 Pixel array unit

[0286] 42 vertical drive unit

[0287] 43 Column Processing Unit

[0288] 44 Horizontal drive unit

[0289] 45 System Control Unit

[0290] 46 pixel drive lines

[0291] 47 vertical signal line

[0292] 48 Signal Processing Unit

[0293] 50 pixels

[0294] 51 taps

[0295] 61 Photodiode

[0296] 62 Pass transistor

[0297] 63 FD Department

[0298] 64 Select transistor

[0299] 65 Reset transistor

[0300] 81 Object

Claims

1. A distance measuring device, include: a light emitting portion that emits irradiation light; a light receiving portion that receives reflected light generated by reflection of the irradiated light on the target object; a calculation section that calculates a distance to the target object based on a time from emission of the irradiation light to reception of the reflected light; and a light emitting control unit, which controls the light emitting unit, wherein the light emission control section controls the light emission of the light emitting section by switching between a first light emission mode and a second light emission mode different from the first light emission mode within a predetermined frame, The predetermined frame has a first subframe and a second subframe, and the light emission control section applies the first light emission mode in the first subframe and applies the second light emission mode in the second subframe.

2. The distance measuring device according to claim 1, wherein The light emission control section randomly switches between the first light emission mode and the second light emission mode.

3. The distance measuring device according to claim 1 or 2, wherein The light emitting portion emits pulse light, and The first light emission mode and the second light emission mode are different in phase of the pulse light.

4. The distance measuring device according to claim 3, wherein The phase is set discretely or continuously.

5. The distance measuring device according to claim 3, wherein The phase is any one of 0 degrees, 90 degrees, 180 degrees, and 270 degrees.

6. The distance measuring device according to claim 1 or 2, wherein The light emitting portion emits pulse light, and The first light emission pattern and the second light emission pattern differ in the timing of starting emission of the pulse light.

7. The distance measuring device according to claim 1, wherein The first subframe and the second subframe have different period lengths.

8. The distance measuring device according to claim 1, wherein The light emission control section switches the first light emission mode and the second light emission mode based on the stored information on the order of the light emission modes.

9. The distance measuring device according to claim 1 or 2, wherein In the predetermined frame, the distance measuring device distributes the charge generated by the light receiving section receiving the reflected light to a first tap and a second tap, and detects a first detection signal according to the charge accumulated in the first tap and a second detection signal according to the charge accumulated in the second tap; In a frame following the predetermined frame, the distance measuring device distributes the charge generated by the light receiving section receiving the reflected light to a first tap and a second tap, and detects a third detection signal based on the charge accumulated in the first tap and a fourth detection signal based on the charge accumulated in the second tap; and The calculation section calculates a distance to the target object using the first to fourth detection signals.

10. The distance measuring device according to claim 1 or 2, wherein In the predetermined frame, the distance measuring device distributes the charge generated by receiving the reflected light by the light receiving section to the first to fourth taps, and detects a first detection signal according to the charge accumulated in the first tap, a second detection signal according to the charge accumulated in the second tap, a third detection signal according to the charge accumulated in the third tap, and a fourth detection signal according to the charge accumulated in the fourth tap, and The calculation section calculates a distance to the target object using the first to fourth detection signals.

11. The distance measuring device according to claim 1 or 2, wherein The distance measuring device is an indirect time-of-flight sensor.

12. The distance measuring device according to claim 1 or 2, wherein The distance measuring device is a direct time-of-flight sensor.

13. The distance measuring device according to claim 1 or 2, The light emission control section controls the light emission of the light emitting section by switching a first light emission mode, a second light emission mode, a third light emission mode different from the first and second light emission modes, and a fourth light emission mode different from the first to third light emission modes within the predetermined frame.

14. The distance measuring device according to claim 13, wherein The second light-emitting mode is 90 degrees out of phase with the first light-emitting mode. The third light emitting mode is 180 degrees out of phase with the first light emitting mode, and The fourth light emitting mode is 270 degrees out of phase with the first light emitting mode.

15. A distance measurement method, comprising the following steps implemented by a distance measurement device performing a distance measurement process: emit irradiating light; receiving reflected light generated by reflection of the illumination light on a target object; calculating a distance to the target object based on a time from emission of the illumination light to reception of the reflected light; and controlling the emission of the irradiation light, wherein in the control of the emission of the illumination light, a first light emission mode and a second light emission mode different from the first light emission mode are switched within a predetermined frame to control the light emission, The predetermined frame has a first subframe and a second subframe, and the light emission control section applies the first light emission mode in the first subframe and applies the second light emission mode in the second subframe.

16. A program product for causing a computer of a distance measuring device to perform a distance measurement process to implement a process, include: emit irradiating light; receiving reflected light generated by reflection of the illumination light on a target object; calculating a distance to the target object based on a time from emission of the illumination light to reception of the reflected light; and controlling the emission of the irradiation light, The processing includes switching a first light emission mode and a second light emission mode different from the first light emission mode within a predetermined frame to control light emission during control of emission of the illumination light, The predetermined frame has a first subframe and a second subframe, and the light emission control section applies the first light emission mode in the first subframe and applies the second light emission mode in the second subframe.

Citation Information

Patent Citations

  • Distance image generation apparatus and distance image generation method

    JP2013076645A

  • In-vehicle time-of-flight optical ranging device

    JP2016090268A

  • Distance sensor

    JP2017191042A

  • Distance measurement and imaging system

    CN105723239A

  • Distance measuring device

    CN106461763A