Light detection device

By using multiple light-emitting elements and optical waveguides in the optical detection device, combined with time difference calculation and correction components, the problem of timing deviation between multiple light-emitting elements and optical receiving elements is solved, improving the accuracy and consistency of distance measurement and reducing component costs.

CN118974595AInactive Publication Date: 2024-11-15SONY SEMICON SOLUTIONS CORP
View PDF 0 Cites 2 Cited by

Patent Information

Application Number
CN202380029697.2
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Priority Date
2022-04-01
Filing Date
2023-03-27
Publication Date
2024-11-15
Estimated Expiration
Not applicable · inactive patent

AI Technical Summary

Technical Problem

In the prior art, manufacturing deviations and temperature variations in multiple light-emitting and light-receiving elements lead to deviations in light emission timing and light reception timing, increasing component costs and reducing the accuracy of distance measurement.

Method used

Multiple light-emitting elements and optical waveguides are used. The timing deviation between the light-emitting elements and the optical receiving elements is corrected through a time difference calculation and correction component. The reflected light pulse signal is received by multiple optical receiving elements, the time difference is calculated and correction information is generated to correct the light emission timing.

Benefits of technology

It improves the accuracy and consistency of distance measurement, reduces component costs, and minimizes the impact of manufacturing deviations and temperature variations.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118974595A_ABST
    Figure CN118974595A_ABST
Patent Text Reader

Abstract

The present invention corrects the deviation between a light-emitting element and a light-receiving element with high accuracy. The light detection device includes: a plurality of light-emitting elements that emit a first light pulse signal; a plurality of optical waveguides that transmit first optical pulse signals emitted by the plurality of light-emitting elements, respectively; a plurality of first light receiving elements that receive the first optical pulse signal transmitted through the plurality of optical waveguides; the plurality of second light receiving elements are used for receiving reflected light pulse signals after the first light pulse signals respectively emitted by the plurality of light emitting elements are reflected by the object; a first time difference calculation unit that calculates a time difference between light emission timings of the plurality of light-emitting elements on the basis of light reception timings of the first light pulse signals in the plurality of first light-receiving elements; and a first correction unit that generates first correction information for correcting the time difference of the light emission timings of the plurality of light-emitting elements on the basis of the time difference calculated by the first time difference calculation unit.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present disclosure relates to a light detection device. Background Art

[0002] There are known ToF sensors that measure the distance to an object by irradiating an optical pulse signal to the object and receiving a reflected light signal reflected by the object, and photon counters that count the number of photons included in the reflected light signal.

[0003] When a light emitting module in which a plurality of light emitting elements are arranged is used as a light emitting source, distance measurement and photon counting can be performed by causing some of the plurality of light emitting elements to emit light while being sequentially shifted.

[0004] In order to send a light pulse signal from a light emitting element to an object and use a light receiving element to receive a reflected light pulse signal from the object to measure the distance to the object, it is necessary to accurately detect the light emission timing of the light emitting element. Therefore, the following technology is disclosed: a reflective component is provided near the light emitting element, and a light receiving element is newly provided to receive the light pulse signal reflected by the reflective component, and the light emission timing is detected by the light receiving element (see Patent Document 1).

[0005] (See Patent Document 1).

[0006] Prior art literature

[0007] Patent Literature

[0008] Patent Document 1: U.S. Patent Publication No. US2016 / 0033644A1 Summary of the invention

[0009] Technical problem to be solved by the invention

[0010] However, when a plurality of light receiving elements are provided to receive reflected light pulse signals from an object, a plurality of light receiving elements are also required for detecting emission timing, which increases component costs.

[0011] In addition, when multiple light emitting elements are provided, the time from when the multiple light emitting elements are instructed to emit light to when the light emitting elements start to emit light may vary due to manufacturing variations and environmental conditions such as temperature. Similarly, when multiple light receiving elements are provided, the time from when the reflected light signal is incident on each light receiving element to when the received light signal is output may vary due to manufacturing variations and environmental conditions such as temperature.

[0012] Therefore, in the present disclosure, a light detecting device capable of correcting the deviation between a light emitting element and a light receiving element with high accuracy is provided.

[0013] Technical solutions for solving technical problems

[0014] In order to solve the above technical problems, according to the present disclosure, a light detection device is provided, comprising:

[0015] A plurality of light emitting elements emit a first light pulse signal;

[0016] A plurality of optical waveguides for transmitting the first optical pulse signals respectively emitted by the plurality of light emitting elements;

[0017] a plurality of first light receiving elements, receiving the first light pulse signals transmitted in the plurality of optical waveguides;

[0018] A plurality of second light receiving elements, receiving reflected light pulse signals after the first light pulse signals respectively emitted by the plurality of light emitting elements are reflected by an object;

[0019] a first time difference calculation unit that calculates a time difference in light emission timing of the plurality of light emitting elements based on a light reception timing of the first light pulse signal in the plurality of first light receiving elements; and

[0020] The first correction unit generates first correction information for correcting the time difference of the light emission timings of the plurality of light emitting elements based on the time difference calculated by the first time difference calculation unit.

[0021] Alternatively, the plurality of light emitting elements may be arranged in plurality in the first direction and in plurality in the second direction.

[0022] The plurality of light emitting elements arranged in the second direction allow the first optical pulse signal to be incident on the respective different optical waveguides,

[0023] The plurality of light emitting elements arranged in the first direction respectively cause the first light pulse signal to be incident on the corresponding optical waveguide at a staggered time.

[0024] Alternatively, two or more intermittently arranged light emitting elements among the plurality of light emitting elements arranged in the second direction may emit the first light pulse signal at the same time.

[0025] The plurality of light emitting elements arranged in the first direction sequentially cause the first optical pulse signal to be incident on the corresponding optical waveguide in the order in which they are arranged in the first direction.

[0026] Alternatively, the first time difference calculation unit calculates the time difference based on a result of the first light pulse signal being repeatedly received by the plurality of first light receiving elements.

[0027] The first correction unit generates the first correction information based on a plurality of calculation results of the time difference.

[0028] The first correction information generated by the first correction unit may include absolute time information based on timing of light emission instructions to the plurality of light emitting elements.

[0029] The first correction unit may generate the first correction information based on an average value of light reception timings of the first light pulse signal received multiple times by the plurality of first light receiving elements and a time difference in light reception timings of the first light pulse signal between the plurality of first light receiving elements.

[0030] Alternatively, the first time difference calculation unit calculates the time difference for each of the plurality of light emitting elements.

[0031] The first correction section generates the first correction information for each of the plurality of light emitting elements.

[0032] Alternatively, the light detection device includes a signal monitoring unit that monitors at least one of a maximum signal intensity, a pulse width, a rising edge timing, a falling edge timing, and a conversion rate of a plurality of the first light pulse signals received by the plurality of first light receiving elements.

[0033] The first correction unit generates the first correction information based on a monitoring result in the signal monitoring unit.

[0034] The photodetection device may include a light emission control unit configured to individually control at least one of light emission timing and light emission pulse waveform of the plurality of light emitting elements based on the first correction information.

[0035] It may also be that the light detection device includes a light emission control unit, which controls at least one of the maximum signal intensity, pulse width, rising edge timing, falling edge timing and conversion rate of the first light pulse signal for each of the multiple light emitting elements based on the first correction information.

[0036] The light detection device may include a distance measuring unit that measures the distance to the object based on the light emission timings of the plurality of light emitting elements corrected according to the first correction information and the light reception timings of the reflected light pulse signals in the plurality of second light receiving elements.

[0037] The photodetection device may include a photon counting unit configured to count received photons based on the first light pulse signals emitted by the plurality of light emitting elements corrected based on the first correction information.

[0038] Alternatively, the light detection device may include a light source that emits a second light pulse signal.

[0039] The plurality of first light receiving elements and the plurality of second light receiving elements are arranged at positions capable of receiving the second optical pulse signal.

[0040] Alternatively, before the plurality of light emitting elements and the plurality of second light receiving elements measure the distance to the object, the light source may intermittently emit the second light pulse signal a plurality of times.

[0041] Alternatively, the light detection device may include:

[0042] a second time difference calculation unit that calculates a time difference in timings at which the plurality of first light receiving elements and the plurality of second light receiving elements respectively receive the second light pulse signal; and

[0043] The second correction section generates second correction information for performing time difference correction of light reception timings of the plurality of second light receiving elements based on the time difference calculated by the second time difference calculation section.

[0044] Alternatively, the second time difference calculation unit calculates the time difference based on a result of repeatedly performing a plurality of light receptions of the second light pulse signal in the plurality of first light receiving elements and the plurality of second light receiving elements.

[0045] The second correction unit generates the second correction information based on the plurality of time differences.

[0046] The second correction unit may generate the second correction information for correcting relative light receiving timings among the plurality of second light receiving elements.

[0047] Alternatively, the light detection device may include a distance measuring unit, which measures the distance to the object based on the light emission timing of the plurality of light emitting elements corrected according to the first correction information and the light reception timing of the reflected light pulse signals in the plurality of second light receiving elements corrected according to the second correction information.

[0048] The light detection device may include a plurality of optical switches, and the plurality of optical switches may switch whether or not the first optical pulse signals emitted by the plurality of light emitting elements are incident on the corresponding optical waveguides.

[0049] Two or more optical switches connected to the same optical waveguide are turned on in sequence, so that the first optical pulse signal emitted by the corresponding light emitting element is incident on the optical waveguide,

[0050] The first correction unit generates the first correction information after the plurality of first light pulse signals emitted by all of the plurality of light emitting elements are received by the plurality of first light receiving elements. BRIEF DESCRIPTION OF THE DRAWINGS

[0051] Figure 1 This is a block diagram showing a schematic configuration of a distance measuring system including a photodetection device according to the first embodiment.

[0052] Figure 2 It is a schematic plan view of the light detection device and the light emitting unit according to the first embodiment.

[0053] Figure 3A This is a diagram showing an ideal pulse waveform of a light pulse signal emitted by each light emitting element.

[0054] Figure 3B This is a diagram showing an example of a pulse waveform showing a variation in the light peak intensity of an optical pulse signal.

[0055] Figure 3C This is a diagram showing an example of a pulse waveform in which the pulse width of an optical pulse signal varies.

[0056] Figure 3D This is a diagram showing an example of a pulse waveform in which the timing of the rising edge or the falling edge of the optical pulse signal varies.

[0057] Figure 3E This is a diagram showing an example of a pulse waveform in which the slew rate of an optical pulse signal varies.

[0058] Figure 4 It is a cross-sectional view showing the structure of the periphery of the light emitting section and the light receiving section.

[0059] Figure 5 It is a schematic top view of a light emitting unit and a light receiving unit.

[0060] Figure 6 : is a flowchart showing a first example of distance measurement processing.

[0061] Figure 7 Yes Description Figure 6 FIG. 5 is a diagram of the processing of steps S15 and S16.

[0062] Figure 8 It is a diagram schematically showing a state where a light source emits light.

[0063] Fig. 9 This is a flowchart showing a process procedure for calculating the time difference in light receiving timing of a plurality of light receiving elements.

[0064] Fig.10 This is a flowchart showing a process procedure for performing ranging in consideration of the Rx in-plane time difference and the Tx in-plane time difference.

[0065] Fig.11 Yes Description Fig.10 FIG. 5 is a diagram of the processing of steps S15a and S16a.

[0066] Fig.12 This is a block diagram showing a schematic configuration of a distance measuring system including a photodetection device according to a second embodiment.

[0067] Fig.13 It is a schematic plan view of a light detection device and a light emitting unit according to the second embodiment.

[0068] Fig.14A This is a diagram showing an ideal pulse waveform of a light pulse signal emitted by each light emitting element.

[0069] Fig. 14B It is a diagram showing a pulse waveform showing a change in the light peak intensity of an optical pulse signal.

[0070] Fig. 14C This is a diagram showing a pulse waveform of a pulse width variation of an optical pulse signal.

[0071] Fig.14D This is a diagram showing a pulse waveform showing a change in the timing of a rising edge or a falling edge of an optical pulse signal.

[0072] Fig.15 This is a block diagram showing a schematic configuration of a distance measuring system including a photodetection device according to a third embodiment.

[0073] Fig.16 It is a schematic plan view of a light detection device and a light emitting unit according to the third embodiment.

[0074] Fig.17A This is a diagram showing an ideal pulse waveform of a light pulse signal emitted by each light emitting element.

[0075] Fig. 17B It is a diagram showing a pulse waveform showing a change in the light peak intensity of an optical pulse signal.

[0076] Fig.18 It is a flowchart showing the processing operation of the third embodiment.

[0077] Fig.19 FIG. 1 is a diagram schematically showing an optical switch disposed between each light emitting element and the corresponding optical waveguide.

[0078] Fig. 20 This is a block diagram showing a schematic configuration of a distance measuring system including a photodetection device according to a fourth embodiment.

[0079] Fig.21 It is a schematic plan view of a light detection device and a light emitting unit according to a fourth embodiment.

[0080] Fig. 22 This is a flowchart showing the processing operation of the photodetection device according to the fourth embodiment.

[0081] Fig.23 This is a block diagram showing an example of a schematic configuration of a vehicle control system.

[0082] Fig.24 It is an explanatory diagram showing an example of the installation positions of the vehicle exterior information detection unit and the imaging unit. DETAILED DESCRIPTION

[0083] Hereinafter, an embodiment of the light detection device will be described with reference to the accompanying drawings. Hereinafter, the description will be centered on the main components of the light detection device, but there may be components and functions in the light detection device that are not shown or described. The following description does not exclude components and functions that are not shown or described.

[0084] (First Embodiment)

[0085] Figure 1 1 is a block diagram showing a schematic configuration of a distance measuring system 2 including the photodetection device 1 according to the first embodiment. Figure 1 The distance measuring system 2 includes a light detection device 1, a light emitting unit 3 and an overall control unit 4. Figure 1 The distance measurement system 2 performs distance measurement processing by the dToF (direct Time of Flight) method. The light detection device 1 has a light receiving unit 25. In this specification and the drawings, the light emitting unit 3 is sometimes referred to as Tx, and the light receiving unit 25 is sometimes referred to as Rx.

[0086] The light emitting unit 3 includes a plurality of light emitting elements 5 , a light emitting source 6 , a driving circuit 7 , a clock generating unit 8 , and a light emitting control unit 9 .

[0087] The plurality of light emitting elements 5 are arranged in a plurality in the first direction X and the second direction Y intersecting each other. The plurality of light emitting elements 5 repeatedly emit light pulse signals (Tx pulse signals) at a predetermined time interval. The light emitting unit 3 can scan the light signals emitted by the plurality of light emitting elements 5 in a predetermined two-dimensional space. The specific method of scanning the light signal is not limited.

[0088] The light emitting element 5 is, for example, a VCSEL (Vertical Cavity Surface Emitting Laser). Hereinafter, an example of a VCSEL array in which a plurality of light emitting elements 5 are arranged on the same substrate is mainly described. Hereinafter, the first direction (horizontal direction) X in which the plurality of light emitting elements 5 are arranged is sometimes referred to as a column, and the second direction (vertical direction) Y is referred to as a row. A plurality of light emitting elements 5 arranged in a row in the first direction X is referred to as a light emitting element row or a light emitting element group. An optical waveguide 19 extending along the first direction X is connected to each light emitting element row. A plurality of optical waveguides 19 are arranged relative to the plurality of light emitting element rows arranged in the second direction Y. Two or more light emitting elements 5 in each light emitting element row can sequentially cause optical pulse signals to be incident on the optical waveguide 19. In this way, the two or more optical pulse signals from the two or more light emitting elements 5 are not incident on the optical waveguide 19 at the same time, and the optical pulse signals from each light emitting element 5 are transmitted sequentially through the corresponding optical waveguide 19.

[0089] The plurality of light-emitting pixel columns arranged in the second direction Y can cause the optical pulse signals to be incident on the plurality of optical waveguides 19 at the same time. Therefore, the plurality of optical waveguides 19 transmit the optical pulse signals from the different light-emitting elements 5 at the same timing.

[0090] The light source 6 is provided separately from the plurality of light emitting elements 5 and is used to correct the time difference of the light receiving timing of the light receiving element 30 described later. Typically, the light source 6 emits a light pulse signal before the plurality of light emitting elements 5 are caused to emit light and start the distance measurement process. The light emitting area of ​​the light source 6 includes the entire area of ​​the light receiving area of ​​the light receiving unit 25. Therefore, all the light receiving elements 30 in the light receiving unit 25 can receive the light pulse signal from the light source 6.

[0091] The light source 6 is not an essential component. If there is no need to correct the time difference of the light receiving timing of the light receiving element 30, the light source 6 may be omitted.

[0092] The driving circuit 7 drives the plurality of light emitting elements 5 and the light source 6 based on the control signal from the light emitting control unit 9. For example, the driving circuit 7 controls at least one of the light emitting timing and the light emitting waveform of the light pulse signal based on the control signal from the light emitting control unit 9. More specifically, the driving circuit 7 controls the voltage level of the voltage applied to the anode or cathode of the plurality of light emitting elements 5 based on the control signal from the light emitting control unit 9, and controls at least one of the signal intensity, light peak intensity, pulse width, rising edge timing, falling edge timing, and conversion rate of the light pulse signal from the plurality of light emitting elements 5.

[0093] The clock generation unit 8 generates a clock signal synchronized with a reference clock signal. The reference clock signal is, for example, a signal input from outside the distance measurement system 2. Alternatively, the reference clock signal may be generated inside the distance measurement system 2.

[0094] The light emission control unit 9 generates a control signal for controlling at least one of the light emission timing and the light emission waveform of each light emitting element 5 in synchronization with the clock signal. The drive circuit 7 drives the plurality of light emitting elements 5 and the light source 6 based on the control signal outputted from the light emission control unit 9.

[0095] The overall control unit 4 controls the light emitting unit 3 and the light detecting device 1. At least one of the light emitting unit 3 and the overall control unit 4 may be integrated in the light detecting device 1.

[0096] The light detection device 1 includes a pixel array section 11, a distance measurement processing section 12, a control section 13, a clock generation section 14, a light emission timing control section 15, and a drive circuit 16. The pixel array section 11 constitutes a light receiving section 25.

[0097] The pixel array unit 11 includes a reference pixel array unit 11a and a distance measurement pixel array unit 11b. The reference pixel array unit 11a includes a plurality of reference pixels (first light receiving elements) 18 arranged at least in the second direction Y. The plurality of reference pixels 18 correspond to the plurality of optical waveguides 19. More specifically, the plurality of reference pixels 18 arranged in the second direction Y respectively receive the optical pulse signals transmitted in the corresponding optical waveguides 19.

[0098] As described later, multiple reference pixels 18 receive light pulse signals emitted by multiple light-emitting elements 5 arranged in the second direction Y through multiple optical waveguides 19. Thus, multiple reference pixels 18 can directly receive light pulse signals from multiple light-emitting elements 5. Therefore, multiple reference pixels 18 can detect the light emission timing of multiple light-emitting elements 5 with high precision. Multiple reference pixels 18 react to the arrival of photons and output voltage signals. When the SPAD (Single Photon Avalanche photo Diode) described later is used as the reference pixel 18, it is not possible to detect the incident photons with a 100% response rate, but rather with a certain statistical response rate. In this specification, the reaction of SPAD to incident light is referred to as light reception. Based on the light pulse signal from the light source 6, multiple reference pixels 18 react to the arrival of photons and output voltage signals.

[0099] The ranging pixel array unit 11b has a plurality of ranging pixels (second light receiving elements) 20 each arranged in a first direction X and a second direction Y. The plurality of ranging pixels 20 receive reflected light signals from the object 10. The plurality of ranging pixels 20 can detect the light intensity of the reflected light signals by averaging the results of repeatedly receiving the reflected light signals. In addition, based on the light pulse signal from the light source 6, the plurality of ranging pixels 20 react to the arrival of photons and output voltage signals. Hereinafter, an example in which the plurality of reference pixels 18 and the plurality of ranging pixels 20 react to the arrival of photons and output voltage signals is described.

[0100] The plurality of reference pixels 18 and the plurality of ranging pixels 20 each have a light receiving element 30. The light receiving element 30 is, for example, a SPAD 30. Each reference pixel 18 and each ranging pixel 20 may also have a quenching circuit not shown. In the initial state, the quenching circuit supplies a reverse bias voltage whose potential difference exceeds the breakdown voltage between the anode and the cathode of the SPAD 30. After the SPAD 30 detects a photon, the driving circuit 16 supplies a reverse bias voltage to the SPAD 30 via the corresponding quenching circuit to prepare for the detection of the next reflected light pulse signal (Rx pulse signal).

[0101] The distance measurement processing unit 12 includes a time-to-digital converter (TDC) 21 , a histogram generating unit 22 , a signal processing unit 23 , and a distance measurement control unit 29 .

[0102] TDC21 generates a time digital signal corresponding to the light reception time of the reflected light pulse signal received by SPAD30 with a specified time resolution. The histogram generating unit 22 generates a histogram having a bin width corresponding to the time resolution of TDC21 based on the time digital signal generated by TDC21. The bin width refers to the width of each frequency unit constituting the histogram. The higher the time resolution of TDC21, the narrower the bin width can be, and a histogram reflecting the time frequency of the received Rx pulse signal can be obtained with higher accuracy. As described above, when SPAD30 is used as a reference pixel 18, SPAD30 reacts to the arrival of photons and outputs a voltage signal. The higher the light intensity, the higher the reaction rate of SPAD30 to photons. Therefore, when a histogram is generated based on the result of repeated reception of light pulse signals by each ranging pixel 20, the light emission timing of the corresponding light emitting element 5 can be detected according to the peak position of the histogram, and the light intensity of the light pulse signal emitted from the corresponding light emitting element 5 can be detected according to the peak height of the histogram.

[0103] The signal processing unit 23 includes a distance measuring unit 23a. The distance measuring unit 23a calculates the distance to the object 10 by calculating the centroid position of the Rx pulse signal based on the histogram, and outputs the calculated distance via the output buffer 28. As described later, the signal processing unit 23 calculates the time difference of the light emission timing of the plurality of light emitting elements 5, and generates a correction signal for correcting the time difference of the light emission timing of the plurality of light emitting elements 5 based on the time difference.

[0104] The signal processing unit 23 may also include a first time difference calculation unit 23b and a first correction unit 23c. The first time difference calculation unit 23b calculates the time difference of the light emission timing of the plurality of light emitting elements 5 based on the light reception timing of the light pulse signal in the plurality of reference pixels 18. The first correction unit 23c generates first correction information for correcting the time difference of the light emission timing of the plurality of light emitting elements 5 based on the time difference calculated by the first time difference calculation unit 23b.

[0105] The first time difference calculation unit 23b may calculate the time difference based on the result of repeatedly performing the light reception of the first light pulse signal in the plurality of reference pixels 18. In this case, the first correction unit 23c generates the first correction information based on the calculation results of the plurality of time differences. The first correction information generated by the first correction unit 23c includes absolute time information based on the timing of the light emission instruction to the plurality of light emitting elements 5.

[0106] Alternatively, the first correction unit 23c generates the first correction information based on an average value of light reception timings of the first light pulse signal received multiple times by the plurality of reference pixels 18 and the time difference in light reception timings of the first light pulse signal between the plurality of reference pixels 18. Alternatively, the first time difference calculation unit 23b calculates the time difference for each of the plurality of light emitting elements 5, and the first correction unit 23c generates the first correction information for each of the plurality of light emitting elements 5.

[0107] The signal processing unit 23 may also include a signal monitoring unit 23d. The signal monitoring unit 23d monitors at least one of the maximum signal intensity, pulse width, rising edge timing, falling edge timing, and conversion rate of the plurality of first light pulse signals received by the plurality of reference pixels 18. In this case, the first correction unit 23c generates the first correction information based on the monitoring result in the signal monitoring unit 23d.

[0108] The signal processing unit 23 may also include a second time difference calculation unit 23e and a second correction unit 23f. The second time difference calculation unit 23e calculates the time difference of the timings at which the plurality of reference pixels 18 and the plurality of ranging pixels 20 receive the second light pulse signal, respectively. The second correction unit 23f generates second correction information for correcting the time difference of the light reception timing of the plurality of ranging pixels 20 based on the time difference calculated by the second time difference calculation unit 23e.

[0109] The second time difference calculation unit 23e calculates the time difference based on the result of repeatedly performing the light reception of the second light pulse signal in the plurality of reference pixels 18 and the plurality of ranging pixels 20. The second correction unit 23f generates the second correction information based on the plurality of time differences. The second correction unit 23f may also generate the second correction information for correcting the relative light reception timing between the plurality of ranging pixels 20.

[0110] Alternatively, the distance measuring unit 23a measures the distance to the object 10 based on the light emission timing of the plurality of light emitting elements 5 corrected according to the first correction information and the light reception timing of the reflected light pulse signals in the plurality of second light receiving elements 30. Alternatively, the distance measuring unit 23a measures the distance to the object 10 based on the light emission timing of the plurality of light emitting elements 5 corrected according to the first correction information and the light reception timing of the reflected light pulse signals in the plurality of second light receiving elements 30 corrected according to the second correction information.

[0111] The control section 13 controls the processing actions of each part in the light detection device 1. The distance measurement control section 29 controls the TDC 21, the histogram generation section 22, and the signal processing section 23 in the distance measurement processing section 12. The light emission timing control section 15 controls the light emission control section 9 in the light emission section 3, and controls the drive circuit 16. When the plurality of reference pixels 18 and the plurality of distance measurement pixels 20 in the pixel array section 11 detect light and the cathode voltage decreases, the drive circuit 16 performs quenching control to restore the cathode voltage to the original voltage, etc.

[0112] The clock generating unit 14 generates a clock signal used by the TDC 21 and the histogram generating unit 22. The clock generating unit 14 generates the clock signal using, for example, a PLL circuit (not shown).

[0113] Figure 2 It is a schematic plan view of the light detection device 1 and the light emitting unit 3 according to the first embodiment. Figure 2 The light emitting section 3 includes a VCSEL array 24 in which a plurality of light emitting elements 5 (VCSELs) are arranged.

[0114] Figure 2 The VCSEL array 24 has 16 light emitting elements 5 in the first direction X (horizontal direction) and 8 light emitting elements 5 in the second direction Y (vertical direction), but this is an example, and the number of light emitting elements 5 arranged in the first direction X and the second direction Y is arbitrary.

[0115] The VCSEL array 24 is provided with eight optical waveguides 19 extending in the first direction X, and 16 light emitting elements 5 are arranged in a staggered manner along each optical waveguide 19. The 16 light emitting elements 5 can inject optical pulse signals into the corresponding optical waveguides 19. In addition, it is prohibited for a plurality of light emitting elements 5 to simultaneously inject optical pulse signals into the optical waveguides 19. Therefore, the 16 light emitting elements 5 inject optical pulse signals into the optical waveguides 19 in sequence.

[0116] Among the eight light emitting elements 5 arranged in the second direction Y (vertical direction), every other four light emitting elements 5 simultaneously emit optical pulse signals. Figure 2 In the figure, the numbers 0 to 15 represent the light emission timings of the plurality of light emitting elements 5. The eight light emitting elements 5 indicated as 0 emit light at the same timing, and the eight light emitting elements 5 indicated as the same number in ascending order emit light at the same timing.

[0117] so, Figure 2 The example in which 16×8=108 light emitting elements 5 are divided into 16 timings and eight light emitting elements 5 emit light in sequence is shown. The optical pulse signals of the eight light emitting elements 5 that emit light simultaneously are transmitted in different optical waveguides 19, respectively.

[0118] The pixel array section 11 in the light receiving section 25 has a plurality of reference pixels 18 and a plurality of ranging pixels 20. Each reference pixel 18 and each ranging pixel 20 have the same structure and a light receiving element 30 having the same structure and electrical characteristics. In addition, as described below, due to variations in the manufacturing process, etc., the electrical characteristics of each reference pixel 18 and the light receiving element 30 constituting each ranging pixel 20 may vary.

[0119] The optical waveguide 19 on the VCSEL array 24 is arranged near the reference pixel 18 in the light receiving unit 25. The optical pulse signal transmitted by each optical waveguide 19 is incident on the corresponding reference pixel 18. Thus, each reference pixel 18 can detect the light emission timing of the corresponding light emitting element 5 in substantially real time. In addition, since it can be considered that there is almost no light loss in the optical waveguide 19, each reference pixel 18 can receive the optical pulse signal having the same light emission intensity as the light emission intensity of the corresponding light emitting element 5.

[0120] The plurality of ranging pixels 20 are arranged in the second direction Y (vertical direction) with, for example, the same number of pixels as the number of reference pixels 18. The number of pixels of the ranging pixels 20 in the first direction X (horizontal direction) is arbitrary. Each reference pixel 18 and each ranging pixel 20 reacts to the arrival of photons and outputs a voltage signal. The reference pixels 18 and each ranging pixel 20 arranged in the first direction X input voltage signals to the corresponding TDC 21, respectively. Each TDC 21 converts the voltage signal of the reference pixel 18 or each ranging pixel 20 into a time digital signal. Although in Figure 2 Omitted, but Figure 1 The histogram generating unit 22 generates a histogram based on the time digital signals output from each TDC 21, and the signal processing unit 23 calculates the distance to the object 10 based on the histogram. In this specification, an example is described in which the number of reference pixels 18 and the number of distance measuring pixels 20 arranged in the second direction Y are the same number, but they do not necessarily need to be the same number.

[0121] Figure 2 Each reference pixel 18 and each distance measuring pixel 20 includes a pixel portion and an analog front end portion (hereinafter referred to as an AFE portion), and a voltage signal corresponding to the optical pulse signal or the reflected optical pulse signal is output from the AFE portion.

[0122] Figure 2 The light control unit 9 in the light emitting unit 3 has a light peak intensity adjustment register 9a, a rising edge timing adjustment register 9b, a falling edge timing adjustment register 9c, and a conversion rate adjustment register 9d. These registers do not necessarily need to be set in full. These registers store information for adjusting the light emission timing and light emission waveform for each of the multiple light emitting elements 5. The drive circuit 7 adjusts the light emission timing and light emission waveform for each light emitting element 5 individually based on the information in these registers. Alternatively, the drive circuit 7 can also uniformly adjust the light emission timing and light emission waveform of all light emitting elements 5 based on the information in these registers.

[0123] Figure 3A 1 is a diagram showing an ideal pulse waveform of the optical pulse signal emitted by each light emitting element 5. Due to the variation in the manufacturing process of the light emitting element 5, and changes in environmental conditions such as temperature and voltage, the pulse waveform of the optical pulse signal may not necessarily be as shown in FIG. Figure 3A As shown, sometimes different pulse waveforms are formed.

[0124] Figure 3B This is a diagram showing an example of a pulse waveform showing a variation in the light peak intensity of an optical pulse signal. Figure 3C This is a diagram showing an example of a pulse waveform in which the pulse width of an optical pulse signal varies. Figure 3D This is a diagram showing an example of a pulse waveform in which the timing of the rising edge or the falling edge of the optical pulse signal varies. Figure 3E This is a diagram showing an example of a pulse waveform in which the slew rate of an optical pulse signal varies.

[0125] The light peak intensity adjustment register 9a stores information for adjusting the maximum light intensity of the optical pulse signal. The rising edge timing adjustment register 9b stores information for adjusting the rising edge timing of the optical pulse signal. The falling edge timing adjustment register 9c stores information for adjusting the falling edge timing of the optical pulse signal. The conversion rate adjustment register 9d stores information for adjusting the conversion rate of the optical pulse signal.

[0126] The signal processing unit 23 stores adjustment information in the light peak intensity adjustment register 9 a , the rising edge timing adjustment register 9 b , the falling edge timing adjustment register 9 c , and the slew rate adjustment register 9 d based on the light reception result in the reference pixel 18 .

[0127] Figure 4 2 is a cross-sectional view showing the structure of the periphery of the light emitting unit 3 and the light receiving unit 25. Figure 4 In the example of , a substrate 52 on which the light emitting unit 3 is arranged and a substrate 35 on which the light receiving unit 25 is arranged are provided separately. It should be noted that the light emitting unit 3 and the light receiving unit 25 may also be arranged on the same substrate.

[0128] Figure 4 The substrate 35 on which the light receiving unit 25 is arranged has a laminated structure, in which the first chip 3a and the second chip 3b are bonded by Cu-Cu bonding 26. The bonding method between the first chip 3a and the second chip 3b is not necessarily limited to the Cu-Cu bonding 26, and may be bonded by bumps or the like.

[0129] like Figure 2 As shown in FIG. 1 , in the first chip 3 a , a reference pixel 18 is arranged on a side close to the light emitting unit 3 , and a distance measuring pixel 20 is arranged on a side far from the light emitting unit 3 . Figure 4 In the depth direction of the paper, there are Figure 1 A plurality of reference pixels 18 and a plurality of ranging pixels 20 in the second direction Y.

[0130] exist Figure 4 In the embodiment, the virtual pixel (DMY pixel) 31 is arranged between the reference pixel 18 and the light emitting unit 3, and the virtual pixel 31 is also arranged between the reference pixel 18 and the distance measuring pixel 20. These virtual pixels 31 are not used to receive the light signal and the reflected light signal from the light emitting element 5, but are provided for the alignment of the reference pixel 18 and the distance measuring pixel 20, etc., and the structure and size of the virtual pixel 31 are arbitrary.

[0131] Each of the dummy pixel 31, the reference pixel 18, and the distance-measuring pixel 20 on the first chip 3a has, for example, a photodiode in which a p-type Si (silicon) layer is arranged on an n-type Si (silicon) layer. A Si (silicon) layer 32, a SiN (silicon nitride) layer 33, and a Si (silicon) layer 34 are stacked on the lower surface side of the dummy pixel 31, the reference pixel 18, and the distance-measuring pixel 20.

[0132] The second chip 3b is provided with a circuit for generating voltages applied to the anode electrode and cathode electrode of the reference pixel 18 and the ranging pixel 20, a circuit for reading the voltage signal of the cathode electrode, etc. The second chip 3b has, for example, a structure in which a SiN (silicon nitride) layer 36 and a SiO2 layer 37 are stacked on a Si (silicon) layer 35.

[0133] The light emitting unit 3 is a stacked structure formed by bonding a VCSEL substrate 38 on which a VCSEL array 24 is arranged and an LDD (Laser Diode Driver) substrate 39. The VCSEL substrate 38 is a substrate made of a compound semiconductor such as GaAs. The surface of the VCSEL substrate 38 corresponding to the LDD substrate 39 is the front surface, and the laser is emitted from the back surface ( Figure 4 The VCSEL substrate 38 is configured to emit light from the upper surface thereof. On the VCSEL substrate 38, a plurality of light emitting elements 5 having a mesa structure are arranged at predetermined intervals. Each light emitting element 5 has a laminated film 40. The laminated film 40 includes a first multilayer film reflector, a first spacer layer, an active layer 41, a second spacer layer, and a second multilayer film reflector, etc. The laser light generated by the active layer 41 is made to resonate between the first multilayer film reflector and the second multilayer film reflector to increase the light intensity, and is emitted from the back side of the substrate. In this way, Figure 4 The VCSEL array 24 is of the back-illuminated type.

[0134] When viewed from the VCSEL substrate 38 side, a cathode electrode 42 is arranged on the upper surface of each light emitting element 5. Similarly, when viewed from the VCSEL substrate 38 side, an anode electrode 44 is arranged on the upper surface and side surface of the undoped GaAs layer 43 arranged on the end side of the VCSEL array 24. When viewed from the VCSEL substrate 38 side, the anode electrode 44 is also arranged on the bottom layer side of the stacked film 40 of the plurality of light emitting elements 5. Figure 4 In the embodiment, the cathode electrode 42 and the anode electrode 44 may be arranged in the opposite manner. Figure 4 In the embodiment, the common electrode is the anode electrode 44, but the common electrode may be the cathode electrode 42, and the anode electrode 44 may be provided on each mesa portion. The periphery of each light emitting element 5 is covered with a resin member 45, for example.

[0135] The LDD substrate 39 has a plurality of pads 46 for supplying drive signals to the plurality of light emitting elements 5 of the VCSEL array 24. The pads 46 of the LDD substrate 39 are bonded to the pads 47 of the corresponding cathode electrodes 42 of the VCSEL array 24.

[0136] The pad 46 of the LDD substrate 39 is formed of a conductive material such as Al (aluminum). The pad 47 on the cathode electrode 42 is formed of a conductive material such as Co (cobalt). A column 48 made of, for example, Cu (copper) is arranged on the pad 46 of the LDD substrate 39, and a conductive laminated film such as a Ni (nickel) layer 49, a solder layer 50, and an Au (gold) layer 51 is arranged between the upper surface of the column 48 and the pad 47.

[0137] The LDD substrate 39 has a stacked structure in which an insulating layer 53 made of SiN or the like is disposed on a base material layer 52 made of Si (silicon) or the like, and a metal light shielding layer 54 made of W (tungsten) or the like is disposed thereon.

[0138] The LDD substrate 39 may also have a Figure 1 In this case, the LDD substrate 39 performs active driving. Alternatively, the LDD substrate 39 may supply a voltage corresponding to a driving signal generated by a driving circuit 7 provided separately from the light emitting section 3 to the cathode electrode 42 and the anode electrode 44. In this case, the LDD substrate 39 performs passive driving.

[0139] The upper surface of the first chip 3a in the light emitting unit 3 is flush with the upper surface of the LDD substrate 39, and the optical waveguide 19 is arranged along these upper surfaces. The optical waveguide 19 has a structure in which a light transmission layer 55 for transmitting an optical pulse signal is surrounded by a cladding layer 56 such as SiO2.

[0140] An opening 42a is provided in a part of the cathode electrode 42 disposed on the upper surface of each light emitting element 5. The optical pulse signal emitted by each light emitting element 5 is transmitted to the back side, but a part of the optical pulse signal is also transmitted to the front side. A part of the light transmitted to the front side of each light emitting element 5 is emitted from the opening 42a.

[0141] The optical waveguide 19 is provided with a grating coupler 57 at a position opposite to the opening 42a of each light emitting element 5. The grating coupler 57 is formed by removing a portion of the cladding layer 56 into a grid shape by photolithography or the like. The optical pulse signal emitted from the opening 42a of each light emitting element 5 is incident into the optical waveguide 19 from the grating coupler 57 of the optical waveguide 19.

[0142] A grating coupler 58 is also arranged near the reference pixel 18 connected to the optical waveguide 19, and the optical pulse signal transmitted in the optical waveguide 19 passes through the grating coupler 58 and enters the reference pixel 18. A Bragg reflector 59 is arranged at the end of the optical waveguide 19 on the light receiving unit 25 side to confine the optical pulse signal in the optical waveguide 19. Thus, the optical pulse signal in the optical waveguide 19 is prevented from entering the distance measuring pixel 20.

[0143] A light shielding wall 60 is disposed in a boundary region between the light emitting section 3 and the light receiving section 25. The light shielding wall 60 is disposed on the optical waveguide 19.

[0144] (Correction of Light Emitting Timing and Light Emitting Waveform of Light Emitting Element 5)

[0145] As described above, due to manufacturing variations, the light emission timing of the plurality of light emitting elements 5 that actually emit the light pulse signal after receiving the light emission instruction signal from the light emission control unit 9 may vary. In addition, the light emission waveform of the light pulse signal emitted by each light emitting element 5 may also vary. Therefore, in this embodiment, at least one of the light emission timing and the light emission waveform of each light emitting element 5 is corrected using the optical waveguide 19 and the reference pixel 18.

[0146] Figure 5 It is a schematic top view of the light emitting unit 3 and the light receiving unit 25. The plurality of light emitting elements 5 in the light emitting unit 3 emit light in sequence, for example, eight at a time, and eight optical pulse signals are transmitted via eight optical waveguides 19 and received by eight reference pixels 18. Figure 5 An example is shown in which a light pulse signal emitted by the light emitting element 5 of the number 0 is transmitted in the corresponding optical waveguide 19. It should be noted that in this specification, an example is mainly shown in which one reference pixel 18 receives a light pulse signal transmitted by one optical waveguide 19, but since the spacing between the light emitting elements 5 and the spacing between the reference pixels 18 and the distance pixels 20 are not necessarily consistent, there may be a situation in which multiple reference pixels 18 receive a light pulse signal transmitted by one optical waveguide 19.

[0147] Figure 6 : is a flowchart showing a first example of distance measurement processing. Figure 6 The time difference between the light emission timings of the plurality of light emitting elements 5 is calculated based on the plurality of light pulse signals received by the plurality of reference pixels 18 via the plurality of optical waveguides 19, and the distance is measured after correcting the light emission timings of the plurality of light emitting elements 5 based on the time difference.

[0148] Figure 6 Steps S1 to S5 represent processing steps for calculating the time difference in light emission timing between the plurality of light emitting elements 5 (hereinafter referred to as Tx in-plane time difference), and steps S11 to S16 represent processing steps for performing distance measurement in consideration of the Tx in-plane time difference.

[0149] In steps S1 to S5, the Tx in-plane time difference is calculated using a plurality of reference pixels 18. When the Tx in-plane time difference is calculated, a plurality of distance-measuring pixels 20 are used to perform distance measurement in steps S11 to S16. The calculation of the Tx in-plane time difference is preferably performed before the distance measurement process in steps S11 to S16. This is because the time difference of the light emission timing of the plurality of light-emitting elements 5 varies not only due to manufacturing variations but also due to environmental conditions such as temperature and voltage.

[0150] exist Figure 6In step S1, the plurality of light emitting elements 5 start emitting light based on the light emitting instruction signal from the light emitting control unit 9. As described above, in step S1, for example, eight light emitting elements 5 start emitting light at the same time. The light pulse signals emitted by the eight light emitting elements 5 are transmitted via eight optical waveguides 19 and received by eight reference pixels 18 (step S2). It should be noted that the light pulse signal transmitted by one optical waveguide 19 may also be received by a plurality of reference pixels 18.

[0151] Next, the signal processing unit 23 detects the time difference between the output timing of the light-emitting instruction signal output by the light-emitting control unit 9 and the timing when the eight light-receiving elements 30 receive the light pulse signal (step S3). This time difference is mainly caused by the time difference of the light-emitting element 5 emitting the light pulse signal. It should be noted that although there is also a time difference from the reference pixel 18 receiving the light pulse signal to the output of the voltage signal, Figure 6 , the deviation of reference pixel 18 is not considered.

[0152] Next, it is determined whether the processing of steps S1 to S3 has been repeated a predetermined number of times (step S4). As described above, the light emitting unit 3 causes the plurality of light emitting elements 5 to emit light eight at a time. Figure 2 In the example of , if the light emission is not repeated at least 16 times, all the light emitting elements 5 cannot emit light. Therefore, in step S4, it is preferred to repeat the processing of steps S1 to S3 so that all the light emitting elements 5 in at least the light emitting section 3 emit light more than once.

[0153] If the determination in step S4 is YES, the time difference in light emission timing between the plurality of light emitting elements 5 (Tx in-plane time difference) is calculated based on the detection result in step S3 (step S5). The process in step S5 corresponds to the process of the first time difference calculation unit 23b described above.

[0154] It should be noted that in step S5, not only the shift in the timing of the optical pulse signal but also the shift in the light intensity of the optical pulse signal may be detected. Therefore, in step S5, the Tx intra-plane difference including the shift in the Tx intra-plane time difference and the light intensity may be calculated.

[0155] By generating a histogram based on each voltage signal obtained by repeatedly receiving the light pulse signal by the reference pixel 18, the time difference in the Tx plane, the light intensity, and the light emission waveform of each light emitting element 5 can be calculated, and the centroid time of the light emission waveform of each light emitting element 5 can be detected based on the calculation result. The centroid time is equivalent to the light emission delay time of the corresponding light emitting element 5.

[0156] The average value TTX, AVE of the time (Rx light receiving time) during which the plurality of reference pixels 18 receive the optical pulse signal is expressed by the following equation (1).

[0157] [Formula 1]

[0158]

[0159] In addition, the error in the light receiving time between the plurality of reference pixels 18 (Rx in-plane time difference) T TXDIFF,k It is represented by the following formula (2). TX,k It is the time difference of the light emission timing of the light emitting element 5k.

[0160] T TXDIFF,k =T TX,k -T TX,AVE (2)

[0161] The average value of the Rx light receiving time in formula (1) is T TX,AVE The time difference T in the Rx plane of formula (2) TXDIFF,k Used to calculate the time difference within the Tx plane.

[0162] When Figure 6 When the Tx plane time difference is calculated in step S5, the distance measurement processing of steps S11 to S16 is performed next.

[0163] First, based on the light-emitting instruction signal from the light-emitting control unit 9, the plurality of light-emitting elements 5 start emitting light pulse signals (step S11). In step S11, as in step S1, for example, every 8 light-emitting elements 5 emit light. At this time, the 8 reference pixels 18 receive the light pulse signal via the optical waveguide 19, but the light pulse signal received by the reference pixel 18 is not used in the processing of step S11. Therefore, it is also possible to stop supplying the driving voltage to the reference pixel 18 so that the reference pixel 18 does not perform the light receiving action. Alternatively, it is also possible to set the output circuit of the reference pixel 18 to a disabled state. Alternatively, as described later, it is also possible to connect an optical switch to the optical waveguide 19 so that the light pulse signal from the reference pixel 18 is not transmitted in the optical waveguide 19.

[0164] When the light pulse signal is irradiated to the object 10 and the transmitted light pulse signal from the object 10 is received by the ranging pixel 20 (step S12), the time from the light emitting element 5 emitting the light pulse signal to the light receiving element 30 receiving the reflected light pulse signal is measured (step S13).

[0165] Next, it is determined whether the processing of steps S11 to S13 has been repeated a predetermined number of times (step S14). Here, for example, the processing of steps S11 to S13 is repeated until all the light emitting elements 5 in the light emitting unit 3 emit a light pulse signal at least once.

[0166] If the result of the determination in step S14 is yes, the light emission timing of each light emitting element 5 is corrected based on the time difference in the Tx plane calculated in step S5 (step S15). The process of step S15 corresponds to the process of the first correction unit 23c described above. Then, the distance to the object 10 is measured based on the time difference between the light emission timing corrected in step S15 and the light reception timing of the reflected light signal in the plurality of distance measuring pixels 20 (step S16).

[0167] Figure 7 Yes Description Figure 6 FIG. 5 is a diagram of the processing of steps S15 and S16.

[0168] Figure 7 The period T' ToF,k is the light receiving timing of the distance measuring pixel 20. TX,k is the time difference of the light-emitting timing of the light-emitting element 5k. Figure 6 In step S16, the corrected period T is calculated by the following formula (3): ToF,k .

[0169] T ToF,k =T' ToF,k -T ToF,k …(3)

[0170] (Correction of Light Receiving Timing of Light Receiving Element 30)

[0171] exist Figure 6 In the processing, although the deviation of the light-emitting timing and the light-emitting waveform of the light-emitting element 5 is taken into account, the distance measurement is performed without taking into account the deviation of the light-receiving timing of the light-receiving element 30. In fact, even if a plurality of light-receiving elements 30 receive reflected light signals at the same time, the timing of outputting the voltage signal corresponding to the reflected light signal will be offset. Therefore, it is preferable to perform the distance measurement on the basis of correcting the time difference of the light-receiving timing of the light-receiving element 30.

[0172] In order to correct the time difference of the light receiving timing of the light receiving element 30, the Figure 1 The light source 6 is shown. The light source 6 emits a light pulse signal. The light pulse signal emitted by the light source 6 can be received by all the reference pixels 18 and the distance measurement pixels 20 in the light receiving unit 25.

[0173] Figure 8 Schematically shows the light source 6 emitting light. Figure 1 as well as Figure 8In the example, the light source 6 is disposed at a corner of the light receiving portion 25 side of the light emitting portion 3, but the configuration location of the light emitting portion 3 is arbitrary. The light source 6 may also be disposed on a substrate different from the plurality of light emitting elements 5. The light source 6 may have a VCSEL structure, may be an LED (Light Emitting Diode), or may be other light sources.

[0174] Fig. 9 1 is a flowchart showing a processing procedure for calculating the time difference in the light receiving timing of the plurality of light receiving elements 30. When calculating the time difference in the light receiving timing of the light receiving elements 30, the optical waveguide 19 is not used.

[0175] First, according to the light emission instruction signal from the light emission control unit 9, the light source 6 emits a light pulse signal (step S21). Then, the light pulse signal is received by the plurality of reference pixels 18 and the plurality of ranging pixels 20 (step S22). For example, the signal processing unit 23 calculates the time difference between the timing when the light emission control unit 9 outputs the light emission instruction signal and the timing when the plurality of reference pixels 18 and the plurality of ranging pixels 20 receive the light pulse signal (step S23).

[0176] Next, it is determined whether the processing of steps S21 to S23 has been repeated a predetermined number of times (step S24). In order to reduce the influence of noise, it is preferable to average the time difference of step S23 based on the result of repeating the processing of steps S21 to S23 a predetermined number of times.

[0177] If the determination in step S24 is YES, the time difference in light reception timing between the plurality of light receiving elements 30 (hereinafter referred to as Rx in-plane time difference) is calculated based on the result of repeating the process of step S23 a predetermined number of times (step S25). The process of step S25 corresponds to the second time difference calculation unit 23e described above.

[0178] Fig.10 This is a flowchart showing a process procedure for performing ranging in consideration of the Rx in-plane time difference and the Tx in-plane time difference. Fig.10 Steps S1 to S5 are performed with Figure 6 That is, the Tx in-plane time difference is calculated using a plurality of optical waveguides 19 and a plurality of reference pixels 18.

[0179] When the Tx in-plane time difference is calculated, the processing of steps S11 to S14, S15a and S16a is performed next. Fig.10 The processing of steps S15a and S16a is the same as Figure 6 The processing of steps S15 and S16 is partially different.

[0180] exist Fig.10In step S15a, not only the light emission timing of the plurality of light emitting elements 5 is corrected based on the Tx in-plane time difference, but also the light reception timing of the plurality of light receiving elements 30 is corrected based on the Rx in-plane time difference. The processing of step S15a corresponds to the processing of the second correction unit 23f described above. In step S16a, the distance to the object 10 is calculated based on the light emission timing and light reception timing corrected in step S15a.

[0181] Fig.11 Yes Description Fig.10 FIG. 5 is a diagram of the processing of steps S15a and S16a. Fig.11 The timing when the plurality of reference pixels 18 and the plurality of ranging pixels 20 receive light pulse signals from the light source 6 and the timing when the plurality of ranging pixels 20 receive reflected light pulse signals from the object 10 are shown.

[0182] Fig.11 The reference pixel response delay time T RXREF,k As shown in the following formula (4), it is the time difference between the timing at which the reference pixel 18 outputs the voltage signal corresponding to the reflected light signal and the timing at which the light emission instruction signal is output.

[0183] T RXREF,k =T' RXREF,k -T RX,TRG …(4)

[0184] As shown in the following formula (5), the ranging pixel response delay time T RXIMG,k It is the time difference between the timing at which the distance measuring pixel 20 outputs the voltage signal corresponding to the reflected light signal and the timing at which the light emission instruction signal is output.

[0185] T RXIMG,k =T' RXIMG,k -T RX,TRG …(5)

[0186] The average value T of the timing at which the plurality of reference pixels 18 and the plurality of distance measuring pixels 20 receive the light pulse signal from the light source 6 is RX,AVE It is represented by the following formula (6).

[0187] [Formula 2]

[0188]

[0189] The time difference (Rx plane time difference) between the timings at which the plurality of reference pixels 18 and the plurality of ranging pixels 20 receive the light pulse signal from the light source 6 is expressed by the following equation (7).

[0190] T RXDIFF,k =T RXIMG,k -T RXREF,k …(7)

[0191] exist Fig. 9 In step S25, based on formula (7), the time difference within the Rx plane can be calculated.

[0192] exist Fig.10 In step S16a, the distance T from the object 10 can be calculated based on the following formula (8): ToF,k .

[0193] T ToF,k =T' ToF,k -(T TX,k +T RXDIFF,k )…(8)

[0194] Thus, in the first embodiment, the light signals emitted by the plurality of light emitting elements 5 are directly received by the plurality of reference pixels 18 via the plurality of optical waveguides 19, so that the time difference of the light emission timing of the plurality of light emitting elements 5 can be accurately detected. Therefore, the distance measurement can be performed based on the detected time difference, taking into account the time difference of the light emission timing of the plurality of light emitting elements 5, and the distance measurement accuracy can be improved.

[0195] In addition, by using a plurality of optical waveguides 19 and a plurality of reference pixels 18, it is possible to detect the light waveforms of the light pulse signals emitted by the plurality of light emitting elements 5. Therefore, based on the light waveforms of the detected light pulse signals, it is possible to correct the light waveforms of the plurality of light emitting elements 5. Thus, it is possible to correct the light peak intensity of the light pulse signal, the shift in pulse width, the shift in rising edge timing, the shift in falling edge timing, and the shift in conversion rate, and to improve the ranging accuracy.

[0196] Furthermore, in this embodiment, before the distance measurement starts, the light pulse signals emitted from the light source 6 are received by the plurality of reference pixels 18 and the plurality of distance measurement pixels 20, thereby detecting the time difference of the light receiving timing of the plurality of light receiving elements 30. Thus, when performing the distance measurement process, not only the time difference of the light emission timing of the light emitting element 5 but also the time difference of the light receiving timing of the light receiving element 30 can be corrected, and the distance measurement accuracy can be further improved.

[0197] (Second Embodiment)

[0198] Fig.12 1 is a block diagram showing a schematic configuration of a distance measuring system 2 including a light detection device 1 according to the second embodiment. Fig.12 The ranging system 2 has Figure 1 The distance measuring system 2 of the embodiment omits the structure of the histogram generating unit 22. In addition, an ADC (Analog Digital Converter: analog-to-digital converter) 12a is provided instead of Figure 1 TDC21. Other structures and Figure 1 same. Fig.12The distance measurement system 2 performs distance measurement processing by the iToF (indirect Time of Flight) method. In the iToF method, since the distance is measured by the phase difference between a plurality of light receiving signals, the histogram generating unit 22 is not required.

[0199] Fig.13 It is a schematic plan view of the photodetection device 1 and the light emitting unit 3 according to the second embodiment. Fig.13 The light emitting unit 3 has a light peak intensity adjustment register 9a, a rising edge timing adjustment register 9b, and a falling edge timing adjustment register 9c, but the Figure 2 This is because in the iToF method, the light emission pulse width tends to be wider than that in the dToF method, and the conversion rate is basically not a concern.

[0200] Fig.14A 1 is a diagram showing an ideal pulse waveform of a light pulse signal emitted by each light emitting element 5 . Fig. 14B : is a diagram showing a pulse waveform after the light peak intensity of an optical pulse signal changes. Fig. 14C This is a diagram showing a pulse waveform after the pulse width of an optical pulse signal is changed. Fig.14D This is a diagram showing a pulse waveform in which the timing of the rising edge or the falling edge of the optical pulse signal changes.

[0201] The light detection device 1 according to the second embodiment is Figure 6 The same processing steps can be used to perform distance measurement by taking into account the time difference in the Tx plane. Alternatively, the light detection device 1 of the second embodiment can be used with Fig.10 In the same processing steps, the distance measurement process is performed in consideration of the Tx in-plane time difference and the Rx in-plane time difference. Thus, the distance measurement accuracy can be improved as in the first embodiment.

[0202] (Third Embodiment)

[0203] The third embodiment corrects the difference in light amount of each distance measuring pixel in the light receiving section based on the difference in light amount of each light emitting element 5 in the light emitting section.

[0204] Fig.15 It is a block diagram showing a schematic configuration of a signal processing system 2 a including the photodetection device 1 according to the third embodiment. Fig.15 The signal processing system 2a includes an image processing unit 12a instead of Figure 1 The image processing unit 12a includes a signal processing unit 23 and a signal processing control unit 29a. Figure 1 same.

[0205] Fig.15The signal processing system 2a performs photon counting in each light receiving element 30, and does not perform distance measurement. When performing photon counting, it is not necessary to convert the photons into a time digital signal in the TDC 21, and it is not necessary to generate a histogram, so the TDC 21 and the histogram generating unit 22 are omitted.

[0206] Fig.15 The reference pixel 18 and the distance measuring pixel 20 have built-in counters to count the number of times the reference pixel 18 and the distance measuring pixel 20 react to received photons.

[0207] Fig.15 The signal processing unit 23 obtains the number of times each distance measuring pixel 20 receives the reflected light pulse signal, and generates a brightness image based on the number of times.

[0208] Fig.16 It is a schematic plan view of the photodetection device 1 and the light emitting unit 3 according to the third embodiment.

[0209] Fig.16 The light emitting unit 3 has a light peak intensity adjustment register 9a, but the register 9a is omitted. Figure 2 The rising edge timing adjustment register 9b, the falling edge timing adjustment register 9c and the conversion rate adjustment register 9d. In the photon counting sensor, since it is assumed that the light emitting element 5 emits a light pulse signal with a longer pulse width than the iToF sensor, the conversion rate will not be a problem and there is no need to obtain time information, so the registers for storing information other than light intensity are omitted.

[0210] Fig.17A 1 is a diagram showing an ideal pulse waveform of a light pulse signal emitted by each light emitting element 5 . Fig. 17B : is a diagram showing a pulse waveform after the light peak intensity of an optical pulse signal changes.

[0211] The light detection device 1 according to the third embodiment can be Figure 6 A similar processing step is used to generate a brightness image by taking into account the light quantity difference within the Tx plane.

[0212] Fig.18 It is a flowchart showing the processing operation of the third embodiment. Fig.18 Steps S31 to S35 of FIG. 1 represent processing steps for calculating the light quantity difference within the Tx plane, and steps S41 to S46 represent processing steps for generating a luminance image in consideration of the light quantity difference within the Tx plane.

[0213] First, the light emitting element 5 starts to emit light (step S31), and the light pulse signal is received at the reference pixel 18 via the optical waveguide 19 (step S32). The reference pixel 18 outputs a pulse signal corresponding to the light intensity of the light pulse signal. The signal processing unit 23 obtains the light amount of the reference pixel 18 by counting the number of times the voltage signal output from the reference pixel 18 exceeds a predetermined threshold value (step S33).

[0214] Next, it is determined whether the processing of steps S31 to S33 has been repeated a predetermined number of times (step S34). The predetermined number of times is the number of times that all light emitting elements 5 emit light at least once. The processing of steps S31 to S33 is repeated until the predetermined number of times is reached. When the predetermined number of times is reached, the light quantity difference in the Tx plane is calculated based on the processing result of step S33 (step S35).

[0215] Next, the light emitting element 5 starts to emit light in order to receive the reflected light signal from the object 10 (step S41). Each ranging pixel 20 receives the reflected light signal from the object 10 (step S42). The ranging pixel 20 outputs a pulse signal corresponding to the light intensity of the reflected light pulse signal. The signal processing unit 23 obtains the light amount of the ranging pixel 20 by counting the number of times the voltage signal output from the ranging pixel 20 exceeds a predetermined threshold value (step S43).

[0216] Next, it is determined whether the processing of steps S41 to S43 is repeated a predetermined number of times (step S44). The predetermined number of times is the number of times all the light emitting elements 5 are made to emit light at least once. The processing of steps S41 to S43 is repeated until the predetermined number of times is reached. When the predetermined number of times is reached, the in-plane light quantity difference of each ranging pixel 20 in the light receiving unit 25 is corrected based on the Tx in-plane light quantity difference calculated in step S35 (step S45). Next, based on the correction result in step S45, a brightness image is generated (step S46).

[0217] Thus, in the third embodiment, the light quantity difference in the Tx plane of each reference pixel 18 in the light emitting unit 3 is calculated and the light quantity difference in each ranging pixel 20 in the light receiving unit 25 is corrected, so that a luminance image can be generated in consideration of the light quantity difference in the Tx plane.

[0218] (Fourth Embodiment)

[0219] In the first to third embodiments, an example is described in which only one of the plurality of light emitting elements 5 capable of inputting an optical pulse signal into each optical waveguide 19 is caused to emit light, and the light emitting element 5 that emits the optical pulse signal is sequentially switched. In this case, it is necessary to sequentially switch the control of the light emission of the plurality of light emitting elements 5. In contrast, if an optical switch 27 is disposed between the plurality of light emitting elements 5 and the optical waveguide 19, and the on / off of the optical switch 27 is sequentially switched, even if the plurality of light emitting elements 5 emit optical pulse signals at the same timing, the optical pulse signals from each light emitting element 5 can be sequentially transmitted through the optical waveguide 19.

[0220] The specific form of the optical switch 27 is not limited. For example, the optical switch 27 can be an optical gate switch, a Mach-Zehnder interferometer, a directional coupler, or other optical switches.

[0221] Fig.19 2 is a diagram schematically showing an optical switch 27 disposed between each light emitting element 5 and the corresponding optical waveguide 19. Even if each light emitting element 5 emits an optical pulse signal, when the optical switch 27 is turned off, the optical pulse signal cannot be transmitted in the optical waveguide 19. That is, the optical switch 27 allows the optical pulse signal emitted by any light emitting element 5 to be transmitted.

[0222] Fig. 20 1 is a block diagram showing a schematic configuration of a distance measuring system 2 including a photodetection device 1 according to a fourth embodiment. Fig. 20 The ranging system 2 in Figure 1 On the basis of the structure of the distance measurement system 2 , an optical switch control unit 61 and an optical switch driving circuit 62 are provided in the light emitting unit 3 , and a memory 63 is provided in the distance measurement processing unit 12 .

[0223] The optical switch control unit 61 controls the on / off of the optical switch 27 connected to each optical waveguide 19 under the control of the overall control unit 4. The optical switch drive circuit 62 switches the optical switch 27 on / off based on the control signal from the optical switch control unit 61.

[0224] A plurality of optical switches 27 are arranged on each of the plurality of optical waveguides 19 corresponding to the plurality of light emitting elements 5 arranged in the first direction X. The memory 63 in the distance measurement processing unit 12 stores the relationship between each of the plurality of optical switches 27 connected to each optical waveguide 19 and the Tx in-plane time difference.

[0225] Fig.21 It is a schematic plan view of the photodetection device 1 and the light emitting unit 3 according to the fourth embodiment. Fig.21 The light emitting unit 3 of the embodiment of the present invention is provided with an optical switch 27 between each of the plurality of light emitting elements 5 and the corresponding optical waveguide 19. Figure 2In addition, all the light emitting elements 5 in the light emitting section 3 emit light at the same time, which is also different from Figure 2 The light emitting part 3 is different. In addition, Fig.21 The light control unit 9 includes a light peak intensity adjustment register 9a, a rising edge timing adjustment register 9b, a falling edge timing adjustment register 9c, and a conversion rate adjustment register 9d, and also includes an optical switch individual control register 9e. The optical switch individual control register 9e stores information related to the switching order of turning on or off the plurality of optical switches 27.

[0226] exist Fig.21 As described above, the memory 63 is arranged at the rear stage of the signal processing unit 23. Figure 2 different.

[0227] Fig. 22 This is a flowchart showing the processing operation of the photodetection device according to the fourth embodiment. Fig.21 Steps S51 to S57 represent a process of calculating the time difference within the Tx plane, and steps S11 to S16 represent a process of performing distance measurement in consideration of the time difference within the Tx plane. Fig. 22 Steps S11 to S16 and Figure 6 Steps S11 to S16 are the same, so their description is omitted.

[0228] In step S51, the optical switch 27 is initially set. For example, only the optical switch 27 connected to the light emitting element 5 No. 0 is turned on, and the optical switches 27 connected to the light emitting elements 5 No. 1 to No. 15 are turned off.

[0229] Next, the optical pulse signal from the light emitting element 5 turned on by the optical switch 27 is transmitted through the optical waveguide 19 (step S52) and received by the reference pixel 18 (step S53). Next, the time difference from the light emission instruction to the reference pixel 18 receiving the optical pulse signal is detected (step S54).

[0230] Next, it is determined whether the processing of steps S51 to S54 has been repeated a predetermined number of times (step S55). When the processing of steps S51 to S54 has been repeated a predetermined number of times, it is determined whether the switching of the optical switch 27 has been completed (step S56). As described above, a plurality of optical switches 27 are connected to each optical waveguide 19, and each optical switch 27 is turned on in sequence to repeat the processing of steps S51 to S55.

[0231] When all the optical switches 27 are turned on in sequence and the process of step S54 is performed, the Tx in-plane time difference is calculated (step S57).

[0232] The Tx in-plane time difference calculated in step S57 is used to Fig.21 In step S15, the Tx plane time difference is corrected.

[0233] Thus, in the fourth embodiment, since the optical switch 27 is provided on each of the plurality of light emitting elements 5 that allow the optical pulse signal to be incident on each of the plurality of optical waveguides 19, even if the light emitting elements 5 emit optical pulse signals at the same time, only one of the optical pulse signals can be transmitted in the optical waveguide 19 by switching the optical switch 27. Therefore, compared with the first to third embodiments described above, the light emission control of the plurality of light emitting elements 5 becomes easier.

[0234] <<Application Examples>>

[0235] The technology involved in the present disclosure can be applied to various products. For example, the technology involved in the present disclosure can be implemented as a device mounted on any type of mobile body such as an automobile, an electric car, a hybrid electric car, a motorcycle, a bicycle, a personal mobility tool, an airplane, an unmanned aerial vehicle, a ship, a robot, a construction machine, an agricultural machine (tractor), etc.

[0236] Fig.23 7000 is a block diagram showing a schematic configuration example of a vehicle control system 7000 as an example of a mobile control system to which the technology involved in the present disclosure can be applied. The vehicle control system 7000 includes a plurality of electronic control units connected via a communication network 7010. Fig.23 In the example shown, the vehicle control system 7000 includes a drive system control unit 7100, a body system control unit 7200, a battery control unit 7300, an external information detection unit 7400, an internal information detection unit 7500, and an integrated control unit 7600. The communication network 7010 connecting these multiple control units may be, for example, an in-vehicle communication network conforming to any standard such as CAN (Controller Area Network), LIN (Local Interconnect Network), LAN (Local Area Network), or FlexRay (registered trademark).

[0237] Each control unit includes a microcomputer that performs calculations according to various programs, a storage unit that stores programs executed by the microcomputer or parameters used in various calculations, and a drive circuit that drives various control objects. Each control unit includes a network I / F for communicating with other control units via the communication network 7010, and a communication I / F for communicating with devices or sensors inside and outside the vehicle through wired or wireless communication. Fig.237, as a functional structure of an integrated control unit 7600, a microcomputer 7610, a general communication I / F 7620, a dedicated communication I / F 7630, a positioning unit 7640, a beacon receiving unit 7650, an in-vehicle device I / F 7660, an audio and video output unit 7670, an in-vehicle network I / F 7680, and a storage unit 7690 are shown. Other control units also include a microcomputer, a communication I / F, a storage unit, and the like.

[0238] The drive system control unit 7100 controls the actions of devices associated with the drive system of the vehicle according to various programs. For example, the drive system control unit 7100 functions as a control device for a drive force generating device such as an internal combustion engine or a drive motor for generating a drive force for the vehicle, a drive force transmitting mechanism for transmitting the drive force to the wheels, a steering mechanism for adjusting the steering angle of the vehicle, and a braking device for generating a braking force for the vehicle. The drive system control unit 7100 may also function as a control device such as an ABS (Antilock Brake System) or an ESC (Electronic Stability Control).

[0239] The drive system control unit 7100 is connected to a vehicle state detection unit 7110. The vehicle state detection unit 7110 includes, for example, a gyro sensor for detecting the angular velocity of the axial rotation of the vehicle body, an acceleration sensor for detecting the acceleration of the vehicle, or at least one of sensors for detecting the amount of operation of the accelerator pedal, the amount of operation of the brake pedal, the steering angle of the steering wheel, the engine speed, or the speed of the wheels. The drive system control unit 7100 performs calculation processing using the signal input from the vehicle state detection unit 7110 to control the internal combustion engine, the drive motor, the electric power steering device, the brake device, etc.

[0240] The body system control unit 7200 controls the actions of various devices installed on the vehicle body according to various programs. For example, the body system control unit 7200 functions as a control device for a keyless entry system, a smart key system, a power window device, or various lights such as headlights, reverse lights, brake lights, direction indicators, or fog lights. In this case, radio waves sent from a mobile device that replaces the key or signals of various switches can be input to the body system control unit 7200. The body system control unit 7200 receives input of these radio waves or signals and controls the door lock device, power window device, lights, etc. of the vehicle.

[0241] The battery control unit 7300 controls the secondary battery 7310, which is the power supply source for the driving motor, according to various programs. For example, information such as the battery temperature, the battery output voltage, or the remaining capacity of the battery is input to the battery control unit 7300 from a battery device having the secondary battery 7310. The battery control unit 7300 uses these signals for calculation processing to perform temperature control of the secondary battery 7310 or control of a cooling device of the battery device.

[0242] The vehicle exterior information detection unit 7400 detects information outside the vehicle equipped with the vehicle control system 7000. For example, at least one of a photographing unit 7410 and a vehicle exterior information detection unit 7420 is connected to the vehicle exterior information detection unit 7400. The photographing unit 7410 includes at least one of a ToF (Time Of Flight) camera, a stereo camera, a monocular camera, an infrared camera, and other cameras. The vehicle exterior information detection unit 7420 includes, for example, an environmental sensor for detecting the current weather or meteorology, or at least one of surrounding information detection sensors for detecting other vehicles, obstacles, pedestrians, etc. around the vehicle equipped with the vehicle control system 7000.

[0243] The environmental sensor may be, for example, at least one of a raindrop sensor for detecting rainy days, a fog sensor for detecting fog, a sunshine sensor for detecting the degree of sunshine, and a snow sensor for detecting snowfall. The surrounding information detection sensor may be at least one of an ultrasonic sensor, a radar device, and a LIDAR (Light Detection and Ranging: Laser Imaging Detection and Ranging: Laser Imaging Detection and Ranging) device. These photographing units 7410 and the vehicle exterior information detection unit 7420 may be configured as separate sensors or devices, or may be configured as a device integrating multiple sensors or devices.

[0244] Here, Fig.24The following is an example of the installation positions of the camera unit 7410 and the vehicle exterior information detection unit 7420. The camera units 7910, 7912, 7914, 7916, and 7918 are installed at at least one of the front nose, side mirrors, rear bumper, rear door, and upper portion of the windshield in the vehicle compartment of the vehicle 7900. The camera unit 7910 installed at the front nose and the camera unit 7918 installed at the upper portion of the windshield in the vehicle compartment mainly acquire images in front of the vehicle 7900. The camera units 7912 and 7914 installed at the side mirrors mainly acquire images on the side of the vehicle 7900. The camera unit 7916 installed at the rear bumper or rear door mainly acquires images at the rear of the vehicle 7900. The camera unit 7918 installed at the upper portion of the windshield in the vehicle compartment is mainly used to detect vehicles or pedestrians in front, obstacles, signal lights, traffic signs, lanes, etc.

[0245] It should be noted that Fig.24 An example of the photographing ranges of the photographing units 7910, 7912, 7914, and 7916 is shown respectively. The photographing range a represents the photographing range of the photographing unit 7910 provided at the front nose, the photographing ranges b and c represent the photographing ranges of the photographing units 7912 and 7914 provided at the side mirrors, respectively, and the photographing range d represents the photographing range of the photographing unit 7916 provided at the rear bumper or the rear door. For example, by superimposing the image data photographed by the photographing units 7910, 7912, 7914, and 7916, a bird's-eye view image of the vehicle 7900 observed from above can be obtained.

[0246] The vehicle exterior information detection units 7920, 7922, 7924, 7926, 7928, 7930 disposed at the front, rear, side, corner, and upper portion of the windshield in the vehicle 7900 may be, for example, ultrasonic sensors or radar devices. The vehicle exterior information detection units 7920, 7926, 7930 disposed at the front nose, rear bumper, rear door, and upper portion of the windshield in the vehicle 7900 may be, for example, LIDAR devices. These vehicle exterior information detection units 7920-7930 are mainly used to detect vehicles ahead, pedestrians, obstacles, and the like.

[0247] return Fig.23The description continues. The vehicle exterior information detection unit 7400 enables the shooting unit 7410 to shoot an image outside the vehicle and receives the shot image data. In addition, the vehicle exterior information detection unit 7400 receives detection information from the vehicle exterior information detection unit 7420 connected thereto. In the case where the vehicle exterior information detection unit 7420 is an ultrasonic sensor, a radar device, or a LIDAR device, the vehicle exterior information detection unit 7400 sends ultrasonic waves or electromagnetic waves, etc., and receives information of the received reflected waves. The vehicle exterior information detection unit 7400 can perform object detection processing or distance detection processing of people, vehicles, obstacles, signs, or text on the road surface based on the received information. The vehicle exterior information detection unit 7400 can perform environmental recognition processing such as identifying rainfall, fog, or road conditions based on the received information. The vehicle exterior information detection unit 7400 can calculate the distance to objects outside the vehicle based on the received information.

[0248] In addition, the vehicle exterior information detection unit 7400 can perform image recognition processing or distance detection processing to identify people, vehicles, obstacles, signs, or text on the road surface based on the received image data. The vehicle exterior information detection unit 7400 can perform distortion correction or alignment processing on the received image data, and can synthesize image data captured by different shooting units 7410 to generate a bird's-eye view image or a panoramic image. The vehicle exterior information detection unit 7400 can use the image data captured by different shooting units 7410 to perform viewpoint conversion processing.

[0249] The in-vehicle information detection unit 7500 detects information inside the vehicle. For example, a driver status detection unit 7510 for detecting the driver's status is connected to the in-vehicle information detection unit 7500. The driver status detection unit 7510 may include a camera for photographing the driver, a biometric sensor for detecting the driver's biological information, or a microphone for collecting sounds inside the vehicle. The biometric sensor is, for example, disposed on a seat surface or a steering wheel, and detects biological information of a passenger sitting on the seat or a driver holding the steering wheel. The in-vehicle information detection unit 7500 can calculate the driver's fatigue or concentration based on the detection information input from the driver status detection unit 7510, and can also determine whether the driver is dozing off. The in-vehicle information detection unit 7500 can perform noise elimination processing and other processing on the collected voice signal.

[0250] The integrated control unit 7600 controls the overall operation in the vehicle control system 7000 according to various programs. An input unit 7800 is connected to the integrated control unit 7600. The input unit 7800 is implemented by a device such as a touch panel, a button, a microphone, a switch or a joystick that can be operated by a passenger. The integrated control unit 7600 can input data obtained by voice recognition of the sound input by the microphone. The input unit 7800 can be, for example, a remote control device using infrared or other radio waves, or an external connection device such as a mobile phone or PDA (Personal Digital Assistant) corresponding to the operation of the vehicle control system 7000. The input unit 7800 can be, for example, a camera, in which case the passenger can input information by gestures. Alternatively, data obtained by detecting the movement of a wearable device worn by the passenger can be input. In addition, the input unit 7800 can include, for example, an input control circuit, which generates an input signal based on the information input by the passenger using the above-mentioned input unit 7800, and outputs it to the integrated control unit 7600. Passengers and the like input various data or instruct processing operations to the vehicle control system 7000 by operating the input unit 7800 .

[0251] The storage unit 7690 may also include a ROM (Read Only Memory) for storing various programs executed by the microcomputer and a RAM (Random Access Memory) for storing various parameters, operation results, sensor values, etc. In addition, the storage unit 7690 may also be implemented by a magnetic storage device such as a HDD (Hard Disc Drive), a semiconductor storage device, an optical storage device, or an optical magnetic storage device.

[0252] The general communication I / F 7620 is a general communication I / F that mediates communication with various devices existing in the external environment 7750. The general communication I / F 7620 can implement cellular communication protocols such as GSM (registered trademark) (Global System of Mobilecommunications), WiMAX (registered trademark), LTE (registered trademark) (Long Term Evolution) or LTE-A (LTE-Advanced: Evolution of LTE), or other wireless communication protocols such as wireless LAN (also known as Wi-Fi (registered trademark)) and Bluetooth (registered trademark). The general communication I / F 7620 can be connected to a device (e.g., an application server or a control server) existing on an external network (e.g., the Internet, a cloud network, or a network inherent to an operator) via a base station or an access point. In addition, the general communication I / F 7620 can be connected to a terminal (e.g., a terminal of a driver, a pedestrian, or a store, or an MTC (Machine Type Communication) terminal) existing near the vehicle using, for example, P2P (Peer To Peer) technology.

[0253] The dedicated communication I / F 7630 is a communication I / F that supports a communication protocol developed for use in a vehicle. The dedicated communication I / F 7630 can implement, for example, standard protocols such as WAVE (Wireless Access in Vehicle Environment), which is a combination of the lower layer IEEE802.11p and the higher layer IEEE1609, DSRC (Dedicated Short Range Communications), or a cellular communication protocol. The dedicated communication I / F 7630 typically performs V2X communication including one or more concepts of vehicle-to-vehicle communication, vehicle-to-infrastructure communication, vehicle-to-home communication, and vehicle-to-pedestrian communication.

[0254] The positioning unit 7640 receives, for example, a GNSS signal from a GNSS (Global Navigation Satellite System) satellite (e.g., a GPS signal from a GPS (Global Positioning System) satellite), performs positioning, and generates location information including the latitude, longitude, and altitude of the vehicle. It should be noted that the positioning unit 7640 can determine the current location by exchanging signals with a wireless access point, or can obtain location information from a terminal such as a mobile phone, PHS, or smart phone with a positioning function.

[0255] The beacon receiving unit 7650 receives radio waves or electromagnetic waves transmitted from a radio station installed on the road, and obtains information such as the current position, congestion, prohibited passage, or required time. It should be noted that the function of the beacon receiving unit 7650 can be included in the above-mentioned dedicated communication I / F 7630.

[0256] The in-vehicle device I / F 7660 is a communication interface that mediates the connection between the microcomputer 7610 and various in-vehicle devices 7760 present in the vehicle. The in-vehicle device I / F 7660 can establish a wireless connection using a wireless communication protocol such as a wireless LAN, Bluetooth (registered trademark), NFC (Near Field Communication), or WUSB (Wireless USB). In addition, the in-vehicle device I / F 7660 can establish a wired connection such as USB (Universal Serial Bus), HDMI (registered trademark) (High-Definition Multimedia Interface), or MHL (Mobile High-definition Link) via a connection terminal (and a cable if necessary) not shown in the figure. The in-vehicle device 7760 may include, for example, a mobile device or wearable device owned by a passenger, or at least one of the information devices carried in or installed in the vehicle. In addition, the in-vehicle device 7760 may include a navigation device that searches for a route to an arbitrary destination. The in-vehicle device I / F 7660 exchanges control signals or data signals with these in-vehicle devices 7760 .

[0257] The in-vehicle network I / F 7680 is an interface that mediates communication between the microcomputer 7610 and the communication network 7010. The in-vehicle network I / F 7680 transmits and receives signals according to a predetermined protocol supported by the communication network 7010.

[0258] The microcomputer 7610 of the integrated control unit 7600 controls the vehicle control system 7000 according to various programs based on information acquired via at least one of the general communication I / F 7620, the dedicated communication I / F 7630, the positioning unit 7640, the beacon receiving unit 7650, the in-vehicle device I / F 7660, and the in-vehicle network I / F 7680. For example, the microcomputer 7610 can calculate the control target value of the driving force generation device, the steering mechanism, or the braking device based on the acquired information inside and outside the vehicle, and output a control command to the drive system control unit 7100. For example, the microcomputer 7610 can coordinate the functions of ADAS (Advanced Driver Assistance System) including collision avoidance or impact mitigation of the vehicle, following the vehicle based on the driving distance, speed maintenance driving, collision warning of the vehicle, or lane departure warning of the vehicle. In addition, the microcomputer 7610 can control the driving force generating device, steering mechanism or braking device based on the information obtained about the vehicle's surroundings, thereby performing coordinated control for the purpose of automatic driving, etc., which allows the vehicle to travel autonomously without relying on the driver's operation.

[0259] The microcomputer 7610 can generate three-dimensional distance information between the vehicle and surrounding objects such as structures and people based on information obtained via at least one of the general communication I / F 7620, the dedicated communication I / F 7630, the positioning unit 7640, the beacon receiving unit 7650, the in-vehicle device I / F 7660, and the vehicle network I / F 7680, and generate local map information including surrounding information of the current position of the vehicle. In addition, the microcomputer 7610 can predict dangers such as a collision of the vehicle, the approach of pedestrians, etc., or entering a road where traffic is prohibited based on the information obtained, and generate a warning signal. The warning signal can be, for example, a signal for generating a warning sound or lighting a warning light.

[0260] The audio and video output unit 7670 transmits at least one of an audio and an image output signal to an output device capable of visually or auditorily notifying the vehicle passengers or the outside of the vehicle. Fig.23In the example, as output devices, an audio speaker 7710, a display unit 7720, and an instrument panel 7730 are illustrated. The display unit 7720 may include, for example, at least one of an on-board display and a head-up display. The display unit 7720 may also have an AR (Augmented Reality) display function. The output device may be a wearable device such as headphones, glasses-type displays worn by passengers, projectors, or lights, etc. in addition to these devices. In the case where the output device is a display device, the display device visually displays the results obtained by various processing performed by the microcomputer 7610 or information received from other control units in various forms such as text, images, tables, and graphs. In addition, in the case where the output device is an audio output device, the audio output device converts an audio signal composed of played sound data or audio data into an analog signal and outputs it audibly.

[0261] It should be noted that in Fig.23 In the example shown, at least two control units connected via the communication network 7010 can be integrated into one control unit. Alternatively, each control unit can also be composed of multiple control units. In addition, the vehicle control system 7000 can have other control units not shown in the figure. In addition, in the above description, part or all of the functions performed by any control unit can be performed by other control units. That is, as long as information is sent and received via the communication network 7010, the prescribed calculation processing can be performed by any control unit. Similarly, a sensor or device connected to any control unit can be connected to other control units, and multiple control units can send and receive detection information to each other via the communication network 7010.

[0262] It should be noted that it can be used to implement the use Figure 1 The computer program for each function of the light detection device 1 according to the present embodiment described in the above-mentioned embodiments is installed in any control unit, etc. In addition, a computer-readable storage medium storing such a computer program may also be provided. The storage medium is, for example, a magnetic disk, an optical disk, a magneto-optical disk, a flash memory, etc. In addition, the above-mentioned computer program may be distributed, for example, via a network without using a storage medium.

[0263] In the vehicle control system 7000 described above, the Figure 1 The light detection device 1 according to the present embodiment described above can be applied to Fig.23 An integrated control unit 7600 of the application example shown.

[0264] In addition, use Figure 1 At least a part of the components of the light detection device 1 described above may also be used in Fig.23The integrated control unit 7600 shown in FIG. 7 is implemented in a module (eg, an integrated circuit module consisting of a bare chip). Alternatively, using Figure 1 The light detection device 1 described above can also be Fig.23 The vehicle control system 7000 shown is implemented by multiple control units.

[0265] It should be noted that the present technology can adopt the following structures.

[0266] (1) A light detection device comprising:

[0267] A plurality of light emitting elements emit a first light pulse signal;

[0268] A plurality of optical waveguides for transmitting the first optical pulse signals respectively emitted by the plurality of light emitting elements;

[0269] a plurality of first light receiving elements, receiving the first light pulse signals transmitted in the plurality of optical waveguides;

[0270] A plurality of second light receiving elements, receiving reflected light pulse signals after the first light pulse signals respectively emitted by the plurality of light emitting elements are reflected by an object;

[0271] a first time difference calculation unit that calculates a time difference in light emission timing of the plurality of light emitting elements based on a light reception timing of the first light pulse signal in the plurality of first light receiving elements; and

[0272] The first correction unit generates first correction information for correcting the time difference of the light emission timings of the plurality of light emitting elements based on the time difference calculated by the first time difference calculation unit.

[0273] (2) The light detection device according to (1), wherein:

[0274] The plurality of light emitting elements are arranged in plurality in the first direction and in plurality in the second direction,

[0275] The plurality of light emitting elements arranged in the second direction allow the first optical pulse signal to be incident on the respective different optical waveguides,

[0276] The plurality of light emitting elements arranged in the first direction respectively cause the first light pulse signal to be incident on the corresponding optical waveguide at a staggered time.

[0277] (3) The light detection device according to (2), wherein:

[0278] Two or more intermittently arranged light emitting elements among the plurality of light emitting elements arranged in the second direction emit the first light pulse signal simultaneously,

[0279] The plurality of light emitting elements arranged in the first direction sequentially cause the first optical pulse signal to be incident on the corresponding optical waveguide in the order in which they are arranged in the first direction.

[0280] (4) The light detection device according to any one of (1) to (3), wherein:

[0281] The first time difference calculation unit calculates the time difference based on the result that the plurality of first light receiving elements repeatedly receive the light of the first light pulse signal a plurality of times.

[0282] The first correction unit generates the first correction information based on a plurality of calculation results of the time difference.

[0283] (5) The light detection device according to any one of (1) to (4), wherein:

[0284] The first correction information generated by the first correction unit includes absolute time information based on the timing of light emission instructions to the plurality of light emitting elements.

[0285] (6) The light detection device according to any one of (1) to (5), wherein:

[0286] The first correction unit generates the first correction information based on an average value of light reception timings when the plurality of first light receiving elements receive the first light pulse signal a plurality of times and a time difference in light reception timing of the first light pulse signal between the plurality of first light receiving elements.

[0287] (7) The light detection device according to any one of (1) to (6), wherein:

[0288] The first time difference calculation unit calculates the time difference for each of the plurality of light emitting elements.

[0289] The first correction section generates the first correction information for each of the plurality of light emitting elements.

[0290] (8) The light detection device according to any one of (1) to (7), wherein:

[0291] The light detection device includes a signal monitoring unit that monitors at least one of a maximum signal intensity, a pulse width, a rising edge timing, a falling edge timing, and a conversion rate of a plurality of the first light pulse signals received by the plurality of first light receiving elements.

[0292] The first correction unit generates the first correction information based on a monitoring result in the signal monitoring unit.

[0293] (9) The light detection device according to any one of (1) to (8), wherein:

[0294] The photodetection device includes a light emission control unit configured to individually control at least one of light emission timing and light emission pulse waveform of the plurality of light emitting elements based on the first correction information.

[0295] (10) The light detection device according to (8), wherein:

[0296] The light detection device includes a light emission control unit that controls at least one of the maximum signal intensity, pulse width, rising edge timing, falling edge timing, and conversion rate of the first light pulse signal for each of the plurality of light emitting elements based on the first correction information.

[0297] (11) The light detection device according to any one of (1) to (10), wherein:

[0298] The photodetection device includes a distance measuring unit that measures the distance to the object based on the light emission timings of the plurality of light emitting elements corrected according to the first correction information and the light reception timings of the reflected light pulse signals in the plurality of second light receiving elements.

[0299] (12) The light detection device according to any one of (1) to (10), wherein:

[0300] The photodetection device includes a photon counting unit configured to count received photons based on the first light pulse signals emitted by the plurality of light emitting elements corrected based on the first correction information.

[0301] (13) The light detection device according to any one of (1) to (12), wherein:

[0302] The light detection device comprises a light source for emitting a second light pulse signal.

[0303] The plurality of first light receiving elements and the plurality of second light receiving elements are arranged at positions capable of receiving the second optical pulse signal.

[0304] (14) The light detection device according to (13), wherein:

[0305] Before the plurality of light emitting elements and the plurality of second light receiving elements measure the distance to the object, the light source intermittently emits the second light pulse signal a plurality of times.

[0306] (15) The light detection device according to (13) or (14), wherein the light detection device comprises:

[0307] a second time difference calculation unit that calculates a time difference in timings at which the plurality of first light receiving elements and the plurality of second light receiving elements respectively receive the second light pulse signal; and

[0308] The second correction section generates second correction information for performing time difference correction of light reception timings of the plurality of second light receiving elements based on the time difference calculated by the second time difference calculation section.

[0309] (16) The light detection device according to (15), wherein:

[0310] The second time difference calculation unit calculates the time difference based on a result of repeatedly performing a plurality of light receptions of the second light pulse signal in the plurality of first light receiving elements and the plurality of second light receiving elements.

[0311] The second correction unit generates the second correction information based on the plurality of time differences.

[0312] (17) The light detection device according to (15) or (16), wherein:

[0313] The second correction section generates the second correction information for correcting relative light reception timings among the plurality of second light receiving elements.

[0314] (18) The light detection device according to any one of (15) to (17), wherein:

[0315] The light detection device includes a distance measuring unit that measures the distance to the object based on the light emission timing of the multiple light emitting elements corrected according to the first correction information and the light reception timing of the reflected light pulse signal in the multiple second light receiving elements corrected according to the second correction information.

[0316] (19) The light detection device according to any one of (1) to (17), wherein:

[0317] The light detection device includes a plurality of optical switches, and the plurality of optical switches switch whether to allow the first optical pulse signals emitted by the plurality of light emitting elements to enter the corresponding optical waveguides.

[0318] Two or more optical switches connected to the same optical waveguide are turned on in sequence, so that the first optical pulse signal emitted by the corresponding light emitting element is incident on the optical waveguide,

[0319] The first correction unit generates the first correction information after the plurality of first light pulse signals emitted by all of the plurality of light emitting elements are received by the plurality of first light receiving elements.

[0320] The method of the present disclosure is not limited to the above-mentioned embodiments, but also includes various modifications that can be thought of by those skilled in the art, and the effect of the present disclosure is not limited to the above-mentioned contents. That is, various additions, changes and partial deletions can be made within the scope of the conceptual ideas and the main purpose of the present disclosure derived from the contents specified in the claims and their equivalents.

[0321] Description of Reference Numerals

[0322] 1: light detection device; 2: distance measurement system; 3: light emitting unit; 3a: first chip; 3b: second chip; 4: overall control unit; 5: light emitting element; 6: light source; 7: drive circuit; 8: clock generation unit; 9: light emitting control unit; 9a: light peak intensity adjustment register; 9b: rising edge timing adjustment register; 9c: falling edge timing adjustment register; 9d: conversion rate adjustment register; 9e: optical switch individual control register; 10: object; 11: pixel array unit; 11a: reference pixel array unit; 11b : Distance measurement pixel array unit; 12: Distance measurement processing unit; 12a: Image processing unit; 13: Control unit; 14: Clock generation unit; 15: Light emission timing control unit; 16: Driving circuit; 18: Reference pixel; 19: Optical waveguide; 20: Distance measurement pixel; 21: Time to digital converter (TDC); 22: Histogram generation unit; 23: Signal processing unit; 23a: Distance measurement unit; 23b: First time difference calculation unit; 23c: First correction unit; 23d: Signal monitoring unit; 23e: Second time difference calculation unit; 23f: Second Correction unit; 24: VCSEL array; 25: light receiving unit; 26: Cu-Cu junction; 27: optical switch; 28: output buffer; 29: ranging control unit; 29a: signal processing control unit; 30: second light receiving element; 30: light receiving element; 31: virtual pixel; 32: silicon layer; 33: silicon nitride layer; 34: silicon layer; 35: silicon layer; 35: substrate; 36: silicon nitride layer; 37: silicon layer; 38: VCSEL substrate; 39: LDD substrate; 40: laminated film; 41: active layer; 42 : cathode electrode; 42a: opening; 43: GaAs layer; 44: cathode electrode; 45: resin part; 46: solder pad; 47: solder pad; 48: column; 49: nickel layer; 50: solder layer; 51: gold layer; 52: substrate; 52: base material layer; 53: insulating layer; 54: metal light-shielding layer; 55: light-transmitting layer; 56: covering layer; 57: grating coupler; 58: grating coupler; 59: Bragg reflector; 60: light-shielding wall; 61: optical switch control unit; 62: optical switch drive circuit; 63: memory.

Claims

1. A light detection device comprising: A plurality of light emitting elements emit a first light pulse signal; A plurality of optical waveguides for transmitting the first optical pulse signals respectively emitted by the plurality of light emitting elements; a plurality of first light receiving elements, receiving the first light pulse signals transmitted in the plurality of optical waveguides; A plurality of second light receiving elements, receiving reflected light pulse signals after the first light pulse signals respectively emitted by the plurality of light emitting elements are reflected by an object; a first time difference calculation unit that calculates a time difference in light emission timing of the plurality of light emitting elements based on a light reception timing of the first light pulse signal in the plurality of first light receiving elements; as well as The first correction unit generates first correction information for correcting the time difference of the light emission timings of the plurality of light emitting elements based on the time difference calculated by the first time difference calculation unit.

2. The light detection device according to claim 1, wherein: The plurality of light emitting elements are arranged in plurality in the first direction and in plurality in the second direction, The plurality of light emitting elements arranged in the second direction allow the first optical pulse signal to be incident on the respective different optical waveguides, The plurality of light emitting elements arranged in the first direction respectively cause the first light pulse signal to be incident on the corresponding optical waveguide at a staggered time.

3. The light detection device according to claim 2, wherein: Two or more intermittently arranged light emitting elements among the plurality of light emitting elements arranged in the second direction emit the first light pulse signal simultaneously, The plurality of light emitting elements arranged in the first direction sequentially cause the first optical pulse signal to be incident on the corresponding optical waveguide in the order in which they are arranged in the first direction.

4. The light detection device according to claim 1, wherein: The first time difference calculation unit calculates the time difference based on the result that the plurality of first light receiving elements repeatedly receive the light of the first light pulse signal a plurality of times. The first correction unit generates the first correction information based on a plurality of calculation results of the time difference.

5. The light detection device according to claim 1, wherein: The first correction information generated by the first correction unit includes absolute time information based on the timing of light emission instructions to the plurality of light emitting elements.

6. The light detection device according to claim 1, wherein: The first correction unit generates the first correction information based on an average value of light reception timings when the plurality of first light receiving elements receive the first light pulse signal a plurality of times and a time difference in light reception timing of the first light pulse signal between the plurality of first light receiving elements.

7. The light detection device according to claim 1, wherein The first time difference calculation unit calculates the time difference for each of the plurality of light emitting elements. The first correction section generates the first correction information for each of the plurality of light emitting elements.

8. The light detection device according to claim 1, wherein The light detection device includes a signal monitoring unit that monitors at least one of a maximum signal intensity, a pulse width, a rising edge timing, a falling edge timing, and a conversion rate of a plurality of the first light pulse signals received by the plurality of first light receiving elements. The first correction unit generates the first correction information based on a monitoring result in the signal monitoring unit.

9. The light detection device according to claim 1, wherein: The photodetection device includes a light emission control unit configured to individually control at least one of light emission timing and light emission pulse waveform of the plurality of light emitting elements based on the first correction information.

10. The light detection device according to claim 8, wherein: The light detection device includes a light emission control unit that controls at least one of the maximum signal intensity, pulse width, rising edge timing, falling edge timing, and conversion rate of the first light pulse signal for each of the plurality of light emitting elements based on the first correction information.

11. The light detection device according to claim 1, wherein: The photodetection device includes a distance measuring unit that measures the distance to the object based on the light emission timings of the plurality of light emitting elements corrected according to the first correction information and the light reception timings of the reflected light pulse signals in the plurality of second light receiving elements.

12. The light detection device according to claim 1, wherein The photodetection device includes a photon counting unit configured to count received photons based on the first light pulse signals emitted by the plurality of light emitting elements corrected based on the first correction information.

13. The light detection device according to claim 1, wherein The light detection device comprises a light source for emitting a second light pulse signal. The plurality of first light receiving elements and the plurality of second light receiving elements are arranged at positions capable of receiving the second optical pulse signal.

14. The light detection device according to claim 13, wherein: Before the plurality of light emitting elements and the plurality of second light receiving elements measure the distance to the object, the light source intermittently emits the second light pulse signal a plurality of times.

15. The light detection device according to claim 13, comprising: a second time difference calculation unit that calculates a time difference in timings at which the plurality of first light receiving elements and the plurality of second light receiving elements respectively receive the second light pulse signal; and The second correction section generates second correction information for performing time difference correction of light reception timings of the plurality of second light receiving elements based on the time difference calculated by the second time difference calculation section.

16. The light detection device according to claim 15, wherein: The second time difference calculation unit calculates the time difference based on a result of repeatedly performing a plurality of light receptions of the second light pulse signal in the plurality of first light receiving elements and the plurality of second light receiving elements. The second correction unit generates the second correction information based on the plurality of time differences.

17. The light detection device according to claim 15, wherein: The second correction section generates the second correction information for correcting relative light reception timings among the plurality of second light receiving elements.

18. The light detection device according to claim 15, wherein: The light detection device includes a distance measuring unit that measures the distance to the object based on the light emission timing of the multiple light emitting elements corrected according to the first correction information and the light reception timing of the reflected light pulse signal in the multiple second light receiving elements corrected according to the second correction information.

19. The light detection device according to claim 1, wherein: The light detection device includes a plurality of optical switches, and the plurality of optical switches switch whether to allow the first optical pulse signals emitted by the plurality of light emitting elements to enter the corresponding optical waveguides. Two or more optical switches connected to the same optical waveguide are turned on in sequence, so that the first optical pulse signal emitted by the corresponding light emitting element is incident on the optical waveguide, The first correction unit generates the first correction information after the plurality of first light pulse signals emitted by all of the plurality of light emitting elements are received by the plurality of first light receiving elements.

Citation Information

Cited By

  • Laser range finder temperature compensation method, system, equipment and medium

    CN120558167A

  • Method and device for activating a SPAD-based LIDAR sensor and surroundings detection system

    US12768961B2