Light receiving device, distance measuring device, and method for controlling a light receiving device

Abstract

This light receiving device comprises a light receiving unit and a control unit. The light receiving unit has: a first light receiving element for receiving light having been emitted from a first light emitting element; and a second light receiving element that is disposed adjacent to the first light emitting element and that receives light having been emitted from a second light emitting element which shares an anode terminal or a cathode terminal with the first light emitting element. The control unit controls the first light receiving element and the second light receiving element so as to cause the first light receiving element and the second light receiving element to receive light when the first light receiving element emits light.

Description

[Technical Field]

[0001] The present disclosure relates to a light receiving device, a distance measuring device, and a method for controlling a light receiving device. [Background technology]

[0002] Conventionally, there are distance measuring devices such as LiDAR (Light Detection and Ranging) that measure the distance to a target object, which is a reflector, by emitting laser light to the outside and receiving reflected light. In this type of distance measuring device, an abnormality in a light emitting element that emits laser light may be detected by a change in the voltage value applied to the light emitting element (for example, see Patent Document 1). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2017-208195 Summary of the Invention [Problem to be solved by the invention]

[0004] However, in the conventional technology, when a plurality of light-emitting elements share an anode terminal or a cathode terminal, there is a problem in that it is not possible to detect an abnormality in the light-emitting element.

[0005] Therefore, the present disclosure proposes a light receiving device, a distance measuring device, and a method for controlling a light receiving device that can detect an abnormality in a light emitting element when multiple light emitting elements share an anode terminal or a cathode terminal. [Means for solving the problem]

[0006] In order to solve the above-described problems, a light receiving device according to an embodiment of the present disclosure includes a light receiving unit having a first light receiving element that receives light emitted by a first light emitting element, and a second light receiving element that receives light emitted by a second light emitting element that is disposed adjacent to the first light emitting element and shares an anode terminal or a cathode terminal with the first light emitting element; Departure a control unit that controls the first light receiving element and the second light receiving element so that, when a light element emits light, the first light receiving element and the second light receiving element receive the light; a determination unit that, when light is detected by both the first light-receiving element and the second light-receiving element when the first light-emitting element emits light, determines that the anode terminal or the cathode terminal shared by the first light-emitting element and the second light-emitting element is short-circuited between the first light-emitting element and the second light-emitting element; Equipped with. [Brief explanation of the drawings]

[0007] [Figure 1] 1 is a block diagram showing a schematic configuration example of a ToF sensor as a distance measuring device according to an embodiment of the present invention. FIG. [Figure 2] FIG. 2 is a diagram for explaining an optical system of the ToF sensor according to the embodiment. [Figure 3] FIG. 2 is a block diagram illustrating a schematic configuration example of a light receiving unit according to the present embodiment. [Figure 4] 1 is a schematic diagram showing an example of the schematic configuration of an LD array and a SPAD array according to the present embodiment. [Figure 5] FIG. 2 is a circuit diagram showing a schematic configuration example of a SPAD pixel according to the present embodiment. [Figure 6] FIG. 2 is a block diagram showing a more detailed configuration example of a SPAD addition unit according to the present embodiment. [Figure 7] FIG. 10 is a diagram showing a histogram generated by a calculation unit. [Figure 8] 3A and 3B are diagrams illustrating a light-emitting pattern of a light-emitting unit and a light-receiving pattern of a light-receiving unit. [Figure 9] FIG. 9 is a diagram illustrating the process of pattern 2-1 in FIG. 8. [Figure 10] FIG. 10 is a diagram illustrating an example of a pattern selection method. [Figure 11] FIG. 9 is a diagram illustrating the process of pattern 2-2 in FIG. 8. [Figure 12] FIG. 10 is a diagram illustrating an example of a pattern selection method. [Figure 13]3A and 3B are diagrams illustrating a light-emitting pattern of a light-emitting unit and a light-receiving pattern of a light-receiving unit. [Figure 14] FIG. 14 is a diagram illustrating the process of pattern 2-1 in FIG. 13. [Figure 15] FIG. 2 is a schematic diagram showing an example of the schematic configuration of an LD array. [Figure 16] FIG. 2 is a schematic diagram showing an example of a light receiving pattern in a SPAD array. [Figure 17] FIG. 2 is a schematic diagram showing an example of a light receiving pattern in a SPAD array. [Figure 18] 10 is a flowchart showing the procedure of the overall process executed by the ToF sensor. [Figure 19] 10 is a flowchart showing a processing procedure in the event of a failure. [Figure 20] 1 is a block diagram showing an example of a schematic configuration of a vehicle control system; [Figure 21] FIG. 2 is an explanatory diagram showing an example of the installation positions of an outside-vehicle information detection unit and an imaging unit. DETAILED DESCRIPTION OF THE INVENTION

[0008] Hereinafter, embodiments of the present disclosure will be described in detail with reference to the drawings. In the following embodiments, the same components are designated by the same reference numerals, and redundant description will be omitted.

[0009] In addition, in this specification and drawings, multiple components having substantially the same functional configuration may be distinguished by adding different numbers after the same reference numeral. However, when there is no particular need to distinguish between multiple components having substantially the same functional configuration, only the same reference numeral is used.

[0010] The explanation will be given in the following order. 1. Embodiment 1.1 Ranging device (ToF sensor) 1.2 Optical system 1.3 Light receiving part 1.4 LD array and SPAD array 1.5 SPAD pixels 1.6 Example of SPAD pixel operation 1.7 SPAD Adder 1.8 Sampling Period 1.9 Histogram 1.10 Anomaly detection method (1) 1.11 Anomaly detection method (2) 1.12 Anomaly detection method (3) 1.13 Anomaly detection method (4) 2. Application Examples 3. Summary

[0011] 1. Embodiment First, the embodiment will be described in detail below with reference to the drawings.

[0012] 1.1 Ranging device (ToF sensor) Fig. 1 is a block diagram showing a schematic configuration example of a ToF sensor as a distance measuring device according to this embodiment. As shown in Fig. 1, the ToF sensor 1 includes a control unit 11, a light emitting unit 13, a light receiving unit 14, a calculation unit 15, and an external interface (I / F) 19. The control unit 11, the light receiving unit 14, and the calculation unit 15 are included in a light receiving device 2.

[0013] The control unit 11 is configured with an information processing device such as a CPU (Central Processing Unit), and controls each unit of the ToF sensor 1. The control unit 11 also controls distance measurement by reading out a detection signal from the light receiving unit 14. The control unit 11 also has a determination unit 111 that determines whether the light emitting unit 13 is abnormal.

[0014] The external I / F 19 may be, for example, a communication adapter for establishing communication with an external host 80 via a communication network conforming to any standard such as a wireless LAN (Local Area Network), a wired LAN, a CAN (Controller Area Network), a LIN (Local Interconnect Network), or FlexRay (registered trademark).

[0015] Here, for example, when the ToF sensor 1 is mounted on a moving body such as an automobile, the host 80 may be an ECU (Engine Control Unit) mounted on the automobile, etc. Furthermore, when the ToF sensor 1 is mounted on an autonomous moving body such as an autonomous moving robot such as a domestic pet robot, a robot vacuum cleaner, an unmanned aerial vehicle, or a follow-up transport robot, the host 80 may be a control device that controls the autonomous moving body.

[0016] The light-emitting unit 13, the details of which will be described later, includes, for example, semiconductor laser diodes, which are a plurality of light-emitting elements arranged in a one-dimensional array along the vertical direction, as light sources, and emits pulsed laser light L1 with a predetermined duration at a predetermined cycle (also referred to as a light emission cycle). The light-emitting unit 13 also emits laser light L1 with a duration of 1 ns (nanosecond) at a cycle of 1 MHz (megahertz). For example, if an object 90 is present within the distance measurement range, the laser light L1 emitted from the light-emitting unit 13 is reflected by the object 90 and enters the light-receiving unit 14 as reflected light L2.

[0017] The light receiving unit 14, the details of which will be described later, includes, for example, a two-dimensional lattice-like arrangement of SPAD pixels, which are light receiving elements that receive light from a plurality of semiconductor laser diodes, and outputs information (e.g., equivalent to the number of detection signals described below) relating to the number of SPAD pixels that detect the incidence of photons after emission of light by the light emitting unit 13 (hereinafter referred to as the detection number). For example, the light receiving unit 14 detects the incidence of photons at a predetermined sampling period for each emission of light by the light emitting unit 13, and outputs the detection number.

[0018] The calculation unit 15 counts the detection counts output from the light receiving unit 14 for each of multiple SPAD pixels (e.g., corresponding to one or more macro pixels described below), and creates a histogram with the time of flight on the horizontal axis and the cumulative pixel value on the vertical axis based on the pixel values ​​obtained by this counting. For example, the calculation unit 15 counts the detection counts at a predetermined sampling frequency for each light emission from the light emitting unit 13 to obtain pixel values, repeatedly performing this process for multiple light emissions from the light emitting unit 13, to create a histogram with the horizontal axis (histogram bins) representing the sampling period corresponding to the time of flight and the vertical axis representing the cumulative pixel value obtained by accumulating the pixel values ​​obtained at each sampling period.

[0019] Furthermore, the calculation unit 15 performs a predetermined filtering process on the created histogram, and then identifies the time-of-flight at which the cumulative pixel value peaks from the filtered histogram. Then, the calculation unit 15 calculates the distance from the ToF sensor 1 or a device equipped with the same to an object 90 present within the ranging range based on the identified time-of-flight. Note that information on the distance calculated by the calculation unit 15 may be output to the host 80 or the like via the external I / F 19, for example.

[0020] 1.2 Optical system 2 is a diagram for explaining the optical system of the ToF sensor according to this embodiment, which is a so-called scanning type optical system that scans the angle of view of the light receiving unit 14 in the horizontal direction.

[0021] 2, the ToF sensor 1 includes, as an optical system, an LD array 131, a collimator lens 132, a half mirror 133, a galvanometer mirror 135, a light-receiving lens 146, and a SPAD array 141. The LD array 131, the collimator lens 132, the half mirror 133, and the galvanometer mirror 135 are included in, for example, the light-emitting unit 13 in FIG. 1. The light-receiving lens 146 and the SPAD array 141 are included in, for example, the light-receiving unit 14 in FIG. 1.

[0022] In the configuration shown in FIG. 2, the laser light L1 emitted from the LD array 131 is converted by the collimator lens 132 into rectangular parallel light whose cross-sectional intensity spectrum is elongated in the vertical direction, and then enters the half mirror 133. The half mirror 133 reflects a portion of the incident laser light L1. The laser light L1 reflected by the half mirror 133 enters the galvanometer mirror 135. The galvanometer mirror 135 is oscillated in the horizontal direction around a predetermined rotation axis by a driver 134 operating under control of the control unit 11, for example. This causes the laser light L1 to be horizontally scanned such that the angle of view SR of the laser light L1 reflected by the galvanometer mirror 135 horizontally scans the distance measurement range AR back and forth. In other words, the driver 134 and the galvanometer mirror 135 function as a scanner that scans the light emitted from the LD array 131 in the horizontal direction. The driver 134 may be a microelectromechanical system (MEMS), a micromotor, or the like.

[0023] The laser light L1 reflected by the galvanometer mirror 135 is reflected by an object 90 present within the distance measurement range AR and enters the galvanometer mirror 135 as reflected light L2. A portion of the reflected light L2 that enters the galvanometer mirror 135 passes through the half mirror 133 and enters the light receiving lens 146, whereby it is imaged on a specific SPAD array 142 in the SPAD array 141. The SPAD array 142 may be the entire SPAD array 141 or a part of it.

[0024] 1.3 Light receiving part 3 is a block diagram showing a schematic configuration example of the light receiving unit according to this embodiment. As shown in FIG. 3, the light receiving unit 14 includes a SPAD array 141, a timing control circuit 143, a drive circuit 144, and an output circuit 145.

[0025] The SPAD array 141 includes a plurality of SPAD pixels 20 arranged in a two-dimensional lattice. A pixel drive line LD (vertical in the drawing) is connected to each column of the plurality of SPAD pixels 20, and an output signal line LS (horizontal in the drawing) is connected to each row of the SPAD pixels 20. One end of the pixel drive line LD is connected to an output terminal of the drive circuit 144 corresponding to each column, and one end of the output signal line LS is connected to an input terminal of the output circuit 145 corresponding to each row.

[0026] In this embodiment, the reflected light L2 is detected using all or part of the SPAD array 141. The area to be used in the SPAD array 141 (SPAD array 142) may be a rectangle elongated in the vertical direction, the same as the image of the reflected light L2 formed on the SPAD array 141 when the entire laser light L1 is reflected as the reflected light L2. However, without being limited to this, the area may be variously modified, such as being larger or smaller than the image of the reflected light L2 formed on the SPAD array 141.

[0027] The drive circuit 144 includes a shift register, an address decoder, etc., and drives each SPAD pixel 20 of the SPAD array 141, for example, all pixels at the same time or column by column. Therefore, the drive circuit 144 includes at least a circuit that applies a quench voltage V_QCH (described later) to each SPAD pixel 20 in a selected column in the SPAD array 141, and a circuit that applies a selection control voltage V_SEL (described later) to each SPAD pixel 20 in the selected column. The drive circuit 144 then applies the selection control voltage V_SEL to the pixel drive line LD corresponding to the column to be read out, thereby selecting, column by column, the SPAD pixels 20 to be used to detect incident photons.

[0028] The signals (called detection signals) V_OUT output from each SPAD pixel 20 in the column selected and scanned by the drive circuit 144 are input to the output circuit 145 through the output signal lines LS. The output circuit 145 outputs the detection signals V_OUT input from each SPAD pixel 20 to a SPAD adder 40 provided for each macro pixel, which will be described later.

[0029] The timing control circuit 143 includes a timing generator that generates various timing signals, and controls the drive circuit 144 and the output circuit 145 based on the various timing signals generated by the timing generator.

[0030] 1.4 LD array and SPAD array FIG. 4 is a schematic diagram showing an example of the schematic configuration of an LD array and a SPAD array according to this embodiment. As shown in FIG. 4, the LD array 131 has, for example, a configuration in which a plurality of semiconductor laser diodes, LDs 131-1 to 131-8, mounted on a substrate 1310 are arranged in a one-dimensional array along the vertical direction. In other words, the LD array 131 has, for example, LDs 131-1 to 131-8 arranged adjacent to each other in order along the vertical direction. The LDs 131-1 to 131-8 each have one anode terminal 1311 to 1318 and share one cathode terminal 1319. Note that this embodiment describes an example in which the LDs 131-1 to 131-8 share one cathode terminal 1319, but the LDs 131-1 to 131-8 may also share one anode terminal. Also, this embodiment describes an example in which the LD array 131 has eight LDs, but the number of LDs may be any number.

[0031] The SPAD array 142 has, for example, a configuration in which a plurality of SPAD pixels 20 are arranged in a two-dimensional lattice pattern. The plurality of SPAD pixels 20 are grouped into a plurality of macro pixels 30, each of which is made up of a predetermined number of SPAD pixels 20 arranged in the row and / or column directions. The shape of the area formed by connecting the outer edges of the SPAD pixels 20 located at the outermost periphery of each macro pixel 30 forms a predetermined shape (for example, a rectangle).

[0032] The SPAD array 142 is configured with a plurality of macro pixels 30 arranged in, for example, the vertical direction (corresponding to the column direction). In this embodiment, the SPAD array 142 is divided into a plurality of regions (hereinafter referred to as SPAD regions) in, for example, the vertical direction. In the example shown in FIG. 4, the SPAD array 142 is divided into eight SPAD regions 142-1 to 142-8, each of which receives laser light emitted by LDs 131-1 to 131-8. The uppermost SPAD region 142-1 corresponds to, for example, the topmost 1 / 8 region in the angle of view SR of the SPAD array 142, and receives the laser light emitted by the LD 131-1. Similarly, the SPAD region 142-2 below it corresponds to, for example, the second 1 / 8 region from the top in the angle of view SR, and receives the laser light emitted by the LD 131-2. Similarly, the SPAD regions 142-3 to 142-8 each correspond to a 1 / 8 region in the angle of view SR, and receive the laser beams emitted by the LDs 131-3 to 131-8.

[0033] 1.5 SPAD pixels Fig. 5 is a circuit diagram showing a schematic configuration example of a SPAD pixel according to this embodiment. As shown in Fig. 5, a SPAD pixel 20 includes a photodiode 21 as a light receiving element and a readout circuit 22 that detects that a photon has been incident on the photodiode 21. When a photon is incident on the photodiode 21 while a reverse bias voltage V_SPAD equal to or greater than the breakdown voltage is applied between the anode and cathode of the photodiode 21, the photodiode 21 generates an avalanche current.

[0034] The readout circuit 22 includes a quench resistor 23, a digital converter 25, an inverter 26, a buffer 27, and a selection transistor 24. The quench resistor 23 is configured, for example, by an N-type MOSFET (Metal Oxide Semiconductor Field Effect Transistor, hereinafter referred to as an NMOS transistor), with its drain connected to the anode of the photodiode 21 and its source grounded via the selection transistor 24. A quench voltage V_QCH that is preset to cause the NMOS transistor to function as a quench resistor is applied to the gate of the NMOS transistor that constitutes the quench resistor 23 from the drive circuit 144 via the pixel drive line LD.

[0035] In this embodiment, the photodiode 21 is a SPAD. A SPAD is an avalanche photodiode that operates in Geiger mode when a reverse bias voltage equal to or greater than the breakdown voltage is applied between its anode and cathode, and is capable of detecting the incidence of a single photon.

[0036] The digital converter 25 includes a resistor 251 and an NMOS transistor 252. The drain of the NMOS transistor 252 is connected to the power supply voltage VDD via the resistor 251, and the source is grounded. The voltage at the connection point N1 between the anode of the photodiode 21 and the quench resistor 23 is applied to the gate of the NMOS transistor 252.

[0037] The inverter 26 includes a P-type MOSFET (hereinafter referred to as a PMOS transistor) 261 and an NMOS transistor 262. The drain of the PMOS transistor 261 is connected to a power supply voltage VDD, and the source of the PMOS transistor 261 is connected to the drain of the NMOS transistor 262. The drain of the NMOS transistor 262 is connected to the source of the PMOS transistor 261, and the source of the NMOS transistor 262 is grounded. The voltage of the connection point N2 between the resistor 251 and the drain of the NMOS transistor 252 is applied to the gate of the PMOS transistor 261 and the gate of the NMOS transistor 262, respectively. The output of the inverter 26 is input to a buffer 27.

[0038] The buffer 27 is a circuit for impedance conversion, and when the output signal from the inverter 26 is input, the buffer 27 converts the impedance of the input output signal and outputs it as a detection signal V_OUT.

[0039] The selection transistor 24 is, for example, an NMOS transistor, and its drain is connected to the source of the NMOS transistor that constitutes the quench resistor 23, and its source is grounded. The selection transistor 24 is connected to the drive circuit 144, and when a selection control voltage V_SEL from the drive circuit 144 is applied to the gate of the selection transistor 24 via the pixel drive line LD, the selection transistor 24 changes from an off state to an on state.

[0040] 1.6 Example of SPAD pixel operation 5 operates, for example, as follows: First, while the selection control voltage V_SEL is applied from the drive circuit 144 to the selection transistor 24 and the selection transistor 24 is in the on state, a reverse bias voltage V_SPAD equal to or greater than the breakdown voltage is applied to the photodiode 21. This allows the photodiode 21 to operate.

[0041] On the other hand, when the selection control voltage V_SEL is not applied from the drive circuit 144 to the selection transistor 24 and the selection transistor 24 is in the off state, the reverse bias voltage V_SPAD is not applied to the photodiode 21, and therefore the operation of the photodiode 21 is prohibited.

[0042] When a photon is incident on the photodiode 21 while the selection transistor 24 is in the ON state, an avalanche current is generated in the photodiode 21. This causes the avalanche current to flow through the quench resistor 23, increasing the voltage at the node N1. When the voltage at the node N1 becomes higher than the ON voltage of the NMOS transistor 252, the NMOS transistor 252 turns ON, and the voltage at the node N2 changes from the power supply voltage VDD to 0 V. When the voltage at the node N2 changes from the power supply voltage VDD to 0 V, the PMOS transistor 261 changes from the OFF state to the ON state, and the NMOS transistor 262 changes from the ON state to the OFF state, causing the voltage at the node N3 to change from 0 V to the power supply voltage VDD. As a result, a high-level detection signal V_OUT is output from the buffer 27.

[0043] Thereafter, as the voltage at the connection point N1 continues to rise, the voltage applied between the anode and cathode of the photodiode 21 becomes smaller than the breakdown voltage, which stops the avalanche current and reduces the voltage at the connection point N1. When the voltage at the connection point N1 becomes lower than the on-voltage of the NMOS transistor 252, the NMOS transistor 252 is turned off, and the output of the detection signal V_OUT from the buffer 27 stops (low level).

[0044] In this way, the readout circuit 22 outputs a high-level detection signal V_OUT during the period from the timing when a photon is incident on the photodiode 21, generating an avalanche current that turns the NMOS transistor 252 on, to the timing when the avalanche current stops and the NMOS transistor 252 turns off. The output detection signal V_OUT is input to the SPAD adder 40 for each macro pixel 30 via the output circuit 145. Therefore, each SPAD adder 40 receives detection signals V_OUT equal to the number of SPAD pixels 20 (detection number) that have detected the incidence of a photon, out of the multiple SPAD pixels 20 that make up one macro pixel 30.

[0045] 1.7 SPAD Adder 6 is a block diagram showing a more detailed configuration example of the SPAD adder according to this embodiment. The SPAD adder 40 may be included in the light receiving unit 14 or the calculation unit 15.

[0046] As shown in FIG. 6, the SPAD adder 40 includes, for example, a pulse shaping unit 41 and a light reception number counting unit 42.

[0047] The pulse shaping unit 41 shapes the pulse waveform of the detection signal V_OUT input from the SPAD array 141 via the output circuit 145 into a pulse waveform with a time width according to the operation clock of the SPAD addition unit 40 .

[0048] The light reception counting unit 42 counts the detection signal V_OUT input from the corresponding macro pixel 30 for each sampling period, thereby counting the number of SPAD pixels 20 (detection number) at which incident photons are detected for each sampling period, and outputs this count value as the pixel value of the macro pixel 30.

[0049] 1.8 Sampling Period Here, the sampling period is a period for measuring the time (time of flight) from when the light-emitting unit 13 emits the laser light L1 until the light-receiving unit 14 detects the incidence of a photon. This sampling period is set to be shorter than the light-emitting period of the light-emitting unit 13. For example, by shortening the sampling period, it becomes possible to calculate the time of flight of a photon emitted from the light-emitting unit 13 and reflected by the object 90 with higher time resolution. This means that by increasing the sampling frequency, it becomes possible to calculate the distance to the object 90 with higher ranging resolution.

[0050] For example, if the flight time from when the light emitting unit 13 emits laser light L1, when this laser light L1 is reflected by the object 90, until this reflected light L2 enters the light receiving unit 14 is t, then since the speed of light C is constant (C ≈ 300,000,000 m (meters) / s (seconds)), the distance L to the object 90 can be calculated using the following formula (1). L=C×t / 2 (1)

[0051] Therefore, if the sampling frequency is 1 GHz, the sampling period is 1 ns (nanosecond). In this case, one sampling period corresponds to 15 cm (centimeter). This indicates that the ranging resolution when the sampling frequency is 1 GHz is 15 cm. Furthermore, if the sampling frequency is doubled to 2 GHz, the sampling period becomes 0.5 ns (nanosecond), and one sampling period corresponds to 7.5 cm (centimeter). This indicates that doubling the sampling frequency can halve the ranging resolution. In this way, by increasing the sampling frequency and shortening the sampling period, it is possible to calculate the distance to object 90 with greater accuracy.

[0052] 1.9 Histogram FIG. 7 shows a histogram generated by the above-described calculation unit 15. Specifically, FIG. 7 shows a linearized histogram in which the vertical axis represents cumulative pixel values ​​and the horizontal axis represents time (time of flight). As shown in FIG. 7, when an object 90 (see FIG. 1) is present in the area detected by the ToF sensor 1, a peak P1 corresponding to the object 90, which is a reflector, appears in the histogram. The peak P1 has a peak width close to the pulse width of the laser light L1.

[0053] 1.10 Anomaly detection method (1) Fig. 8 is a diagram showing the light emission pattern of the light emitter and the light reception pattern of the light receiver. From the left, Fig. 8 shows the pattern name, the numbers of LDs 131-1 to 131-8 that are required to emit light, the numbers of SPAD areas 142-1 to 142-8 that are required to detect light, the numbers of LDs 131-1 to 131-8 that emit light in the normal case, the numbers of SPAD areas 142-1 to 142-8 that detect light in the normal case, the location of a short circuit in the abnormal case, the numbers of LDs 131-1 to 131-8 that emit light in the abnormal case, and the numbers of SPAD areas 142-1 to 142-8 that detect light in the abnormal case.

[0054] 9 is a diagram showing the processing of pattern 2-1 in FIG. 8. In the processing of pattern 2-1, the area onto which LDs 131-1 to 131-8 irradiate light is A11, and the area onto which SPAD areas 142-1 to 142-8 detect light is A12. Specifically, the control unit 11 causes LD 131-2 to emit light based on the LD light emission request, and causes SPAD areas 142-1 and 142-2 to detect light based on the SPAD detection area. In this way, when any one of LDs 131-1 to 131-8 emits light, the control unit 11 controls SPAD areas 142-1 to 142-8 so that the SPAD area that receives light from the emitting LD and the SPAD area that receives light from the LD adjacent to the emitting LD receive the light.

[0055] At this time, in a normal case where no failure occurs in the LDs 131-1 to 131-8, the LD 131-2 emits light, the SPAD area 142-2 detects the light, and the SPAD area 142-1 does not detect the light.

[0056] On the other hand, in an abnormal case where the anode terminal 1311 of LD 131-1 and the anode terminal 1312 of LD 131-2 are short-circuited, the power applied to LD 131-2 is applied equally to LD 131-1 and LD 131-2, causing both LD 131-1 and LD 131-2 to emit light. Then, both SPAD regions 142-1 and 142-2 detect light. Therefore, in the processing of pattern 2-1, if both SPAD regions 142-1 and 142-2 detect light, it is determined that the anode terminal 1311 and the anode terminal 1312 are short-circuited. Therefore, if both SPAD regions 142-1 and 142-2 detect light when LD 131-2 emits light, the determination unit 111 determines that the light-emitting unit 13 is abnormal.

[0057] Fig. 10 is a diagram showing an example of a pattern selection method. As shown in Fig. 10, by executing the processes of patterns 1, 2-1 to 7-1, and 8 as steps 1 to 8, it is possible to identify whether or not a short circuit has occurred in the anode terminals 1311 to 1318 of LDs 131-1 to 131-8, and further to identify the location where the short circuit has occurred.

[0058] In addition, since the total amount of power applied to the LD array 131 does not change between the normal case and the abnormal case, it is not possible to detect a short circuit in the LD array 131 based on the voltage value, etc. Furthermore, if the anode terminal and the cathode terminal are not common and each of the light-emitting elements has an anode terminal and a cathode terminal, it is possible to detect a short circuit based on the voltage value, etc., but it is not possible to miniaturize the LD array 131.

[0059] 1.11 Anomaly detection method (2) Fig. 11 is a diagram showing the processing of pattern 2-2 in Fig. 8. In the processing of pattern 2-2, the area onto which LDs 131-1 to 131-8 irradiate light is A11, and the area onto which SPAD areas 142-1 to 142-8 detect light is A13. Specifically, the control unit 11 causes LD 131-2 to emit light based on the LD light emission request, and causes SPAD areas 142-2 and 142-3 to detect light based on the SPAD detection areas.

[0060] At this time, in a normal case where no failure occurs in the LDs 131-1 to 131-8, the LD 131-2 emits light, the SPAD area 142-2 detects the light, and the SPAD area 142-3 does not detect the light.

[0061] On the other hand, in an abnormal case where the anode terminal 1312 of LD 131-2 and the anode terminal 1313 of LD 131-3 are short-circuited, the power applied to LD 131-2 is applied equally to LD 131-2 and LD 131-3, causing both LD 131-2 and LD 131-3 to emit light. Then, both SPAD region 142-2 and SPAD region 142-3 detect light. Therefore, when both SPAD region 142-2 and SPAD region 142-3 detect light in the processing of pattern 2-2, it is determined that the anode terminal 1312 and the anode terminal 1313 are short-circuited.

[0062] Fig. 12 is a diagram showing an example of a pattern selection method. As shown in Fig. 12, by executing the processes of patterns 1, 2-2 to 7-2, and 8 as steps 1 to 8, it is possible to identify whether or not a short circuit has occurred in the anode terminals 1311 to 1318 of LDs 131-1 to 131-8, and further to identify the location where the short circuit has occurred.

[0063] 1.12 Anomaly detection method (3) Fig. 13 is a diagram showing the light emission pattern of the light emitter and the light reception pattern of the light receiver. As in Fig. 8, Fig. 13 shows, from the left, the pattern name, the numbers of LDs 131-1 to 131-8 that are required to emit light, the numbers of SPAD areas 142-1 to 142-8 that are required to detect, the numbers of LDs 131-1 to 131-8 that emit light in the normal case, the numbers of SPAD areas 142-1 to 142-8 that detect light in the normal case, the location of a short circuit in the abnormal case, the numbers of LDs 131-1 to 131-8 that emit light in the abnormal case, and the numbers of SPAD areas 142-1 to 142-8 that detect light in the abnormal case.

[0064] Fig. 14 is a diagram showing the processing of pattern 2-1 in Fig. 13. In the processing of pattern 2-1, the area onto which LDs 131-1 to 131-8 irradiate light is A11, and the area onto which SPAD areas 142-1 to 142-8 detect light is A14. Specifically, the control unit 11 causes LD 131-2 to emit light based on the LD light emission request, and causes SPAD areas 142-1, 142-2, and 142-3 to detect light based on the SPAD detection areas.

[0065] At this time, in a normal case where no failure occurs in the LDs 131-1 to 131-8, the LD 131-2 emits light, the SPAD area 142-2 detects the light, and the SPAD areas 142-1 and 142-3 do not detect the light.

[0066] On the other hand, in an abnormal case where the anode terminal 1311 of LD 131-1 and the anode terminal 1312 of LD 131-2 are short-circuited, the power applied to LD 131-2 is applied equally to LD 131-1 and LD 131-2, causing both LD 131-1 and LD 131-2 to emit light. Then, both SPAD regions 142-1 and 142-2 detect light. Therefore, when both SPAD regions 142-1 and 142-2 detect light in the processing of pattern 2-1, it is determined that the anode terminal 1311 and the anode terminal 1312 are short-circuited.

[0067] For each pattern shown in FIG. 13, by executing the processing of Steps 1 to 8 of FIG. 10 or FIG. 12, it is possible to identify whether a short circuit has occurred in the anode terminals 1311 to 1318 of LDs 131-1 to 131-8, and further to identify the location where the short circuit has occurred.

[0068] 1.13 Anomaly detection method (4) Fig. 15 is a schematic diagram showing an example of the outline configuration of an LD array. As shown in Fig. 15, the LD array 131 may have LDs 131-11 to 131-nm arranged in a two-dimensional lattice pattern. LDs 131-11 to 131-1n adjacent in the horizontal direction (row direction) share one anode terminal 13111. Similarly, n LDs adjacent in the horizontal direction share anode terminals 13112 to 1311m for each row. LDs 131-11 to 131-m1 adjacent in the vertical direction (column direction) share one cathode terminal 13121. Similarly, m LDs adjacent in the vertical direction share cathode terminals 13122 to 1312n for each column.

[0069] Fig. 16 is a schematic diagram showing an example of a light receiving pattern in a SPAD array. As shown in Fig. 16, the SPAD array 142 is divided into, for example, m regions in the vertical direction and n regions in the horizontal direction. In the example shown in Fig. 16, the SPAD array 142 is divided into SPAD regions 142-11 to 142-mn that receive the laser beams emitted by the LDs 131-11 to 131-mn, respectively.

[0070] 16, the area onto which the LD array 131 irradiates light is A21, and the area onto which the SPAD array 142 detects light is A22. Specifically, the control unit 11 causes the LD 131-33 to emit light onto the area A21 based on the LD light emission request, and also causes the SPAD area 142-32, SPAD area 142-33, and SPAD area 142-34 corresponding to the area A22 to detect light based on the SPAD detection area, thereby detecting short circuits between horizontally adjacent anode terminals. By sequentially scanning and executing this process for all the LDs 131-11 to 131-nm and SPAD areas 142-11 to 142-mn, it is possible to detect short circuits in all the anode terminals.

[0071] Similarly, the control unit 11 causes the LD 131-33 to emit light to irradiate the area A21 based on the LD light emission request, and also causes the SPAD area 142-23, SPAD area 142-33, and SPAD area 142-43 corresponding to the area A23 to detect light based on the SPAD detection area, thereby detecting short circuits between vertically adjacent cathode terminals. By sequentially scanning and executing this process for all the LDs 131-11 to 131-nm and SPAD areas 142-11 to 142-mn, it is possible to detect short circuits in all the cathode terminals.

[0072] Note that the detection of shorts in the anode terminals corresponding to region A22 and the detection of shorts in the cathode terminals corresponding to region A23 may be performed separately, or may be performed simultaneously. FIG. 17 is a schematic diagram showing an example of a light receiving pattern in a SPAD array. As shown in FIG. 17, the control unit 11 causes the LD 131-33 to emit light to irradiate region A21 based on the LD light emission request, and causes the SPAD region 142-23, SPAD region 142-32, SPAD region 142-33, SPAD region 142-34, and SPAD region 142-43 corresponding to region A24 to detect light based on the SPAD detection region, thereby simultaneously detecting shorts between adjacent anode terminals and cathode terminals. By sequentially scanning and performing this process for all LDs 131-11 to 131-nm and SPAD regions 142-11 to 142-mn, shorts in all anode terminals and cathode terminals can be simultaneously detected.

[0073] Next, the processing procedure of the processing executed by the ToF sensor 1 will be described with reference to Fig. 18. Fig. 18 is a flowchart showing the processing procedure of the overall processing executed by the ToF sensor 1.

[0074] As shown in Fig. 18, the control unit 11 executes, for example, the patterns shown in Fig. 8 in the order shown in Fig. 10 to detect a fault (step S101). Note that the processing performed when a fault is detected will be described later.

[0075] Next, the light emitting unit 13 emits light to emit the laser light L1 (step S102).

[0076] Then, the light receiving unit 14 receives reflected light L2 that is the laser light L1 reflected by the object 90 (step S103).

[0077] Thereafter, the calculation unit 15 generates a histogram of the cumulative pixel values ​​based on the detection signal output from the light receiving unit 14 (step S104).

[0078] Then, the control unit 11 calculates the distance to the object 90 based on the generated histogram (step S105).

[0079] Next, the control unit 11 outputs the calculated distance to the host 80 (step S106), and ends the process.

[0080] Next, a processing procedure when a malfunction is detected in step S101 of Fig. 18 will be described with reference to Fig. 19. Fig. 19 is a flowchart showing the processing procedure when a malfunction occurs. It is assumed that the ToF sensor 1 is installed in a vehicle that is traveling in an autonomous driving mode.

[0081] 18, if the determination unit 111 determines that no failure that causes a short circuit in the LDs 131-1 to 131-8 has occurred (step S201: No), the control unit 11 continues the automatic operation (step S202). In other words, the process of FIG. 18 continues, and the ToF sensor 1 continues to output the distance measurement result.

[0082] In step S101, if the determination unit 111 determines that a failure has occurred in the LDs 131-1 to 131-8, causing a short circuit (step S201: Yes), the control unit 11 determines whether or not it is possible to switch from autonomous driving to driving by a passenger (step S203). Specifically, the control unit 11 notifies the passenger of a message prompting the passenger to select whether or not to switch driving by displaying on a display unit of a car navigation system or the like of the vehicle equipped with the ToF sensor 1 or by providing audio guidance, and determines whether or not it is possible to switch driving from autonomous driving to driving by a passenger based on the passenger's response to the message. Note that if a failure occurs in the LDs 131-1 to 131-8, the power applied to the LDs 131-1 to 131-8 that are to emit light is halved, resulting in a weakened light intensity and making it impossible to measure long distances. Therefore, if a failure occurs in the LDs 131-1 to 131-8, it is preferable to stop autonomous driving.

[0083] If the passenger responds to the message that driving can be switched to the passenger, the control unit 11 determines that driving can be switched from automatic driving to passenger driving (step S203: Yes) and switches from automatic driving to passenger driving (step S204).

[0084] On the other hand, if the passenger responds to the message by saying that it is not possible to switch driving to the passenger, the control unit 11 determines that it is not possible to switch driving from automatic driving to the passenger (step S203: No) and automatically stops the vehicle in which the ToF sensor 1 is installed (step S205).

[0085] As described above, when the determination unit 111 determines that the light-emitting unit 13 is abnormal while a moving body such as a vehicle is traveling in an automatic driving mode, the control unit 11 controls the moving body to switch from automatic driving to manual driving or to stop the moving body. As a result, when the light-emitting unit 13 fails, the safety of the vehicle in which the ToF sensor 1 is installed can be ensured.

[0086] 2. Application Examples The technology according to the present disclosure can be applied to various products. For example, the technology according to the present disclosure may be realized as a device mounted on any type of moving body, such as an automobile, an electric vehicle, a hybrid electric vehicle, a motorcycle, a bicycle, a personal mobility device, an airplane, a drone, a ship, a robot, a construction machine, or an agricultural machine (tractor).

[0087] 20 is a block diagram showing a schematic configuration example of a vehicle control system 7000, which is an example of a mobile object control system to which the technology according to the present disclosure can be applied. The vehicle control system 7000 includes a plurality of electronic control units connected via a communication network 7010. In the example shown in FIG. 20, the vehicle control system 7000 includes a drive system control unit 7100, a body system control unit 7200, a battery control unit 7300, an outside-vehicle information detection unit 7400, an inside-vehicle information detection unit 7500, and an integrated control unit 7600. The communication network 7010 connecting these multiple control units may be an in-vehicle communication network conforming to any standard, such as a Controller Area Network (CAN), a Local Interconnect Network (LIN), a Local Area Network (LAN), or FlexRay (registered trademark).

[0088] Each control unit includes a microcomputer that performs arithmetic processing according to various programs, a storage unit that stores the programs executed by the microcomputer or parameters used in various calculations, and a drive circuit that drives various devices to be controlled. Each control unit includes a network I / F for communicating with other control units via a communication network 7010, and a communication I / F for communicating with devices or sensors inside and outside the vehicle via wired or wireless communication. Figure 20 illustrates the functional configuration of the integrated control unit 7600, including a microcomputer 7610, a general-purpose communication I / F 7620, a dedicated communication I / F 7630, a positioning unit 7640, a beacon receiving unit 7650, an in-vehicle device I / F 7660, an audio / video output unit 7670, an in-vehicle network I / F 7680, and a storage unit 7690. Similarly, the other control units also include a microcomputer, a communication I / F, a storage unit, and the like.

[0089] The drivetrain control unit 7100 controls the operation of devices related to the drivetrain of the vehicle in accordance with various programs. For example, the drivetrain control unit 7100 functions as a control device for a driving force generating device for generating driving force for the vehicle, such as an internal combustion engine or a drive motor, a driving force transmission mechanism for transmitting driving force to the wheels, a steering mechanism for adjusting the steering angle of the vehicle, and a braking device for generating braking force for the vehicle. The drivetrain control unit 7100 may also function as a control device for an ABS (Antilock Brake System) or an ESC (Electronic Stability Control), etc.

[0090] A vehicle state detection unit 7110 is connected to the drivetrain control unit 7100. The vehicle state detection unit 7110 includes at least one of a gyro sensor that detects the angular velocity of the axial rotational motion of the vehicle body, an acceleration sensor that detects the acceleration of the vehicle, or a sensor that detects the amount of operation of the accelerator pedal, the amount of operation of the brake pedal, the steering angle of the steering wheel, the engine rotation speed, the rotation speed of the wheels, etc. The drivetrain control unit 7100 performs arithmetic processing using signals input from the vehicle state detection unit 7110, and controls the internal combustion engine, the drive motor, the electric power steering device, the brake device, etc.

[0091] Body system control unit 7200 controls the operation of various devices mounted on the vehicle body in accordance with various programs. For example, body system control unit 7200 functions as a control device for a keyless entry system, a smart key system, a power window device, or various lamps such as head lamps, backup lamps, brake lamps, turn signals, and fog lamps. In this case, radio waves transmitted from a portable device that serves as a key or signals from various switches may be input to body system control unit 7200. Body system control unit 7200 receives these radio waves or signals and controls the vehicle's door lock device, power window device, lamps, etc.

[0092] The battery control unit 7300 controls the secondary battery 7310, which is the power supply source for the drive motor, in accordance with various programs. For example, information such as battery temperature, battery output voltage, or remaining battery capacity is input to the battery control unit 7300 from a battery device equipped with the secondary battery 7310. The battery control unit 7300 performs arithmetic processing using these signals, and controls the temperature regulation of the secondary battery 7310 or a cooling device or the like provided in the battery device.

[0093] The outside vehicle information detection unit 7400 detects information outside the vehicle equipped with the vehicle control system 7000. For example, at least one of an imaging unit 7410 and an outside vehicle information detection unit 7420 is connected to the outside vehicle information detection unit 7400. The imaging unit 7410 includes at least one of a ToF (Time Of Flight) camera, a stereo camera, a monocular camera, an infrared camera, and other cameras. The outside vehicle information detection unit 7420 includes at least one of an environmental sensor for detecting the current weather or climate, or a surrounding information detection sensor for detecting other vehicles, obstacles, pedestrians, etc. around the vehicle equipped with the vehicle control system 7000.

[0094] The environmental sensor may be, for example, at least one of a raindrop sensor that detects rain, a fog sensor that detects fog, a sunshine sensor that detects the degree of sunshine, and a snow sensor that detects snowfall. The surrounding information detection sensor may be at least one of an ultrasonic sensor, a radar device, and a LIDAR (Light Detection and Ranging, Laser Imaging Detection and Ranging) device. The imaging unit 7410 and the outside vehicle information detection unit 7420 may each be provided as an independent sensor or device, or may be provided as a device in which multiple sensors or devices are integrated.

[0095] 21 is a diagram showing an example of the installation positions of the imaging unit 7410 and the vehicle exterior information detection unit 7420. The imaging units 7910, 7912, 7914, 7916, and 7918 are provided, for example, at least one of the front nose, side mirrors, rear bumper, back door, and upper part of the windshield inside the vehicle cabin of the vehicle 7900. The imaging unit 7910 provided on the front nose and the imaging unit 7918 provided on the upper part of the windshield inside the vehicle cabin mainly acquire images of the front of the vehicle 7900. The imaging units 7912 and 7914 provided on the side mirrors mainly acquire images of the sides of the vehicle 7900. The imaging unit 7916 provided on the rear bumper or back door mainly acquires images of the rear of the vehicle 7900. The imaging unit 7918 provided on the upper part of the windshield inside the vehicle cabin is mainly used to detect leading vehicles, pedestrians, obstacles, traffic lights, traffic signs, lanes, etc.

[0096] 21 shows an example of the imaging ranges of the imaging units 7910, 7912, 7914, and 7916. Imaging range a indicates the imaging range of imaging unit 7910 provided on the front nose, imaging ranges b and c indicate the imaging ranges of imaging units 7912 and 7914 provided on the side mirrors, respectively, and imaging range d indicates the imaging range of imaging unit 7916 provided on the rear bumper or back door. For example, by overlaying the image data captured by imaging units 7910, 7912, 7914, and 7916, a bird's-eye view image of vehicle 7900 viewed from above can be obtained.

[0097] The vehicle exterior information detection units 7920, 7922, 7924, 7926, 7928, and 7930 provided on the front, rear, sides, and corners of the vehicle 7900 and above the windshield inside the vehicle cabin may be, for example, ultrasonic sensors or radar devices. The vehicle exterior information detection units 7920, 7926, and 7930 provided on the front nose, rear bumper, back door, and above the windshield inside the vehicle cabin of the vehicle 7900 may be, for example, LIDAR devices. These vehicle exterior information detection units 7920 to 7930 are mainly used to detect preceding vehicles, pedestrians, obstacles, etc.

[0098] Returning to FIG. 20 , the explanation will be continued. The outside vehicle information detection unit 7400 causes the imaging unit 7410 to capture an image outside the vehicle and receives the captured image data. The outside vehicle information detection unit 7400 also receives detection information from the connected outside vehicle information detection unit 7420. If the outside vehicle information detection unit 7420 is an ultrasonic sensor, a radar device, or a LIDAR device, the outside vehicle information detection unit 7400 emits ultrasonic waves or electromagnetic waves and receives information on the received reflected waves. The outside vehicle information detection unit 7400 may perform object detection processing or distance detection processing for people, cars, obstacles, signs, text on the road, etc. based on the received information. The outside vehicle information detection unit 7400 may also perform environment recognition processing for recognizing rainfall, fog, road conditions, etc. based on the received information. The outside vehicle information detection unit 7400 may also calculate the distance to an object outside the vehicle based on the received information.

[0099] The outside vehicle information detection unit 7400 may also perform image recognition processing or distance detection processing to recognize people, vehicles, obstacles, signs, characters on the road, etc., based on the received image data. The outside vehicle information detection unit 7400 may perform processing such as distortion correction or alignment on the received image data, and may also generate an overhead image or a panoramic image by combining image data captured by different image capturing units 7410. The outside vehicle information detection unit 7400 may also perform viewpoint conversion processing using image data captured by different image capturing units 7410.

[0100] The interior information detection unit 7500 detects information inside the vehicle. A driver state detection unit 7510 that detects the state of the driver is connected to the interior information detection unit 7500, for example. The driver state detection unit 7510 may include a camera that captures an image of the driver, a biosensor that detects the driver's biometric information, or a microphone that collects sound from within the vehicle cabin. The biosensor is provided, for example, on the seat or steering wheel, and detects the biometric information of a passenger sitting in the seat or the driver gripping the steering wheel. The interior information detection unit 7500 may calculate the driver's level of fatigue or concentration, or determine whether the driver is dozing, based on the detection information input from the driver state detection unit 7510. The interior information detection unit 7500 may perform processing such as noise canceling on the collected audio signal.

[0101] The integrated control unit 7600 controls the overall operation of the vehicle control system 7000 in accordance with various programs. An input unit 7800 is connected to the integrated control unit 7600. The input unit 7800 may be implemented by a device that can be operated by a passenger, such as a touch panel, a button, a microphone, a switch, or a lever. Data obtained by voice recognition of a voice input through a microphone may be input to the integrated control unit 7600. The input unit 7800 may be, for example, a remote control device using infrared or other radio waves, or an externally connected device such as a mobile phone or a personal digital assistant (PDA) that can operate the vehicle control system 7000. The input unit 7800 may be, for example, a camera, in which case the passenger can input information by gestures. Alternatively, data obtained by detecting the movement of a wearable device worn by the passenger may be input. Furthermore, the input unit 7800 may include, for example, an input control circuit that generates an input signal based on information input by the passenger or the like using the input unit 7800 and outputs the input signal to the integrated control unit 7600. By operating this input unit 7800, passengers and the like input various data to the vehicle control system 7000 and instruct processing operations.

[0102] The storage unit 7690 may include a ROM (Read Only Memory) that stores various programs executed by the microcomputer, and a RAM (Random Access Memory) that stores various parameters, calculation results, sensor values, etc. The storage unit 7690 may also be realized by a magnetic storage device such as an HDD (Hard Disc Drive), a semiconductor storage device, an optical storage device, a magneto-optical storage device, or the like.

[0103] The general-purpose communication I / F 7620 is a general-purpose communication I / F that mediates communication between various devices present in the external environment 7750. The general-purpose communication I / F 7620 may implement a cellular communication protocol such as GSM (Global System of Mobile communications), WiMAX (registered trademark), LTE (Long Term Evolution), or LTE-Advanced (LTE-A), or other wireless communication protocols such as wireless LAN (also referred to as Wi-Fi (registered trademark)) or Bluetooth (registered trademark). The general-purpose communication I / F 7620 may connect to devices (e.g., application servers or control servers) present on an external network (e.g., the Internet, a cloud network, or an operator-specific network) via, for example, a base station or an access point. The general-purpose communication I / F 7620 may also connect to terminals present near the vehicle (e.g., terminals of drivers, pedestrians, or stores, or machine-type communication (MTC) terminals) using, for example, P2P (Peer to Peer) technology.

[0104] The dedicated communication I / F 7630 is a communication I / F that supports a communication protocol designed for use in vehicles. The dedicated communication I / F 7630 may implement a standard protocol such as WAVE (Wireless Access in Vehicle Environment), which is a combination of a lower layer IEEE802.11p and an upper layer IEEE1609, a dedicated short range communications (DSRC), or a cellular communication protocol. The dedicated communication I / F 7630 typically performs V2X communication, which is a concept including one or more of vehicle-to-vehicle communication, vehicle-to-infrastructure communication, vehicle-to-home communication, and vehicle-to-pedestrian communication.

[0105] The positioning unit 7640 performs positioning by receiving, for example, GNSS signals from GNSS (Global Navigation Satellite System) satellites (for example, GPS signals from GPS (Global Positioning System) satellites), and generates position information including the latitude, longitude, and altitude of the vehicle. Note that the positioning unit 7640 may identify the current position by exchanging signals with a wireless access point, or may obtain position information from a terminal such as a mobile phone, PHS, or smartphone that has a positioning function.

[0106] The beacon receiver 7650 receives, for example, radio waves or electromagnetic waves transmitted from radio stations or the like installed on the road, and acquires information such as the current location, congestion, road closures, required travel time, etc. The function of the beacon receiver 7650 may be included in the dedicated communication I / F 7630 described above.

[0107] The in-vehicle device I / F 7660 is a communication interface that mediates connections between the microcomputer 7610 and various in-vehicle devices 7760 present in the vehicle. The in-vehicle device I / F 7660 may establish a wireless connection using a wireless communication protocol such as wireless LAN, Bluetooth (registered trademark), NFC (Near Field Communication), or WUSB (Wireless USB). The in-vehicle device I / F 7660 may also establish a wired connection such as USB (Universal Serial Bus), HDMI (High-Definition Multimedia Interface), or MHL (Mobile High-Definition Link) via a connection terminal (and a cable, if necessary) not shown. The in-vehicle device 7760 may include, for example, at least one of a mobile device or a wearable device owned by a passenger, or an information device carried or installed in the vehicle. The in-vehicle device 7760 may also include a navigation device that searches for a route to a desired destination. The in-vehicle device I / F 7660 exchanges control signals or data signals with these in-vehicle devices 7760 .

[0108] The in-vehicle network I / F 7680 is an interface that mediates communication between the microcomputer 7610 and the communication network 7010. The in-vehicle network I / F 7680 transmits and receives signals in accordance with a predetermined protocol supported by the communication network 7010.

[0109] The microcomputer 7610 of the integrated control unit 7600 controls the vehicle control system 7000 in accordance with various programs based on information acquired via at least one of the general-purpose communication I / F 7620, the dedicated communication I / F 7630, the positioning unit 7640, the beacon receiving unit 7650, the in-vehicle device I / F 7660, and the in-vehicle network I / F 7680. For example, the microcomputer 7610 may calculate control target values ​​for the driving force generating device, the steering mechanism, or the braking device based on acquired information inside and outside the vehicle, and output control commands to the drivetrain control unit 7100. For example, the microcomputer 7610 may perform cooperative control aimed at realizing functions of an Advanced Driver Assistance System (ADAS), including vehicle collision avoidance or impact mitigation, following driving based on the following distance, vehicle speed maintenance driving, vehicle collision warning, vehicle lane departure warning, etc. In addition, the microcomputer 7610 may perform cooperative control for the purpose of autonomous driving, in which the vehicle travels autonomously without relying on driver operation, by controlling a driving force generating device, a steering mechanism, a braking device, etc. based on information acquired about the vehicle's surroundings.

[0110] The microcomputer 7610 may generate three-dimensional distance information between the vehicle and objects such as surrounding structures and people, and create local map information including information about the vicinity of the vehicle's current location, based on information acquired via at least one of the general-purpose communication I / F 7620, the dedicated communication I / F 7630, the positioning unit 7640, the beacon receiving unit 7650, the in-vehicle device I / F 7660, and the in-vehicle network I / F 7680. Furthermore, the microcomputer 7610 may predict dangers, such as a vehicle collision, the approach of a pedestrian, or entry into a closed road, based on the acquired information, and generate a warning signal. The warning signal may be, for example, a signal for generating a warning sound or turning on a warning lamp.

[0111] The audio / video output unit 7670 transmits at least one of audio and image output signals to an output device capable of visually or audibly notifying vehicle occupants or the outside of the vehicle of information. In the example of FIG. 20 , an audio speaker 7710, a display unit 7720, and an instrument panel 7730 are illustrated as output devices. The display unit 7720 may include, for example, at least one of an on-board display and a head-up display. The display unit 7720 may have an AR (Augmented Reality) display function. The output device may be other devices besides these devices, such as headphones, a wearable device such as an eyeglass-type display worn by the occupant, a projector, or a lamp. When the output device is a display device, the display device visually displays results obtained by various processes performed by the microcomputer 7610 or information received from other control units in various formats, such as text, images, tables, and graphs. When the output device is an audio output device, the audio output device converts audio signals consisting of reproduced audio data or acoustic data into analog signals and audibly outputs the analog signals.

[0112] In the example shown in FIG. 20 , at least two control units connected via the communication network 7010 may be integrated into one control unit. Alternatively, each control unit may be composed of multiple control units. Furthermore, the vehicle control system 7000 may include another control unit not shown. In the above description, some or all of the functions performed by one control unit may be performed by another control unit. In other words, as long as information is transmitted and received via the communication network 7010, predetermined arithmetic processing may be performed by one of the control units. Similarly, a sensor or device connected to one control unit may be connected to another control unit, and multiple control units may transmit and receive detection information to and from each other via the communication network 7010.

[0113] A computer program for realizing each function of the ToF sensor 1 according to this embodiment described with reference to FIG. 1 can be implemented in any control unit or the like. A computer-readable recording medium storing such a computer program can also be provided. Examples of the recording medium include a magnetic disk, an optical disk, a magneto-optical disk, and a flash memory. The computer program may also be distributed, for example, via a network without using a recording medium.

[0114] In the vehicle control system 7000 described above, the ToF sensor 1 according to this embodiment described with reference to Fig. 1 can be applied to the integrated control unit 7600 of the application example shown in Fig. 20. For example, the control unit 11, the calculation unit 15, and the external I / F 19 of the ToF sensor 1 correspond to the microcomputer 7610, the storage unit 7690, and the in-vehicle network I / F 7680 of the integrated control unit 7600. However, without being limited thereto, the vehicle control system 7000 may correspond to the host 80 in Fig. 1.

[0115] 1 may be realized in a module (for example, an integrated circuit module configured on a single die) for the integrated control unit 7600 shown in Fig. 20. Alternatively, the ToF sensor 1 described using Fig. 1 may be realized by multiple control units of the vehicle control system 7000 shown in Fig. 20.

[0116] 3. Summary As described above, according to one embodiment of the present disclosure, the light receiving device 2 according to this embodiment includes a light receiving unit 14 and a control unit 11. The light receiving unit 14 includes a first light receiving element (e.g., SPAD region 142-1) that receives light emitted by a first light emitting element (e.g., LD 131-1), and a second light receiving element (e.g., SPAD region 142-2) that is disposed adjacent to the first light emitting element and receives light emitted by a second light emitting element (e.g., LD 131-2) that shares a cathode terminal (e.g., cathode terminal 1319) with the first light emitting element. The control unit 11 controls the first light receiving element and the second light receiving element so that, when the first light receiving element emits light, the first light receiving element and the second light receiving element receive the light. This makes it possible to detect a short circuit between the anode terminal 1311 of LD 131-1 and the anode terminal 1312 of LD 131-2, which are adjacent in the vertical direction. By repeatedly executing this process as shown in Fig. 10 or 12, it is possible to detect a short circuit for all of LDs 131-1 to 131-8. Therefore, according to the light receiving device 2, when a plurality of light emitting elements share an anode terminal or a cathode terminal, it is possible to detect an abnormality in the light emitting element.

[0117] Although the embodiments of the present disclosure have been described above, the technical scope of the present disclosure is not limited to the above-described embodiments, and various modifications are possible within the scope of the gist of the present disclosure. Furthermore, components of different embodiments and modifications may be combined as appropriate.

[0118] Furthermore, the effects of each embodiment described in this specification are merely examples and are not limiting, and other effects may also be obtained.

[0119] The effects described in this specification are merely examples and are not limiting, and other effects may also be present.

[0120] The present technology can also be configured as follows. (1) a light receiving section including a first light receiving element that receives light emitted by a first light emitting element, and a second light receiving element that receives light emitted by a second light emitting element that is disposed adjacent to the first light emitting element and shares an anode terminal or a cathode terminal with the first light emitting element; a control unit that controls the first light receiving element and the second light receiving element so that, when the first light receiving element emits light, the first light receiving element and the second light receiving element receive light; A light receiving device comprising: (2) The light receiving device described in (1) above is provided with a judgment unit that judges that a light emitting unit having the first light emitting element and the second light emitting element is abnormal if the second light receiving element detects light when the first light receiving element emits light. (3) The light receiving device according to (1) or (2) above, wherein the light receiving device is installed on a moving body. (4) The light receiving device described in (3), wherein when the judgment unit determines that the light emitting unit is abnormal while the moving body is traveling in automatic driving, the control unit controls the moving body to switch from automatic driving to manual driving or to stop the moving body. (5) the light receiving unit includes a third light receiving element that is disposed adjacent to the first light emitting element and receives light emitted by a third light emitting element that shares an anode terminal or a cathode terminal with the first light emitting element; The light receiving device described in any one of (1) to (4), wherein the control unit controls the first light receiving element, the second light receiving element, and the third light receiving element so that when the first light receiving element emits light, the first light receiving element, the second light receiving element, and the third light receiving element receive the light. (6) a light-emitting section including a first light-emitting element and a second light-emitting element disposed adjacent to the first light-emitting element and sharing an anode terminal or a cathode terminal with the first light-emitting element; a light receiving section including a first light receiving element that receives light emitted by the first light emitting element and a second light receiving element that receives light emitted by the second light emitting element; a control unit that controls the first light receiving element and the second light receiving element so that, when the first light receiving element emits light, the first light receiving element and the second light receiving element receive light; A ranging device comprising: (7) A method for controlling a light receiving device including: a light receiving unit having a first light receiving element that receives light emitted by a first light emitting element; and a second light receiving element that receives light emitted by a second light emitting element that is disposed adjacent to the first light emitting element and shares an anode terminal or a cathode terminal with the first light emitting element; and a control unit that controls the light receiving unit, A control method for a light-receiving device, in which the control unit controls the first light-receiving element and the second light-receiving element so that, when the first light-receiving element emits light, the first light-receiving element and the second light-receiving element receive light. [Explanation of symbols]

[0121] 1 ToF sensor (ranging device) 2 Photodetector 11 Control section 13 Light-emitting part 14 Light receiving part 15 Arithmetic section 20 SPAD pixels 30 macro pixels 80 hosts 90 Object

Claims

1. a light receiving section including a first light receiving element that receives light emitted by a first light emitting element, and a second light receiving element that receives light emitted by a second light emitting element that is disposed adjacent to the first light emitting element and shares an anode terminal or a cathode terminal with the first light emitting element; a control unit that controls the first light receiving element and the second light receiving element so that, when the first light emitting element emits light, the first light receiving element and the second light receiving element receive the light; a determination unit that, when light is detected by both the first light-receiving element and the second light-receiving element when the first light-emitting element emits light, determines that the anode terminal or the cathode terminal shared by the first light-emitting element and the second light-emitting element is short-circuited between the first light-emitting element and the second light-emitting element; A light receiving device comprising:

2. The determination unit:

2. The light receiving device according to claim 1, wherein when the first light emitting element emits light, if the second light receiving element detects light, it determines that a light emitting unit having the first light emitting element and the second light emitting element is abnormal.

3. The light receiving device according to claim 2 , wherein the light receiving device is installed on a moving object.

4. The light receiving device according to claim 3, wherein when the determination unit determines that the light emitting unit is abnormal while the moving body is traveling in automatic driving, the control unit controls the moving body to switch from automatic driving to manual driving or to stop the moving body.

5. the light receiving unit includes a third light receiving element that is disposed adjacent to the first light emitting element and receives light emitted by a third light emitting element that shares an anode terminal or a cathode terminal with the first light emitting element; the control unit controls the first light receiving element, the second light receiving element, and the third light receiving element so that, when the first light receiving element emits light, the first light receiving element, the second light receiving element, and the third light receiving element receive light; The determination unit further 2. The light receiving device according to claim 1, wherein when the first light emitting element emits light and light is detected by the first light receiving element and the third light emitting element, it is determined that the anode terminal or the cathode terminal shared by the first light emitting element and the third light emitting element is shorted between the first light emitting element and the third light emitting element.

6. a light-emitting section including a first light-emitting element and a second light-emitting element disposed adjacent to the first light-emitting element and sharing an anode terminal or a cathode terminal with the first light-emitting element; a light receiving section including a first light receiving element that receives light emitted by the first light emitting element and a second light receiving element that receives light emitted by the second light emitting element; a control unit that controls the first light receiving element and the second light receiving element so that, when the first light receiving element emits light, the first light receiving element and the second light receiving element receive light; a determination unit that, when light is detected by both the first light-receiving element and the second light-receiving element when the first light-emitting element emits light, determines that the anode terminal or the cathode terminal shared by the first light-emitting element and the second light-emitting element is short-circuited between the first light-emitting element and the second light-emitting element; A ranging device comprising:

7. A control method for a light receiving device including a light receiving unit having a first light receiving element that receives light emitted by a first light emitting element, and a second light receiving element that receives light emitted by a second light emitting element that is disposed adjacent to the first light emitting element and shares an anode terminal or a cathode terminal with the first light emitting element, a control unit that controls the light receiving unit, and a determination unit, the control unit controls the first light receiving element and the second light receiving element so that, when the first light receiving element emits light, the first light receiving element and the second light receiving element receive light; the determination unit determines that the anode terminal or the cathode terminal shared by the first light-emitting element and the second light-emitting element is short-circuited between the first light-emitting element and the second light-emitting element when light is detected by both the first light-receiving element and the second light-receiving element when the first light-emitting element emits light; A method for controlling a light receiving device.

Images