Optical detection device and distance measurement system

By generating histograms through the array units and computing units of the optical detection device, and combining them with the fault detection unit, the problems of complex optical receiver array structure and insufficient fault diagnosis in the existing technology are solved, thus achieving efficient fault detection and improved ranging accuracy.

CN117295972BActive Publication Date: 2026-11-17SONY SEMICON SOLUTIONS CORP
View PDF 3 Cites 0 Cited by

Patent Information

Application Number
CN202280034643.0
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Priority Date
2021-05-19
Filing Date
2022-03-30
Publication Date
2026-11-17
Estimated Expiration
2042-03-30

AI Technical Summary

Technical Problem

Existing optical receiver array distance measurement systems have complex structures, and increasing the number of optical receivers reduces processing speed and lacks fault diagnosis capabilities.

Method used

An optical detection device, including an array unit, a computing unit, and a fault detection unit, is used to detect faults by generating histograms and detecting noise components in the circuit, and to diagnose faults using test mode signals.

Benefits of technology

Effective fault diagnosis improves processing speed and ranging accuracy, and simplifies system structure.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN117295972B_ABST
    Figure CN117295972B_ABST
Patent Text Reader

Abstract

[Problem] Effectively diagnose and detect faults. [Solution] A light detection device includes: an array unit having multiple light receiving regions and multiple light receiving elements arranged in each light receiving region; a calculation unit for generating a histogram relating the number of times light is received by the light receiving element in the pixel and the timing of the light reception for each pixel including at least one light receiving element contained in each of the multiple light receiving regions; and a fault detection unit for detecting faults in the calculation unit.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This disclosure relates to optical detection devices and distance measurement systems. Background Technology

[0002] Autonomous driving technology has attracted attention. In autonomous driving technology, it is necessary to accurately and quickly measure the distance to objects located near the vehicle. As a method for measuring distance, a technique has been proposed that divides the light receiving range of an array of light receiving elements arranged in an array into multiple regions, sets an optimal calculation coefficient for each region, and calculates the distance to the object (for example, see Patent Document 1).

[0003] Reference List

[0004] Patent documents

[0005] Patent Document 1: Publication 2020-118567 Summary of the Invention

[0006] Technical issues

[0007] The distance measurement system disclosed in Patent Document 1 has processing circuitry for measuring the distances of multiple regions, resulting in a complex structure. Specifically, to detect objects near a vehicle with high accuracy, it is necessary to increase the number of light-receiving elements included in the light-receiving element array. With an increase in the number of light-receiving elements included in the light-receiving element array, from the viewpoint of increasing processing speed, the number of regions obtained by dividing the light-receiving range needs to increase. With an increase in the number of regions obtained by dividing the light-receiving range, the number of processing circuitry used for measuring distances increases.

[0008] Vehicle-mounted equipment has important functional safety considerations and is initially preferably designed to include structures for performing fault diagnosis of each processing circuit arranged within the distance measurement system. However, the aforementioned Patent Document 1 does not describe fault diagnosis for the distance measurement system.

[0009] Therefore, according to this disclosure, an optical detection device and a distance measurement system capable of effectively performing fault diagnosis and fault detection are provided.

[0010] Solution to the problem

[0011] To address the aforementioned problems, according to this disclosure, a light detection apparatus includes: an array unit configured to have a plurality of light receiving regions and a plurality of light receiving elements arranged in each light receiving region; a calculation unit configured to generate a histogram relating the number of times light is received in the light receiving elements within the pixel and the timing of light reception for each pixel, including one or more light receiving elements contained in each of the plurality of light receiving regions; and a fault detection unit configured to detect faults within the calculation unit.

[0012] The calculation unit may include: a sampling circuit configured to sample the output signals of a plurality of optical receiving elements included in each of a plurality of optical receiving regions at a predetermined sampling period and output a detection signal for each pixel indicating that the plurality of optical receiving elements have received light; an adder circuit configured to generate a pixel value obtained by adding the number of detection signals for each pixel; and a histogram generation circuit configured to generate a histogram of each pixel in each of the plurality of optical receiving regions based on the pixel value generated by the adder circuit, and the fault detection unit may detect a fault in at least one of the sampling circuit, the adder circuit, and the histogram generation circuit.

[0013] The calculation unit may include: a filtering circuit configured to eliminate noise components included in a histogram generated by the histogram generation circuit; an echo detection circuit configured to measure the distance to an object by detecting the time difference until light is reflected by the object and received by the array unit based on the histogram after the noise components are eliminated using the filtering circuit; and a fault detection unit may detect a fault in at least one of the sampling circuit, the addition circuit, the histogram generation circuit, the filtering circuit, and the echo detection circuit.

[0014] The calculation unit may include a plurality of region calculation units corresponding to each of the plurality of optical receiving regions. Each of the plurality of region calculation units may include at least some of the circuits of a sampling circuit, an addition circuit, a histogram generation circuit, a filtering circuit, and an echo detection circuit. The fault detection unit may detect faults in at least some of the circuits of the sampling circuit, the addition circuit, the histogram generation circuit, the filtering circuit, and the echo detection circuit for each of the plurality of region calculation units.

[0015] The fault detection unit can input the same test mode signal to two of the multiple regional computing units, and determine that either of the two regional computing units is faulty if the output signals of the two regional computing units are different.

[0016] The fault detection unit may include: two selectors configured to select whether to input a test mode signal to the input node or internal node of the two area computing units; and a comparator configured to compare the output signals of the two area computing units with each other when the two selectors select the input of the test mode signal.

[0017] The fault detection unit may include two encoding units. When the two selectors select the input of the test mode signal, the two encoding units generate encoded data of the output signals of the two area calculation units. The comparator can compare the two encoded data generated by the two encoding units.

[0018] The calculation unit may include two or more even-numbered area calculation units, and the fault detection unit may divide the even-numbered area calculation units into two area calculation units in each group, input the same test mode signal to the two area calculation units in each group, and determine that either of the two area calculation units is faulty if the output signals of the two area calculation units are different.

[0019] The calculation unit may include three or more odd-numbered area calculation units, and the fault detection unit may use some of the area calculation units in a duplex mode to divide the odd-numbered area calculation units into multiple groups of two area calculation units, input the same test mode signal to each group of two area calculation units, and determine that either of the two area calculation units is faulty if the output signals of the two area calculation units are different.

[0020] The computing unit may include three or more of the multiple regional computing units, and the fault detection unit may input the same test mode signal to the multiple regional computing units, and determine that some regional computing units are faulty based on whether the output signals of some of the multiple regional computing units are different from the output signals of the remaining regional computing units, which are more numerous than some of the regional computing units.

[0021] Each of the multiple regional computing units may have cascaded multi-stage processing circuitry, including at least some of the following circuits: sampling circuitry, addition circuitry, histogram generation circuitry, filtering circuitry, and echo detection circuitry. The comparator may include multiple comparison units connected to the output nodes of two or more stages of processing circuitry cascaded to the selector side of each of the multiple regional computing units. Each of the multiple comparison units may compare the output signals of the output nodes of different stages of processing circuitry in the two regional computing units with each other.

[0022] The computing unit may have cascaded multi-stage processing circuits, including some of the following circuits: sampling circuit, addition circuit, histogram generation circuit, filtering circuit, and echo detection circuit. Different selectors may be connected to the input side of two or more processing circuits in the multi-stage processing circuit. Each selector may be used to select a test mode signal. Comparators may be arranged in association with each selector on the back stage of the processing circuit to which each selector is connected.

[0023] The number of pixels in the array unit can be greater than the number of pixels generated by the histogram generated by the calculation unit. The sampling circuit can output the detection signal of each pixel in the array unit. The addition circuit can generate the pixel value of each pixel whose number of pixels is less than the number of pixels in the array unit. A selector can be set between the sampling circuit and the addition circuit. During normal operation, the detection signal output from the sampling circuit is adjusted over time and input to the addition circuit. During fault diagnosis, the test mode signal is input to the addition circuit.

[0024] The number of pixels in the array unit can be greater than the number of pixels generated by the calculation unit to produce the histogram. The sampling circuit can output the detection signal of each pixel in the array unit. The addition circuit can generate the pixel value of each pixel in the array unit. The histogram generation circuit can generate a histogram for each pixel whose number of pixels is less than the number of pixels in the array unit. A selector can be arranged between the addition circuit and the histogram generation circuit. During normal operation, the pixel value generated by the addition circuit is input to the histogram generation circuit over time. During fault diagnosis, the test mode signal is input to the histogram generation circuit.

[0025] Each of the multiple regional computing units may include a computing coefficient storage unit that stores a first computing coefficient used in the computing process during normal operation and a second computing coefficient used in the computing process during fault diagnosis. The optical detection device may also include a control unit configured to perform control of selecting one of the first and second computing coefficients and providing the selected computing coefficient to the multi-level processing circuit and performing selection switching of the selector.

[0026] Each of the multiple regional computing units may have a first computing coefficient storage unit, which stores first computing coefficients used in the computing process during normal operation, and the optical detection device may further include: a second computing coefficient storage unit configured to store second computing coefficients used in the computing process during fault diagnosis; and a control unit that performs the following control: supplying first computing coefficients to the multi-level processing circuit during normal operation, and performing the following control during fault diagnosis: supplying second computing coefficients to the multi-level processing circuit, and performing selection switching of the selection unit.

[0027] It may include a timing control unit, which is configured to control the array unit and the computing unit respectively during a normal operation cycle based on the light generated by the array unit and during a fault diagnosis cycle based on the test mode signal to perform fault detection of the computing unit when the light receiving operation of the array unit is stopped.

[0028] It may include a timing control unit, which is configured to perform the following control: during the cycle in which each processing circuit inside the computing unit performs processing based on the light received by the array unit, inputting a test mode signal to the input node or internal node of the computing unit and outputting a fault diagnosis signal from the computing unit.

[0029] It may include a pattern generator configured to generate a test pattern signal that includes a time series random pattern, and the same test pattern signal may be provided to multiple regional computing units.

[0030] According to this disclosure, a distance measurement system includes: a light detection device; and a light projection unit configured to project light onto an object. Attached Figure Description

[0031] Figure 1 This is a block diagram illustrating a schematic configuration example of a ToF sensor.

[0032] Figure 2 This is a diagram illustrating the optical system of a ToF sensor according to the present disclosure.

[0033] Figure 3 This is a block diagram illustrating a schematic configuration example of an optical receiving unit according to the present disclosure.

[0034] Figure 4 This is a schematic diagram illustrating an example configuration of a SPAD array according to the present disclosure.

[0035] Figure 5 This is a circuit diagram illustrating a schematic configuration example of a SPAD pixel according to the present disclosure.

[0036] Figure 6 This is an illustration showing an example of a depth image acquired by a ToF sensor.

[0037] Figure 7 It shows that based on the responsibility Figure 7 An example illustration of a histogram generated from a frame image of the first SPAD region shown in the diagram.

[0038] Figure 8 It shows that based on the responsibility Figure 7 An example illustration of a histogram generated from a frame image acquired from the SPAD region of the fourth region shown in the diagram.

[0039] Figure 9 This is a block diagram illustrating a schematic configuration example of the computing unit according to the comparative example.

[0040] Figure 10 This is a block diagram illustrating a schematic configuration example of a computing unit.

[0041] Figure 11 This is a diagram showing the calculated coefficients.

[0042] Figure 12 This is a block diagram illustrating a schematic configuration example of a computing unit.

[0043] Figure 13 This is a diagram illustrating an example of the laminated structure of the light receiving unit and computing unit of a ToF sensor.

[0044] Figure 14 This is a diagram illustrating an example of the planar layout of the light-receiving surface of a light-receiving chip.

[0045] Figure 15 This is a diagram showing an example of a planar layout of the circuit chip on the side of the light receiving chip.

[0046] Figure 16 This is a block diagram of a light detection device according to the first embodiment.

[0047] Figure 17 This is a block diagram of a light detection device according to the second embodiment.

[0048] Figure 18 This is a block diagram of a light detection device according to the third embodiment.

[0049] Figure 19 This is a block diagram of a light detection device according to the fourth embodiment.

[0050] Figure 20 This is a block diagram of a light detection device according to the fifth embodiment.

[0051] Figure 21 This is a block diagram of a light detection device according to the sixth embodiment.

[0052] Figure 22 It is based on Figure 21 A block diagram of a modified optical detection device.

[0053] Figure 23 This is a block diagram of a light detection device according to the seventh embodiment.

[0054] Figure 24 It is based on Figure 23 A block diagram of a modified optical detection device.

[0055] Figure 25AThis is a block diagram of a light detection device according to the eighth embodiment.

[0056] Figure 25B It is shown Figure 25A The diagram shows the internal configuration of the register block.

[0057] Figure 26A This is a block diagram of a light detection device according to the ninth embodiment.

[0058] Figure 26B This is a block diagram showing the internal configuration of the register blocks arranged for each region computing unit.

[0059] Figure 27 This is an operation timing diagram of the optical detection device according to the tenth embodiment.

[0060] Figure 28 This is an operation timing diagram of the optical detection device according to the eleventh embodiment.

[0061] Figure 29 This is a block diagram of a light detection device according to the twelfth embodiment.

[0062] Figure 30 This is a block diagram of a light detection device according to the thirteenth embodiment.

[0063] Figure 31 This is a block diagram illustrating an example of the overall configuration of a vehicle control system.

[0064] Figure 32 This is an explanatory diagram showing an example of the location where the vehicle external information detection unit and imaging unit are installed. Detailed Implementation

[0065] In the following description, embodiments of the optical detection device and distance measurement system will be described with reference to the accompanying drawings. While the main components of the optical detection device and distance measurement system will be described primarily below, additional components or functions, not shown or described, may exist within the optical detection device and distance measurement system. The following description does not exclude components or functions not shown or described.

[0066] (Distance measurement system: ToF sensor)

[0067] Figure 1 This is a block diagram illustrating a schematic configuration example of a ToF sensor as a distance measurement system including a light detection device 10 according to the present disclosure. Figure 1 As shown, the ToF sensor 1 includes a control unit 11, a light-emitting unit 13, a light-receiving unit 14, a computing unit 15, and an external output interface (I / F) 19. The light-receiving unit 14 and the computing unit 15 are configured with a light detection device 10.

[0068] For example, the control unit 11 is configured as an information processing device such as a central processing unit (CPU) and controls the various units of the ToF sensor 1.

[0069] The external output I / F 19 can be, for example, a communication adapter for establishing communication with an external host 80 via a communication network that conforms to any standard, such as a wireless local area network (LAN) or a wired LAN, and also conforms to a controller local area network (CAN), a local area network (LIN), or FlexRay (registered trademark).

[0070] Here, for example, when the ToF sensor 1 is installed in a car or the like, the host 80 may be an engine control unit (ECU) installed in a car or the like. When the ToF sensor 1 is installed in an autonomous mobile robot (such as a robotic pet at home) or an autonomous mobile body (such as a robotic cleaner, a drone, or a randomly transporting robot), the host 80 may be a control device for controlling the autonomous mobile body, etc.

[0071] The light-emitting unit 13 includes, for example, one or more semiconductor laser diodes as a light source and emits laser light L1 in the form of pulses with a predetermined time width at a predetermined period (also called the emission period). Furthermore, the light-emitting unit 13 emits laser light L1 with a time width of 1 nanosecond (ns) at a period of 1 MHz, for example. For example, if an object 90 is present within the distance measurement range, the laser light L1 emitted from the light-emitting unit 13 is reflected by the object 90 and incident on the light-receiving unit 14 as reflected light L2.

[0072] Although details will be described below, the light receiving unit 14 includes, for example, a plurality of single-photon avalanche photodiode (SPAD) pixels arranged in a two-dimensional lattice pattern and outputs information relating to the number of SPAD pixels that have detected photon incidence after the light emitting unit 13 emits light (hereinafter referred to as the detection number) (e.g., corresponding to the number of detection signals described below). For example, the light receiving unit 14 detects photon incidence for a predetermined sampling period in response to one emission of the light emitting unit 13 and outputs the number of detections.

[0073] The calculation unit 15 collects each detection count output from the light receiving unit 14 for a plurality of SPAD pixels (e.g., corresponding to one or more macro pixels described below), and generates a histogram with time-of-flight as the horizontal axis and cumulative pixel count as the vertical axis based on the pixel values ​​acquired through its collection. For example, by repeatedly performing the acquisition of pixel values ​​by collecting the number of detections for one emission from the light-emitting unit 13 at a predetermined sampling frequency for multiple emission from the light-emitting unit 13, the calculation unit 15 generates a histogram with a horizontal axis (the group interval of the histogram), the horizontal axis being the sampling period corresponding to the time-of-flight, and the vertical axis being the cumulative pixel value acquired by accumulating the pixel values ​​acquired in each sampling period.

[0074] Furthermore, after performing a predetermined filtering process on the generated histogram, the calculation unit 15 identifies the time of flight when the accumulated pixel value becomes a peak from the filtered histogram. Then, the calculation unit 15 calculates the distance to the ToF sensor 1 or a device on which the ToF sensor 1 is mounted to an object 90 existing within the distance measurement range based on the identified time of flight. The distance information calculated by the calculation unit 15 can be output to the host 80, for example, via an external output I / F 19.

[0075] (Optical System)

[0076] Figure 2 This is a diagram illustrating the optical system of a ToF sensor according to the present disclosure. Figure 2 The diagram shows a so-called scanning optical system that scans the viewing angle of the light receiving unit 14 in the horizontal direction. However, the optical system of a ToF sensor is not limited to this; for example, it can also be a so-called flash ToF system with a fixed viewing angle of the light receiving unit 14.

[0077] like Figure 2 As shown, the ToF sensor 1 includes a light source 131, a collimating lens 132, a semi-reflecting mirror 133, a galvanometer mirror 135, a light receiving lens 146, and a SPAD array 141 as an optical system. The light source 131, collimating lens 132, semi-reflecting mirror 133, and galvanometer mirror 135 are included in, for example... Figure 1 The light-emitting unit 13 is included, for example, with a light-receiving lens 146 and a SPAD array 141. Figure 1 In the optical receiving unit 14.

[0078] exist Figure 2In the configuration shown, laser L1 emitted from light source 131 is converted by collimating lens 132 into parallel light with a rectangular intensity spectrum that is longer in the vertical direction, and then incident on a semi-reflecting mirror 133. The semi-reflecting mirror 133 reflects a portion of the incident laser L1. The laser L1 reflected by the semi-reflecting mirror 133 is then incident on a galvanometer mirror 135. For example, the galvanometer mirror 135 is vibrated in a horizontal direction with a predetermined rotation axis set as its center of vibration by a drive unit 134 that operates according to control from control unit 11. Accordingly, the laser L1 is horizontally scanned such that the viewing angle SR of the laser L1 reflected by the galvanometer mirror 135 scans the distance measurement range AR in a reciprocating manner in the horizontal direction. Microelectromechanical systems (MEMS), micromotors, etc., can be used in the drive unit 134.

[0079] Laser L1, reflected by galvanometer lens 135, is reflected by object 90 present within the distance measurement range AR, and the reflected light L2 is incident on galvanometer lens 135. A portion of the reflected light L2, already incident on galvanometer lens 135, is transmitted through semi-reflective mirror 133 and incident on light receiving lens 146, thus forming an image in a specific SPAD array 142 within SPAD array 141. Furthermore, the SPAD array 142 used may be the entire SPAD array 141 or a portion thereof.

[0080] (Optical receiving unit)

[0081] Figure 3 This is a block diagram illustrating a schematic configuration example of an optical receiving unit according to this disclosure. Figure 3 As shown, the optical receiving unit 14 includes a SPAD array 141, a timing control circuit 143, a driving circuit 144, and an output circuit 145.

[0082] SPAD array 141 includes a plurality of SPAD pixels 20 arranged in a two-dimensional grid pattern. Pixel drive lines LD (vertical direction in the figure) are connected to the plurality of SPAD pixels 20 in each column, and output signal lines LS (horizontal direction in the figure) are connected to each row. One end of the pixel drive line LD is connected to the output terminal of the drive circuit 144 corresponding to the column, and one end of the output signal line LS is connected to the input terminal of the output circuit 145 corresponding to the row.

[0083] exist Figure 3In this process, all or a portion of the SPAD array 141 is used to detect the reflected light L2. In the area used in the SPAD array 141 (the SPAD array 142 used), where the entire laser L1 is reflected as reflected light L2, the image of the reflected light L2 formed in the SPAD array 141 is formed as an image that is a long rectangle in the vertical direction. However, the configuration is not limited to this and various modifications can be made, such as making the area larger or smaller than the area of ​​the image of the reflected light L2 formed on the SPAD array 141.

[0084] The driving circuit 144 includes a shift register, an address decoder, etc., and drives the SPAD pixels 20 of the SPAD array 141 simultaneously, column by column. Therefore, the driving circuit 144 includes at least circuitry for applying a quenching voltage V_QCH (described later) to each SPAD pixel 20 in a selected column of the SPAD array 141 and circuitry for applying a selection control voltage V_SEL (described later) to each SPAD pixel 20 in the selected column. The driving circuit 144 then selects the SPAD pixels 20 for detecting incident photons column by column by column by column by column by column by column by column by column by column by column by column by column by column by column by column by column by column by column by column.

[0085] The signal (called the detection signal) V_OUT output from the SPAD pixel 20 in the column selected and scanned by the driving circuit 144 is input to the output circuit 145 through the output signal line LS. The output circuit 145 inputs the detection signal V_OUT output from each SPAD pixel 20 to the calculation unit 15 described below.

[0086] The timing control circuit 143 has a timing generator that generates various timing signals, and controls the drive circuit 144 and the output circuit 145 according to the various timing signals generated by the timing generator.

[0087] (SPAD array)

[0088] Figure 4 This is a schematic diagram illustrating an example configuration of a SPAD array according to this disclosure. Figure 4 As shown, for example, the SPAD array 142 used has a configuration in which a plurality of SPAD pixels 20 are arranged in a two-dimensional lattice pattern. The plurality of SPAD pixels 20 are grouped into a plurality of macro pixels 30, each macro pixel being configured by a predetermined number of SPAD pixels 20 arranged in the row and / or column directions. A predetermined shape (e.g., a rectangle) is formed by connecting the shape of the regions obtained by connecting the outer edges of the SPAD pixels 20 located on the outermost periphery of the macro pixels 30.

[0089] For example, the SPAD array 142 used is configured with a plurality of macro pixels 30 arranged in the vertical direction (corresponding to the column direction). In this disclosure, for example, the SPAD array 142 used is divided into a plurality of regions (hereinafter referred to as SPAD regions) in the vertical direction. Figure 4 In the example shown, the SPAD array 142 used is divided into four SPAD regions 142-1 to 142-4. For example, SPAD region 142-1, located at the lowest position, corresponds to the lowest 1 / 4 region in the viewing angle SR of the SPAD array 142 used; SPAD region 142-2, located above it, corresponds to the second 1 / 4 region from the bottom in the viewing angle SR; SPAD region 142-3, located above it, corresponds to the third 1 / 4 region from the bottom in the viewing angle SR; and SPAD region 142-4, located at the top, corresponds to the highest 1 / 4 region in the viewing angle SR.

[0090] (SPAD pixels)

[0091] Figure 5 This is a circuit diagram illustrating a schematic configuration example of the SPAD pixel 20 according to this disclosure. Figure 5 As shown, the SPAD pixel 20 includes a photodiode 21 as a light receiving element and a readout circuit 22 for detecting the incidence of photons in the photodiode 21. When a reverse bias voltage V_SPAD equal to or higher than the breakdown voltage is applied between the anode and cathode of the photodiode 21, the photodiode 21 generates an avalanche current when a photon is incident.

[0092] The readout circuit 22 includes a quench resistor 23, a digitizer 25, an inverter 26, a buffer 27, and a select transistor 24. For example, an N-type metal-oxide-semiconductor field-effect transistor (MOSFET; hereinafter referred to as an NMOS transistor) is used, with its drain connected to the anode of the photodiode 21 and its source grounded through the select transistor 24. Furthermore, a preset quench voltage V_QCH, allowing the NMOS transistor to act as a quench resistor, is applied from the drive circuit 144 via the pixel drive line LD to the gate of the NMOS transistor constituting the quench resistor 23.

[0093] Figure 5 The photodiode 21 shown is a SPAD. A SPAD is an avalanche photodiode that operates in Geiger mode and can detect incident photons when a reverse bias voltage equal to or greater than the breakdown voltage is applied between its anode and cathode.

[0094] The digital converter 25 includes a resistor 251 and an NMOS transistor 252. The drain of the NMOS transistor 252 is connected to the power supply voltage VDD via the resistor 251, and its source is grounded. Furthermore, the voltage at the connection node N1 between the anode of the photodiode 21 and the quench resistor 23 is applied to the gate of the NMOS transistor 252.

[0095] Inverter 26 includes a P-type MOSFET (hereinafter referred to as a PMOS transistor) 261 and an NMOS transistor 262. The drain of PMOS transistor 261 is connected to the power supply voltage VDD, and its source is connected to the drain of NMOS transistor 262. The drain of NMOS transistor 262 is connected to the source of PMOS transistor 261, and its source is grounded. The voltage at the connection node N2 between resistor 251 and the drain of NMOS transistor 262 is applied to the gates of PMOS transistor 261 and NMOS transistor 262. The output of inverter 26 is input to buffer 27.

[0096] Buffer 27 is an impedance transformation circuit. When the output signal from inverter 26 is input to buffer 27, buffer 27 performs impedance transformation on the input output signal and outputs the transformed signal as the detection signal V_OUT.

[0097] The select transistor 24 is, for example, an NMOS transistor, whose drain is connected to the source of the NMOS transistor that forms the quench resistor 23, and whose source is grounded. The select transistor 24 is connected to the drive circuit 144. When the select control voltage V_SEL from the drive circuit 144 has been applied to the gate of the select transistor 24 via the pixel drive line LD, the select transistor 24 changes from off to on.

[0098] (Illustrative example of SPAD pixel operation)

[0099] For example, Figure 5 The readout circuit 22 shown operates as follows. In other words, firstly, during the period when the selection control voltage V_SEL is applied from the drive circuit 144 to the selection transistor 24 and the selection transistor 24 is in the on state, a reverse via voltage V_SPAD equal to or higher than the breakdown voltage is applied to the photodiode 21. Accordingly, the operation of the photodiode 21 is enabled.

[0100] On the other hand, during the period when the selection control voltage V_SEL is not applied from the drive circuit 144 to the selection transistor 24 and the selection transistor 24 is in the off state, the reverse bias voltage V_SPAD is not applied to the photodiode 21, and thus the operation of the photodiode 21 is disabled.

[0101] When the selector transistor 24 is in the on state, photons are incident on the photodiode 21, generating an avalanche current in the photodiode 21. Therefore, the avalanche current flows through the quench resistor 23, and the voltage at connection node N1 increases. When the voltage at connection node N1 becomes higher than the turn-on voltage of NMOS transistor 252, NMOS transistor 252 turns on, and the voltage at connection node N2 changes from the supply voltage VDD to 0V. Then, when the voltage at connection node N2 changes from the supply voltage VDD to 0V, PMOS transistor 261 changes from the off state to the on state, NMOS transistor 262 changes from the on state to the off state, and the voltage at connection node N3 changes from 0V to the supply voltage VDD.

[0102] Therefore, a high-level detection signal V_OUT is output from buffer 27.

[0103] Subsequently, as the voltage at connection node N1 continues to rise, the voltage applied between the anode and cathode of photodiode 21 becomes lower than the breakdown voltage, and accordingly, the avalanche current stops, and the voltage at connection node N1 drops. Then, when the voltage at connection node N1 becomes lower than the turn-on voltage of NMOS transistor 252, NMOS transistor 252 enters the off state, and the output of the detection signal V_OUT from buffer 27 stops (goes low).

[0104] In this way, during the period from the timing of photons incident on the photodiode 21 to generate an avalanche current, and accordingly, the NMOS transistor 252 enters the on state, to the timing of the avalanche current stopping and the NMOS transistor 252 entering the off state, the readout circuit 22 outputs a high-level detection signal V_OUT. The output detection signal V_OUT is input to the computing unit 15 through the output circuit 145.

[0105] (Depth image)

[0106] Figure 6 This is a simplified diagram illustrating an example of a depth image acquired by a ToF sensor according to this disclosure, and a simplified diagram illustrating an example of a depth image acquired by a ToF sensor 1 mounted in a position facing the front of a vehicle. Figure 6 As shown, in this disclosure, when the laser L1 is scanned once in the horizontal direction, a depth image 50 corresponding to the distance measurement range AR is acquired as depth information to the depth of objects existing within the distance measurement range AR. Therefore, as Figure 4As shown, when the SPAD array 142 used vertically is vertically divided into four parts, the depth image 50 can be divided into four vertically aligned regions 50-1 to 50-4. Here, the first region 50-1 is the depth image acquired in SPAD region 142-1, the second region 50-2 is the depth image acquired in SPAD region 142-2, the third region 50-3 is the depth image acquired in SPAD region 142-3, and the fourth region 50-4 is the depth image acquired in SPAD region 142-4.

[0107] For example, the first region 50-1 located at the bottommost edge is a depth image of the area near the bottom of the vehicle on which the ToF sensor 1 is installed. Therefore, the first region 50-1 is more likely to contain objects that are close to the vehicle, such as road surface, white lines, and curbs.

[0108] The fourth region 50-4, located at the top, is, for example, a depth image near the top of the vehicle. Therefore, the fourth region 50-4 is likely to contain objects that are relatively far from the vehicle, such as signs and markers.

[0109] The second region 50-2 is, for example, a depth image of the lower front side of a vehicle. Therefore, the second region 50-2 is likely to contain objects at an intermediate distance between near and far, such as a vehicle or road surface with a short distance between the two sides.

[0110] The third region 50-3 is, for example, a depth image of the upper front side of a vehicle. Therefore, in the third region 50-3, for example, objects are more likely to exist at a distance that is an intermediate distance between short and long distances and at a distance that is longer than the objects with high probability included in the second region 50-2, such as vehicles traveling forward with long distances, or workpieces on roads including traffic lights.

[0111] Furthermore, the horizontal line H1 may be included in the second region 50-2 or in the third region 50-3. Alternatively, it may not be limited to this; the horizontal line may also be included in the first region 50-1 or the fourth region 50-4, or it may not be included in any of the regions 50-1 to 50-4.

[0112] In addition, in order to emit laser L1 for acquiring depth images of a specific region (specific viewpoint) once or multiple times, the acquisition is related to... Figure 6The frame images of the regions corresponding to the viewing angles of the SPAD array 142 used are indicated by dashed lines. Therefore, when the SPAD array 142 is vertically divided into four sections, in order to emit laser L1 to acquire depth images of a specific region (specific viewing angle) that is executed one or more times, frame images 51-1 corresponding to the viewing angle of SPAD region 142-1, 51-2 corresponding to the viewing angle of SPAD region 142-2, 51-3 corresponding to the viewing angle of SPAD region 142-3, and 51-4 corresponding to the viewing angle of SPAD region 142-4 are acquired. Furthermore, in addition to scanning laser L1 in the horizontal direction, frame images 51-1 to 51-4 slide in the horizontal direction.

[0113] (Histogram)

[0114] Here, when the lowermost first region 50-1 and the uppermost fourth region 50-4 are focused, typically, objects near the bottom of the device corresponding to the first region 50-1 are located near the device, and objects near the upper side of the device corresponding to the fourth region 50-4 are located away from the device. Therefore, as Figure 7 As shown, in the histogram G1 generated based on the frame image 51-1 obtained from the SPAD region 142-1 responsible for the first region 50-1, the accumulated pixel values ​​become peaks during the short flight time, and as... Figure 8 As shown, in histogram G4 generated based on frame image 51-4 obtained from SPAD region 142-4 which is responsible for fourth region 50-4, the accumulated pixel values ​​become peaks over long flight time.

[0115] (Issues when configuring calculation coefficients to be generic)

[0116] Therefore, as Figure 9 As shown, when performing calculation processing for calculating the distance to the object using the common calculation unit 915 and the common calculation coefficient 916 on frame images 51-1 to 51-4 acquired from SPAD regions 142-1 to 142-4 respectively, it cannot be determined whether the distance measurement results 917-1 to 917-4 are calculated using the optimal calculation coefficient, and therefore, there is a possibility of a decrease in distance measurement accuracy.

[0117] (Calculations based on this disclosure)

[0118] Therefore, in this disclosure, as Figure 10 As shown, the calculation unit 15 is divided into four regional calculation units 15-1 to 15-4, so as to form a pair with the four SPAD regions 142-1 to 142-4 respectively, and individual calculation coefficients 16-1 to 16-4 are set to the regional calculation units 15-1 to 15-4.

[0119] With this configuration, the individual calculation coefficients 16-1 to 16-4 based on the predicted distance to the object can be set to the area calculation units 15-1 to 15-4 respectively, and thus the corresponding distance measurement results 17-1 to 17-4 can be calculated using the optimal calculation coefficients. Accordingly, even when objects at close range and objects at long range are present within the distance measurement range AR, the decrease in distance measurement accuracy can be suppressed.

[0120] For example, for the region calculation unit 15-1 corresponding to the SPAD region 142-1 in which objects can easily exist at short distances, the high threshold Sth1 (see...) Figure 7 The threshold for extracting the reflected light L2 component from the detected light can be set as calculation coefficient 16-1, and a filtering coefficient for eliminating low-frequency noise components can be set. A low threshold Sth4 (see [reference]) is also calculated for the region corresponding to the SPAD region 142-4 where objects can easily exist at a distance. Figure 8 The threshold can be set as the calculation coefficient 16-4, and the filter coefficient for eliminating high-frequency noise components can be set.

[0121] Similarly, for the region calculation units 15-2 and 15-3, the optimal calculation coefficients 16-2 and 16-3 can be set based on the distance between them and the objects predicted in the second region 50-2 and the third region 50-3.

[0122] (Example of calculating coefficients)

[0123] As an example of the calculation coefficients 16-1 to 16-4 respectively set by the regional calculation units 15-1 to 15-4 according to this disclosure, for example, Figure 11 As shown, there are thresholds (hereinafter referred to as echo thresholds) for extracting the component of reflected light L2 from the detected light and filtering coefficients (hereinafter referred to as filtering coefficients) for eliminating the aforementioned noise components, resolution of the depth image to be acquired (hereinafter referred to as resolution), frame rate for reading the depth image from the SPAD array 142 used (hereinafter referred to as frame rate), and histogram output range (time frame) (hereinafter referred to as histogram output range), etc.

[0124] As described above, the echo threshold is a threshold used to extract the component of reflected light L2 from the light detected by the SPAD pixel 20, and as... Figure 11 As shown, for example, the echo threshold can be set such that the first region 50-1, which has a high probability of being directed toward an object at a short distance, becomes higher, and the fourth region 50-4, which has a high probability of being directed toward an object at a long distance, becomes lower.

[0125] As mentioned above, the filter coefficients are used to remove noise components from the generated histogram, and as... Figure 11 As shown, for example, the filter coefficients for reducing low-frequency components can be set toward the first region 50-1, and the filter coefficients for reducing high-frequency components can be set toward the fourth region 50-4.

[0126] As mentioned above, for example, the resolution can be changed by altering the number of macro pixels 30 that configure one pixel. Figure 11 As shown, for example, the resolution can be set such that it is higher toward the first region 50-1 and lower toward the fourth region 50-4. By reducing the resolution, the dynamic range of a pixel can be widened, and thus weak reflected light L2 from objects located at a distance can be detected. On the other hand, by increasing the resolution, a finer depth image can be obtained, thereby improving the accuracy of distance measurements.

[0127] For example, the frame rate can be changed by altering the number of group intervals in the histogram generated by the histogram circuit 152 described below and the emission period of the light-emitting unit 13. For instance, the frame rate can be doubled by halving the number of group intervals in the histogram and doubling the emission period of the light-emitting unit 13. Figure 11 As shown, for example, the frame rate can be set such that it increases towards the first region 50-1 and decreases towards the fourth region 50-4. By increasing the frame rate, the distance to an object can be measured at a higher cycle, thus allowing for a faster response to the object. On the other hand, by decreasing the frame rate, the amount of data processing can be reduced, and therefore, processing time and power consumption can be reduced.

[0128] For example, the output range of a histogram can be changed by altering the range (time frame) of the generated histogram to be output. For instance, when calculating the distance to an object at a short distance, the output bandwidth can be reduced by using earlier time frames of the output histogram. Conversely, when calculating the distance to an object at a distant distance, the output bandwidth can be similarly reduced by using later time frames of the output histogram. Figure 11 As shown, for example, the output range of the histogram can be set to another previous time frame toward the histogram of the first region 50-1, and can be set to another subsequent time frame toward the histogram of the fourth region 50-4. By reducing the output range of the histogram, the amount of data processing can be reduced, thereby achieving a reduction in processing time and power consumption.

[0129] The calculated coefficients described above are merely a simple example and can be modified in various ways. For instance, the calculated coefficients could include values ​​subtracted from the histogram based on noise from external interference light, sampling frequency, etc.

[0130] (Illustrative configuration example of a computing unit)

[0131] Figure 12 This is a block diagram illustrating a schematic configuration example of a computing unit according to this disclosure. Figure 12 As shown, each of the region calculation units 15-1 to 15-4 includes a sampling circuit 150, a SPAD addition circuit 151, a histogram circuit 152, a filtering circuit 153, an echo detection circuit 154, and a register block 155.

[0132] For example, register block 155 is a memory region configured using static random access memory (SRAM) and stores individual computation coefficients used in computational processes performed by each of the sampling circuit 150, SPAD adder circuit 151, histogram circuit 152, filter circuit 153, and echo detection circuit 154 belonging to the corresponding computational unit of the region.

[0133] For example, the sampling circuit 150 converts the pulse waveform of the signal V_OUT output from the SPAD array 141 through the output circuit 145 into a detection signal of pulse waveform with a time width according to the resolution of the calculation coefficients stored in the register block 155 of the corresponding area calculation unit based on the operating clock of the SPAD adder circuit 151, and outputs the detection signal.

[0134] By counting the detection signal V_OUT input from the corresponding macropixel 30 for each sampling period, the SPAD adder circuit 151 counts the number of SPAD pixels 20 in which photons have been detected (detection count) for each sampling period, and outputs this count value as the pixel value of the macropixel 30.

[0135] Here, the sampling period is the interval from the emission of laser L1 by the light-emitting unit 13 to the detection of the incident photon by the light-receiving unit 14 (time of flight). This sampling period is set to be shorter than the emission period of the light-emitting unit 13. For example, shortening the sampling period allows for the calculation of the time of flight of photons emitted from the light-emitting unit 13 and reflected by the object 90 with higher temporal resolution. This means that increasing the sampling frequency allows for the calculation of the distance to the object 90 with higher distance measurement resolution.

[0136] For example, after the light emitting unit 13 emits laser L1, until the reflected light L2 is incident in the light receiving unit 14 and the flight time of the laser L1 being reflected by the object 90 is represented by t, the speed of light C is constant (C≈300,000,000 m / s), and therefore the distance L to the object 90 can be calculated as in the following equation (1).

[0137] L=C×t / 2 (1)

[0138] Therefore, when the sampling frequency is 1 GHz, the sampling period is 1 ns (nanoseconds). In this case, one sampling period corresponds to 15 cm (centimeters). This indicates that at a sampling frequency of 1 GHz, the distance measurement resolution is 15 cm. Furthermore, when the sampling frequency is doubled to 2 GHz, the sampling period becomes 0.5 ns (nanoseconds), so one sampling period corresponds to 7.5 cm (centimeters). This shows that when the sampling frequency is doubled, the distance measurement resolution can be halved. Thus, increasing the sampling frequency and shortening the sampling period allows for the calculation of distances to objects with higher accuracy.

[0139] For example, histogram circuit 152 adds the pixel value of each pixel, synchronously calculated by sampling circuit 150, to the value of the group interval corresponding to the sampling period in the pixel's histogram (i.e., the group interval corresponding to the time of flight according to the frame rate among the calculated coefficients stored in register block 155 of the corresponding region calculation unit) and / or the generation range of the histogram, thereby generating a histogram for each pixel (e.g., see...). Figure 7 or Figure 8 ).

[0140] For example, the filter circuit 153 performs filtering on the histogram generated by the histogram circuit 152 based on the noise-cutting filter coefficients among the calculated coefficients stored in the register block 155 of the corresponding region calculation unit, thereby eliminating noise in the frequency band according to the filter coefficients.

[0141] For example, based on the echo threshold among the calculation coefficients stored in the register block 155 of the corresponding area calculation unit, the echo detection circuit 154 extracts the component of the reflected light L2 from the histogram after noise cancellation, and calculates the distance to the object drawn in each pixel based on the number of group intervals (time of flight) in which the accumulated pixel values ​​become peaks in the extracted component of the reflected light L2.

[0142] For example, frame images 51-1 to 51-4 configured with the distance to the object calculated as described above can be input to the host 80 via the control unit 11 or the external output I / F 19.

[0143] (Example of chip configuration for optical receiving unit and computing unit)

[0144] Figure 13 This is a diagram illustrating an example of the laminated structure of the light receiving unit and computing unit of the ToF sensor according to this disclosure. Figure 13 As shown, the light receiving unit 14 and the computing unit 15 have a structure of a laminated chip 100 in which the light receiving chip 101 and the circuit chip 102 are vertically bonded. The light receiving chip 101 is, for example, a semiconductor chip including a SPAD array 141, in which photodiodes 21 of the SPAD pixels 20 of the light receiving unit 14 are arranged, and the circuit chip 102 is, for example, in which photodiodes 21 of the SPAD pixels 20 of the light receiving unit 14 are arranged, in addition to... Figure 1 The semiconductor chip is a component other than the SPAD pixel 20 of the light receiving unit 14, the photodiode 21, and the computing unit 15 shown in the figure.

[0145] In the bonding between the light receiving chip 101 and the circuit chip 102, for example, a so-called direct bonding can be used, in which the bonding surface is planarized and the two chips are bonded using inter-electro-force bonding. However, it is not limited to this, and other bonding methods such as so-called CU-CU bonding, bump bonding, etc., can also be used, for example, bonding is formed on the bonding surface by electrode pads made of copper (Cu), etc.

[0146] Furthermore, the optical receiver chip 101 and the circuit chip 102 are electrically connected to each other via a connection portion such as a through-silicon via (TSV) penetrating the semiconductor substrate. In the connection using TSVs, for example, a so-called dual TSV method (for connecting two TSVs, i.e., a TSV disposed in the optical receiver chip 101 and a TSV provided from the optical receiver chip 101 to the circuit chip 102 on the outer surface of the chip), a so-called common TSV method (for connecting the optical receiver chip 101 and the circuit chip 102 by a TSV penetrating both chips), etc., can be employed.

[0147] However, when the light receiver chip 101 and the circuit chip 102 are joined together using a Cu-Cu junction or a bump junction, the light receiver chip 3121 and the circuit chip 3122 are electrically connected to each other through the Cu-Cu junction or the bump junction.

[0148] In addition, Figure 13 In the laminated chip 100 shown, the components are not limited to the light receiving unit 14 and the computing unit 15, and the light emitting unit 13, the control unit 11 and other components may be included therein.

[0149] (Example of planar layout for each chip)

[0150] Figure 14 This is a diagram illustrating an example of the planar layout of the light-receiving surface of the light-receiving chip 101. (See diagram for example.) Figure 14As shown, the effective pixel region 120 of the light receiving surface of the light receiving chip 101 has a configuration in which a plurality of photodiodes 21 are arranged in a two-dimensional lattice pattern. The photodiodes 21 belonging to the SPAD pixels 20 of the SPAD array 142 used may be some of the photodiodes 21 in the effective pixel region 120 or may be all of the photodiodes 21.

[0151] Figure 15 This is a diagram illustrating an example of the planar layout of the circuit chip 102 on the side of the optical receiver chip 101. (See diagram for example.) Figure 15 As shown, a read circuit region 22A is arranged in the region of the circuit chip 102 corresponding to the region of the SPAD array 142 used. In this read circuit region, the read circuits 22 of the SPAD pixels 20 are arranged in a two-dimensional grid pattern. In addition, four region calculation units 15-1 to 15-4 are arranged parallel to each other in the region adjacent to the read circuit region 22A.

[0152] In each region calculation unit 15-1 to 15-4, starting from the region closest to the readout circuit region 22A, the sampling circuit 150, histogram circuit 152, filter circuit 153, and echo detection circuit 154 are arranged sequentially. In this way, by arranging the components according to the order in which the processing of the detection signal output from the readout circuit 22 is performed, the wiring length from readout to output can be shortened, and thus signal delay can be reduced.

[0153] Furthermore, register block 155 is arranged in parallel with sampling circuit 150, histogram circuit 152, filtering circuit 153, and echo detection circuit 154. In this way, by arranging register block 155 adjacent to sampling circuit 150, histogram circuit 152, filtering circuit 153, and echo detection circuit 154, the routing of signal lines from register block 155 to the circuits can be simplified.

[0154] Furthermore, as described above, by dividing the computing unit 15 into four regional computing units 15-1 to 15-4, the circuit design of a single regional computing unit can be easily performed, and the circuit pattern of one regional computing unit can be used in the other three regional computing units. Therefore, the advantage is that the workload and time required for circuit design can be significantly reduced.

[0155] exist Figures 1 to 15In the light detection device 10 and distance measurement system shown, the viewing angle of the SPAD array 142 used is divided into multiple regions (corresponding to frame images 51-1 to 51-4). Independent calculation coefficients can be set for each region, and therefore, the optimal calculation coefficients for each region can be set based on the distance to objects with a high probability of being present in each region. Accordingly, the distance to the object can be calculated using the optimal calculation coefficients for each region, and thus, for example, even when objects at close range and objects at distant range are present within the distance measurement range AR, a decrease in distance measurement accuracy can be suppressed.

[0156] Furthermore, since the regional computing units 15-1 to 15-4 for each region can be configured to have the same circuit pattern, the workload and time required for circuit design can be significantly reduced.

[0157] Furthermore, for example, if distance measurement processing is not performed on a portion of the area, power supply to the corresponding computing unit (any one of the area computing units 15-1 to 15-4) can be stopped, and thus there is also the advantage of being able to reduce power consumption as needed.

[0158] In addition, Figures 1 to 15 In the light detection device 10 and distance measurement system 1 shown, although the view angle SR of the SPAD array 142 used is shown to scan in a reciprocating manner in the horizontal direction, the configuration is not limited to this, and the view angle SR of the SPAD array 142 used can be configured to scan in a reciprocating manner in the vertical direction, wherein the longitudinal direction of the SPAD array 142 used is set to the horizontal direction.

[0159] like Figure 12 As shown, Figures 1 to 15 The illustrated optical detection device 10 and distance measurement system 1 include multiple area calculation units 15-1 to 15-4. Each of the area calculation units 15-1 to 15-4 includes a sampling circuit 150, a histogram circuit 152, a filtering circuit 153, and an echo detection circuit 154. Therefore, despite its complex internal configuration, it does not include fault diagnosis functionality. Consequently, even if a part of the circuitry within the distance measurement system 1 fails, the fault cannot be detected quickly. From a functional safety point of view, the optical detection device 10 and the distance measurement system 1 are also insufficient.

[0160] Therefore, the optical detection device 10 and the distance measurement system 1 described later have the feature of fault diagnosis function. More specifically, in addition to the SPAD array (array unit) 141 and the computing unit 15, the optical detection device 10 according to this disclosure also includes a fault detection unit 4. The SPAD array is similar to... Figure 1The SPAD array shown has multiple light-receiving regions, and multiple light-receiving elements (photodiodes 21) are disposed in each light-receiving region. The calculation unit 15 generates a histogram relating the number of times light is received in the light-receiving element 21 within a pixel to the light-receiving timing for each pixel including one or more light-receiving elements 21, which are included in each of the multiple light-receiving regions. A fault detection unit 4 detects faults within the calculation unit 15. For a specific configuration of the fault detection unit 4, multiple candidates can be considered, and therefore they will be described sequentially.

[0161] (First Implementation)

[0162] Figure 16 This is a block diagram of the light detection device 10 according to the first embodiment. (and...) Figure 12 Similar, in Figure 16 The light detection device 10 shown includes a SPAD array 141 divided into four regions 142-1 to 142-4, a computing unit 15, a fault detection unit 4, a control unit 5, an external output interface unit (hereinafter referred to as external output I / F) 19, and an error output I / F 7. In the following text, the four divided regions within the SPAD array 141 will be referred to as SPAD array regions 0 to 3 (142-1 to 142-4).

[0163] The computing unit 15 has four region computing units 15-1 to 15-4 corresponding to SPAD array regions 0 to 3 (142-1 to 142-4). Each of the four region computing units 15-1 to 15-4 includes at least some of the circuits in the sampling circuit 150, SPAD addition circuit 151, histogram circuit 152, filtering circuit 153, echo detection circuit 154, and register block 33. Each circuit within the region computing units 15-1 to 15-4 performs operations related to... Figure 12 The operation is similar to that shown in the diagram. The output signals of the region calculation units 15-1 to 15-4 are output to the outside via external output I / F 19. Register block 33 stores the optimal calculation coefficients for each processing circuit within the corresponding region calculation units 15-1 to 15-4 used to perform the calculation processing.

[0164] The sampling circuit 150 samples the output signals of a plurality of light-receiving elements 21 included in each of the plurality of light-receiving regions at a predetermined sampling period, and outputs a detection signal for each pixel indicating that the plurality of light-receiving elements 21 have received light. The SPAD adder circuit 151 generates a pixel value by adding the number of detection signals for each pixel (macropixel 30). The histogram circuit 152 generates a histogram for each pixel in each of the plurality of light-receiving regions based on the pixel values ​​generated by the SPAD adder circuit 151. The filter circuit 153 eliminates noise components contained in the histogram generated by the histogram circuit 152. The echo detection circuit 154 detects the time difference before light is reflected by the subject and received by the array unit based on the histogram after noise component elimination by the filter circuit 153, thereby measuring the distance to the subject.

[0165] The fault detection unit 4 inputs the same test mode to two of the four regional computing units 15-1 to 15-4, and when the output signals of the two regional computing units are different, it determines that one of the two regional computing units is faulty.

[0166] The fault detection unit 4 includes four selectors 8 and four pattern generators (PG) 9 corresponding to the four region calculation units 15-1 to 15-4 and two comparators 31.

[0167] The pattern generator 9 generates test pattern signals during fault diagnosis. The four pattern generators 9 within the fault detection unit 4 each generate a test pattern signal. These generated test pattern signals are input to their corresponding selectors 8. Each pattern generator 9 changes its test pattern signal over time. For example, each pattern generator 9 generates a test pattern signal whose pattern changes randomly over time. Each pattern generator 9 can use pseudo-random numbers to generate the test pattern signal. The two pattern generators 9 corresponding to each comparator 31 generate test pattern signals with the same pattern series changes.

[0168] Each selector 8 selects one of the detection signal sampled by the sampling circuit 150 and the test mode signal generated by the mode generator 9, and inputs the selected signal to the corresponding SPAD addition circuit 151. Each selector 8 selects the detection signal sampled by the sampling circuit 150 during normal operation and selects the test mode signal during fault diagnosis.

[0169] During fault diagnosis, for example, the same test mode signal is input to each SPAD adder circuit 151, and register block 33 sets the same calculation coefficients in region calculation units 15-1 to 15-4 respectively. Therefore, SPAD adder circuit 151, histogram circuit 152, filter circuit 153, and echo detection circuit 154 perform processing based on the test mode signal input to SPAD adder circuit 151.

[0170] The fault detection unit 4 includes two comparators 31 for the four region calculation units 15-1 to 15-4. Each comparator 31 compares the output signals of two region calculation units that are different from each other when performing fault diagnosis. When performing fault diagnosis, when the same test mode signal is input to the SPAD adder circuit 151 and the register block 33 sets the same calculation coefficients in the region calculation units 15-1 to 15-4, the output signal of the echo detection circuit 154 is the same under normal operation of each SPAD adder circuit 151, each histogram circuit 152, each filter circuit 153, and each echo detection circuit 154. Therefore, each comparator 31 outputs a signal indicating the consistency of the comparison results.

[0171] During fault diagnosis, if at least some circuits within one of the two region calculation units input to comparator 31 are faulty, the output signals of the two region calculation units will be inconsistent, and comparator 31 will output a signal indicating that the comparison results do not coincide. Based on this, it can be determined that either of the two region calculation units input to comparator 31 is faulty.

[0172] For example, the comparison result signal output from comparator 31 is output to the outside through error output I / F 7 and external output I / F 19. Based on the comparison result signal output from comparator 31, a fault can be detected in any of the region calculation units 15-1 to 15-4 inside the calculation unit 15.

[0173] The control unit 5 switches the selector 8. Specifically, during normal operation, the control unit 5 causes the selector 8 to select the detection signal output from the sampling circuit 150, and during fault diagnosis, the selector 8 causes the selector 8 to select the test mode signal output from the mode generator 9.

[0174] Error output I / F7 notifies that a fault has been detected. Alternatively, by omitting error output I / F7, fault detection can be notified via external output I / F19. In the event of a fault detection, an interrupt can be applied to a host processor (not shown in the figure), for example, based on the output signal from error output I / F7 or external output I / F19. Alternatively, the host processor can detect a fault by periodically polling the values ​​of error output I / F7, external output I / F19, and various registers. Optionally, information regarding the presence / absence of a fault detection result can be added to data output from external output I / F19 in a predetermined format (e.g., MIPI: Mobile Industry Processor Interface, I2C: Internal Integrated Circuit, SPI: Serial Peripheral Interface, etc.).

[0175] In this manner, when performing fault diagnosis, the optical detection device 10 according to the first embodiment inputs two corresponding output signals from the four region calculation units 15-1 to 15-4 within the calculation unit 15 to mutually different comparators 31, and inputs the same test mode signal to the region calculation units 15-1 to 15-4. Accordingly, when at least a portion of the circuitry within a part of a region calculation unit fails, an inconsistency is detected in the comparator 31, and the output signal of the region calculation unit with the failed circuitry is input to the comparator 31. Therefore, based on whether an inconsistency is detected in any of the comparators 31, it is possible to detect whether one of the four region calculation units 15-1 to 15-4 within the calculation unit 15 is faulty.

[0176] exist Figure 16 In the illustrated optical detection device 10, although it can be known that one of the four region calculation units 15-1 to 15-4 within the calculation unit 15 is faulty, the faulty region calculation unit cannot be identified. Therefore, another mechanism for identifying faulty region calculation units can be provided. For example, if an inconsistency in the comparison result is detected in a comparator 31, a verification process can be performed. In this verification process, specific data is written into the memory (not shown) inside the histogram circuit 152 within the memory (not shown) connected to the two region calculation units of the comparator 31 and the echo detection circuit 154, and it is determined whether the written data can be read normally. Based on this, a region calculation unit with a faulty memory can be identified.

[0177] exist Figure 16Although an example has been shown of setting up SPAD array regions 0 to 3 (142-1 to 142-4), four sampling circuits 150, and a computing unit 15 including four region computing units 15-1 to 15-4, the number of SPAD array regions does not necessarily need to be four. In the case of n (here, n is two or more integers) SPAD array regions, n sampling circuits 150, computing units 15 including n region computing units 15-1 to 15-4, n pattern generators 9, and n selectors 8 are arranged. In the case of an even number of n, n / 2 comparators 31 are arranged. Furthermore, in the embodiments described below, the value of n is arbitrary, but according to the embodiments described below, n can be either odd or even.

[0178] (Second Implementation)

[0179] Figure 17 This is a block diagram of the light detection device 10 according to the second embodiment. In the following description, it will be shown that... Figure 16 Different points of the light detection device 10 shown in the figure.

[0180] exist Figure 17 The light detection device 10 shown in the figure has a computing unit 15, which has the same characteristics as in the light detection device 10. Figure 16 The configuration shown is similar to the one described above. Except... Figure 16 In addition to the internal components of the fault detection unit 4 shown in the figure, Figure 17 The fault detection unit 4 shown includes an encoding unit 32. In other words, in Figure 17 The fault detection unit 4 shown includes four selectors 8 and four pattern generators 9 corresponding to the four region calculation units 15-1 to 15-4, two comparators 31, and an encoding unit 32.

[0181] During fault diagnosis, encoding unit 32 generates encoded data of the output signals of the corresponding region computing units 15-1 to 15-4. For example, the encoded data is a Cyclic Redundancy Check (CRC) signal. In the accompanying drawings of this application, encoding unit 32 will be represented by CRC 32. The CRC signal is generated by performing data compression on the output signals of region computing units 15-1 to 15-4, and therefore the number of storage bits can be reduced compared to storing the output signals of region computing units 15-1 to 15-4 as is. Therefore, the cost of storing the output results of region computing units 15-1 to 15-4 can be reduced.

[0182] In the case where the distance measurement system 1 including the optical detection device 10 according to this embodiment has an encoding unit 32 for communication already installed therein, the encoding unit 32 can be used to generate a CRC signal, so there is no need to arrange a new encoding unit 32.

[0183] exist Figure 17 The comparator 31 shown compares two CRC signals generated by the two encoding units 32. As mentioned above, the number of bits in the CRC signal is less than the number of bits in the output signals of the region calculation units 15-1 to 15-4, and thus the internal configuration of the comparator 31 can be further simplified.

[0184] In this way, in the light detection device 10 according to the second embodiment, the encoded data obtained by comparing the output signals of the encoding region calculation units 15-1 to 15-4 is compared. Therefore, compared with the case where the output signals of the region calculation units 15-1 to 15-4 are compared with each other, the configuration of the comparator 31 can be simplified. Therefore, the number of bits when storing the output results of the region calculation units 15-1 to 15-4 can be reduced.

[0185] (Third Implementation)

[0186] In the first and second embodiments described above, an even number of region calculation units 15-1 to 15-4 are arranged inside the calculation unit 15. The fault detection unit 4 divides the even number of region calculation units 15-1 to 15-4 into groups of two region calculation units each, inputs the same test mode signal to each group of two region calculation units, and determines that either of the two region calculation units has failed if the output signals of the two region calculation units are different. In contrast, the third embodiment described below indicates that an odd number of region calculation units 15-1 to 15-3 are arranged inside the calculation unit 15. Furthermore, the odd number is not limited to three; it can also be five or more odd numbers.

[0187] Figure 18 This is a block diagram of the light detection device 10 according to the third embodiment. Figure 18 The optical detection device 10 shown includes SPAD array regions 0 to 2, a computing unit 15 having three region computing units 15-1 to 15-3, and a fault detection unit 4.

[0188] The fault detection unit 4 includes three pattern generators 9, three selectors 8, and two comparators 31. Each comparator 31 compares the output signals of two of the three region calculation units 15-1 to 15-3 with each other. The output signals of the region calculation units 15-1 to 15-3 are input to the two comparators 31. The output signals of the remaining two region calculation units are input to one of the two comparators 31. Accordingly, the two comparators 31 compare the output signals of the two region calculation units with each other in a repetitive manner using the output signal of one region calculation unit.

[0189] When an inconsistency in the comparison results is detected in at least one of the two comparators 31, it can be determined that one of the regional computing units inside the computing unit 15 is faulty.

[0190] In addition, with Figure 17 Similarly, multiple encoding units 32 of the output signals of the encoding region calculation units 15-1 to 15-3 can be set in Figure 18 The light detection device 10 shown in the figure can input multiple coded data to the comparator 31.

[0191] In this way, in the third embodiment, although an odd number of region computing units 15-1 to 15-3 are arranged inside the computing unit 15, by inputting the output signals of some region computing units to multiple comparators 31 in a duplex manner, by dividing all the region computing units 15-1 to 15-3 inside the computing unit 15 into two regions computing units in each group, the output signals of the two regions computing units can be compared with each other by each comparator 31, and similar to the first and second embodiments, it is possible to detect that any one of the region computing units 15-1 to 15-3 inside the computing unit 15 is faulty.

[0192] (Fourth Implementation)

[0193] In the optical detection apparatus 10 according to the first to third embodiments described above, although it can be known that any region computing unit within the computing unit 15 is faulty, the fault detection unit 4 cannot identify which region computing unit is faulty, and in order to identify it, as described above, in addition to the fault detection unit 4, a verification device or the like is also required. The optical detection apparatus 10 according to the fourth embodiment described below is configured to be able to use the fault detection unit 4 to identify the region computing unit that has already malfunctioned.

[0194] Figure 19 This is a block diagram of the light detection device 10 according to the fourth embodiment. In the following description, it will be further explained... Figure 16 Different points of the light detection device 10 shown in the figure. Figure 19 The optical detection device 10 shown includes SPAD array regions 0 to 2, a computing unit 15 having three region computing units 15-1 to 15-3, and a fault detection unit 4.

[0195] The fault detection unit 4 includes three pattern generators 9 and three selectors 8 corresponding to the three region calculation units 15-1 to 15-3 and a comparator 31. The output signals of the three region calculation units 15-1 to 15-3 are input to the comparator 31, and the comparator 31 compares the three output signals with each other. Then, if one of the three output signals is different from the remaining two output signals, it can be determined that the region calculation unit that has output that signal is faulty.

[0196] In this way, by comparing the three input output signals, comparator 31 can identify the region computing unit that has failed through majority decision.

[0197] exist Figure 19 In this configuration, although the output signals of three region computing units 15-1 to 15-3 are input to comparator 31, the output signals of four or more region computing units can be input to comparator 31, and a faulty region computing unit can be identified through majority decision. For example, when the output signals of four region computing units 15-1 to 15-4 are input to comparator 31, if one of the output signals differs from the remaining three, it can be identified that the region computing unit that output that signal has failed.

[0198] In addition, with Figure 17 Similarly, multiple encoding units 32 of the output signals of the encoding region calculation units 15-1 to 15-3 can be set in Figure 19 The light detection device 10 shown in the figure can input multiple coded data to the comparator 31.

[0199] In this way, in the fourth embodiment, the output signals of three or more regional computing units are input to comparator 31, the output signals are compared with each other, and the regional computing unit that has failed is identified by majority decision, thereby the location of the failure can be identified with a simple configuration.

[0200] (Fifth Implementation)

[0201] In the fifth embodiment, fault diagnosis is performed separately on the multi-level processing circuits within the regional computing units 15-1 to 15-4.

[0202] Figure 20 This is a block diagram of the light detection device 10 according to the fifth embodiment. Figure 20 The internal configuration of the fault detection unit 4 in the optical detection device 10 shown is the same as that in the optical detection device 10 shown. Figure 16 The internal configuration of the fault detection unit 4 shown is different. Besides the four pattern generators 9 and four selectors 8 corresponding to the four region calculation units 15-1 to 15-4, Figure 20The fault detection unit 4 shown includes multiple comparators 31 (first to fourth comparators 31-1 to 31-4), and the output signals of the multi-stage processing circuits inside the region calculation units 15-1 to 15-4 are input to these multiple comparators 31. Here, the processing circuits are the sampling circuit 150, SPAD addition circuit 151, histogram circuit 152, filtering circuit 153, and echo detection circuit 154 within the region calculation units 15-1 to 15-4.

[0203] exist Figure 20 In the example shown, two of the output signals of the four SPAD adder circuits 151 within the four region calculation units 15-1 to 15-4 are grouped together and input to two first comparators 31-1. If the output signals are inconsistent with each other, a fault is detected in any of the SPAD adder circuits 151. Similarly, two of the output signals of the four histogram circuits 152 within the four region calculation units 15-1 to 15-4 are grouped together and input to two second comparators 31-2. If the output signals are inconsistent with each other, a fault is detected in any of the histogram circuits 152. Similarly, two of the output signals of the four filter circuits 153 within the four region calculation units 15-1 to 15-4 are grouped together and input to two third comparators 31-3. If the output signals are inconsistent with each other, a fault is detected in any of the filter circuits 153. Similarly, the two output signals of the four echo detection circuits 154 in the four area calculation units 15-1 to 15-4 are set as a group and input to two fourth comparators 31-4, and if the output signals are inconsistent with each other, any one of the echo detection circuits 154 is detected to be faulty.

[0204] Figure 20 The fault detection unit 4 shown includes a total of eight comparators 31 (two of each of the first to fourth comparators 31-1 to 31-4), and each comparator 31 can detect which processing circuit in each region calculation unit 15-1 to 15-4 has failed. For example, the output signal of each comparator 31 is output to the outside via error output I / F 7 or external output I / F 19.

[0205] Although Figure 20 The fault detection unit 4 shown in the diagram inputs two output signals from the processing circuits within each region calculation unit 15-1 to 15-4 to the first comparator 31-1 to the fourth comparator 31-4, but with... Figure 19 Similarly, three or more output signals of each processing circuit can be input to comparator 31 and can be configured to identify which processing circuit is faulty through majority decision.

[0206] In addition, with Figure 17 Similarly, the encoded data obtained through the output signal of the encoding processing circuit can be input to comparator 31.

[0207] In this way, in the fifth embodiment, the output signals of the processing circuits of each stage inside the multiple region computing units 15-1 to 15-4 are compared by corresponding comparators 31 (first comparator 31 to fourth comparator 31-1 to 31-4), and thus it is possible to detect which processing circuit inside the region computing units 15-1 to 15-4 has a fault.

[0208] (Sixth Implementation Method)

[0209] In the sixth embodiment, a test mode signal is input to multiple locations within the sampling circuit 150 and the calculation circuit, and fault detection is performed at these multiple locations.

[0210] Figure 21 This is a block diagram of the light detection device 10 according to the sixth embodiment. Figure 21 The internal configuration of the fault detection unit 4 in the optical detection device 10 shown is the same as that in the optical detection device 10 shown. Figure 16 The internal configuration of the fault detection unit 4 shown is different. Figure 21 The fault detection unit 4 shown includes four first pattern generators 9-1 and four first selectors 8-1 arranged between SPAD array regions 0 to 3 (142-1 to 142-4), four sampling circuits 150, two output signals from the output signals of the four SPAD adders being input as a set to two first comparators 31-1, four second pattern generators 9-2 and four second selectors 8-2 arranged between the four SPAD adders and four histogram circuits 152, and two output signals from the output signals of the four echo detection circuits 154 being input as a set to two second comparators 31-2.

[0211] Four first pattern generators 9-1, four first selectors 8-1, and two first comparators 31-1 are used to detect faults in any one of the four sampling circuits 150 and the four SPAD addition circuits 151 during test modes. A fault is detected in any one of the four sampling circuits 150 and the four SPAD addition circuits 151 when an inconsistency in the output signal is detected in at least one of the two first comparators 31-1. The four test modes generated by the four first pattern generators 9-1 are random modes generated using pseudo-random numbers, etc., and the two test modes corresponding to the two first comparators 31-1 are modes with the same pattern series change.

[0212] Four second-mode generators 9-2, four second-selectors 8-2, and two second-comparator 31-2 are used to detect faults in any of the four histogram circuits 152, four filter circuits 153, and four echo detection circuits 154 during test modes. A fault is detected in any of the four histogram circuits 152, four filter circuits 153, and four echo detection circuits 154 when an inconsistency in the output signal is detected in at least one of the two second-comparator 31-2. The four test modes generated by the four second-mode generators 9-2 are random modes generated using pseudo-random numbers, etc., and the two test modes corresponding to the two second-comparator 31-2 are modes with the same pattern series changes.

[0213] During fault diagnosis, control unit 5 selects either a first fault diagnosis mode or a second fault diagnosis mode. When control unit 5 selects the first fault diagnosis mode, first selection unit 8-1 selects a first inspection mode and inputs the selected first test mode to sampling circuit 150. In this case, the processing of sampling circuit 150 and SPAD adder circuit 151 is executed sequentially based on the first test mode, and two input signals from the output signals of the four SPAD adder circuits 151 are input as a group to two first comparators 31-1. Accordingly, when the first fault diagnosis mode is selected, the two first comparators 31-1 can detect faults in either the four sampling circuits 150 or the four SPAD adder circuits 151.

[0214] When the control unit 5 selects the second fault diagnosis mode, the second selection unit 8-2 selects the second inspection mode and inputs the selected second inspection mode to the histogram circuit 152. In this case, the processing of the histogram circuit 152, the filter circuit 153, and the echo detection circuit 154 is executed sequentially based on the second test mode, and the two output signals of the four echo detection circuits 154 are input as a group to the two second comparators 31-2. Accordingly, when the second fault diagnosis mode is selected, the two second comparators 31-2 can detect a fault in any one of the four histogram circuits 152, the four filter circuits 153, or the four echo detection circuits 154.

[0215] Figure 22 It is based on Figure 21 A block diagram of a modified example of the optical detection device 10. Figure 22 In the middle, the two first comparators 31-1 are arranged in relation to... Figure 21 The positions shown are different. Two of the output signals from histogram circuit 152 are input as a group to... Figure 22 The two first comparators 31-1 are shown in the figure.

[0216] During fault diagnosis, the control unit 5 selects either a first fault diagnosis mode or a second fault diagnosis mode. When the control unit 5 selects the first fault diagnosis mode, the first selection unit 8-1 selects a first inspection mode and inputs the selected first test mode to the sampling circuit 150. In this case, based on the first test mode, the processing of the sampling circuit 150, the SPAD adder circuit 151, and the histogram circuit 152 is executed sequentially, and two input signals from the output signals of the four histogram circuits 152 are input as a group to the two first comparators 31-1. Accordingly, when the first fault diagnosis mode is selected, the two first comparators 31-1 can detect that any one of the four sampling circuits 150, the four SPAD adder circuits 151, or the four histogram circuits 152 has failed.

[0217] When the control unit 5 selects the second fault diagnosis mode, the second selection unit 8-2 selects the second inspection mode and inputs the selected second inspection mode to the histogram circuit 152. In this case, based on the second test mode, the processing of the histogram circuit 152, the filter circuit 153, and the echo detection circuit 154 is executed sequentially, and the two output signals of the four echo detection circuits 154 are input as a group to the two second comparators 31-2. Thus, when the second fault diagnosis mode is selected, the two second comparators 31-2 can detect that any one of the four histogram circuits 152, the four filter circuits 153, or the four echo detection circuits 154 has failed.

[0218] Also in Figure 21 and Figure 22 The light detection device 10 shown can input three or more output signals to a first comparator 31-1 or a second comparator 31-2, and can identify the fault processing circuit by majority decision.

[0219] In addition, with Figure 17 Similarly, the encoded data obtained by encoding the output signal of each processing circuit can be input to comparator 31.

[0220] In this way, in the sixth embodiment, the test mode is input to multiple locations inside the light detection device 10, and the output signals of different levels of processing circuits in the multi-level processing circuits inside each region calculation unit 15-1 to 15-4 are input to a separate comparator 31, thereby making it easy to identify the location where a fault has occurred inside the light detection device 10.

[0221] (Seventh Implementation)

[0222] According to the seventh embodiment, the light detection device 10 indicates a situation where the number of pixels in the SPAD array 141 is greater than the number of pixels that the computing unit 15 can process.

[0223] Figure 23 This is a block diagram of the light detection device 10 according to the seventh embodiment. Figure 23 The optical detection device 10 shown includes: a SPAD array 141, a sampling circuit 150, a selector 8, a column shifter setting register 34, a calculation unit 15 including four region calculation units 15-1 to 15-4, and a fault detection unit 4. The fault detection unit 4 includes a pattern generator 9 and two comparators 31.

[0224] In this embodiment, it is assumed that the number of pixels inside the SPAD array 141 is greater than the number of pixels that the calculation unit 15 can process, and the calculation unit 15 performs a distance measurement process for each pixel group in the column direction inside the SPAD array 141.

[0225] The sampling circuit 150 outputs a detection signal corresponding to the number of pixels within the SPAD array 141. The detection signal output from the sampling circuit 150 is shifted by the column number set in the column shift setting register 34 and output from the selector 8 during normal operation. In this way, the selector 8 selects the detection signal corresponding to each pixel in some columns within the SPAD array 141 and provides it to the calculation unit 15.

[0226] Selector 8 is positioned between sampling circuit 150 and the four SPAD adders. In normal operation, as described above, selector 8 performs a column shift on the detection signal output from sampling circuit 150 and then provides the detection signal to each SPAD adder circuit 151.

[0227] On the other hand, when performing fault diagnosis, selector 8 selects the test pattern signal generated by pattern generator 9 and provides the selected test pattern signal to each SPAD adder circuit 151 inside computing unit 15, without performing the operation of offsetting each column (hereinafter referred to as column offset).

[0228] and Figure 16 Similarly, calculation unit 15 includes four region calculation units 15-1 to 15-4, and each region calculation unit 15-1 to 15-4 includes a SPAD addition circuit 151, a histogram circuit 152, a filtering circuit 153, and an echo detection circuit 154. Two of the output signals of the four echo detection circuits 154 are input as a group to two comparators 31. The comparison operation performed by comparators 31 is similar to... Figure 16 The comparison operations shown are similar.

[0229] Figure 24 It is based on Figure 23 A block diagram of a modified example of the optical detection device 10. Figure 24 In the light detection device 10 shown, the SPAD addition circuit 151 detects the pixel values ​​of all pixels within the SPAD array 141. The histogram circuit 152, filter circuit 153, and echo detection circuit 154 on the back stage of the SPAD addition circuit 151 can process pixels corresponding to a target number of pixels less than the number of pixels within the SPAD array 141.

[0230] The pixel values ​​output from the SPAD adder circuit 151 are column-shifted and then input into each histogram circuit 152.

[0231] Figure 24 The light detection device 10 shown in the figure has four selectors 8 disposed between four SPAD adder circuits 151 and four histogram circuits 152. During normal operation, as described above, each selector 8 performs a column shift of the pixel value output from each SPAD adder circuit 151 and then provides the column shifter pixel value to the corresponding histogram processing unit. On the other hand, when performing fault diagnosis, each selection unit 8 selects a test mode signal generated by the pattern generator 9 and inputs the selected test mode signal into the corresponding histogram circuit 152.

[0232] Also in Figure 23 and Figure 24 The light detection device 10 shown can input three or more output signals to a first comparator 31-1 or a second comparator 31-2, and can identify the fault processing circuit by majority decision.

[0233] In addition, with Figure 17 Similarly, the encoded data obtained by encoding the output signal of each processing circuit can be input to comparator 31.

[0234] In this way, even when the number of pixels in the SPAD array 141 is greater than the number of pixels in each processing circuit inside the computing unit 15, the light detection device 10 according to the seventh embodiment can perform fault diagnosis by inputting a test mode signal to each processing circuit when performing fault diagnosis.

[0235] (Eighth Implementation Method)

[0236] In the eighth embodiment, register block 33, which stores the calculation coefficients used when the processing circuits in the region calculation units 15-1 to 15-4 perform calculation processing, stores the calculation coefficients used for fault diagnosis.

[0237] Figure 25A This is a block diagram of the light detection device 10 according to the eighth embodiment. Figure 25A Showing with Figure 17 The configuration is similar to that of the light detection device 10 shown in the image. More specifically, it is similar to... Figure 17 Similar to the light detection device 10 shown in the figure, Figure 25A The fault detection unit 4 shown includes four pattern generators 9, four selectors 8, and four encoding units (CRC) 32 corresponding to the four region calculation units 15-1 to 15-4, and two comparators 31. Furthermore, in Figure 25A The optical detection device 10 shown includes a control unit 5. The control unit 5 switches the selector 8 and the calculation coefficients within the register block 33 during normal operation or fault diagnosis. The encoding unit 32 generates encoded data obtained by encoding the output signal of the echo detection circuit 154. The encoded data is, for example, a CRC signal. Furthermore, the encoding unit 32 can generate encoded data other than CRC signals.

[0238] Figure 25B This is a block diagram showing the internal configuration of register block (calculation coefficient storage unit) 33. For example... Figure 25B As shown, register block 33 includes a first register 35 storing calculation coefficients (first calculation coefficients) for normal operation, a second register 36 storing calculation coefficients (second calculation coefficients) for fault diagnosis, and a selector 37 that selects one of the calculation coefficients stored in the first register 35 and the calculation coefficients stored in the second register 36 based on a control signal from the control unit 5.

[0239] Register blocks 33 are arranged for each region calculation unit 15-1 to 15-4, and a second register 36 is arranged in each register block 33, so that the calculation coefficients for fault diagnosis can be set separately for each region calculation unit 15-1 to 15-4.

[0240] Furthermore, the light detection device 10 according to the eighth embodiment can be combined with the light detection device 10 according to the first to seventh embodiments described above. Therefore, the configuration, except for the register block 33 and the control unit 5 inside the light detection device 10, can be the same as the configuration of the light detection device 10 according to the second to seventh embodiments.

[0241] In addition, Figure 25A In the light detection device 10 shown, three or more output signals can be input to a first comparator 31-1 or a second comparator 31-2, and the fault processing circuit can be identified by majority decision.

[0242] In addition, with Figure 17 Similarly, the encoded data obtained by encoding the output signal of each processing circuit can be input to comparator 31.

[0243] In this manner, in the eighth embodiment, calculation coefficients for normal operation and calculation coefficients for fault diagnosis are stored in register block 33, and one of the calculation coefficients is selected and provided to each of the area calculation units 15-1 to 15-4 according to instructions from the control unit 5. Accordingly, after setting appropriate calculation coefficients for fault diagnosis in each area calculation unit 15-1 to 15-4, fault diagnosis can be performed by inputting a test mode. Furthermore, in the eighth embodiment, individual calculation coefficients can be set in each area calculation unit 15-1 to 15-4 not only during normal operation but also during fault diagnosis.

[0244] (Ninth Implementation)

[0245] When performing fault diagnosis, it is assumed that test mode signals, which are changed in the same pattern series, are input to multiple area calculation units 15-1 to 15-4. Therefore, it is assumed that the calculation coefficients set in area calculation units 15-1 to 15-4 during fault diagnosis can be configured to be the same without causing any problems. Therefore, in the ninth embodiment described below, the same calculation coefficients are set in the multiple area calculation units 15-1 to 15-4 during fault diagnosis.

[0246] Figure 26A This is a block diagram of the light detection device 10 according to the ninth embodiment, and Figure 26B This is a block diagram illustrating the internal configuration of register blocks 33 located in each region computing unit 15-1 to 15-4. In the following description, the focus will be on... Figure 25A and Figure 25B The differences in the light detection device 10 shown in the figure.

[0247] Figure 26B The internal configuration of register block 33 shown in the figure is similar to... Figure 25B The internal configuration of register block 33 shown in the figure is different. Figure 26B The register block 33 shown includes a normal operation register (first calculation coefficient storage unit) 38 for storing calculation coefficients used for normal operation and a selector 39.

[0248] Furthermore, in addition to the register block 33 for each of the region calculation units 15-1 to 15-4, the optical detection device 10 according to the ninth embodiment also includes a fault diagnosis register block (second calculation coefficient storage unit) 40. The fault diagnosis register block 40 is provided for the plurality of region calculation units 15-1 to 15-4.

[0249] During normal operation and during fault diagnosis, the control unit 5 controls the selection of the selector 39 within the register block 33 for each region calculation unit 15-1 to 15-4. Accordingly, the selector 39 selects the calculation coefficients stored in the normal operation register 38 during normal operation and the calculation coefficients stored in the fault diagnosis register block 40 during fault diagnosis.

[0250] Also in Figure 26A In the light detection device 10 shown, three or more output signals can be input to a first comparator 31-1 or a second comparator 31-2, and the fault processing circuit can be identified by majority decision.

[0251] In addition, with Figure 17 Similarly, the encoded data obtained by encoding the output signal of each processing circuit can be input to comparator 31.

[0252] In this way, in the optical detection device 10 according to the ninth embodiment, when performing fault diagnosis, after setting common calculation coefficients in multiple region calculation units 15-1 to 15-4, the test mode signal is input, thus simplifying the internal configuration of the register block 33 set in each region calculation unit 15-1 to 15-4.

[0253] (Tenth Implementation)

[0254] In the optical detection device 10 according to the tenth embodiment, the normal operation cycle and the fault diagnosis cycle are completely separated from each other. The optical detection device 10 according to the tenth embodiment can be combined with the optical detection devices 10 according to the first to ninth embodiments described above, and therefore has the internal configuration of the optical detection device 10 according to any one of the first to ninth embodiments.

[0255] Figure 27 This is an operation timing diagram of the optical detection device 10 according to the tenth embodiment. As shown, a fault diagnosis period is provided during the blanking period between the start processing period and the normal operation period for distance measurement. During the fault diagnosis period, the distance measurement processing in the optical detection device 10 is stopped. In other words, during the fault diagnosis cycle, the optical receiving operation using the SPAD array 141 and the sampling operation using the sampling circuit 150 are stopped, and each region calculation unit 15-1 to 15-4 within the calculation unit 15 operates each processing circuit based on the test pattern signal generated by the pattern generator 9.

[0256] For example, execution is performed by control unit (timing control unit) 5. Figure 27The cycle control shown in the figure. According to the tenth embodiment, the control unit 5 controls the SPAD array 141 and the calculation unit 15 respectively during the normal operation cycle based on the light generation histogram received by the SPAD array 141 and during the fault diagnosis cycle in which the calculation unit 15 performs fault detection based on the test mode signal when the light receiving operation of the SPAD array 141 is stopped.

[0257] Thus, in the tenth embodiment, fault diagnosis is performed while the processing operation during normal operation is stopped, so fault diagnosis of each area computing unit 15-1 to 15-4 can be performed without affecting the processing operation during normal operation.

[0258] (Eleventh Implementation Method)

[0259] The optical detection device 10 according to the eleventh embodiment performs fault diagnosis until the next light is received after the SPAD array 141 receives light. The optical detection device 10 according to the eleventh embodiment can be combined with the optical detection devices 10 according to the first to ninth embodiments described above. Therefore, the internal configuration of the optical detection device 10 is consistent with the internal configuration of the optical detection device 10 according to any one of the first to ninth embodiments.

[0260] Figure 28 This is an operation timing diagram of the light detection device 10 according to the eleventh embodiment. The light-emitting unit inside the distance measurement system 1 intermittently emits laser light at predetermined intervals. Therefore, the SPAD array 141 intermittently receives reflected light from an object according to the emission timing of the light-emitting unit. The timing of receiving reflected light varies depending on the distance to the object, and therefore the period during which the SPAD array 141 receives light and performs distance measurement (hereinafter referred to as the sensor data processing period) has a predetermined time width. The SPAD array 141 has multiple sensor data processing periods according to the intermittent emission timing of the light-emitting unit, and between each sensor data processing period, there exists a period during which the SPAD array 141 does not receive light (hereinafter referred to as the non-light reception period or test data processing period). Thus, in the eleventh embodiment, fault diagnosis is performed during the non-light reception period (test data processing period).

[0261] Figure 28The diagram illustrates a sensor data processing cycle in which histogram circuit 152 performs the histogram generation process, a sensor data processing cycle in which filter circuit 153 performs the noise cancellation process, and a sensor data processing cycle in which echo detection circuit 154 performs distance measurement. After the processing by histogram circuit 152 is completed, the processing by filter circuit 153 is performed, followed by the processing by echo detection circuit 154. Therefore, the processing of histogram circuit 152, filter circuit 153, and echo detection circuit 154 during normal operation is performed in a time-shifted manner. In the eleventh embodiment, between these processes, a test mode for fault diagnosis is input, and the test mode is processed in the order of histogram circuit 152, filter circuit 153, and echo detection circuit 154.

[0262] For example, through the control unit (timing control unit) 5 Figure 28 The cycle control shown in the figure. The control unit 5 according to the eleventh embodiment performs control to input test mode signals to the input node or internal node of the computing unit 15 between cycles of processing based on the light received by the SPAD array 141 within each processing circuit inside the computing unit 15 and output fault diagnosis signals from the computing unit 15.

[0263] According to the eleventh embodiment, fault diagnosis is performed between pipeline processes without stopping the normal operation of the pipeline process, and therefore the fault diagnosis and fault detection of the calculation unit 15 can be performed without reducing the accuracy and speed of distance measurement.

[0264] (The function and effects of the first to eleventh embodiments)

[0265] In the first to eleventh embodiments, since fault diagnosis and fault detection can be performed without setting up physical redundant circuits, it is possible to perform fault diagnosis and fault detection without increasing the circuit size of the optical detection device 10 and increasing its power consumption.

[0266] Furthermore, in the first to eleventh embodiments, no comparison is performed between the output signal when the input test mode signal is not performed and the pre-prepared output expectation value, so there is no need for a storage unit to store the output expectation value.

[0267] Furthermore, in the first to eleventh embodiments, a fault detection unit 4 can be added with almost no change to the block configuration of the light detection device 10, and thus the fault detection unit 4 can be added to the light detection device 10 with various internal configurations after installation.

[0268] Furthermore, in the first to eleventh embodiments, without duplexing the processing circuits inside the light detection circuit, the same fault detection rate as when duplexing is implemented can be obtained.

[0269] Thus, although the optical detection device 10 according to the first to eleventh embodiments has the various technical effects described above, in the optical detection device 10 including the histogram circuit 152 and the echo detection circuit 154, there will be no optical detection device 10 with fault detection function in the future, so the following configuration can be considered.

[0270] (Twelfth Implementation)

[0271] Figure 29 This is a block diagram of the light detection device 10 according to the twelfth embodiment. Figure 29 In the light detection device 10 shown, the internal configuration of each region calculation unit 15-1 to 15-4 within the calculation unit 15 is dual. More specifically, Figure 29 The optical detection device 10 shown includes a fault detection unit 4 for each of the region calculation units 15-1 to 15-4, and the fault detection unit 4 includes processing circuitry having the same configuration as those in the region calculation units 15-1 to 15-4. In other words, the SPAD addition circuit 151, histogram circuit 152, filter circuit 153, and echo detection circuit 154 within the region calculation units 15-1 to 15-4 are also arranged in the fault detection unit 4. Hereinafter, the SPAD addition circuit 151, histogram circuit 152, filter circuit 153, and echo detection circuit 154 within the region calculation units 15-1 to 15-4 will be referred to as the first region calculation units 15-1 to 15-4, and the SPAD addition circuit 151, histogram circuit 152, filter circuit 153, and echo detection circuit 154 within the fault detection unit 4 will be referred to as the second region calculation units 15-1 to 15-4. In each processing circuit within the second area calculation units 15-1 to 15-4 within the fault detection unit 4, the calculation coefficients for fault diagnosis are set from the corresponding register block 33.

[0272] Comparators 31, arranged for each of the four region computing units 15-1 to 15-4, compare the output signal of the corresponding unit among the first region computing units 15-1 to 15-4 with the output signal of the corresponding unit among the second region computing units 15-1 to 15-4, and output a comparison result signal. The comparison result signal indicates whether any one of the first or second region computing units 15-1 to 15-4 has a fault. The comparison result signals output from the four comparators 31 corresponding to the four region computing units 15-1 to 15-4 are output to the outside via error output I / F 7.

[0273] Similar to the first region calculation units 15-1 to 15-4, the detection signal output from the sampling circuit 150 is input to the second region calculation units 15-1 to 15-4 inside the fault detection unit 4. Therefore, during normal operation, without using the test mode, the comparator 31 can consistently perform fault detection using the detection signal output from the sampling circuit 150.

[0274] In the light detection device 10 according to the twelfth embodiment, the internal configuration of the multiple region calculation units 15-1 to 15-4 inside the calculation unit 15 is dual, and therefore, despite the problem of the increased circuit size of the light detection device 10, the comparator 31 can continuously perform fault detection during normal operation without the need to input a test mode signal from the outside.

[0275] (Thirteenth Implementation Method)

[0276] Figure 30 This is a block diagram of the light detection apparatus 10 according to the thirteenth embodiment. In the following description, it will be reconciled with... Figure 16 Different points of the light detection device 10 shown in the figure.

[0277] Figure 30 The light detection device 10 shown includes a pattern generator 9, a selector 8, a desired value output circuit 41, and a comparator 31 for each region calculation unit 15-1 to 15-4 within the calculation unit 15. When a test pattern signal generated by the pattern generator 9 is pre-input into the SPAD adder circuit 151 inside the region calculation units 15-1 to 15-4, the desired value output circuit 41 stores the desired value representing the hypothetical output signal output from the region calculation units 15-1 to 15-4.

[0278] During fault diagnosis, each selector 8 selects a test mode signal and inputs the selected test mode signal to the SPAD addition circuit 151. Each of the area calculation units 15-1 to 15-4 processes the test mode signal sequentially, and the output signal of the final stage echo detection circuit 154 is input to comparator 31. Comparator 31 compares the output signal of the echo detection circuit 154 with the expected value output from the expected value output circuit 41, and if they are inconsistent, determines that the corresponding one of the area calculation units 15-1 to 15-4 has failed.

[0279] In this way, the light detection device 10 according to the thirteenth embodiment has a desired value output circuit 41 for each of the region calculation units 15-1 to 15-4, and the circuit size is increased. On the other hand, by comparing the output signal of each of the region calculation units 15-1 to 15-4 with the desired value by the comparator 31, it is possible to identify that one of the region calculation units 15-1 to 15-4 is faulty if it is inconsistent with the desired value.

[0280] <<Application Examples>>

[0281] The technology disclosed herein can be applied to a variety of products. For example, the technology disclosed herein can be implemented as a device installed on any kind of mobile body (such as automobiles, electric vehicles, hybrid electric vehicles, motorcycles, bicycles, personal mobility devices, aircraft, drones, ships, robots, construction machinery, or agricultural machinery (tractors)).

[0282] Figure 31 This is a block diagram illustrating an example of the overall configuration of a vehicle control system 7000, which is an example of a mobile body control system applying the technology according to this disclosure. The vehicle control system 7000 includes multiple electronic control units connected via a communication network 7010. Figure 31 In the example shown, the vehicle control system 7000 includes a drive system control unit 7100, a body system control unit 7200, a battery control unit 7300, an external information detection unit 7400, an internal information detection unit 7500, and an integrated control unit 7600. The communication network 7010 connecting these multiple control units can be, for example, an in-vehicle communication network conforming to any specification such as Controller Area Network (CAN), Local Interconnect Network (LIN), Local Area Network (LAN), FlexRay (registered trademark), etc.

[0283] Each control unit includes a microcomputer that performs arithmetic processing according to various programs, a storage unit that stores the programs executed by the microcomputer, parameters for various arithmetic calculations, and drive circuits that drive various controlled objects. Each control unit includes a network I / F for communicating with other control units via a communication network 7010, and a communication I / F for communicating via wired or wireless communication with devices, sensors, etc., inside or outside the vehicle. Figure 31In the diagram, a microcomputer 7610, a general communication I / F 7620, a dedicated communication I / F 7630, a positioning unit 7640, a beacon receiving unit 7650, an in-vehicle equipment I / F 7660, an audio / image output unit 7670, an in-vehicle network I / F 7680, and a storage unit 7690 are shown as the functional configuration of the integrated control unit 7600. Other control units include a microcomputer, communication I / F, and a storage unit.

[0284] For example, the drive system control unit 7100 controls the operation of devices related to the vehicle's drive system according to various programs. For example, the drive system control unit 7100 functions as a control device, such as a drive force generating device for generating drive force (e.g., an internal combustion engine or drive motor) for generating drive force for the vehicle, a drive force transmission mechanism for transmitting drive force to the wheels, a steering mechanism for adjusting the vehicle's steering angle, and a braking device for generating braking force for the vehicle. The drive system control unit 7100 may have the functions of control devices such as anti-lock braking systems (ABS) and electronic stability control (ESC).

[0285] A vehicle status detection unit 7110 is connected to the drive system control unit 7100. The vehicle status detection unit 7110 includes, for example, a gyroscope sensor for detecting the angular velocity of the vehicle's axial rotational motion, an acceleration sensor for detecting the vehicle's acceleration, and at least one sensor for detecting the amount of operation relative to the accelerator pedal, the amount of operation relative to the brake pedal, the steering angle of the steering wheel, the engine speed, and the wheel speed. The drive system control unit 7100 uses the signals input from the vehicle status detection unit 7110 to perform calculations and control the internal combustion engine, drive motor, electric power steering, braking system, etc.

[0286] The body system control unit 7200 controls the operation of various devices equipped in the vehicle body according to various programs. For example, the body system control unit 7200 is used as a control device for keyless entry systems, smart key systems, power windows, or various lights such as headlights, taillights, brake lights, turn indicators, and fog lights. In this case, instead of signals from buttons or various switches, radio waves emitted from a portable device can be input to the body system control unit 7200. The body system control unit 7200 receives the input radio waves or signals and controls the door locking devices, power windows, and vehicle lights.

[0287] The battery control unit 7300 controls the secondary battery 7310, which serves as the power supply source for the drive motor, according to various programs. For example, information such as battery temperature, battery output voltage, or remaining battery capacity is input from the battery device including the secondary battery 7310 to the battery control unit 7300. The battery control unit 7300 uses such signals to perform arithmetic calculations and to perform temperature regulation control of the secondary battery 7310 or control of cooling devices equipped in the battery device, etc.

[0288] The vehicle exterior information detection unit 7400 detects external information of the vehicle on which the vehicle control system 7000 is installed. For example, at least one of the imaging unit 7410 and the vehicle exterior information detection unit 7420 is connected to the vehicle exterior information detection unit 7400. The imaging unit 7410 includes at least one of a time-of-flight (ToF) camera, a stereo camera, a single-lens camera, an infrared camera, and other cameras. The vehicle exterior information detection unit 7420 includes at least one of, for example, an environmental sensor that detects current weather or atmospheric phenomena and a surrounding information detection sensor that detects other vehicles, obstacles, pedestrians, etc., around the vehicle on which the vehicle control system 7000 is installed.

[0289] For example, the environmental sensor may be at least one of a raindrop sensor for detecting rain, a fog sensor for detecting fog, a sunlight sensor for detecting sunlight intensity, and a snow sensor for detecting snowfall. The environmental information detection sensor may be at least one of an ultrasonic sensor, a radar device, and a LIDAR (light detection and distance measurement or laser imaging detection and distance measurement) device. The imaging unit 7410 and the external information detection unit 7420 may be included as independent sensors or devices, or may be included in a device in which multiple sensors or devices are integrated.

[0290] Here, Figure 32 An example of the mounting positions of imaging unit 7410 and vehicle exterior information detection unit 7420 is shown. Imaging units 7910, 7912, 7914, 7916, and 7918 are provided, for example, at at least one of the following locations in the passenger compartment of vehicle 7900: the front nose, side mirrors, rear bumper, rear door, and upper part of the windshield. Imaging unit 7910 in the front nose and imaging unit 7918 in the upper part of the windshield primarily acquire images of the front of vehicle 7900. Imaging units 7912 and 7914 included in the side mirrors primarily acquire images of the sides of vehicle 7900. Imaging unit 7916 in the rear bumper or rear door primarily acquires images of the rear of vehicle 7900. Imaging unit 7918 in the upper part of the windshield in the passenger compartment is mainly used to detect vehicles, pedestrians, obstacles, traffic lights, traffic signs, lanes, etc.

[0291] exist Figure 32The diagram illustrates examples of the imaging ranges of each imaging unit 7910, 7912, 7914, and 7916. Imaging range a indicates the imaging range of imaging unit 7910 located on the front nose, imaging ranges b and c indicate the imaging ranges of imaging units 7912 and 7914 located on the side mirrors, and imaging range d indicates the imaging range of imaging unit 7916 located on the rear bumper or rear door. For example, by overlaying image data captured by imaging units 7910, 7912, 7914, and 7916, a top-down view of the vehicle 7900 can be obtained.

[0292] The exterior information detection units 7920, 7922, 7924, 7926, 7928, and 7930, located at the front, rear, sides, corners, and top of the windshield within the vehicle compartment of vehicle 7900, can be, for example, ultrasonic sensors or radar devices. The exterior information detection units 7920, 7926, and 7930, located at the front nose, rear bumper, rear door, and top of the windshield within the vehicle compartment of vehicle 7900, can be, for example, LIDAR devices. These exterior information detection units 7920 to 7930 are primarily used for detecting oncoming vehicles, pedestrians, obstacles, etc.

[0293] Refer again Figure 31 Continuing the description. The exterior information detection unit 7400 causes the imaging unit 7410 to capture images of the exterior of the vehicle and receives the captured image data. Additionally, the exterior information detection unit 7400 receives detection information from the connected exterior information detection section 7420. When the exterior information detection section 7420 is an ultrasonic sensor, radar device, or LIDAR device, the exterior information detection unit 7400 transmits ultrasonic waves, electromagnetic waves, etc., and receives information about the received reflected waves. The exterior information detection unit 7400 can perform object detection processing or distance detection processing for people, vehicles, obstacles, signs, and roles on the road surface based on the received information. The exterior information detection unit 7400 can perform environmental recognition processing for identifying rain, fog, road conditions, etc., based on the received information. The exterior information detection unit 7400 can calculate the distance to objects outside the vehicle based on the received information.

[0294] Furthermore, the exterior information detection unit 7400 can perform image recognition processing or distance detection processing based on the received image data to identify people, vehicles, obstacles, signs, text on the road surface, etc. The exterior information detection unit 7400 can perform processing such as distortion correction or alignment on the received image data, and combine image data captured by different imaging units 7410 to generate a bird's-eye view image or a panoramic image. The exterior information detection unit 7400 can use image data captured by different imaging units 7410 to perform viewpoint switching processing.

[0295] The in-vehicle information detection unit 7500 detects information inside the vehicle. For example, a driver state detection unit 7510, which detects the driver's state, is connected to the in-vehicle information detection unit 7500. The driver state detection unit 7510 may include a camera that images the driver, a biosensor that detects the driver's biological information, or a microphone that collects sound from inside the vehicle. For example, the biosensor is disposed on the seat surface, steering wheel, etc., and detects the biological information of passengers sitting in the seat or the driver holding the steering wheel. The in-vehicle information detection unit 7500 may calculate the driver's fatigue level or concentration level, or determine whether the driver has drowned, based on the detected information input from the driver state detection unit 7510. The in-vehicle information detection unit 7500 may perform noise cancellation processing, etc., on the collected sound signals.

[0296] The integrated control unit 7600 controls the overall internal operation of the vehicle control system 7000 according to various programs. An input unit 7800 is connected to the integrated control unit 7600. For example, the input unit 7800 may be implemented via a passenger-operable input device such as a touch panel, button, microphone, switch, lever, etc. Data obtained by performing voice recognition on voice input from the microphone can be input to the integrated control unit 7600. For example, the input unit 7800 may be a remote control device using infrared or other radio waves, or it may be an external connection device, such as a mobile phone or personal digital assistant (PDA), capable of responding to the operation of the vehicle control system 7000. The input unit 7800 may be, for example, a camera, in which case the passenger can input information via gestures. Optionally, data obtained by detecting the movement of a wearable device worn by the passenger can be input. Furthermore, the input unit 7800 may include, for example, an input control circuit that generates an input signal based on information input by the passenger using the input unit 7800 and outputs the input signal to the integrated control unit 7600. Passengers can input various data into the vehicle control system 7000 or instruct processing operations through the operation input unit 7800.

[0297] The storage unit 7690 may include a read-only memory (ROM) for storing various programs executed by a microcomputer and a random access memory (RAM) for storing various parameters, calculation results, sensor values, etc. Furthermore, the storage unit 7690 may be implemented using magnetic storage devices such as hard disk drives (HDDs), semiconductor storage devices, optical storage devices, magneto-optical storage devices, etc.

[0298] The General Communication I / F 7620 is a general communication I / F that mediates communication with various devices existing in the external environment 7750. The General Communication I / F 7620 can implement cellular communication protocols such as GSM (Global System for Mobile Communications), WiMAX, LTE (Long Term Evolution), and LTE-A (LTE-Advanced), as well as other wireless communication protocols such as Wireless LAN (also known as Wi-Fi) and Bluetooth. For example, the General Communication I / F 7620 can connect to devices (e.g., application servers or control servers) existing on external networks (e.g., the Internet, cloud networks, or enterprise-specific networks) via base stations or access points. Furthermore, for example, the General Communication I / F 7620 can use peer-to-peer (P2P) technology to connect to terminals existing near the vehicle (e.g., driver's terminal, pedestrian, or shop or machine-type communication (MTC) terminal).

[0299] The Dedicated Communication I / F 7630 is a communication I / F that supports communication protocols developed for use in vehicles. For example, the Dedicated Communication I / F 7630 can implement standard protocols such as Wireless Access in a Vehicle Environment (WAVE), Dedicated Short Range Communication (DSRC), or cellular communication protocols, which are combinations of the lower layer IEEE 802.11p and the upper layer IEEE 1609. The Dedicated Communication I / F 7630 typically performs V2X communication, which includes one or more concepts such as vehicle-to-vehicle communication, vehicle-to-infrastructure communication, vehicle-to-home communication, and vehicle-to-pedestrian communication.

[0300] The positioning unit 7640 receives GNSS signals (e.g., GPS signals from Global Positioning System (GPS) satellites) from Global Navigation Satellite System (GNSS) satellites, performs positioning, and generates location information including the vehicle's latitude, longitude, and altitude. The positioning unit 7640 can specify its current location by exchanging signals with a wireless access point, or it can obtain location information from a terminal with positioning capabilities (such as a mobile phone, PHS, or smartphone).

[0301] The beacon receiving unit 7650 receives radio waves or electromagnetic waves transmitted from radio stations or similar devices installed on the road, and acquires information such as current location, traffic congestion, no traffic, or estimated time. The functionality of the beacon receiving unit 7650 can be included in the aforementioned dedicated communication I / F 7630.

[0302] The vehicle-mounted device I / F 7660 is a communication interface that mediates the connection between the microcomputer 7610 and various vehicle-mounted devices 7760 present in the vehicle. The vehicle-mounted device I / F 7660 can establish a wireless connection using wireless communication protocols such as Wireless LAN, Bluetooth (registered trademark), NFC (Near Field Communication), or WUSB (Wireless USB). Furthermore, the vehicle-mounted device I / F 7660 can establish a wired connection such as USB (Universal Serial Bus), HDMI (registered trademark) (High-Definition Multimedia Interface), or MHL (Mobile High-Definition Link) via a connection terminal (not shown) (and a cable if necessary). The vehicle-mounted device 7760 may include, for example, at least one of a passenger's mobile device or wearable device, and an information device carried or attached to the vehicle. Additionally, the vehicle-mounted device 7760 may include a navigation device that searches for routes to any destination. The vehicle-mounted device I / F 7660 exchanges control signals or data signals with the vehicle-mounted device 7760.

[0303] The vehicle network I / F 7680 is an interface that mediates communication between the microcomputer 7610 and the communication network 7010. The vehicle network I / F 7680 sends and receives signals according to predetermined protocols supported by the communication network 7010.

[0304] The microcomputer 7610 of the integrated control unit 7600 controls the vehicle control system 7000 according to various programs based on information acquired through at least one of the following: general communication I / F 7620, dedicated communication I / F 7630, positioning unit 7640, beacon receiving unit 7650, in-vehicle equipment I / F 7660, and in-vehicle network I / F 7680. For example, the microcomputer 7610 can calculate control target values ​​for the drive force generating device, steering mechanism, or braking device based on acquired information about the vehicle's interior and exterior, and output control commands to the drive system control unit 7100. For example, the microcomputer 7610 can perform cooperative control to realize the functions of an advanced driver assistance system (ADAS), including vehicle collision avoidance, impact mitigation, speed maintenance driving after distance-based driving, vehicle collision warning, and vehicle lane departure warning. The microcomputer 7610 can perform coordinated control by controlling the drive force generating device, steering mechanism, or braking device based on acquired information about the vehicle's surroundings to perform autonomous driving, regardless of the driver's actions.

[0305] The microcomputer 7610 can generate 3D distance information between a vehicle and objects such as surrounding structures or people based on information acquired via at least one of a general communication I / F 7620, a dedicated communication I / F 7630, a positioning unit 7640, a beacon receiving unit 7650, an in-vehicle device I / F 7660, and an in-vehicle network I / F 7680, and can generate local map information including surrounding information such as the vehicle's current position. The microcomputer 7610 can predict hazards, such as vehicle collisions, pedestrian approach, or entry into a prohibited roadway, based on the acquired information, and can generate warning signals. Warning signals may, for example, be signals used to generate a warning sound or activate warning lights.

[0306] The audio / image output unit 7670 sends an output signal of at least one of audio and image to an output device capable of visually or audibly notifying passengers of the vehicle or outside the vehicle of information. Figure 31 In the example shown, audio speaker 7710, display unit 7720, and dashboard 7730 are shown as output devices. For example, display unit 7720 may include at least one of an in-vehicle display and a head-up display. Display unit 7720 may have augmented reality (AR) display functionality. The output device can be not only this type of device, but also another type of device, such as headphones, wearable devices (such as glasses-type displays worn by passengers), projectors, or lights. When the output device is a display device, it visually displays, in various formats (such as text, images, tables, and graphics), the results obtained through various processes performed by microcomputer 7610 or information received from another control unit. When the output device is a sound output device, it converts audio signals formed from reproduced sound data, sound data, etc., into analog signals and outputs the analog signals audibly.

[0307] exist Figure 31 In the example shown, at least two control units connected via communication network 7010 can be integrated into a single control unit. Optionally, each control unit may consist of multiple control units. Furthermore, the vehicle control system 7000 may include another control unit (not shown). Additionally, as described above, other control units may possess some or all of the functions of any one of the control units. That is, any one of the control units can perform a predetermined computational process as long as information is sent and received via communication network 7010. Similarly, sensors or devices connected to any one of the control units can be connected to other control units, and multiple control units can send detection information to or receive detection information from each other via communication network 7010.

[0308] This technology can also be configured as follows.

[0309] (1) A light detection device, comprising: an array unit configured to have a plurality of light receiving regions and a plurality of light receiving elements disposed in each light receiving region; a calculation unit configured to generate a histogram relating the number of times light is received in the light receiving elements within the pixel and the timing of light reception for each pixel including one or more light receiving elements contained in each of the plurality of light receiving regions; and a fault detection unit configured to detect faults within the calculation unit.

[0310] (2) The light detection apparatus according to (1), wherein the calculation unit includes: a sampling circuit configured to sample the output signals of a plurality of light receiving elements included in each of a plurality of light receiving regions at a predetermined sampling period, and output a detection signal for each pixel indicating that the plurality of light receiving elements have received light; an adder circuit configured to generate a pixel value obtained by adding the number of detection signals of each pixel; and a histogram generation circuit configured to generate a histogram of each pixel in each of the plurality of light receiving regions based on the pixel value generated by the adder circuit, and a fault detection unit detects a fault in at least one of the sampling circuit, the adder circuit, and the histogram generation circuit.

[0311] (3) The light detection device according to (2), wherein the calculation unit includes: a filtering circuit configured to eliminate noise components included in the histogram generated by the histogram generation circuit; an echo detection circuit configured to, after eliminating the noise components using the filtering circuit, measure the distance to the object based on the histogram by detecting the time difference between the time after the projected light until the light is reflected by the object and received by the array unit, and a fault detection unit detects a fault in at least one of the sampling circuit, the addition circuit, the histogram generation circuit, the filtering circuit and the echo detection circuit.

[0312] (4) The optical detection device according to (3), wherein the calculation unit includes a plurality of region calculation units corresponding to each of the plurality of optical receiving regions, each of the plurality of region calculation units includes at least some of the circuits of sampling circuit, addition circuit, histogram generation circuit, filtering circuit and echo detection circuit, and the fault detection unit detects faults in at least some of the circuits of sampling circuit, addition circuit, histogram generation circuit, filtering circuit and echo detection circuit for each of the plurality of region calculation units.

[0313] (5) According to the optical detection device of (4), the fault detection unit inputs the same test mode signal to two of the multiple area calculation units, and determines that either of the two area calculation units has a fault when the output signals of the two area calculation units are different.

[0314] (6) The optical detection device according to (5), wherein the fault detection unit includes: two selectors configured to select whether a test mode signal is input to the input node or internal node of the two area computing units; and a comparator configured to compare the output signals of the two area computing units with each other when the two selectors select the input of the test mode signal.

[0315] (7) According to the optical detection device of (6), the fault detection unit includes two coding units. When the two selectors select the input of the test mode signal, the two coding units generate the coded data of the output signals of the two area calculation units, and the comparator compares the two coded data generated by the two coding units.

[0316] (8) The optical detection device according to any one of (5) to (7), wherein the calculation unit includes two or more even-numbered area calculation units, and the fault detection unit divides the even-numbered area calculation units into two area calculation units in each group, inputs the same test mode signal to the two area calculation units in each group, and determines that either of the two area calculation units is faulty when the output signals of the two area calculation units are not the same.

[0317] (9) The optical detection device according to any one of (5) to (7), wherein the computing unit includes three or more regional computing units, and the fault detection unit uses some regional computing units to divide an odd number of regional computing units into two groups of two regional computing units in a duplex manner, inputs the same test mode signal to the two regional computing units in each group, and determines that either of the two regional computing units is faulty when the output signals of the two regional computing units are different.

[0318] (10) According to the optical detection device of (4), wherein the calculation unit includes three or more of the multiple regional calculation units, the fault detection unit inputs the same test mode signal to the multiple regional calculation units, and determines that some regional calculation units have faults based on whether the output signal of some of the multiple regional calculation units is different from the output signal of the remaining regional calculation units that are greater than some of the regional calculation units.

[0319] (11) The optical detection device according to (6) or (7), wherein each of the plurality of regional computing units has a cascaded multi-stage processing circuit, the multi-stage processing circuit including at least some of the following circuits: sampling circuit, addition circuit, histogram generation circuit, filtering circuit and echo detection circuit; the comparator includes a plurality of comparison units connected to the output nodes of two or more stages of the processing circuit, the output nodes of the two or more stages of the processing circuit being cascaded to the back stage of the selector of each of the plurality of regional computing units; and each of the plurality of comparison units compares the output signals of the output nodes of different stages of the processing circuits in the two regional computing units with each other.

[0320] (12) The optical detection device according to (6) or (7), wherein the computing unit has a multi-stage processing circuit in cascade, including some of the circuits such as a sampling circuit, an addition circuit, a histogram generation circuit, a filtering circuit and an echo detection circuit, and different selectors are connected to the input side of two or more processing circuits in the multi-stage processing circuit, and a test mode signal can be selected using each selector, and wherein a comparator is arranged in association with each selector on the back stage side of the processing circuit, and each selector is connected to the processing circuit.

[0321] (13) The light detection device according to (6) or (7), wherein the number of pixels of the array unit is greater than the number of pixels generated by the calculation unit executing the histogram, the sampling circuit outputs the detection signal of each pixel of the array unit, the addition circuit generates the pixel value of each pixel whose number of pixels is less than the number of pixels of the array unit, and the selector is set between the sampling circuit and the addition circuit, and during normal operation, the detection signal output from the sampling circuit is adjusted over time to be input to the addition circuit, and during fault diagnosis, the test mode signal is input to the addition circuit.

[0322] (14) The light detection device according to (6) or (7), wherein the number of pixels of the array unit is greater than the number of pixels generated by the calculation unit to perform histogram generation, the sampling circuit outputs the detection signal of each pixel of the array unit, the addition circuit generates the pixel value of each pixel of the array unit, and the histogram generation circuit generates a histogram of each pixel whose number of pixels is less than the number of pixels of the array unit, and a selector is arranged between the addition circuit and the histogram generation circuit, which adjusts the pixel value generated by the addition circuit to the histogram generation circuit over time during normal operation, and inputs the test mode signal to the histogram generation circuit during fault diagnosis.

[0323] (15) The optical detection device according to (12), wherein each of the plurality of regional calculation units includes a calculation coefficient storage unit, the calculation coefficient storage unit stores a first calculation coefficient used in the calculation process during normal operation and a second calculation coefficient used in the calculation process during fault diagnosis, the optical detection device further includes a control unit, the control unit being configured to perform control to select one of the first calculation coefficient and the second calculation coefficient and provide the selected calculation coefficient to the multi-level processing circuit and perform selection switching of the selector.

[0324] (16) The optical detection device according to (12), wherein each of the plurality of regional computing units has a first computing coefficient storage unit, the first computing coefficient storage unit stores the first computing coefficient used in the computing process during normal operation, the optical detection device further includes: a second computing coefficient storage unit configured to store the second computing coefficient used in the computing process during fault diagnosis; and a control unit that performs the following control: supplies the first computing coefficient to the multi-level processing circuit during normal operation, and performs the following control during fault diagnosis: supplies the second computing coefficient to the multi-level processing circuit, and performs selection switching of the selection unit.

[0325] (17) The optical detection device according to any one of (5) to (16) further includes a timing control unit, which is configured to control the array unit and the computing unit respectively during a normal operation cycle based on the light generated by the array unit and during a fault diagnosis cycle in which the computing unit performs fault detection based on the test mode signal when the light receiving operation of the array unit is stopped.

[0326] (18) The light detection device according to any one of (5) to (16) further includes a timing control unit, which is configured to perform the following control: inputting a test mode signal to an input node or internal node of the computing unit and outputting a fault diagnosis signal from the computing unit during a cycle in which each processing circuit inside the computing unit performs processing based on the light received by the array unit.

[0327] (19) The optical detection apparatus according to any one of (5) to (18) further includes: a pattern generator configured to generate a test pattern signal comprising a random pattern of time series, wherein the same test pattern signal is provided to multiple area computing units.

[0328] (20) A distance measurement system comprising: a light detection device of any one of (3) to (19); and a light projection unit configured to project light onto an object.

[0329] This disclosure is not limited to the foregoing embodiments, and includes various modifications that can be made by those skilled in the art, and the effects of this disclosure are not limited to the details described above. In other words, various additions, modifications, and partial deletions can be made without departing from the concept and spirit of this disclosure, which can be derived from the details defined in the claims and their equivalents.

[0330] Reference number list

[0331] 1 Distance Measurement System

[0332] 4 Fault Detection Unit

[0333] 5 Control Unit

[0334] 8 Selectors

[0335] 8-1 First Selector

[0336] 8-2 Second Selector

[0337] 9 Pattern Generator

[0338] 9-1 First Pattern Generator

[0339] 9-2 Second Pattern Generator

[0340] 10. Optical Detection Device

[0341] 11 Control Unit

[0342] 13 light-emitting units

[0343] 14 Optical receiving unit

[0344] 15 Computing Units

[0345] 15-1 Regional Computing Unit

[0346] 15-2 Regional Calculation Unit

[0347] 15-3 Regional Computing Unit

[0348] 15-4 Regional Computing Unit

[0349] 19. External Output Interfaces (I / F)

[0350] 20 SPAD pixels

[0351] 21 Optical receiving element

[0352] 21. Photodiode

[0353] 22 circuits

[0354] 22A circuit area

[0355] 23. Quenched resistors

[0356] 24 Select Transistor

[0357] 25 Digital Converters

[0358] 26 Inverters

[0359] 27 Buffer

[0360] 30 macropixels

[0361] 31 Comparator

[0362] 32 coding units

[0363] 33 Register block

[0364] 34-column shift set register

[0365] 35 First Register

[0366] 36 Second Register

[0367] 37 Selector

[0368] 38 Normal Operation Register

[0369] 39 Selector

[0370] 40 Fault Diagnosis Register Block

[0371] 41 Expected Value Output Circuit

[0372] 50 Depth Image

[0373] 80 host

[0374] 90 objects

[0375] 100 chips

[0376] 101 Optical Receiver Chip

[0377] 102 circuit chip

[0378] 120 effective pixel area

[0379] 131 Light Source

[0380] 132 Collimating Lens

[0381] 133 Semi-reflective mirror

[0382] 134 drive units

[0383] 135 galvanometer lens

[0384] 141 SPAD array

[0385] 142 SPAD array used

[0386] 143 Timing Control Circuit

[0387] 144 drive circuit

[0388] 145 Output Circuit

[0389] 146 Light receiving lens

[0390] 150 sampling circuit

[0391] 151 SPAD Adder Circuit

[0392] 152 Histogram Circuit

[0393] 153 Filtering Circuit

[0394] 154 Echo Detection Circuit

[0395] Register block 155

[0396] 251 Resistor

[0397] 915 Computing Units

[0398] 916 Calculation coefficients

Claims

1. A light detection device, comprising: The array unit is configured to have multiple light receiving regions and multiple light receiving elements arranged in each of the light receiving regions; A calculation unit, for each pixel including one or more light receiving elements contained in each of the plurality of light receiving regions, is configured to generate a histogram relating the number of times light is received in the light receiving elements within the pixel and the timing of light reception. The calculation unit includes a calculation coefficient storage unit that stores first calculation coefficients used in calculation processing during normal operation and second calculation coefficients used for signal calculation processing during fault detection. The control unit is configured to perform control to select the first calculation coefficient and provide the selected first calculation coefficient to the calculation unit, and is also configured to provide the second calculation coefficient to the calculation unit when performing fault diagnosis on the calculation unit; as well as The fault detection unit is configured to detect internal faults of the calculation unit based on the signal calculation processing performed using the second calculation coefficients.

2. The optical detection device according to claim 1, wherein The computing unit includes: The sampling circuit is configured to sample the output signals of a plurality of light-receiving elements included in each of the plurality of light-receiving regions at a predetermined sampling period and output a detection signal for each pixel indicating that the plurality of light-receiving elements have received light; An adder circuit is configured to generate a pixel value obtained by adding the number of detection signals for each pixel; A histogram generation circuit is configured to generate a histogram for each pixel in each of a plurality of light-receiving regions based on the pixel values ​​generated by the addition circuit, and The fault detection unit detects faults in at least one of the sampling circuit, the addition circuit, and the histogram generation circuit.

3. The optical detection device according to claim 2, wherein The computing unit includes: A filtering circuit is configured to eliminate noise components included in the histogram generated by the histogram generation circuit; and The echo detection circuit is configured to measure the distance to the object by detecting the time difference between the time after light is projected and the time between the light being reflected by the object and received by the array unit, based on the histogram after the noise components have been eliminated using the filtering circuit. The fault detection unit detects faults in at least one of the sampling circuit, the addition circuit, the histogram generation circuit, the filtering circuit, and the echo detection circuit.

4. The optical detection device according to claim 3, wherein The computing unit includes multiple region computing units corresponding to each of the plurality of optical receiving regions. Each of the plurality of said region calculation units includes at least some of the following circuits: the sampling circuit, the addition circuit, the histogram generation circuit, the filtering circuit, and the echo detection circuit. The fault detection unit detects faults in at least some of the circuits in the sampling circuit, the addition circuit, the histogram generation circuit, the filtering circuit, and the echo detection circuit for each of the plurality of region calculation units.

5. The light detecting device according to claim 4, wherein The fault detection unit inputs the same test mode signal to two of the multiple regional computing units, and determines that either of the two regional computing units is faulty if the output signals of the two regional computing units are different.

6. The light detecting device according to claim 5, wherein The fault detection unit includes: Two selectors are configured to select whether the test mode signal is input to the input node or internal node of the two region computing units; and The comparator is configured to compare the output signals of the two region calculation units with each other when the two selectors select the input of the test mode signal.

7. The optical detection device according to claim 6, wherein, The fault detection unit includes two encoding units. When the two selectors select the input of the test mode signal, the two encoding units generate encoded data of the output signals of the two area calculation units. The comparator compares the two encoded data generated by the two encoding units.

8. The optical detection device according to claim 5, wherein The computing unit includes two or more even-numbered region computing units, and The fault detection unit divides an even number of the area calculation units into two area calculation units per group, inputs the same test mode signal to the two area calculation units in each group, and determines that either of the two area calculation units is faulty if the output signals of the two area calculation units are different.

9. The optical detection device according to claim 5, wherein The computing unit comprises three or more odd-numbered region computing units, and The fault detection unit uses some of the regional computing units in a duplex manner to divide an odd number of regional computing units into multiple groups of two regional computing units, inputs the same test mode signal to the two regional computing units in each group, and determines that either of the two regional computing units is faulty when the output signals of the two regional computing units are different.

10. The optical detection device according to claim 5, wherein The computing unit includes three or more regional computing units, and The fault detection unit inputs the same test mode signal to multiple regional computing units, and determines that some of the regional computing units are faulty based on whether the output signals of some of the regional computing units are different from the output signals of the remaining regional computing units that are more numerous than some of the regional computing units.

11. The optical detection device according to claim 6, wherein Each of the plurality of said regional computing units has cascaded multi-stage processing circuits, said multi-stage processing circuits including at least some of the sampling circuit, the addition circuit, the histogram generation circuit, the filtering circuit, and the echo detection circuit. The comparator includes multiple comparison units connected to the output nodes of two or more stages of the processing circuitry, and the output nodes of the two or more stages of the processing circuitry are cascaded to the downstream side of the selector of each of the multiple region computing units. Each of the plurality of comparison units compares the output signals of the output nodes of the processing circuits at different levels in the two region computing units with each other.

12. The optical detection device according to claim 6, wherein The computing unit has cascaded multi-stage processing circuits, including some circuits from the sampling circuit, the addition circuit, the histogram generation circuit, the filtering circuit, and the echo detection circuit. In this circuit, different selectors are connected to the input sides of two or more processing circuits in a multi-stage processing circuit, and the test mode signal can be selected using each of the selectors. The comparator is arranged in association with each of the selectors on the back stage of the processing circuit, and each of the selectors is connected to the back stage of the processing circuit.

13. The optical detection device according to claim 6, wherein The number of pixels in the array unit is greater than the number of pixels generated by the calculation unit when executing the histogram. The sampling circuit outputs the detection signal for each pixel of the array unit. The addition circuit generates a pixel value for each pixel whose number of pixels is less than the number of pixels in the array unit. The selector is arranged between the sampling circuit and the addition circuit. During normal operation, it adjusts the input of the detection signal output from the sampling circuit to the addition circuit over time, and during fault diagnosis, it inputs the test mode signal to the addition circuit.

14. The optical detection device according to claim 6, wherein, The number of pixels in the array unit is greater than the number of pixels generated by the calculation unit when executing the histogram. The sampling circuit outputs the detection signal for each pixel of the array unit. The addition circuit generates the pixel value of each pixel in the array unit. The histogram generation circuit generates a histogram for each pixel whose number of pixels is less than the number of pixels in the array unit. The selector is arranged between the addition circuit and the histogram generation circuit. During normal operation, it adjusts the pixel value generated by the addition circuit over time and inputs it to the histogram generation circuit. During fault diagnosis, it inputs the test mode signal to the histogram generation circuit.

15. The light detecting device of claim 5, further comprising: The timing control unit is configured to control the array unit and the computing unit respectively during a normal operation cycle in which the histogram is generated based on the light received by the array unit, and during a fault diagnosis cycle in which the computing unit performs fault detection based on the test mode signal when the light receiving operation of the array unit is stopped.

16. The light detecting device of claim 5, further comprising: The timing control unit is configured to control the input of the test mode signal to the input node or internal node of the computing unit and the output of the fault diagnosis signal from the computing unit during the cycle of processing based on the light received by the array unit in each processing circuit within the computing unit.

17. The light detecting device of claim 5, further comprising: The pattern generator is configured to generate test pattern signals that include random patterns from a time series. The same test mode signal is provided to multiple regional computing units.

18. A distance measurement system, comprising: The optical detection device according to claim 3; as well as A light projection unit is configured to project light onto the object.

Citation Information

Patent Citations

  • Photoelectric sensor

    JP2008058291A

  • Signal processing device and method, and program

    JP2019004361A

  • Distance measurement device, on-vehicle system, and distance measurement method

    JP2020118567A