Light detection device, imaging device, and electronic apparatus

Abstract

To improve sensitivity in a pixel for acquiring an image plane phase difference.SOLUTION: A light detection device comprises a pixel array, a conversion unit, and a phase difference detection unit. The pixel array is provided with a plurality of pixel groups in a two-dimensional array pattern. The conversion unit is provided for at least each of the pixel groups and converts an analog signal based on the intensity of light acquired in the pixel group into a digital signal. The phase difference detection unit detects a phase difference on the basis of the digital signal generated by the conversion unit. The pixel groups each include a plurality of light-receiving pixels including at least a first light-receiving pixel and a second light-receiving pixel, and has an on-chip lens disposed on the incident surface side of the plurality of light-receiving pixels. The phase difference detection unit detects a phase difference on the basis of a first digital signal corresponding to an analog signal output from the first light-receiving pixel and a second digital signal corresponding to an analog signal output from the second light-receiving pixel.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present disclosure relates to a light detection device, an imaging device, and an electronic device. [Background technology]

[0002] In a solid-state imaging device having an ADC (Analog to Digital Converter) for each pixel, a comparator circuit is provided in the pixel, and one OCL (On-Chip Lens) is provided for each pixel. In such a configuration, the pixel that acquires the image plane phase difference has a structure in which the pixel is shielded by a light-shielding film such as a metal film, which causes a problem of reduced sensitivity of the image plane phase difference pixel. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2022-033756 A Summary of the Invention [Problem to be solved by the invention]

[0004] Therefore, one of the non-limiting problems that the embodiments of the present disclosure aim to solve is to improve the sensitivity of the pixels that acquire the image plane phase difference. The problem that the embodiments of the present disclosure aim to solve can be, as some non-limiting examples, a problem corresponding to the effects described in the embodiments. That is, a problem that corresponds to at least one of the effects described in the description of the embodiments of the present disclosure can be the problem that the present disclosure aims to solve. [Means for solving the problem]

[0005] According to one embodiment, a photodetection device includes a pixel array, a conversion unit, and a phase difference detection unit. The pixel array includes a plurality of pixel groups arranged in a two-dimensional array. A conversion unit is provided for at least each of the pixel groups, and converts an analog signal based on the light intensity acquired in the pixel group into a digital signal. The phase difference detection section detects a phase difference based on the digital signal generated in the conversion section. The pixel group is The image sensor includes a plurality of light receiving pixels including at least a first light receiving pixel and a second light receiving pixel, an on-chip lens disposed on an incident surface side of the plurality of light receiving pixels; has. The phase difference detection unit detects a phase difference based on a first digital signal corresponding to an analog signal output from the first light receiving pixel and a second digital signal corresponding to an analog signal output from the second light receiving pixel.

[0006] The conversion section may be provided for each of the plurality of light receiving pixels.

[0007] The plurality of light receiving pixels may receive light using a global shutter system, convert an analog signal into a digital signal, and output the digital signal.

[0008] The phase difference detection section may detect a phase difference based on signals output from the first light receiving pixel and the second light receiving pixel included in the same pixel group.

[0009] The phase difference detection section may detect a phase difference based on signals output from the first light receiving pixel and the second light receiving pixel included in different pixel groups.

[0010] The first light receiving pixel and the second light receiving pixel may be provided at positions shifted in a line direction in the pixel group.

[0011] The first light receiving pixel and the second light receiving pixel may be provided at positions shifted in a column direction in the pixel group.

[0012] The plurality of light receiving pixels belonging to the pixel group may share a floating diffusion region.

[0013] The plurality of light receiving pixels belonging to the pixel group may convert analog signals into digital signals within the pixel group by a rolling shutter system.

[0014] The floating diffusion region of each of the light receiving pixels belonging to the pixel group may be disposed at a position away from a light collecting position in a top view.

[0015] According to one embodiment, an imaging device includes a pixel array, a conversion unit, a phase difference detection unit, and an output unit. The pixel array includes a plurality of pixel groups arranged in a two-dimensional array. A conversion unit is provided for at least each of the pixel groups, and converts an analog signal based on the light intensity acquired in the pixel group into a digital signal. The phase difference detection unit detects a phase difference based on the digital signal generated by the conversion unit. The output unit outputs image data based on the digital signal generated by the conversion unit. The pixel group is The image sensor includes a plurality of light receiving pixels including at least a first light receiving pixel and a second light receiving pixel, an on-chip lens disposed on an incident surface side of the plurality of light receiving pixels; having The phase difference detection unit detects a phase difference based on a first digital signal corresponding to an analog signal output from the first light receiving pixel and a second digital signal corresponding to an analog signal output from the second light receiving pixel.

[0016] According to one embodiment, an electronic device includes any of the light detection devices or imaging devices described above. [Brief description of the drawings]

[0017] [Figure 1] FIG. 1 is a block diagram illustrating an example of a light detection device according to an embodiment. [Diagram 2]FIG. 2 is a diagram illustrating an example of a pixel array according to an embodiment. [Diagram 3] FIG. 2 is a diagram illustrating an example of a pixel array according to an embodiment. [Figure 4] FIG. 2 is a diagram illustrating an example of a light receiving pixel according to an embodiment. [Diagram 5] FIG. 2 is a diagram illustrating an example of an on-chip lens according to an embodiment. [Figure 6] FIG. 2 is a diagram illustrating an example of a pixel array according to an embodiment. [Figure 7] FIG. 2 is a diagram illustrating an example of a pixel array according to an embodiment. [Figure 8] FIG. 2 is a diagram showing an example of a top perspective view of a pixel group according to an embodiment. [Figure 9] FIG. 2 is a diagram showing an example of a top perspective view of a pixel group according to an embodiment. [Figure 10] FIG. 2 is a diagram showing an example of a top perspective view of a pixel group according to an embodiment. [Figure 11] FIG. 2 is a diagram showing an example of a top perspective view of a pixel group according to an embodiment. [Figure 12] 1 is a block diagram showing an example of a schematic configuration of a vehicle control system; [Figure 13] 4 is an explanatory diagram showing an example of the installation positions of an outside-vehicle information detection unit and an imaging unit; FIG. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0018] Hereinafter, the embodiments of the present disclosure will be described with reference to the drawings. The drawings are used for explanation, and the shape, size, or size ratio of each component in an actual device to other components does not necessarily have to be as shown in the drawings. In addition, since the drawings are simplified, components necessary for implementation other than those shown in the drawings are also appropriately provided.

[0019] 1 is a diagram illustrating an example of a photodetection device according to an embodiment. The photodetection device 1 includes at least a pixel array 10, a row selection circuit 12, a column selection circuit 14, an AD conversion circuit 16, and a signal processing circuit 18. The photodetection device 1 also includes components necessary for detecting light, such as a control unit (control circuit) that controls each circuit, and a power supply unit (power supply circuit) that supplies power to each circuit. One example of the photodetection device 1 is a solid-state imaging device that generates image data.

[0020] The photodetector 1 obtains image information according to the intensity of light irradiated onto the pixel array 10, and obtains a phase difference based on the position of the pixel. The phase difference may be a phase difference on an image plane.

[0021] The pixel array 10 is an area that receives light and includes pixels arranged in a two-dimensional array.

[0022] The row selection circuit 12 scans a line in the pixel array 10 and sequentially outputs signals acquired by pixels belonging to that line to the signal processing circuit 18 .

[0023] The column selection circuit 14 selects a column in the pixel array 10 to specify a column in the line being scanned by the row selection circuit 12, and outputs a signal to the signal processing circuit 18.

[0024] The AD conversion circuit 16 converts analog signals generated by the pixels belonging to the pixel array 10 through photoelectric conversion into digital signals and outputs the digital signals. As an example, the AD conversion circuit 16 is provided in the circuit of each pixel belonging to the pixel array 10. The AD conversion circuit 16 operates as a conversion unit in the photodetector 1 that converts analog signals into digital signals.

[0025] The AD conversion circuit 16 can be arranged as a part of the pixel circuit for each pixel, and image data can be acquired by the global shutter method by providing the AD conversion circuit 16 for each pixel. In this case, the transfer transistor in each pixel circuit may have a memory that holds signal values ​​for one frame.

[0026] The signal processing circuit 18 is a circuit that performs signal processing on the digital signal converted by the AD conversion circuit 16. The signal processing circuit 18 can generate image data from the digital signal and execute various filter processing, color processing, etc. As one of the signal processing, the signal processing circuit 18 can also obtain a phase difference, in particular an image plane phase difference, based on signals output from a plurality of pixels output from the AD conversion circuit 16.

[0027] The signal processing circuit 18 can obtain the phase difference on the image plane by obtaining the phase difference of light reflected, transmitted, irradiated, etc. from the same point on the subject based on the output of a first pixel (first light receiving pixel) arranged at a certain position and a second pixel (second light receiving pixel) arranged at a position different from the first pixel. In this case, the signal processing circuit 18 operates as a phase difference detection unit in the photodetection device 1 as a part thereof.

[0028] The calculation of the phase difference from the acquired signal value can be realized by a general method. For example, the signal processing circuit 18 can obtain the image plane phase difference by using a conventional calculation method for obtaining an arbitrary phase difference, which calculates the phase difference based on a pixel value whose left half is shaded and a pixel value whose right half is shaded, which exist on the same line.

[0029] The configuration of the pixels belonging to the pixel array 10 will now be described using some non-limiting examples.

[0030] (First embodiment) 2 is a diagram showing an example of an arrangement of pixel groups in a pixel array 10 according to an embodiment. In the pixel array 10, pixel groups 100 are arranged in a two-dimensional array.

[0031] The pixel group 100 is arranged in the pixel array 10 so as to form a two-dimensional array with respect to a first direction and a second direction intersecting the first direction. The first direction is, for example, a line direction, and the second direction is, for example, a column direction.

[0032] Each pixel group 100 includes a plurality of light receiving regions (light receiving elements, light receiving pixels), and generates and outputs an analog signal based on the intensity of light irradiated to each light receiving region. In addition, the pixel group 100 may include an AD conversion circuit 16 for each light receiving region (light receiving pixel) belonging to the pixel group 100, and an analog signal generated in the light receiving region can be converted into a digital signal and output for each pixel group 100. By providing an AD conversion circuit 16 for each light receiving region of the pixel group 100 as described above, it is possible to output a signal in a global shutter system.

[0033] 3 is a diagram showing a more specific example of the arrangement of the pixel groups. The pixel group 100 may be, for example, a pixel group 100R that receives red light, a pixel group 100G that receives green light, and a pixel group 100b that receives blue light, arranged in a Bayer array.

[0034] 3, light of a predetermined color may be received by each pixel group 100. For example, pixel groups having light receiving regions that receive visible light, such as a pixel group 100 that receives white light and a pixel group 100 that receives light of each color of cyan, magenta, and yellow, or pixel groups that receive light in bands other than visible light, such as ultraviolet light and infrared light (including a plasmon filter), may be arranged.

[0035] 4 is a diagram showing an example of an arrangement of light receiving pixels in a pixel group 100 according to an embodiment. The pixel group 100 includes, as a non-limiting example, a light receiving pixel 102, a light receiving pixel 104, a light receiving pixel 106, and a light receiving pixel 108.

[0036] As shown in the figure, the pixel group 100 includes, for example, 2 × 2 light receiving pixels, which can function to act as a single light receiving region. As described above, the pixel group 100 includes, for example, light receiving pixels 102, 104, 106, and 108 as light receiving regions corresponding to the same color.

[0037] The photosensitive pixel 102, the photosensitive pixel 104, the photosensitive pixel 106, and the photosensitive pixel 108 each have a light-receiving region (photoelectric conversion region) that generates an analog signal from the intensity of light incident on each region in the pixel group 100, and the analog signal acquired in this light-receiving region can be converted into a digital signal via an AD conversion circuit 16 provided in each photosensitive pixel and output. In other words, the pixel group 100 can output the digital signals output from the photosensitive pixel 102, the photosensitive pixel 104, the photosensitive pixel 106, and the photosensitive pixel 108 as a signal of one color.

[0038] For example, the signal processing circuit 18 can use the average value of the signal values ​​output from photosensitive pixel 102, photosensitive pixel 104, photosensitive pixel 106, and photosensitive pixel 108 as the pixel value to represent the intensity of light incident on the pixel group 100.

[0039] As another example, a mosaic process or color matrix process can be performed based on the signal values ​​output from each light-receiving pixel to obtain an appropriate color output value. The mosaic process can also be performed by weighting based on the positions of the light-receiving pixel 102, the light-receiving pixel 104, the light-receiving pixel 106, and the light-receiving pixel 108 in each pixel group 100 according to the Bayer array shown in FIG.

[0040] An on-chip lens 110 is provided across a plurality of light receiving pixels on the incident surface side of the pixel group 100. The on-chip lens 110 is a lens that appropriately focuses light incident on the pixel group 100.

[0041] 5 is a diagram (a simplified cross-sectional view taken along line AA in FIG. 4) showing the pixel group 100 and the on-chip lens 110 from the front. As shown in this figure, the pixel group 100 is provided with an on-chip lens 110 on the light receiving surface side.

[0042] The light-shielding film 112 is a film that appropriately controls the light-receiving region in the light-receiving pixels of the pixel group 100, and is a film formed of a material that appropriately blocks light in the band received by the pixel group 100, such as a metal thin film, a semiconductor thin film, or an insulating thin film (oxide film). The light-shielding film 112 is disposed on the light emission side of the on-chip lens 110 to prevent light that has passed through the on-chip lens 110 from sparsely leaking to adjacent lenses.

[0043] Each light-receiving pixel acquires an analog signal based on the intensity of light incident on the light-receiving surface side in the photoelectric conversion region 114, and outputs the signal to the outside via the transfer transistor TG.

[0044] In the drawings, color filters and the like are omitted from the photoelectric conversion region 114, but are assumed to be appropriately arranged. The light-shielding film 112 is arranged on the incident surface side of the photoelectric conversion region 114 so as to partially block light entering surrounding pixels. The light-shielding film 112 may be provided, for example, between the color filter and the photoelectric conversion region 114, or may be provided above the color filter. In other words, the light-shielding film 112 may be provided directly below the on-chip lens 110 so as to be in contact with the on-chip lens 110 or not in contact with the on-chip lens 110.

[0045] In addition, in the drawing, the light-shielding film 112 is disposed so as to be embedded in the photoelectric conversion region 114, but this is not limited thereto. The light-shielding film 112 may be disposed on the upper surface of the photoelectric conversion region 114.

[0046] The transfer transistor TG is a transistor that operates as a gate to output an analog signal generated in the photoelectric conversion region 114 to a floating diffusion region. The analog signal propagated to the floating diffusion region is converted into a digital signal in an AD conversion circuit 16 provided for each light receiving pixel, i.e., each photoelectric conversion region, and this digital signal is supplied to a signal processing circuit 18.

[0047] Each photoelectric conversion region 114 is disposed so as to be appropriately insulated by an insulating film. By acquiring a signal based on the intensity of light incident on each photoelectric conversion region 114, it is possible to acquire a pixel value for each light-receiving pixel in the pixel group.

[0048] Here, for example, by considering the photosensitive pixels 106 and 108 as first photosensitive pixels and the photosensitive pixels 102 and 104 as second photosensitive pixels, when the pixel group 100 is considered as one pixel, the first photosensitive pixel can obtain the intensity of light incident on the right half, and the second photosensitive pixel can obtain the intensity of light incident on the left half.

[0049] Within the same pixel group 100, at least a part of the signal processing circuit 18 operating as a phase difference detection unit can obtain the left and right phase difference in the same pixel group from the signal values ​​of the first light receiving pixel and the second light receiving pixel set as described above.

[0050] Also, as shown in FIG. 6 which illustrates an example of a pixel array according to one embodiment, a phase difference can be obtained between two pixel groups, pixel group 100a and pixel group 100b, which are located at any position on the same line (first direction).

[0051] The signal processing circuit 18 can acquire an image plane phase difference (a general image plane phase difference) along the line direction based on, for example, the signal values ​​of the photosensitive pixels 106 and 108, which are the first photosensitive pixels of the pixel group 100a, and the signal values ​​of the photosensitive pixels 102 and 104, which are the second photosensitive pixels of the pixel array 101b.

[0052] The setting of the first light receiving pixel and the second light receiving pixel is not limited to the above. For example, the light receiving pixel 104 and the light receiving pixel 108 in Fig. 4 may be the first light receiving pixel, and the light receiving pixel 102 and the light receiving pixel 106 may be the second light receiving pixel.

[0053] In this case, as shown in FIG. 7 which illustrates an example of a pixel array according to one embodiment, a phase difference in the column direction can be obtained between two pixel groups, pixel group 100a and pixel group 100b, which are located at any position in the same column (second direction).

[0054] The signal processing circuit 18 can acquire an image plane phase difference along the column direction based on, for example, the signal values ​​of the photosensitive pixels 104 and 108, which are the first photosensitive pixels of the pixel group 100a, and the signal values ​​of the photosensitive pixels 102 and 106, which are the second photosensitive pixels of the pixel group 100b.

[0055] That is, at least a part of the signal processing circuit 18 serving as a phase difference detection unit can acquire the image plane phase difference in the first direction or the second direction based on the signal values ​​output from the first light receiving pixel and the second light receiving pixel provided in different pixel groups 100.

[0056] The phase difference can be appropriately obtained by using a global shutter system in which an AD conversion circuit 16 is provided for each light-receiving pixel.

[0057] Note that the phase difference is not limited to the above, and for example, in two pixel groups 100 that exist at positions shifted by the same number in the line direction and column direction, an image plane phase difference in the 45-degree direction can be obtained based on the signal value of the photosensitive pixel 108 as the first photosensitive pixel and the signal value of the photosensitive pixel 102 as the second photosensitive pixel. In this case, it is also possible to use the photosensitive pixels 104, 106, and 108 as the first photosensitive pixels, and the photosensitive pixels 102, 104, and 106 as the second photosensitive pixels.

[0058] In addition, the pixel group that acquires the image plane phase difference may be a pixel group that acquires light of the same color, or may be a pixel group that acquires light of different colors. When acquiring a phase difference in a pixel group that acquires light of different colors, it is also possible to acquire the phase difference based on a signal value weighted for each band of the acquired light.

[0059] As described above, according to this embodiment, it is possible to appropriately acquire the image plane phase difference by using a normal pixel (light receiving pixel in the above embodiment) without arranging a pixel that acquires the light intensity of a different region in the photoelectric conversion region by arranging a light shielding film on the incident surface side of the pixel. As a result, it is possible to acquire the phase difference without blocking the intensity of light incident from the light receiving surface side of the pixel, and it is possible to appropriately acquire the image plane phase difference without deteriorating the signal value in the pixel for acquiring the image plane phase difference.

[0060] In addition, since it is possible to obtain a phase difference using normal pixels without setting pixels that obtain a phase difference by a light-shielding film on the light-receiving surface side, the first light-receiving pixel and the second light-receiving pixel can be set arbitrarily as described above. Therefore, by using the pixel group and light-receiving pixel in the present disclosure, it is possible to appropriately obtain an image plane phase difference at any timing using pixels belonging to any line and column, or pixels belonging to a 45-degree direction.

[0061] In the above, the pixel group 100 is provided with 2×2 light receiving pixels, that is, one on-chip lens 110 has 2×2 light receiving pixels, but the present invention is not limited to this. For example, the pixel group 100 may have 3×3 light receiving pixels or 4×4 light receiving pixels. When the pixel group 100 has 3×3 light receiving pixels, the pixel group 100 may be divided into pixels belonging to the left, center, and right, and the left column may be the second pixel and the right column may be the first pixel to obtain a phase difference in the line direction, or the left and center columns may be the second pixels and the center and right columns may be the second pixels to obtain a phase difference in the line direction. The same applies to the case of 4×4 light receiving pixels. The same can be applied to the phase difference in the column direction and the phase difference in the diagonal direction.

[0062] Furthermore, the pixel configuration in pixel group 100 is not limited to including the same number of light-receiving pixels in the line and column directions as described above, but may include a different number of light-receiving pixels, such as 2 x 3 pixels.

[0063] Second embodiment In the above-described embodiment, a method for acquiring a phase difference from a light receiving pixel has been described. In the present embodiment, however, a non-limiting example of the arrangement of components when implementing the above processing will be described.

[0064] 8 is a top perspective view showing an example of the positional relationship between the photoelectric conversion region 114, the transfer transistor TG, and the floating diffusion region FD in a pixel group according to an embodiment. In the figure, the configuration of each light receiving pixel belonging to one pixel group 100 is shown. The circle shown by the dotted line indicates, for example, an area where light incident vertically on the light receiving region is collected by the on-chip lens 110.

[0065] 8, each light-receiving pixel can have a transfer transistor TG and a floating diffusion region FD that are in the same positional relationship with respect to the photoelectric conversion region 114. In this case, the light-receiving pixels in the pixel array 10 can have the same configuration, making it easy to maintain the consistency of the circuit as a whole.

[0066] 9 is a top perspective view showing an example of the positional relationship between the photoelectric conversion region 114, the transfer transistor TG, and the floating diffusion region FD in a pixel group according to an embodiment. Unlike in FIG. 8, the floating diffusion region FD is disposed at a position far from the light collecting region.

[0067] 10 is a top perspective view showing an example of the positional relationship between the photoelectric conversion region 114, the transfer transistor TG, and the floating diffusion region FD in a pixel group according to an embodiment. As in FIG. 9, the floating diffusion region FD is disposed at a position far from the light collecting region. Compared to FIG. 9, the distance between the light collecting region and the floating diffusion region FD is disposed more uniformly in each light receiving pixel.

[0068] As shown in the examples of Figures 9 and 10, by placing the floating diffusion region FD away from the region where more light is collected, it is possible to reduce PLS (parasitic light sensitivity).

[0069] 11 is a top perspective view showing an example of the positional relationship between the photoelectric conversion region 114, the transfer transistor TG, and the floating diffusion region FD in a pixel group according to an embodiment. In contrast to Figures 9 and 10, the transfer transistor TG is disposed in a region close to the light collecting region. In this arrangement, the floating diffusion region FD can be shared by each of the light receiving pixels belonging to the pixel group 100.

[0070] The floating diffusion region FD can be shared by multiple light receiving pixels, that is, the AD conversion circuit 16 connected via this floating diffusion region FD can be shared by multiple light receiving pixels belonging to the pixel group 100. Unlike any of the above-mentioned forms, an AD conversion circuit 16 is provided for each pixel group 100, rather than for each light receiving pixel.

[0071] In this case, it is possible to reduce the number of AD conversion circuits 16 compared to the above-mentioned embodiment, and it is possible to increase the degree of freedom in layout. In the multiple light receiving pixels belonging to the pixel group 100, signals are acquired in the rolling shutter format, but since the rolling shutter is applied to an extremely small number of light receiving pixels, it is possible to acquire an image close to that of a global shutter with the occurrence of rolling shutter distortion suppressed, and to acquire a phase difference.

[0072] As described above, various arrangements can be used in this embodiment, and the layout can be configured with a high degree of freedom in terms of the application and relationship with other configurations.

[0073] According to the embodiment of the present disclosure, for example, since it is not necessary to shade half of the pixel with a metal film, it is possible to improve the sensitivity, and since the global shutter method is adopted, it is possible to obtain the image plane phase difference without rolling shutter distortion in either the line direction or the column direction. Also, as described in the second embodiment, various layouts can be used.

[0074] The photodetector 1 in each of the above-described embodiments is capable of obtaining a phase difference based on signals output from a plurality of light-receiving pixels, and also capable of obtaining highly sensitive image information in an unshielded state.

[0075] Moreover, the photodetector 1 can be used in electronic devices including the above-described solid-state imaging device, such as imaging devices in vehicle-mounted devices, smartphones, tablet terminals, and drones.

[0076] The technology according to the present disclosure can be applied to various products. For example, the technology according to the present disclosure may be realized as a device mounted on any type of moving body such as an automobile, an electric vehicle, a hybrid electric vehicle, a motorcycle, a bicycle, a personal mobility device, an airplane, a drone, a ship, a robot, a construction machine, an agricultural machine (tractor), etc.

[0077] 12 is a block diagram showing a schematic configuration example of a vehicle control system 7000 which is an example of a mobile object control system to which the technology according to the present disclosure can be applied. The vehicle control system 7000 includes a plurality of electronic control units connected via a communication network 7010. In the example shown in FIG. 12, the vehicle control system 7000 includes a drive system control unit 7100, a body system control unit 7200, a battery control unit 7300, an outside-vehicle information detection unit 7400, an inside-vehicle information detection unit 7500, and an integrated control unit 7600. The communication network 7010 connecting these multiple control units may be an in-vehicle communication network conforming to any standard such as CAN (Controller Area Network), LIN (Local Interconnect Network), LAN (Local Area Network), or FlexRay (registered trademark).

[0078] Each control unit includes a microcomputer that performs arithmetic processing according to various programs, a storage unit that stores the programs executed by the microcomputer or parameters used in various calculations, and a drive circuit that drives various control target devices. Each control unit includes a network I / F for communicating with other control units via a communication network 7010, and a communication I / F for communicating with devices or sensors inside and outside the vehicle by wired communication or wireless communication. In FIG. 12, a microcomputer 7610, a general-purpose communication I / F 7620, a dedicated communication I / F 7630, a positioning unit 7640, a beacon receiving unit 7650, an in-vehicle device I / F 7660, an audio / video output unit 7670, an in-vehicle network I / F 7680, and a storage unit 7690 are illustrated as the functional configuration of the integrated control unit 7600. Other control units also include a microcomputer, a communication I / F, a storage unit, and the like.

[0079] The drivetrain control unit 7100 controls the operation of devices related to the drivetrain of the vehicle according to various programs. For example, the drivetrain control unit 7100 functions as a control device for a drive force generating device for generating a drive force of the vehicle, such as an internal combustion engine or a drive motor, a drive force transmission mechanism for transmitting the drive force to the wheels, a steering mechanism for adjusting the steering angle of the vehicle, and a braking device for generating a braking force of the vehicle. The drivetrain control unit 7100 may also function as a control device such as an ABS (Antilock Brake System) or an ESC (Electronic Stability Control).

[0080] A vehicle state detection unit 7110 is connected to the drive system control unit 7100. The vehicle state detection unit 7110 includes at least one of a gyro sensor that detects the angular velocity of the axial rotational motion of the vehicle body, an acceleration sensor that detects the acceleration of the vehicle, or a sensor for detecting the amount of operation of an accelerator pedal, the amount of operation of a brake pedal, the steering angle of a steering wheel, the engine rotation speed, or the rotation speed of wheels, for example. The drive system control unit 7100 performs arithmetic processing using signals input from the vehicle state detection unit 7110, and controls the internal combustion engine, the drive motor, the electric power steering device, the brake device, etc.

[0081] The body system control unit 7200 controls the operation of various devices mounted on the vehicle body according to various programs. For example, the body system control unit 7200 functions as a control device for a keyless entry system, a smart key system, a power window device, or various lamps such as head lamps, back lamps, brake lamps, turn signals, and fog lamps. In this case, radio waves or signals of various switches transmitted from a portable device that replaces a key may be input to the body system control unit 7200. The body system control unit 7200 receives the input of these radio waves or signals and controls the door lock device, power window device, lamps, and the like of the vehicle.

[0082] The battery control unit 7300 controls the secondary battery 7310, which is a power supply source for the drive motor, according to various programs. For example, information such as battery temperature, battery output voltage, or remaining capacity of the battery is input to the battery control unit 7300 from a battery device equipped with the secondary battery 7310. The battery control unit 7300 performs calculation processing using these signals, and controls the temperature regulation of the secondary battery 7310 or controls a cooling device or the like equipped in the battery device.

[0083] The outside-vehicle information detection unit 7400 detects information outside the vehicle equipped with the vehicle control system 7000. For example, at least one of an imaging unit 7410 and an outside-vehicle information detection unit 7420 is connected to the outside-vehicle information detection unit 7400. The imaging unit 7410 includes at least one of a ToF (Time Of Flight) camera, a stereo camera, a monocular camera, an infrared camera, and other cameras. The outside-vehicle information detection unit 7420 includes at least one of an environmental sensor for detecting the current weather or climate, or a surrounding information detection sensor for detecting other vehicles, obstacles, pedestrians, and the like around the vehicle equipped with the vehicle control system 7000.

[0084] The environmental sensor may be, for example, at least one of a raindrop sensor that detects rain, a fog sensor that detects fog, a sunshine sensor that detects the degree of sunshine, and a snow sensor that detects snowfall. The surrounding information detection sensor may be at least one of an ultrasonic sensor, a radar device, and a LIDAR (Light Detection and Ranging, Laser Imaging Detection and Ranging) device. The imaging unit 7410 and the outside vehicle information detection unit 7420 may be provided as independent sensors or devices, or may be provided as a device in which multiple sensors or devices are integrated.

[0085] Here, FIG. 13 shows an example of the installation positions of the imaging unit 7410 and the vehicle exterior information detection unit 7420. The imaging units 7910, 7912, 7914, 7916, and 7918 are provided, for example, at least one of the front nose, side mirrors, rear bumper, back door, and upper part of the windshield in the vehicle interior of the vehicle 7900. The imaging unit 7910 provided on the front nose and the imaging unit 7918 provided on the upper part of the windshield in the vehicle interior mainly acquire images of the front of the vehicle 7900. The imaging units 7912 and 7914 provided on the side mirrors mainly acquire images of the sides of the vehicle 7900. The imaging unit 7916 provided on the rear bumper or back door mainly acquires images of the rear of the vehicle 7900. The imaging unit 7918 provided on the upper part of the windshield in the vehicle interior is mainly used to detect a preceding vehicle, a pedestrian, an obstacle, a traffic light, a traffic sign, a lane, or the like.

[0086] 13 shows an example of the imaging ranges of the imaging units 7910, 7912, 7914, and 7916. Imaging range a indicates the imaging range of the imaging unit 7910 provided on the front nose, imaging ranges b and c indicate the imaging ranges of the imaging units 7912 and 7914 provided on the side mirrors, and imaging range d indicates the imaging range of the imaging unit 7916 provided on the rear bumper or back door. For example, image data captured by the imaging units 7910, 7912, 7914, and 7916 are superimposed to obtain an overhead image of the vehicle 7900 viewed from above.

[0087] The outside information detection units 7920, 7922, 7924, 7926, 7928, and 7930 provided on the front, rear, sides, and corners of the vehicle 7900 and on the upper part of the windshield inside the vehicle cabin may be, for example, ultrasonic sensors or radar devices. The outside information detection units 7920, 7926, and 7930 provided on the front nose, rear bumper, back door, and on the upper part of the windshield inside the vehicle cabin of the vehicle 7900 may be, for example, LIDAR devices. These outside information detection units 7920 to 7930 are mainly used to detect preceding vehicles, pedestrians, obstacles, and the like.

[0088] Returning to FIG. 12, the description will be continued. The outside-vehicle information detection unit 7400 causes the imaging unit 7410 to capture an image outside the vehicle, and receives the captured image data. The outside-vehicle information detection unit 7400 also receives detection information from the outside-vehicle information detection unit 7420 connected thereto. When the outside-vehicle information detection unit 7420 is an ultrasonic sensor, a radar device, or a LIDAR device, the outside-vehicle information detection unit 7400 transmits ultrasonic waves or electromagnetic waves, and receives information on the received reflected waves. The outside-vehicle information detection unit 7400 may perform object detection processing or distance detection processing for people, cars, obstacles, signs, or characters on the road surface, based on the received information. The outside-vehicle information detection unit 7400 may perform environment recognition processing for recognizing rainfall, fog, road surface conditions, and the like, based on the received information. The outside-vehicle information detection unit 7400 may calculate the distance to an object outside the vehicle based on the received information.

[0089] Furthermore, the outside vehicle information detection unit 7400 may perform image recognition processing or distance detection processing to recognize people, cars, obstacles, signs, or characters on the road surface, based on the received image data. The outside vehicle information detection unit 7400 may perform processing such as distortion correction or position adjustment on the received image data, and may generate an overhead image or a panoramic image by synthesizing image data captured by different imaging units 7410. The outside vehicle information detection unit 7400 may perform viewpoint conversion processing using image data captured by different imaging units 7410.

[0090] The in-vehicle information detection unit 7500 detects information inside the vehicle. For example, a driver state detection unit 7510 that detects the state of the driver is connected to the in-vehicle information detection unit 7500. The driver state detection unit 7510 may include a camera that captures an image of the driver, a biosensor that detects the bioinformation of the driver, or a microphone that collects sound in the vehicle cabin. The biosensor is provided, for example, on the seat or steering wheel, and detects the bioinformation of a passenger sitting in the seat or a driver gripping the steering wheel. The in-vehicle information detection unit 7500 may calculate the degree of fatigue or concentration of the driver based on the detection information input from the driver state detection unit 7510, or may determine whether the driver is dozing. The in-vehicle information detection unit 7500 may perform processing such as noise canceling processing on the collected sound signal.

[0091] The integrated control unit 7600 controls the overall operation of the vehicle control system 7000 according to various programs. The input unit 7800 is connected to the integrated control unit 7600. The input unit 7800 is realized by a device that can be operated by an occupant to input, such as a touch panel, a button, a microphone, a switch, or a lever. Data obtained by voice recognition of a voice input by a microphone may be input to the integrated control unit 7600. The input unit 7800 may be, for example, a remote control device using infrared or other radio waves, or an externally connected device such as a mobile phone or a PDA (Personal Digital Assistant) that supports the operation of the vehicle control system 7000. The input unit 7800 may be, for example, a camera, in which case the occupant can input information by gestures. Alternatively, data obtained by detecting the movement of a wearable device worn by the occupant may be input. Furthermore, the input unit 7800 may include, for example, an input control circuit that generates an input signal based on information input by the occupant using the above-mentioned input unit 7800 and outputs the input signal to the integrated control unit 7600. A passenger or the like operates the input unit 7800 to input various data to the vehicle control system 7000 and to instruct processing operations.

[0092] The storage unit 7690 may include a ROM (Read Only Memory) that stores various programs executed by the microcomputer, and a RAM (Random Access Memory) that stores various parameters, calculation results, sensor values, etc. The storage unit 7690 may be realized by a magnetic storage device such as an HDD (Hard Disc Drive), a semiconductor storage device, an optical storage device, or a magneto-optical storage device, etc.

[0093] The general-purpose communication I / F 7620 is a general-purpose communication I / F that mediates communication between various devices present in the external environment 7750. The general-purpose communication I / F 7620 may implement a cellular communication protocol such as GSM (registered trademark), WiMAX (registered trademark), LTE (registered trademark) (Long Term Evolution) or LTE-Advanced (LTE-A), or other wireless communication protocols such as wireless LAN (also called Wi-Fi (registered trademark)) and Bluetooth (registered trademark). The general-purpose communication I / F 7620 may connect to a device (e.g., an application server or a control server) present on an external network (e.g., the Internet, a cloud network, or a carrier-specific network) via, for example, a base station or an access point. The general-purpose communication I / F 7620 may also connect to a terminal (e.g., a driver's, pedestrian's, or store's terminal, or a Machine Type Communication (MTC) terminal) present in the vicinity of the vehicle using, for example, a Peer To Peer (P2P) technology.

[0094] The dedicated communication I / F 7630 is a communication I / F that supports a communication protocol designed for use in a vehicle. The dedicated communication I / F 7630 may implement a standard protocol such as WAVE (Wireless Access in Vehicle Environment), which is a combination of a lower layer IEEE802.11p and a higher layer IEEE1609, DSRC (Dedicated Short Range Communications), or a cellular communication protocol. The dedicated communication I / F 7630 typically performs V2X communication, which is a concept including one or more of vehicle-to-vehicle communication, vehicle-to-infrastructure communication, vehicle-to-home communication, and vehicle-to-pedestrian communication.

[0095] The positioning unit 7640 performs positioning by receiving, for example, a GNSS signal from a Global Navigation Satellite System (GNSS) satellite (for example, a GPS signal from a Global Positioning System (GPS) satellite) and generates position information including the latitude, longitude, and altitude of the vehicle. The positioning unit 7640 may identify the current position by exchanging signals with a wireless access point, or may obtain position information from a terminal such as a mobile phone, PHS, or smartphone having a positioning function.

[0096] The beacon receiving unit 7650 receives, for example, radio waves or electromagnetic waves transmitted from radio stations or the like installed on the road, and acquires information such as the current location, congestion, road closure, required time, etc. The function of the beacon receiving unit 7650 may be included in the dedicated communication I / F 7630 described above.

[0097] The in-vehicle device I / F 7660 is a communication interface that mediates a connection between the microcomputer 7610 and various in-vehicle devices 7760 present in the vehicle. The in-vehicle device I / F 7660 may establish a wireless connection using a wireless communication protocol such as wireless LAN, Bluetooth (registered trademark), NFC (Near Field Communication), or WUSB (Wireless USB). In addition, the in-vehicle device I / F 7660 may establish a wired connection such as a Universal Serial Bus (USB), a High-Definition Multimedia Interface (HDMI (registered trademark), or a Mobile High-definition Link (MHL)) via a connection terminal (and a cable, if necessary) not shown. The in-vehicle device 7760 may include, for example, at least one of a mobile device or a wearable device owned by a passenger, or an information device carried into or attached to the vehicle. The in-vehicle device 7760 may also include a navigation device that searches for a route to an arbitrary destination. The in-vehicle device I / F 7660 exchanges control signals or data signals with these in-vehicle devices 7760.

[0098] The in-vehicle network I / F 7680 is an interface that mediates communication between the microcomputer 7610 and the communication network 7010. The in-vehicle network I / F 7680 transmits and receives signals in accordance with a predetermined protocol supported by the communication network 7010.

[0099] The microcomputer 7610 of the integrated control unit 7600 controls the vehicle control system 7000 according to various programs based on information acquired through at least one of the general-purpose communication I / F 7620, the dedicated communication I / F 7630, the positioning unit 7640, the beacon receiving unit 7650, the in-vehicle device I / F 7660, and the in-vehicle network I / F 7680. For example, the microcomputer 7610 may calculate a control target value of a driving force generating device, a steering mechanism, or a braking device based on the acquired information inside and outside the vehicle, and output a control command to the drive system control unit 7100. For example, the microcomputer 7610 may perform cooperative control for the purpose of realizing the functions of an ADAS (Advanced Driver Assistance System), including vehicle collision avoidance or impact mitigation, following driving based on the distance between vehicles, vehicle speed maintenance driving, vehicle collision warning, vehicle lane departure warning, etc. In addition, the microcomputer 7610 may perform cooperative control for the purpose of autonomous driving, in which the vehicle travels autonomously without relying on driver operation, by controlling a driving force generating device, a steering mechanism, a braking device, etc. based on information acquired about the vehicle's surroundings.

[0100] The microcomputer 7610 may generate three-dimensional distance information between the vehicle and objects such as surrounding structures and people, and create local map information including peripheral information of the current position of the vehicle, based on information acquired via at least one of the general-purpose communication I / F 7620, the dedicated communication I / F 7630, the positioning unit 7640, the beacon receiving unit 7650, the in-vehicle device I / F 7660, and the in-vehicle network I / F 7680. The microcomputer 7610 may also predict dangers such as vehicle collisions, the approach of pedestrians, or entry into a closed road, based on the acquired information, and generate a warning signal. The warning signal may be, for example, a signal for generating a warning sound or turning on a warning lamp.

[0101] The audio / image output unit 7670 transmits at least one of audio and image output signals to an output device capable of visually or audibly notifying the passengers of the vehicle or the outside of the vehicle of information. In the example of FIG. 12, an audio speaker 7710, a display unit 7720, and an instrument panel 7730 are illustrated as output devices. The display unit 7720 may include, for example, at least one of an on-board display and a head-up display. The display unit 7720 may have an AR (Augmented Reality) display function. The output device may be other devices such as headphones, a wearable device such as a glasses-type display worn by the passenger, a projector, or a lamp, other than these devices. When the output device is a display device, the display device visually displays the results obtained by various processes performed by the microcomputer 7610 or information received from other control units in various formats such as text, image, table, graph, etc. When the output device is an audio output device, the audio output device converts an audio signal consisting of reproduced audio data or acoustic data into an analog signal and audibly outputs it.

[0102] In the example shown in FIG. 12, at least two control units connected via the communication network 7010 may be integrated into one control unit. Alternatively, each control unit may be composed of multiple control units. Furthermore, the vehicle control system 7000 may include another control unit not shown. In the above description, some or all of the functions performed by any control unit may be provided by another control unit. In other words, as long as information is transmitted and received via the communication network 7010, a predetermined arithmetic processing may be performed by any control unit. Similarly, a sensor or device connected to any control unit may be connected to another control unit, and multiple control units may transmit and receive detection information to each other via the communication network 7010.

[0103] A computer program for realizing each function of the photodetector 1 according to this embodiment described with reference to Figs. 1 to 11 can be implemented in any control unit or the like. A computer-readable recording medium in which such a computer program is stored can also be provided. The recording medium is, for example, a magnetic disk, an optical disk, a magneto-optical disk, a flash memory, or the like. The computer program may also be distributed, for example, via a network, without using a recording medium.

[0104] In the vehicle control system 7000 described above, the photodetector 1 according to the present embodiment described using FIGS. 1 to 11 can be applied to at least a part of the imaging section 7410 or the in-vehicle information detection unit 7510 of the application example shown in FIG. 12.

[0105] The above-described embodiment may be modified as follows.

[0106] (1) A pixel array including a plurality of pixel groups arranged in a two-dimensional array; a conversion unit provided for at least each of the pixel groups, the conversion unit converting an analog signal based on the light intensity acquired in the pixel group into a digital signal; a phase difference detection unit that detects a phase difference based on the digital signal generated by the conversion unit; Equipped with The pixel group is The image sensor includes a plurality of light receiving pixels including at least a first light receiving pixel and a second light receiving pixel, an on-chip lens disposed on an incident surface side of the plurality of light receiving pixels; having the phase difference detection unit detects a phase difference based on a first digital signal corresponding to the analog signal output from the first light receiving pixel and a second digital signal corresponding to the analog signal output from the second light receiving pixel. Light detection device.

[0107] (2) The conversion unit is provided for each of the plurality of light receiving pixels, The optical detection device according to (1).

[0108] (3) The plurality of light receiving pixels receive light using a global shutter system, convert an analog signal into a digital signal, and output the digital signal. An optical detection device according to (1) or (2).

[0109] (4) the phase difference detection unit detects a phase difference based on signals output from the first light receiving pixel and the second light receiving pixel included in the same pixel group. An optical detection device according to any one of (1) to (3).

[0110] (5) the phase difference detection unit detects a phase difference based on signals output from the first light receiving pixel and the second light receiving pixel included in different pixel groups; An optical detection device according to any one of (1) to (3).

[0111] (6) The first light receiving pixel and the second light receiving pixel are provided at positions shifted in a line direction in the pixel group. An optical detection device according to any one of (1) to (5).

[0112] (7) the first light receiving pixel and the second light receiving pixel are provided at positions shifted in a column direction in the pixel group; An optical detection device according to any one of (1) to (5).

[0113] (8) the plurality of light receiving pixels belonging to the pixel group share a floating diffusion region; An optical detection device according to any one of (1) to (7).

[0114] (9) The plurality of light receiving pixels belonging to the pixel group convert analog signals into digital signals within the pixel group by a rolling shutter system. The optical detection device according to (8).

[0115] (10) a floating diffusion region of each of the plurality of light receiving pixels belonging to the pixel group is disposed at a position away from a light collecting position in a top view; An optical detection device according to any one of (1) to (7).

[0116] (11) A pixel array including a plurality of pixel groups arranged in a two-dimensional array; a conversion unit provided for at least each of the pixel groups, the conversion unit converting an analog signal based on the light intensity acquired in the pixel group into a digital signal; a phase difference detection unit that detects a phase difference based on the digital signal generated by the conversion unit; an output unit that outputs image data based on the digital signal generated by the conversion unit; Equipped with The pixel group is The image sensor includes a plurality of light receiving pixels including at least a first light receiving pixel and a second light receiving pixel, an on-chip lens disposed on an incident surface side of the plurality of light receiving pixels; having the phase difference detection unit detects a phase difference based on a first digital signal corresponding to the analog signal output from the first light receiving pixel and a second digital signal corresponding to the analog signal output from the second light receiving pixel. Imaging device.

[0117] (12) The optical detection device according to any one of (1) to (10) or the imaging device according to (11), electronic equipment.

[0118] The aspects of the present disclosure are not limited to the above-described embodiments, but include various conceivable modifications, and the effects of the present disclosure are not limited to the above-described contents. The components in each embodiment may be appropriately combined and applied. In other words, various additions, modifications, and partial deletions are possible within the scope of the conceptual idea and intent of the present disclosure derived from the contents defined in the claims and their equivalents. [Explanation of symbols]

[0119] 1: Photodetector circuit, 10: Pixel array, 100: pixel group, 100R, 100G, 100B: pixel group, 100a, 100b: pixel groups, 102, 104, 106, 108: light receiving pixels, 110: On-chip lens, 112: Light-shielding film, 114: Photoelectric conversion region, TG: transfer transistor; FD: Floating diffusion area; 12: row scanning circuit; 14: Column selection circuit, 16: AD conversion circuit, 18: Signal processing circuit

Claims

1. A pixel array including a plurality of pixel groups arranged in a two-dimensional array; a conversion unit provided for at least each of the pixel groups, the conversion unit converting an analog signal based on the light intensity acquired in the pixel group into a digital signal; a phase difference detection unit that detects a phase difference based on the digital signal generated by the conversion unit; Equipped with The pixel group is The image sensor includes a plurality of light receiving pixels including at least a first light receiving pixel and a second light receiving pixel, an on-chip lens disposed on an incident surface side of the plurality of light receiving pixels; having the phase difference detection unit detects a phase difference based on a first digital signal corresponding to the analog signal output from the first light receiving pixel and a second digital signal corresponding to the analog signal output from the second light receiving pixel. Light detection device.

2. The conversion unit is provided for each of the plurality of light receiving pixels, 2. The optical detection device according to claim 1.

3. The plurality of light receiving pixels receive light using a global shutter system, convert an analog signal into a digital signal, and output the digital signal.

2. The optical detection device according to claim 1.

4. the phase difference detection unit detects a phase difference based on signals output from the first light receiving pixel and the second light receiving pixel included in the same pixel group.

2. The optical detection device according to claim 1.

5. the phase difference detection unit detects a phase difference based on signals output from the first light receiving pixel and the second light receiving pixel included in different pixel groups; 2. The optical detection device according to claim 1.

6. The first light receiving pixel and the second light receiving pixel are provided at positions shifted in a line direction in the pixel group.

2. The optical detection device according to claim 1.

7. the first light receiving pixel and the second light receiving pixel are provided at positions shifted in a column direction in the pixel group; 2. The optical detection device according to claim 1.

8. the plurality of light receiving pixels belonging to the pixel group share a floating diffusion region; 2. The optical detection device according to claim 1.

9. The plurality of light receiving pixels belonging to the pixel group convert analog signals into digital signals within the pixel group by a rolling shutter system.

9. The optical detection device according to claim 8.

10. a floating diffusion region of each of the plurality of light receiving pixels belonging to the pixel group is disposed at a position away from a light collecting position in a top view; 2. The optical detection device according to claim 1.

11. A pixel array including a plurality of pixel groups arranged in a two-dimensional array; a conversion unit provided for at least each of the pixel groups, the conversion unit converting an analog signal based on the light intensity acquired in the pixel group into a digital signal; a phase difference detection unit that detects a phase difference based on the digital signal generated by the conversion unit; an output unit that outputs image data based on the digital signal generated by the conversion unit; Equipped with The pixel group is The image sensor includes a plurality of light receiving pixels including at least a first light receiving pixel and a second light receiving pixel, an on-chip lens disposed on an incident surface side of the plurality of light receiving pixels; having the phase difference detection unit detects a phase difference based on a first digital signal corresponding to the analog signal output from the first light receiving pixel and a second digital signal corresponding to the analog signal output from the second light receiving pixel. Imaging device.

12. A photodetector comprising the photodetector according to claim 1, electronic equipment.

13. An imaging device comprising: electronic equipment.

Images