Indirect ToF sensor, stacked sensor chip, and method for measuring distance to an object using the sensor and chip

By using a multi-tap photodetector in an indirect ToF sensor to store signal charges within a predetermined period and using the signal ratio to determine the object distance, the problem of insufficient measurement accuracy under a single frame and single light source is solved, and wide-range measurement and depth image generation are achieved effectiveness.

CN116113844BActive Publication Date: 2024-11-22HUAWEI TECH CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202080105137.7
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2020-07-23
Publication Date
2024-11-22
Estimated Expiration
2040-07-23

AI Technical Summary

Technical Problem

Indirect ToF sensors are difficult to achieve wide range measurements from short distances to long distances in a single frame or a single light source, and the depth measurement accuracy of traditional methods is insufficient, which is prone to errors due to signal saturation or motion blur.

Method used

At least one light source is used to emit pulsed light, and the first and second photodetectors composed of multiple taps are sequentially stored in a predetermined period, and the object distance is determined using the output signal ratio of different taps, which is suitable for measurements of different distances. And generate a depth image through interpolation processing.

Benefits of technology

A wide range of measurements from short distances to long distances under a single frame or a single light source is realized, which improves measurement accuracy, reduces the impact of motion blur and signal saturation, and enhances the ability to generate depth images.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN116113844B_ABST
    Figure CN116113844B_ABST
Patent Text Reader

Abstract

The present invention provides a method for measuring the distance to an object, comprising: emitting pulsed light from at least one light source; sequentially storing signal charges generated by received light within a predetermined period through each tap in at least one first photodetector, wherein the first photodetector includes a plurality of taps; sequentially storing signal charges generated by received light within a predetermined period through each tap in at least one second photodetector, wherein the second photodetector includes a plurality of taps and has an area greater than that of the first photodetector, wherein the steps of sequentially storing signal charges generated by received light within the predetermined period through each tap in the at least one first photodetector and sequentially storing signal charges generated by received light within the predetermined period through each tap in the at least one second photodetector are performed simultaneously, The method also includes: after the steps of sequentially storing the signal charge generated by the received light within a predetermined period through each tap in the at least one first photodetector and sequentially storing the signal charge generated by the received light within a predetermined period through each tap in the at least one second photodetector are repeated a predetermined number of times, outputting the signal charge stored by the taps in the at least one first photodetector and the taps in the second photodetector as light receiving signals; determining the distance from the first photodetector and the second photodetector according to the taps in the at least one first photodetector that output the light receiving signal through reflected light, and according to the taps in the at least one second photodetector that output the light receiving signal through the reflected light, wherein the reflected signal is the emitted pulse light reflected onto the object.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to an indirect ToF sensor, a stacked sensor chip, and a method of measuring the distance to an object using the sensor and the chip. Background Art

[0002] Recently, the demand for three-dimensional sensing has been increasing. Mobile devices including depth imaging cameras have also been proposed. Conventionally, a multi-camera parallax system is known as a method for implementing three-dimensional sensing and depth imaging. However, the multi-camera parallax system is generally large and complicated to operate. The depth measurement accuracy of such a system is insufficient. Therefore, a depth sensor using infrared light has recently been used instead of the multi-camera parallax system.

[0003] Time-of-Flight (ToF) systems are depth sensors that use infrared light. Commercially available products mainly use indirect ToF systems.

[0004] Indirect ToF methods measure the flight time of light by using the signal ratio between multi-tap detection nodes. Fig.12 A method for measuring the distance to an object using a conventional ToF sensor is shown. The indirect ToF sensor emits pulsed light 10 from a light source at a predetermined period T. The light 10 is reflected on the object and returns to the indirect ToF sensor as reflected light 12 and strikes a photodetector. The photodetector includes a plurality of taps for storing signal charges. The photodetector stores signal charges generated by absorbing the light 12 reflected on the object. After repeatedly emitting the light 10 and storing the signal charges according to the tap reflected light 12 a predetermined number of times, the photodetector outputs the stored signal charges from the taps to the detection node as a light reception signal. Fig.12 In the example shown, the photodetector includes a tap and Tap and The taps are activated sequentially in a predetermined cycle and store signal charges. The timing is synchronized with the pulse of light 10. The reflected light 12 is at the tap is activated during and tap is activated during the period of striking the photodetector. Fig.12 80% of the reflected light 12 is at the tap During the activation period, 20% of the reflected light 12 hits the photodetector at the tap is activated during the period of striking the photodetector. Therefore, the In and out of the tap The output optical reception signal is stored in the tap In and out of the tap The ratio of the output light receiving signal is 8:2. Since the reflected light 12 hits the photodetector according to the time, the tap and The ratio of the output light reception signals changes, so the time it takes for the reflected light 12 to come back can be determined from the ratio of the light reception signals, and thus the distance to the object can be measured.

[0005] If the photodetectors are arranged in an array, the distances to the object at different locations on the array are mapped and a depth image can be obtained.

[0006] In the indirect ToF method, the intensity of light reflected on an object is proportional to the inverse of the square of the distance to the target object. In other words, since the intensity of light reflected on an object near the photodetector is large, the light can easily saturate the storage node. On the other hand, the intensity of light reflected on an object far from the photodetector is small, and the signal charge generated by the reflected light is small. Therefore, the reflected light is not easily detected.

[0007] The frequency and pulse width of the emitted light are very important for the accuracy of determining the distance. In general, the accuracy of determining the distance increases when the light is emitted at a higher frequency or a narrower pulse width. However, since the frequency when the tap is activated must be shorter than the flight time of the light, operation at a higher frequency reduces the range of measurable distances. Therefore, wide-range distance measurement is usually achieved by using data obtained in at least two frames in which pulsed light with different pulse frequencies is emitted. However, when using a frame that acquires data for a nearby object and a frame that acquires data for a distant object, if the object moves between the two frames, motion blur may occur due to the long reading time. In addition, multiple light sources may be required for the emission of these frames. Summary of the invention

[0008] Problems to be solved by the present invention

[0009] Required: Indirect ToF sensor that achieves wide range measurement from short distance to long distance with single frame or single light source; stacked sensor chip and electronic circuit of indirect ToF sensor; method of measuring distance to object by sensor and chip.

[0010] Solutions to the problem

[0011] According to a first aspect of the present invention there is provided a method for measuring a distance to an object, comprising:

[0012] emitting pulsed light from at least one light source;

[0013] sequentially storing signal charges generated by received light over a predetermined period through each tap in at least one first photodetector, wherein the first photodetector includes a plurality of taps;

[0014] sequentially storing signal charges generated by received light in a predetermined period through each tap of at least one second photodetector, wherein the second photodetector includes a plurality of taps and has an area greater than that of the first photodetector,

[0015] wherein the steps of sequentially storing the signal charge generated by the received light within the predetermined period through each tap in the at least one first photodetector and the steps of sequentially storing the signal charge generated by the received light within the predetermined period through each tap in the at least one second photodetector are performed simultaneously,

[0016] The method further comprises:

[0017] After the steps of sequentially storing the signal charges generated by the received light in a predetermined period by each tap in the at least one first photodetector and sequentially storing the signal charges generated by the received light in a predetermined period by each tap in the at least one second photodetector are repeated a predetermined number of times, outputting the signal charges stored by the taps in the at least one first photodetector and the taps in the second photodetector as light reception signals;

[0018] The distance to the first photodetector and the second photodetector is determined based on a tap in the at least one first photodetector that outputs a light receiving signal through reflected light, and based on a tap in the at least one second photodetector that outputs a light receiving signal through the reflected light, wherein the reflected signal is a transmitted pulse light reflected onto an object.

[0019] With regard to the first aspect of the invention, the at least one light source may comprise only one light source.

[0020] With regard to the first aspect of the invention, the number of taps in the second photodetector may be greater than the number of taps in the first photodetector.

[0021] With regard to the first aspect of the invention, the first and second photodetectors may be arranged in an array;

[0022] The method may further include obtaining a depth image representing the distance to the object in two dimensions based on the distance from the first photodetector to the object determined from the first photodetector and based on the distance from the second photodetector to the object determined from the second photodetector.

[0023] Regarding the first aspect of the present invention, when the light receiving signal output by the tap in the second photodetector from the reflected light is saturated, the method further includes: determining the distance from the second photodetector to the object by interpolating the distances from the multiple first photodetectors to the object.

[0024] Regarding the first aspect of the present invention, when the light receiving signal output by the tap of the reflected light in the first photodetector is less than or equal to a predetermined value, the method may further include determining the distance from the first photodetector to the object by interpolating the distances from the multiple second photodetectors to the object.

[0025] With respect to the first aspect of the present invention, a period of sequentially storing signal charges through all taps in the first photodetector may be repeated multiple times within a period of sequentially storing signal charges through all taps in the second photodetector;

[0026] The distance from the first photodetector to the object may be determined based on the light reception signal output from the tap in the second photodetector based on the reflected light and the light reception signal output from the tap of the first photodetector based on the reflected light.

[0027] With respect to the first aspect of the present invention, the first photodetector may include at least a first group of first photodetectors and a second group of first photodetectors;

[0028] Sequentially storing signal charges within a predetermined period through the taps of the first photodetector may include:

[0029] sequentially storing signal charge through each tap in the first group of first photodetectors;

[0030] At a timing phase-shifted from a timing of sequentially storing signal charges from each tap in the first group of first photodetectors, signal charges are sequentially stored by each tap in the second group of first photodetectors.

[0031] According to a second aspect of the present invention, there is provided an indirect ToF sensor, comprising:

[0032] at least one light source;

[0033] a photodetector array comprising at least a first photodetector and a second photodetector,

[0034] The area of ​​the second photodetector is larger than that of the first photodetector.

[0035] With regard to the second aspect of the present invention, the at least one light source may comprise only one light source.

[0036] With regard to the second aspect of the present invention, the first photodetector may include a plurality of taps;

[0037] The second photodetector includes a greater number of taps than the first photodetector.

[0038] According to a third aspect of the present invention, there is provided a stacked sensor chip, comprising:

[0039] The indirect ToF sensor of the second aspect of the present invention;

[0040] A chip including an electronic circuit,

[0041] Wherein, the indirect ToF sensor and the chip are stacked and electrically coupled to each other.

[0042] With regard to the third aspect according to the present invention, the electronic circuit may control the indirect ToF sensor;

[0043] The electronic circuit may process a light reception signal from the indirect ToF sensor.

[0044] Effects of the Invention

[0045] According to various aspects of the present invention, there can be provided: an indirect ToF sensor that achieves wide range measurement from short distance to long distance with a single frame or a single light source; a stacked sensor chip and an electronic circuit of the indirect ToF sensor; and a method for measuring the distance to an object by means of the sensor and the chip.

[0046] BRIEF DESCRIPTION OF THE DRAWINGS

[0047] Figure 1 A plan view of an indirect ToF sensor provided according to a first embodiment of the present invention.

[0048] Figure 2 A schematic diagram of a method for measuring the distance to an object through indirect ToF sensing provided by a first embodiment of the present invention.

[0049] Figure 3 A schematic diagram of a method for measuring the distance to a nearby object by using an indirect ToF sensor provided by a first embodiment of the present invention.

[0050] Figure 4 A schematic diagram of a method for measuring the distance to a distant object by using an indirect ToF sensor provided by a first embodiment of the present invention.

[0051] Figure 5 A schematic diagram of a method for generating a depth image through indirect ToF sensing provided by a first embodiment of the present invention.

[0052] Figure 6 A plan view of an indirect ToF sensor provided according to a second embodiment of the present invention.

[0053] Figure 7 A schematic diagram of a method for measuring the distance to an object through indirect ToF sensing provided by a second embodiment of the present invention.

[0054] Figure 8 A schematic diagram of a method for generating a depth image through indirect ToF sensing provided by a second embodiment of the present invention.

[0055] Fig. 9 A plan view of an indirect ToF sensor provided by a third embodiment of the present invention.

[0056] Fig.10 A schematic diagram of a method for measuring the distance to an object through indirect ToF sensing provided by a third embodiment of the present invention.

[0057] Fig.11 This is a cross-sectional view of the stacked sensor chip provided by the present invention.

[0058] Fig.12 Schematic diagram of measuring the distance to an object using a traditional indirect ToF sensor. DETAILED DESCRIPTION

[0059] Figure 1 A plan view of an indirect time-of-flight (ToF) sensor provided in accordance with a first embodiment of the present invention. Figure 1 The indirect ToF sensor shown in the figure includes at least a first photodetector 2 and a second photodetector 4. The first photodetector 2 and the second photodetector 4 are arranged in an array to form a photodetector array 1. The area of ​​the second photodetector 4 is larger than the area of ​​the first photodetector 2. The indirect ToF sensor includes at least one light source not shown. The photodetector array 1 may include a third photodetector, a fourth photodetector, ... having an area different from that of the first photodetector 2 and the second photodetector 4. At least one light source may include a single light source.

[0060] The first photodetector 2 includes a plurality of taps not shown. For example, the first photodetector 2 includes a tap and tap The second photodetector 4 includes a plurality of taps not shown. For example, the second photodetector 4 includes the same number of taps as the first photodetector 2. and tap The tap here includes at least a port for outputting signal charge and a gate for controlling the output of the signal charge to the port. The tap may also include a capacitor for storing signal charge and a gate for controlling the storage of the signal charge in the capacitor and the output of the signal charge from the capacitor.

[0061] Figure 2 A schematic diagram of a method for measuring a distance D to an object 8 by indirect ToF sensing provided for a first embodiment. Light 10 emitted from a light source of the indirect ToF sensor reflects off the object 8 and returns to the indirect ToF sensor as reflected light 12. The distance D from the indirect ToF sensor to the object 8 can be measured based on the time from the emitted light 10 to the reflected light 12 returning to the indirect ToF sensor.

[0062] Figure 3 A method for measuring a distance D to a nearby object 8 by using an indirect ToF sensor provided by a first embodiment of the present invention is shown. Figure 4 The first embodiment of the present invention provides a method for measuring the ratio of the indirect ToF sensor. Figure 3 In the case of a more distant object 8 the distance D approaches.

[0063] The light source of the indirect ToF sensor emits pulsed light 10 with a predetermined cycle time and a predetermined width. The light 10 can have any wavelength. Infrared light is preferred because it is invisible to humans. The light reflected on the object 8 hits the indirect ToF sensor as reflected light 12 with a delay relative to the emission of the light 10. The delay is proportional to the distance to the object 8.

[0064] In the embodiment of the present invention, for example, the first photodetector 2 includes a tap and tap Tap Through the same

[0065] The light source 10 is activated by the emission of light, and the tap will correspond to the active tap The signal charge of the light that strikes the first photodetector 2 during the period of φ is stored in, for example, a storage capacitor not shown. After the activation is completed, tap is activated. will correspond to the active tap The signal charge of the light that strikes the first photodetector 2 during the period of φ is stored in, for example, a storage capacitor not shown. After the activation is completed, tap and tap The durations of the activation taps are preferably equal to one another.

[0066] exist Figure 3 In the example shown, for example, the first photodetector 4 includes a tap and tap Tap is activated by synchronizing the emission of light from the light source and will correspond to the activation tap The signal charge of the light that strikes the second photodetector 4 during the period of time is stored in, for example, a storage capacitor not shown. After the activation is completed, tap is activated. will correspond to the active tap The signal charge of the light that strikes the second photodetector 4 during the period of time is stored in, for example, a storage capacitor not shown. After the activation is completed, tap and tap The durations of activating the taps of the second photodetector 4 are preferably equal to one another and equal to the duration of the taps of the first photodetector 2 and the cycle time.

[0067] After the above cycle, i.e., the emission of the pulsed light 10 and the first photodetector 2 and the second photodetector 3 in synchronization with the emission of the light 10,

[0068] Two photodetector 4 taps and The activation of is repeated a predetermined number of times, and the signal charge stored in each storage capacitor is output as a light receiving signal. For example, the cycle is repeated by outputting pulse light 10 at a frequency of 100 MHz for a duration of 1 millisecond. After the duration has passed, the stored signal charge is output as a light receiving signal.

[0069] exist Figure 3 In the embodiment, since the reflected light 12 hits the indirect ToF sensor with a delay proportional to the distance to the object 8, the reflected light 12 activates the tap of the first photodetector 2 and tap The cycle and activation tap and the second photodetector 4 The indirect ToF sensor is hit during the period of Figure 3 80% of the reflected light 12 activates the tap The first photodetector 2 and the second photodetector 4 are hit during the activation of the tap During this period, 20% of the reflected light 12 hits the first photodetector 2 and the second photodetector 4.

[0070] On the other hand, Figure 4 In, due to Figure 3Compared to the case shown, the return of the reflected light 12 is delayed, so that the tap is activated. During the period, the rate at which the reflected light 12 strikes the first photodetector 2 and the second photodetector 4 decreases, and the tap is activated. During the period of time, the rate at which the reflected light 12 strikes the first photodetector 2 and the second photodetector 4 increases. Figure 4 , 20% of the reflected light 12 activates the tap During the period of striking the first photodetector 2 and the second photodetector 4, 80% of the reflected light 12 activates the tap Therefore, the time from the emission of light 10 to the return of reflected light 12 can be obtained from the tap The amount of light received signal output is related to the tap Since the time from the emission of light 10 to the return of reflected light 12 is proportional to the distance D from the indirect ToF sensor to the object 8, the time from the tap to the reflected light 12 is proportional to the distance D from the indirect ToF sensor to the object 8. The amount of light received signal output from the tap The amount of the output light reception signal determines the distance D from the indirect ToF sensor to the object 8 .

[0071] The intensity of the reflected light 12 decreases in proportion to the inverse of the square of the distance D to the object 8. In the case where the area of ​​the first photodetector 2 is suitable for the intensity of the reflected light 12 from the nearby object 8, the signal charge of the reflected light 12 from the distant object 8 stored by the first photodetector 2 is reduced, and the signal-to-noise ratio may be reduced. Therefore, it may not be preferable to measure the distance D to the distant object 8 by the first photodetector 2. On the other hand, since the area of ​​the second photodetector 4 is larger than that of the first photodetector 2, the sensitivity of the second photodetector 4 is greater than that of the first photodetector 2 and is suitable for a smaller light intensity. Therefore, the large area of ​​the second photodetector 4 is suitable for the intensity of the reflected light 12 of the distant object 8. However, in this case, when the reflected light 12 with a large intensity hits the second photodetector 4 from the nearby object 8, the second photodetector 4 may become saturated. Therefore, it may not be preferable to measure the distance D to the distant object 8 by the second photodetector 4. Therefore, in the indirect ToF sensor according to the first embodiment, the first photodetector 2 may be preferably used to measure the distance to the nearby object, and the second photodetector 4 may be preferably used to measure the distance to the distant object.

[0072] Figure 5 A method for generating a depth image representing the distance to the object 8 in a two-dimensional manner with respect to such an indirect ToF sensor provided by the first embodiment is shown.

[0073] As discussed above, the intensity of the reflected light 12 decreases in proportion to the inverse of the square of the distance D to the object 8. If the distance D to the object 8 is small, the reflected light 12 has a large intensity, and the second photodetector 4 having a large area may become saturated. Therefore, the ratio of the light reception signal output from the tap of the second photodetector 4 may not be consistent with the ratio of the reflected light that hits during the activation period of the tap of the second photodetector 4. In this case, a depth image can be generated based only on the light reception signal from the first photodetector 2 without using the output from the second photodetector 4. Specifically, when the reflected light 12 from the nearby object 8 hits the photodetector array 1 and the second photodetector 4 is as shown in FIG. Figure 5 When saturated as shown in (a), the light receiving signal from the second photodetector 4 is ignored. Figure 5 Then, by interpolating the light receiving signal from the first photodetector 2, as shown in Figure 5 As shown in (c), data of the distance D at the position of the second photodetector 4 is derived to obtain a depth image.

[0074] On the other hand, when the distance D to the object 8 is large, the intensity of the reflected light 12 is small, and the light receiving signal output from the first photodetector 2 having a small area may become small. Therefore, the signal-to-noise ratio may be reduced, and it may be difficult to accurately detect the distance D. In this case, a depth image may be generated based only on the light receiving signal from the second photodetector 4 without using the output from the first photodetector 2. Specifically, when the reflected light 12 is Figure 5 When the distant object 8 shown in (a) hits the photodetector array 1, and the light receiving signal from the first photodetector 2 is less than or equal to a predetermined threshold, as shown in Figure 5 As shown in (d), the light receiving signal from the first photodetector 2 is ignored. Then, by interpolating the light receiving signal from the second photodetector 4, as shown in Figure 5 As shown in (e), data of the distance D at the position of the first photodetector 2 is derived to obtain a depth image.

[0075] If the light receiving signal output from the first photodetector 2 is greater than the threshold value and the second photodetector 4 is not saturated, a Figure 5 (c) and can be generated based on the light receiving signal from the second photodetector 4 Figure 5 The two depth images can be Figure 5 (f) shows the combination, generating Figure 5 (g) The final depth image is shown.

[0076] When the object 8 is near the indirect ToF sensor, the shorter pulse width of the light 10 improves the accuracy of the distance D in a short range and is therefore preferred. However, when the object 8 moves away from the indirect ToF sensor, the next emission of the light 10 and the measurement of the distance begin before the reflected light 12 returns to the indirect ToF sensor. If it is also necessary to measure distant objects 8, the frequency of the pulsed light should be lower. However, in this case, the low frequency of the pulsed light reduces the measurement accuracy of the distance D to nearby objects 8.

[0077] Figure 6 A plan view of an indirect ToF sensor provided according to a second embodiment of the present invention. Figure 7 A schematic diagram of a method for measuring the distance to an object by indirect ToF sensing provided by the second embodiment of the present invention. The indirect ToF sensor provided by the second embodiment of the present invention can adapt to the measurement of distant objects and improve the measurement accuracy of nearby objects.

[0078] like Figure 6 As shown, the photodetector array 21 of the indirect ToF sensor provided by the second embodiment of the present invention includes at least a first photodetector 22 and a second photodetector 24, and the area of ​​the second photodetector 24 is larger than the area of ​​the first photodetector 22 which is similar to the photodetector array 1 of the indirect ToF sensor provided by the first embodiment of the present invention.

[0079] The first photodetector 22 includes a plurality of taps (not shown). For example, the first photodetector 22 includes a tap and tap The second photodetector 24 includes taps (not shown), the number of which is greater than the number of taps of the first photodetector 22. For example, the second photodetector 24 includes taps to

[0080] Figure 7 (a) shows a method of measuring the distance D to a nearby object 8 by an indirect ToF sensor. In this case, as shown in reference Figure 3 In the first embodiment discussed, the light 12 reflected from the object 8 activates the tap of the first photodetector 22. The cycle and activation of the tap of the first photodetector 22 The first photodetector 22 is hit during the period of and The ratio between the output light reception signals determines the time from the emission of the light 10 to the return of the reflected light 12 , that is, the distance D to the object 8 .

[0081] Figure 7(b) shows a method of measuring the distance D to a nearby object 8 by an indirect ToF sensor. to In the cycle of sequentially storing signal charges, all taps of the first photodetector 22 and The cycle of sequentially storing signal charges is repeated multiple times. Figure 7 In the example shown in (b), the number of times is two. The reflected light 12 activates the tap of the first photodetector 22. and The reflected light 12 hits the first photodetector 22 during the second cycle, and the tap of the second photodetector 24 is activated. and The tap of the first photodetector 22 and The stored signal charge should be Figure 7 (a) is distinguished from the signal charge caused by the reflected light 12 of the nearby object 8. In this case, according to the tap of the second photodetector 24 and The stored signal charge can determine the light receiving signal output from the first photodetector 22 as the light receiving signal at the activation tap. and Then, by using the tap from the first photodetector 22 and The output light receiving signal can make the resolution of the depth image of the distant object 8 obtained by the second photodetector 24 higher.

[0082] Figure 8 The second embodiment of the present invention provides a method for generating an indirect ToF sensor. Figure 7 A method for obtaining a depth image of an improved technical solution of the distance to an object 8 measured by a method. As discussed above, the intensity of the reflected light 12 decreases in proportion to the inverse of the square of the distance D to the object 8. Therefore, if the distance D to the object 8 is small, the reflected light 12 may have a large intensity, and the second photodetector 24 having a large area may become saturated. Therefore, the ratio of the light receiving signal output from the tap of the second photodetector 24 may be inconsistent with the ratio of the reflected light striking the second photodetector 24 during the period of activating the tap of the second photodetector 24. In this case, a depth image can be generated based only on the light receiving signal from the first photodetector 22, without using the output from the second photodetector 24. Specifically, the reflected light 12 from the nearby object 8 strikes the second photodetector 24. Figure 8(a) The photodetector array 21. If the second photodetector 24 becomes saturated, the light receiving signal from the second photodetector 24 can be ignored, as shown in FIG. Figure 8 Then, the distance D at the position of the second photodetector 24 can be determined by interpolating the light receiving signal from the first photodetector 22, generating Figure 8 (c) The depth image shown.

[0083] On the other hand, if the distance D to the object 8 is large, the reflected light 12 may have a smaller intensity, and the signal charge stored by the photodetector 22 having a smaller area becomes smaller. Then, the signal-to-noise ratio may be reduced, and it may be difficult to accurately detect the distance D. In this case, a depth image may be generated based only on the light reception signal from the second photodetector 24 without using the light reception signal from the first photodetector 22. Specifically, when the reflected light 12 from the distant object 8 hits the photodetector array 21 and the light reception signal from the first photodetector 22 is less than or equal to Figure 8 (a) when the light receiving signal from the first photodetector 22 is ignored. Figure 8 Then, by interpolating the light receiving signal from the second photodetector 24, the data of the distance D at the position of the first photodetector 22 is derived to generate Figure 8 (e) Depth image shown.

[0084] When the light receiving signal output from the first photodetector 22 is greater than the threshold and the second photodetector 24 is not saturated, the Figure 8 (c) generates a depth image based on the light receiving signal of the first photodetector 22, and Figure 8 The light receiving signal of the second photodetector 24 shown in (e) generates a depth image, and the two depth images are combined to generate Figure 8 The final depth image shown in (f).

[0085] In this way, the indirect ToF sensor can improve the measurement accuracy of nearby objects by shortening the pulse width of the light 10 , and can adapt to the measurement of distant objects by increasing the number of taps of the second photodetector 24 .

[0086] Fig. 9 A plan view of an indirect ToF sensor provided by a third embodiment of the present invention. Fig.10 A method for measuring the distance to an object by indirect ToF sensing provided by a third embodiment of the present invention is shown.

[0087] If, in an indirect ToF sensor measurement method, an attempt is made to eliminate the influence of ambient light when measuring the distance to an object, two images are obtained by shifting the phase of the activated tap by 90 degrees. However, since such an operation captures two images, two frames are required to obtain one depth image, and thus the temporal resolution is reduced.

[0088] The photodetector array 31 of the indirect ToF sensor according to the third embodiment includes a first group of first photodetectors 32-1 and a second group of first photodetectors 32-2, and a second photodetector 34, such as Fig. 9 As shown. The first group of first photodetectors 32-1 and the second group of first photodetectors 32-2 have the same area and the same number of taps. The area of ​​the second photodetector 34 is larger than that of the first group of photodetectors 32-1 and the second group of first photodetectors 32-2, and the number of taps is larger than that of the first group of photodetectors 32-1 and the second group of first photodetectors 32-2. For example, in Fig. 9 In the example shown, the first photodetectors 32-1 and 32-2 each include two taps. The second photodetector 34 may include four taps to

[0089] like Fig.10 As shown, the taps of the second group of first photodetectors 32-2 are activated. and The timing of activating the tap of the first group of first photodetectors 32-1 and The timing of the first photodetector 32-1 is shifted by 90 degrees. and The stored signal charges constitute the first frame, which is formed by the taps of the second group of first photodetectors 32-2. and The stored signal charge constitutes the second frame. By comparing the two frames, the influence of ambient light can be eliminated.

[0090] The reflected light 12 strikes the second photodetector 34 in two cycles, activating two of the four taps. Fig.10 In the example, reflected light 12 activates the tap and The reflected light 12 hits the second photodetector 34 during the period of the reflected light 12. Therefore, there are always two consecutive periods to activate the two taps, during which the reflected light 12 does not hit the second photodetector 34. During the activation period when the reflected light 12 hits, the light receiving signals from the two taps are regarded as the first frame; during the activation period when the reflected light 12 does not hit, the light receiving signals from the two taps are regarded as the second frame. By comparing the two frames, the influence of ambient light can be eliminated.

[0091] Fig.11 A cross-sectional view of a stacked sensor chip provided for an embodiment of the present invention. The stacked sensor chip 26 includes a stacked structure in which a chip 28 of a photodetector array 1 and an electronic circuit chip 18 are stacked. The electronic circuit chip 18 may include a control circuit for controlling a light source not shown and taps of photodetectors of the photodetector array 1. The electronic circuit chip 18 may also include a processing circuit for processing light receiving signals output from the photodetectors. The wiring 14 for controlling the taps of the photodetectors of the photodetector array 1 and transmitting the light receiving signals output from the taps to the electronic circuit chip 18 may be integrated into several groups in a predetermined manner. The integrated wiring 14 may be electrically coupled to the electronic circuit chip 18 at the coupling portion 16.

[0092] Since each photodetector of the photodetector array 1 provided by the embodiment of the present invention includes a plurality of taps, the photodetector array 1 may include a large number of wirings for controlling the taps and transmitting the light receiving signal, and thus the coupling with the electronic circuit chip 18 may be complicated. Fig.11 The stacked sensor chip 26 shown in the figure can integrate wiring coupled with the photodetector array 1 to simplify the communication between the photodetector array 1 and the electronic circuit chip 18. In addition, since the photodetector array 1 and the electronic chip 18 can be manufactured in separate processes and can be coupled to each other in the final step, the manufacturing process can be simplified. In addition, since a wafer on which many photodetector arrays 1 are arranged and a wafer on which many electronic circuit chips 18 are arranged can be bonded and can be cut into chips, the manufacturing process can be further simplified.

[0093] Although the embodiments of the present invention have been described by way of example, it will be readily apparent to those skilled in the art that various modifications and variations can be made without departing from the spirit and scope of the present invention.

[0094] name

[0095] 1, 21 and 31: Photodetector arrays

[0096] 2 and 22: The first photodetector

[0097] 4 and 24: Second photodetector

[0098] 8: Objects

[0099] 10: Light

[0100] 12: Reflected Light

[0101] 14: Wiring

[0102] 16: Coupling part

[0103] 18: Electronic circuit chip

[0104] 26: Stacked sensor chips

[0105] 28: Photodetector array chip

[0106] 32-1: The first group of first photodetectors

[0107] 32-2: The second group of first photodetectors

[0108] 34: Second photodetector

Claims

1. A method for measuring the distance to an object, characterized in that include: emitting pulsed light from at least one light source; sequentially storing signal charges generated by received light over a predetermined period through each tap in at least one first photodetector, wherein the first photodetector includes a plurality of taps; sequentially storing signal charges generated by received light in a predetermined period through each tap of at least one second photodetector, wherein the second photodetector includes a plurality of taps and has an area greater than that of the first photodetector, wherein the steps of sequentially storing the signal charge generated by the received light within the predetermined period through each tap in the at least one first photodetector and the steps of sequentially storing the signal charge generated by the received light within the predetermined period through each tap in the at least one second photodetector are performed simultaneously, The method further comprises: After the steps of sequentially storing the signal charges generated by the received light in a predetermined period by each tap in the at least one first photodetector and sequentially storing the signal charges generated by the received light in a predetermined period by each tap in the at least one second photodetector are repeated a predetermined number of times, outputting the signal charges stored by the taps in the at least one first photodetector and the taps in the second photodetector as light reception signals; The distances to the first photodetector and the second photodetector are determined based on a tap in the at least one first photodetector that outputs a light receiving signal through reflected light, and based on a tap in the at least one second photodetector that outputs a light receiving signal through the reflected light, wherein the reflected light is transmitted pulse light reflected onto an object.

2. The method according to claim 1, characterized in that The at least one light source comprises only one light source.

3. The method according to claim 1, characterized in that The number of taps in the second photodetector is greater than the number of taps in the first photodetector.

4. The method according to claim 1, characterized in that: The first photodetector and the second photodetector are arranged in an array, The method further includes obtaining a depth image representing the distance to the object in two dimensions based on the distance from the first photodetector to the object determined from the first photodetector and based on the distance from the second photodetector to the object determined from the second photodetector.

5. The method according to claim 1, characterized in that When the light reception signal outputted from the tap in the second photodetector by the reflected light is saturated, the method further comprises determining the distance from the second photodetector to the object by interpolating the distances from the plurality of first photodetectors to the object.

6. The method according to claim 1, characterized in that When the light reception signal outputted from the tap in the first photodetector by the reflected light is less than or equal to a predetermined value, the method further comprises determining the distance from the first photodetector to the object by interpolating the distances from the plurality of second photodetectors to the object.

7. The method according to claim 3, characterized in that A cycle of sequentially storing signal charges through all taps in the first photodetector is repeated multiple times within a cycle of sequentially storing signal charges through all taps in the second photodetector; The distance from the first photodetector to the object is determined based on the light reception signal output from the tap in the second photodetector according to the reflected light and the light reception signal output from the tap of the first photodetector according to the reflected light.

8. The method according to claim 1, characterized in that The first photodetector includes at least a first group of first photodetectors and a second group of first photodetectors; Sequentially storing signal charges within a predetermined period through the taps of the first photodetector comprises: sequentially storing signal charge through each tap in the first group of first photodetectors; At a timing phase-shifted from a timing of sequentially storing signal charges from each tap in the first group of first photodetectors, signal charges are sequentially stored by each tap in the second group of first photodetectors.

9. An indirect ToF sensor, characterized in that: include: at least one light source; A photodetector array comprising at least a first photodetector and a second photodetector, wherein the first photodetector comprises a plurality of taps and the second photodetector comprises a plurality of taps; The first photodetector is used to sequentially store signal charges generated by the received light within a predetermined period through each tap of at least one first photodetector; The second photodetector is used to sequentially store signal charges generated by the received light within a predetermined period through each tap in at least one second photodetector; The first photodetector is further configured to output the signal charge stored by the taps in the at least one first photodetector after sequentially storing the signal charge generated by the received light through each tap in the at least one first photodetector for a predetermined number of times within a predetermined period; The second photodetector is further configured to output the signal charge stored by the taps in the at least one second photodetector after sequentially storing the signal charge generated by the received light through each tap in the at least one second photodetector for a predetermined number of times within a predetermined period; The light reflected on the object hits the indirect ToF sensor to form the received light, and the stored signal charge output by the tap in the at least one first photodetector and the tap in the second photodetector is a light receiving signal, which is used to determine the distance between the object and the indirect ToF sensor; wherein the area of ​​the second photodetector is larger than the area of ​​the first photodetector.

10. The indirect ToF sensor according to claim 9, characterized in that: The at least one light source comprises only one light source.

11. The indirect ToF sensor according to claim 9, characterized in that: The first photodetector includes a plurality of taps; The second photodetector includes a greater number of taps than the first photodetector.

12. A stacked sensor chip, characterized in that: include: The indirect ToF sensor according to any one of claims 9 to 11; A chip including an electronic circuit, Wherein, the indirect ToF sensor and the chip are stacked and electrically coupled to each other.

13. The stacked sensor chip according to claim 12, characterized in that: The electronic circuit controls the indirect ToF sensor; The electronic circuit processes a light reception signal from the indirect ToF sensor.