Light pixel projection module

By using a beam-splitting optics device in the optical pixel projection module to split the light beam into a main beam and a secondary beam, with the secondary beam used to trigger the ToF photodetector, the problem of complex and power-consuming synchronous electronic devices in the prior art is solved, and simplified and power-saving ToF measurement is achieved.

CN115053148BActive Publication Date: 2024-11-12AMS OSRAM INT GMBH
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202180012845.0
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Priority Date
2020-02-06
Filing Date
2021-02-05
Publication Date
2024-11-12
Estimated Expiration
2041-02-05

AI Technical Summary

Technical Problem

Existing optical pixel projection modules require complex and power-consuming fast electronic devices to synchronize photoelectric detection and IR laser driving, resulting in a complex and power-consuming system.

Method used

A beam-splitting optical device is used to split the beam emitted by the ToF light source into a main beam component and a secondary beam component. The secondary beam component remains in the module to strike the ToF photodetector and serves as a trigger for time measurement, eliminating the need for synchronization electronics.

Benefits of technology

The system structure has been simplified, energy consumption has been reduced, and power-saving ToF measurement capabilities have been achieved, while the ease of measurement and accuracy have been improved.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN115053148B_ABST
    Figure CN115053148B_ABST
Patent Text Reader

Abstract

A light pixel projection module (1300) includes a pixel light source (1302), a light pixel projection component (1304), and an optical ToF measurement component (1306) for measuring the distance to an external object (O), wherein the ToF measurement component (1306) includes a ToF light source (1322), a beam splitting optical device (1304) for splitting an incident light beam (IL) into a reflected main beam component (ILm) and a transmitted attenuated secondary beam component (ILs), and an APD-based ToF photodetector (1324). The beam splitting optical device (1304) is arranged in the optical path of the light beam (IL) emitted by the ToF light source (1322) so that it splits each light beam (IL) into a main beam component (ILm) that leaves the module (1300) and proceeds toward the external object (O) and a secondary beam component (ILs) that remains in the module (1300) and strikes the ToF photodetector (1324). The beam splitting optical device (1304) also serves as the light pixel projection component (1304).
Need to check novelty before this filing date? Find Prior Art

Description

[0001] This application claims the priority of German patent application No. 102020201453.1. The disclosure content of the above German patent application is hereby incorporated by reference into the present application.

[0002] The present disclosure also relates to a light pixel projection module for integration into an electronic device, the light pixel projection module being adapted to emit light pixels to be projected onto a surface, the light pixel projection module comprising:

[0003] - a light pixel generation component including a pixel light source;

[0004] - a light pixel projection component for projecting light pixels generated by the light pixel generation component; and

[0005] -Optical Time-of-Flight (ToF) measurement component for measuring the distance between the projection module and external objects,

[0006] ToF measurement components include:

[0007] a) a ToF light source for emitting light to be directed to and reflected from an external object;

[0008] b) a beam splitting optical device for splitting an incident light beam into a reflected primary beam component and a transmitted attenuated secondary beam component; and

[0009] c) APD-based ToF photodetector for light detection.

[0010] Such a light pixel projection module is known from document US2019 / 0310489A1.

[0011] A disadvantage of this known solution is that it requires complex and power-hungry fast electronics 124, 170 to synchronize the photodetection with the driving of the IR laser 510 during ToF measurements.

[0012] Therefore, an object of the present disclosure is to provide a light pixel projection module with simple and power-saving ToF measurement capabilities.

[0013] According to the present disclosure, this object is achieved by: arranging a beam splitting optical device in the optical path of a light beam emitted by a ToF light source so that it splits each light beam emitted by the ToF light source into:

[0014] i) a main beam component leaving the module and heading towards an external object; and

[0015] ii) The secondary beam component that remains inside the module and hits the ToF photodetector.

[0016] Due to the beam splitting optics of the present disclosure, a small portion of the ToF beam is diverted onto the ToF photodetector when leaving the module. The detection of this sub-beam component by the ToF photodetector can then be used as a trigger for the necessary time measurement. Thus, the complex synchronization electronics of the prior art can be omitted.

[0017] According to a preferred embodiment, the projection module of the present disclosure may include one, several or all of the following features in all technically possible combinations:

[0018] - the beam splitting optics is a layer stack, the upper mirrored portion of which acts as the main reflector and the lower light attenuating portion is arranged below the upper mirrored portion;

[0019] - the layer stack is deposited on the active surface area of ​​the ToF photodetector;

[0020] - the upper mirror part is an optical long-pass filter having a cut-off wavelength higher than the maximum wavelength of the light beam emitted by the ToF light source, so that the sub-beam component of the light beam split by the beam splitting optical device is equal to no more than 5% of the total intensity of the light beam;

[0021] - the lower light attenuating portion is a neutral density filter, preferably with a fractional transmittance not exceeding 0.01%;

[0022] - The beam splitting optics also serve as a light pixel projection component;

[0023] - a package that houses the components of the projection module, so that the ToF light source and the ToF photodetector share the same package;

[0024] - a photodetector assembly for detecting irradiance drift of a pixel light source and / or a ToF light source;

[0025] - the photodetector assembly includes one or more silicon photomultiplier tubes;

[0026] - beam splitting optics covering both the photodetector assembly and the ToF photodetector;

[0027] - A ToF photodetector comprising at least one single photon avalanche diode or SPAD;

[0028] -The ToF photodetector consists of a single SPAD, and the ToF measurement assembly also includes a ToF light scanning device for scanning the main beam component on an external object to obtain its 3D image.

[0029] The present disclosure also relates to an image projection device for projecting a pixelated image onto a surface, the image projection device comprising a projection module as defined above and a light scanning module for distributing light pixels projected by the projection module to different parts of the surface, thereby creating a pixelated image.

[0030] The present disclosure also relates to a method for ToF measurement using the projection module as defined above.

[0031] Preferred embodiments of the present disclosure will now be described in detail with reference to the accompanying drawings, in which:

[0032] Figure 1 is a functional block diagram of a first embodiment of a light pixel projection module according to the present disclosure;

[0033] Figure 2 It is shown Figure 1 Functional block diagram of the different components of the power supply and monitoring electronics of the projection module;

[0034] Figure 3a and 3b yes Figure 1 and 2 A perspective view of a possible structural implementation of the first embodiment; and

[0035] Figure 4 It is a functional block diagram of the second embodiment of the light pixel projection module according to the present disclosure.

[0036] Figure 1 A first embodiment 1300 of a light pixel projection module according to the present disclosure is shown. The light pixel projection module 1300 is bounded by a dashed polygon. The light pixel projection module 1300 is a device that can be used to project a varying light beam onto a screen to create pixels of an image for entertainment or professional applications. It is an optoelectronic component that can be integrated into an electronic device, such as a smartphone, a wearable device, or a tablet.

[0037] The light pixel projection module 1300 is adapted to emit pixels of light P, which will be projected onto a surface S.

[0038] The light pixel projection module 1300 includes a light pixel generation component 1302 , a light pixel projection component 1304 , an optical time-of-flight measurement component 1306 (defined by a dashed envelope), a photodetector component 1308 , and power and monitoring electronics 1310 .

[0039] In this example, the light pixel generation component 1302 consists of three laser diodes 1312, 1314 and 1316. The first laser diode 1312 is a blue laser and emits light BL with a wavelength of, for example, 475nm. The second laser diode 1314 is a green laser and emits light GL with a wavelength of, for example, 515nm. The third laser diode 1316 is a red laser and emits light RL with a wavelength of, for example, 635nm. The power of each laser diode may be up to 50mW. Preferably, each laser diode emits an intermittent single light pulse (full width at half maximum, or FWHM) with a duration of, for example, 2ns. The three laser diodes 1312, 1314 and 1316 and therefore the light pixel generation component 1302 can be defined together as a pixel light source.

[0040] exist Figure 1 , the light pixel projection component 1304 is implemented as a layer stack having an upper mirror portion 1318 and a lower light attenuation portion 1320 arranged below the upper portion 1318. In this example, the layer stack 1304 is deposited on the photodetector component 1308. The upper mirror portion 1318 can be an optical long pass filter. The long pass filter 1318 can be implemented in a multilayer coating technology using, for example, silicon dioxide and titanium dioxide. The lower light attenuation portion 1320 can be a neutral density filter, preferably having a fractional transmittance of not more than 0.01%. The lower light attenuation portion 1320 can be implemented as a metal layer filter (e.g., based on aluminum) with a micron area aperture.

[0041] The optical time-of-flight (TOF) measurement assembly 1306 is configured to measure the distance between the projection module 1300 and an external object O. The TOF measurement assembly 1306 includes a TOF light source 1322 , a beam splitting optics 1304 , an avalanche photodiode (APD) based TOF photodetector 1324 , and TOF measurement electronics 1326 .

[0042] The TOF light source 1322 is configured to emit light IL, which is directed onto an external object O and reflected by the external object O. Preferably, the TOF light source 1322 is an infrared (IR) laser diode. The infrared laser diode 1322 can emit light of a wavelength of about 905nm. The power of the infrared laser diode 1322 can be as high as 1 to 10W, but is preferably in the order of 50-100mW. The infrared laser diode 1322 can specifically emit a light pulse having a duration (full width at half maximum, FWHM) of about 2ns. In the present embodiment, all four laser diodes 1312, 1314, 1316 and 1322 are combined together and form a multi-wavelength laser illumination block. Grouping all the light sources of the projection module 1300 in one place simplifies the setting of the module and the control of the light sources.

[0043] The pixel light sources 1302 (i.e., red, green and blue lasers) and the time-of-flight light source 1322 (i.e., IR laser) are both oriented relative to the layer stack 1304 so that the light beams BL, GL, RL and IL emitted by these light sources hit the outer surface 1328 of the layer stack 1304 at an angle α of approximately 45°.

[0044] exist Figure 1 In the illustrated embodiment, the light pixel projection assembly (i.e., layer stack) 1304 also serves as a beam splitting optical device. This means that the layer stack 1304 splits the incident light beam (e.g., light beam IL) into a reflected main beam component ILm and a transmitted attenuated secondary beam component ILs. More precisely, the layer stack 1304 is arranged in the optical path of the light beams emitted by the TOF light source 1322 and the pixel light source 1302, so that it splits each light beam (e.g., BL) into a main beam component (BLm) that leaves the module 1300 and a secondary beam component (BLs) that remains in the module 1300 and strikes the TOF photodetector 1324 or the photodetector assembly 1308. To this end, the upper mirror portion 1318 serves as a primary reflector. As described above, the primary reflector 1318 can be an optical long-pass filter. Its cut-off wavelength is higher than the maximum wavelength of the light beam IL emitted by the TOF light source 1322. Since the time-of-flight light source 1322 is typically an infrared light source, this means that the optical long-pass filter 1318 reflects almost all light, regardless of whether it comes from the time-of-flight light source 1322 or the pixel light source 1302. The sub-beam components ILs, BLs, GLs and RLs of the light beams IL, BL, GL and RL separated by the layer stack 1304 may not exceed 5% of the total intensity of the light beams.

[0045] The TOF photodetector 1324 is arranged below the layer stack 1304. In the present example, the photodetector assembly 1308 and the TOF photodetector 1324 are integrated into a single monolithic photodetector chip 1330. The layer stack 1304 is deposited over the entire top surface of the photodetector chip 1330 and thus over the active surface areas of the TOF photodetector 1324 and the photodetector assembly 1308. In other words, the layer stack 1304 covers both the photodetector assembly 1308 and the TOF photodetector 1324.

[0046] exist Figure 1 In a first embodiment, the TOF photodetector 1324 is implemented as an array of single photon avalanche diodes (SPADs). The SPAD array 1324 may have a total of 64x64 pixels, with the pixels having independent outputs.

[0047] The TOF measurement electronics 1326 used to read out the signals delivered by the SPAD array 1324 may be a time-to-digital converter or TDC.

[0048] The photodetector assembly 1308 may include four silicon photomultipliers (SiPMs) 1332, 1334, 1336, and 1338. Each silicon photomultiplier is associated with one of the lasers 1312, 1314, 1316, and 1322. The first silicon photomultiplier 1332 is configured to monitor the irradiance of the blue laser 1312. The second silicon photomultiplier 1334 is configured to monitor the irradiance of the green laser 1314. The third silicon photomultiplier 1336 is configured to monitor the irradiance of the red laser 1316. The fourth silicon photomultiplier 1338 is configured to monitor the irradiance of the infrared laser 1322. All four silicon photomultipliers may be of the same type. Alternatively, each SiPM may have its own specific design that is optimized for the detection of light of the associated color.

[0049] exist Figure 1 In the embodiment, four silicon photomultipliers 1332 to 1338 are arranged adjacent to each other and flush. This arrangement makes it possible for, when the blue laser 1312 emits and the beam splitter 1304 splits the blue light beam BL, the sub-beam component BLs hits the first silicon photomultiplier 1332, when the green laser 1314 emits and the beam splitter 1304 splits the green light beam GL, the sub-beam component GLs hits the second silicon photomultiplier 1334, when the red laser 1316 emits and the beam splitter 1304 splits the red light beam RL, the sub-beam component RLs hits the third silicon photomultiplier 1336, and when the infrared laser 1322 emits and the beam splitter 1304 splits the infrared light beam IL, the sub-beam component ILs hits the fourth silicon photomultiplier 1338.

[0050] The purpose of the photodetector assembly 1308 is to detect potential drifts in the laser light source irradiance. The four silicon photomultipliers 1332 to 1338 may each have 10 x 10 pixels and may have multiplexed outputs.

[0051] Power supply and monitoring electronics 1310 in Figure 2 1308 and identified therein by a dashed polygon. The purpose of the power supply and monitoring electronics 1310 is to provide the photodetector assembly 1308 and the TOF photodetector 1324 with the power necessary for their operation and also to process the output signals D1 to D4 delivered by the four silicon photomultipliers 1332 to 1338. To this end, the power supply and monitoring electronics 1310 includes a power supply 1340, a discriminator stage 1342, a converter stage 1344 and a processing stage 1346. As indicated by the arrows, the power supply 1340 individually provides the necessary operating voltages for the first three silicon photomultipliers (blue, green and red) 1332, 1334 and 1336. The fourth silicon photomultiplier 1338 and the SPAD array 1324 form an integrated pair and are jointly powered by the power supply 1340.

[0052] In this example, both the discriminator stage 1342 and the converter stage 1344 have four separate channels for the four separate signals D1 to D4 of the four silicon photomultiplier tubes. The discriminator stage 1342 acts as a thresholder to remove low-level artifacts from the output signals D1 to D4. The purpose of the converter stage 1344 after the discriminator stage 1342 is to count or integrate the signals. Thus, the converter stage 1344 can be a counter or an analog-to-digital converter (ADC). The output of the converter stage 1344 is then used to monitor the intensity or irradiance of the laser, such as Figure 2 If there is drift in the intensity of the light delivered by the laser, corrective action can be taken by adjusting the operation of the laser driver 1348. In this way, optimal brightness of the projected image obtained with the help of the projection module 1300 can be ensured.

[0053] Figure 1 and Figure 2 The projection module 1300 operates as follows:

[0054] The red, green, blue and infrared lasers emit very fast high-power light pulses RL, GL, BL and IL. Most of the laser light is reflected by the layer stack 1304. The red, green and blue light reflected by the layer stack 1304 is used for laser projection. For this purpose, the reflected components BLm, GLm and RLm can be shaped by the beam shaper 1311 and scanned by the light scanning module 1313, for example, on the screen S. The light scanning module 1313 can be, for example, a micro-electromechanical system or a MEMS with a scanning mirror. In this way, a pixelated image is obtained on the surface of the screen S. The projection module 1300 and the light scanning module 1313 together form an image projection device 1315. In this image generation process, the pixel P is projected by the layer stack 1304 of the projection module 1300.

[0055] A small portion of the light emitted by the four lasers is transmitted and attenuated by the layer stack 1304. This small portion reaches the four silicon photomultipliers 1332 to 1338 and the SPAD array 1324. The red, green, blue and infrared lasers transmitted by the layer stack 1304 are monitored at a single pulse level by four independent silicon photomultipliers. If there is an undesirable drift in the intensity of the pulses emitted by the red, green and / or blue lasers, the control of the laser driver 1348 is adjusted accordingly to correct the brightness of the image projected onto the screen S with the help of the projection module 1300.

[0056] Optionally, the fourth silicon photomultiplier 1338 can also be used to detect stray infrared light inside the projection module 1300, for example, during the time interval between consecutive infrared laser pulses detected by the fourth silicon photomultiplier 1338. Measurement of the amount of stray infrared light, and therefore IR noise present in the projection module 1300, can be used to improve the signal-to-noise ratio and / or the accuracy of the time-of-flight measurement.

[0057] The time-of-flight measurement is performed as follows: the secondary component ILs of the infrared light arriving at the SPAD array 1324 triggers the time acquisition of each pixel of the SPAD array. At the same time, the reflected main beam component ILm leaves the module and moves towards the external object O. The infrared light from the main beam component ILm is then reflected back from the external object O and returns to the SPAD array 1324. This generates a corresponding stop signal for each pixel of the SPAD array and the time acquisition is completed. The resulting time-of-flight measurement can be used to construct a 3D image of the surface of the external object O. Preferably, the return of the infrared light from the external object O triggers a new round of time acquisition, and the process stops once the infrared light propagates back and forth between the SPAD array 1324 and the external object O for the second time. This process can be repeated multiple times in a closed loop.

[0058] We will now turn to FIG. 3 , which shows a possible structure of a projection module 1300 of the present disclosure. As shown in FIG. 3 , all elements of the projection module 1300 can be integrated into a single package 1348. The package 1348 can have a rectangular parallelepiped shape. It can be made of ceramic or silicone. In the example shown, the package 1348 has an outer edge 1350 surrounding a groove 1352. Various functional elements of the projection module 1300 are arranged in the groove 1352. A cover 1354 can cover the groove 1352. Figure 3a Projection module 1300 is shown without cover 1354. Figure 3b The projection module 1300 is shown to include a cover 1354. The cover 1354 may be made of glass and include a metal mask. It may have a first transmission window 1356 for the light pixel P and a second transmission window 1358 for the infrared light from the ToF measurement component 1306.

[0059] The inclined support member 1360 is disposed in the groove 1352. The inclined support member 1360 has an inclined surface 1362. The photodetector chip 1330 is attached to the inclined surface 1362.

[0060] To better observe the photodetector chip 1330, Figure 3a The layer stack 1304 on top of the chip is omitted in FIG. 13. In practice, the beam splitting layer stack 1304 of course covers the entire photodetector chip 1330 and therefore the entire inclined surface 1362.

[0061] The photodetector chip 1330 is divided into a front half H1 and a rear half H2 , the front half including the fourth silicon photomultiplier tube 1338 and the SPAD array 1324 , and the rear half including the first three silicon photomultiplier tubes 1332 , 1334 , and 1336 .

[0062] SPAD array 1324 may be composed of a single row of single photon avalanche diodes, such as Figure 3a Preferably, all SPADs in the single row are at the same vertical distance from the lower surface of the cover 1354. This can simplify time-of-flight based 3D imaging because it minimizes the difference in path length from one SPAD pixel to the next.

[0063] Four laser diodes 1312, 1314, 1316, and 1322 are arranged in a facing relationship relative to an inclined support 1360. The lasers are arranged in the groove 1352 in such a manner that the laser beam propagates in a direction parallel to the bottom of the groove 1352. In this configuration, the inclined surface 1362 of the support 1360 forms a 45° angle with the bottom of the groove 1352, so that the beam component reflected from the beam splitting layer stack 1304 (not shown) can leave the projection module 1300 in a direction perpendicular to the plane defined by the cover 1354.

[0064] refer to Figure 4 We will now describe a second embodiment 2300 of a projection module according to the present disclosure. The second embodiment 2300 is similar in many respects to Figure 1 To the first embodiment 1300 shown in FIG3 . In the following, we will only describe the differences with respect to the first embodiment. For similarities, please refer to the previous description of the first embodiment.

[0065] The second embodiment 2300 differs from the first embodiment 1300 in that the TOF photodetector 2324 is composed of a single SPAD. In addition, the TOF measurement assembly further includes a TOF light scanning device 2500 for scanning the main beam component ILm on the external object O to obtain its 3D image. The TOF light scanning device 2500 can be a micro-electromechanical system or a MEMS with a scanning mirror. The advantage of this variant is that it allows the size of the TOF photodetector 2324 to be reduced.

[0066] In summary, the light pixel projection module disclosed in the present invention has the following technical advantages:

[0067] -Integrated time-of-flight measurement components for 3D imaging of external objects;

[0068] - Automatically correct the brightness of the projected image by monitoring the light intensity of the laser light source in real time;

[0069] -Infrared stray light monitoring to improve noise suppression during time-of-flight measurements;

[0070] -Simplifies time-of-flight measurements by using a small portion of the ToF beam as a trigger for time interval measurements;

[0071] - Very compact packaging concept, the multi-wavelength laser illumination module and the high-sensitivity real-time multi-wavelength light monitoring module are integrated into a single package in a face-to-face manner.

Claims

1. A light pixel projection module (1300) for integration into an electronic device, the light pixel projection module (1300) being adapted to emit light pixels (P) to be projected onto a surface (S), the light pixel projection module (1300) comprising: - a light pixel generation component (1302) comprising a pixel light source; - a light pixel projection component (1304) for projecting the light pixels (P) generated by the light pixel generation component; and - an optical time-of-flight (ToF) measurement component (1306), for measuring the distance between the projection module (1300) and an external object (O), the ToF measurement component (1306) comprising: a) a ToF light source (1322) for emitting light to be directed to and reflected from the external object (O); b) a beam splitting optical device (1304) for splitting an incident light beam (IL) into a reflected main beam component (ILm) and a transmitted attenuated secondary beam component (ILs); and c) an APD-based ToF photodetector (1324) for light detection; The invention is characterized in that the beam splitting optical device (1304) is arranged in the optical path of the light beam (IL) emitted by the ToF light source (1322), so that it splits each light beam (IL) emitted by the ToF light source into: i) said reflected main beam component (ILm) leaving said module (1300) and heading towards said external object (O); and ii) the transmitted attenuated secondary beam components (ILs) that remain within the module (1300) and impinge on the ToF photodetector (1324); and Wherein, the beam splitting optical device (1304) is also used as the light pixel projection component.

2. The projection module (1300) according to claim 1, wherein the beam splitting optical device (1304) is a layer stack, whose upper mirror part (1318) serves as a main reflector and the lower light attenuation part (1320) is arranged below the upper mirror part.

3. The projection module (1300) according to claim 2, wherein: The layer stack (1304) is deposited on an active surface area of ​​the ToF photodetector (1324).

4. The projection module (1300) according to claim 2 or 3, wherein: The upper mirror portion (1318) is an optical long-pass filter whose cut-off wavelength is higher than the maximum wavelength of the light beam (IL) emitted by the ToF light source (1322), so that the sub-beam components (ILs) of the light beam separated by the beam splitting optical device (1304) do not exceed 5% of the total intensity of the light beam.

5. The projection module (1300) according to claim 2 or 3, wherein: The lower light attenuation portion (1320) is a neutral density filter.

6. The projection module (1300) according to claim 2 or 3, wherein: The lower light attenuation portion (1320) is a neutral density filter with a fractional transmittance not exceeding 0.01%.

7. The projection module (1300) according to claim 1, further comprising a package (1348) which houses the components of the projection module (1300), the ToF light source (1322) and the ToF photodetector (1324) thus sharing the same package.

8. The projection module (1300) according to claim 1, further comprising a photodetector component (1308) for detecting an irradiance drift of the pixel light source (1302) and / or the ToF light source (1322).

9. The projection module (1300) according to claim 8, wherein: The photodetector assembly (1308) includes one or more silicon photomultiplier tubes (1332).

10. The projection module (1300) according to claim 8 or 9, wherein: The beam splitting optics (1304) covers both the photodetector assembly (1308) and the ToF photodetector (1324).

11. The projection module (1300) according to claim 1, wherein: The ToF photodetector (1324) includes at least one single photon avalanche diode or SPAD.

12. The projection module (2300) according to claim 11, wherein: The ToF photodetector (2324) is composed of a single SPAD, and the ToF measurement component also includes a ToF light scanning device (2500) for scanning the main light beam component (ILm) on the external object (O) to obtain its 3D image.

13. An image projection device (1315) for projecting a pixelated image onto a surface (S), the image projection device (1315) comprising a projection module (1300) according to any one of claims 1 to 12 and a light scanning module (1313) for distributing light pixels (P) projected by the projection module to different parts of the surface (S), thereby creating a pixelated image.