Projecting structured light patterns from a device with an OLED display screen
By setting specific spacing and orientation light emitting elements on the OLED display screen, using OLED as a two-dimensional diffraction grating to generate a high-contrast structured light pattern, the problem of insufficient contrast in structured light projection in portable devices is solved, reducing equipment costs and improving equipment costs The thinness and control accuracy of the display screen are displayed.
Patent Information
- Application Number
- CN202080045251.5
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Priority Date
- 2019-06-20
- Filing Date
- 2020-06-10
- Publication Date
- 2024-12-06
- Estimated Expiration
- 2040-06-10
AI Technical Summary
The existing structured light projection equipment is difficult to achieve high contrast structured light patterns in portable devices, and is costly, and the use of microlens arrays in the prior art increases the equipment complexity and cost.
Using an apparatus with an organic light emitting diode (OLED) display screen, by setting a specific spacing and orientation between the OLED pixel and the light emitting element, an OLED display screen is used as a two-dimensional diffraction grating to generate an interference pattern to achieve a structured light pattern with high contrast.
High contrast structured light pattern projection in portable devices is realized, reducing equipment costs, and since the OLED display screen does not require backlight, the device is thinner and can control brightness by pixel, which is suitable for devices such as smartphones.
Smart Images

Figure CN114051656B_ABST
Abstract
Description
Technical Field
[0001] The present disclosure relates to projecting structured light patterns from a device having an organic light emitting diode (OLED) display screen. Background Art
[0002] For example, in applications where the distance to an object in a scene needs to be determined, structured light can be used. The light pattern generated by the structured light in the scene can be used to distinguish objects based on their distance from the device emitting the structured light. The game console may include a pattern projector for illuminating a scene in which a player is present with structured light, and the illuminated scene is imaged and analyzed to achieve three-dimensional (3D) mapping (also known as depth mapping) of the scene.
[0003] In another example, structured light can be used to identify a user. In such an example, the structured light can include an array of light spots. A detector receives reflections from the light spots, and a processor uses the reflected light to determine if the face is that of an authorized user. If the face is that of an authorized user, the processor can unlock the device and allow the device to be used. The device can be, for example, a smartphone or other portable host computing device. Summary of the invention
[0004] The present disclosure describes projecting a structured light pattern from a device having an organic light emitting diode (OLED) display screen, such as a smartphone, a game console, or other portable host computing device.
[0005] For example, in one aspect, a device includes a display screen including OLED pixels arranged in a first plane at a specific pitch. A light projector includes light emitting elements arranged in a second plane parallel to the first plane. The light emitting elements are arranged at the same pitch as the OLED pixels or at an integer multiple of the pitch of the OLED pixels. The light emitting elements are operable to generate light having a wavelength for transmission through the display screen, and the first plane and the second plane are separated from each other by a distance D such that d 2 =2*(λ)*(D) / (N), where d is the spacing, λ is the wavelength, and N is a positive integer.
[0006] Some embodiments include one or more of the following features. For example, in some cases, the OLED pixels are arranged in a two-dimensional array and the light-emitting elements are arranged in a two-dimensional array. The light-emitting elements may be, for example, VCSELs. In some cases, the VCSELs (or other light-emitting elements) are in an arrangement having the same orientation as the orientation of the arrangement of the OLED pixels. The arrangement of the VCSELs may be laterally displaced in a second plane relative to the arrangement of the OLED pixels. Preferably, the plurality of VCSELs and each of the plurality of OLED pixels are arranged so that the orientation of the arrangement of the VCSELs is not rotated relative to the orientation of the arrangement of the OLED pixels.
[0007] In some cases, each of the light-emitting elements is arranged to illuminate a corresponding subset of the OLED pixels, and each of the subsets includes multiple adjacent OLED pixels so that light from each particular one of the light-emitting elements passes through different ones of the OLED pixels in the corresponding subset to produce an interference pattern.
[0008] The display screen and light projector may be integrated as part of, for example, a portable computing device (eg, a smartphone).
[0009] According to another aspect, a method includes generating light of wavelength λ using a light emitting element, and transmitting the light generated by the light emitting element through a display screen, the display screen including OLED pixels arranged in a first plane at a specific pitch. The light emitting element is arranged in a second plane parallel to the first plane, and the light emitting element is arranged at the same pitch as the plurality of OLED pixels (or at an integer multiple of the pitch). The first plane and the second plane are separated from each other by a distance D, such that d 2 =2*(λ)*(D) / (N), where d is the spacing and N is a positive integer.
[0010] Some embodiments include one or more of the following features. For example, in some cases, each of the light emitting elements illuminates a corresponding subset of the OLED pixels, and each of the subsets includes a plurality of adjacent OLED pixels, such that light from each particular one of the light emitting elements passes through different ones of the OLED pixels in the corresponding subset to produce an interference pattern.
[0011] In some cases, light generated by the light emitting element is transmitted through a display screen of the smartphone.
[0012] In some embodiments, the interference pattern can be projected onto a scene, with at least one object in the scene reflecting some of the light. The method can include sensing at least some of the reflected light, and using a signal generated by the sensed light for eye tracking or other applications.
[0013] Other aspects, features, and advantages will be apparent from the following detailed description, drawings, and claims. BRIEF DESCRIPTION OF THE DRAWINGS
[0014] Figure 1 Describes an example of a device according to an embodiment of the present disclosure;
[0015] Figure 2 Depicting an example of a portable host computing device in which aspects of the present disclosure are integrated;
[0016] Figure 3 Depicting further details of an apparatus according to some embodiments of the present disclosure. DETAILED DESCRIPTION
[0017] like Figure 1 As depicted, the device (optoelectronic system) includes a light projector 20 to project a structured light pattern 28 onto one or more objects in a scene of interest 26. In some embodiments, the projected pattern is composed of light in the IR (infrared) or near IR region of the spectrum. Light from the projected pattern 28 can be reflected by one or more objects in the scene 26 and sensed by an image sensor 22, which includes spatially distributed photosensitive components (e.g., pixels) that are sensitive to the wavelength of light emitted by the light projector 20. The detection signal can be read out and used by processing circuitry, such as for stereo matching, to generate a 3D image. In some cases, one or more optical elements (such as a lens 27) help direct the light reflected from the scene 26 to the image sensor 22. The use of structured light can be advantageous, for example, to provide additional texture for matching pixels in a stereo image.
[0018] In another example, the structured light pattern 28 may be reflected from the user's face, and the reflected light may be sensed by the image sensor 22. The detected signal may be used to create a depth map of the user's face. The depth map may then be compared to a depth map of an authorized user.
[0019] In some embodiments, the light projector 20, the lens 27, and the image sensor 22 are integrated into a portable host computing device 100 (such as a mobile phone (cellular phone), a smart phone, a tablet computer, a personal digital assistant, or a notebook computer with network capabilities) (see Figure 2 ). In this case, the light projector 20, the lens 27, and the image sensor 22 may be disposed below the display screen 24 of the host device.
[0020] The display screen 24 can be implemented as an OLED display screen. An OLED is a light emitting diode (LED) in which the emitting electroluminescent layer is a thin film of an organic compound that emits light in response to an electric current. The organic layer is located between two electrodes, at least one of which is transparent or translucent to the light generated by the light projector 20. Since the pixels of an OLED generate their own light, the OLED display screen 24 does not require a backlight and can be ultra-thin. In addition, the brightness of the OLED screen can be controlled pixel by pixel. These features make the OLED display screen very suitable for portable host computing devices such as smartphones.
[0021] In general, the pitch of the OLED pixel array determines the resolution of the image displayed by the OLED display screen 24. The pixel pitch, for example, provides an indication of pixel density, which is calculated by the distance between the centers of two adjacent pixels. An equivalent metric is the number of pixels per inch (ppi). For example, some smartphones have a 5-inch (130 mm) display panel with a 1920×1080 pixel array, which corresponds to about 441 ppi (a pixel pitch of about 58 μm). Other smartphones have a 6-inch (150 mm) display panel with a 2:1 aspect ratio and a 2880×1440 pixel array, which is about 538 ppi (a pixel pitch of about 47 μm). Still other smartphones have a 2436×1125 pixel array with about 458 ppi (or a pixel pitch of about 55 μm). In general, the pixel pitch can be 30 μm or more. In general, the pixel pitch can be as high as 70 μm. Some portable computing devices use OLED display screens with different resolutions than the aforementioned examples.
[0022] As described in detail below, the light projector 20 is arranged so that a light signal generated by the light projector passes through the OLED display screen 24 and produces a structured light pattern 28, which may include a pattern of discrete features projected onto one or more objects in a scene 26 external to the host device.
[0023] like Figure 3 As depicted, the light projector 20 may include, for example, one or more light emitting elements 30 (e.g., high power light emitting elements), such as an array of vertical cavity surface emitting lasers (VCSELs) operable to emit a predetermined narrow range of wavelengths (e.g., in the IR or near IR portion of the spectrum). Each of the light emitting elements 30 may be operable, for example, to emit light within a range of about 850 nm + / - 10 nm, or within a range of about 830 nm + / - 10 nm, or within a range of about 940 nm + / - 10 nm. Different wavelengths and ranges may be suitable for other embodiments.
[0024] Each OLED pixel of the OLED display screen 24 includes a portion that is transmissive to infrared radiation (such as emitted by the light emitting element). The transmissive portion may, for example, be approximately half the area of each pixel. The transmissive portion may, for example, be rectangular, hexagonal, or have some other shape. The transmissive portion of each OLED acts as a hole through which the light emitted by the light projector 20 passes. The OLED display screen acts as a two-dimensional diffraction grating. This causes interference in the light emitted by the VCSEL, which can be used to obtain a structured light pattern 28.
[0025] To obtain a structured light pattern 28 with a strong contrast, the VCSEL array should have the same periodic arrangement, including the same pitch (or, equivalently, the same ppi) as the OLED pixel array. Thus, if the OLED display screen 24 has a regular arrangement of pixels, for example, at a pitch d, the VCSELs 30 should be arranged at the same pitch. Furthermore, the array of VCSELs 30 should have the same orientation as the array of OLED pixels in the display screen 24 (e.g., the grid containing the VCSELs and the grid containing the OLED pixels should have parallel axes). Although the arrangement of the VCSELs 30 may be displaced (e.g., laterally displaced in a plane parallel to the plane of the OLED pixels), the arrangement of the VCSELs should preferably not be rotated relative to the arrangement of the OLED pixels in the display screen 24.
[0026] The distance between the plane of the VCSEL array and the plane of the OLED pixel array can be referred to as D. Preferably, the plane containing the VCSEL array and the plane containing the OLED pixel array are parallel to each other. Figure 3 As shown, a structured light pattern 28 generated by a VCSEL beam and passing through an OLED display screen 24 is recorded in the far-field. Black dots indicate locations of high light intensity, while white areas indicate areas of low light intensity. For a particular selection of pitch d, wavelength λ and distance D, the contrast present in the structured light pattern 28 is particularly high, while for other distances D, only a much lower contrast is present in the established pattern. The equation describing the relationship between the values of pitch d, wavelength λ and distance D for obtaining very strong contrast in the structured light pattern 28 is as follows:
[0027] d 2 =2*(λ)*(D) / (N),
[0028] Where N represents a positive integer (e.g., 1, 2, 3, 4, etc.). In a specific example, the VCSEL 30 emits light in the infrared range of the spectrum (e.g., 940 nm), and the integer N is set to N=1, and the distance (D) between the plane of the VCSEL array and the plane of the OLED pixel array is about 1.08 mm for a pitch (d) of about 45 μm. Different values may be applicable to other embodiments. If N=2 is used, a stronger contrast is visible in the pattern 28, and the distance D can be halved (if other values remain the same). The above equation is described in US10509147, the contents of which are hereby incorporated by reference herein.
[0029] In some cases, each of the VCSELs 30 is arranged to illuminate a corresponding subset of pixels of the OLED display screen 24, each of which includes a plurality of adjacent pixels, so that light from each particular one of the VCSELs passes through different ones of the pixels in the corresponding subset to produce an interference pattern. All interference patterns are superimposed so that the structured light produces a high-density interference pattern that can be used to illuminate a scene. The fact that the structured light is an interference pattern established by the interference of light propagating through different OLED pixels will allow the contrast of the structured light to be maintained substantially constant over a wide range of distances from the OLED display screen 24 (e.g., in the far field, such as from about 5 cm-10 cm to infinity).
[0030] In some cases, each of the OLED pixels and the VCSELs are arranged in an array (eg, a linear array or a 2D array).
[0031] Generally, the patterned light projection formed from the superimposed interference patterns is based on the periodicity of the VCSEL array and the OLED pixel array. The field of illumination (FOI) is limited by the divergence of the VCSEL 30. Therefore, the above technology is particularly suitable for applications such as point pattern recognition (e.g., eye tracking) that only require a relatively small FOI. The technology can also be used for 3D mapping of scenes or detecting the movement of objects. These applications can be integrated into, for example, smartphones (see Figure 2 ) and other portable computing devices including OLED display screens. The technology can also be used for facial recognition via depth mapping of the face (e.g., to determine whether the user is an authorized user of a smartphone or other portable computing device).
[0032] In the above embodiment, the OLED display screen 24 has a regular arrangement of pixels with a pitch d, and the VCSELs 30 have the same pitch d. However, in other embodiments, the pitch of the VCSELs 30 may be an integer multiple of the pitch of the OLED display screen. For example, the pitch of the VCSELs 30 may be 2d, 3d, etc.
[0033] In some cases, light projector 20, lens 27, and image sensor 22 are components of the same optoelectronic module. In other embodiments, light projector 20 may be a discrete component that is not integrated into the same module as image sensor 22 and / or lens 27.
[0034] The designs of smartphones and other portable computing devices referenced in this disclosure may include one or more processors (e.g., electronic control units such as microprocessors), one or more memories (e.g., RAM), storage (e.g., disk or flash memory), a user interface (which may include, for example, a keypad, an OLED display screen, a touch or other gesture sensor, a camera or other optical sensor, a compass sensor, a 3D magnetometer, a 3-axis accelerometer, a 3-axis gyroscope, one or more microphones, etc., together with software instructions for providing a graphical user interface), interconnections (e.g., buses) between these elements, and interfaces for communicating with other devices (which may be wireless and / or wired, wireless such as GSM, 3G, 4G, CDMA, WiFi, WiMax, Zigbee or Bluetooth, wired such as through an Ethernet LAN, a T-1 Internet connection, etc.). Various components may be disposed under the cover glass.
[0035] The foregoing techniques facilitate the realization of a device operable to produce a structured light pattern with high contrast. A microlens array is not necessary because the OLED display screen (which acts as a two-dimensional diffraction grating) provides an interference pattern that is superimposed to form the structured light pattern 28. Since a microlens array is not necessary, the cost of the device can be reduced.
[0036] Although this document contains many specific implementation details, it should not be interpreted as a limitation to the present invention or the scope of protection claimed, but should be interpreted as an explanation of the specific features of the present invention's specific embodiments. The specific features described in the context of the separate embodiments in this document may also be combined in a single embodiment and implemented. On the contrary, the various features described in the context of a single embodiment may also be implemented separately in a plurality of different embodiments or in any appropriate sub-combination. In addition, although the features may be described above as working in certain combinations and even initially claimed, one or more features in the claimed combination may be cut out from the claimed combination in some cases, and the claimed combination may be for a variation of a sub-combination or a sub-combination. Therefore, other embodiments are within the scope of the appended claims.
Claims
1. A device comprising: A display screen comprising a plurality of OLED pixels arranged in a first plane at a specific pitch; A light projector, comprising a plurality of light emitting elements, the plurality of light emitting elements being arranged in a second plane parallel to the first plane, the plurality of light emitting elements being arranged at the same pitch as the plurality of OLED pixels, or at an integral multiple of the pitch of the plurality of OLED pixels, wherein: The plurality of light emitting elements are operable to generate light having a wavelength for transmission through the display screen, and wherein the first plane and the second plane are separated from each other by a distance D such that d 2 =2*(λ)*(D) / (N), where d is the pitch of the OLED pixels, λ is the wavelength, and N is a positive integer.
2. The device of claim 1, wherein the OLED pixels are arranged in a two-dimensional array, and wherein the light emitting elements are arranged in a two-dimensional array.
3. The device according to claim 1 or 2, wherein the light emitting element is a VCSEL.
4. The apparatus of claim 3, wherein the plurality of VCSELs are in an arrangement having the same orientation as an arrangement of the plurality of OLED pixels.
5. The apparatus of claim 4, wherein the arrangement of the plurality of VCSELs is laterally displaced in the second plane relative to the arrangement of the plurality of OLED pixels.
6. The apparatus of claim 3, wherein the plurality of VCSELs and each of the plurality of OLED pixels are arranged such that an orientation of the arrangement of the VCSELs is not rotated relative to an orientation of the arrangement of the OLED pixels.
7. A device according to claim 1 or 2, wherein each of the light-emitting elements is arranged to illuminate a corresponding subset of the OLED pixels, and each of the subsets includes a plurality of adjacent OLED pixels so that light from each specific one of the light-emitting elements passes through different ones of the OLED pixels in the corresponding subset to produce an interference pattern.
8. The apparatus of claim 1 or 2, wherein the display screen and light projector are integrated as part of a portable computing device.
9. The apparatus of claim 8, wherein the portable computing device is a smartphone.
10. A method comprising: Using a plurality of light emitting elements to generate light of wavelength λ; and The method comprises: transmitting the light generated by the plurality of light emitting elements through a display screen, the display screen comprising a plurality of OLED pixels, the plurality of OLED pixels being arranged in a first plane at a specific pitch, wherein the plurality of light emitting elements are arranged in a second plane parallel to the first plane, the plurality of light emitting elements are arranged at the same pitch as the plurality of OLED pixels, or at an integral multiple of the pitch of the plurality of OLED pixels, and wherein the first plane and the second plane are separated from each other by a distance D so that d 2 =2*(λ)*(D) / (N), where d is the pitch of the OLED pixel, and N is a positive integer.
11. The method of claim 10, wherein each of the light-emitting elements illuminates a corresponding subset of the OLED pixels, and each of the subsets includes a plurality of adjacent OLED pixels, such that light from each particular one of the light-emitting elements passes through different ones of the OLED pixels in the corresponding subset to produce an interference pattern.
12. The method of claim 11, wherein the light generated by the plurality of light emitting elements is transmitted through a display screen of a smartphone.
13. The method of claim 11, wherein the interference pattern is projected onto a scene, at least one object in the scene reflecting some of the light, the method comprising: At least some of the reflected light is sensed.
14. The method of claim 13, further comprising using a signal generated by the sensed light for eye tracking.
15. The method according to any one of claims 10 to 14, wherein the light emitting element is a VCSEL.
