Optical system for under-display image sensors in electronic devices

Abstract

An electronic device is provided. The electronic device includes a display having a plurality of pixels. The display defines a transparent area disposed between a first pixel of the plurality of pixels and a second pixel of the plurality of pixels. The electronic device includes an image sensor disposed below the display. The image sensor is aligned with the transparent area defined by the display. The electronic device further includes an optical system disposed on the display and across the transparent area defined by the display. The optical system is configured to direct external light onto the transparent area of ​​the display.

Description

[Technical Field]

[0001] The present disclosure relates generally to displays for electronic devices with under-display image sensors, and more particularly to optical systems for under-display image sensors. [Background technology]

[0002] An electronic device (e.g., a smartphone, laptop, smartwatch, tablet, etc.) may include a display for displaying content (e.g., time, date, etc.) to a user. The electronic device may further include one or more cameras. For example, the electronic device may include an under-display camera. The under-display camera may be configured to acquire image data. For example, the under-display camera may capture image data (e.g., video, photos, etc.) of a user using the electronic device. Summary of the Invention

[0003] Aspects and advantages of embodiments of the present disclosure will be set forth in part in the description that follows, and may be learned from the description, or may be learned by practice of the embodiments.

[0004] In one aspect, an electronic device is provided. The electronic device includes a display having a plurality of pixels. The display defines a transparent region disposed between a first pixel of the plurality of pixels and a second pixel of the plurality of pixels. The electronic device includes an image sensor disposed below the display. The image sensor is aligned with the transparent region defined by the display. The electronic device further includes an optical system disposed over the display and across the transparent region defined by the display. The optical system is configured to direct external light onto the transparent region of the display.

[0005] In some embodiments, the transparent region includes an aperture extending vertically from the image sensor to the top of the display. In some embodiments, the plurality of pixels are arranged in a plurality of rows. Further, in such embodiments, the first pixel and the second pixel are adjacent to each other in a first row of the plurality of rows. In some embodiments, the optical system includes a lens having a diameter of less than 1 millimeter.

[0006] In some embodiments, the optical system is disposed above the display. Further, in some embodiments, the top of the display includes a thin-film encapsulation layer. In some embodiments, the shape of the optical system conforms to a dome. In alternative embodiments, the cross-sectional shape of the optical system conforms to a triangle.

[0007] In some embodiments, the display includes a plurality of additional optical systems disposed on the display. Further, each of the plurality of additional optical systems can be disposed over a corresponding pixel of the plurality of pixels. In some embodiments, the optical system disposed over the transparent region of the display can have a first shape, while one or more of the additional optical systems can have a second shape different from the first shape. In some embodiments, one or more of the additional optical systems includes a lens having a diameter of less than 1 millimeter. In some embodiments, the optical system disposed over the transparent region and the plurality of additional optical systems are integrally formed as a monolithic structure.

[0008] In another aspect, a wearable computing device is provided. The wearable computing device includes a housing, a first band, and a second band. The first band is coupled to the housing at a first position. The second band is coupled to the housing at a second position. The second band is further coupleable to the first band. The wearable computing device includes a display having a plurality of pixels. The display defines a transparent area disposed between a first pixel of the plurality of pixels and a second pixel of the plurality of pixels. The electronics includes an image sensor disposed below the display. The image sensor is aligned with the transparent area defined by the display. The electronics further includes an optical system disposed over the display and across the transparent area defined by the display. The optical system is configured to direct external light onto the transparent area of ​​the display.

[0009] In some embodiments, the plurality of pixels are arranged in a plurality of rows. Further, the first pixel and the second pixel are adjacent to each other in a first row of the plurality of rows. In some embodiments, the optical system is arranged on top of the display. Further, in some embodiments, the top of the display includes a thin film encapsulation layer.

[0010] In some embodiments, the wearable computing device further includes a plurality of additional optical systems disposed on the display. Furthermore, each of the plurality of additional optical systems can be disposed over a corresponding pixel of the plurality of pixels. In some embodiments, the optical system disposed over the transparent region of the display can have a first shape, while one or more of the additional optical systems can have a second shape different from the first shape. In some embodiments, one or more of the additional optical systems includes a lens having a diameter of less than 1 millimeter. In some embodiments, the optical system disposed over the transparent region and the plurality of additional optical systems are integrally formed as a monolithic structure.

[0011] These and other features, aspects, and advantages of various embodiments of the present disclosure will become better understood with reference to the following description and appended claims. The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate exemplary embodiments of the present disclosure and, together with the description, serve to explain associated principles.

[0012] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS A detailed description of embodiments directed to those skilled in the art is set forth herein with reference to the accompanying drawings. [Brief explanation of the drawings]

[0013] [Figure 1] 1 illustrates an electronic device according to some embodiments of the present disclosure. [Figure 2] FIG. 2 illustrates a cross-sectional view of a display of an electronic device according to some embodiments of the present disclosure. [Figure 3] FIG. 2 illustrates a side view of an optical system disposed on a display of an electronic device according to some embodiments of the present disclosure. [Figure 4] FIG. 1 illustrates a wearable computing device according to some embodiments of the present disclosure. [Figure 5] FIG. 1 illustrates an exploded view of a wearable computing device according to some embodiments of the present disclosure. [Figure 6] FIG. 1 illustrates a cross-sectional view of a wearable computing device according to some embodiments of the present disclosure. DETAILED DESCRIPTION OF THE INVENTION

[0014] Reference will now be made in detail to the embodiments of the present disclosure, one or more examples of which are illustrated in the drawings. Each example is provided by way of explanation of the disclosure, and not as a limitation thereof. Indeed, it will be apparent to those skilled in the art that various modifications and variations can be made in the present disclosure without departing from the scope or spirit of the disclosure. For example, features illustrated or described as part of one embodiment can be used with another embodiment to yield a still further embodiment. Therefore, it is intended that the present invention cover such modifications and variations as come within the scope of the appended claims and their equivalents.

[0015] Exemplary aspects of the present disclosure are directed to electronic devices (e.g., smartphones, laptops, smartwatches, tablets, etc.) having a display (e.g., an organic light-emitting diode display) configured to display content (e.g., emails, text messages). The electronic device may further include an image sensor (e.g., a camera) disposed below the display. In this manner, the image sensor may be referred to as an under-display image sensor.

[0016] For example, an under-display image sensor receives less external light (e.g., light from the environment surrounding the electronic device) than an image sensor that is not disposed under the display. Therefore, the quality of an image acquired via the under-display image sensor may be inferior to the quality of an image acquired using another image sensor in the electronic device. For example, an image acquired via the under-display image sensor may be blurred compared to an image acquired via an image sensor that is not disposed under the display.

[0017] Exemplary aspects of the present disclosure are directed to electronic devices having a display that defines a transparent region defined between adjacent pixels of the display. For example, the transparent region can be defined between adjacent pixels in a row of pixels. It should be understood that the transparent region of the display does not include the pixel. In some implementations, the transparent region can be an aperture defined between an under-display image sensor and a top portion of the display (e.g., a thin encapsulation layer). More specifically, the aperture can extend from the top of the display to the image sensor. In this manner, the display can provide a dedicated path (e.g., an aperture) for directing external light passing through the top of the display onto the under-display image sensor.

[0018] The electronic device may further include an optical system disposed over the transparent region of the display to direct external light toward the transparent region (e.g., aperture) defined by the display. For example, in some embodiments, the optical system may be disposed on top of the display (e.g., a thin-film encapsulation layer). It should be understood that one or more parameters (e.g., shape) of the optical system may be configured to direct (e.g., refract) external light toward the transparent region of the display. For example, in some embodiments, the optical system may have a dome shape. In alternative embodiments, the optical system may have a shape that conforms to a triangle. More specifically, the cross-sectional shape of the optical system may conform to a triangle. In some embodiments, the optical system may include a microlens. As used herein, "microlens" refers to a lens having a diameter that is less than 1 millimeter.

[0019] In some implementations, the electronic device can include multiple additional optical systems. Each of the additional optical systems can be positioned over a corresponding pixel of the multiple pixels included in the display. Furthermore, each of the additional optical systems can be configured to direct light emitted from the corresponding pixel toward an environment surrounding the electronic device. For example, parameters (e.g., shape, refractive index) of each of the additional optical systems can be configured to focus the light emitted from the corresponding pixel. In this manner, the "screen door" effect associated with the display can be reduced or eliminated.

[0020] In some embodiments, the optical system disposed over the transparent area of ​​the display and the multiple additional optical systems disposed over the corresponding pixels of the display can be integrally formed as a monolithic structure. For example, in such embodiments, the monolithic structure can be disposed on top of the display (e.g., a thin-film encapsulation layer). In this manner, by disposing the monolithic structure on top of the display (e.g., a thin-film encapsulation layer), the optical system can be aligned with the transparent area of ​​the display, and the additional optical systems can be aligned with the corresponding pixels of the display.

[0021] In some embodiments, the optical system and the multiple additional optical systems may have the same shape. For example, the optical system and the multiple additional optical systems may have a shape that corresponds to a dome. In alternative embodiments, the optical system may have a first shape, and one or more of the additional optical systems may have a second shape that is different from the first shape. For example, the optical system disposed on the transparent region may have a cross-sectional shape that corresponds to a triangle, while one or more of the additional optical systems may have a cross-sectional shape that corresponds to a dome.

[0022] Electronic devices according to exemplary aspects of the present disclosure can provide numerous technical effects and advantages. For example, transparent regions (e.g., apertures) of a display can provide a direct path between external light and an under-display image sensor. Furthermore, optics (e.g., microlenses) disposed on the transparent regions can direct (e.g., refract) external light toward the transparent regions. In this manner, the quality of images acquired via the under-display image sensor can be improved, at least in part, by the optics directing external light toward the transparent regions of the display. It should be appreciated that directing external light toward the transparent regions of the display can improve the quality of images acquired by the under-display image sensor, particularly when the display is off (i.e., when the display is not displaying content).

[0023] Referring now to the figures, FIG. 1 illustrates an electronic device 100 having a display 110 in accordance with some embodiments of the present disclosure. In some embodiments, the display 110 may be an organic light-emitting diode display. As shown, the display 110 may include a plurality of pixels 120 (only two are shown). It should be understood that the pixels 120 may be configured to output light of a plurality of different colors. In this manner, the pixels 120 of the display 110 may be controlled to display content (e.g., images, video) for viewing by a user of the electronic device 100.

[0024] In some implementations, the pixels 120 may be arranged in a row-column configuration. For example, the display 110 may include multiple rows of pixels 120 and multiple columns of pixels 120. However, it should be understood that the pixels 120 of the display 110 may be arranged in any suitable configuration.

[0025] It should be understood that electronic device 100 may include any suitable electronic device having a display 110. For example, in some implementations, electronic device 100 may be a mobile computing device (e.g., a smartphone, a tablet, a laptop, etc.).

[0026] As shown, the display 110 can define transparent regions 130 disposed between adjacent pixels 120. For example, in an embodiment in which the pixels 120 are arranged in a row-column configuration, the transparent regions 130 can be defined between adjacent pixels in a first row of a plurality of rows. More specifically, the transparent regions 130 can be defined between adjacent pixels 120 in the first row. It should be understood that there may be no pixels 120 in the transparent regions 130. Details of transparent regions are described in more detail below.

[0027] As shown, electronic device 100 may include an image sensor 140 (indicated by a dashed circle) disposed below display 110. Image sensor 140 may be aligned with transparent region 130 of display 110. In this manner, image sensor 140 may receive light exiting transparent region 130 of display 110. In some implementations, image sensor 140 may include a camera configured to acquire image data (e.g., video, photographs).

[0028] Referring now to FIG. 2, a cross-sectional view of display 110 of electronic device 100 (FIG. 1) is provided in accordance with some embodiments of the present disclosure. Display 110 can define a horizontal direction H and a vertical direction V. As shown, display 110 can include a lower portion 200, an upper portion 210, and a middle portion 220 disposed between lower portion 200 and upper portion 210. Lower portion 200 can include, for example, a substrate. In some embodiments, the substrate can be a flexible substrate (e.g., a polyimide substrate). Upper portion 210 can include a thin-film encapsulation layer. In embodiments in which display 110 is an organic light-emitting diode display, the thin-film encapsulation layer can include a first inorganic layer, a second inorganic layer, and an organic layer disposed between the first inorganic layer and the second inorganic layer.

[0029] For the portion of display 110 that includes pixel 120, intermediate portion 220 may include multiple layers. For example, in embodiments in which display 110 is an organic light-emitting diode display, intermediate portion 220 may include cathode 222, anode 244, and one or more layers (e.g., light-emitting layer, conductive layer) disposed between cathode 222 and anode 224.

[0030] As shown, a transparent region 130 can be defined between the image sensor 140 and the top 210 of the display 110. For example, the transparent region 130 can be an aperture extending from the image sensor 140 to the top 210 of the display 110 along the vertical direction V. Additionally, the aperture can extend between adjacent pixels 120 of the display 110 along the horizontal direction H. In this manner, the transparent region 130 (e.g., an aperture) can provide a dedicated path for external light 230 (e.g., light in the environment surrounding the electronic device 100) to the image sensor 140 disposed below the display 110.

[0031] As shown, the electronic device 100 ( FIG. 1 ) can further include an optical system 300 disposed directly above the transparent region 130 of the display 110 to direct (e.g., refract) the external light 230 toward the transparent region 130 of the display 110. More specifically, the optical system 300 can direct the external light 230 toward the transparent region 130 of the display 110. In some implementations, the optical system 300 can be disposed on the top 210 of the display 110. It should be understood that one or more parameters (e.g., shape) of the optical system 300 can be configured to direct (e.g., refract) the external light 230 toward the transparent region 130 of the display 110. For example, as shown in FIG. 2 , the optical system 300 can have a shape corresponding to a dome. Alternatively or additionally, the optical system 300 can be a microlens (e.g., a lens having a diameter of less than 1 millimeter) in some implementations.

[0032] In some implementations, the electronic device 100 (FIG. 1) can include multiple additional optical systems 310 (only two shown). Each of the additional optical systems 310 can be positioned over a corresponding pixel 120 of the display 110. Furthermore, each of the additional optical systems 310 can be configured to manipulate light associated with the corresponding pixel 120. For example, each of the additional optical systems 310 can be configured to focus light associated with the corresponding pixel. In this manner, the "screen door" effect associated with the display 110 can be reduced or eliminated.

[0033] In some embodiments, the optical system 300 disposed over the transparent region 130 of the display 110 and the additional optical systems 310 disposed over the corresponding pixels 120 of the display 110 can be integrally formed as a monolithic structure. In such embodiments, the monolithic structure can be disposed on the top 210 of the display 110 (e.g., a thin-film encapsulation layer). In some embodiments, the optical system 300 and the multiple additional optical systems 310 can have the same shape. For example, the optical system 300 disposed over the transparent region 130 of the display 110 and the multiple additional optical systems 310 can have a shape corresponding to a dome. In alternative embodiments, the optical system 300 disposed over the transparent region 130 of the display 110 can have a first shape, and one or more of the additional optical systems 300 can have a second shape that is different from the first shape.

[0034] It should be understood that in some implementations, the electronic device 100 can include multiple image sensors 140. In such implementations, the display 110 of the electronic device 100 can include multiple transparent regions 130. Furthermore, the electronic device 100 can include multiple optical systems 300. For example, each of the optical systems 300 can be disposed over a corresponding one of the multiple transparent regions 130. In this manner, the external light 230 can be directed to each of the transparent regions 130 via the corresponding optical system 300. It should be understood that directing the external light 230 onto the transparent regions 130 of the display 110 can increase the amount of external light 230 directed to the image sensor 140, thereby improving the quality of the image acquired via the image sensor 140.

[0035] 3 , optical system 300, positioned directly above transparent region 130 of display 110, may, in some implementations, have a cross-sectional shape that corresponds to a triangle. As shown, a first side of optical system 300 may direct external light 230 toward transparent region 130 of display 110. Additionally, a second side of optical system 300 may direct external light 230 toward transparent region 130 of display 110. It should be understood that optical system 300 may have any suitable shape configured to facilitate directing (e.g., refracting) external light 230 toward transparent region 130 of display 110.

[0036] 4-6, a wearable computing device 400 is provided in accordance with some embodiments of the present disclosure. It should be understood that the wearable computing device 400 may include the display 110 of the electronic device 100 described above with reference to FIGS. 1 and 2. Additionally, the wearable computing device 400 may include the image sensor 140 of the electronic device 100 described above with reference to FIGS. 1 and 2. Still further, the wearable computing device 400 may include the optical systems 300, 310 described above with reference to FIGS. 1 and 2. In particular, the wearable computing device 400 may include the optical system 300 (FIG. 2) disposed on the transparent region 130 (FIG. 2) of the display 110. Details of the wearable computing device 400 will now be described.

[0037] As shown, the wearable computing device 400 can be worn, for example, on a user's arm 402 (e.g., wrist). For example, the wearable computing device 400 can include a housing 410. The housing 410 can define a cavity 411 in which one or more electronic components (e.g., disposed on a printed circuit board) are disposed. For example, the wearable computing device 400 can include a printed circuit board 420 disposed within the cavity 411. Further, one or more electronic components can be disposed on the printed circuit board 420.

[0038] The wearable computing device 400 may include a first band 430 and a second band 432. As shown, the first band 430 may be coupled to the housing 410 at a first position thereof. Conversely, the second band 432 may be coupled to the housing 410 at a second position thereof. Additionally, the first band 430 and the second band 432 may be coupled to each other to secure the housing 410 to the user's arm 402.

[0039] In some embodiments, the first band 430 can include a buckle or clasp (not shown). Additionally, the second band 432 can include a plurality of openings (not shown) spaced apart from one another along the length of the second band 432. In such embodiments, a protrusion of a buckle associated with the first band 430 can extend through one of the plurality of openings defined by the second band 432 to couple the first band 430 to the second band 432.

[0040] It should be appreciated that any suitable type of fastener can be used to couple first band 430 to second band 432. For example, in some embodiments, first band 430 and second band 432 can include magnets. In such embodiments, first band 430 and second band 432 can be magnetically coupled to one another to secure housing 410 to user's arm 402.

[0041] Wearable computing device 400 may include a display 110 configured to display content (e.g., time, date, biometrics, notifications, etc.) for a user to view. For example, display 110 may include a plurality of pixels. In some implementations, display 110 may include an organic light-emitting diode display. However, it should be understood that display 110 may include any suitable type of display.

[0042] In some implementations, wearable computing device 400 may include a cover 450 disposed on housing 410 such that cover 450 is disposed over display 110. In this manner, cover 450 may protect display 110 from scratches. In some implementations, wearable computing device 400 may include a seal (not shown) disposed between housing 410 and cover 450. For example, a first surface of the seal may contact housing 410 and a second surface of the seal may contact cover 450. In this manner, the seal between housing 410 and cover 450 may prevent liquid (e.g., water) from entering cavity 411 defined by housing 410.

[0043] It should be appreciated that cover 450 may be optically transparent so that a user can view information displayed on display 110. For example, in some embodiments, cover 450 may comprise a glass material. However, it should be appreciated that cover 450 may comprise any suitable optically transparent material. For example, in some embodiments, cover 450 may comprise a plastic material.

[0044] While the present subject matter has been described in detail with reference to various specific exemplary embodiments thereof, each example is provided by way of explanation and not a limitation of the disclosure. Those skilled in the art, upon understanding the foregoing, will readily be able to make modifications, variations, and equivalents to such embodiments. Accordingly, the present disclosure does not exclude the inclusion of such modifications, alterations, and / or additions to the present subject matter as would be readily apparent to one skilled in the art. For example, features illustrated or described as part of one embodiment can be used with another embodiment to yield yet a further embodiment. Accordingly, the present disclosure is intended to cover such modifications, variations, and equivalents.

Claims

1. An electronic device, a display including a plurality of pixels, the display defining a transparent area disposed between a first pixel of the plurality of pixels and a second pixel of the plurality of pixels, the electronic device further comprising: an image sensor disposed below the display, the image sensor aligned with the transparent area defined by the display; an optical system disposed over the display and across the transparent area defined by the display, the optical system configured to direct external light onto the transparent area of ​​the display; the display includes a lower portion, an upper portion, and an intermediate portion disposed between the lower portion and the upper portion; the lower portion includes a substrate, the optical system is disposed in the upper portion, and the middle portion includes a light-emitting layer; The transparent area includes an opening that extends vertically from the image sensor through the lower and middle portions to the upper portion.

2. The electronic device of claim 1 , wherein the plurality of pixels are arranged in a plurality of rows, and the first pixel and the second pixel are adjacent to each other in a first row of the plurality of rows.

3. 3. The electronic device of claim 1, wherein the optical system comprises a lens having a diameter of less than 1 millimeter.

4. The electronic device of any one of claims 1 to 3, wherein the top of the display comprises a thin film encapsulation layer.

5. 5. The electronic device according to claim 1, wherein the optical system has a shape that corresponds to a dome.

6. 6. The electronic device according to claim 1, wherein the cross-sectional shape of the optical system coincides with a triangle.

7. 7. The electronic device of claim 1, further comprising a plurality of additional optical systems arranged on the display, each of the plurality of additional optical systems being arranged on a corresponding pixel of the plurality of pixels.

8. the optical system disposed over the transparent area of ​​the display has a first shape; The electronic device of claim 7 , wherein one or more of the plurality of additional optical systems has a second shape that is different from the first shape.

9. The electronic device of claim 7 , wherein one or more of the additional optics comprises a lens having a diameter of less than 1 millimeter.

10. The electronic device according to claim 8 , wherein the optical system disposed on the transparent area and the plurality of additional optical systems are integrally formed as a monolithic structure.

11. 1. A wearable computing device, comprising: The housing and a first band coupled to the housing at a first location; a second band coupled to the housing at a second position, the second band being coupleable to the first band, the wearable computing device further comprising: a display including a plurality of pixels, the display defining a transparent area disposed between a first pixel of the plurality of pixels and a second pixel of the plurality of pixels, the wearable computing device further comprising: an image sensor disposed below the display, the image sensor aligned with the transparent area defined by the display, the wearable computing device further comprising: an optical system disposed over the display and across the transparent area defined by the display, the optical system configured to direct external light onto the transparent area of ​​the display; the display includes a lower portion, an upper portion, and an intermediate portion disposed between the lower portion and the upper portion; the lower portion includes a substrate, the optical system is disposed in the upper portion, and the middle portion includes a light-emitting layer; A wearable computing device, wherein the transparent area comprises an opening extending vertically from the image sensor through the bottom and middle portions to the top.

12. 12. The wearable computing device of claim 11, wherein the plurality of pixels are arranged in a plurality of rows, and the first pixel and the second pixel are adjacent to each other in a first row of the plurality of rows.

13. 13. The wearable computing device of claim 11 or 12, wherein the top of the display comprises a thin film encapsulation layer.

14. 14. The wearable computing device of claim 11, further comprising a plurality of additional optical systems disposed on the display, each of the plurality of additional optical systems being disposed on a corresponding pixel of the plurality of pixels.

15. The wearable computing device of claim 14 , wherein one or more of the additional optics comprises a lens having a diameter of less than 1 millimeter.

16. The wearable computing device of claim 14 , wherein the optical system disposed over the transparent area of ​​the display and the plurality of additional optical systems are integrally formed as a monolithic structure.

17. The wearable computing device of claim 11 , wherein the transparent area comprises an opening defined between the image sensor and a top of the display.

Images