Computing device, method and computer-readable storage medium

Abstract

The computing device includes a display panel having a first end and a second end, a sensor, and a processing circuit. The display panel includes a matrix of pixels and defines an aperture surrounded by pixels of the matrix of pixels but not including pixels of the matrix of pixels. A length of the aperture parallel to an axis connecting the first end and the second end is greater than a length of the aperture perpendicular to the axis. The sensor is configured to capture light passing through the aperture. The processing circuit is disposed proximate the second end and configured to output a control signal to the pixel of the matrix of pixels.

Description

[Technical field]

[0001] This application claims the benefit of U.S. Patent Application No. 17 / 197,784, filed March 10, 2021, the entire contents of which are incorporated herein by reference. [Background technology]

[0002] background Computing devices, such as so-called smartphones, tablets, etc., may include one or more cameras for taking pictures and videos. An example of such a camera may be a front-facing camera, i.e., a camera that faces a user of the computing device when the user is looking at a display panel of the computing device. The front-facing camera may be used, for example, to take selfies or videos. The computing device may be configured such that the front-facing camera is within the housing of the computing device and below the display panel. Summary of the Invention [Problem to be solved by the invention]

[0003] In such configurations, a region of the display panel (usually in the shape of a circle or "punch hole") cannot contain light-blocking components (e.g., light-emitting diodes (LEDs), traces, etc.) to define an aperture (e.g., a transparent hole) through which light can pass to reach the front camera's image sensor. Because the aperture cannot contain light-blocking components, such as light-emitting elements (e.g., pixels), the active area of ​​the display panel (i.e., the area useful for displaying an image) can be reduced.

[0004] overview Generally, the amount of light that reaches the image sensor can affect the performance of the image sensor and therefore the performance of the camera. Therefore, the display panel can be configured to define an aperture that is large enough to ensure that a sufficient amount of light reaches the image sensor of the front camera. For example, since the shape of the image sensor is usually rectangular and the shape of the aperture is usually circular, the display panel can define a circular aperture with a border that surrounds the underlying rectangular image sensor so that the image sensor is not optically blocked by the display panel (when looking vertically and facing the front camera).

[0005] However, a display panel may define an aperture having dimensions that reduce the active area of ​​the display panel without improving the performance of the front camera. For example, some of the light passing through a large aperture relative to the underlying image sensor may fall somewhere other than the image sensor (i.e., outside the bounds of the image sensor). Similarly, light passing through an aperture having a different shape than the image sensor may fall somewhere other than the image sensor. For example, some of the light passing through a circular aperture may fall outside the bounds of the image sensor. [Means for solving the problem]

[0006] In general, the present disclosure is directed to a display panel having an aperture of reduced area that allows an underlying front camera image sensor to receive sufficient light. According to one or more aspects of the present disclosure, rather than the aperture having a circular shape, the aperture may have an oblong shape in which the length of the aperture parallel to the long axis of the display panel is longer than the length of the aperture perpendicular to the axis. For reasons explained in more detail below, such a shape may reduce the size of the aperture and the size of the inactive bezel surrounding the aperture as well as reduce the proportion of light passing through the aperture that gets somewhere other than the front camera image sensor. As a result, the active area of ​​the display panel of the computing device may be increased without compromising the performance of the front camera.

[0007] An example computing device includes a display panel having a first end and a second end. The display panel includes a matrix of pixels and defines an aperture surrounded by, but not including, pixels of the matrix of pixels. A length of the aperture parallel to an axis connecting the first end and the second end is greater than a length of the aperture perpendicular to the axis. The example computing device includes a sensor configured to capture light passing through the aperture and a processing circuit disposed proximate the second end and configured to output a control signal to a pixel of the matrix of pixels.

[0008] An example method includes displaying a first image at a first time on a display panel of a computing device. The display panel has a first end and a second end. The display panel includes a matrix of pixels and defines an aperture surrounded by pixels of the matrix of pixels but not including pixels of the matrix of pixels. A length of a physical shape of the aperture parallel to an axis connecting the first end and the second end is greater than a length of a physical shape of the aperture perpendicular to the axis. An example method includes displaying a second image on the display panel at a second time different from the first time, the second image causing a physical shape of the aperture to have a modified apparent shape different from the physical shape, and capturing the image with a sensor that senses light passing through the aperture.

[0009] An example non-transitory computer readable storage medium stores instructions that, when executed, cause a processing circuit of a computing device to display a first image at a first time on a display panel of the computing device. The display panel has a first end and a second end. The display panel includes a matrix of pixels and defines an aperture surrounded by pixels of the matrix of pixels but not including pixels of the matrix of pixels. A length of a physical shape of the aperture parallel to an axis connecting the first end and the second end is longer than a length of a physical shape of the aperture perpendicular to the axis. An example non-transitory computer readable storage medium stores instructions that, when executed, cause a processing circuit of a computing device to display a second image at a second time different from the first time on the display panel, the second image resulting in a physical shape of the aperture having a modified apparent shape different from the physical shape, and instructions to capture an image with a sensor that senses light passing through the aperture.

[0010] The details of one or more embodiments of the disclosure are set forth in the accompanying drawings and the description below. Other features, objects, and advantages will become apparent from the description and drawings, and from the claims. [Brief description of the drawings]

[0011] [Figure 1] FIG. 1 is a system diagram illustrating an example computing device having a display panel defining an oblong aperture surrounded by a matrix of pixels, in accordance with one or more aspects of the present disclosure. [Figure 2A] 1A-1D are conceptual diagrams illustrating various example shapes of apertures in a computing device, in accordance with one or more aspects of the present disclosure. [Figure 2B] 1A-1D are conceptual diagrams illustrating various example shapes of apertures in a computing device, in accordance with one or more aspects of the present disclosure. [Figure 2C] 1A-1D are conceptual diagrams illustrating various example shapes of apertures in a computing device, in accordance with one or more aspects of the present disclosure. [Diagram 3] 1 is a conceptual diagram illustrating an example bezel surrounding an aperture of a computing device. [Figure 4] FIG. 2 is a system diagram illustrating the field of view of a front camera of an example computing device, in accordance with one or more aspects of the present disclosure. [Diagram 5] 2 is a block diagram illustrating the computing device of FIG. 1 in greater detail. [Figure 6] 1 is a flowchart illustrating an example method of operating a computing device having an aperture to modify a shape of the aperture, in accordance with one or more techniques of this disclosure. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0012] Detailed Description 1 is a system diagram illustrating an example computing device 100 having a display panel 102 defining an oblong aperture 104 ("aperture 104") surrounded by a matrix of pixels in accordance with one or more aspects of the present disclosure. Examples of computing devices 100 may include, but are not limited to, mobile phones (including so-called "smartphones"), foldable computing devices, smart glasses, smart watches, portable speakers (including portable smart speakers), laptop computers, portable gaming systems, wireless gaming system controllers, ambient computing devices (including so-called "smart displays"), and the like. As shown in FIG. 1, computing device 100 may include a camera 101, a display 102, and a processing circuit 106.

[0013] The display panel 102 may include a first end 110 and a second end 112. The first end 110 and the second end 112 may oppose one another such that an axis 108 connects the first end 110 and the second end 112. Examples of the display panel 102 may include, but are not limited to, a liquid crystal display (LCD), a light emitting diode (LED) display, an organic light emitting diode (OLED) display, an active matrix organic light emitting diode ("AMOLED") display, a micro LED display, or similar monochrome or color displays capable of outputting visible information to a user of the display panel 102. In some examples, the display panel 102 may be configured to allow sensors beneath the display panel 102 to operate through the display panel by omitting back cover material from an area of ​​the display back cover above the sensors. In such examples, the display panel 102 may be an OLED display, an AMOLED display, or any other suitable display. The display panel 102 may include light emitting elements arranged as a matrix of pixels.

[0014] As shown in FIG. 1, the computing device 100 includes a processing circuit 106 within a housing of the computing device 100. The processing circuit 106 may perform functions and / or execute instructions within the computing device 100. For example, the processing circuit 106 is configured to output control signals to pixels of the display panel 102. Examples of the processing circuit 106 may include a display driver integrated circuit (DDIC), a central processing unit (CPU), a visual processing unit (VPU), a graphics processing unit (GPU), a tensor processing unit (TPU), a neural processing unit (NPU), a neural processing engine, a core of a CPU, a VPU, a GPU, a TPU, an NPU, or other processing device, an application specific integrated circuit (ASIC), a field programmable gate array (FPGA), a coprocessor, a controller, or a combination of the above-mentioned processing devices. The processing circuit 106 may be embedded within other hardware components (e.g., an image sensor, an accelerometer, etc.). Additionally, the computing device 100 may include a processing device in addition to the processing circuit 106, such as another processing circuit.

[0015] The processing circuit 106 may be located in any portion of the device 100. As an example, the processing circuit 106 may be located proximate the second end 112. As mentioned above, the processing circuit 106 may include a DDIC. In some examples, the processing circuit 112 may be located at least in part under another component of the device 100, such as the display panel 102. In some examples, such as when the processing circuit 106 includes a DDIC, the processing circuit 106 may be connected to the display panel 102 by a ribbon cable. Thus, the processing circuit 106 may be a DDIC located proximate the second end 112, or may be at least in part under the display panel 102 and connected to the display panel 102 by a ribbon cable.

[0016] Computing device 100 may include one or more cameras configured to obtain image data. For example, camera 101 may be integrated into computing device 100 such that a lens of camera 101 faces toward a user of computing device 100 when the user is looking at display panel 102. Camera 101 may be referred to as a front-facing camera. Computing device 100 may also include one or more rear-facing cameras (not shown for ease of illustration) that face generally opposite camera 101. In general, camera 101 may include a camera body (e.g., defined within computing device 100).

[0017] As mentioned above, the display panel 102 may include a matrix of pixels. The matrix of pixels may be arranged such that the display panel 102 defines an aperture 104 (e.g., a hole, a transparent window, etc.) that is surrounded by pixels of the matrix of pixels. The display panel 102 may define the aperture 104 having a length L1 and a length L2, where L1 is the length of the aperture 104 parallel to the axis 108 and L2 is the length of the aperture 104 perpendicular to the axis 108.

[0018] The aperture 104 may be configured to allow light into the camera body of the camera 101 to form an image on the image sensor 105 of the camera 101. For example, the aperture 104 may not include light-blocking components, such as light-emitting elements (e.g., pixels), such that the aperture 104 is a transparent area. Because the aperture 104 may not include a pixel of a matrix of pixels, the aperture 104 may be a blind area (i.e., an area without active pixels). In some examples, the aperture 104 may be defined proximate to the first end 110 of the display panel 102. For example, the center of gravity of the aperture 104 may be closer to the first end 110 than to the second end 112. In some examples, an inactive, non-transparent bezel 115 ("bezel 115") may surround the aperture 104. Thus, the blind area of ​​the display panel 102 may include the area of ​​the aperture 104 and the area of ​​the bezel 115.

[0019] The image sensor 105 of the camera 101 may be an electronic image sensor. The image sensor 105 may be configured to detect (e.g., capture) and transmit information used to generate an image. For example, the image sensor 105 may convert the variable attenuation of light waves (e.g., as light waves pass through or reflect from the aperture 104) into a digital signal that is received by a processing device of the computing device 100. Examples of the image sensor 105 may include a charge-coupled device (CCD), a complementary metal-oxide semiconductor sensor (CMOS sensor), and the like. The image sensor 105 may vary in shape and size. As shown in FIG. 1, the shape of the image sensor 105 may be rectangular.

[0020] The configuration of the camera 101 may affect various properties of the light that reaches the image sensor 105. For example, the camera 101 may include a lens configured to focus the light that enters the camera 101. Similarly, the size of the aperture 104 of the camera 101 may be increased or decreased to allow more or less light to pass through the aperture 104 and reach the image sensor 105. The configuration of the camera 101 may also define the field of view (FOV) of the camera 101. The FOV may represent the portion of a scene that is visible through the camera at a particular position and orientation in space. Thus, objects outside the FOV when the image is captured may not be recorded in the image. In some examples, the angle of the FOV may be affected by the lens, aperture 104, and image sensor 105 of the camera 101.

[0021] In some examples, aperture 104 may have a size large enough to ensure that the entirety of image sensor 105 (e.g., the entirety of the active area of ​​image sensor 105) is not optically blocked by display panel 102. For example, display panel 102 may define aperture 104 with a boundary large enough to surround image sensor 105 such that the entirety of image sensor 105 is not optically blocked by display panel 102.

[0022] Because the aperture 104 may not contain any light emitting elements (e.g., pixels), the active area (i.e., the area useful for displaying an image) of the display panel 102 may be reduced. However, this reduction in active area may not correspond to an improvement in the performance of the camera 101 because, depending on the dimensions of the aperture 104, some of the light passing through the aperture 104 may not reach the image sensor 105 of the camera 101, but instead may enter somewhere other than the image sensor 105.

[0023] For example, light may enter region 114 (shown in FIG. 1 as the total area of ​​the shaded region between the boundary of aperture 104 and the boundary of image sensor 105). Region 114 may therefore represent a portion of aperture 104 that is a blind area and does not contribute to the performance of camera 101. Thus, reducing the area of ​​region 114 may advantageously allow for pixel regrowth of display panel 102, increasing the active area of ​​the display panel without compromising the performance of camera 101.

[0024] According to one or more aspects of the present disclosure, a display panel (e.g., display panel 102) of a computing device (e.g., computing device 100) may define a reduced-area aperture (e.g., relative to a circular aperture) while still allowing sufficient light to enter onto an image sensor (e.g., image sensor 105). For example, rather than display panel 102 defining aperture 104 having a circular shape, display panel 102 may define a reduced-area aperture with an oblong shape that more closely resembles the size, shape, orientation, etc., of image sensor 105 as compared to a circle, allowing the area of ​​aperture 104 to be reduced without affecting the performance of camera 101. Additionally, L1 of the reduced-area aperture may be longer than L2 of the reduced-area aperture, thereby reducing the thickness of the bezel (as described in more detail with respect to FIGS. 3A-3B), which in turn may further reduce the blind area of ​​computing device 100.

[0025] For example, as shown in the example of FIG. 1, the aperture 104 has a rectangular shape with rounded corners. The shape of the aperture 104 may be more similar to the image sensor 105 than a circle, such that the boundaries of the aperture 104 more closely contour the periphery of the image sensor 105 than the boundaries of a circular aperture. As mentioned above, the aperture 104 may be defined by the display panel 102 to ensure that the entirety of the image sensor 105 is not optically blocked by the display panel 102. However, compared to a circular aperture, the aperture 104 may have a smaller area (due to less spacing between the boundaries of the aperture 104 and the boundaries of the image sensor 105), potentially allowing for a reduction in the blind area of ​​the display panel 102. In particular, by using an aperture 104 having a rectangular shape with rounded corners instead of a circular aperture, the area of ​​the region 114 may be reduced, potentially allowing for pixel regrowth and an increase in the active area of ​​the display panel 102.

[0026] Other shapes for the reduced area aperture are contemplated by the present disclosure. For example, the reduced area aperture may have a rectangular, elliptical, disk-shaped rectangular, or any other oblong elliptical shape. In any case, the L1 of the reduced area aperture (e.g., aperture 104) may be longer than the L2 of the reduced area aperture to reduce the thickness of the bezel, thereby further reducing the blind area of ​​the display panel 102. Similarly, the image sensor 105 may have the same orientation as the reduced area aperture to reduce the blind area. That is, as with the reduced area aperture, the length of the image sensor 105 parallel to the axis 108 may be longer than the length of the image sensor 105 perpendicular to the axis 108. In this way, the reduced area aperture may be more closely contoured around the boundary of the image sensor 105, reducing the area of ​​the region (e.g., region 114A) that represents the proportion of light that does not reach the image sensor 105.

[0027] 2A-2C are conceptual diagrams illustrating various example apertures 204A-204C (collectively, "apertures 204") of a computing device according to one or more techniques of the present disclosure. Each of the apertures 204 (e.g., apertures 204A-204C) is an example of the aperture 104 shown in FIG. 1. Although only a few shapes of the apertures 204 are shown herein, it should be understood that other oblong shapes are contemplated, including rectangles with rounded corners. As shown in FIG. 2A-2C, the apertures 204 may have a size large enough that each boundary encompasses the entirety (of the active area) of the image sensor 205 such that the entirety of the image sensor 205 is not optically blocked by the display panel (e.g., display panel 102). The image sensor 205 is an example of the image sensor 105 shown in FIG. 1. Thus, the shape, size, orientation, etc. of the image sensor 205 may be the same as those of the image sensor 105. In some examples, the aspect ratio of the image sensor 205 may be 4:3, 3:2, 1.85:1, etc.

[0028] As shown in FIG. 2A, light may pass through a disk-shaped rectangular shaped aperture 204A having L1 longer than L2 to reach the image sensor 205. The aperture 204A may have a size large enough that the border of the aperture 204A surrounds the entire image sensor 205 such that the entire image sensor 205 is not optically blocked (e.g., by the display panel 102). As shown in the example of FIG. 2A, the image sensor 205 may receive only a proportion of the light that passes through the aperture 204A, such that the remaining light enters elsewhere. The proportion of light that does not reach the image sensor 205 may be represented by an area 214A (which is an example of the area 114 shown in FIG. 1) of the aperture 204A. Region 214A may be smaller than the area between the boundary of the circular aperture and the boundary of the image sensor (e.g., image sensor 205) surrounded by the circular aperture, potentially allowing pixel regrowth in the area near aperture 204A and increasing the active area of ​​the display panel (e.g., display panel 102).

[0029] As shown in FIG. 2B, light may pass through an elliptical shaped aperture 204B having L1 longer than L2 to reach the image sensor 205. The aperture 204B may have a size large enough that the border of the aperture 204B surrounds the entire image sensor 205 such that the entire image sensor 205 is not optically blocked (e.g., by the display panel 102). As shown in the example of FIG. 2B, the image sensor 205 may receive only a proportion of the light that passes through the aperture 204B, such that the remaining light enters elsewhere. The proportion of light that does not reach the image sensor 205 may be represented by an area 214B (which is an example of the area 114 shown in FIG. 1) of the aperture 204B. Region 214B may be smaller than the area between the boundary of the circular aperture and the boundary of the image sensor (e.g., image sensor 205) surrounded by the circular aperture, potentially allowing pixel regrowth in the area near aperture 204B and increasing the active area of ​​the display panel (e.g., display panel 102).

[0030] As shown in FIG. 2C, light may pass through a rectangular aperture 204C having L1 longer than L2 to reach the image sensor 205. The aperture 204C may have a size large enough that the border of the aperture 204C encompasses the entire image sensor 205. Alternatively, the aperture 204C may be larger, as shown in FIG. 2C. In either case, the image sensor may not be optically blocked (e.g., by the display panel 102). As shown in the example of FIG. 2C, the image sensor 205 may receive only a proportion of the light that passes through the aperture 204C, such that the remaining light enters elsewhere. The proportion of light that does not reach the image sensor 205 may be represented by an area 214C (which is an example of the area 114 shown in FIG. 1) of the aperture 204C. Region 214C may be smaller than the area between the boundary of the circular aperture and the boundary of the image sensor (e.g., image sensor 205) surrounded by the circular aperture, potentially allowing pixel regrowth in the area near aperture 204C and increasing the active area of ​​the display panel (e.g., display panel 102).

[0031] As shown in FIGS. 2A-2C, the area of ​​region 214, which represents the proportion of light that does not reach image sensor 205, may be reduced by making aperture 204 (e.g., compared to aperture 104) more similar in size, shape, orientation, etc. to those of image sensor 205, such that aperture 204 (e.g., compared to aperture 104) more closely contours around the boundaries of image sensor 205. For example, a circular aperture may have a relatively large spacing between the boundaries of the circular aperture and the boundaries of the image sensor (e.g., image sensor 205), and thus a relatively large area therebetween. On the other hand, as shown in the example of FIG. 2C, aperture 204C having a rectangular shape may result in a relatively small spacing between the boundaries of aperture 204C and the boundaries of image sensor 205, and thus a relatively small area 214C.

[0032] In some examples, a computing device (e.g., computing device 100), in addition to a first processing circuit (e.g., processing circuit 106) configured to output control signals to pixels of the matrix of pixels, may include a second processing circuit configured to control operation of the first processing circuit such that pixels of the matrix of pixels surrounding aperture 204 are selectively deactivated to modify the appearance of the shape of aperture 204. For example, even if display panel 102 of computing device 100 defines aperture 204C such that the shape of aperture 204C is rectangular, the second processing circuit may control operation of processing circuit 112 to deactivate pixels surrounding aperture 204C to make the shape of aperture 204C appear to a user of computing device 100 as a circle similar to aperture 104, a rectangle with rounded corners similar to aperture 104, a disc-shaped rectangle similar to aperture 204A, an ellipse similar to aperture 204B, a square, etc.

[0033] According to the technique used for tracing the route, when a processing circuit (e.g., processing circuit 106) configured to output control signals to pixels of a matrix of pixels is placed proximate to a second end (e.g., second end 112) of a computing device (e.g., computing device 100), it is understood by those skilled in the art that the length (i.e., L1) of an aperture (e.g., aperture 104, aperture 204, etc.) parallel to an axis (e.g., axis 108) connecting a first end (e.g., first end 110) and a second end of the computing device may not affect the thickness of the bezel, but the length (i.e., L2) of the aperture perpendicular to the axis may increase the thickness of the bezel. Thus, if the first length of the aperture is longer than the second length of the aperture, by orienting the aperture such that the first length is perpendicular to the axis, the thickness of the bezel surrounding the aperture may increase, increasing the blind area of ​​the display panel.

[0034] Figure 3 is a conceptual diagram illustrating an example bezel 315 (which is an example of the bezel 115 shown in Figure 1) surrounding an aperture 304 of a computing device (e.g., computing device 100). As shown in Figure 3, the aperture 304 may be surrounded by an area representing the bezel 315. The aperture 304 is an example of the aperture 104 shown in Figure 1. Thus, the aperture 104 may be in the shape of a rectangle with rounded corners, with L1 longer than L2.

[0035] The orientation of the aperture 304 may result in a reduction in the thickness of the bezel 315. For example, if the aperture 304 is oriented on a display panel (e.g., the display panel 102) such that L2 is longer than L1 (e.g., the aperture 304 is rotated 90°), instead of the orientation of the aperture 304 shown in FIG. 3, the thickness of the bezel 315 may increase (relative to the thickness of the bezel shown in FIG. 3).

[0036] In an example where the first length of the aperture 304 is longer than the second length of the aperture 304, the aperture 304 may be oriented such that the first length of the aperture 304 is parallel to an axis (e.g., axis 108) connecting a first end (e.g., first end 110) and a second end of a computing device (e.g., computing device 100), and the second length of the aperture is perpendicular to the axis. In other words, the aperture 304 may be oriented such that the (longer) first length of the aperture 304 is L1 and the (shorter) second length of the aperture 304 is L2, with L1 being longer than L2. As a result, the thickness of the bezel 315 surrounding the aperture 304 may be reduced, or at least an increase in the thickness of the bezel 315 (due to a different orientation of the aperture 304) may be avoided. Thus, pixels may be grown in the area near the bezel 315, potentially increasing the active area of ​​a display panel (eg, display panel 102).

[0037] 4 is a system diagram illustrating the FOV of a camera 401 through a display panel 402 of a computing device 400, according to one or more aspects of the present disclosure. The computing device 400 is an example of the computing device 100 shown in FIG. 1. The camera 401 is an example of the camera 101 shown in FIG. 1. The display panel 402 is an example of the display panel 102 shown in FIG. 1. As shown in FIG. 4, the display panel 402 may include a matrix 418 of (non-transparent) pixels. The matrix 418 of pixels may define an aperture 404 (which is an example of the aperture 104 shown in FIG. 1) having a length L1 and a length L2. For example, the aperture 404 may be surrounded by pixels of the matrix 418 of pixels. At the same time, the aperture 404 may not include pixels of the matrix 418 of pixels. Further, the matrix of pixels 418 may define a bezel 415 (which is one example of the bezel 115 shown in FIG. 1) that surrounds the aperture 404. The bezel may be inactive and non-transparent. The bezel 415 may have a thickness T.

[0038] The light waves 416 may pass through an aperture 404, which is configured to be transparent, to reach the image sensor 405 of the camera 401. As shown in FIG. 4, the aperture 404 may be defined such that the boundaries of the aperture 404 surround the entire image sensor 405 (which is an example of the image sensor 105 shown in FIG. 1) such that the entire image sensor 405 is not optically blocked by the display panel 402. That is, a first proportion of the light waves 416 may reach any portion of the active area of ​​the image sensor 405. However, as also shown in FIG. 4, a second proportion of the light waves 416 may enter somewhere other than the image sensor 405.

[0039] As described above, the configuration of the camera 401 may determine the FOV 419 of the camera 401. The FOV 419 may represent the portion of a scene that is visible through the camera at a particular position and orientation in space. Thus, objects outside the FOV 419 at the time the image is captured may not be recorded in the image. In some examples, the angle of the FOV 419 may be affected by the lens, aperture 404, and image sensor 405 of the camera 401.

[0040] In some examples, the aperture 404 may be defined such that the display panel 402 does not optically block the FOV 419. For example, as shown in FIG. 4, L2 of the aperture 404 may be long enough so that neither the bezel 415 nor the matrix of pixels 418 blocks the FOV 419. Although not shown in FIG. 4, it should be understood that L1 or any other length of the aperture 404 may also be long enough so that neither the bezel nor the matrix of pixels 418 optically block the FOV 419.

[0041] However, in some respects, the size of the aperture 404 does not affect the FOV 419 (e.g., does not determine whether the FOV 419 is blocked by the bezel 415 or the matrix of pixels). For example, as shown in FIG. 4, the L2 of the aperture 404 may be wider than the maximum angle of the FOV 419 of the camera 401. Thus, the length (e.g., L1, L2, etc.) of the aperture 404 may generally affect the FOV 419, and in some examples, increasing the size of the aperture 404 may increase the blind area of ​​the display 402 without increasing the FOV 419.

[0042] Because the aperture 404 may be the only transparent area of ​​the display panel 402, the aperture 404 may be surrounded by non-transparent areas that block the FOV 419. Furthermore, whether the non-transparent area surrounding the aperture 404 is the bezel 415 or the matrix of pixels 418 may be irrelevant since the blockage of the FOV 419 may be the same in either case. Thus, in examples where the bezel 415 surrounds the (transparent) aperture 404, the thickness of the bezel 415 may not increase or decrease the FOV 419 (as opposed to the size of the aperture 404, which may increase or decrease the FOV 419 in some examples). However, because the bezel 415 may be inactive, the thickness of the bezel 415 may still affect the blind area of ​​the display panel 402. As mentioned above, by defining the aperture 404 such that L1 of the aperture 404 is longer than L2 of the aperture 404, the thickness of the bezel 415 may be reduced, potentially allowing pixel regrowth near the bezel 415.

[0043] FIG. 5 is a block diagram illustrating an embodiment of the computing device of FIG. 1 in more detail. The computing device 500 illustrated in the embodiment of FIG. 5 is an example of the computing device 100 illustrated in FIG. 1. As illustrated in the embodiment of FIG. 5, the computing device 500 includes a presence-aware display 502 (which may be an example of the display panel 102 illustrated in FIG. 1), one or more processors 520, one or more communications ("COMM") components 522, one or more image sensors 505 (each an example of the image sensor 105), and one or more storage devices 526. As illustrated in FIG. 5, the storage device 526 may include a dynamic aperture module 534, a user interface (UI) module 536, and application modules 538A-538N (collectively, "application modules 538").

[0044] A communication channel 528 may interconnect (physically, communicatively, and / or operatively) each of the components 502, 505, 520, 522, and / or 526 for inter-component communication, thereby allowing the components 502, 505, 520, 522, and 526 to communicate with one another. In some examples, the communication channel 528 may include a system bus, a network communication, one or more inter-process communication data structures, or any other component for communicating data (also referred to as information). Although shown to include components 502, 505, 520, 522, and 526, the computing device 500 may include other components or fewer components than those shown, and such components may be included in other control units, such as a telematic control unit (TCU).

[0045] One or more COMM components 522 of the computing device 500 may communicate with external devices by transmitting and / or receiving data. For example, the computing device 500 may use one or more of the COMM components 522 to transmit and / or receive radio signals over a wireless network, such as a cellular wireless network. In some examples, the COMM components 522 may transmit and / or receive satellite signals over a satellite network, such as a Global Positioning System (GPS) network. Examples of the COMM components 522 include network interface cards (such as Ethernet cards), optical transceivers, radio frequency transceivers, GPS receivers, or any other type of device that may transmit and / or receive information. Other examples of the COMM components 522 may include shortwave radios (e.g., short-range communications (NFC), Bluetooth (including Bluetooth Low Energy (BLE)), GPS, 3G, 4G, 5G, and WiFi radios found in mobile devices, as well as universal serial bus (USB) controllers, and the like.

[0046] In some examples, the presence-sensing display 502 of the computing device 500 may include functionality of an input component and / or an output component. In the example of FIG. 5, the presence-sensing display 502 may include a presence-sensing input (PSI) component 530 ("PSI component 530"), such as a presence-sensing screen or a touch-sensing screen. In some examples, the PSI component 530 may detect an object at and / or near the PSI component 530. As an example of range, the PSI component 530 may detect an object, such as a finger or stylus, that is within 2 inches or less than 2 inches of the PSI component 530. The PSI component 530 may determine a location (e.g., (x,y) coordinates) of the PSI component 530 where the object is detected. In another example of range, the PSI component 530 may detect an object within 2 inches or less than 2 inches of the PSI component 530, with other ranges possible. The PSI component 530 may use capacitive, inductive, and / or optical recognition techniques to determine the position of the PSI component 530 selected by the user's finger.

[0047] In some examples, the presence aware display 502 may also provide output to the user using tactile, auditory, or visual cues. For example, the presence aware display 502 may include a display component 532 that displays a graphical user interface. The display component 532 may be any type of output component that provides visual output. Although shown as an integrated component of the computing device 500, the presence aware display 502 may in some examples be an external component that shares a data or information path with other components of the computing device 500 for sending and / or receiving inputs and outputs. For example, the presence aware display 502 may be a built-in component of the computing device 500 that is located within and physically connected to the external packaging of the computing device 500. In another example, the presence aware display 502 may be an external component of the computing device 500 that is located outside and physically separated from the packaging of the computing device 500. In some examples, the presence aware display 502, when located outside and physically separate from the packaging of the computing device 500, may be implemented by two separate components: a presence aware input component 530 for receiving input and a display component 532 for providing output.

[0048] Similar to the display panel 102 of FIG. 1, the presence sensing display 502 may define an aperture through which one or more of the image sensors 505 may receive light. In some examples, the aperture defined by the presence sensing display 502 may have an oblong shape. For example, a length (L1) of the physical shape of the aperture parallel to an axis connecting a first end of the presence sensing display 502 and a second end of the presence sensing display 502 may be longer than a length (L2) of the physical shape of the aperture perpendicular to the axis. As mentioned above, processing circuitry (e.g., which may be included in the processor 520) may be located proximate to the second end.

[0049] One or more storage devices 526 in the computing device 500 may store information for processing during operation of the computing device 500 (e.g., the computing device 500 may store data accessed by the dynamic aperture module 534 during execution on the computing device 500). In some examples, the storage device 526 is a temporary memory, meaning that the primary purpose of the storage device 526 is not long-term storage. The storage device 526 on the computing device 500 may be configured for short-term storage of information as a volatile memory, and thus may not retain stored content when powered off. Examples of volatile memory include random access memory (RAM), dynamic random access memory (DRAM), static random access memory (SRAM), and other forms of volatile memory known in the art.

[0050] The storage device 526 in some examples also includes one or more computer-readable storage media. The storage device 526 in some examples also includes one or more non-transitory computer-readable storage media. The storage device 526 may be configured to store a larger amount of information than is typically stored by a volatile memory. The storage device 526 may further be configured for long-term storage of information as a non-volatile memory space and may retain information after a power on / off cycle. Examples of non-volatile memory include magnetic hard disks, optical disks, flash memory, or forms of electrically programmable memory (EPROM) or electrically erasable programmable (EEPROM) memory. The storage device 526 may store program instructions and / or information (e.g., data) associated with the dynamic aperture module 534. The storage device 526 may include a memory configured to store data or other information associated with the dynamic aperture module 534.

[0051] The one or more processors 520 may perform functions and / or execute instructions associated with the computing device 500. Examples of the processor 520 include an application processor, a display controller, an auxiliary processor, one or more sensor hubs, and any other hardware configured to function as a processor, processing unit, or processing device. The dynamic aperture module 534 may be operable (or executed) by the processor 520 to perform various actions, operations, or functions of the computing device 500. For example, the dynamic aperture module 534 may form executable bytecodes that, when executed, cause the processor 520 to perform certain operations according to various aspects of the techniques described herein. In another example, the processor 520 of the computing device 500 may retrieve and execute instructions stored by the storage device 526 that cause the processor 520 to perform operations described herein belonging to the dynamic aperture module 534, the UI module 536, and / or the application module 538. The instructions, when executed by the processor 520, may cause the computing device 500 to store information in the storage device 526.

[0052] In some examples, the processor 520 may include a first processing circuit (e.g., the processing circuit 112) disposed proximate to a second end of the presence sensing display 502. The first processing circuit may be configured to output control signals to pixels of the matrix of pixels of the display panel 102. In some examples, the first processing circuit may be a DDIC. The processor 520 may further include a second processing circuit configured to control the operation of the first processing circuit such that pixels of the matrix of pixels surrounding the aperture 204C are selectively deactivated to modify the appearance of the shape of the aperture 204C. In some examples, the second processing circuit may include one or both of a central processing unit (CPU) or a graphics processing unit (GPU).

[0053] One or more image sensors 505 may be configured to detect (e.g., acquire) and transmit information used to generate an image. For example, an image sensor may convert the variable attenuation of light waves (e.g., as light waves pass through or reflect off an object) into a digital signal that is received by the processor 520 of the computing device 500. Examples of image sensors may include charge-coupled devices (CCDs) and active pixel sensors (CMOS sensors). The image sensors 505 may vary in shape and size, but are typically rectangular. Similarly, the aspect ratio of the image sensors 505 may vary, but common aspect ratios may be 4:3, 3:2, 1.85:1, etc. The format of the image sensor 505 may determine the FOV of a particular lens when used with a particular image sensor.

[0054] The UI module 536 may be executable to control an interface between a user and the computing device 500. For example, the UI module 536 may process input (e.g., received via the presence awareness input component 530, the image sensor 505, or other input component) and / or facilitate the output of information (e.g., generating or rendering a graphical user interface for display on the display component 532 or other output component).

[0055] Application module 538 may provide graphical information and instructions to UI module 536 that UI module 536 includes as content or information to be included in the graphical representation. For example, application module 536 may be a photography application that executes on computing device 500 to enable a user of computing device 500 to take, view, and / or edit photos, videos, or other images.

[0056] As discussed above, the presence sensing display 502 may define an aperture through which a sensor of the image sensor 505 receives light. In some instances, it may be desirable for the shape of the aperture to be different at different times. For example, while the physical shape of the aperture (e.g., the actual area of ​​the display component 532 that does not contain the light emitting elements) may be oblong, in certain scenarios it may be desirable for the aperture to have a rounded or non-oblong appearance.

[0057] According to one or more aspects of the present disclosure, the dynamic aperture module 534 may modify the apparent shape of an aperture (e.g., aperture 204C) so that the aperture appears to have different shapes at different times. For example, the dynamic aperture module 534 may selectively deactivate, by the processor 520, pixels of a matrix of pixels surrounding the aperture, which may have a rectangular physical shape, to modify the appearance of the aperture's size, shape, orientation, etc. In response to the deactivation of pixels of the matrix of pixels surrounding the aperture 204C, the aperture may now appear different (e.g., have a modified apparent shape). For example, the shape of the aperture (i.e., the appearance of aperture 204C after the selective deactivation of pixels of the matrix of pixels surrounding the aperture 204C) may appear to be a circle, a disk-like rectangle, an ellipse, a square, or any other shape and / or size. In this manner, the dynamic aperture module 534 may increase the visual appeal of the aperture to a user of the computing device 500.

[0058] In some examples, the dynamic aperture module 534 may gradually modify the appearance of the shape of the aperture such that the appearance of the shape of the aperture visibly transitions from a first shape to a second shape. For example, the dynamic aperture module 534 may gradually modify the appearance of the aperture such that the appearance of the shape of the aperture visibly transitions from a rectangular shape to an elliptical shape. In this manner, the dynamic aperture module 534 may effectively cross-fade between different apparent shapes of the aperture.

[0059] The dynamic aperture module 534 may receive user input to determine modifications to the aperture. For example, a user of the computing device 500 may provide input through the PSI component 530 to select a graphical element displayed by the presence aware display 502 that is associated with modifying the appearance of the shape of the aperture 204C to a particular shape (e.g., a circle). In response to selecting the selection of the graphical element, the dynamic aperture module 534 may modify the appearance of the shape of the aperture 204C such that the shape of the aperture 204C appears to be the particular shape (e.g., a circle). Similarly, a user of the computing device 500 may provide another input (e.g., through the PSI component 520) to activate selectively deactivated pixels surrounding the aperture.

[0060] The modules 534, 536, 538 may perform the operations described herein using software, hardware, firmware, or a mixture of hardware, software, and / or firmware residing in and / or executing on the computing device 500. The computing device 500 may execute the modules 534, 536, 538 using one or more processors located within the housing of the computing device 500. In some examples, the computing device 500 may execute the modules 534, 536, 538 as one or more virtual machines executing on the underlying hardware of the computing device 500 located within the housing of the computing device 500. The modules 534, 536, 538 may execute as one or more services or components of the operating system or computing platform of the computing device 500. The modules 534, 536, 538 may execute as one or more executable programs in the application layer of the computing platform of the computing device 500.

[0061]

[0023] Figure 6 is a flow chart illustrating an example method for adjusting the apparent shape of an aperture, according to one or more techniques of this disclosure. For purposes of explanation, the technique of Figure 6 is described in the context of computing device 500 of Figure 5. However, it should be understood that the method of Figure 6 may be performed by other examples of computing devices as described herein.

[0062] The computing device 500 may display 602 a first image. For example, initially, a photography application module of the application modules 538 may cause the UI module 536 to render a graphical user interface (GUI) including a picture (e.g., of a mountain in FIG. 6). The UI module 536 may cause the presence aware display 502 to output the GUI. For example, the UI module 536 may output a signal to a DDIC (e.g., a column driver IC) that controls at least a portion of the display component 532 of the presence aware display 502, which may cause pixels of the display component 532 to form an image.

[0063] As described above, the display component 532 may include a matrix of pixels (e.g., the matrix of pixels 418). The matrix of pixels may be arranged such that the display component 532 defines an aperture that is surrounded by pixels of the matrix of pixels but does not include pixels of the matrix of pixels. The display component 532 may include a first end and a second end (opposing each other such that an axis connects the first end and the second end of the presence sensing display panel 502).

[0064] The computing device 500 may display (604) a second image that results in the physical shape of the aperture having a modified apparent shape that is different from the physical shape. For example, at a second time that is different from the first time, the dynamic aperture module 534 may cause the UI module 536 to modify the rendered GUI to adjust the appearance of the shape of the aperture. As an example, the UI module 536 may deactivate (e.g., cause the DDIC to deactivate and / or set to zero values) pixels of a matrix of pixels proximate to the aperture such that the physical shape of the aperture has the modified apparent shape. As shown in the example of FIG. 6, the computing device 500 may modify an aperture having a physical shape of a rounded rectangle to have a modified apparent shape of a circle.

[0065] The computing device 500 may modify the aperture to any desired shape. Exemplary modified apparent shapes include, but are not necessarily limited to, a circle, a disk-shaped rectangle, an ellipse, or a rectangle. In some examples, the modified apparent shape of the aperture may be surrounded by pixels of the matrix of pixels that are not yet deactivated. For example, the pixels of the matrix of pixels that the computing device 500 uses to form the modified apparent shape of the aperture may not be border or edge pixels of the display component 532.

[0066] In some examples, the dynamic aperture module 534 may gradually modify the appearance of the shape of the aperture such that the appearance of the shape of the aperture visibly transitions from a first shape to a second shape. For example, the dynamic aperture module 534 may gradually modify the appearance of the aperture such that the appearance of the shape of the aperture visibly transitions (e.g., cross-fades) from a rectangular shape to an elliptical shape.

[0067] The dynamic aperture module 534 may receive user input to determine modifications to the aperture. For example, a user of the computing device 500 may provide input through the PSI component 530 to select a graphical element displayed by the presence aware display 502 that is associated with modifying the appearance of the shape of the aperture to a particular shape (e.g., a circle). In response to selecting the selection of the graphical element, the dynamic aperture module 534 may modify the appearance of the shape of the aperture 204C such that the shape of the aperture appears to be the particular shape (e.g., a circle). In this manner, the apparent shape of the aperture may be user selectable.

[0068] Computing device 500 may capture an image with a sensor that senses light passing through an aperture (608). For example, an image sensor of image sensor 505 may convert the light passing through the aperture into data, which may be received by a capture application of UI module 536 and / or application module 538.

[0069] The following numbered examples may illustrate one or more aspects of the present disclosure. Example 1: A computing device includes a display panel having a first end and a second end. The display panel includes a matrix of pixels and defines an aperture surrounded by, but not including, a pixel of the matrix of pixels. A length of the aperture parallel to an axis connecting the first end and the second end is greater than a length of the aperture perpendicular to the axis. The computing device includes a sensor configured to capture light passing through the aperture and a processing circuit disposed proximate the second end and configured to output a control signal to the pixel of the matrix of pixels.

[0070] Example 2: The computing device of example 1, wherein the display panel defines an aperture such that the sensor is not optically blocked by the display panel.

[0071] Example 3: The computing device of example 1, wherein the shape of the aperture is an oblong shape.

[0072] Example 4: The computing device of example 1, wherein the shape of the aperture is rectangular.

[0073] Example 5: The computing device of example 4, wherein one or more corners of the aperture are rounded.

[0074] Example 6: The computing device of example 1, wherein the shape of the aperture is one of an ellipse or a disk-like rectangle.

[0075] Example 7: The computing device of Example 1, wherein the processing circuit includes a first processing circuit, and the computing device further includes a second processing circuit configured to control operation of the first processing circuit such that pixels of the matrix of pixels surrounding the aperture are selectively deactivated to modify the appearance of the shape of the aperture.

[0076] Example 8: The computing device of Example 6, wherein the first processing circuit includes a display driver integrated circuit (DDIC) and the second processing circuit includes one or both of a central processing unit (CPU) or a graphical processing unit (GPU).

[0077] Example 9: The computing device of Example 1, wherein the display includes an organic light-emitting diode (OLED) display configured to enable the sensor to operate through the OLED display by omitting back cover material from an area of ​​the OLED display back cover above the sensor.

[0078] Example 10: The computing device of example 1, wherein the sensor is an electronic image sensor and the aspect ratio of the sensor is one of 4:3, 3:2, or 1.85:1.

[0079] Example 11: A method includes displaying a first image at a first time on a display panel of a computing device. The display panel has a first end and a second end. The display panel includes a matrix of pixels and defines an aperture surrounded by pixels of the matrix of pixels but not including pixels of the matrix of pixels. A length of a physical shape of the aperture parallel to an axis connecting the first end and the second end is longer than a length of a physical shape of the aperture perpendicular to the axis. The method includes displaying a second image on the display panel at a second time different from the first time, the second image causing the physical shape of the aperture to have a modified apparent shape different from the physical shape, and capturing the image with a sensor that senses light passing through the aperture.

[0080] Example 12: The method of example 11, wherein displaying the second image includes deactivating pixels of a matrix of pixels adjacent to the aperture such that the physical shape of the aperture has a modified apparent shape.

[0081] Example 13: The method of example 11, wherein a length of the modified apparent shape of the aperture parallel to an axis connecting the first end and the second end is not longer than a length of the modified apparent shape of the aperture perpendicular to the axis.

[0082] Example 14: The method of example 11, wherein the modified apparent shape of the aperture is one of a circle, a disk-rectangle, an ellipse, or a rectangle.

[0083] Example 15: The method of example 11, wherein displaying the second image includes crossfading from the first image to the second image such that the appearance of the aperture visibly transitions from its physical shape to its modified apparent shape.

[0084] Example 16: The method of example 11, further comprising controlling operation of pixels of the matrix of pixels with a display driver integrated circuit (DDIC) located proximate the second end.

[0085] Example 17: The method of example 11, wherein the display panel includes an organic light-emitting diode (OLED) display configured to enable the sensor to sense light through the OLED display by omitting back cover material from an area of ​​the OLED display back cover above the sensor.

[0086] Example 18: The method of example 11, wherein the sensor is an electronic image sensor and the aspect ratio of the sensor is one of 4:3, 3:2, or 1.85:1.

[0087] Example 19: A computer-readable storage medium storing instructions that, when executed, cause a processing circuit of a computing device to display a first image at a first time on a display panel of the computing device, the display panel having a first end and a second end, the display panel including a matrix of pixels and defining an aperture surrounded by pixels of the matrix of pixels but not including pixels of the matrix of pixels, wherein a length of the physical shape of the aperture parallel to an axis connecting the first end and the second end is longer than a length of the physical shape of the aperture perpendicular to the axis, and display a second image on the display panel at a second time different from the first time, resulting in a physical shape of the aperture having a modified apparent shape different from the physical shape, and instructions to capture an image with a sensor that senses light passing through the aperture.

[0088] Example 20: The computer-readable storage medium of Example 19, wherein the instructions to cause the processing circuit to display the second image include instructions to cause the processing circuit to deactivate pixels of the matrix of pixels adjacent to the aperture such that the physical shape of the aperture has a modified apparent shape, and a length of the modified apparent shape of the aperture parallel to an axis connecting the first end and the second end is not longer than a length of the modified apparent shape of the aperture perpendicular to the axis.

[0089] The techniques described in this disclosure may be implemented, at least in part, in hardware, software, firmware, or any combination thereof. For example, various aspects of the described techniques may be implemented in one or more processors, including one or more microprocessors, digital signal processors (DSPs), application specific integrated circuits (ASICs), field programmable gate arrays (FPGAs), or any other equivalent integrated or discrete logic circuits, and any combination of such components. The term "processor" or "processing circuitry" may generally refer to any of the aforementioned logic circuits alone or in combination with other logic circuits, or any other equivalent circuitry. A control unit including hardware may also execute one or more of the techniques of this disclosure.

[0090] Such hardware, software, and firmware may be implemented within the same device or separate devices to support the various techniques described in this disclosure. In addition, any of the described units, modules, or components may be implemented together or separately as separate but interoperable logical devices. The depiction of different features as modules or units is intended to highlight different functional aspects and does not necessarily imply that such modules or units must be realized by separate hardware, firmware, or software components. Rather, functionality associated with one or more modules or units may be performed by separate hardware, firmware, or software components, or may be integrated within a common or separate hardware, firmware, or software component.

[0091] The techniques described in this disclosure may also be embodied or encoded in an article of manufacture that includes a computer-readable storage medium encoded with instructions. Instructions embedded or encoded in an article of manufacture that includes an encoded computer-readable storage medium may cause one or more programmable or other processors to perform one or more of the techniques described herein, such as when the instructions contained in or encoded on the computer-readable storage medium are executed by the one or more processors. The computer-readable storage medium may include a random access memory (RAM), a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electronically erasable programmable read-only memory (EEPROM), a flash memory, a hard disk, a compact disk ROM (CD-ROM), a floppy disk, a cassette, a magnetic medium, an optical medium, or other computer-readable medium. In some examples, an article of manufacture may include one or more computer-readable storage media.

[0092] In some examples, a computer-readable storage medium may include a non-transitory medium. The term "non-transitory" may indicate that the storage medium is not embodied in a carrier wave or propagated signal. In some examples, a non-transitory storage medium may store data that may change over time (e.g., in RAM or cache).

[0093] Various examples have been described. These and other examples are within the scope of the following claims.

Claims

1. a display panel having a first end and a second end, the display panel including a matrix of pixels and defining an aperture surrounded by, but not including, pixels of the matrix of pixels, a length of the aperture parallel to an axis connecting the first end and the second end being greater than a length of the aperture perpendicular to the axis; a sensor configured to capture light passing through the aperture; and and processing circuitry disposed proximate the second end and configured to output control signals to pixels of the matrix of pixels.

2. The computing device of claim 1 , wherein the display panel defines the aperture such that the sensor is not optically blocked by the display panel.

3. The computing device of claim 1 or claim 2, wherein the aperture is oblong in shape.

4. The computing device of claim 1 or claim 2, wherein the aperture is rectangular in shape.

5. The computing device of claim 4 , wherein one or more corners of the aperture are rounded.

6. The computing device of claim 1 or claim 2, wherein the shape of the aperture is one of an ellipse or a disk-rectangle.

7. The processing circuitry includes a first processing circuit, and the computing device is 7. A computing device as described in any of claims 1 to 6, further comprising a second processing circuit configured to control operation of the first processing circuit such that pixels of the matrix of pixels surrounding the aperture are selectively deactivated to modify the appearance of the shape of the aperture.

8. 8. The computing device of claim 7, wherein the first processing circuitry includes a display driver integrated circuit (DDIC) and the second processing circuitry includes one or both of a central processing unit (CPU) or a graphical processing unit (GPU).

9. 9. The computing device of claim 1, wherein the display includes an organic light emitting diode (OLED) display configured to enable the sensor to operate through the OLED display by omitting back cover material from an area of ​​the OLED display back cover over the sensor.

10. 10. The computing device of claim 1, wherein the sensor is an electronic image sensor and the aspect ratio of the sensor is one of 4:3, 3:2, or 1.85:

1.

11. displaying a first image at a first time on a display panel of a computing device, the display panel having a first end and a second end, the display panel including a matrix of pixels and defining an aperture surrounded by but not including pixels of the matrix of pixels, the length of a physical shape of the aperture parallel to an axis connecting the first end and the second end being greater than a length of the physical shape of the aperture perpendicular to the axis; displaying, at the display panel, a second image at a second time different from the first time, the second image causing the physical shape of the aperture to have a modified apparent shape different from the physical shape; and capturing an image with a sensor that senses light passing through the aperture.

12. Displaying the second image includes: The method of claim 11 , comprising deactivating pixels of the matrix of pixels adjacent to the aperture such that the physical shape of the aperture has the modified apparent shape.

13. 13. The method of claim 11 or 12, wherein a length of the modified apparent shape of the aperture parallel to the axis connecting the first end and the second end is no longer than a length of the modified apparent shape of the aperture perpendicular to the axis.

14. 14. The method of claim 11, wherein the modified apparent shape of the aperture is one of a circle, a disk-rectangle, an ellipse, or a rectangle.

15. 15. The method of claim 11, wherein displaying the second image includes crossfading from the first image to the second image such that an appearance of the aperture visibly transitions from the physical shape to the modified apparent shape.

16. 16. The method of claim 11, further comprising controlling operation of pixels of the matrix of pixels by a display driver integrated circuit (DDIC) located proximate to the second end.

17. 17. The method of claim 11, wherein the display panel includes an organic light emitting diode (OLED) display configured to enable the sensor to sense light through the OLED display by omitting back cover material from an area of ​​the OLED display back cover over the sensor.

18. 18. The method of claim 11, wherein the sensor is an electronic image sensor and the aspect ratio of the sensor is one of 4:3, 3:2, or 1.85:

1.

19. A computer-readable storage medium, which, when executed, causes a processing circuitry of a computing device to: storing instructions for causing a first image to be displayed at a first time on a display panel of the computing device, the display panel having a first end and a second end, the display panel including a matrix of pixels and defining an aperture surrounded by but not including pixels of the matrix of pixels, the length of a physical shape of the aperture parallel to an axis connecting the first end and the second end being greater than a length of the physical shape of the aperture perpendicular to the axis; instructions to display, at the display panel, a second image at a second time different from the first time, the second image resulting in the physical shape of the aperture having a modified apparent shape different from the physical shape; and instructions for causing an image to be captured by a sensor that senses light passing through the aperture.

20. The instructions for causing the processing circuit to display the second image may include instructions for the processing circuit to:

20. The computer-readable storage medium of claim 19, comprising instructions to deactivate pixels of the matrix of pixels proximate to the aperture such that the physical shape of the aperture has the modified apparent shape, wherein a length of the modified apparent shape of the aperture parallel to the axis connecting the first end and the second end is no longer than a length of the modified apparent shape of the aperture perpendicular to the axis.

Images