Controlling computing device display with display cut-out

Abstract

Embodiments may include a computing device configured to control a display including a display cut-out. In some aspects, the computing device may monitor whether ambient light intensity satisfies an ambient light threshold, and may control the display to present a display masking area that substantially matches the display cut-out in response to the ambient light intensity satisfying the ambient light threshold.

Description

Background Art

[0001] Computing devices such as smart phones, tablet computers and other devices generally include touch screen devices that can display functions and receive user input. Such computing devices are also generally equipped with cameras, ambient light sensors, and other devices oriented in the same direction as the display. Because such devices are designed to be handheld, the display screen is relatively small. In order to save the scarce display area, cameras, light sensors and other devices are generally arranged below the display, and the display includes an area that is physically cut off so that the camera, sensor, etc. can function. In order to visually conceal the display cutout, the device display can be controlled to display a graphic masking area similar to the physical cutout in color around the display cutout. However, the appearance difference between the display cutout and the masking area is generally visually obvious, particularly in brightly lit areas or in the sun. This difference is not beautiful, and may be distracted from the display function of the device, thereby potentially interfering with the function of the computing device. Summary of the invention

[0002] Various aspects include methods for controlling a computing device display including a display cutout and a computing device configured to perform the method. Various aspects may include monitoring whether an ambient light intensity satisfies an ambient light threshold, and in response to the ambient light intensity satisfying the ambient light threshold, controlling the display to present a display masking area that substantially matches the display cutout.

[0003] In some aspects, controlling the display to present a display masking region that substantially matches the display cutout includes controlling the display to present the display masking region based on one or more user interface elements being presented on the display.

[0004] In some aspects, controlling the display to present a display masking area that substantially matches the display cutout may include: generating a display masking layer corresponding to the display cutout based on one or more user interface elements being presented by the display; determining the display masking area based on the display cutout and the one or more user interface elements being presented by the display; modifying the display masking layer by the determined display masking area; and controlling the display to present the modified display masking layer.

[0005] In some aspects, determining the display masking area based on the display cutout and the one or more user interface elements being presented by the display may include: receiving information about the user interface elements from an application that generates the user interface elements and dynamically generating the display masking area to substantially match the display cutout based on the information about the user interface elements received from the application.

[0006] In some aspects, controlling the display to present a display masking area that substantially matches the display cutout in response to ambient light intensity satisfying an ambient light threshold may include controlling the display to present a first display masking area at a first time based on a first ambient light intensity and controlling the display to present a second display masking area at a second time based on a second ambient light intensity.

[0007] Additional aspects may include a computing device having a processor configured to perform one or more operations of any of the methods outlined above. Additional aspects may include a non-transitory processor-readable storage medium having processor-executable instructions stored thereon, the processor-executable instructions being configured to cause a processor of a computing device to perform operations of any of the methods outlined above. Additional aspects include a computing device having components for performing the functions of any of the methods outlined above. Additional aspects include a system-on-chip for use in a computing device, the system-on-chip comprising a processor configured to perform one or more operations of any of the methods outlined above. BRIEF DESCRIPTION OF THE DRAWINGS

[0008] The accompanying drawings, which are incorporated herein and constitute a part of this specification, illustrate exemplary embodiments of the claims and, together with the general description given above and the detailed description given below, serve to explain features of the claims.

[0009] Figure 1A An example computing device suitable for implementing any of the various embodiments is illustrated.

[0010] Figures 1B to 1E An example computing device that displays a masked area that is significantly larger than a display cutout is illustrated.

[0011] Figure 2 is a component block diagram illustrating an example computing system suitable for implementing any of the various embodiments.

[0012] Figure 3 is a functional block diagram of an example computing device suitable for implementing various embodiments.

[0013] FIG. 4A to FIG. 4C A method of controlling a computing device display including a display cutout according to various embodiments is illustrated.

[0014] Figure 5A is a process flow diagram illustrating a method executable by a processor of a computing device for controlling a computing device display including a display cutout according to various embodiments.

[0015] FIG. 5B to FIG. 5Dis a process flow diagram illustrating operations that may be performed by a processor of a computing device as part of a method for controlling a computing device display including a display cutout according to various embodiments.

[0016] Figure 6 is a component block diagram of a computing device suitable for use with the various embodiments. DETAILED DESCRIPTION

[0017] Various embodiments will be described in detail with reference to the accompanying drawings. Wherever possible, the same reference numerals will be used throughout the drawings to refer to the same or similar parts. References to specific examples and embodiments are for illustrative purposes and are not intended to limit the scope of the claims.

[0018] Various embodiments include systems and methods for controlling a computing device display including a display cutout. Various embodiments may improve the operation of a computing device by improving the operation of a display of a computing device, particularly a computing device having a display with a physical cutout.

[0019] The term "computing device" is used herein to refer to any or all of the following: cellular phones, smart phones, portable computing devices, personal or mobile multimedia players, laptop computers, tablet computers, smartbooks, ultrabooks, handheld computers, wireless email receivers, Internet-enabled multimedia cellular phones, medical devices and equipment, biometric sensors / devices, wearable devices (including smart watches, smart clothing, smart glasses, smart wristbands, smart jewelry (e.g., smart rings, smart bracelets, etc.)), entertainment devices (e.g., game controllers, music and video players, satellite radios, etc.), wireless network-enabled Internet of Things (IoT) devices (including smart meters / sensors, router devices, industrial manufacturing equipment, large and small machines and appliances for home or business use), computing devices attached to or incorporated into various mobile platforms, global positioning system devices, and similar electronic devices that include memory, wireless communication components and programmable processors.

[0020] The term "system on chip" (SOC) is used herein to refer to a single integrated circuit (IC) chip that includes multiple resources and / or processors integrated on a single substrate. A single SOC may include circuits for digital, analog, mixed signal, and radio frequency functions. A single SOC may also include any number of general and / or specialized processors (digital signal processors, modem processors, video processors, etc.), storage blocks (e.g., ROM, RAM, flash memory, etc.), and resources (e.g., timers, voltage regulators, oscillators, etc.). The SOC may also include software for controlling the integrated resources and processors and for controlling peripheral devices.

[0021] The term "system-in-package" (SIP) may be used herein to refer to a single module or package that contains multiple resources, computing units, cores and / or processors on two or more IC chips, substrates, or SOCs. For example, a SIP may include a single substrate on which multiple IC chips or semiconductor dies are stacked in a vertical configuration. Similarly, a SIP may include one or more multi-chip modules (MCMs) on which multiple ICs or semiconductor dies are packaged into a unified substrate. A SIP may also include multiple independent SOCs that are coupled together via high-speed communication circuits and packaged in close proximity, such as on a single motherboard or in a single wireless device. The proximity of the SOCs facilitates high-speed communication and sharing of memory and resources.

[0022] As used herein, the terms "network", "system", "wireless network", "cellular network" and "wireless communication network" may interchangeably refer to a portion or all of a wireless network of a carrier associated with a wireless device and / or a subscription on a wireless device. The techniques described herein may be used in various wireless communication networks, such as code division multiple access (CDMA), time division multiple access (TDMA), FDMA, orthogonal FDMA (OFDMA), single carrier FDMA (SC-FDMA), and other networks. In general, any number of wireless networks may be deployed in a given geographic area. Each wireless network may support at least one radio access technology, which may operate on one or more frequencies or frequency ranges. For example, a CDMA network may implement Universal Terrestrial Radio Access (UTRA) (including Wideband Code Division Multiple Access (WCDMA) standards), CDMA2000 (including IS-2000, IS-95 and / or IS-856 standards), etc. In another example, a TDMA network may implement GSM Enhanced Data Rates for GSM Evolution (EDGE). In another example, an OFDMA network may implement Evolved UTRA (E-UTRA) (including the LTE standard), Institute of Electrical and Electronics Engineers (IEEE) 802.11 (Wi-Fi), IEEE 802.16 (WiMAX), IEEE 802.20, Etc. Reference may be made to wireless networks using the LTE standard, and thus the terms "Evolved Universal Terrestrial Radio Access," "E-UTRAN," and "eNodeB" may also be used interchangeably herein to refer to wireless networks. However, such references are provided merely as examples and are not intended to exclude wireless networks using other communication standards. For example, although various third generation (3G) systems, fourth generation (4G) systems, and fifth generation (5G) systems are discussed herein, those systems are cited merely as examples and may be replaced with future generation systems (e.g., sixth generation (6G) or higher generation systems) in various examples.

[0023] Computing devices are also typically equipped with cameras, ambient light sensors, and other devices disposed below the display of the computing device. An area of ​​the display is physically cut off to enable the camera, sensor, etc. to function (referred to herein as a "display cutout"). In order to visually disguise the display cutout, the device display may be controlled to display a graphical masking area similar to the physical cutout in color around the display cutout (referred to herein as a "display masking area"). The display masking area is sometimes referred to differently as a "flexible masking user interface (UI) layer", "dynamic island", "dynamic visual cutout area", and other similar names. However, the appearance difference between the display cutout and the masking area is usually visually obvious, especially in a brightly lit area or in the sun. For example, the pixel value of the display masking area may be set to zero, indicating, for example, "no color", "no light", "black", etc. However, if the ambient light intensity is strong enough, the display cutout and the display masking area reflect different colors and are easily distinguished. This difference may be distracted from the display function of the device and may interfere with the function of the computing device.

[0024] Various embodiments include methods for controlling a computing device display including a display cutout and a computing device configured to perform the method. Some embodiments may include monitoring whether the ambient light intensity (i.e., the brightness or intensity of the ambient light) meets an ambient light threshold, and controlling the display to present a display masking area that substantially matches the display cutout in response to the ambient light intensity meeting the ambient light threshold. In some embodiments, the computing device may dynamically determine the ambient light threshold based on one or more user interface elements being presented by the display. In some embodiments, the computing device may apply a static ambient light threshold.

[0025] In some embodiments, the computing device may generate a display masking region that substantially matches the shape of the display cutout. In some embodiments, the computing device may generate a display masking region that substantially matches the height of the display cutout. In some embodiments, the computing device may generate a display masking region that substantially matches the width of the display cutout. In some embodiments, the computing device may generate a display masking region based on one or more user interface elements being presented by the display outside the display masking region. In some embodiments, the computing device may generate a display masking region based on one or more user interface elements being presented within the display masking region.

[0026] For example, in some embodiments, the computing device may generate a display masking layer corresponding to the display cutout based on one or more user interface elements being presented by the display. Such user interface elements may be presented outside the display masking layer and / or within the display masking layer. The computing device may determine a display masking area based on the display cutout and one or more user interface elements being presented by the display device. The computing device may modify the display masking layer by the determined display masking area, and may control the display to present the modified display masking layer.

[0027] In some embodiments, the computing device may dynamically generate a display masking region based on information received from an application that generates one or more user interface elements. In some embodiments, the computing device may receive information about a user interface element from an application that generates the user interface element, and may dynamically generate a display masking region to substantially match the display cutout based on the information about the user interface element received from the application. The computing device may modify the display masking layer by the dynamically determined display masking region, and may control the display to present the modified display masking layer.

[0028] In some embodiments, the computing device may dynamically modify the display masking region in response to changing ambient light intensity. In some embodiments, the computing device may apply two or more ambient light thresholds and may dynamically modify the display masking region in response to the ambient light intensity satisfying a first threshold, a second threshold, etc. In some embodiments, the computing device may present a first display masking region at a first time based on a first ambient light intensity and present a second display masking region at a second time based on a second ambient light intensity.

[0029] Various embodiments improve the operation of a computing device by enabling the computing device to dynamically generate and / or modify a display masking region to substantially match a display cutout based on the intensity of ambient light. Enabling the computing device to dynamically determine and present a display masking region that substantially matches a display cutout reduces distraction caused by visual differences between the display masking region and the display cutout. Enabling the computing device to dynamically determine and present a display masking region that substantially matches a display cutout can reduce interference with the functionality of the computing device caused by visual differences between the display masking region and the display cutout.

[0030] Figure 1AAn example computing device 100a suitable for implementing any of the various embodiments is illustrated. The computing device 100 may include a body 110 having a front region 112, a rear region 114, two sides 116a, 116b between the front region 112 and the rear region 114, and a top region 118 between the front region 112 and the rear region 114. The front region 112 may include a display 102a incorporating a touch sensor device to form a touch screen display. The touch sensor is configured to detect changes in capacitance at a location where the sensor is touched (or nearly touched) by an object, particularly a user's hand, thumb, or finger.

[0031] The display 102a may incorporate one or more display cutouts 104, 106. The display cutouts 104, 106 may be formed to accommodate the operation of one or more devices (such as cameras, ambient light sensors, and / or other suitable devices) disposed behind the display 102a. The processor of the computing device 100 may control the display 102a to display the masking region 108a. Conventionally, the display masking region is significantly larger than the display cutouts 104, 106. The processor of the computing device may configure the display masking region with a color similar to the color visible in the display cutouts 104, 106 or no color. However, in the presence of sufficiently strong ambient light (such as sunlight 120), the difference between the display masking region 108a and the display cutouts 104, 106 is obvious.

[0032] Figures 1B to 1E Example computing devices 100b to 100e that display a masked area that is significantly larger than a display cutout are illustrated. For example, computing device 100b includes a display 102a having display cutouts 104, 106. The computing device is controlling display 102a to display a masked area 108a that is significantly larger than the area of ​​display cutouts 104, 106. As another example, computing device 100c is controlling display 102b to display a masked area 108b that is significantly larger than the area of ​​display cutouts 104, 106 and includes a graphical element 110. In this example, graphical element 110 includes information about an airplane flight.

[0033] As another example, computing device 100d is controlling display 102c to display a masked area 108c that is significantly larger than the area of ​​display cutouts 104, 106 and includes graphical element 112. Display masked area 108c is smaller than display masked area 108b, but display masked area 108c is still significantly larger than the area of ​​display cutouts 104, 106.

[0034] As another example, computing device 100e is controlling display 102d to display graphical elements 114 of an application (in this example, graphical elements of a text messaging application, including a keyboard and text bubbles) and a display masking area 108d superimposed over at least some of graphical elements 114. In this example, display masking area 108d includes graphical element 116. As one example, graphical element 116 indicates an incoming phone call and caller ID, and also includes a virtual button that enables a user to accept or decline the incoming call.

[0035] Each of the display masking regions 108a-108d is significantly larger than the display cutouts 104, 106. Under sufficiently strong ambient light conditions, the visual difference between the display masking regions 108a-108d and the display cutouts 104, 106 is significant. The significant visual difference between the display masking regions 108a-108d and the display cutouts 104, 106 may distract from the functionality of the application being executed on the computing device 102a-102e and may distract the user. In addition, the difference between the display masking regions 108a-108d and the display cutouts 104, 106 may be visually unpleasing.

[0036] Figure 2 is a component block diagram illustrating an example computing system 200 suitable for implementing any of the various embodiments. The various embodiments may be implemented on a number of single-processor and multi-processor computer systems, including systems on a chip (SOC) or systems in packages (SIPs).

[0037] refer to Figure 1A to Figure 2 , the illustrated example computing system 200 (which may be a SIP in some embodiments) includes two SOCs 202, 204 coupled to a clock 206, a voltage regulator 208, and a wireless transceiver 266, which is configured to send and receive wireless communications to / from a wireless device (e.g., 120a to 120e) or a base station (e.g., 110a to 110d) via an antenna (not shown). In some embodiments, the first SOC 202 may operate as a central processing unit (CPU) of the wireless device, which executes these instructions by performing arithmetic, logic, control, and input / output (I / O) operations specified by the instructions of the software application. In some embodiments, the second SOC 204 may operate as a specialized processing unit. For example, the second SOC 204 may operate as a dedicated 5G processing unit responsible for managing high-capacity, high-speed (e.g., 5Gbps, etc.) and / or ultra-high frequency short-wave length (e.g., 28GHz mmWave spectrum, etc.) communications.

[0038] The first SOC 202 may include a digital signal processor (DSP) 210, a modem processor 212, a graphics processor 214, an application processor 216, one or more coprocessors 218 (e.g., vector coprocessors) connected to one or more of these processors, memory 220, custom circuits 222, system components and resources 224, interconnects / bus modules 226, one or more temperature sensors 230, a thermal management unit 232, and a thermal power envelope (TPE) component 234. The second SOC 204 may include a 5G modem processor 252, a power management unit 254, an interconnect / bus module 264, a plurality of mmWave transceivers 256, memory 258, and various additional processors 260 (such as an application processor, a packet processor, etc.).

[0039] Each processor 210, 212, 214, 216, 218, 252, 260 may include one or more cores, and each processor / core may perform operations independently of other processors / cores. For example, the first SOC 202 may include a processor that executes a first type of operating system (e.g., FreeBSD, LINUX, OS X, etc.) and a processor that executes a second type of operating system (e.g., MICROSOFT WINDOWS10). In addition, any or all of the processors 210, 212, 214, 216, 218, 252, 260 may be included as part of a processor cluster architecture (e.g., a synchronous processor cluster architecture, an asynchronous or heterogeneous processor cluster architecture, etc.).

[0040] The first SOC 202 and the second SOC 204 may include various system components, resources and custom circuits for managing sensor data, analog-to-digital conversion, wireless data transmission, and for performing other specialized operations, such as decoding data packets and processing encoded audio and video signals to present in a web browser. For example, the system components and resources 224 of the first SOC 202 may include power amplifiers, voltage regulators, oscillators, phase-locked loops, peripheral bridges, data controllers, memory controllers, system controllers, access ports, timers, and other similar components for supporting processors and software clients running on wireless devices. System components and resources 224 and / or custom circuits 222 may also include circuits for interfacing with peripheral devices (such as cameras, electronic displays, wireless communication devices, external memory chips, etc.).

[0041] The first SOC 202 and the second SOC 204 may communicate via an interconnect / bus module 250. The various processors 210, 212, 214, 216, 218 may be interconnected to one or more memory elements 220, system components and resources 224, and custom circuits 222, and a thermal management unit 232 via an interconnect / bus module 226. Similarly, the processor 252 may be interconnected to a power management unit 254, a millimeter wave transceiver 256, a memory 258, and various additional processors 260 via an interconnect / bus module 264. The interconnect / bus modules 226, 250, 264 may include an array of reconfigurable logic gates and / or implement a bus architecture (e.g., CoreConnect, AMBA, etc.). Communications may be provided by an advanced interconnect, such as a high-performance network on chip (NoC).

[0042] The first SOC 202 and / or the second SOC 204 may also include an input / output module (not illustrated) for communicating with resources external to the SOC, such as a clock 206 and a voltage regulator 208. The resources external to the SOC (e.g., clock 206, voltage regulator 208) may be shared by two or more of the internal SOC processors / cores.

[0043] In addition to the example SIP 200 discussed above, various embodiments may be implemented in a wide variety of computing systems that may include a single processor, multiple processors, multi-core processors, or any combination thereof.

[0044] Figure 3 is a functional block diagram of an example computing device 300 suitable for implementing various embodiments. Figures 1A to 3 , computing device 300 may be similar to computing device 100. For example, computing device 300 may be a multi-SIM computing device, such as a multi-SIM multi-standby (MSMS) computing device. Computing device 300 may include at least one subscriber identity module (SIM) interface 302 that may receive a first SIM ("SIM-1") 304a associated with a first subscription. In some embodiments, at least one SIM interface 302 may be implemented as a plurality of SIM interfaces 302 that may receive at least a second SIM associated with at least a second subscription.

[0045] The SIM in various embodiments may be a universal integrated circuit card (UICC) configured with a SIM and / or universal SIM (USIM) application to enable access to a variety of different networks. The UICC may also provide storage for phonebooks and other applications. Alternatively, in a code division multiple access (CDMA) network, the SIM may be a UICC removable user identity module (R-UIM) or a CDMA subscriber identity module (CSIM) on a card.

[0046] Each SIM 304a may have a CPU, ROM, RAM, EEPROM, and I / O circuits. One or more of the first SIM 304a and any additional SIMs used in various embodiments may contain user account information, an International Mobile Station Identifier (IMSI), a SIM Application Toolkit (SAT) command set, and storage space for phonebook contacts. One or more of the first SIM 304a and any additional SIMs may further store a home identifier (e.g., a system identification number (SID) / network identification number (NID) pair, a home PLMN (HPLMN) code, etc.) to indicate the SIM network operator provider. An integrated circuit card identification (ICCID) SIM serial number may be printed on one or more SIMs 304a for identification. In some embodiments, an additional SIM may be provided for use on the computing device 300 by a virtual SIM (VSIM) application (not shown). For example, a VSIM application may implement a remote SIM on the computing device 300 by supplying a corresponding SIM profile.

[0047] The computing device 300 may include at least one controller, such as a general purpose processor 306, which may be coupled to a coder / decoder (CODEC) 308. The CODEC 308 may in turn be coupled to a speaker 310 and a microphone 312. The general purpose processor 306 may also be coupled to at least one memory 314. The memory 314 may be a non-transitory tangible computer-readable storage medium storing processor-executable instructions. For example, these instructions may include routing subscription-related communication data through a transmit chain and a receive chain of a corresponding baseband-RF resource chain. The memory 314 may store an operating system (OS), as well as user application software and executable instructions. The general purpose processor 306 and the memory 314 may each be coupled to at least one baseband modem processor 316. Each SIM 304a in the computing device 300 may be associated with a baseband-RF resource chain including at least one baseband modem processor 316 and at least one radio frequency (RF) resource 318.

[0048] RF resources 318 may include receiver and transmitter circuits coupled to at least one antenna 320 and configured to perform transmit / receive functions for wireless services associated with each SIM 304a of computing device 300. RF resources 318 may implement separate transmit functionality and receive functionality, or may include a transceiver that combines transmitter functionality and receiver functionality. RF resources 318 may be configured to support a variety of radio access technologies / wireless networks operating according to different wireless communication protocols. RF resources 318 may include or provide connections to different groups of amplifiers, digital-to-analog converters, analog-to-digital converters, filters, voltage-controlled oscillators, etc. Multiple antennas 320 and / or receive blocks may be coupled to RF resources 318 to facilitate multi-mode communications with various combinations of antennas and receiver / transmitter frequencies and protocols (e.g., LTE, Wi-Fi, Bluetooth, etc.).

[0049] The baseband modem processor of the computing device 300 may be configured to execute software including at least one modem stack associated with at least one SIM. The SIM and associated modem stack may be configured to support a variety of communication services that meet different user needs. In addition, information for executing different signaling procedures may be provided to a particular SIM in order to access domains of the core network associated with these services and process their data.

[0050] In some embodiments, the general processor 306, memory 314, baseband modem processor 316, and RF resources 318 may be included in a system-on-chip device 322. The SIM 304a and their corresponding interface 302 may be external to the system-on-chip device 322. In addition, various input and output devices may be coupled to components of the system-on-chip device 322, such as interfaces or controllers. Example user input components suitable for use in the computing device 300 may include, but are not limited to, a keypad 324, a touch screen 326 (e.g., 102a), such as a bevel edge touch screen.

[0051] In some embodiments, general purpose processor 306 can be coupled to one or more device sensors 328. Device sensors 328 can provide outputs that include information about the environment surrounding computing device 300. For example, a computing device can include an ambient light sensor that is configured to sense the intensity of ambient light incident on the ambient light sensor and provide outputs to general purpose processor 306 that include information about the intensity of the ambient light.

[0052] Figure 4A A method 400a of controlling a computing device display including a display cutout is illustrated according to various embodiments. Figures 1A to 4A, method 400a may be implemented by a processor (e.g., 210, 212, 214, 216, 218, 252, 260, 306) of a computing device 402, 404 (e.g., 100a to 100e, 300), an ambient light sensor (e.g., 328) coupled to the processor, and a display device (e.g., 102, 326) coupled to the processor.

[0053] At a first time T1, a processor of computing device 402 may control display 410a to present display masking layer 408a around display cutouts 404, 406. In an embodiment, the processor may generate display masking layer 408a without reference to ambient light intensity. Display masking layer 408a may include a first height 420a and a first width 420b. The processor may monitor whether ambient light intensity 430a meets an ambient light threshold. For example, the processor may receive an output of an ambient light sensor (e.g., 328), and using information provided in such output, may monitor whether ambient light intensity 430a meets an ambient light threshold.

[0054] Based on information from the ambient light sensor, the processor may determine that the ambient light intensity 430a meets the ambient light threshold. In response to determining that the ambient light intensity 430a meets the ambient light threshold, at a second time T2, the processor of the computing device 402 may control the display 410a to present a display masking area 408b around the display cutouts 404, 406. In some embodiments, in response to determining that the ambient light intensity 430a meets the ambient light threshold, the processor may determine the display masking area 408b. The display masking area 408b may include a second height 420c and a second width 420d. In some embodiments, the second height 420c may be less than the first height 420a. In some embodiments, the second width 420d is less than the first width 420b. In some embodiments, the display masking area 408b may substantially match the size, area, and / or shape of the display cutouts 404, 406. In some embodiments, the processor may control the display 410b to modify the display masking layer 408a by the determined display masking area 408b.

[0055] In some embodiments, the processor may select the color of the display masking area 408b based on the amount or intensity of ambient light detected by the processor. In some embodiments, the processor may select the color of the display masking area 408b based on one or more other graphical elements being presented on the display 410a within the display masking area 408b and / or outside the display masking area. In embodiments in which the processor selects the color of the display masking area 408b, the processor may control the display 410a to present the selected color in an area of ​​the display masking area 408b that is not directly above one of the display cutouts 404, 406 (if any such area exists). For example, the display masking area 408b includes an area between the display cutout 404 and the display cutout 406 that is not above either of the display cutouts 404, 406. In such embodiments, the processor may control the display 410a to present the selected color in an area of ​​the display masking area 408b between the display cutout 404 and the display cutout 406. In various embodiments,

[0056] In some embodiments, the computing device 402 may include only one of the display cutouts 404, 406. In such embodiments, the processor of the computing device 402 may control the display 410a to present the display masking area 408b in a manner that substantially matches the area, size, shape, etc. of the single display cutout 404, 406. In some embodiments, at least one edge of the display masking area 408b may match at least one edge of the display cutout 404, 406.

[0057] Figure 4B A method 400b of controlling a computing device display including a display cutout is illustrated according to various embodiments. Figures 1A to 4B , method 400b may be implemented by a processor (e.g., 210, 212, 214, 216, 218, 252, 260, 306) of a computing device 402, 404 (e.g., 100a to 100e, 300), an ambient light sensor (e.g., 328) coupled to the processor, and a display device (e.g., 102, 326) coupled to the processor.

[0058] At a first time T1, a processor of a computing device 422 may control a display 410b to present a display masking layer 408c around the display cutouts 404, 406. In some embodiments, the processor may generate a display masking layer 408c without reference to ambient light intensity. In some embodiments, a first display masking layer 408c may include a first height 424a and a first width 424b. In some embodiments, a first display masking layer 408c may include one or more first graphic elements 426a arranged in a first position within the first display masking layer 408c. The processor may monitor whether the ambient light intensity 430b satisfies an ambient light threshold (TH) (e.g., using information output by an ambient light sensor (e.g., 328)).

[0059] Based on information from the ambient light sensor, the processor may determine that the ambient light intensity 430b meets the ambient light threshold. In response to determining that the ambient light intensity 430b meets the ambient light threshold, at a second time T2, the processor of the computing device 422 may control the display 410b to present a display masking area 408d around the display cutouts 404, 406. The display masking area 408d may include a second height 424c and a second width 424d. In some embodiments, the second height 424c is less than the first height 424a. In some embodiments, the second width 424d is less than the first width 424b. In some embodiments, the display masking area 408d may substantially match the size, area, and / or shape of the display cutouts 404, 406.

[0060] In some embodiments, the processor may control the display 410b to modify the display mask layer 408c by the determined display masking area 408d. In some embodiments, the processor may control the display 410b to modify the position, size, arrangement or other aspects of one or more first graphic elements in the display masking area 408d in the first graphic element 426a. In some embodiments, the display masking area 408d may include one or more second graphic elements 426b arranged in the second position within the display masking area 408d. In some embodiments, the second graphic element 420b may be a smaller version of the first graphic element 426a. In some embodiments, the distance between the second graphic element 426b may be less than the distance between the first graphic element 426a, so that the second graphic element 426b is displayed closer together than the first graphic element 426a. In some embodiments, the distance between the second graphic element 426b and the display cutout 404, 406 may be less than the distance between the first graphic element 426a and the display cutout 404, 406. In some implementations, at least one edge of the display masking area 408d can match at least one edge of the display cutouts 404 , 406 .

[0061] Figure 4C A method 400c of controlling a computing device display including a display cutout is illustrated according to various embodiments. Figures 1A to 4C , method 400c may be implemented by a processor (e.g., 210, 212, 214, 216, 218, 252, 260, 306) of a computing device 402, 404 (e.g., 100a to 100e, 300), an ambient light sensor (e.g., 328) coupled to the processor, and a display device (e.g., 102, 326) coupled to the processor.

[0062] In some embodiments, the computing device may dynamically modify the display masking area in response to changing ambient light intensity. In some embodiments, the computing device may apply two or more ambient light thresholds and may dynamically modify the display masking area in response to the ambient light intensity satisfying a first threshold, a second threshold, etc.

[0063] For example, at a first time T1, the processor of the computing device 442 may control the display 410c to present the display masking layer 434a. The display masking layer 434a may be presented around the display cutouts 404, 406. In some embodiments, the processor may generate the display masking layer 434a without reference to the ambient light intensity. The display masking layer 434a may include a first height 432a and a first width 432b.

[0064] The processor may monitor whether the ambient light intensity 430c satisfies a first ambient light threshold (TH1) (e.g., using information output by an ambient light sensor (e.g., 328)). The processor may determine that the ambient light intensity 430c satisfies the first ambient light threshold TH1, and at a second time T2, the processor may control the display 410c to present a first display masking area 434b around the display cutouts 404, 406. The first display masking area 434b may include a second height 432c and a second width 432d. In some embodiments, the second height 432c may be less than the first height 432a. In some embodiments, the second width 432d is less than the first width 432b.

[0065] The processor may monitor whether the ambient light intensity 430d meets the second ambient light threshold (TH2). In this example, the ambient light intensity 430d is greater than the ambient light intensity 430c. The processor may determine that the ambient light intensity 430d meets the second ambient light threshold TH2. In response to determining that the ambient light intensity 430d meets the second ambient light threshold TH2, at the second time T2, the processor may control the display 410c to present a second display masking area 434c around the display cutouts 404, 406. The second display masking area 434c may include a third height 432e and a third width 432f. In some embodiments, the third height 432e may be less than the second height 432c. In some embodiments, the third width 432f may be less than the second width 432d.

[0066] Figure 5A is a process flow diagram illustrating a method 500a for controlling a computing device display including a display cutout that may be performed by a processor of a computing device according to various embodiments. Figures 1A to 5A , components for performing the operations of method 500a may include a processor (e.g., 210, 212, 214, 216, 218, 252, 260, 306) of a computing device 402, 404 (e.g., 100a-100e, 300, 402, 422, 442), an ambient light sensor (e.g., 328) coupled to the processor, and a display device (e.g., 102, 326, 410) coupled to the processor.

[0067] In block 502, the processor may monitor whether the ambient light intensity (i.e., the brightness or intensity of the ambient light) meets an ambient light threshold. For example, the processor may monitor whether the ambient light intensity 430a, 430b, 430c meets the ambient light threshold, which may be a brightness or intensity value stored in a memory.

[0068] In block 504, the processor may control the display to present a display masking region that substantially matches the display cutout in response to the ambient light intensity (or the intensity of ambient light) satisfying the ambient light threshold. For example, the processor may control the display 102, 410a to present a display masking region 408a around the display cutout 404 in response to determining that the ambient light intensity 430 satisfies the ambient light threshold. In some embodiments, the processor may control the display to present a display masking region based on one or more user interface elements being presented by the display. For example, the processor may control the display 410b to present a masking region 408d based on the graphical element 426b.

[0069] Figure 5Bis a process flow diagram illustrating operations 500b that may be performed by a processor of a computing device as part of a method 500a for controlling a computing device display including a display cutout in accordance with various embodiments. Figures 1A to 5B , components for performing operation 500b may include a processor (e.g., 210, 212, 214, 216, 218, 252, 260, 306) of a computing device 402, 404 (e.g., 100a-100e, 300, 402, 422, 442), an ambient light sensor (e.g., 328) coupled to the processor, and a display device (e.g., 102, 326, 410) coupled to the processor.

[0070] After monitoring whether the ambient light intensity satisfies the ambient light threshold in block 502 as described, in block 510 the processor may generate a display masking layer corresponding to the display cutout based on one or more user interface elements being presented by the display.

[0071] In block 512, the processor may determine a display masking region based on the display cutout and one or more user interface elements being presented by the display.For example, the processor may determine the display masking region 408d based on one or more user interface elements 426a, 426b.

[0072] In block 514, the processor may modify the display masking layer by the determined display masking region. For example, the processor may modify the display masking layer 408c by the determined display masking region 408d.

[0073] In block 516, the processor may control the display to present the modified display masking layer. For example, the processor may control the display 410b to present the display masking region 408d.

[0074] Figure 5C is a process flow diagram illustrating operations 500c that may be performed by a processor of a computing device as part of a method 500a for controlling a computing device display including a display cutout in accordance with various embodiments. Figures 1A to 5C , components for performing operation 500c may include a processor (e.g., 210, 212, 214, 216, 218, 252, 260, 306) of a computing device 402, 404 (e.g., 100a-100e, 300, 402, 422, 442), an ambient light sensor (e.g., 328) coupled to the processor, and a display device (e.g., 102, 326, 410) coupled to the processor.

[0075] After generating a display masking layer corresponding to the display cutout based on one or more user interface elements being presented by the display in block 510 as described, the processor may receive information about the user interface element from the application that generated the user interface element in block 520. For example, the processor may receive information about user interface elements 426a and / or 426b from a phone application.

[0076] In block 522, the processor may dynamically generate a display masking region to substantially match the display cutout based on information about the user interface element received from the application. For example, the processor may use information about user interface elements 426a and / or 426b to dynamically generate a display masking region 424c to substantially match the display cutout 404, 406. In some embodiments, at least one edge of the display masking region (e.g., 408d) may match at least one edge of the display cutout (e.g., 404, 406).

[0077] As described, in block 514, the processor may modify the display masking layer by the determined display masking region.

[0078] Figure 5D is a process flow diagram illustrating operations 500d that may be performed by a processor of a computing device as part of a method 500a for controlling a computing device display including a display cutout in accordance with various embodiments. FIG. 1A to FIG. 5D , components for performing operation 500d may include a processor (e.g., 210, 212, 214, 216, 218, 252, 260, 306) of a computing device 402, 404 (e.g., 100a-100e, 300, 402, 422, 442), an ambient light sensor (e.g., 328) coupled to the processor, and a display device (e.g., 102, 326, 410) coupled to the processor.

[0079] After the processor monitors whether the ambient light intensity satisfies the ambient light threshold in block 502 as described, the processor may control the display to present a first display masking region at a first time based on the first ambient light intensity in block 530. For example, the processor may control the display 410b to present a first display masking region 434b around the display cutout in response to determining that the ambient light intensity 430c satisfies the first ambient light threshold TH1.

[0080] In block 532, the processor may control the display to present a second display masking region at a second time based on the second ambient light intensity. For example, the processor may control the display 410c to present a second display masking region 434c around the display cutout in response to determining that the ambient light intensity 430d satisfies the second ambient light threshold TH2.

[0081] Figure 6 is a component block diagram of a computing device 600 suitable for use with various embodiments. Figures 1A to 6 , the computing device 600 (eg, 100a - 100e , 300 , 402 , 422 , and 442 ) may be configured to perform the methods and operations 400a - 500d of the various embodiments.

[0082] The computing device 600 may include a first SOC 202 (e.g., a SOC-CPU) coupled to a second SOC 204 (e.g., a 5G-capable SOC). The first SOC 202 and the second SOC 204 may be coupled to an internal memory 616, a display 612, and may be coupled to a speaker 614. Additionally, the computing device 600 may include an antenna 604 that may be connected to a wireless data link for sending and receiving electromagnetic radiation, and / or a cellular telephone transceiver 266 coupled to one or more processors in the first SOC 202 and / or the second SOC 204. The computing device 600 may also include a menu selection button or rocker switch 620 for receiving user input.

[0083] The computing device 600 may also include a sound coding / decoding (CODEC) circuit 610 that digitizes the sound received from the microphone into a data packet suitable for wireless transmission and decodes the received sound data packet to generate an analog signal provided to the speaker to generate sound. Moreover, one or more of the processors in the first SOC 202 and the second SOC 204, the wireless transceiver 266, and the CODEC 610 may include a digital signal processor (DSP) circuit (not shown separately).

[0084] The network computing device 600 and the processor of the computing device 600 may be any programmable microprocessor, microcomputer, or one or more multi-processor chips that can be configured by software instructions (applications) to perform a variety of functions including the functions of the various embodiments described below. In some mobile devices, multiple processors may be provided, such as one processor within the SOC 204 dedicated to wireless communication functions and one processor within the SOC 202 dedicated to running other applications. Software applications may be stored in the memory 616 and then accessed and loaded into the processor. The processor may include internal memory sufficient to store application software instructions.

[0085] As used in this application, the terms "component", "module", "system", etc. are intended to include computer-related entities, such as but not limited to hardware, firmware, a combination of hardware and software, software, or software being executed, which are configured to perform specific operations or functions. For example, a component can be, but is not limited to, a process, a processor, an object, an executable file, an execution thread, a program, and / or a computer running on a processor. By way of example, both an application running on a wireless device and a wireless device can be referred to as a component. One or more components may reside within a process and / or an execution thread, and a component may be located on a processor or core and / or distributed between two or more processors or cores. In addition, these components may be executed from various non-transient computer-readable media having various instructions and / or data structures stored thereon. Components can communicate via local and / or remote processes, function or procedure calls, electronic signals, data packets, memory reads / writes, and other known network, computer, processor, and / or process-related communication methods.

[0086] Several different cellular and mobile communication services and standards are available and are contemplated in the future, all of which can be implemented and benefit from various implementations. Such services and standards include, for example, the Third Generation Partnership Project (3GPP), Long Term Evolution (LTE) system, third generation wireless mobile communication technology (3G), fourth generation wireless mobile communication technology (4G), fifth generation wireless mobile communication technology (5G), Global System for Mobile Communications (GSM), Universal Mobile Telecommunications System (UMTS), 3GSM, General Packet Radio Service (GPRS), Code Division Multiple Access (CDMA) system (e.g., cdmaOne, CDMA1020TM), Enhanced Data Rates for GSM Evolution (EDGE), Advanced Mobile Phone System (AMPS), Digital AMPS (IS-136 / TDMA), Evolution Data Optimized (EV-DO), Digital Enhanced Cordless Telecommunications (DECT), Worldwide Interoperability for Microwave Access (WiMAX), Wireless Local Area Network (WLAN), Wi-Fi Protected Access I and II (WPA, WPA2), and Integrated Digital Enhanced Network (iDEN). Each of these technologies involves, for example, the transmission and reception of voice, data, signaling and / or content messages. It should be understood that any reference to terminology and / or technical details related to individual telecommunication standards or technologies is for illustrative purposes only and is not intended to limit the scope of the claims to a particular communication system or technology unless specifically recited in the claim language.

[0087] The various embodiments illustrated and described are provided merely as examples of various features of the claims. However, the features shown and described with respect to any given embodiment are not necessarily limited to the associated embodiment, and may be used or combined with other embodiments shown and described. In addition, the claims are not intended to be limited to any one example embodiment. For example, one or more of the methods and operations 400a-500d may replace or be combined with one or more operations of the methods and operations 400a-500d.

[0088] Specific implementation examples are described in the following paragraphs. Although some of the specific implementation examples in the following specific implementation examples are described according to example systems and methods, other example implementations may include: the example operations discussed in the following paragraphs may be implemented by various computing devices for controlling a computing device display including a display cutout; the example methods discussed in the following paragraphs may be implemented by a computing device including a processor configured with processor-executable instructions to perform the operations of the methods of the following specific implementation examples; the example methods discussed in the following paragraphs may be implemented by a computing device including a component for performing the functions of the methods of the following specific implementation examples; and the example methods discussed in the following paragraphs may be implemented on a non-transitory processor-readable storage medium having processor-executable instructions stored thereon, which are configured to cause a processor of a computing device to perform the operations of the methods of the following specific implementation examples.

[0089] Embodiment 1. A method for controlling a computing device display including a display cutout, comprising: monitoring whether ambient light intensity satisfies an ambient light threshold; and controlling the display to present a display masking area that substantially matches the display cutout in response to the ambient light intensity satisfying the ambient light threshold.

[0090] Embodiment 2. The method of claim 1 , wherein controlling the display to present a display masking region that substantially matches the display cutout comprises controlling the display to present the display masking region based on one or more user interface elements being presented on the display.

[0091] Embodiment 3. A method according to claim 1, wherein controlling the display to present a display masking area that substantially matches the display cutout comprises: generating a display masking layer corresponding to the display cutout based on one or more user interface elements being presented by the display; determining the display masking area based on the display cutout and the one or more user interface elements being presented by the display; modifying the display masking layer by the determined display masking area; and controlling the display to present the modified display masking layer.

[0092] Embodiment 4. A method according to claim 3, wherein determining the display masking area based on the display cutout and the one or more user interface elements being presented by the display comprises: receiving information about the user interface element from an application that generates the user interface element; and dynamically generating the display masking area to substantially match the display cutout based on the information about the user interface element received from the application.

[0093] Embodiment 5. A method according to any one of claims 1 to 4, wherein: in response to the ambient light intensity satisfying the ambient light threshold, controlling the display to present a display masking area that substantially matches the display cutout comprises: controlling the display to present a first display masking area at a first time based on the first ambient light intensity and controlling the display to present a second display masking area at a second time based on the second ambient light intensity.

[0094] The foregoing method descriptions and process flow charts are provided only as illustrative examples, and are not intended to require or imply that the operations of the various embodiments must be performed in the order given. As will be appreciated by those skilled in the art, the order of operations in the foregoing embodiments may be performed in any order. Words such as "thereafter", "then", "next", etc. are not intended to limit the order of operations; these words are used to guide the reader through the description of the method. In addition, any reference to a claim element in the singular form (e.g., a reference using the article "one", "an", or "said") should not be interpreted as limiting the element to the singular.

[0095] The various exemplary logic blocks, modules, components, circuits, and algorithmic operations described in conjunction with the embodiments disclosed herein may be implemented as electronic hardware, computer software, or a combination of the two. In order to clearly illustrate this interchangeability of hardware and software, various exemplary components, blocks, modules, circuits, and operations have been generally described above in terms of their functionality. Whether such functionality is implemented as hardware or software depends on the specific application and the design constraints imposed on the entire system. The technician may implement the described functionality in different ways for each specific application, but such implementation decisions should not be interpreted as departing from the scope of the claims.

[0096] The hardware for implementing the various exemplary logic components, logic blocks, modules, and circuits described in conjunction with the embodiments disclosed herein may be implemented or executed with a general purpose processor, digital signal processor (DSP), application specific integrated circuit (ASIC), field programmable gate array (FPGA) or other programmable logic device, discrete gate or transistor logic components, discrete hardware components, or any combination thereof designed to perform the functions described herein. Although a general purpose processor may be a microprocessor, in an alternative, the processor may be any conventional processor, controller, microcontroller, or state machine. The processor may also be implemented as a combination of receiver smart objects, for example, a combination of a DSP and a microprocessor, a plurality of microprocessors, one or more microprocessors in conjunction with a DSP core, or any other such configuration. Alternatively, some operations or methods may be performed by circuits specific to a given function.

[0097] In one or more embodiments, the functions described can be implemented in hardware, software, firmware, or any combination thereof. If implemented in software, the functions can be stored as one or more instructions or codes on a non-transient computer-readable storage medium or a non-transient processor-readable storage medium. The operation of the method or algorithm disclosed herein can be implemented in a processor-executable software module or a processor-executable instruction, which can reside on a non-transient computer-readable or processor-readable storage medium. A non-transient computer-readable or processor-readable storage medium can be any storage medium that can be accessed by a computer or a processor. By way of example and without limitation, such non-transient computer-readable or processor-readable storage media can include RAM, ROM, EEPROM, FLASH memory, CD-ROM or other optical disk storage devices, magnetic disk storage devices or other magnetic storage smart objects, or any other medium that can be used to store the required program code in the form of an instruction or data structure and can be accessed by a computer. Disks and optical disks as used herein include compact discs (CDs), laser discs, optical discs, digital versatile discs (DVDs), floppy disks, and blue discs, wherein disks generally reproduce data magnetically, and optical discs reproduce data optically with lasers. The above combinations are also included within the scope of non-transitory computer-readable and processor-readable media. Additionally, the operations of a method or algorithm may reside as one or any combination or set of codes and / or instructions on a non-transitory processor-readable storage medium and / or computer-readable storage medium, which may be incorporated into a computer program product.

[0098] The above description of the disclosed embodiments is provided to enable any person skilled in the art to make or use the claims. Various modifications to these embodiments will be apparent to those skilled in the art, and the general principles defined herein may be applied to other embodiments without departing from the scope of the claims. Thus, the present disclosure is not intended to be limited to the embodiments shown herein, but should be accorded the broadest scope consistent with the following claims and the principles and novel features disclosed herein.

Claims

1. A computing device, comprising: a display, the display comprising a display cutout; Ambient light sensor; and a processor coupled to the display and the ambient light sensor, wherein the processor is configured to: monitoring whether the intensity of ambient light meets an ambient light threshold; and The display is controlled to present a display masking area substantially matching the display cutout in response to the intensity of ambient light satisfying the ambient light threshold. 2 . The computing device of claim 1 , wherein the processor is further configured to control the display to present the display masking region based on one or more user interface elements being presented on the display.

3. The computing device of claim 1 , wherein the processor is further configured to: generating a display masking layer corresponding to the display cutout based on one or more user interface elements being presented on the display; determining the display masking region based on the display cutout and the one or more user interface elements being presented by the display; modifying the display masking layer by the determined display masking area; as well as The display is controlled to present the modified display masking layer.

4. The computing device of claim 1 , wherein the processor is further configured to: generating a display masking layer corresponding to the display cutout based on one or more user interface elements being presented on the display; receiving information about the user interface element from an application that generated the user interface element; dynamically generating the display masking region to substantially match the display cutout based on the information received from the application about the user interface element; modifying the display masking layer by the determined display masking area; as well as The display is controlled to present the modified display masking layer.

5. The computing device of claim 1 , wherein the processor is further configured to control the display to present a first display masking region at a first time based on a first intensity of ambient light, and to control the display to present a second display masking region at a second time based on a second intensity of ambient light.

6. A method of controlling a computing device display including a display cutout, the method comprising: Monitor whether the ambient light intensity meets the ambient light threshold; as well as The display is controlled to present a display masking area substantially matching the display cutout in response to the ambient light intensity satisfying the ambient light threshold.

7. The method of claim 6, wherein controlling the display to present a display masking area that substantially matches the display cutout comprises: The display is controlled to present the display masking region based on one or more user interface elements being presented on the display.

8. The method of claim 6, wherein controlling the display to present a display masking area that substantially matches the display cutout comprises: generating a display masking layer corresponding to the display cutout based on one or more user interface elements being presented on the display; determining the display masking region based on the display cutout and the one or more user interface elements being presented on the display; modifying the display masking layer by the determined display masking area; as well as The display is controlled to present the modified display masking layer.

9. The method of claim 8, wherein determining the display masking area based on the display cutout and the one or more user interface elements being presented by the display comprises: receiving information about the user interface element from an application that generated the user interface element; as well as The display masking region is dynamically generated based on the information received from the application about the user interface element to substantially match the display cutout.

10. The method of claim 6, wherein controlling the display to present a display masking area substantially matching the display cutout in response to an ambient light intensity satisfying an ambient light threshold comprises: The display is controlled to present a first display masked region at a first time based on a first ambient light intensity and the display is controlled to present a second display masked region at a second time based on a second ambient light intensity.

11. A computing device, the computing device comprising: a display, the display comprising a display cutout; A component for monitoring whether the ambient light intensity meets the ambient light threshold; and Means for controlling the display to present a display masking area substantially matching the display cutout in response to the ambient light intensity satisfying the ambient light threshold.

12. The computing device of claim 11, wherein the means for controlling the display to present a display masking area that substantially matches the display cutout comprises: Means for controlling the display to present the display masking region based on one or more user interface elements being presented on the display.

13. The computing device of claim 11, wherein the means for controlling the display to present a display masking area that substantially matches the display cutout comprises: means for generating a display masking layer corresponding to the display cutout based on one or more user interface elements being presented by the display; means for determining the display masking region based on the display cutout and the one or more user interface elements being presented on the display; means for modifying the display masking layer by the determined display masking region; and Means for controlling the display to present the modified display masking layer.

14. The computing device of claim 13, wherein the means for determining the display masking area based on the display cutout and the one or more user interface elements being presented by the display comprises: means for receiving information about the user interface element from an application generating the user interface element; and Means for dynamically generating the display masking region to substantially match the display cutout based on the information received from the application regarding the user interface element.

15. The computing device of claim 11, wherein the means for controlling the display to present a display masking area substantially matching the display cutout in response to an ambient light intensity satisfying an ambient light threshold comprises: Means for controlling the display to present a first display masked region at a first time based on a first ambient light intensity and controlling the display to present a second display masked region at a second time based on a second ambient light intensity.

16. A non-transitory processor-readable medium having processor-executable instructions stored thereon, the processor-executable instructions being configured to cause a processor of a computing device to perform operations comprising: Monitor whether the ambient light intensity meets the ambient light threshold; as well as In response to the ambient light intensity satisfying the ambient light threshold, the display is controlled to present a display masking area that substantially matches the display cutout.

17. The non-transitory processor-readable medium of claim 16, wherein the stored processor-executable instructions are further configured to cause the processor to perform operations such that controlling the display to present a display masking area that substantially matches the display cutout comprises: The display is controlled to present the display masking region based on one or more user interface elements being presented on the display.

18. The non-transitory processor-readable medium of claim 16, wherein the stored processor-executable instructions are further configured to cause the processor to perform operations such that controlling the display to present a display masking area that substantially matches the display cutout comprises: generating a display masking layer corresponding to the display cutout based on one or more user interface elements being presented by the display; determining the display masking region based on the display cutout and the one or more user interface elements being presented on the display; modifying the display masking layer by the determined display masking area; as well as The display is controlled to present the modified display masking layer.

19. The non-transitory processor-readable medium of claim 18, wherein the stored processor-executable instructions are further configured to cause the processor to perform operations such that determining the display masking area based on the display cutout and the one or more user interface elements being presented by the display comprises: receiving information about the user interface element from an application that generated the user interface element; as well as The display masking region is dynamically generated based on the information received from the application about the user interface element to substantially match the display cutout.

20. The non-transitory processor-readable medium of claim 16, wherein the stored processor-executable instructions are further configured to cause the processor to perform operations such that, in response to an ambient light intensity satisfying an ambient light threshold, controlling the display to present a display masking area that substantially matches the display cutout comprises: The display is controlled to present a first display masked region at a first time based on a first ambient light intensity and the display is controlled to present a second display masked region at a second time based on a second ambient light intensity.

Images