Screen defect and contaminant detection for mobile devices

Abstract

Systems and methods for detecting and mitigating contaminants on a display are disclosed. In one aspect, a mobile device may scan a display. The mobile device may generate one or more images related to the contaminant based on the scan. The mobile device may detect contaminants on the display based on the one or more images. The mobile device may identify contaminants on the display using the one or more images. The mobile device may perform a mitigation action to mitigate the contaminant based on the identification of the contaminant.

Description

Technical Field

[0001] Aspects of the present invention generally relate to contaminant and scratch detection for mobile device screens. Background Art

[0002] Contaminants on the display of a smartphone or mobile device, such as dust / dirt particles and liquids, can scratch and damage the display, especially a rollable display. However, currently, smartphones cannot distinguish between different types of contaminants on the display, such as dust particles, scratches, and liquids. The smartphone may need to know what type of contaminant is on what part of the display to resolve the problem. For example, an application on a smartphone may need to know what type of contaminant is on what part of the display to work properly, such as a fingerprint reader. Scratches or contaminants on the display may cause erroneous readings. In addition, contaminants can cause damage to screens that are rollable, foldable, or otherwise allow the contaminant to move relative to the screen surface. Summary of the invention

[0003] A simplified overview of one or more aspects disclosed herein is given below. Therefore, the following overview should not be considered as a broad overview related to all expected aspects, nor should the following overview be considered as identifying key or important elements related to all expected aspects or delineating the scope associated with any particular aspect. Therefore, the sole purpose of the following overview is to present certain concepts related to one or more aspects related to the mechanisms disclosed herein in a simplified form before the detailed description given below.

[0004] In one aspect, a method for mitigating contaminants on a display includes: scanning the display; generating one or more images associated with the contaminants based on the scan; detecting the contaminants on the display based on the one or more images; identifying the contaminants on the display using the one or more images; and performing mitigation actions to mitigate the contaminants based on the identification of the contaminants.

[0005] In one aspect, a mobile device includes: an ultrasonic scanner; a memory; and at least one processor, the at least one processor being communicatively coupled to the memory and the ultrasonic scanner and configured to mitigate contaminants on a display, the at least one processor, the memory, and the ultrasonic scanner being cooperatively configured to: scan the display; generate one or more images associated with contaminants based on the scan; detect contaminants on the display based on the one or more images; identify contaminants on the display using the one or more images; and perform mitigation actions based on the identification of the contaminants to mitigate the contaminants.

[0006] In one aspect, a mobile device configured to mitigate contaminants on a display includes: a component for scanning the display; a component for generating one or more images associated with the contaminants based on the scan; a component for detecting contaminants on the display based on the one or more images; a component for identifying contaminants on the display using the one or more images; and a component for performing mitigation actions to mitigate the contaminants based on the identification of the contaminants.

[0007] In one aspect, a non-transitory computer-readable medium storing computer-executable instructions configured to mitigate contaminants on a display, the computer-executable instructions, when executed by a mobile device, causes the mobile device to: scan the display; generate one or more images associated with contaminants based on the scan; detect contaminants on the display based on the one or more images; identify contaminants on the display using the one or more images; and perform mitigation actions to mitigate the contaminants based on the identification of the contaminants.

[0008] Other objects and advantages associated with the various aspects disclosed herein will be apparent to those skilled in the art based on the accompanying drawings and detailed description. BRIEF DESCRIPTION OF THE DRAWINGS

[0009] The accompanying drawings are presented to aid in describing various aspects thereof.

[0010] Figure 1 An example wireless communication system in accordance with aspects of the present disclosure is shown.

[0011] Figure 2 An exemplary mobile device in accordance with aspects of the present disclosure is shown.

[0012] Figure 3A and 3B Exemplary images of contaminants on a display are shown in accordance with various aspects of the present disclosure.

[0013] FIG. 4A to FIG. 4D An example implementation of a mobile device for remediating contaminants on a display of the mobile device in accordance with various aspects of the present disclosure is shown.

[0014] FIG. 5A to FIG. 5C A block diagram illustrating a contaminant detection (CD) process according to one or more aspects of the present disclosure is shown.

[0015] Figure 6 Flowcharts corresponding to one or more methods of detecting contaminants according to various aspects of the present disclosure are shown. DETAILED DESCRIPTION

[0016] Various aspects of the present disclosure are provided in the following description and related drawings for various examples provided for illustrative purposes. Alternative aspects may be designed without departing from the scope of the present disclosure. In addition, well-known elements of the present disclosure will not be described in detail or will be omitted to avoid blurring the relevant details of the present disclosure.

[0017] The words "exemplary" and / or "example" are used herein to mean "serving as an example, instance, or illustration." Any aspect described herein as "exemplary" and / or "example" is not necessarily to be construed as preferred or advantageous over other aspects. Likewise, the term "aspects of the disclosure" does not require that all aspects of the disclosure include the discussed feature, advantage, or mode of operation.

[0018] Those skilled in the art will recognize that the information and signals described below may be represented using any of a variety of different techniques and technologies. For example, data, instructions, commands, information, signals, bits, symbols, and chips that may be referenced throughout the following description may be represented by voltage, current, electromagnetic waves, magnetic fields or magnetic particles, optical fields or optical particles, or any combination thereof, depending in part on the specific application, in part on the desired design, in part on the corresponding technology, etc.

[0019] In addition, many aspects are described in terms of sequences of actions to be performed by, for example, elements of a computing device. It will be appreciated that the various actions described herein can be performed by specific circuits (e.g., application specific integrated circuits), by program instructions being executed by one or more processors, or by a combination of the two. In addition, the sequence of actions (or multiple) described herein can be considered to be fully embodied in any form of non-transitory computer-readable storage medium, which has a corresponding computer instruction set stored therein, which, when executed, will cause or instruct the associated processor of the device to perform the functions described herein. Therefore, various aspects of the present disclosure can be embodied in several different forms, all of which have been contemplated to be within the scope of the claimed subject matter. In addition, for each of the various aspects described herein, the corresponding form of any such aspect can be described herein as (for example) "logic configured to perform the described actions".

[0020] As used herein, unless otherwise specified, the terms "user terminal equipment" (UE) and "base station" are not intended to be specific to or otherwise limited to any particular radio access technology (RAT). In general, a UE may be any wireless communication device (e.g., a mobile phone, a router, a tablet computer, a laptop computer, a customer asset tracking device, a wearable device (e.g., a smart watch, glasses, augmented reality (AR) / virtual reality (VR) headsets, etc.), a vehicle (e.g., a car, a motorcycle, a bicycle, etc.), an Internet of Things (IoT) device, etc.) used by a user to communicate over a wireless communication network. A UE may be mobile or may be stationary (e.g., at certain times) and may communicate with a radio access network (RAN). As used herein, the term "UE" may be interchangeably referred to as an "access terminal" or "AT", "client device", "wireless device", "subscriber device", "subscriber terminal", "subscriber station", "user terminal" or "UT", "mobile device", "mobile terminal", "mobile station" or variations thereof. In general, a UE is able to communicate with a core network via a RAN, and through the core network, the UE is able to connect to external networks such as the Internet and to other UEs. Of course, other mechanisms for connecting to the core network and / or the Internet are also possible for the UE, such as through a wired access network, a wireless local area network (WLAN) network (e.g., based on the Institute of Electrical and Electronics Engineers (IEEE) 802.11 specification, etc.), etc.

[0021] Figure 1 An exemplary wireless communication system 100 is shown. The wireless communication system 100 (which may also be referred to as a wireless wide area network (WWAN)) may include various base stations 102 and various UEs 104. The base stations 102 may include macrocell base stations (high-power cellular base stations) and / or small cell base stations (low-power cellular base stations). In one aspect, the macrocell base stations may include eNBs and / or ng-eNBs (where the wireless communication system 100 corresponds to an LTE network), or gNBs (where the wireless communication system 100 corresponds to an NR network), or a combination of both, and the small cell base stations may include femtocells, picocells, microcells, etc.

[0022] The base stations 102 may collectively form a RAN and interface with a core network 170 (e.g., an evolved packet core (EPC) or a 5G core (5GC)) via a backhaul link 122, and interface with one or more location servers 172 (which may be part of the core network 170 or may be external to the core network 170) via the core network 170. The base stations 102 may communicate with each other directly or indirectly (e.g., via the EPC / 5GC) via a backhaul link 134, which may be wired or wireless. The mmW base station 180 may communicate with the core network 170 via the backhaul link 122 to provide support to the UE 182 and the UE 164 via a wireless link 184. The UE 164 may also communicate with the base station 102 via the wireless link 120.

[0023] Base stations 102 may communicate wirelessly with UEs 104. Each of base stations 102 may provide communication coverage for a corresponding geographic coverage area 110. In one aspect, one or more cells may be supported by base stations 102 in each geographic coverage area 110. In addition, a small cell (SC) base station 102' may have a geographic coverage area 110' that substantially overlaps with the geographic coverage area 110 of one or more macro cell base stations 102. A "cell" is a logical communication entity used to communicate with a base station (e.g., via a certain frequency resource, which is referred to as a carrier frequency, component carrier, carrier, frequency band, etc.), and may be associated with an identifier (e.g., a physical cell identifier (PCI), a virtual cell identifier (VCI), a cell global identifier (CGI)) for distinguishing cells operating via the same or different carrier frequencies. In some cases, different cells may be configured according to different protocol types (e.g., machine type communication (MTC), narrowband IoT (NB-IoT), enhanced mobile broadband (eMBB), or other protocol types) that may provide access to different types of UEs. Because a cell is supported by a specific base station, depending on the context, the term "cell" can refer to either or both of a logical communication entity and a base station that supports it. In some cases, the term "cell" can also refer to a geographic coverage area (e.g., a sector) of a base station, as long as the carrier frequency can be detected and used for communication within a certain portion of the geographic coverage area 110.

[0024] The wireless communication system 100 may also include a wireless local area network (WLAN) access point (AP) 150 in communication with a WLAN station (STA) 152 via a communication link 154 in an unlicensed spectrum (e.g., 5 GHz). When communicating in the unlicensed spectrum, the WLAN STA 152 and / or the WLAN AP 150 may perform a clear channel assessment (CCA) or a listen-before-talk (LBT) process to determine whether a channel is available prior to communication.

[0025] exist Figure 1 In the example of FIG. 1 , one or more Earth-orbiting satellite positioning system (SPS) spacecraft (SV) 112 (eg, satellites) may be used as any of the illustrated UEs (for simplicity, in FIG. 1 ). Figure 1 104). UE 104 may include one or more dedicated SPS receivers specifically designed to receive SPS signals 124 for deriving geographic location information from SV 112. SPS generally includes a system of transmitters (e.g., SV 112) that are positioned so that a receiver (e.g., UE 104) can determine its position on or above the earth based at least in part on signals received from the transmitters (e.g., SPS signals 124). As used herein, SPS may include any combination of one or more global and / or regional navigation satellite systems and / or augmentation systems, and SPS signals 124 may include SPS, SPS-like, and / or other signals associated with such one or more SPS.

[0026] The wireless communication system 100 may also include one or more UEs (such as UE 190) indirectly connected to one or more communication networks via one or more device-to-device (D2D) peer-to-peer (P2P) links (referred to as “side links”). Figure 1 In the example of FIG. 1 , UE 190 has a D2D P2P link 192 with one of UEs 104 connected to one of base stations 102 (e.g., through which UE 190 can indirectly obtain cellular connectivity) and a D2D P2P link 194 with a WLAN STA 152 connected to a WLAN AP 150 (through which UE 190 can indirectly obtain WLAN-based Internet connectivity). In the example, D2D P2P links 192 and 194 can be connected using any well-known D2D RAT (such as LTE Direct (LTE-D), WiFi Direct (WiFi-D), etc.) to support.

[0027] refer to Figure 2, shows a simplified schematic diagram of an exemplary mobile device 200 having a processor 220, an antenna array 210, a transceiver 222, a camera sensor system 230, and a display 234. In one aspect, the mobile device 200 can employ ultrasonic full-screen fingerprint scanner / sensor technology to detect fingerprints and other objects on the display 234. The mobile device 200 also includes a memory 240. The camera sensor system 230 includes a camera 232 and an ultrasonic scanner 236 that sends and receives ultrasonic pulses. The camera sensor system 230 may further include other sensors (not shown), such as one or more of a lidar sensor, a radar sensor, a speed sensor, and / or any other sensor that may assist in the operation of the mobile device 200. It will be noted that the mobile device 200 may be similar to the UE 104, 190, or Figure 1 and may further include any other UEs as known to those skilled in the art but not described herein. Figure 2 One or more components shown in .

[0028] Mobile device 200 may be any suitable electronic device that is mobile. For example, mobile device 200 may be a smart phone, a tablet computer, a laptop computer, a smart watch, a shipment tracking device, a wearable device, smart glasses, a vehicle-mounted computer installed in a vehicle, etc. For example, in one aspect, display 234 may be a rollable display, such as a Figure 4A Display 410 is shown. In another aspect, display 234 can be a flat, non-rollable display. In yet another aspect, display 234 can be a foldable display. In addition, it will be appreciated that although mobile device 200 is used for illustrative purposes, the pollutant identification and mitigation aspects disclosed herein are not limited to the mobile devices or various example configurations shown. For example, the disclosed aspects can be applied to any suitable display, such as a monitor, a television, etc.

[0029] As explained above, the antenna array 210 includes multiple antennas for transmitting and receiving beamforming. The antenna array 210 is coupled to the transceiver 222. The processor 220 can control the antenna array 210 and the transceiver 222. The transceiver 222 may include a wireless wide area network (WWAN) transceiver that provides components (e.g., components for transmitting, components for receiving, components for measuring, components for tuning, components for suppressing transmission, etc.) for communicating via one or more wireless communication networks (not shown) such as NR networks, LTE networks, GSM networks, etc. The transceiver 222 may also include a wireless local area network (WLAN) transceiver.

[0030] In addition, the transceiver 222 may include a satellite positioning system (SPS) receiver. The SPS receiver may be connected to one or more antennas in the antenna array 210, respectively, and may provide components for receiving and / or measuring SPS signals, respectively, wherein the SPS signals are such as global positioning system (GPS) signals, global navigation satellite system (GLONASS) signals, Galileo signals, Beidou signals, Indian regional navigation satellite system (NAVIC), Quasi-Zenith Satellite System (QZSS), etc. The SPS receiver may include any suitable hardware and / or software for receiving and processing SPS signals.

[0031] like Figure 2 As shown, the processor 220 is coupled to the transceiver 222. Figure 2 As shown, the processor 220 is also coupled to the memory 240 and the camera sensor system 230. The camera sensor system 230 includes a camera 232 and an ultrasonic scanner 236. In one aspect, the ultrasonic scanner 236 can send ultrasonic pulses to detect fingerprints and objects, such as contaminants (solid and liquid contaminants) on the display 234. In one aspect, the ultrasonic scanner 236 can include an ultrasonic transmitter and a receiver (not shown). The ultrasonic scanner 236 can send ultrasonic pulses against a finger or an object on the display 234 and detect pulses that are absorbed or bounced back to the ultrasonic scanner 236. In one aspect, the processor 220 can control the operation of the camera sensor system 230 including the ultrasonic scanner 236. In addition, the processor 220 is coupled to the display 234 and can display objects and renderings including virtual objects and renderings on the display 234.

[0032] In various aspects, the processor 220 can use the ultrasonic scanner 236 to detect various contaminants on the display 234, including liquid contaminants and solid contaminants. The ultrasonic scanner 236 can send ultrasonic pulses to the display 234 and receive pulses reflected back to the ultrasonic scanner 236 to detect contaminants on the display 234. In one aspect, the processor 220 can instruct the ultrasonic scanner 236 to send ultrasonic pulses at various frequencies and use various range gate delays to detect contaminants. The processor 220 can use multiple combinations of frequencies and range gate delays to create and generate multiple images of contaminants. In other words, the ultrasonic scanner 236 can change the frequency of the ultrasonic pulses sent to detect contaminants, and can change the range gate delay to provide a timing offset to help detect contaminants. In other aspects, embedded imaging sensors can be used to detect contaminants. For example, one or more captured images can be compared with a calibration image that can be established during an initial test of the device (such as a factory calibration process).

[0033] For example, Figure 3AAn image 310 of liquid contaminants is shown on display 234. Image 310 may have been generated by ultrasound scanner 236 using various frequencies and various range gate delays. For example, different types of materials have different times it takes for sound waves to reflect back, and the reflections can also vary with different frequencies. Based on the various frequencies and reflection times used, the contaminants can be classified according to the type of contaminant. In another example, Figure 3B An image 320 of solid contaminants (such as dirt / dust contaminants) that has been generated by the ultrasonic scanner 236 is shown. In one aspect, the processor 220 can direct the ultrasonic scanner 236 to send ultrasonic pulses to the display 234 to detect and generate images of possible contaminants at specific time intervals on the display 234. The time interval can be controlled by the processor 220. In one aspect, the ultrasonic scanner 236 can use a high range gate delay (HRGD) to detect liquid contaminants, and can use a fingerprint range gate delay (FPRGD), which is a lower range gate delay for detecting other types of contaminants. The range gate delay is controlled by a programmable delay line, which can include a coarse delay line and a fine delay line that can be selectively activated to control the time interval. In addition, it will be appreciated that using multiple threshold times based on expected delay / reflection times, various contaminants can be detected and identified.

[0034] In one aspect, the ultrasonic scanner 236 may send the generated image (e.g., image 310) to the processor 220 for further processing. The processor 220 may perform further processing to remove noise and blur, thereby creating a clearer image. In some aspects, an image processing algorithm may be used, such as a point spread function (PSF), which is an image processing technique that can be used to combine multiple images in a short time interval to improve image quality. After processing the image to remove noise and blur, the processor 220 may use a neural network to identify or classify contaminants on the display 234. In some aspects, the processor 220 may use a convolutional neural network (CNN) to identify or classify contaminants. The CNN may have been trained to identify various liquid contaminants and solid contaminants, such as dust and particles. Therefore, the processor 220 may use a CNN to identify the type of contaminant, such as a liquid, solid, or other appropriate classification, such as a scratch, which may be detected as a persistent solid and / or may be confirmed by a user of the mobile device. These classifications may be used to further improve the mitigation techniques disclosed herein.

[0035] On the one hand, the processor 220 can also classify the identified pollutants as weak pollutants or strong pollutants based on the time required for identifying the pollutants. For example, if the time required for identifying the pollutants exceeds a certain threshold time, the pollutants can be classified or identified as strong pollutants, and if the time does not exceed the threshold time, the pollutants can be classified or identified as weak pollutants. For example, in some aspects, a threshold time of about 6 milliseconds (ms) can be considered as a threshold time. However, it will be appreciated that the threshold time depends on the time required for the sound wave to reflect back and collect images. As those skilled in the art will appreciate, this can be determined in the calibration process using known pollutants. Therefore, various aspects are not limited to the specific examples and values ​​provided herein. In addition, in some aspects, the pollutants identified can be classified as solid weak pollutants, solid strong pollutants, liquid weak pollutants or liquid strong pollutants, etc. On the one hand, the processor 220 can use additional classification to classify pollutants.

[0036] After identifying the contaminant, processor 220 may take remedial actions to mitigate the problem caused by the contaminant. For example, Figure 4A A mobile device 400 is shown having a rollable display 410. In one aspect, the mobile device 400 can be similar to the mobile device 200, and the display 410 can be similar to the display 234. Similar to the mobile device 200, the mobile device 400 can include other components, such as the processor 220 and the camera sensor system 230. Figure 4A As shown, if the processor 220 detects the pollutant 415 and identifies the pollutant 415 as a solid pollutant, the processor 220 can use the wiping plane device 420 to remove the pollutant 415 from the display 410. In other aspects, a blower or a combination of a blower and a wiper can be used to mitigate the pollutant. As a further improvement, for weak contamination, the action can be different, for example, using a blower, a wiper, etc. that can be part of a mobile device. However, in some aspects, for strong pollutants, the user can be directly asked to take specific actions to mitigate the pollutant.

[0037] On the other hand, Figure 4B As shown, if the processor 220 detects a contaminant 415 (liquid or solid), the processor 220 may display a user interface (UI) window 440 on the display 410. Figure 4BAs shown, window 440 can display a warning to the user of mobile device 400, such as avoiding screen scrolling to protect display 234. Processor 220 can additionally prevent the screen from rolling up until the user confirms that the contamination has been alleviated. For example, by pressing the "OK" soft key, processor 220 can continue to roll up display 234. However, in other aspects, processor 220 can rescan display 234 to confirm that the contamination is alleviated (e.g., no contamination is detected or an acceptable contamination level is detected). In some aspects, rescanning can be performed only in the contamination area identified in the previous scan to reduce power consumption and processing time.

[0038] On the other hand, Figure 4C As shown, when the processor 220 detects a contaminant (or multiple), the processor 220 may display a UI window 450 that warns the user of the mobile device 400 to clean the contaminant (or multiple) by highlighting the location of the contaminant (or multiple), as shown by the highlighted contaminant areas 455 and 460. Figure 4C As shown, contaminant regions 455 and 460 identify the location of the contaminant on the display. In some aspects, one or more contaminant regions (e.g., 455 and 460) can be identified as separate contaminant types using text, color, geometry, etc. The mitigation message can include warnings, contaminant type information, mitigation techniques (e.g., recommended cleaning processes, cleaning materials, etc.), and / or links to additional information. In addition, in some aspects, by pressing the "Continue" soft key, the processor 220 is able to continue to roll up the display 234. However, in other aspects, after receiving confirmation that the mitigation action is complete (e.g., pressing "Continue"), the processor 220 can rescan the contaminant region (or multiple) (e.g., 455 and 460) or the display 234 in the entire screen to confirm that the contaminant is mitigated. For example, no contamination is detected or an acceptable level of contamination is detected.

[0039] exist Figure 4DIn another example shown, if the processor 220 detects a scratch (such as a scratch in the contaminant region 475), the processor 220 may display a UI window 470 asking the user whether he wants to remove the scratch. In addition, the processor 220 may highlight the scratch by highlighting the contaminant region 475. The user may choose to remove the scratch. If the user chooses to remove the scratch, the processor 220 may initiate a process of attempting to repair and remove the scratch. In some aspects, after the contaminant is identified as a scratch, the processor may perform a self-repair process to alleviate the scratch. The self-repair process may include using at least one of heat, light, or current to alleviate the scratch. In addition, in some aspects, the self-repair process may be limited to the contaminant region 475, which may reduce the power consumption and processing time for removing the scratch. In addition, after the mitigation process (e.g., the self-repair process in this example) is completed, the processor 220 may rescan the display 234 in the contaminant region 475 or the entire screen to confirm that the contaminant is alleviated. For example, the scratch is removed or reduced to an acceptable level. If a rescan results in further detection of scratches in the contaminant region 475, the self-healing process can be automatically repeated one or more predetermined times with varying parameters (e.g., longer duration, higher heat, current, etc.) until the contaminant is mitigated. Alternatively, at each rescan, the process can wait for user confirmation to continue.

[0040] It will be appreciated that the foregoing illustrative examples are provided merely to help explain the various disclosed aspects. For example, different display types may have different mitigation messages / actions. In some aspects, for a foldable display, a warning not to fold the display may be presented prior to mitigating the contaminant, and mitigation techniques may include partially folding and / or positioning the display so that gravity will act to dislodge the contaminant and vibrating the phone to remove the contaminant. Thus, it will be appreciated that in accordance with various aspects disclosed herein, the processor 220 may take other actions to mitigate detected and identified contaminants, and the disclosed aspects are not limited to FIG. 4A to FIG. 4D The components and actions shown in .

[0041] Figure 2 The components of can be implemented in various ways. In some embodiments, Figure 2The components of may be implemented in one or more circuits, such as, for example, one or more processors and / or one or more ASICs (which may include one or more processors). Here, each circuit may use and / or incorporate at least one memory component for storing information or executable code used by the circuit to provide the functionality. For example, some or all of the functions represented by blocks 210 to 240 may be implemented by a processor and memory component(s) of the mobile device 200 (e.g., by executing appropriate code and / or by appropriate configuration of the processor components). However, as will be appreciated, such operations, actions, and / or functions may actually be performed by a specific component or combination of components of the mobile device 200, such as the antenna array 210, the transceiver 222, the processor 220, the camera sensor system 230, the display 234, and the memory 240.

[0042] FIG. 5A to FIG. 5C A block diagram of one or more contaminant detection (CD) processes 500 is shown in accordance with one or more aspects of the present disclosure. Figure 5A , CD processing 500 can be started at module 510. Process 500 can be initiated by calling startup module 510 at predetermined intervals from an upper layer application (e.g., such as an application that relies on screen clarity and / or screen image capture) in response to an environmental / contextual change of the mobile device (e.g., a temperature change, an extended idle period, a change in ambient light, etc.), and process 500 can be triggered as part of other operations (such as traditional fingerprint background imaging and CD detection) when the display is rolled up. At module 520, HRGD CD processing is performed to detect liquid contaminants as discussed herein. At module 530, FPRGD CD processing is performed to detect solid contaminants as discussed herein. In each case, for HRGD CD at module 520 and FPRGD at module 530, if a contaminant is not detected, output 540 is assumed to be detected only air or no contaminant is detected. Similarly, in each case, for HRGD CD at module 520 and FPRGD CD at module 530, if a contaminant is detected, output 550 indicates that the contaminant is detected. It will be appreciated that this is a simplified block diagram provided for high-level explanation only, and should not be construed as limiting the various aspects disclosed herein. For example, it is not necessary to run both the HRGD CD and the FPRGD CD at every moment. Furthermore, additional shielding can be performed, such as being able to perform electromagnetic interference (EMI) checks to ensure that the image is not affected and / or compromised by high-frequency noise. Additional details related to the HRGD CD and the FPRGD CD are provided below.

[0043] refer to Figure 5B, a block diagram of HRGD CD processing of module 520 according to one or more aspects of the present disclosure is shown. For example, dashed module 521 involves input image generation. Module 522 may include scanning parameters such as frequency (f), DC voltage bias (Dbias), and FPRGD settings for setting various programmable delay lines, which provide appropriate scanning of an object of interest (e.g., a liquid) under given environmental conditions (such as temperature) (e.g., typically HRGD will be greater for lower temperatures and smaller for higher temperatures). These parameters for configuring an ultrasound scanner (e.g., 236) can be obtained from a lookup table (LUT) and / or dynamically configured. At module 524, one or more images are acquired using an ultrasound scanner configured with parameters for HRGD CD. These images (or multiples) are then passed to module 526, where contamination detection is performed. If a contaminant is detected, the output indicates that it will be contaminated, and in some aspects, the output can include a ranking that will allow further classification of weak or strong contaminants. If contaminants are not detected, the detected images can optionally qualify as background (BG) images and can be stored in the memory / database 560 so they can be used for fingerprint detection and / or other image processing that can use background images for image processing (e.g., a subtraction function for removing background).

[0044] refer to Figure 5C , a block diagram of the FPRGD CD process of module 530 is shown according to one or more aspects of the present disclosure. For example, dashed module 531 relates to input image generation. Module 532 may include scanning parameters such as frequency (f), DC voltage bias (Dbias), and HRGD settings for setting various programmable delay lines, which provide appropriate scanning of an object of interest (e.g., a solid) under given environmental conditions (such as temperature). These parameters for configuring an ultrasound scanner (e.g., 236) can be obtained from a lookup table (LUT) and / or dynamically configured. At module 534, one or more images are acquired using an ultrasound scanner configured with the parameters of the FPRGD CD. These images (or multiple images) are then passed to module 536, where contamination detection is performed. If a contaminant is detected, the output indicates that it will be contaminated, and the output can include a ranking that will allow further classification of weak or strong contaminants. If contaminants are not detected, the detected images may optionally qualify as background (BG) images and may be stored in memory / database 560 so they can be used for fingerprint detection as described above and / or other image processing that may use background imaging.

[0045] It will be appreciated that the contamination detection module (e.g., modules 526 and 536) can include multiple elements. For example, in some aspects, at a high level, contaminant detection is performed in two functions / processes / elements 1: 1. Image preprocessing; 2. Convolutional neural network (CNN) classifier. In some aspects, the CNN outputs a contamination score in the range of 0.0 to 1.0, where a lower number (below a determined threshold) indicates air or no contamination, and the intensity of contamination increases as the contamination score increases. It will be appreciated that the output range and relative grading can be normalized and set to various ranges and inversions, such as 0 to 10 and higher numbers indicating no contamination. Therefore, these examples should not be interpreted as limiting the various aspects disclosed. It will be appreciated that, as is known in the art, CNN classifiers are trained based on a large sampling of screen images of known contaminants and uncontaminated screens. In addition, it will be appreciated that image preprocessing can include various functions / processes / elements. For example, in some aspects, image preprocessing can include frame removal (e.g., using standard functions from an image processing pipeline (IPP) library), high pass filtering (to remove background gradients from the image), automatic scaling using gains and offsets calculated from the IPP library. It will be appreciated that the foregoing examples are provided to illustrate and not to limit the various aspects disclosed. For example, it will be appreciated that the CNN classifier in module 526 and the CNN classifier in module 536 differ at least in that the training of the CNN classifiers will be for contaminants that are both used for detection (e.g., liquids and solids, respectively). In addition, in some aspects, the CNN module can be further trained to recognize different types of contaminants, such as liquids, water, liquids, oils, and the intensity of each of these contaminants. Therefore, the various aspects disclosed are not limited to the explicit examples provided.

[0046] It will be appreciated that the various aspects include various methods for performing the processes, functions and / or algorithms disclosed herein. For example, Figure 6 A method 600 is shown for detecting contamination on a display and taking action to repair or mitigate the contamination. The method may be performed by, for example, Figure 1 The mobile device 200, processor 220, UE 104, 190 or other UE device shown in the figure or any other suitable device (e.g., monitor, television, etc.) that may include a display having the functions disclosed herein. For ease of illustration of various aspects, in the example configuration, mitigation Figure 6 The method 600 of detecting contaminants on a display as described herein may be related to being performed by a mobile device as discussed herein.

[0047] At block 610, the method scans the display. For example, in some aspects as described herein, the scanning can be performed by using ultrasound pulses. In some aspects, the ultrasound scanner 236 can scan the display 234 by sending and receiving ultrasound pulses.

[0048] At block 620, the method generates an image of the contaminant based on the image. For example, in some aspects, the ultrasound scanner 236 can generate one or more images of the contaminant (eg, images 310 and 320).

[0049] At block 630 , the method detects contaminants on the display based on the one or more images.

[0050] At block 640, the method identifies contaminants and contaminant regions on the display using the one or more images. For example, in some aspects, the processor 220 may use a neural network to identify contaminants based on the generated images.

[0051] At block 650, the method performs mitigation actions based on the identification of the contaminant to mitigate the contaminant. For example, in some aspects, the processor 220 can take various actions to mitigate the contaminant, such as displaying a UI window to warn the user, wiping dust off the display, performing a self-repair process to remove scratches, etc.

[0052] From the foregoing it will be appreciated that the various aspects disclosed may include additional and / or alternative methods, processes and / or actions. For example, scanning a display using ultrasonic pulses may include changing the frequency of the ultrasonic pulses and / or changing the range gate delay of the ultrasonic pulses to generate an image. In some aspects, scanning may be performed by an ultrasonic full screen fingerprint sensor.

[0053] In some aspects, performing a mitigation action may include performing one or more actions. For example, a mitigation action may include displaying a user interface (UI) window (see, e.g., Figure 4A To Figure Figure 4D ). In addition, the mitigation message may include text identifying the contaminant and / or the mitigation message may include instructions to mitigate the contaminant. Various methods may also include highlighting the contaminant area on the display (e.g., 455, 460, 470).

[0054] In some aspects, the various methods disclosed may include: receiving confirmation that the mitigation action is complete; and rescanning the display in the contaminant area to confirm that the contaminant is mitigated. Confirmation may also include receiving input from a user indicating that the mitigation action is complete. In other aspects, confirmation may include receiving a completion indication from an automatic mitigation action (e.g., self-repair, erase, etc.). For example, in some aspects, the mitigation action may also include identifying the contaminant as a scratch and performing a self-repair process to mitigate the scratch. In some aspects, the self-repair process includes using at least one of heat, light, or electric current to mitigate scratches. In other aspects, the self-repair process may be limited to the contaminant area. It will be appreciated that the self-repair process can be used on rollable displays, foldable displays, and fixed displays.

[0055] In some aspects, the mitigation aspects may depend on the display type. For example, if the display is a rollable display, the mitigation action may also include preventing the display from being rolled up. This may trigger an automatic cleaning process and / or may be used in combination with one or more UI messages to the user and request manual cleaning. In some aspects, the user may be allowed to override the blocking of rolling up by selecting a specified user input. In some aspects, the mitigation action for mitigation may be limited to the contaminant area. For example, only a portion of the screen containing the contaminant area may be cleaned.

[0056] In the above detailed description, it can be seen that different features are grouped together in the examples. This disclosure should not be understood as an intention that the example clauses have more features than the features explicitly mentioned in each clause. On the contrary, various aspects of the present disclosure may include less than all the features of the disclosed individual example clauses. Therefore, the following clauses should be considered to be incorporated into the specification, wherein each clause itself can be used as a separate example. Although each dependent clause can refer to a specific combination with one of the other clauses in the clause, the aspect (or multiple) of the dependent clause is not limited to a specific combination. It will be recognized that other example clauses can also include a combination of the subject matter of the dependent clause aspect (or multiple) with any other dependent clause or independent clause, or any feature with other dependent and independent clauses. Various aspects disclosed herein explicitly include these combinations, unless it is clearly expressed or can be easily inferred that a specific combination is not intended (for example, contradictory aspects, such as defining an element as both an insulator and a conductor). In addition, various aspects of the clause are also intended to be included in any other independent clause, even if the clause is not directly dependent on the independent clause.

[0057] Implementation examples are described in the following numbered clauses.

[0058] Item 1. A method for mitigating contaminants on a display, the method comprising: scanning the display; generating one or more images associated with the contaminants based on the scan; detecting contaminants on the display based on the one or more images; identifying contaminants on the display using the one or more images; and performing mitigation actions to mitigate the contaminants based on the identification of the contaminants.

[0059] Clause 2. The method of clause 1, wherein scanning the display further comprises: scanning the display using an ultrasonic scanner.

[0060] Clause 3. The method of clause 2, further comprising: varying a frequency of ultrasound pulses used by the ultrasound scanner to generate one or more images.

[0061] Clause 4. The method of any one of clauses 2 to 3, further comprising: varying a range gate delay of an ultrasound scanner to generate an image.

[0062] Clause 5. A method according to any one of clauses 2 to 4, wherein the ultrasonic scanner is an ultrasonic full-screen fingerprint sensor.

[0063] Clause 6. The method of any one of clauses 1 to 5, wherein performing a mitigation action comprises: displaying a user interface (UI) window including a mitigation message.

[0064] Clause 7. The method of clause 6, wherein the mitigation message includes text identifying the contaminant.

[0065] Clause 8. The method of any of Clauses 6 to 7, wherein the mitigation message includes instructions to mitigate the pollutant.

[0066] Clause 9. The method according to any one of clauses 6 to 8, further comprising: highlighting the pollutant region on the display, wherein the pollutant region contains the pollutant.

[0067] Clause 10. The method of any of clauses 1 to 9, further comprising: receiving confirmation that the mitigation action is complete; and rescanning the display in the contaminant area to confirm that the contaminant is mitigated.

[0068] Clause 11. The method of clause 10, wherein receiving confirmation further comprises: receiving input from a user indicating completion of the mitigation action.

[0069] Clause 12. The method of any of clauses 10 to 11, wherein receiving a confirmation further comprises: receiving a completion indication from the automatic mitigation action.

[0070] Clause 13. The method of any one of clauses 1 to 12, wherein performing a mitigation action further comprises: identifying the contaminant as a scratch; and performing a self-healing process to mitigate the scratch.

[0071] Clause 14. The method of clause 13, wherein the self-healing process comprises using at least one of heat, light, or electrical current to relieve the scratch.

[0072] Clause 15. The method of clause 14, wherein the self-healing process is limited to the contaminant region.

[0073] Clause 16. The method of any of clauses 1 to 15, wherein the display is a rollable display, and performing the mitigating action further comprises: preventing the display from rolling up.

[0074] Clause 17. The method of any of Clauses 1 to 16, wherein the mitigation action for mitigation is limited to the pollutant region including the pollutant.

[0075] Clause 18. The method of any one of clauses 1 to 17, wherein identifying the contaminant comprises identifying the contaminant as a solid, a liquid, or a scratch.

[0076] Clause 19. The method of clause 18, wherein identifying contaminants further comprises: using a neural network trained to identify contaminants.

[0077] Clause 20. The method of any one of clauses 18 to 19, wherein identifying the contaminant further comprises: identifying the contaminant as weak or strong based on a time at which the contaminant is identified.

[0078] Item 21. A mobile device comprising: an ultrasonic scanner; a memory; and at least one processor, the at least one processor being communicatively coupled to the memory and the ultrasonic scanner and configured to mitigate contaminants on a display, the at least one processor, the memory, and the ultrasonic scanner being collaboratively configured to: scan the display; generate one or more images associated with contaminants based on the scan; detect contaminants on the display based on the one or more images; identify contaminants on the display using the one or more images; and perform mitigation actions based on the identification of contaminants to mitigate the contaminants.

[0079] Clause 22. The mobile device of clause 21, wherein the at least one processor configured to scan the display comprises at least one processor configured to: scan the display using an ultrasound scanner.

[0080] Clause 23. The mobile device of clause 22, wherein the at least one processor is further configured to: vary a frequency of ultrasound pulses used by the ultrasound scanner to generate the one or more images.

[0081] Clause 24. The mobile device of any of clauses 22 to 23, wherein the at least one processor is further configured to: vary a range gate delay of the ultrasound scanner to generate the image.

[0082] Clause 25. A mobile device according to any one of clauses 22 to 24, wherein the ultrasonic scanner is an ultrasonic full-screen fingerprint sensor.

[0083] Clause 26. A mobile device as described in any of clauses 21 to 25, wherein the at least one processor configured to perform a mitigation action includes at least one processor configured to perform the following processing: display a user interface (UI) window including a mitigation message.

[0084] Clause 27. The mobile device of clause 26, wherein the mitigation message includes text identifying the contaminant.

[0085] Clause 28. The mobile device of any of clauses 26 to 27, wherein the mitigation message includes instructions for mitigating the pollutant.

[0086] Clause 29. The mobile device of any one of clauses 26 to 28, wherein the at least one processor is further configured to: highlight the contaminant region on the display, wherein the contaminant region contains the contaminant.

[0087] Clause 30. The mobile device of any of clauses 21 to 29, wherein the at least one processor is further configured to: receive confirmation that the mitigation action is complete; and rescan the display in the contaminant area to confirm that the contaminant is mitigated.

[0088] Clause 31. The mobile device of clause 30, wherein the at least one processor configured to receive the confirmation comprises at least one processor configured to receive input from a user indicating completion of the mitigation action.

[0089] Clause 32. The mobile device of any of clauses 30 to 31, wherein the at least one processor configured to receive the confirmation comprises at least one processor configured to receive a completion indication from the automatic mitigation action.

[0090] Clause 33. A mobile device according to any of clauses 21 to 32, wherein the at least one processor configured to perform a mitigation action includes at least one processor configured to: identify a contaminant as a scratch; and perform a self-healing process to mitigate the scratch.

[0091] Clause 34. The mobile device of clause 33, wherein the self-healing process comprises using at least one of heat, light, or electrical current to alleviate the scratch.

[0092] Clause 35. A mobile device according to clause 34, wherein the self-healing process is limited to the contaminated area.

[0093] Clause 36. The mobile device of any one of clauses 21 to 35, wherein the display is a rollable display, and performing the mitigation action further comprises: preventing the display from rolling up.

[0094] Clause 37. A mobile device according to any of clauses 21 to 36, wherein the mitigation action for mitigation is limited to a pollutant area including the pollutant.

[0095] Clause 38. The mobile device of any of clauses 21 to 37, wherein the at least one processor configured to identify a contaminant comprises at least one processor configured to identify the contaminant as a solid, a liquid, or a scratch.

[0096] Clause 39. The mobile device of clause 38, wherein the at least one processor configured to identify the contaminant comprises at least one processor configured to use a neural network trained to identify the contaminant.

[0097] Clause 40. The mobile device of any of clauses 38 to 39, wherein the at least one processor configured to identify the contaminant comprises at least one processor configured to identify the contaminant as weak or strong based on a time at which the contaminant is identified.

[0098] Item 41. A mobile device configured to mitigate contaminants on a display, comprising: a component for scanning the display; a component for generating one or more images associated with the contaminants based on the scan; a component for detecting contaminants on the display based on the one or more images; a component for identifying contaminants on the display using the one or more images; and a component for performing mitigation actions to mitigate the contaminants based on the identification of the contaminants.

[0099] Clause 42. The mobile device of clause 41, wherein the component for scanning the display further comprises an ultrasound scanner.

[0100] Clause 43. The mobile device of clause 42, further comprising: means for varying the frequency of ultrasound pulses used by the ultrasound scanner to generate one or more images.

[0101] Clause 44. A mobile device according to any one of clauses 42 to 43, further comprising: means for varying a range gate delay of an ultrasound scanner to generate an image.

[0102] Clause 45. A mobile device according to any one of clauses 42 to 44, wherein the ultrasonic scanner is an ultrasonic full-screen fingerprint sensor.

[0103] Clause 46. A mobile device as recited in any one of Clauses 41 to 45, wherein the means for performing a mitigation action comprises: means for displaying a user interface (UI) window comprising a mitigation message.

[0104] Clause 47. The mobile device of clause 46, wherein the mitigation message includes text identifying the contaminant.

[0105] Clause 48. The mobile device of any of clauses 46 to 47, wherein the mitigation message includes instructions for mitigating the pollutant.

[0106] Clause 49. The mobile device according to any one of clauses 46 to 48, further comprising: a component for highlighting a pollutant region on the display, wherein the pollutant region contains pollutants.

[0107] Clause 50. The mobile device of any of clauses 41 to 49, further comprising: means for receiving confirmation that the mitigation action is complete; and means for rescanning the display in the contaminant area to confirm that the contaminant is mitigated.

[0108] Clause 51. The mobile device of clause 50, wherein the means for receiving confirmation further comprises: means for receiving input from a user indicating completion of the mitigation action.

[0109] Clause 52. The mobile device of any of clauses 50 to 51, wherein the means for receiving a confirmation further comprises: means for receiving a completion indication from the automatic mitigation action.

[0110] Clause 53. A mobile device according to any one of clauses 41 to 52, wherein the component for performing a mitigation action further comprises: a component for identifying a contaminant as a scratch; and a component for performing a self-repair process to mitigate the scratch.

[0111] Clause 54. The mobile device of clause 53, wherein the self-healing process comprises using at least one of heat, light, or electrical current to relieve the scratch.

[0112] Clause 55. A mobile device according to clause 54, wherein the self-healing process is limited to the contaminated area.

[0113] Clause 56. The mobile device of any one of clauses 41 to 55, wherein the display is a rollable display, and performing the mitigation action further comprises: a component for preventing the display from rolling up.

[0114] Clause 57. A mobile device as in any of clauses 41 to 56, wherein the mitigation action for mitigation is limited to a pollutant region including the pollutant.

[0115] Clause 58. A mobile device according to any one of clauses 41 to 57, wherein the means for identifying a contaminant comprises means for identifying the contaminant as a solid, a liquid, or a scratch.

[0116] Clause 59. The mobile device of clause 58, wherein the means for identifying contaminants further comprises means for using a neural network trained to identify contaminants.

[0117] Clause 60. The mobile device of any one of clauses 58 to 59, wherein the means for identifying the contaminant further comprises means for identifying the contaminant as weak or strong based on a time at which the contaminant is identified.

[0118] Clause 61. A non-transitory computer-readable medium storing computer-executable instructions configured to mitigate contaminants on a display, the computer-executable instructions, when executed by a mobile device, causing the mobile device to: scan the display; generate one or more images associated with contaminants based on the scan; detect contaminants on the display based on the one or more images; identify contaminants on the display using the one or more images; and perform mitigation actions to mitigate the contaminants based on the identification of the contaminants.

[0119] Clause 62. The non-transitory computer-readable medium of clause 61, wherein the computer-executable instructions that, when executed by the mobile device, cause the mobile device to scan the display include computer-executable instructions that, when executed by the mobile device, cause the mobile device to scan the display using an ultrasound scanner.

[0120] Clause 63. The non-transitory computer-readable medium of clause 62, further comprising computer-executable instructions that, when executed by the mobile device, cause the mobile device to: change a frequency of ultrasound pulses used by the ultrasound scanner to generate one or more images.

[0121] Clause 64. The non-transitory computer-readable medium of any of clauses 62 to 63, further comprising computer-executable instructions that, when executed by a mobile device, cause the mobile device to: change a range gate delay of an ultrasound scanner to generate an image.

[0122] Clause 65. The non-transitory computer-readable medium of any one of clauses 62 to 64, wherein the ultrasonic scanner is an ultrasonic full-screen fingerprint sensor.

[0123] Clause 66. A non-transitory computer-readable medium according to any of clauses 61 to 65, wherein the computer-executable instructions that, when executed by the mobile device, cause the mobile device to perform mitigation actions include computer-executable instructions that, when executed by the mobile device, cause the mobile device to display a user interface (UI) window that includes a mitigation message.

[0124] Clause 67. The non-transitory computer-readable medium of Clause 66, wherein the mitigation message includes text identifying the contaminant.

[0125] Clause 68. The non-transitory computer-readable medium of any of Clauses 66 to 67, wherein the mitigation message includes instructions for mitigating the contaminant.

[0126] Clause 69. The non-transitory computer-readable medium of any of clauses 66 to 68, further comprising computer-executable instructions that, when executed by a mobile device, cause the mobile device to: highlight a contaminant region on a display, wherein the contaminant region contains contaminants.

[0127] Clause 70. A non-transitory computer-readable medium according to any of clauses 61 to 69, further comprising computer-executable instructions that, when executed by a mobile device, cause the mobile device to: receive confirmation that a mitigation action is complete; and rescan the display in the contaminant area to confirm that the contaminant is mitigated.

[0128] Clause 71. A non-transitory computer-readable medium according to clause 70, wherein the computer-executable instructions that, when executed by the mobile device, cause the mobile device to receive a confirmation include computer-executable instructions that, when executed by the mobile device, cause the mobile device to receive input from a user indicating that the mitigation action is complete.

[0129] Clause 72. A non-transitory computer-readable medium according to any of clauses 70 to 71, wherein the computer-executable instructions that, when executed by the mobile device, cause the mobile device to receive a confirmation include computer-executable instructions that, when executed by the mobile device, cause the mobile device to receive a completion indication from the automatic mitigation action.

[0130] Clause 73. A non-transitory computer-readable medium according to any one of clauses 61 to 72, wherein the computer executable instructions that, when executed by the mobile device, cause the mobile device to perform mitigation actions include computer executable instructions that, when executed by the mobile device, cause the mobile device to perform the following processing: identifying contaminants as scratches; and performing a self-healing process to mitigate the scratches.

[0131] Clause 74. The non-transitory computer-readable medium of clause 73, wherein the self-healing process comprises using at least one of heat, light, or electrical current to mitigate the scratch.

[0132] Clause 75. The non-transitory computer-readable medium of clause 74, wherein the self-healing process is limited to the contaminant region.

[0133] Clause 76. The non-transitory computer-readable medium of any of Clauses 61 to 75, wherein the display is a rollable display, and performing the mitigating action further comprises: preventing the display from rolling up.

[0134] Clause 77. The non-transitory computer-readable medium of any of Clauses 61 to 76, wherein the mitigation action for mitigation is limited to a contaminant region including the contaminant.

[0135] Clause 78. A non-transitory computer-readable medium according to any of clauses 61 to 77, wherein the computer executable instructions that, when executed by the mobile device, cause the mobile device to identify a contaminant include computer executable instructions that, when executed by the mobile device, cause the mobile device to identify the contaminant as a solid, a liquid, or a scratch.

[0136] Clause 79. The non-transitory computer-readable medium of clause 78, wherein the computer-executable instructions that, when executed by the mobile device, cause the mobile device to identify contaminants include computer-executable instructions that, when executed by the mobile device, cause the mobile device to perform the following processing: using a neural network trained to identify contaminants.

[0137] Clause 80. A non-transitory computer-readable medium according to any one of clauses 78 to 79, wherein the computer executable instructions that, when executed by the mobile device, cause the mobile device to identify a contaminant include computer executable instructions that, when executed by the mobile device, cause the mobile device to perform the following processing: identifying the contaminant as weak or strong based on the time when the contaminant is identified.

[0138] Those skilled in the art will recognize that information and signals may be represented using any of a variety of different technologies and techniques. For example, data, instructions, commands, information, signals, bits, symbols, and chips that may be referenced throughout the above description may be represented by voltages, currents, electromagnetic waves, magnetic fields or particles, optical fields or particles, or any combination thereof.

[0139] In addition, those skilled in the art will recognize that the various illustrative logic blocks, modules, circuits, and algorithmic steps described in conjunction with the various aspects disclosed herein can be implemented as electronic hardware, computer software, or a combination of the two. In order to clearly illustrate this interchangeability of hardware and software, various illustrative components, blocks, modules, circuits, and steps have been generally described above with respect to their functions. Whether such functions are implemented as hardware or software depends on the specific application and the design constraints imposed on the entire system. Those skilled in the art may implement the described functions in different ways for each specific application, but such implementation decisions should not be interpreted as resulting in a departure from the scope of the present disclosure.

[0140] The various illustrative logical blocks, modules, and circuits described in conjunction with the various aspects disclosed herein may be implemented or performed using a general purpose processor, a DSP, an ASIC, an FPGA, or other programmable logic device, discrete gate or transistor logic, discrete hardware components, or any combination thereof designed to perform the functions described herein. A general purpose processor may be a microprocessor, but in an alternative, the processor may be any conventional processor, controller, microcontroller, or state machine. The processor may also be implemented as a combination of computing devices, for example, a combination of a DSP and a microprocessor, a plurality of microprocessors, a combination of one or more microprocessors and a DSP core, or any other such configuration.

[0141] The methods, sequences and / or algorithms described in conjunction with the various aspects disclosed herein may be embodied directly in hardware, in a software module executed by a processor, or in a combination of the two. The software module may reside in a random access memory (RAM), a flash memory, a read-only memory (ROM), an erasable programmable ROM (EPROM), an electrically erasable programmable ROM (EEPROM), a register, a hard disk, a removable disk, a CD-ROM, or any other form of storage medium known in the art. An example storage medium is coupled to a processor so that the processor can read information from the storage medium and write information to the storage medium. In an alternative, the storage medium may be integrated into the processor. The processor and the storage medium may reside in an ASIC. The ASIC may reside in a user terminal (e.g., UE). In an alternative, the processor and the storage medium may reside in a user terminal as discrete components.

[0142] In one or more example aspects, the functions described can be implemented in hardware, software, firmware, or any combination thereof. If implemented in software, the functions can be stored on a computer-readable medium or transmitted via a computer-readable medium as one or more instructions or codes. Computer-readable media include both computer storage media and communication media, and communication media include any media that helps to transfer a computer program from one place to another. Storage media can be any available media that can be accessed by a computer. As an example and not a limitation, such computer-readable media can include RAM, ROM, EEPROM, CD-ROM or other optical disk storage devices, magnetic disk storage devices or other magnetic storage devices, or any other media that can be used to carry or store the desired program code in the form of instructions or data structures and can be accessed by a computer. In addition, any connection is appropriately referred to as a computer-readable medium. For example, if the software is sent from a website, server, or other remote source using a coaxial cable, fiber optic cable, twisted pair, digital subscriber line (DSL), or wireless technology (such as infrared, radio, and microwave), the coaxial cable, fiber optic cable, twisted pair, DSL, or wireless technology (such as infrared, radio, and microwave) is included in the definition of the medium. As used herein, disk and disc include compact disc (CD), laser disc, optical disc, digital versatile disc (DVD), floppy disk and Blu-ray disc, where disks usually reproduce data magnetically, while discs reproduce data optically with lasers. Combinations of the above should also be included within the scope of computer-readable media.

[0143] Although the foregoing disclosure shows the illustrative aspects of the present disclosure, it should be noted that various changes and modifications can be made herein without departing from the scope of the present disclosure as defined by the appended claims. The functions, steps and / or actions of the method claims according to the various aspects of the present disclosure described herein do not need to be performed in any particular order. In addition, although the elements of the present disclosure can be described or claimed in singular form, plural forms are covered unless explicitly stated to be limited to the singular form.

Claims

1. A method for mitigating contaminants on a display, the method comprising: scanning the display; generating one or more images associated with the contaminant based on the scan; detecting the contaminant on the display based on the one or more images; identifying the contaminant on the display using the one or more images; as well as Mitigation actions are performed based on the identification of the contaminant to mitigate the contaminant.

2. The method according to claim 1, wherein: Scanning the display further comprises: The display is scanned using an ultrasound scanner.

3. The method according to claim 2, further comprising: The frequency of ultrasound pulses used by the ultrasound scanner is varied to generate the one or more images.

4. The method according to claim 2, further comprising: The range gate delay of the ultrasound scanner is varied to generate images.

5. The method according to claim 2, wherein: The ultrasonic scanner is an ultrasonic full-screen fingerprint sensor.

6. The method according to claim 1, wherein: Mitigation actions include: A user interface (UI) window including a mitigation message is displayed.

7. The method according to claim 6, wherein: The mitigation message includes text identifying the contaminant.

8. The method according to claim 6, wherein: The mitigation message includes instructions to mitigate the contaminant.

9. The method according to claim 6, further comprising: A pollutant region is highlighted on the display, wherein the pollutant region contains the pollutant.

10. The method according to claim 1, further comprising: receiving confirmation that the mitigation action was completed; as well as Rescan the display in the area of ​​the contamination to confirm that the contamination is mitigated.

11. The method according to claim 10, wherein: Receiving the confirmation further comprises: Input is received from a user indicating that the mitigation action is completed.

12. The method according to claim 10, wherein: Receiving the confirmation further comprises: Receive a completion indication from an automatic mitigation action.

13. The method according to claim 1, wherein: Performing mitigation actions also includes: identifying the contaminant as a scratch; and A self-healing process is performed to relieve the scratches.

14. The method according to claim 13, wherein: The self-healing process includes using at least one of heat, light, or electrical current to relieve the scratch.

15. The method according to claim 14, wherein: The self-healing process is limited to the contaminated area.

16. The method according to claim 1, wherein: The display is a scrollable display, and performing the mitigation action further comprises: The display is prevented from being rolled up.

17. The method according to claim 1, wherein: The mitigation action for mitigation is limited to a pollutant region including the pollutant.

18. The method according to claim 1, wherein: Identifying the contaminant includes identifying the contaminant as a solid, a liquid, or a scratch.

19. The method according to claim 18, wherein: Identifying the contaminants may also include: Use a neural network trained to identify pollutants.

20. The method according to claim 18, wherein: Identifying the contaminants may also include: The contaminant is identified as weak or strong based on the time at which the contaminant is identified.

21. A mobile device, comprising: Ultrasound scanner; Memory; as well as at least one processor communicatively coupled to the memory and the ultrasound scanner and configured to mitigate contaminants on a display, the at least one processor, memory, and ultrasound scanner cooperatively configured to: scanning the display; generating one or more images associated with the contaminant based on the scan; detecting the contaminant on the display based on the one or more images; identifying the contaminant on the display using the one or more images; and Mitigation actions are performed based on the identification of the contaminant to mitigate the contaminant.

22. The mobile device according to claim 21, wherein: The at least one processor configured to scan the display includes at least one processor configured to: The display is scanned using the ultrasound scanner.

23. The mobile device of claim 22, wherein: The ultrasonic scanner is an ultrasonic full-screen fingerprint sensor.

24. The mobile device of claim 21, wherein: The at least one processor is further configured to: receiving confirmation that the mitigation action was completed; and The display is rescanned in the area of ​​contamination to confirm that the contamination is mitigated.

25. A mobile device configured to mitigate contaminants on a display, comprising: means for scanning said display; means for generating one or more images associated with the contaminant based on the scan; means for detecting the contaminant on the display based on the one or more images; means for identifying the contaminant on the display using the one or more images; as well as Means for performing a mitigation action to mitigate the contaminant based on the identification of the contaminant.

26. The mobile device of claim 25, wherein: The means for scanning the display also includes an ultrasound scanner.

27. The mobile device of claim 26, wherein: The ultrasonic scanner is an ultrasonic full-screen fingerprint sensor.

28. A non-transitory computer-readable medium storing computer-executable instructions configured to mitigate contaminants on a display, the computer-executable instructions, when executed by a mobile device, causing the mobile device to: scanning the display; generating one or more images associated with the contaminant based on the scan; detecting the contaminant on the display based on the one or more images; identifying the contaminant on the display using the one or more images; as well as Mitigation actions are performed based on the identification of the contaminant to mitigate the contaminant.

29. The non-transitory computer readable medium of claim 28, wherein: The computer executable instructions that, when executed by the mobile device, cause the mobile device to scan the display include computer executable instructions that, when executed by the mobile device, cause the mobile device to scan the display using an ultrasound scanner.

30. The non-transitory computer readable medium of claim 29, wherein: The ultrasonic scanner is an ultrasonic full-screen fingerprint sensor.

Images