Defect detection method and device, terminal and storage medium

Abstract

The present disclosure relates to a defect detection method and apparatus, a terminal, and a storage medium. The defect detection method comprises: controlling an ultrasonic wave generator to transmit ultrasonic waves toward a screen assembly; the screen assembly comprises: a screen and / or a transparent cover plate covering the screen; detecting an echo of the ultrasonic wave to obtain echo information; and determining whether the screen assembly has a defect based on the echo information.

Description

Technical Field

[0001] The present disclosure relates to the field of display technology, and in particular to a defect detection method and device, a terminal, and a storage medium. Background Art

[0002] The display is a crucial component in mobile devices. It displays the system interface and application interfaces, among other things. Therefore, prior to assembly, the display must be inspected for various defects to ensure that the display incorporated into the mobile device meets quality requirements.

[0003] For example, defect detection of a display screen generally uses electrical performance testing or a charge-coupled device (CCD) to capture optical images and perform detection based on the captured images.

[0004] Screen defect detection in related technologies needs to be performed in a specific detection environment. Summary of the Invention

[0005] The present disclosure provides a defect detection method and device, a terminal, and a storage medium.

[0006] A first aspect of an embodiment of the present disclosure provides a defect detection method, which is applied to a terminal, wherein the terminal is provided with a screen assembly and an ultrasonic emitting device located below the screen assembly, including:

[0007] Controlling the ultrasonic wave generating device to transmit ultrasonic waves toward the screen assembly; the screen assembly includes: a screen and / or a transparent cover plate covering the screen;

[0008] detecting an echo of the ultrasonic wave to obtain echo information;

[0009] It is determined whether the screen assembly has defects based on the echo information.

[0010] Based on the above solution, the detecting the ultrasonic echo to obtain echo information includes: detecting the ultrasonic echo to generate an echo image;

[0011] The determining whether the screen assembly has a defect according to the echo information includes: determining whether the screen assembly has a defect according to the echo image.

[0012] Based on the above solution, the terminal is further provided with an ultrasonic receiving device located below the screen assembly, and the ultrasonic receiving device is used to receive the echo and form the echo image.

[0013] Based on the above solution, the ultrasonic receiving device is a thin film transistor TFT.

[0014] Based on the above solution, the method further includes:

[0015] Determine defect parameters of the defect based on the echo information, wherein the defect parameters include at least one of the following: defect shape; defect width; defect depth; defect position; and defect length.

[0016] Based on the above solution, the echo is received by an ultrasonic receiving device, and the determination of whether the screen has a defect based on the echo information includes:

[0017] determining the energy distribution of the echo on the receiving surface of the ultrasonic receiving device according to the echo information;

[0018] Based on the energy distribution, determining whether there is an area on the receiving surface where the echo energy meets a preset condition;

[0019] If there is an area where the echo energy meets the preset condition, it is determined that the screen assembly has a defect.

[0020] Based on the above solution, determining whether there is an area on the receiving surface where the echo energy meets a preset condition based on the energy distribution includes:

[0021] determining, based on the energy distribution, whether there is an area on the receiving surface where the ratio between the echo energy and the transmitted energy of the ultrasonic wave is greater than a ratio threshold;

[0022] If there is an area where the ratio between the echo energy and the transmission energy is greater than the ratio threshold, it is determined that there is an area on the receiving surface where the echo energy meets the preset condition.

[0023] Based on the above solution, the method further includes:

[0024] Before or when the ultrasonic wave is emitted, a first prompt message is output, wherein the first prompt message is used to prompt the user to stop touching the screen component.

[0025] Based on the above solution, the method further includes:

[0026] When it is determined that the screen assembly has a defect, second prompt information is output; wherein the second prompt information is used to prompt that the screen assembly has a defect.

[0027] Based on the above solution, determining whether the screen assembly has a defect according to the echo information includes:

[0028] After detecting a turn-on operation for indicating that a defect detection function is turned on, determining whether the screen assembly has a defect based on the echo information.

[0029] Based on the above scheme, determining whether the screen assembly is defective according to the echo information includes: when the terminal is in the first working mode, determining whether the screen assembly is defective according to the echo information; and / or, the method also includes: when the terminal is in the second working mode, determining the fingerprint information above the screen assembly according to the echo information.

[0030] A second aspect of an embodiment of the present disclosure provides a defect detection device, which is applied to a terminal. The terminal is provided with a screen assembly and an ultrasonic emitting device located below the screen assembly. The device includes:

[0031] A transmitting module, configured to control the ultrasonic wave generating device to transmit ultrasonic waves toward the screen assembly; the screen assembly comprises: a screen and / or a transparent cover plate covering the screen;

[0032] A detection module, configured to detect the ultrasonic echo and obtain echo information;

[0033] A determination module is used to determine whether the screen assembly has a defect based on the echo information.

[0034] Based on the above solution, the detection module is used to detect the echo of the ultrasonic wave and generate an echo image;

[0035] The determination module is used to determine whether the screen component is defective based on the echo image.

[0036] Based on the above solution, the terminal is further provided with an ultrasonic receiving device located below the screen assembly, and the ultrasonic receiving device is used to receive the echo and form the echo image.

[0037] Based on the above solution, the ultrasonic receiving device is a thin film transistor TFT.

[0038] Based on the above solution, the determination module is further configured to determine defect parameters of the defect based on the echo information, wherein the defect parameters include at least one of the following:

[0039] Defect shape;

[0040] Defect width;

[0041] Defect depth;

[0042] Defect location;

[0043] Defect length.

[0044] Based on the above scheme, the echo is received by an ultrasonic receiving device, and the determination module is used to determine the energy distribution of the echo on the receiving surface of the ultrasonic receiving device according to the echo information; based on the energy distribution, it is determined whether there is an area on the receiving surface where the echo energy meets the preset conditions; if there is an area where the echo energy meets the preset conditions, it is determined that the screen assembly has a defect.

[0045] Based on the above solution, the determination module is used to determine, based on the energy distribution, whether there is an area on the receiving surface where the ratio between the echo energy and the transmitted energy of the ultrasonic wave is greater than a ratio threshold;

[0046] If there is an area where the ratio between the echo energy and the transmission energy is greater than the ratio threshold, it is determined that there is an area on the receiving surface where the echo energy meets the preset condition.

[0047] Based on the above solution, the device further includes:

[0048] The first prompt module is used to output a first prompt message before or when the ultrasonic wave is emitted, wherein the first prompt message is used to prompt to stop touching the screen component.

[0049] Based on the above solution, the device further includes:

[0050] The second prompt module is used to output second prompt information when it is determined that the screen component has a defect, wherein the second prompt information is used to prompt that the screen component has a defect.

[0051] Based on the above solution, the determination module is used to determine whether the screen assembly has a defect according to the echo information after detecting the start operation for indicating that the defect detection function is turned on.

[0052] Based on the above solution, the determining module is used to determine whether the screen assembly has a defect according to the echo information when the terminal is in the first working mode; and / or

[0053] The device further comprises:

[0054] The fingerprint module is used to determine the fingerprint information above the screen assembly according to the echo information when the terminal is in the second working mode.

[0055] According to a third aspect of an embodiment of the present disclosure, there is provided a mobile terminal, including:

[0056] a memory for storing processor-executable instructions;

[0057] a processor connected to the memory;

[0058] The processor is configured to execute the defect detection method described above.

[0059] According to a fourth aspect of an embodiment of the present disclosure, a non-transitory computer-readable storage medium is provided. When instructions in the storage medium are executed by a processor of a computer, the computer is enabled to perform the defect detection method as described above.

[0060] The technical solutions provided by the embodiments of the present disclosure may have the following beneficial effects:

[0061] In the disclosed embodiments, ultrasound is used to detect cracks and other defects in the screen assembly. This allows the reuse of the ultrasonic transmitter within the terminal, thus breaking the limitation of requiring detection under specific testing conditions and enabling the inspection of the screen assembly while the terminal is in use. Furthermore, the use of ultrasound for detection, based on ultrasonic echo detection, allows for highly accurate detection of cracks in the screen assembly, resulting in high detection accuracy. BRIEF DESCRIPTION OF THE DRAWINGS

[0062] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and, together with the description, serve to explain the principles of the present disclosure.

[0063] Figure 1 is a flowchart of a defect detection method according to an exemplary embodiment;

[0064] Figure 2 is a schematic diagram of fingerprint detection according to an exemplary embodiment;

[0065] Figure 3 is a schematic diagram showing defect detection according to an exemplary embodiment;

[0066] Figure 4 is a flowchart of a defect detection method according to an exemplary embodiment;

[0067] Figure 5 is a flowchart of a defect detection method according to an exemplary embodiment;

[0068] Figure 6 is a schematic structural diagram of a terminal according to an exemplary embodiment;

[0069] Figure 7 is a schematic structural diagram of a defect detection device according to an exemplary embodiment;

[0070] Figure 8 It is a schematic structural diagram of a terminal according to an exemplary embodiment. DETAILED DESCRIPTION

[0071] Exemplary embodiments will be described in detail herein, examples of which are illustrated in the accompanying drawings. In the following description, when referring to the drawings, identical numerals in different figures represent identical or similar elements unless otherwise indicated. The embodiments described in the following exemplary embodiments are not intended to represent all embodiments consistent with the present disclosure. Rather, they are merely examples of devices consistent with certain aspects of the present disclosure, as detailed in the appended claims.

[0072] like Figure 1 As shown, an embodiment of the present disclosure provides a defect detection method, which is applied to a terminal, wherein the terminal is provided with a screen assembly and an ultrasonic emitting device located below the screen assembly, and the method includes:

[0073] S110: Control the ultrasonic wave generating device to transmit ultrasonic waves toward the screen assembly; the screen assembly includes: a screen and / or a transparent cover covering the screen;

[0074] S120: Detecting the ultrasonic echo to obtain echo information;

[0075] S130: Determine whether the screen assembly has defects based on the echo information.

[0076] In the embodiment of the present disclosure, the defects of the screen assembly that can be detected may include at least but not limited to: cracks and / or pores.

[0077] The defect detection method provided by the embodiments of the present disclosure is applicable to various types of terminals, including but not limited to fixed terminals and mobile terminals.

[0078] Fixed terminals include desktop computers or large-screen display devices. For example, large-screen display devices include smart TVs and / or projection devices.

[0079] The mobile terminal includes but is not limited to: a mobile phone, a tablet computer, a wearable device, a vehicle-mounted device or an Internet of Things terminal. The Internet of Things terminal includes but is not limited to: smart home devices and / or smart office devices.

[0080] The terminal provided by the embodiment of the present disclosure may be a terminal having a screen assembly and an ultrasonic transmitter. The ultrasonic transmitter is located at the bottom of the screen assembly. The terminal is provided with a screen assembly and an ultrasonic transmitting device located below the screen assembly. The screen may include: a touch screen and a non-touch screen; the touch screen includes: a display screen and a touch panel stacked with the display screen; the touch screen can detect touch operations acting on the touch screen through the touch panel. The non-touch screen may include a display screen, does not include a touch panel stacked with the display screen, and cannot detect touch operations acting on the display screen. Typical touch screens may include: an organic light emitting diode (OLED) touch screen or a liquid crystal touch screen.

[0081] In some embodiments, a transparent cover plate is further stacked on the screen to protect the screen. The transparent cover plate may be a glass cover plate (Cover Glass, CG) but is not limited to a glass cover plate.

[0082] In some embodiments, the transparent cover may further include a plastic cover.

[0083] In the disclosed embodiments, the screen assembly includes a screen and / or a transparent cover plate covering the screen surface. Optionally, the screen assembly may be any module comprising glass. For example, the screen may include a glass substrate. The transparent cover plate may be a glass plate with relatively good anti-slip properties.

[0084] The ultrasonic transmitter may be any ultrasonic transmitter located at the bottom of the screen assembly, capable of transmitting ultrasonic waves toward the screen assembly. In a terminal, the ultrasonic transmitter may be located below the screen. For example, the ultrasonic transmitter may be against the back of the touch screen.

[0085] In some embodiments, the ultrasonic transmitter within the terminal can be used for gesture detection or for detecting the distance and / or outline of an object captured by the front camera during photography. The ultrasonic transmitter used in the disclosed embodiments can be a reused ultrasonic transmitter originally used for other functions within the terminal, or it can be a dedicated ultrasonic transmitter specifically introduced to address defects in the screen and / or transparent cover. This is merely an example, and the specific implementation is not limited to this.

[0086] In some embodiments, the terminal may include a fingerprint module. The fingerprint module includes an ultrasonic transmitter and an image sensor for detecting ultrasonic waves. The ultrasonic transmitter transmits ultrasonic waves, and the image sensor detects ultrasonic waves returned by the ultrasonic waves (i.e., echoes) and generates an echo image.

[0087] If the screen and / or transparent cover has cracks or pores, there will be air in the cracks or pores. This will increase the number of echoes generated by the air reflected from the ultrasonic waves emitted at the corresponding location, resulting in greater echo energy at the corresponding location. If the screen or transparent cover has no cracks, that is, there is no air in the cracks or pores to reflect the ultrasonic waves, the ultrasonic waves will be more absorbed by the screen and / or transparent cover. In view of this, in step S130, the screen assembly can be detected for defects based on the echo information.

[0088] In one embodiment, if an ultrasonic sensor located below the screen is used to transmit ultrasonic waves for defect detection, since a transparent cover is superimposed on the screen, it is necessary to accurately determine whether the defect is located on the screen or the transparent cover. This can be achieved by controlling the ultrasonic transmission power. For example, if the current screen component is the screen, the ultrasonic transmission power is a first power; if the current screen component is the transparent cover, the ultrasonic transmission power is a second power, where the first power is lower than the second power. This power control can not only locate the screen component where the defect is located, but also save excessive power consumption caused by excessive ultrasonic transmission power.

[0089] like Figure 2 Figure 1 shows a schematic diagram of a fingerprint module detecting a fingerprint. The fingerprint on the surface of the finger is composed of the skin protrusions (i.e., the ridges of the fingerprint) and the depressions between the protrusions (i.e., the valleys of the fingerprint). Figure 2 The ridges of the fingerprint are shown at B, and the valleys of the fingerprint are shown at A. There are tiny spaces between the valleys of the fingerprint and the screen surface. These tiny spaces contain air, which acts as a transmission medium for ultrasonic waves and returns them.

[0090] exist Figure 2 In the fingerprint sensor, the Ag conductive layer can be a component of the thin film transistor (TFT) in the fingerprint transmitter. When AC is applied between the TFT and the Ag conductive layer, the piezoelectric material located between the TFT and the Ag conductive layer senses the voltage change generated by the AC, causing it to expand and contract, emitting ultrasonic waves. If the ultrasonic waves return, they will act on the TFT, causing the TFT to sense echo energy of varying strengths, forming corresponding texture signals, thereby generating an echo image. Figure 2 The conductive foam or conductive ink in the device can absorb the echo, reducing its continued propagation so that ultrasonic waves can also be transmitted from the back of the terminal.

[0091] Figure 2 The screen in the phone is a flexible OLED screen.

[0092] Based on the same principle, if there are gaps or holes in the screen and / or glass cover, the space in the environment will enter the gaps or holes, so that the ultrasonic waves are not absorbed but reflected during the transmission process. In this way, the echo information obtained by echo detection can be used to detect whether the screen and / or transparent cover has defects such as cracks and / or holes.

[0093] refer to Figure 3 As shown, if there are defects such as gaps or pores in the screen, air will be introduced into these defects. For example, see Figure 3 Point B in the figure shows a crack; point A is the screen without a crack. Applying alternating current to the piezoelectric material to transmit ultrasonic waves creates more echoes at point B; however, much of the ultrasonic waves emitted at point A are absorbed by the screen and / or the transparent cover itself.

[0094] pass Figure 2 and Figure 3 The module shown in the figure performs ultrasonic emission and echo detection. An alternating current with a frequency of 13 to 18 MHz can be applied between the Ag conductive layer and the TFT, causing the piezoelectric material to expand and contract based on the changing electric field and emit ultrasonic waves.

[0095] In one embodiment, the S120 may include: detecting the echo of the ultrasonic wave and generating an echo image;

[0096] The S120 may include: determining whether the screen component has a defect according to the echo image.

[0097] If the screen and / or transparent cover has defects such as cracks and / or pores, an image different from that at locations without defects will be formed on the echo image. For example, if position A on the echo image corresponds to a defective area of the screen component, and position B on the echo image corresponds to a non-defective area of the screen component, then position A and position B correspond to different textures and / or grayscales. In this way, by using an image analysis algorithm, it is possible to extract image features from different areas of the image and match them with image features of defects and / or non-defective areas to determine whether the screen component has defects. The image analysis algorithms herein include, but are not limited to, neural network-based image analysis algorithms. For example, the echo image is input into a trained neural network capable of detecting defects such as cracks, and the neural network can output a judgment as to whether the screen component has defects.

[0098] In another embodiment, some neural networks may also output some defect parameters of the defect.

[0099] Of course, a specific implementation method is provided here in which the echo information is an echo image, and whether there is a defect on the screen component is determined by detecting the echo image, but the specific implementation is not limited to this.

[0100] In one embodiment, the terminal is further provided with an ultrasonic receiving device located below the screen assembly, and the ultrasonic receiving device is used to receive the echo and form the echo image.

[0101] Exemplarily, the ultrasonic receiving device is a thin film transistor (TFT).

[0102] For example, the ultrasonic receiving device includes a TFT array composed of a plurality of TFTs, the TFT array forms an echo receiving surface, and generates the echo image based on the received echo energy.

[0103] like Figure 4 As shown, the method further includes:

[0104] S140: Determine defect parameters of the defect based on the echo information, wherein the defect parameters include at least one of the following: defect shape; defect width; defect depth; defect position; and defect length.

[0105] Defect parameters can display different attributes of a defect. For example, if the defect is a crack, the defect parameters of the crack can indicate at least one of the following:

[0106] Crack shape, including but not limited to: a single crack without bifurcation, a branch-like crack with bifurcation;

[0107] A crack width, where the crack width refers to a width in a first direction parallel to a tiling plane of the screen or transparent cover;

[0108] Crack depth refers to the length of the crack in the vertical direction of the flat surface of the screen or transparent cover;

[0109] The crack length refers to the width in a second direction within the tiling plane of the screen or transparent cover, where the second direction is perpendicular to the first direction;

[0110] The crack position indicates that the crack is located on the screen and / or the transparent cover, and can further indicate: the specific position of the crack on the screen and / or the transparent cover.

[0111] Taking the defect as a pore as an example, the defect parameter of the pore may indicate at least one of the following: the position of the pore; the shape of the pore; the inner diameter of the pore, etc.

[0112] Of course, the above is only an example. In a specific implementation, the defect parameter may be a parameter that describes any attribute of the defect in the spatial structure.

[0113] Thus, in the embodiment of the present disclosure, based on the analysis of the echo image, not only can it be detected whether there are defects on the screen and / or transparent cover, but also many parameter attributes of the defects can be detected to facilitate subsequent terminal maintenance and / or grade determination.

[0114] In some embodiments, as Figure 4 As shown, the S130 may include:

[0115] S131: Determine the energy distribution of the echo on the receiving surface of the ultrasonic receiving device according to the echo information;

[0116] S132: Determine, based on the energy distribution, whether there is an area on the receiving surface where the echo energy meets a preset condition;

[0117] S133: If there is an area where the echo energy meets the preset condition, it is determined that the screen assembly has a defect.

[0118] In one embodiment, the energy distribution may specifically indicate: echo energy values received in different areas.

[0119] In one embodiment, if an echo image is generated, the image reflecting the echo energy can be analyzed to find an area that meets the preset conditions. If an area that meets the preset conditions is found, it can be considered that there is a defect on the screen assembly.

[0120] In another embodiment, the terminal may further include: an ultrasonic receiver, which directly receives ultrasonic waves and can directly determine the value of echo energy instead of generating an echo image.

[0121] It can be understood that the S132 may include:

[0122] determining, based on the energy distribution, whether there is an area on the receiving surface where the ratio between the echo energy and the transmitted energy of the ultrasonic wave is greater than a ratio threshold;

[0123] If there is an area where the ratio between the echo energy and the transmission energy is greater than the ratio threshold, it is determined that there is an area on the receiving surface where the echo energy meets the preset condition.

[0124] If an ultrasonic receiver is used to receive echoes and detect the echo energy, the screen assembly can be inspected for defects. In one optional method, the ultrasonic emission energy is recorded and the echo energy is detected. The ratio of the echo energy to the emission energy is calculated, and the screen assembly defect is determined based on the space where the ratio lies. For example, if the ratio is greater than 80%, the screen assembly is considered defective, while if the ratio is less than 80%, the screen assembly is considered not defective.

[0125] The ratio threshold may be an experimental value determined by experiments, or may be a value based on statistics of echo energy and emission energy detected when defects such as cracks exist.

[0126] For example, as described above, the ratio threshold may be 80%, 70%, or 85%.

[0127] When using this method to detect defects in screen components, the screen components can be layered into multiple areas within their tiled plane, and defect detection can be performed based on the areas. This method can also locate the location of the defect.

[0128] Of course, defect parameters of the defect, such as the shape, length and / or width of the defect, may also be estimated based on the specific size of the ratio.

[0129] For example, if the area corresponding to 9 or 16 adjacent pixels on the screen is regarded as one region, a certain shape can be determined according to the ratio of the adjacent regions. Of course, it is also possible to locate the defect position with relatively high accuracy.

[0130] In one embodiment, Figure 2 As shown, the method further includes:

[0131] S100: before emitting the ultrasonic wave or when emitting the ultrasonic wave, outputting a first prompt message, wherein the first prompt message is used to prompt to stop touching the screen component.

[0132] In order to reduce the possibility of users touching the screen and thus causing interference in defect detection with fingers, etc., in the embodiment of the present disclosure, a first prompt message is output.

[0133] The outputting of the first prompt information may include:

[0134] Display the first prompt information, for example, control a display screen to display the first prompt information;

[0135] The first prompt information is outputted by voice, for example, the voice of the first prompt information is outputted through a speaker or earphone.

[0136] For example, when performing defect detection on the screen component, the display screen enters a full-screen display state or an always on display (AOD) display state, and displays the first prompt information.

[0137] In some embodiments, in order to ensure that the condition of the screen and / or transparent cover of the terminal in use is understood, for example, during the use of the terminal, cracks and other defects may occur due to falling or collision, the defect detection method provided by the embodiment of the present disclosure can be performed regularly or irregularly to perform detection. For example, every week or month, the terminal automatically starts ultrasonic-based screen and / or transparent cover defect detection. For another example, ultrasonic-based defect detection is started based on user input. During the use of the terminal, the user may drop or collide with the terminal. Perhaps the user cannot see from the appearance that the screen and / or glass cover of the terminal have defects such as cracks caused by falling and / or collision. In this case, the terminal can be triggered to perform ultrasonic-based defect detection through input operation.

[0138] In one embodiment, the method further comprises:

[0139] When it is determined that the screen component has a defect, a second prompt message is output. The second prompt message is used to prompt that the screen component has a defect.

[0140] If the screen component is detected to have a defect, a second prompt message is output through the display screen or the audio module. If the screen is detected to have a defect, the second prompt message can be output to prompt the user to repair it in time.

[0141] In addition, if the terminal has not yet been shipped, the manufacturer can be prompted to promptly intercept terminals with defective screen components such as screens and / or transparent covers from being shipped.

[0142] Of course, in some embodiments, the method further includes:

[0143] Classifying the severity of the defect according to the defect parameters of the defect;

[0144] Output the severity level information of the defect.

[0145] This grade information can be used by manufacturers to determine whether screen components such as the screen and / or transparent cover need to be replaced. If there is a defect but the defect has very little impact on use, the severity level is determined to be low (i.e., a minor defect). The manufacturer can reduce the quality level of the terminal by lowering the quality level of the terminal, or by disassembling the screen and / or cover and assembling it on a terminal with lower quality level requirements, so as to enable the continued use of the screen and / or transparent cover with minor defects and reduce unnecessary scrapping.

[0146] In some embodiments, if the current terminal is a terminal with a reduced quality level or low quality, then during factory use, the ultrasonic-based defect detection method provided by the embodiment of the present disclosure is used. When a defect is detected before leaving the factory, the defect is ignored, that is, at least the second prompt information will not be output.

[0147] For example, during periodic inspection, it is only necessary to inspect the positions of the screen and / or transparent cover where defects are likely to occur during use of the terminal. For example, periodic inspection is performed on the four corners of the screen.

[0148] In some embodiments, S130 may include: after detecting a turn-on operation for indicating that a defect detection function is turned on, determining whether the screen assembly has a defect according to the echo information.

[0149] That is, the method further includes: after detecting the activation operation of the detection function, activating the defect detection function; wherein the ultrasonic wave used for detection is emitted after the defect detection function is activated;

[0150] After completing the detection, the defect detection function is turned off.

[0151] Since continuous detection will increase the power consumption of the terminal, in the embodiment of the present disclosure, the detection function will not be turned on until the activation operation of the defect detection function is detected. After the detection function is turned on, the ultrasonic transmitter emits ultrasonic waves to perform defect detection of screen components such as the screen and / or transparent cover. After the detection is completed, the detection function is automatically turned off. After the defect detection function is turned off, the ultrasonic transmitter will stop emitting ultrasonic waves, and the sensor that detects echo information will also stop detecting echo information, thereby saving power consumption of the terminal.

[0152] In one embodiment, the terminal has a setting page, and the setting page has a virtual control for turning on or off the defect detection function.

[0153] Of course, in another embodiment, the terminal may have some physical buttons, such as a volume adjustment button and / or a power switch, etc. The activation operation of the activation detection function may act on one or more physical buttons at the same time.

[0154] In one embodiment, the terminal includes a fingerprint module located below the screen, and the fingerprint module has multiple working modes.

[0155] The fingerprint module includes: an ultrasonic transmitter capable of emitting ultrasonic waves and a sensor for detecting echoes and generating echo images.

[0156] In one embodiment, the S130 includes: when the terminal is in the first working mode, determining whether the screen assembly has a defect according to the echo information;

[0157] It can be understood that the method further includes: when the terminal is in the second working mode, determining the fingerprint information above the screen assembly according to the echo information.

[0158] That is, in the second working mode, the fingerprint module performs the fingerprint detection function; in the first working mode, the fingerprint module performs the defect detection function.

[0159] The detection configurations for the fingerprint detection function and the defect detection function are different.

[0160] The detection configuration includes but is not limited to:

[0161] Ultrasonic transmission power;

[0162] How long does the ultrasonic emission last?

[0163] The emission range of ultrasonic waves.

[0164] For example, since the fingerprint detection module needs to produce a clear fingerprint image and the user's finger must be located on the cover of the terminal, the ultrasonic wave emitted by the ultrasonic transmitter may be absorbed by the screen, the transparent cover, and then transmitted to the surface of the finger in turn; therefore, the ultrasonic wave transmission power in the first working mode may be slightly greater than the transmission power when performing defect detection.

[0165] For another example, the ultrasonic emission range can cover the entire screen and / or the entire transparent cover area, but when performing fingerprint detection, the fingerprint icon can be displayed to inform the user of the fingerprint detection area. However, if the screen and / or transparent cover is fully inspected for defects, the ultrasonic emission range for defect detection is larger than the fingerprint detection range.

[0166] The present disclosure discloses a novel application of fingerprint detection using ultrasonic fingerprint detection. Figure 2 The valley where the ultrasonic wave encounters the fingerprint ( Figure 2 In the middle A area), more than 85% of the light will be reflected back due to the presence of air and received by the TFT; when encountering the ridges of the fingerprint ( Figure 2 Most of the fingerprint penetrates the finger, and only a small amount returns to the TFT; this will form a pattern signal of varying strengths on the TFT, i.e., the fingerprint image.

[0167] Ultrasonic waves have a reflectivity of over 85% when encountering air, so there cannot be any air in the screen. This property can be used to detect micro-cracks in the display screen and glass cover, allowing for fault elimination and early warning.

[0168] like Figure 3Even without finger pressure, a crack (B) in the screen receives ultrasonic waves, and most of the energy is reflected back. At point A, where there's no crack, some energy is absorbed during propagation, resulting in less energy being returned. This method can detect the shape of the crack, and if the signal is sufficient, image processing algorithms can be used to determine the crack's depth and width.

[0169] A switch can be set on the phone to detect screen defects and other defects mentioned above. During the screen and / or transparent cover defect detection, the user is reminded to avoid touching the display screen as this may affect the display quality. After defect detection is complete, the detection function is automatically turned off.

[0170] This solution has limited usage conditions and can only be used on mobile phones with full-screen ultrasonic fingerprints. The area of screen defects detected by single-point ultrasonic fingerprints or large-area ultrasonic fingerprints is too small, only the size of the ultrasonic fingerprint sensor area.

[0171] Figure 6 The terminal shown on the left has a full-screen ultrasonic function. Therefore, by using this full-screen ultrasonic function, it is possible to detect fine cracks on the screen and CG anytime and anywhere, screen out defective products, and reduce quality accidents.

[0172] Figure 6 The terminal shown on the right has a partial ultrasonic fingerprint. If the terminal only has a partial ultrasonic fingerprint, and the emission angle of the ultrasonic transmitter in the fingerprint module corresponding to the ultrasonic fingerprint is not adjustable, it can only detect defects such as cracks on the local screen and / or transparent cover. If the emission angle of the ultrasonic transmitter contained in the fingerprint module corresponding to the partial fingerprint detection can be changed, for example, by changing the emission angle, any position in the AA area of the terminal display can be scanned, then this partial fingerprint detection module can still be used for defect detection of the screen and / or transparent cover.

[0173] Develop screen defect detection functions using full-screen ultrasonic fingerprint technology to reduce production and testing costs.

[0174] like Figure 7 As shown, an embodiment of the present disclosure provides a defect detection device, which is applied to a terminal. The terminal is provided with a screen assembly and an ultrasonic emitting device located below the screen assembly; the device includes:

[0175] Transmitting module 710, used to control the ultrasonic wave generating device to transmit ultrasonic waves toward the screen assembly; screen assembly The screen assembly includes: a screen and / or a transparent cover covering the screen;

[0176] The detection module 720 is used to detect the ultrasonic echo and obtain echo information;

[0177] The determination module 730 is configured to determine whether the screen component has a defect based on the echo information.

[0178] In some embodiments, the transmitting module 710, the detecting module 720 and the determining module 730 may be program modules; after being executed by the processor, the program modules can realize ultrasonic emission, echo detection and defect determination.

[0179] In other embodiments, the transmitting module 710, the detecting module 720 and the determining module 730 may be soft-hard combination modules; the soft-hard combination modules include but are not limited to programmable arrays; programmable arrays include but are not limited to: field programmable arrays or complex programmable arrays.

[0180] In some other embodiments, the transmitting module 710, the detecting module 720 and the determining module 730 may be pure hardware modules; pure hardware modules include but are not limited to: application-specific integrated circuits.

[0181] In some embodiments, the detection module 720 is used to detect the echo of the ultrasonic wave and generate an echo image;

[0182] The determination module 730 is configured to determine whether the screen component is defective based on the echo image.

[0183] In one embodiment, the terminal is further provided with an ultrasonic receiving device located below the screen assembly, and the ultrasonic receiving device is used to receive the echo and form the echo image.

[0184] In one embodiment, the ultrasonic receiving device is a thin film transistor (TFT).

[0185] In some embodiments, the determination module 730 is further configured to determine defect parameters of the defect based on the echo information, wherein the defect parameters include at least one of the following:

[0186] Defect shape;

[0187] Defect width;

[0188] Defect depth;

[0189] Defect location;

[0190] Defect length.

[0191] In some embodiments, the determination module 730 is used to determine the energy distribution of the echo on the receiving surface of the ultrasonic receiving device based on the echo information; based on the energy distribution, determine whether there is an area on the receiving surface where the echo energy meets the preset conditions; if there is an area where the echo energy meets the preset conditions, it is determined that there is a defect in the screen assembly.

[0192] In some embodiments, the determination module 730 is used to determine whether there is an area on the receiving surface where the ratio between the echo energy and the ultrasonic emission energy is greater than a ratio threshold based on the energy distribution; if there is an area where the ratio between the echo energy and the emission energy is greater than the ratio threshold, it is determined that there is an area on the receiving surface where the echo energy meets the preset conditions.

[0193] In some embodiments, the apparatus further comprises:

[0194] The first prompt module is used to output a first prompt message before or when the ultrasonic wave is emitted, wherein the first prompt message is used to prompt to stop touching the screen component.

[0195] In some embodiments, the apparatus further comprises:

[0196] The second prompt module is used to output second prompt information when it is determined that the screen component has a defect, wherein the second prompt information is used to prompt that the screen component has a defect.

[0197] In some embodiments, the apparatus further comprises:

[0198] A startup module is used to start the defect detection function after detecting the start-up operation of the detection function; wherein the ultrasonic wave used for detection is emitted after the defect detection function is started; after completing the detection, the defect detection function is turned off.

[0199] The determination module is used to determine whether the screen assembly has a defect based on the echo information when the terminal is in the first working mode; and / or the device also includes: a fingerprint module, used to determine the fingerprint information above the screen assembly based on the echo information when the terminal is in the second working mode.

[0200] An embodiment of the present disclosure provides a terminal, including:

[0201] a memory for storing processor-executable instructions;

[0202] a processor, connected to the memory;

[0203] The processor is configured to execute the defect detection method provided by any of the aforementioned technical solutions.

[0204] The processor may include various types of storage media, which are non-transitory computer storage media that can continue to store information after the communication device loses power.

[0205] The terminal includes but is not limited to: a mobile terminal.

[0206] The processor can be connected to the memory through a bus, etc., and is used to read the executable program stored in the memory. For example, it can execute Figure 1 、 Figures 4 and 5 At least one of any of the methods shown.

[0207] Figure 8 FIG. 8 is a block diagram of a terminal 800 according to an exemplary embodiment. For example, the terminal 800 may be a mobile phone, a mobile computer, or the like.

[0208] Reference Figure 8 The terminal 800 may include one or more of the following components: a processing component 802 , a memory 804 , a power component 806 , a multimedia component 808 , an audio component 810 , an input / output (I / O) interface 812 , a sensor component 814 , and a communication component 816 .

[0209] The processing component 802 generally controls the overall operation of the terminal 800, such as operations associated with display, phone calls, data communications, camera operation, and recording operations. The processing component 802 may include one or more processors 820 to execute instructions to perform all or part of the steps of the above-described method. In addition, the processing component 802 may include one or more modules to facilitate interaction between the processing component 802 and other components. For example, the processing component 802 may include a multimedia module to facilitate interaction between the multimedia component 808 and the processing component 802.

[0210] The memory 804 is configured to store various types of data to support operations on the device 800. Examples of such data include instructions for any application or method operating on the terminal 800, contact data, phone book data, messages, pictures, videos, etc. The memory 804 can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic disk, or optical disk.

[0211] Power component 806 provides power to various components of terminal 800. Power component 806 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power to terminal 800.

[0212] The multimedia component 808 includes a screen that provides an output interface between the terminal 800 and the user. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touches, slides, and gestures on the touch panel. The touch sensor can not only sense the boundaries of a touch or slide action, but also detect the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 808 includes a front camera and / or a rear camera. When the device 800 is in an operating state, such as a shooting state or a video state, the front camera and / or the rear camera can receive external multimedia data. Each front camera and rear camera can be a fixed optical lens system or have focal length and optical zoom capabilities.

[0213] The audio component 810 is configured to output and / or input audio signals. For example, the audio component 810 includes a microphone (MIC), and when the terminal 800 is in an operating state, such as a call state, a recording state, and a voice recognition state, the microphone is configured to receive external audio signals. The received audio signal can be further stored in the memory 804 or transmitted via the communication component 816. In some embodiments, the audio component 810 also includes a speaker for outputting audio signals.

[0214] I / O interface 812 provides an interface between processing component 802 and peripheral interface modules, such as a keyboard, click wheel, buttons, etc. These buttons may include but are not limited to: a home button, volume buttons, a start button, and a lock button.

[0215] The sensor assembly 814 includes one or more sensors for providing various aspects of status assessment for the terminal 800. For example, the sensor assembly 814 can detect the open / closed state of the device 800, the relative positioning of components, such as the display and keypad of the terminal 800. The sensor assembly 814 can also detect changes in the position of the terminal 800 or a component of the terminal 800, the presence or absence of user contact with the terminal 800, the orientation or acceleration / deceleration of the terminal 800, and temperature changes of the terminal 800. The sensor assembly 814 may include a proximity sensor configured to detect the presence of nearby objects without any physical contact. The sensor assembly 814 may also include an optical sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 814 may also include an accelerometer, a gyroscope, a magnetic sensor, a pressure sensor, or a temperature sensor.

[0216] The communication component 816 is configured to facilitate wired or wireless communication between the terminal 800 and other devices. The terminal 800 can access a wireless network based on a communication standard, such as Wi-Fi, 2G or 3G, or a combination thereof. In an exemplary embodiment, the communication component 816 receives a broadcast signal or broadcast-related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 816 also includes a near field communication (NFC) module to facilitate short-range communication. For example, the NFC module can be implemented based on radio frequency identification (RFID) technology, infrared data association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology and other technologies.

[0217] In an exemplary embodiment, the terminal 800 may be implemented by one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), controllers, microcontrollers, microprocessors, or other electronic components to perform the above methods.

[0218] In an exemplary embodiment, a non-transitory computer-readable storage medium including instructions is also provided, such as a memory 804 including instructions, which can be executed by the processor 820 of the terminal 800 to perform the above method. For example, the non-transitory computer-readable storage medium can be a ROM, a random access memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, etc.

[0219] The present disclosure provides a non-transitory computer-readable storage medium. When the instructions in the storage medium are executed by a processor of a mobile terminal, the mobile terminal can execute the defect detection method provided by any of the above embodiments, and can execute the following steps: Figure 1、 Figures 4 and 5 At least one of any of the methods shown.

[0220] Other embodiments of the present disclosure will readily occur to those skilled in the art after considering the specification and practicing the invention disclosed herein. This disclosure is intended to cover any variations, uses, or adaptations of the present disclosure that follow the general principles of the present disclosure and include common knowledge or customary techniques in the art not disclosed herein. The description and examples are to be considered as exemplary only, with the true scope and spirit of the present disclosure being indicated by the following claims.

[0221] It should be understood that the present disclosure is not limited to the exact structures that have been described above and shown in the drawings, and that various modifications and changes can be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.

Claims

1. A defect detection method, characterized in that: Applied in a terminal, the terminal is provided with a screen assembly and a fingerprint module located below the screen assembly, the fingerprint module includes an ultrasonic emitting device, and the method includes: Controlling the ultrasonic emitting device to emit ultrasonic waves toward the screen assembly; the screen assembly includes: a screen and / or a transparent cover covering the screen; Based on the fingerprint module, detecting the ultrasonic echo to obtain echo information; determining whether the screen assembly has a defect based on the echo information; Determining whether the screen assembly is defective based on the echo information includes: determining whether the screen assembly is defective based on the echo information when the terminal is in a first operating mode; the echo information received in the first operating mode is used to reflect the difference in absorption and reflection of the transmitted ultrasonic wave by the screen assembly; The method further comprises: When the terminal is in the second working mode, determining fingerprint information above the screen assembly according to the echo information; The method further comprises: If the terminal is in the first working mode, a first prompt message is output before or when the ultrasonic wave is emitted, wherein the first prompt message is used to prompt to stop touching the screen component.

2. The method according to claim 1, characterized in that The detecting the ultrasonic echo to obtain echo information includes: detecting the ultrasonic echo to generate an echo image; The determining whether the screen assembly has a defect according to the echo information includes: determining whether the screen assembly has a defect according to the echo image.

3. The method according to claim 2, characterized in that The terminal is further provided with an ultrasonic receiving device located in the fingerprint module, and the ultrasonic receiving device is used to receive the echo and form the echo image.

4. The method according to claim 3, characterized in that The ultrasonic receiving device is a thin film transistor (TFT).

5. The method according to claim 1, wherein The method further comprises: Determine defect parameters of the defect based on the echo information, wherein the defect parameters include at least one of the following: defect shape; defect width; defect depth; defect position; and defect length.

6. The method according to claim 1, characterized in that Receiving the echo by an ultrasonic receiving device, and determining whether the screen has a defect based on the echo information, includes: determining the energy distribution of the echo on the receiving surface of the ultrasonic receiving device according to the echo information; Based on the energy distribution, determining whether there is an area on the receiving surface where the echo energy meets a preset condition; If there is an area where the echo energy meets the preset condition, it is determined that the screen assembly has a defect.

7. The method according to claim 6, characterized in that The determining, based on the energy distribution, whether there is an area on the receiving surface where the echo energy meets a preset condition includes: determining, based on the energy distribution, whether there is an area on the receiving surface where the ratio between the echo energy and the transmitted energy of the ultrasonic wave is greater than a ratio threshold; If there is an area where the ratio between the echo energy and the transmission energy is greater than the ratio threshold, it is determined that there is an area on the receiving surface where the echo energy meets the preset condition.

8. The method according to any one of claims 1 to 7, characterized in that The method further comprises: When it is determined that the screen assembly has a defect, second prompt information is output; wherein the second prompt information is used to prompt that the screen assembly has a defect.

9. The method according to any one of claims 1 to 7, characterized in that The determining, based on the echo information, whether the screen assembly has a defect includes: After detecting a turn-on operation for indicating that a defect detection function is turned on, determining whether the screen assembly has a defect based on the echo information.

10. A defect detection device, characterized in that: Applied to a terminal, the terminal is provided with a screen assembly and a fingerprint module located below the screen assembly, the fingerprint module includes an ultrasonic emitting device, and the device includes: A transmitting module, configured to control the ultrasonic transmitting device to transmit ultrasonic waves toward the screen assembly; the screen assembly comprises: a screen and / or a transparent cover covering the screen; A detection module, configured to detect the ultrasonic echo based on the fingerprint module and obtain echo information; a determination module, configured to determine whether the screen assembly has a defect based on the echo information; The determining module is further configured to determine, when the terminal is in the first operating mode, based on the echo information, whether the screen assembly has a defect; the echo information received in the first operating mode is configured to reflect a difference in absorption and reflection of the transmitted ultrasonic wave by the screen assembly; The device further comprises: a fingerprint module, configured to determine fingerprint information above the screen assembly based on the echo information when the terminal is in the second operating mode; The first prompt module is used to output a first prompt message before or when the ultrasonic wave is emitted, wherein the first prompt message is used to prompt to stop touching the screen component.

11. The device according to claim 10, characterized in that The detection module is used to detect the ultrasonic echo and generate an echo image; The determination module is used to determine whether the screen component is defective based on the echo image.

12. The device according to claim 10, characterized in that The echo is received by an ultrasonic receiving device, and the determining module is used to determine the energy distribution of the echo on the receiving surface of the ultrasonic receiving device according to the echo information; based on the energy distribution, determine whether there is an area on the receiving surface where the echo energy meets a preset condition; If there is an area where the echo energy meets the preset condition, it is determined that the screen assembly has a defect.

13. The device according to claim 12, characterized in that The determining module is configured to determine, based on the energy distribution, whether there is an area on the receiving surface where the ratio between the echo energy and the ultrasonic transmission energy is greater than a ratio threshold; If there is an area where the ratio between the echo energy and the transmission energy is greater than the ratio threshold, it is determined that there is an area on the receiving surface where the echo energy meets the preset condition.

14. The device according to any one of claims 11 to 13, characterized in that The device further comprises: The second prompt module is used to output second prompt information when it is determined that the screen component has a defect, wherein the second prompt information is used to prompt that the screen component has a defect.

15. The device according to any one of claims 10 to 13, characterized in that The determination module is configured to determine whether the screen assembly has a defect based on the echo information after detecting a start operation for indicating that a defect detection function is turned on.

16. A terminal, characterized in that: include: a memory for storing processor-executable instructions; a processor connected to the memory; The processor is configured to execute the defect detection method according to any one of claims 1 to 9. 17 . A non-transitory computer-readable storage medium, which, when instructions in the storage medium are executed by a processor of a computer, enables the computer to perform the defect detection method according to claim 1 .

Images