Under-screen optical fingerprint interaction method, device and computer-readable storage medium

Abstract

The present invention discloses an under-screen optical fingerprint interaction method, device and computer-readable storage medium, wherein the method comprises: adding and drawing a corresponding mask in the current application according to the transparency determined by the relationship curve; detecting whether the mask is included in the graphic data synthesis service of the system, and when the mask exists and the highlight mode is not turned on, continuing to synthesize the mask after blocking a preset time, so that the highlight mode and the mask are effective on the screen at the same time; when the mask does not exist and the highlight mode is turned on, turning off the highlight mode, and starting to synthesize the mask after blocking the preset time, so that the highlight mode and the mask are invalid on the screen at the same time. A humanized under-screen optical fingerprint interaction solution is realized, which avoids the flickering and jamming problems in the global highlight mode, improves the fluency and visual perception of the under-screen optical fingerprint interaction, and enhances the user experience.

Description

Technical Field

[0001] The present invention relates to the field of mobile communications, and in particular to an under-screen optical fingerprint interaction method, device, and computer-readable storage medium. Background Art

[0002] In the existing technology, with the continuous development of smart terminal devices, under-screen optical fingerprint technology has also been widely used. This technology relies on the screen backlight to illuminate the finger fingerprint, and the under-screen fingerprint camera performs comparative recognition based on the fingerprint texture reflected by the finger fingerprint. At present, backlight highlight is divided into local highlight and global highlight. Global highlight is popular because the brightness of global highlight is high and the problem is that the fingerprint recognition success rate is higher than that of local highlight. Among them, the highlight mode is called high brightness mode, HBM.

[0003] The current problem is that after turning on the global HBM, the screen brightness reaches the maximum and users will feel it is very dazzling.

[0004] In order to solve the above technical problems, the current common practice is to display a translucent black masking DIM when the finger is pressed on the fingerprint area on the application side, and turn on the HBM at the same time.

[0005] However, in the above solution, the time required for drawing DIM to be displayed on the screen is different from the time required for turning on HBM to be displayed on the screen. In addition, flickering may occur when DIM is drawn, which gives the user the impression of system lag and poor user experience. Summary of the invention

[0006] In order to solve the above technical defects in the prior art, the present invention proposes an under-screen optical fingerprint interaction method, which includes:

[0007] A curve of the relationship between the brightness of the highlight mode of the under-screen optical fingerprint and the transparency of the mask of the under-screen optical fingerprint is plotted.

[0008] When the fingerprint icon corresponding to the under-screen optical fingerprint receives a touch event, the current transparency is found according to the current screen brightness and the relationship curve, and a corresponding mask is added and drawn in the current application according to the transparency.

[0009] Detect whether the system's graphic data synthesis service includes the mask layer. When the mask layer exists and the highlight mode is not turned on, continue to synthesize the mask layer after blocking for a preset time so that the highlight mode and the mask layer are effective on the screen at the same time.

[0010] When the mask does not exist and the highlight mode is turned on, the highlight mode is turned off, and the mask is synthesized after blocking the preset time, so that the highlight mode and the mask are simultaneously invalid on the screen.

[0011] Optionally, the relationship curve between the brightness of the highlight mode of drawing the under-screen optical fingerprint and the transparency of the mask layer of the under-screen optical fingerprint includes:

[0012] The screen brightness corresponding to the device at multiple brightness levels and the sampled brightness when the transparency of the mask is adjusted in the highlight mode are obtained.

[0013] The relationship curve is generated according to the screen brightness and the sampling brightness.

[0014] Optionally, when the fingerprint icon corresponding to the under-screen optical fingerprint receives a touch event, searching for the current transparency according to the current screen brightness and the relationship curve, and adding and drawing a corresponding mask in the current application according to the transparency, includes:

[0015] A window is added to the application above the layer of the fingerprint icon and below the animation layer of the application.

[0016] The mask layer is drawn in the window, and the mask layer is set according to the transparency.

[0017] Optionally, the detecting system includes the mask layer in a graphic data synthesis service, and when the mask layer exists and the highlight mode is not turned on, continuing to synthesize the mask layer after blocking for a preset time, so that the highlight mode and the mask layer are effective on the screen at the same time, including:

[0018] Get the effective period of the highlight mode.

[0019] The difference between the effective period and two screen refresh periods is taken as the preset time.

[0020] Optionally, the detecting system includes the mask layer in the graphic data synthesis service, and when the mask layer exists and the highlight mode is not turned on, continuing to synthesize the mask layer after blocking for a preset time, so that the highlight mode and the mask layer are effective on the screen at the same time, further comprising:

[0021] When the mask layer already exists in the graphic data synthesis service, the current synthesis task is written into the register corresponding to the highlight mode.

[0022] The synthesis progress of the mask layer is blocked for the preset time through the register.

[0023] Optionally, the detecting system includes the mask layer in the graphic data synthesis service, and when the mask layer exists and the highlight mode is not turned on, continuing to synthesize the mask layer after blocking for a preset time, so that the highlight mode and the mask layer are effective on the screen at the same time, further comprising:

[0024] After the synthesis progress of the mask layer is blocked for the preset time, the mask layer is continued to be synthesized.

[0025] When the mask synthesis is completed, the highlight mode takes effect synchronously.

[0026] Optionally, when the mask layer does not exist and the highlight mode is turned on, the highlight mode is turned off, and the mask layer is synthesized after blocking for the preset time, so that the highlight mode and the mask layer are simultaneously invalid on the screen, including:

[0027] When the mask layer does not exist in the graphic data synthesis service, the current synthesis task is written into the register corresponding to the highlight mode.

[0028] The synthesis progress of the mask layer is blocked for the preset time through the register.

[0029] Optionally, when the mask layer does not exist and the highlight mode is turned on, the highlight mode is turned off, and the mask layer is synthesized after blocking the preset time, so that the highlight mode and the mask layer are simultaneously invalid on the screen, further comprising:

[0030] After the synthesis progress of the mask layer is blocked for the preset time, synthesis of the mask layer begins.

[0031] When the mask synthesis is completed, the highlight mode synchronization is disabled.

[0032] The present invention also proposes an under-screen optical fingerprint interaction device, which includes a memory, a processor, and a computer program stored in the memory and runnable on the processor. When the computer program is executed by the processor, the steps of the under-screen optical fingerprint interaction method as described in any one of the above items are implemented.

[0033] The present invention also proposes a computer-readable storage medium, which stores an under-screen optical fingerprint interaction program. When the under-screen optical fingerprint interaction program is executed by a processor, the steps of the under-screen optical fingerprint interaction method as described in any one of the above items are implemented.

[0034] The method, device and computer-readable storage medium for interacting with optical fingerprints under the screen of the present invention are implemented, by drawing a curve of the relationship between the brightness of the highlight mode of the optical fingerprint under the screen and the transparency of the mask of the optical fingerprint under the screen; when the fingerprint icon corresponding to the optical fingerprint under the screen receives a touch event, the current transparency is found according to the current screen brightness and the curve, and the corresponding mask is added and drawn in the current application according to the transparency; whether the mask is included in the graphic data synthesis service of the detection system, when the mask exists and the highlight mode is not turned on, the mask continues to be synthesized after blocking the preset time, so that the highlight mode and the mask are effective on the screen at the same time; when the mask does not exist and the highlight mode is turned on, the highlight mode is turned off, and the mask is synthesized after blocking the preset time, so that the highlight mode and the mask are invalid on the screen at the same time. A humanized optical fingerprint interaction solution under the screen is realized, which avoids the flickering and freezing problem in the global highlight mode, improves the fluency and visual perception of the interaction of the optical fingerprint under the screen, and enhances the user experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0035] The present invention will be further described below with reference to the accompanying drawings and embodiments, in which:

[0036] Figure 1 It is a hardware structure diagram of a mobile terminal involved in the present invention;

[0037] Figure 2 is a communication network system architecture diagram provided by an embodiment of the present invention;

[0038] Figure 3 is a flow chart of the first embodiment of the under-screen optical fingerprint interaction method of the present invention;

[0039] Figure 4 is a flow chart of a second embodiment of the under-screen optical fingerprint interaction method of the present invention;

[0040] Figure 5 is a flow chart of a third embodiment of the under-screen optical fingerprint interaction method of the present invention;

[0041] Figure 6 is a flow chart of a fourth embodiment of the under-screen optical fingerprint interaction method of the present invention;

[0042] Figure 7 is a flow chart of a fifth embodiment of the under-screen optical fingerprint interaction method of the present invention;

[0043] Figure 8 is a flow chart of a sixth embodiment of the under-screen optical fingerprint interaction method of the present invention;

[0044] Fig. 9is a flow chart of the seventh embodiment of the under-screen optical fingerprint interaction method of the present invention;

[0045] Fig.10 It is a flow chart of the eighth embodiment of the under-screen optical fingerprint interaction method of the present invention. DETAILED DESCRIPTION

[0046] It should be understood that the specific embodiments described herein are only used to explain the present invention, and are not used to limit the present invention.

[0047] In the subsequent description, the suffixes such as "module", "component" or "unit" used to represent elements are only used to facilitate the description of the present invention, and have no specific meanings. Therefore, "module", "component" or "unit" can be used in a mixed manner.

[0048] The terminal may be implemented in various forms. For example, the terminal described in the present invention may include mobile terminals such as mobile phones, tablet computers, laptop computers, PDAs, portable media players (PMPs), navigation devices, wearable devices, smart bracelets, pedometers, etc., as well as fixed terminals such as digital TVs and desktop computers.

[0049] The following description will be made by taking a mobile terminal as an example, and those skilled in the art will appreciate that, in addition to components specifically used for mobile purposes, the configuration according to the embodiments of the present invention can also be applied to fixed-type terminals.

[0050] See also Figure 1 , which is a schematic diagram of the hardware structure of a mobile terminal for implementing various embodiments of the present invention, the mobile terminal 100 may include: RF (Radio Frequency, radio frequency) unit 101, WiFi module 102, audio output unit 103, A / V (audio / video) input unit 104, sensor 105, display unit 106, user input unit 107, interface unit 108, memory 109, processor 110, and power supply 111 and other components. Those skilled in the art can understand that Figure 1 The structure of the mobile terminal shown in the figure does not constitute a limitation on the mobile terminal. The mobile terminal may include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently.

[0051] Combine the following Figure 1 The following is a detailed introduction to the various components of the mobile terminal:

[0052] The radio frequency unit 101 can be used for receiving and sending signals during information transmission or communication. Specifically, after receiving the downlink information of the base station, it is sent to the processor 110 for processing; in addition, the uplink data is sent to the base station. Generally, the radio frequency unit 101 includes but is not limited to an antenna, at least one amplifier, a transceiver, a coupler, a low noise amplifier, a duplexer, etc. In addition, the radio frequency unit 101 can also communicate with the network and other devices through wireless communication. The above-mentioned wireless communication can use any communication standard or protocol, including but not limited to GSM (Global System of Mobile communication), GPRS (General Packet Radio Service), CDMA2000 (Code Division Multiple Access 2000), WCDMA (Wideband Code Division Multiple Access), TD-SCDMA (Time Division-Synchronous Code Division Multiple Access), FDD-LTE (Frequency Division Duplexing-Long Term Evolution) and TDD-LTE (Time Division Duplexing-Long Term Evolution), etc.

[0053] WiFi is a short-range wireless transmission technology. Mobile terminals can help users send and receive emails, browse web pages, and access streaming media through WiFi module 102. It provides users with wireless broadband Internet access. Figure 1 The WiFi module 102 is shown, but it is understandable that it is not an essential component of the mobile terminal and can be omitted as needed without changing the essence of the invention.

[0054] The audio output unit 103 can convert the audio data received by the RF unit 101 or the WiFi module 102 or stored in the memory 109 into an audio signal and output it as sound when the mobile terminal 100 is in a call signal reception mode, a talk mode, a recording mode, a voice recognition mode, a broadcast reception mode, etc. Moreover, the audio output unit 103 can also provide audio output related to a specific function performed by the mobile terminal 100 (for example, a call signal reception sound, a message reception sound, etc.). The audio output unit 103 may include a speaker, a buzzer, etc.

[0055] The A / V input unit 104 is used to receive audio or video signals. The A / V input unit 104 may include a graphics processor (GPU) 1041 and a microphone 1042, and the graphics processor 1041 processes the image data of a static picture or video obtained by an image capture device (such as a camera) in a video capture mode or an image capture mode. The processed image frame can be displayed on the display unit 106. The image frame processed by the graphics processor 1041 can be stored in the memory 109 (or other storage medium) or sent via the radio frequency unit 101 or the WiFi module 102. The microphone 1042 can receive sound (audio data) via the microphone 1042 in a telephone call mode, a recording mode, a voice recognition mode, and other operating modes, and can process such sound into audio data. The processed audio (voice) data can be converted into a format output that can be sent to a mobile communication base station via the radio frequency unit 101 in the case of a telephone call mode. The microphone 1042 can implement various types of noise elimination (or suppression) algorithms to eliminate (or suppress) noise or interference generated in the process of receiving and sending audio signals.

[0056] The mobile terminal 100 also includes at least one sensor 105, such as a light sensor, a motion sensor, and other sensors. Specifically, the light sensor includes an ambient light sensor and a proximity sensor, wherein the ambient light sensor can adjust the brightness of the display panel 1061 according to the brightness of the ambient light, and the proximity sensor can turn off the display panel 1061 and / or the backlight when the mobile terminal 100 is moved to the ear. As a type of motion sensor, the accelerometer sensor can detect the magnitude of acceleration in all directions (generally three axes), and can detect the magnitude and direction of gravity when stationary. It can be used for applications that identify the posture of the mobile phone (such as horizontal and vertical screen switching, related games, magnetometer posture calibration), vibration recognition related functions (such as pedometer, tapping), etc.; as for other sensors that can also be configured on the mobile phone, such as fingerprint sensors, pressure sensors, iris sensors, molecular sensors, gyroscopes, barometers, hygrometers, thermometers, infrared sensors, etc., they will not be repeated here.

[0057] The display unit 106 is used to display information input by the user or information provided to the user. The display unit 106 may include a display panel 1061, which may be configured in the form of a liquid crystal display (LCD), an organic light-emitting diode (OLED), or the like.

[0058] The user input unit 107 can be used to receive input digital or character information, and to generate key signal input related to the user settings and function control of the mobile terminal. Specifically, the user input unit 107 may include a touch panel 1071 and other input devices 1072. The touch panel 1071, also known as a touch screen, can collect the user's touch operation on or near it (such as the user's operation on the touch panel 1071 or near the touch panel 1071 using any suitable object or accessory such as a finger, stylus, etc.), and drive the corresponding connection device according to a pre-set program. The touch panel 1071 may include two parts: a touch detection device and a touch controller. Among them, the touch detection device detects the user's touch orientation, detects the signal brought by the touch operation, and transmits the signal to the touch controller; the touch controller receives the touch information from the touch detection device, converts it into the touch point coordinates, and then sends it to the processor 110, and can receive and execute the command sent by the processor 110. In addition, the touch panel 1071 can be implemented in various types such as resistive, capacitive, infrared, and surface acoustic waves. In addition to the touch panel 1071, the user input unit 107 may also include other input devices 1072. Specifically, the other input devices 1072 may include, but are not limited to, one or more of a physical keyboard, a function key (such as a volume control key, a switch key, etc.), a trackball, a mouse, a joystick, etc., which are not specifically limited here.

[0059] Furthermore, the touch panel 1071 may cover the display panel 1061. When the touch panel 1071 detects a touch operation on or near it, it transmits the information to the processor 110 to determine the type of the touch event. Then, the processor 110 provides a corresponding visual output on the display panel 1061 according to the type of the touch event. Figure 1 In the figure, the touch panel 1071 and the display panel 1061 are used as two independent components to implement the input and output functions of the mobile terminal. However, in some embodiments, the touch panel 1071 and the display panel 1061 can be integrated to implement the input and output functions of the mobile terminal, which is not limited here.

[0060] The interface unit 108 serves as an interface through which at least one external device can be connected to the mobile terminal 100. For example, the external device may include a wired or wireless headset port, an external power supply (or battery charger) port, a wired or wireless data port, a memory card port, a port for connecting a device with an identification module, an audio input / output (I / O) port, a video I / O port, a headphone port, etc. The interface unit 108 may be used to receive input (e.g., data information, power, etc.) from an external device and transmit the received input to one or more elements within the mobile terminal 100 or may be used to transmit data between the mobile terminal 100 and an external device.

[0061] The memory 109 can be used to store software programs and various data. The memory 109 can mainly include a program storage area and a data storage area, wherein the program storage area can store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc.; the data storage area can store data created according to the use of the mobile phone (such as audio data, a phone book, etc.), etc. In addition, the memory 109 can include a high-speed random access memory, and can also include a non-volatile memory, such as at least one disk storage device, a flash memory device, or other volatile solid-state storage devices.

[0062] The processor 110 is the control center of the mobile terminal. It uses various interfaces and lines to connect various parts of the entire mobile terminal. It executes various functions of the mobile terminal and processes data by running or executing software programs and / or modules stored in the memory 109, and calling data stored in the memory 109, so as to monitor the mobile terminal as a whole. The processor 110 may include one or more processing units; preferably, the processor 110 may integrate an application processor and a modem processor, wherein the application processor mainly processes the operating system, user interface, and application programs, etc., and the modem processor mainly processes wireless communications. It is understandable that the above-mentioned modem processor may not be integrated into the processor 110.

[0063] The mobile terminal 100 may also include a power supply 111 (such as a battery) for supplying power to various components. Preferably, the power supply 111 may be logically connected to the processor 110 via a power management system, thereby implementing functions such as charging, discharging, and power consumption management through the power management system.

[0064] although Figure 1 Not shown, the mobile terminal 100 may further include a Bluetooth module, etc., which will not be described in detail here.

[0065] To facilitate understanding of the embodiments of the present invention, the communication network system on which the mobile terminal of the present invention is based is described below.

[0066] See also Figure 2 , Figure 2 A communication network system architecture diagram is provided for an embodiment of the present invention. The communication network system is an LTE system of universal mobile communication technology. The LTE system includes a UE (User Equipment) 201, an E-UTRAN (Evolved UMTS Terrestrial Radio Access Network) 202, an EPC (Evolved Packet Core) 203 and an operator's IP service 204, which are sequentially connected for communication.

[0067] Specifically, UE201 may be the above-mentioned terminal 100, which will not be described in detail here.

[0068] E-UTRAN 202 includes eNodeB 2021 and other eNodeBs 2022 , etc. Among them, eNodeB 2021 can be connected to other eNodeBs 2022 through a backhaul (eg, an X2 interface), and eNodeB 2021 is connected to EPC 203 , and eNodeB 2021 can provide UE 201 with access to EPC 203 .

[0069] EPC203 may include MME (Mobility Management Entity) 2031, HSS (Home Subscriber Server) 2032, other MMEs 2033, SGW (Serving Gate Way) 2034, PGW (PDN Gate Way) 2035 and PCRF (Policy and Charging Rules Function) 2036, etc. Among them, MME2031 is a control node that processes signaling between UE201 and EPC203, and provides bearer and connection management. HSS2032 is used to provide some registers to manage functions such as home location register (not shown in the figure), and save some user-specific information such as service features and data rates. All user data can be sent through SGW2034, PGW2035 can provide IP address allocation and other functions for UE 201, PCRF2036 is the policy and charging control policy decision point for service data flow and IP bearer resources, which selects and provides available policy and charging control decisions for the policy and charging execution function unit (not shown in the figure).

[0070] The IP service 204 may include the Internet, an intranet, an IMS (IP Multimedia Subsystem) or other IP services.

[0071] Although the above introduction takes the LTE system as an example, those skilled in the art should know that the present invention is not only applicable to the LTE system, but also to other wireless communication systems, such as GSM, CDMA2000, WCDMA, TD-SCDMA and future new network systems, etc., which are not limited here.

[0072] Based on the above mobile terminal hardware structure and communication network system, various embodiments of the method of the present invention are proposed.

[0073] Embodiment 1

[0074] Figure 3 1 is a flow chart of the first embodiment of the under-screen optical fingerprint interaction method of the present invention. An under-screen optical fingerprint interaction method, the method comprising:

[0075] S1. Draw a curve showing the relationship between the brightness of the highlight mode of the under-screen optical fingerprint and the transparency of the mask of the under-screen optical fingerprint.

[0076] S2. When the fingerprint icon corresponding to the under-screen optical fingerprint receives a touch event, the current transparency is searched according to the current screen brightness and the relationship curve, and a corresponding mask is added and drawn in the current application according to the transparency.

[0077] S3. Detect whether the system's graphic data synthesis service includes the mask layer. When the mask layer exists and the highlight mode is not turned on, continue to synthesize the mask layer after blocking for a preset time, so that the highlight mode and the mask layer are effective on the screen at the same time.

[0078] S4. When the mask does not exist and the highlight mode is turned on, the highlight mode is turned off, and the mask is synthesized after blocking the preset time, so that the highlight mode and the mask are simultaneously invalid on the screen.

[0079] In this embodiment, considering that the fundamental problem in the above background technology is that it is difficult to ensure that HBM and DIM are effective at the same time on the screen, this embodiment proposes an interactive solution. Specifically, first, when the screen is globally highlighted and the time for issuing HBM to take effect is greater than 2 screen refresh cycles Vsync, a brightness-alpha curve is produced according to different brightness samples; then, a semi-transparent window, that is, a DIM window, is added on the application side; finally, in the system's graphics data synthesis service Surfaceflinger, the time of HBM and DIM is aligned to synchronize the time when HBM takes effect on the screen and the time when the DIM window takes effect on the screen, thereby solving the problem of screen HBM glare and DIM flicker.

[0080] The beneficial effect of this embodiment is that by drawing the relationship curve between the brightness of the highlight mode of the optical fingerprint under the screen and the transparency of the mask layer of the optical fingerprint under the screen; when the fingerprint icon corresponding to the optical fingerprint under the screen receives a touch event, the current transparency is found according to the current screen brightness and the relationship curve, and the corresponding mask layer is added and drawn in the current application according to the transparency; whether the graphic data synthesis service of the detection system includes the mask layer, when the mask layer exists and the highlight mode is not turned on, the mask layer is continuously synthesized after blocking the preset time, so that the highlight mode and the mask layer are effective on the screen at the same time; when the mask layer does not exist and the highlight mode is turned on, the highlight mode is turned off, and the mask layer is synthesized after blocking the preset time, so that the highlight mode and the mask layer are invalid on the screen at the same time. A humanized under-screen optical fingerprint interaction solution is realized, which avoids the flickering and freezing problem in the global highlight mode, improves the fluency and visual perception of the under-screen optical fingerprint interaction, and enhances the user experience.

[0081] Embodiment 2

[0082] Figure 4 : is a flow chart of the second embodiment of the under-screen optical fingerprint interaction method of the present invention. Based on the above embodiment, the relationship curve between the brightness of the highlight mode of drawing the under-screen optical fingerprint and the transparency of the mask of the under-screen optical fingerprint includes:

[0083] S11. Obtaining the screen brightness of the device at multiple brightness levels, and the sampled brightness when adjusting the transparency of the mask in the highlight mode.

[0084] S12. Generate the relationship curve according to the screen brightness and the sampling brightness.

[0085] In this embodiment, a curve graph of the brightness of HBM and the alpha (transparency) of DIM is generated. For example, when the mobile phone is set to different brightness, the brightness of the screen is different. The HBM state is the maximum brightness state. The HBM state needs to be the same as the normal state. When the brightness bar is slid, the brightness on the screen will also change. Therefore, it is necessary to generate the curve graph first. Specifically, the curve graph is generated by adjusting the nit value of the screen brightness corresponding to different brightness levels of the mobile phone and the nit value of the screen sampling when the alpha of DIM is adjusted in the HBM state, which are in the same relationship of one increasing while the other decreasing. In this embodiment, after obtaining the curve graph, the alpha value of DIM that needs to be set under different brightness conditions can be obtained.

[0086] The beneficial effect of this embodiment is that the relationship curve is generated according to the screen brightness and the sampling brightness by acquiring the screen brightness corresponding to the device at multiple brightness levels and the sampling brightness when adjusting the transparency of the mask in the highlight mode.

[0087] Embodiment 3

[0088] Figure 5 is a flowchart of the third embodiment of the under-screen optical fingerprint interaction method of the present invention. Based on the above embodiment, when the fingerprint icon corresponding to the under-screen optical fingerprint receives a touch event, the current transparency is found according to the current screen brightness and the relationship curve, and a corresponding mask is added and drawn in the current application according to the transparency, including:

[0089] S21, adding a window in the application that is above the layer of the fingerprint icon and below the animation layer of the application.

[0090] S22, drawing the mask layer in the window, and setting the mask layer according to the transparency.

[0091] In this embodiment, when the finger presses the fingerprint icon, the brightness of the current mobile phone screen is obtained, and then the alpha value of DIM at the corresponding brightness is found according to the curve chart; then, a window is added to the application to draw the DIM of the corresponding brightness and the corresponding alpha value of the window is set.

[0092] The beneficial effect of this embodiment is that by adding a window in the application that is above the layer of the fingerprint icon and below the animation layer of the application; drawing the mask layer in the window, and setting the mask layer according to the transparency, a humanized under-screen optical fingerprint interaction solution is implemented, the flickering and freezing problem in the global highlight mode is avoided, the smoothness and visual perception of the under-screen optical fingerprint interaction are improved, and the user experience is enhanced.

[0093] Embodiment 4

[0094] Figure 6 is a flowchart of the fourth embodiment of the under-screen optical fingerprint interaction method of the present invention. Based on the above embodiment, whether the graphic data synthesis service of the detection system includes the mask layer, when the mask layer exists and the highlight mode is not turned on, the mask layer is continuously synthesized after blocking for a preset time, so that the highlight mode and the mask layer are effective on the screen at the same time, including:

[0095] S31, obtaining the effective period of the highlight mode.

[0096] S32: taking the difference between the effective period and two screen refresh periods as the preset time.

[0097] In this embodiment, HBM will take effect only when it is greater than 2 screen refresh cycles, that is, Vsync cycles.

[0098] The beneficial effect of this embodiment is that by obtaining the effective period of the highlight mode and taking the difference between the effective period and the two screen refresh periods as the preset time, a humanized under-screen optical fingerprint interaction solution is implemented, which avoids the flickering and freezing problem in the global highlight mode, improves the smoothness and visual perception of the under-screen optical fingerprint interaction, and enhances the user experience.

[0099] Embodiment 5

[0100] Figure 7 is a flowchart of the fifth embodiment of the under-screen optical fingerprint interaction method of the present invention. Based on the above embodiment, whether the graphic data synthesis service of the detection system includes the mask layer, when the mask layer exists and the highlight mode is not turned on, the mask layer is continuously synthesized after blocking for a preset time, so that the highlight mode and the mask layer are effective on the screen at the same time, and also includes:

[0101] S33: When the mask layer already exists in the graphic data synthesis service, write the current synthesis task into the register corresponding to the highlight mode.

[0102] S34, blocking the synthesis progress of the mask layer for the preset time through the register.

[0103] In this embodiment, when Surfaceflinger (SF for short) is synthesized, it is checked whether the DIM is included in the SF. If the layer layer of the current image synthesis (the window in the application is mapped to the layer in Surfaceflinger) contains the DIM, the register of the HBM is controlled by the layer state.

[0104] The beneficial effect of this embodiment is that when the mask layer already exists in the graphic data synthesis service, the current synthesis task is written into the register corresponding to the highlight mode; the synthesis progress of the mask layer is blocked for the preset time through the register. A humanized under-screen optical fingerprint interaction solution is realized, which avoids the flickering and freezing problem in the global highlight mode, improves the smoothness and visual perception of the under-screen optical fingerprint interaction, and enhances the user experience.

[0105] Embodiment 6

[0106] Figure 8is a flowchart of a sixth embodiment of the under-screen optical fingerprint interaction method of the present invention. Based on the above embodiment, whether the graphic data synthesis service of the detection system includes the mask layer, when the mask layer exists and the highlight mode is not turned on, the mask layer is continuously synthesized after blocking for a preset time, so that the highlight mode and the mask layer are effective on the screen at the same time, and also includes:

[0107] S35. After blocking the synthesis progress of the mask layer for the preset time, continue to synthesize the mask layer.

[0108] S36. When the mask synthesis is completed, the highlight mode takes effect synchronously.

[0109] In this embodiment, after the image is synthesized in SF, 2 Vsyncs will be output and displayed on the screen. Since HBM is more than 2 Vsync cycles, when the DIM is found and HBM is not turned on when SF synthesizes the image, the HBM register is written, and then the preset time, that is, the HBM effective time - 2 Vsync times, is blocked; finally, DIM synthesis is continued. At this time, HBM takes effect on the screen and DIM takes effect on the screen will arrive at the same time.

[0110] The beneficial effect of this embodiment is that after the synthesis progress of the mask layer is blocked for the preset time, the mask layer is continued to be synthesized; when the synthesis of the mask layer is completed, the highlight mode takes effect synchronously. A humanized under-screen optical fingerprint interaction solution is realized, which avoids the flickering and freezing problem in the global highlight mode, improves the smoothness and visual perception of the under-screen optical fingerprint interaction, and enhances the user experience.

[0111] Embodiment 7

[0112] Fig. 9 is a flowchart of the seventh embodiment of the under-screen optical fingerprint interaction method of the present invention. Based on the above embodiment, when the mask layer does not exist and the highlight mode is turned on, the highlight mode is turned off, and the mask layer is synthesized after blocking the preset time, so that the highlight mode and the mask layer are simultaneously invalid on the screen, including:

[0113] S41. When the mask layer does not exist in the graphic data synthesis service, write the current synthesis task into the register corresponding to the highlight mode.

[0114] S42: Block the synthesis progress of the mask layer for the preset time through the register.

[0115] The beneficial effect of this embodiment is that when the mask layer does not exist in the graphic data synthesis service, the current synthesis task is written into the register corresponding to the highlight mode; the synthesis progress of the mask layer is blocked for the preset time through the register. A humanized under-screen optical fingerprint interaction solution is realized, which avoids the flickering and freezing problem in the global highlight mode, improves the smoothness and visual perception of the under-screen optical fingerprint interaction, and enhances the user experience.

[0116] Embodiment 8

[0117] Fig.10 It is a flowchart of the eighth embodiment of the under-screen optical fingerprint interaction method of the present invention. Based on the above embodiment, when the mask layer does not exist and the highlight mode is turned on, the highlight mode is turned off, and the mask layer is synthesized after blocking the preset time, so that the highlight mode and the mask layer are invalid on the screen at the same time, and also includes:

[0118] S43, after blocking the synthesis progress of the mask layer for the preset time, start synthesizing the mask layer.

[0119] S44: When the mask synthesis is completed, the highlight mode synchronization is disabled.

[0120] In this embodiment, if HBM is turned on during SF synthesis, but DIM is not detected, HBM is turned off, and then HBM effective time minus 2 Vsync times are blocked, and finally, synthesis is continued. At this time, HBM failure on the screen and DIM failure on the screen will arrive at the same time.

[0121] The beneficial effect of this embodiment is that after the synthesis progress of the mask layer is blocked for the preset time, the mask layer is started to be synthesized; when the synthesis of the mask layer is completed, the highlight mode synchronization is invalidated. A humanized under-screen optical fingerprint interaction solution is realized, which avoids the flickering and freezing problem in the global highlight mode, improves the smoothness and visual perception of the under-screen optical fingerprint interaction, and enhances the user experience.

[0122] Embodiment 9

[0123] Based on the above embodiments, the present invention also proposes an under-screen optical fingerprint interaction device, which includes a memory, a processor, and a computer program stored in the memory and run on the processor. When the computer program is executed by the processor, the steps of the under-screen optical fingerprint interaction method as described in any one of the above items are implemented.

[0124] It should be noted that the above-mentioned device embodiment and method embodiment belong to the same concept, and the specific implementation process is detailed in the method embodiment, and the technical features in the method embodiment are correspondingly applicable in the device embodiment, which will not be repeated here.

[0125] Embodiment 10

[0126] Based on the above embodiments, the present invention also proposes a computer-readable storage medium, which stores an under-screen optical fingerprint interaction program. When the under-screen optical fingerprint interaction program is executed by a processor, the steps of the under-screen optical fingerprint interaction method as described in any one of the above items are implemented.

[0127] It should be noted that the above-mentioned medium embodiment and method embodiment belong to the same concept, and the specific implementation process is detailed in the method embodiment, and the technical features in the method embodiment are correspondingly applicable in the medium embodiment, which will not be repeated here.

[0128] It should be noted that, in this article, the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, an element defined by the sentence "comprises a ..." does not exclude the existence of other identical elements in the process, method, article or device including the element.

[0129] The serial numbers of the above embodiments of the present invention are only for description and do not represent the advantages or disadvantages of the embodiments.

[0130] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus a necessary general hardware platform, and of course by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present invention, or the part that contributes to the prior art, can be embodied in the form of a software product, which is stored in a storage medium (such as ROM / RAM, a magnetic disk, or an optical disk), and includes a number of instructions for enabling a terminal (which can be a mobile phone, a computer, a server, an air conditioner, or a network device, etc.) to execute the methods described in each embodiment of the present invention.

[0131] The embodiments of the present invention are described above in conjunction with the accompanying drawings, but the present invention is not limited to the above-mentioned specific implementation modes, which are merely illustrative rather than restrictive. Under the guidance of the present invention, ordinary technicians in this field can also make many forms without departing from the scope of protection of the present invention and the claims, all of which are within the protection of the present invention.

Claims

1. An under-screen optical fingerprint interaction method, characterized in that: The method comprises: Draw a curve of the relationship between the brightness of the highlight mode of the under-screen optical fingerprint and the transparency of the mask of the under-screen optical fingerprint; When the fingerprint icon corresponding to the under-screen optical fingerprint receives a touch event, the current transparency is found according to the current screen brightness and the relationship curve, and a corresponding mask is added and drawn in the current application according to the transparency; Detect whether the system's graphic data synthesis service includes the mask layer, and if the mask layer exists and the highlight mode is not turned on, continue to synthesize the mask layer after blocking for a preset time, so that the highlight mode and the mask layer are effective on the screen at the same time; When the mask does not exist and the highlight mode is turned on, the highlight mode is turned off, and the mask is synthesized after blocking the preset time, so that the highlight mode and the mask are simultaneously invalid on the screen.

2. The under-screen optical fingerprint interaction method according to claim 1, characterized in that: The relationship curve between the brightness of the highlight mode of drawing the under-screen optical fingerprint and the transparency of the mask layer of the under-screen optical fingerprint includes: Obtaining the screen brightness of the device at multiple brightness levels, and the sampled brightness when adjusting the transparency of the mask in the highlight mode; The relationship curve is generated according to the screen brightness and the sampling brightness.

3. The under-screen optical fingerprint interaction method according to claim 2, characterized in that: When the fingerprint icon corresponding to the under-screen optical fingerprint receives a touch event, searching the current transparency according to the current screen brightness and the relationship curve, and adding and drawing a corresponding mask in the current application according to the transparency, including: Adding a window in the application that is above the layer of the fingerprint icon and below the animation layer of the application; The mask layer is drawn in the window, and the mask layer is set according to the transparency.

4. The under-screen optical fingerprint interaction method according to claim 3, characterized in that: The detecting system includes the mask layer in the graphic data synthesis service, and when the mask layer exists and the highlight mode is not turned on, continuing to synthesize the mask layer after blocking for a preset time, so that the highlight mode and the mask layer are effective on the screen at the same time, including: Obtaining the effective period of the highlight mode; The difference between the effective period and two screen refresh periods is taken as the preset time.

5. The under-screen optical fingerprint interaction method according to claim 4, characterized in that: The detecting system includes whether the mask layer is included in the graphic data synthesis service, and when the mask layer exists and the highlight mode is not turned on, continuing to synthesize the mask layer after blocking for a preset time, so that the highlight mode and the mask layer are effective on the screen at the same time, further comprising: When the mask layer already exists in the graphic data synthesis service, writing the current synthesis task into the register corresponding to the highlight mode; The synthesis progress of the mask layer is blocked for the preset time through the register.

6. The under-screen optical fingerprint interaction method according to claim 5, characterized in that: The detecting system includes whether the mask layer is included in the graphic data synthesis service, and when the mask layer exists and the highlight mode is not turned on, continuing to synthesize the mask layer after blocking for a preset time, so that the highlight mode and the mask layer are effective on the screen at the same time, further comprising: After blocking the synthesis progress of the mask layer for the preset time, continuing to synthesize the mask layer; When the mask synthesis is completed, the highlight mode takes effect synchronously.

7. The under-screen optical fingerprint interaction method according to claim 6, characterized in that: When the mask layer does not exist and the highlight mode is turned on, the highlight mode is turned off, and the mask layer is synthesized after blocking the preset time, so that the highlight mode and the mask layer are simultaneously invalid on the screen, including: When the mask layer does not exist in the graphic data synthesis service, writing the current synthesis task into the register corresponding to the highlight mode; The synthesis progress of the mask layer is blocked for the preset time through the register.

8. The under-screen optical fingerprint interaction method according to claim 7, characterized in that: When the mask layer does not exist and the highlight mode is turned on, the highlight mode is turned off, and the mask layer is synthesized after blocking the preset time, so that the highlight mode and the mask layer are simultaneously invalid on the screen, and further comprising: After the synthesis progress of the mask layer is blocked for the preset time, starting to synthesize the mask layer; When the mask synthesis is completed, the highlight mode synchronization is disabled.

9. An under-screen optical fingerprint interaction device, characterized in that: The device includes a memory, a processor, and a computer program stored in the memory and executable on the processor. When the computer program is executed by the processor, the steps of the under-screen optical fingerprint interaction method as described in any one of claims 1 to 8 are implemented.

10. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores an under-screen optical fingerprint interaction program, and when the under-screen optical fingerprint interaction program is executed by the processor, the steps of the under-screen optical fingerprint interaction method according to any one of claims 1 to 8 are implemented.

Images