Electronic device, heart rate detection method and computer-readable storage medium
Patent Information
- Application Number
- GB2025011095
- Authority / Receiving Office
- GB · GB
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2023-09-13
- Publication Date
- 2025-08-20
AI Technical Summary
The prior art is difficult to realize real-time heart rate detection and display without special equipment, and user interaction is insufficient.
Blood flow information is collected through the fingerprint recognition module in the electronic device, the heart rate information is determined in combination with the touch controller and the processor, and the display module alternately displays images through the display driver, and the image switching frequency matches the heart rate.
Real-time heart rate detection and display without special equipment is realized, and user interaction performance is optimized, allowing users to obtain heart rate information in real time during the detection process.
Abstract
Description
Electronic device, heart rate detection method, and computer-readable storage medium Technical Field
[0001] The present disclosure relates to the field of terminal technology, and in particular to an electronic device, a heart rate detection method, and a computer-readable storage medium. Background Art
[0002] Heart rate refers to the frequency of the heartbeat, the number of times the heart beats per minute. Heart rate can vary depending on age, gender, and other physiological conditions, and there are significant individual differences in resting heart rate. With the technological development of terminal devices, terminal devices are becoming increasingly functional and intelligent. Currently, terminal devices can be used to detect the user's heart rate information. The heart rate detection function of terminal devices is usually implemented based on hardware such as sensors. The sensor converts the heart's vibration signal into a corresponding electrical signal, and then determines the heart rate based on the period of the peak of the electrical signal.
[0003] Summary of the Invention
[0004] On the one hand, an electronic device is provided. The electronic device includes a fingerprint recognition module, a touch controller, a processor, a display driver and a display module. The touch controller is configured to send a first control signal to the fingerprint recognition module in response to a heart rate detection instruction to control the fingerprint recognition module to collect blood flow information in the user's blood vessels. The touch controller is configured to obtain blood flow information in the user's blood vessels and determine the user's heart rate information based on the blood flow information; and, generate a second control signal according to the heart rate information, and send the second control signal to the display driver. The display driver is configured to generate a first display drive signal according to the second control signal to control the display module to alternately display a first image and a second image, and the switching frequency of the first image and the second image matches the heart rate information.
[0005] In some embodiments, the first display driving signal includes a plurality of display cycles, each display cycle includes a display time of the first image and a display time of the second image. Within a display cycle, the display brightness of the first image and the second image is different.
[0006] In some embodiments, the first display driving signal includes a light emitting control signal, and the ratio of the duty cycle of each light emitting control signal corresponding to the first image and the duty cycle of each light emitting control signal corresponding to the second image are equal, and the ratio is not equal to 1.
[0007] In some embodiments, a data voltage value corresponding to each data signal corresponding to the first image is different from a data voltage value corresponding to each data signal corresponding to the second image.
[0008] In some embodiments, the first display driving signal includes a light emitting control signal, and the ratio of the duty cycle of each light emitting control signal corresponding to the first image and the duty cycle of each light emitting control signal corresponding to the second image are equal, and the ratio is not equal to 1.
[0009] In some embodiments, the duration of the working level of each light emitting control signal corresponding to the first image is different from the duration of the working level of each light emitting control signal corresponding to the second image.
[0010] In some embodiments, the number of operating levels of the light emitting control signals corresponding to the first image is different from the number of operating levels of the light emitting control signals corresponding to the second image.
[0011] In some embodiments, within a display period, the displayed contents of the first image and the second image are different.
[0012] In some embodiments, the processor is further configured to calculate the user's heart rate parameters within a set period based on the user's heart rate information, generate a third control signal including the heart rate parameters, and send the third control signal to the display driver. The display driver is further configured to generate a second display drive signal based on the third control signal to control the display module to display an image including the heart rate parameters on the first image and / or the second image.
[0013] In some embodiments, the area of the image containing the heart rate parameter is smaller than the area of the first image and / or the second image.
[0014] In some embodiments, within a display cycle, the display brightness of the image containing the heart rate parameters remains unchanged.
[0015] In some embodiments, the fingerprint recognition module collects blood flow information within the user's blood vessels, including: collecting multiple images containing the blood flow information. After the processor determines the user's heart rate information, the touch controller is further configured to obtain the frame rate of the multiple images containing the blood flow information and send the frame rate to the processor; the processor is further configured to send a vertical synchronization signal to the display driver, the vertical synchronization signal being used to indicate the frame rate of the multiple images containing the blood flow information; the display driver is further configured to generate a negative feedback signal based on the refresh rate of the display module and send it to the processor; the processor is further configured to generate an adjustment signal based on the frame rate and refresh rate; and the display driver is further configured to adjust the refresh rate of the display module under the control of the adjustment signal so that the refresh rate of the first image and the second image displayed by the display module matches the frame rate.
[0016] In some embodiments, the display driver is further configured to generate a third display driving signal according to the detection preparation instruction to control the display module to display a third image.
[0017] On the other hand, a heart rate detection method is provided. The heart rate detection method includes: a touch controller sending a first control signal to a fingerprint recognition module in response to a heart rate detection instruction to control the fingerprint recognition module to collect blood flow information in the user's blood vessels. A processor obtains the blood flow information and determines the user's heart rate information based on the blood flow information; the processor also generates a second control signal based on the heart rate information and sends the second control signal to a display driver. The display driver generates a first display drive signal based on the second control signal to control the display module to alternately display a first image and a second image, where the switching frequency between the first and second images matches the heart rate information.
[0018] In some embodiments, the processor calculates the user's heart rate parameters within a set period based on the user's heart rate information, generates a third control signal including the heart rate parameters, and sends the third control signal to the display driver. The display driver generates a second display drive signal based on the third control signal to control the display module to display an image including the heart rate parameters on the first image and / or the second image.
[0019] In some embodiments, the display driver generates a third display driving signal according to the detection preparation instruction to control the display module to display the third image. The detection preparation instruction is issued before the heart rate detection instruction.
[0020] In some embodiments, the fingerprint recognition module collecting blood flow information within a user's blood vessels includes: collecting multiple images containing blood flow information. After the processor determines the heart rate information, the touch controller obtains the frame rate of the multiple images containing the blood flow information and sends the frame rate to the processor; the processor sends a vertical synchronization signal to the display driver, the vertical synchronization signal being used to indicate the frame rate of the multiple images containing the blood flow information; the display driver generates a negative feedback signal based on the refresh rate of the display module and sends it to the processor; the processor generates an adjustment signal based on the frame rate and refresh rate; and the display driver adjusts the refresh rate of the display module under the control of the adjustment signal so that the refresh rate of the first image and the second image displayed by the display module matches the frame rate.
[0021] In some embodiments, the processor sends a vertical synchronization signal to a display driver, the vertical synchronization signal being used to indicate the frame rate of the plurality of images containing blood flow information. The display driver adjusts the refresh rate of the display module based on the frame rate so that the refresh rate of the first image and the second image displayed by the display module matches the frame rate. The display driver also sends a negative feedback signal to the processor, the negative feedback signal being used to indicate the refresh rate of the first image and the second image.
[0022] In another aspect, a computer-readable storage medium is provided. The computer-readable storage medium stores computer program instructions, which, when executed on a computer (e.g., an electronic device), cause the computer to perform one or more steps of the heart rate detection method described in any of the above embodiments.
[0023] In another aspect, a computer program product is provided, comprising computer program instructions, which, when executed on a computer (e.g., an electronic device), cause the computer to perform one or more steps of the heart rate detection method as described in any of the above embodiments.
[0024] In another aspect, a computer program is provided, which, when executed on a computer (eg, an electronic device), causes the computer to execute one or more steps of the heart rate detection method as described in any one of the above embodiments. BRIEF DESCRIPTION OF THE DRAWINGS
[0025] To more clearly illustrate the technical solutions of the present disclosure, the following briefly introduces the drawings required for use in some embodiments of the present disclosure. Obviously, the drawings described below are only drawings of some embodiments of the present disclosure, and those skilled in the art can also derive other drawings based on these drawings. Furthermore, the drawings described below are schematic diagrams and are not intended to limit the actual dimensions of the products, actual processes of the methods, actual timing of signals, and the like involved in the embodiments of the present disclosure.
[0026] FIG1 is a block diagram of an electronic device according to some embodiments;
[0027] FIG2 is a planar structural diagram of an electronic device according to some embodiments;
[0028] FIG3 is a planar structural diagram of an electronic device according to some other embodiments;
[0029] FIG4 is a block diagram of signal flow in an electronic device according to some embodiments;
[0030] FIG5 shows a first image and a second image alternately displayed by a display module according to some embodiments;
[0031] FIG6 is a timing diagram of data signals according to some embodiments;
[0032] FIG7 shows a first image and a second image alternately displayed by a display module according to some other embodiments;
[0033] FIG8 is a timing diagram of a data signal or a first voltage signal according to some embodiments;
[0034] FIG9 is a timing diagram of a light emitting control signal or a power supply voltage signal according to some embodiments;
[0035] FIG10 is a timing diagram of a light emitting control signal or a power supply voltage signal according to some other embodiments;
[0036] FIG11 is an image including heart rate parameters displayed by a display module according to some embodiments;
[0037] FIG12 is another image including heart rate parameters displayed by a display module according to some embodiments;
[0038] FIG13 is a timing diagram of a vertical synchronization signal and a negative feedback signal according to some embodiments;
[0039] FIG14 is a comparison diagram of a third image displayed by a display module and the first and second images according to some embodiments;
[0040] FIG15 is a comparison diagram of a third image displayed by a display module and the first and second images according to some other embodiments;
[0041] FIG16 is a flow chart of a heart rate detection method according to some embodiments;
[0042] FIG17 is a flow chart of a heart rate detection method according to some other embodiments;
[0043] FIG18 is a flowchart of a heart rate detection method according to yet other embodiments. DETAILED DESCRIPTION
[0044] The following will be combined with the accompanying drawings to clearly and completely describe the technical solutions in some embodiments of the present disclosure. Obviously, the embodiments described are only some embodiments of the present disclosure, not all embodiments. Based on the embodiments provided by the present disclosure, all other embodiments obtained by ordinary technicians in this field are within the scope of protection of the present disclosure.
[0045] Unless the context requires otherwise, throughout the specification and claims, the term "comprise" and its other forms, such as the third person singular form "comprises" and the present participle form "comprising", are to be interpreted as open and inclusive, that is, "including, but not limited to". In the description of the specification, the terms "one embodiment", "some embodiments", "exemplary embodiments", "example", "specific example" or "some examples" are intended to indicate that the particular features, structures, materials or characteristics associated with the embodiment or example are included in at least one embodiment or example of the present disclosure. The schematic representation of the above terms does not necessarily refer to the same embodiment or example. In addition, the particular features, structures, materials or characteristics may be included in any one or more embodiments or examples in any appropriate manner.
[0046] In the following, the terms "first" and "second" are used for descriptive purposes only and should not be understood to indicate or imply relative importance or implicitly specify the number of the technical features indicated. Therefore, a feature defined as "first" or "second" may explicitly or implicitly include one or more of the features. In the description of the embodiments of the present disclosure, unless otherwise specified, "plurality" means two or more.
[0047] When describing some embodiments, the expressions "coupled" and "connected" and their derivatives may be used. The term "connected" should be understood in a broad sense. For example, "connection" can be a fixed connection, a detachable connection, or an integral connection; it can be directly connected or indirectly connected through an intermediate medium. The term "coupled" indicates, for example, that two or more components are in direct physical or electrical contact. The term "coupled" or "communicatively coupled" may also refer to two or more components that are not in direct contact with each other, but still cooperate or interact with each other. The embodiments disclosed herein are not necessarily limited to the contents of this document.
[0048] “At least one of A, B and C” has the same meaning as “at least one of A, B or C” and both include the following combinations of A, B and C: A only, B only, C only, the combination of A and B, the combination of A and C, the combination of B and C, and the combination of A, B and C.
[0049] “A and / or B” includes the following three combinations: A only, B only, and a combination of A and B.
[0050] As used herein, the term "if" is optionally interpreted to mean "when" or "upon" or "in response to determining" or "in response to detecting," depending on the context. Similarly, the phrases "if it is determined that" or "if [stated condition or event] is detected" are optionally interpreted to mean "upon determining" or "in response to determining" or "upon detecting [stated condition or event]" or "in response to detecting [stated condition or event]," depending on the context.
[0051] The use of "adapted to" or "configured to" herein is intended to be open and inclusive language that does not exclude devices adapted or configured to perform additional tasks or steps.
[0052] Additionally, the use of “based on” is meant to be open and inclusive, as a process, step, calculation, or other action “based on” one or more stated conditions or values may, in practice, be based on additional conditions or values beyond those stated.
[0053] It will be understood that when a layer or element is referred to as being on another layer or substrate, it can be directly on the other layer or substrate, or intervening layers may be present therebetween.
[0054] Exemplary embodiments are described herein with reference to cross-sectional and / or plan views that are idealized exemplary drawings. In the drawings, the thickness of layers and the area of regions are exaggerated for clarity. Therefore, variations in shape relative to the drawings due to, for example, manufacturing techniques and / or tolerances are contemplated. Therefore, the exemplary embodiments should not be construed as limited to the shapes of the regions shown herein, but rather include deviations in shape due to, for example, manufacturing. For example, an etched region shown as a rectangle will typically have curved features. Therefore, the regions shown in the drawings are schematic in nature, and their shapes are not intended to illustrate the actual shape of regions of the device and are not intended to limit the scope of the exemplary embodiments.
[0055] 1 , 2 and 3 , some embodiments of the present disclosure provide an electronic device 10 , which includes a display module 5 .
[0056] Exemplarily, the electronic device 10 includes but is not limited to laptop computers, tablet computers, mobile phones, PDAs (Personal Digital Assistants), navigators, wearable devices (such as portable computer watches), and any other products or components with display functions.
[0057] Exemplarily, the display module 5 may be any device that displays moving (eg, video), fixed (eg, still image), text, or images.
[0058] From the perspective of the light-emitting type of the display module 5, the display module 5 can be an active light-emitting display module or a non-active light-emitting display module. In the case where the display module 5 is a non-active light-emitting display module, the display module 5 can include a liquid crystal display (LCD). In the case where the display module 5 is an active light-emitting display module, the display module 5 can be a quantum dot light emitting diode (QLED), a mini light-emitting diode (MLED), or an organic light-emitting diode (OLED), or a plasma display panel (PDP).
[0059] From the perspective of the shape of the display module 5, the display module 5 can be a flat display module, a curved display module, or a foldable display module.
[0060] From the perspective of the shape of the display module 5, the display module 5 can be rectangular or circular, etc. As shown in Figures 2 and 3, when the display module 5 is rectangular, its corners can be in an arc shape.
[0061] The above is merely an illustration of some possible implementations of the present disclosure and is not intended to limit the present disclosure. The implementations of the present disclosure are not limited thereto, and any other display types may also be considered as long as the same technical concept is applied.
[0062] In some embodiments, as shown in FIG. 2 and FIG. 3 , the display module 5 includes a plurality of pixels, and each pixel includes sub-pixels P of at least three colors.
[0063] In some examples, the sub-pixel P includes at least a first color sub-pixel, a second color sub-pixel, and a third color sub-pixel. The first color, the second color, and the third color are three primary colors, such as red, green, and blue.
[0064] In some other examples, the sub-pixel P further includes a fourth color sub-pixel, and the fourth color is, for example, white.
[0065] In some embodiments, the display module 5 is an OLED display module, and each sub-pixel P includes at least one OLED light-emitting element. The OLED display module includes an OLED pixel driving circuit configured to control one or a group of OLED light-emitting elements to emit light.
[0066] For example, a group of OLED light-emitting elements may include a row or a column of OLED light-emitting elements, or may include a plurality of adjacent OLED light-emitting elements.
[0067] Exemplarily, the OLED pixel driving circuit includes at least: a first light-emitting control module, a first voltage signal terminal, a second voltage signal terminal, a light-emitting control signal terminal, and a data signal terminal. The first voltage signal terminal is coupled to the anode of the OLED light-emitting element and is configured to transmit a first voltage signal VDD to the anode of the OLED light-emitting element. The second voltage signal terminal is coupled to the cathode of the OLED light-emitting element and is configured to transmit a second voltage signal VSS to the cathode of the OLED light-emitting element.
[0068] The first light-emitting control module is configured to, under the control of a light-emitting control signal EM provided by the light-emitting control signal terminal, generate an OLED drive current in response to a first voltage signal VDD from the first voltage signal terminal, a second voltage signal VSS from the second voltage signal terminal, and a data signal Data from the data signal terminal, and transmit the current to the OLED light-emitting element. The OLED light-emitting element is configured to emit light in accordance with the OLED drive current when the light-emitting control signal provided by the light-emitting control signal terminal EM is at an operating level.
[0069] In other embodiments, the display module 5 is an MLED display module, and each sub-pixel P includes at least one MLED light-emitting element. The MLED display module includes an MLED pixel driving circuit configured to control one or a group of MLED light-emitting elements to emit light.
[0070] Exemplarily, a group of MLED light-emitting elements may include a row or a column of MLED light-emitting elements, or may include a plurality of adjacent MLED light-emitting elements.
[0071] Exemplarily, the MLED pixel driver circuit includes at least a second light-emitting control module, a power supply terminal, a light-emitting control signal terminal, and a data signal terminal. The positive and negative electrodes of the power supply terminal are respectively coupled to the first and second electrodes of the MLED light-emitting element. The power supply terminal is configured to provide a power supply voltage signal VCC to the MLED to control the MLED light-emitting element to conduct.
[0072] The second light-emission control module is configured to, under the control of a light-emission control signal OE provided by the light-emission control signal terminal, generate an MLED drive current based on a power voltage signal VCC provided by the power supply terminal and a data signal Data provided by the data signal terminal, and transmit the current to the MLED light-emitting element. The MLED light-emitting element is configured to emit light in accordance with the MLED drive current when the light-emission control signal OE provided by the light-emission control signal terminal is at an operating level.
[0073] In some other embodiments, the display module 5 is an LCD display module, which includes a liquid crystal display panel and a backlight module, with the liquid crystal display panel being disposed on the light-emitting side of the backlight module. The liquid crystal display panel includes an array substrate and an opposing substrate disposed oppositely, and a liquid crystal layer located between the array substrate and the opposing substrate, wherein the liquid crystal layer includes a plurality of liquid crystal molecules.
[0074] In some examples, the array substrate includes a pixel electrode and a switching transistor (TFT) connected to the pixel electrode. The gate of the switching transistor TFT is coupled to a gate line, the first electrode of the switching transistor TFT is coupled to a data line, and the second electrode of the switching transistor TFT is coupled to the pixel electrode. The switching transistor TFT is configured to turn on under the control of a gate signal (Gate) transmitted by the gate line and transmit a data signal (Data) from the data line to the pixel electrode.
[0075] The common electrode is disposed on the array substrate or the counter substrate and is coupled to a common voltage terminal (eg, a common electrode line), which is configured to provide a common voltage to the common electrode.
[0076] The liquid crystal molecules are configured to deflect under the control of an electric field formed by a common voltage connected to the common electrode and a pixel voltage connected to the pixel electrode, so as to change the light transmittance of the liquid crystal molecules.
[0077] For example, the backlight module includes a plurality of light emitting elements for providing the liquid crystal display panel with light required for displaying images. The plurality of light emitting elements may be MLED light emitting elements.
[0078] In some embodiments, as shown in FIG1 , the electronic device 10 further includes: a fingerprint recognition module 1 , a touch controller 2 , a processor 3 and a display driver 4 .
[0079] As shown in FIG4 , the touch controller 2 is configured to send a first control signal to the fingerprint recognition module 1 in response to a heart rate detection instruction, so as to control the fingerprint recognition module 1 to collect blood flow information in the user's blood vessels.
[0080] As shown in Figure 4, processor 3 is configured to obtain blood flow information within the user's blood vessels and determine the user's heart rate information based on the blood flow information. Processor 3 is also configured to generate a second control signal based on the user's heart rate information and send the second control signal to display driver 4.
[0081] As shown in Figure 4, the display driver 4 is configured to generate a first display drive signal based on the second control signal and send it to the display module 5 to control the display module 5 to alternately display the first image TX1 and the second image TX2, and the switching frequency of the first image TX1 and the second image TX2 matches the heart rate information.
[0082] For example, the heart rate detection instruction may be issued by the processor 3. The processor 3 sends the heart rate detection instruction to the fingerprint recognition module 1 in the following two ways, for example.
[0083] For example, the user triggers a function button on the electronic device 10 to inform the electronic device 10 to detect the user's heart rate. At this time, the processor 3 generates a heart rate detection instruction and sends the heart rate detection instruction.
[0084] The user triggering the function button on the electronic device may be that the electronic device 10 is loaded with an application for performing heart rate detection, and after the user enters the application, clicking the corresponding function button within the application is deemed to trigger the function button on the electronic device 10. After the fingerprint recognition module 1 begins collecting blood flow information in the user's blood vessels, the display module 5 alternately displays the first image TX1 and the second image TX2 according to the user's heart rate information.
[0085] For another example, when the duration of the user touching the fingerprint recognition module 1 reaches a first set duration (eg, 5 seconds), the processor 3 issues a heart rate detection instruction in response to the duration of the user touching the fingerprint recognition module 1 .
[0086] The electronic device 10 provided in some embodiments of the present disclosure can detect the user's heart rate through the joint action of the fingerprint detection module 1, the touch controller 2 and the processor 3, without the need to set up a dedicated heart rate detection device. In addition, the electronic device 10 allows the user to intuitively see the heartbeat corresponding to the heart rate information during the heart rate detection process by changing the display screen of the display module 5 (i.e., alternating the display of the first image TX1 and the second image TX2), and the switching frequency of the display screen of the display module 5 is the same as the user's heartbeat frequency, so that the display module 5 displays the heartbeat rhythm at the same frequency.
[0087] It is understandable that the heart rate information includes at least the number of heartbeats of the user in a unit time (eg, one minute), and also includes the duration of one heartbeat of the user in the unit time.
[0088] Compared to displaying the heart rate test results through the display module 5 after the heart rate test is completed, the electronic device 10 provided by some embodiments of the present disclosure can interact with the user's heart rate in real time, so that the user can obtain the heart rate information in real time through the changes in the display screen of the display module 5 during the heart rate detection process, thereby optimizing the interaction performance between the electronic device 10 and the user.
[0089] 2 and 3 , the size of the active display area AA (Active Area) of the display module 5 is smaller than or equal to the size of the display module 5 . The active display area AA is the area where the display module 5 can display images.
[0090] Exemplarily, as shown in FIG. 2 and FIG. 3 , the display module 5 is a touch display module.
[0091] In some examples, the fingerprint recognition module 1 is disposed in at least a portion of the area below the display module 5 (on the non-display side opposite to the display side); or, is disposed in at least a portion of the area inside the display module 5 .
[0092] In other examples, the fingerprint recognition module 1 is disposed on the back side of the electronic device 10 .
[0093] In some other examples, the fingerprint recognition module 1 is disposed on a side of the electronic device 10 .
[0094] For example, the fingerprint recognition module 1 switches its operating state in response to a control instruction from the processor 3 or the touch controller 2 (i.e., the control instruction may be sent to the fingerprint recognition module 1 by the processor 3 or by the touch controller 2). The fingerprint recognition module 1 is configured to implement different functions in different operating states.
[0095] For example, the fingerprint recognition module 1 is used to collect fingerprint information of the user in the first working state; and is used to collect blood flow information in the user's blood vessels in the second working state.
[0096] The following takes the example of the processor 3 sending a control instruction to the fingerprint recognition module 1 to illustrate several situations of the control instruction sent by the processor 3.
[0097] In some examples, the user issues a control instruction to the fingerprint recognition module 1 by triggering a function button on the electronic device 10. The user triggering the function button on the electronic device 10 may be that the electronic device 10 is loaded with an application for performing heart rate detection, and the user clicks on the application icon to open the application, which is considered to trigger the function button on the electronic device 10, and the fingerprint recognition module 1 switches its working state.
[0098] In other examples, the user sends a control instruction to the fingerprint recognition module 1 by continuously touching the fingerprint recognition module 1. The user continuously touching the fingerprint recognition module 1 includes at least the following two situations.
[0099] For example, when the user touches the fingerprint recognition module 1 for a first set duration (e.g., 0.1s), the processor 3 issues a first control instruction in response to the duration of the user's touch, causing the fingerprint recognition module 1 to switch to the first operating state. When the fingerprint recognition module 1 is in the first operating state, if the user touches the information collection area C, the fingerprint recognition module 1 can collect fingerprint information within the touch information collection area C.
[0100] For another example, if the user touches the fingerprint recognition module 1 for a second set duration (e.g., 5 seconds), the processor 3 issues a second control instruction in response to the duration of the user's touch, causing the fingerprint recognition module 1 to switch to the second operating state. When the fingerprint recognition module 1 is in the second operating state, if the user touches the information collection area C, the fingerprint recognition module 1 can collect blood flow information within the user's blood vessels.
[0101] The fingerprint recognition module 1 includes, for example, an optical fingerprint sensor. When the fingerprint recognition module 1 is in the second operating state, the user touches the information collection area C with, for example, a finger (or a subcutaneous area with blood vessels, such as an earlobe), and the fingerprint recognition module 1 collects multiple fingerprint information (e.g., multiple fingerprint images) within the information collection area C.
[0102] When the heart beats, blood is pushed from the heart to all parts of the body. During this process, due to the flow of blood, the absorption rate and reflectivity of light by the body part (such as the finger) touching the fingerprint detection module 1 changes. In this way, for the same fingerprint image information, the optical fingerprint sensor collects different optical signals, thereby obtaining blood flow information in the user's blood vessels based on the changes in the optical signals corresponding to multiple fingerprint information.
[0103] Controlling the fingerprint recognition module 1 to collect blood flow information in the user's blood vessels may be to collect optical signals corresponding to multiple fingerprint image information.
[0104] In some other examples, the fingerprint recognition module 1 switches to the sleep state in response to the sleep instruction.
[0105] When the fingerprint recognition module 1 is in the dormant state, touching the information collection area C will not trigger the fingerprint recognition module 1 to work (eg, collect the user's fingerprint information and / or collect the blood flow information in the user's blood vessels).
[0106] The following description will be made by taking the fingerprint recognition module 1 being disposed below the display module 5 or within the display module 5 as an example.
[0107] In some examples, as shown in FIG. 2 , the size of the fingerprint recognition module 1 is smaller than the size of the active display area AA of the display module 5 .
[0108] For example, as shown in FIG2 , the fingerprint recognition module 1 can be disposed within the active display area AA of the display module 5. In this case, when the fingerprint recognition module 1 is in operation, touching the information collection area C of the display module 5 can trigger the fingerprint recognition module 1 to collect the user's fingerprint information and / or collect blood flow information within the user's blood vessels.
[0109] In other examples, as shown in FIG3 , the size of the fingerprint recognition module 1 is greater than or equal to the size of the active display area AA of the display module 5 .
[0110] For example, as shown in Figure 3, the effective display area AA can be located within the effective recognition area B of the fingerprint recognition module 1, and the effective recognition area B surrounds the information collection area C. In this case, by touching any part of the information collection area C, the fingerprint recognition module 1 can collect the user's fingerprint information and / or blood flow information in the user's blood vessels.
[0111] For example, as shown in Figures 2 and 3, the display module 5 has an information collection area C corresponding to the effective recognition area B of the fingerprint recognition module 1. The effective recognition area B is the portion of the fingerprint recognition module 1 that can effectively collect the user's fingerprint information and / or blood flow information within the user's blood vessels. The size of the fingerprint recognition module 1 is greater than or equal to the size of its effective recognition area B.
[0112] In some examples, the size of the effective identification area B is the same as or approximately the same as the size of the information collection area C.
[0113] It should be noted that the size of the effective recognition area B can be larger than the size of the information collection area C, thereby ensuring that when the information collection area C is touched, the fingerprint recognition module 1 can completely and effectively obtain the fingerprint information in the information collection area C. When the fingerprint recognition module 1 is in an operating state (e.g., the first operating state or the second operating state), touching the portion of the display module 5 corresponding to the fingerprint recognition module 1 (e.g., the information collection area C) can trigger the fingerprint recognition module 1 to collect the user's fingerprint information or blood flow information in the user's blood vessels.
[0114] The following introduces a specific technical solution for controlling the display module 5 to alternately display the first image and the second image using the first display driving signal.
[0115] In some embodiments, as shown in Figures 5 and 6, the first display drive signal sent by the display driver 4 to the display module 5 includes multiple display cycles T. Each display cycle T includes a display time t1 of a first image TX1 and a display time t2 of a second image TX2. Within a display cycle T, the first image TX1 and the second image TX2 display different contents.
[0116] Illustratively, when the electronic device 10 detects the user's heart rate, the display driver 4 is configured to generate a first display driving signal to control the display module 5 to alternately display the first image TX1 and the second image TX2 at a switching frequency matching the heart rate information.
[0117] Each display cycle T corresponds to, for example, the time it takes for a user's heartbeat to complete. For example, the time it takes for a user's heartbeat to complete is 0.8 seconds or 1 second. Accordingly, the duration of the display cycle T is 0.8 seconds or 1 second. Thus, within each display cycle T, the display module 5 alternately displays a first image TX1 and a second image TX2. By observing the changes in the display screen of the display module 5, the user can intuitively see changes in heart rate during the heart rate detection process. For example, the faster the heartbeat, the higher the switching frequency between the first image TX1 and the second image TX2.
[0118] Compared with displaying the heart rate test result through the display module 5 after completing the heart rate detection, the above solution can optimize the interaction effect between the electronic device 10 and the user.
[0119] 6 , the first image TX1 includes x frames of images, and the second image TX2 includes y frames of images, where x ≥ 1 and y ≥ 1. The x frames of images included in the first image TX1 have the same display screen, the y frames of images included in the second image TX2 have the same display screen, and the first image TX1 and the second image TX2 have different display screens.
[0120] By changing the data signals corresponding to the display screens of display module 5 so that the data signals corresponding to the first image TX1 and the second image TX2 are different, the display screen of display module 5 alternately changes its display content as the user's heart rate changes. During the user's heart rate monitoring process, the user can obtain real-time heart rate information by observing the switching frequency of the display screens of display module 5.
[0121] Compared to displaying the heart rate test results through the display module 5 after the heart rate test is completed, the electronic device 10 provided by some embodiments of the present disclosure can obtain heart rate information in real time through changes in the display screen of the display module 5 during the heart rate detection process, thereby optimizing the interaction performance between the electronic device 10 and the user.
[0122] For example, the higher the switching frequency of the display screen content of the display module 5 (ie, the higher the switching frequency of the first image TX1 and the second image TX2), the faster the user's heartbeat is. During the heart rate detection process, the user can intuitively see the heart rate changes.
[0123] The content displayed by the first image TX1 and / or the second image TX2 can be customized according to user needs. This is for illustrative purposes only and is not intended to limit the present disclosure.
[0124] The above technical solution can be applied to an electronic device 10 having an active light-emitting display module or a non-active light-emitting display module.
[0125] In some embodiments, as shown in FIG7 , the first display drive signal sent by the display driver 4 to the display module 5 includes multiple display cycles T. Each display cycle T includes a display time t1 of a first image TX1 and a display time t2 of a second image TX2. Within a display cycle T, the display brightness of the first image TX1 and the second image TX2 are different.
[0126] For example, as shown in Figure 7, the second display brightness when the display module 5 displays the second image TX2 can be 1.5 times, 2 times or 2.5 times the first display brightness when displaying the first image TX1. The above brightness changes are only for illustrative purposes and are not specifically limited. It can significantly distinguish the brightness changes of the screen, so that the user can know the changes in heart rate by watching the display screen of the display module 5.
[0127] In some examples, as shown in FIG. 7 , the display screens of the first image TX1 and the second image TX2 are the same but the display brightness is different.
[0128] In other examples, the first image TX1 and the second image TX2 are displayed in different screens and at different brightnesses.
[0129] That is, within one display period T, on the premise that the display brightness of the alternately displayed first image TX1 and the second image TX2 are different, the first image TX1 and the second image TX2 may display the same picture or different pictures.
[0130] The above technical solution can be applied to an electronic device 10 having an active light-emitting display module or a non-active light-emitting display module.
[0131] When applied to an electronic device 10 having an OLED display module, the OLED driving current can be changed by changing at least one of the following three items: the duty cycle of the light-emitting control signal EM corresponding to the first image TX1 and the second image TX2, the value of the first voltage VDD corresponding to the first image TX1 and the second image TX2, and the data voltage signal Data corresponding to the first image TX1 and the second image TX2, thereby changing the light-emitting brightness of the OLED light-emitting element.
[0132] When applied to an electronic device 10 having an MLED display module, the MLED driving current can be changed by changing at least one of the following three items: the duty cycle of the light-emitting control signal OE corresponding to the first image TX1 and the second image TX2, the power supply voltage signal VCC corresponding to the first image TX1 and the second image TX2, and the value of the data voltage signal Data corresponding to the first image TX1 and the second image TX2, thereby changing the light-emitting brightness of the MLED light-emitting element.
[0133] When applied to an electronic device 10 having an LCD display module, the data voltage signal Data corresponding to the first image TX1 and the second image TX2 can be changed, thereby changing the voltage applied to the pixel electrode, so that the deflection angle of the liquid crystal molecules corresponding to the pixel electrode P is changed, and then the light transmittance of this part of the liquid crystal molecules is changed, so that the display brightness of the display module changes.
[0134] The above-mentioned display modules are expected to realize alternating changes between the first image TX1 and the second image TX2 through one or more of the following embodiments. Figures 6 and 8 show the values of the data voltage of the image displayed by the display module 5 according to the data signal Data in the first display driving signal.
[0135] In some embodiments, the display module 5 can be an active light-emitting display module or a non-active light-emitting display module. As shown in FIG8 , the first display drive signal includes a data signal Data, and the ratio of each data signal Data corresponding to the first image TX1 to each data signal Data corresponding to the second image TX2 is equal, and the ratio is not equal to 1.
[0136] Exemplarily, as shown in FIG7 , the first image TX1 includes x frames of images, the second image TX2 includes y frames of images, and the display screens of the x frames of images included in the first image TX1 and the y frames of images included in the second image TX2 are the same.
[0137] In some examples, the data signals Data corresponding to the x frames of images included in the first image TX1 are the same, and the data signals Data corresponding to the y frames of images included in the second image TX2 are the same.
[0138] By proportionally adjusting the data signals Data corresponding to the display screen of the display module 5 (the first image TX1 and the second image TX2), the display grayscale corresponding to the sub-pixel P of the display module 5 is changed proportionally. In this way, the image displayed by the display module 5 according to the data signals Data corresponding to the first image TX1 is the same as the display screen of the image displayed according to the data signals Data corresponding to the second image TX2, but the display brightness is different, so that the display screen of the display module 5 changes alternately between bright and dark with the user's heart rate. During the heart rate detection process, the user can intuitively see the heart rate information (such as the time it takes for one heartbeat, etc.) by watching the display screen of the display module 5.
[0139] For example, the first image TX1 and the second image TX2 display the same display screen. When the display module 5 displays the first image TX1 and the second image TX2 , the display content corresponding to each sub-pixel P remains unchanged, and the display grayscale changes.
[0140] The display brightness change between the first image TX1 and the second image TX2 may be: the display brightness of the second image TX2 increases by 30%, 50%, or 100% compared to the first image TX1; or the display brightness of the second image TX2 decreases by 10%, 50%, or 80% compared to the first image TX1. This is for illustrative purposes only and is not intended to limit the present disclosure.
[0141] In some embodiments, as shown in FIG. 8 , the data voltage value corresponding to each data signal Data corresponding to the first image TX1 is different from the data voltage value corresponding to each data signal Data corresponding to the second image TX2 .
[0142] The display brightness of the first image TX1 and the second image TX2 with the larger data voltage value corresponding to the data signal Data is brighter. Referring to FIG8 , the data voltage values corresponding to the data signals Data corresponding to the second image TX2 are larger than the data voltage values corresponding to the data signals Data corresponding to the first image TX1. Therefore, the display brightness of the second image TX2 is brighter than that of the first image TX1. Thus, by alternating the display of the first image TX1 and the second image TX2, the user can intuitively obtain real-time heart rate information through the brightness changes of the display screen of the display module 5.
[0143] In some embodiments, the display module 5 may be an OLED display module. As shown in FIG8 , the first display drive signal includes a first voltage signal VDD, and the ratio of each first voltage signal VDD corresponding to the first image TX1 to each first voltage signal VDD corresponding to the second image TX2 is equal, and the ratio is not equal to 1.
[0144] When the first voltage signal VDD transmitted to the anode of the OLED light-emitting element changes, the voltage value transmitted to the anode of the OLED light-emitting element changes, and the voltage difference connected between the anode and cathode of the OLED light-emitting element changes, thereby changing the light brightness of the OLED light-emitting element.
[0145] By proportionally adjusting the first voltage signals VDD corresponding to the display screens of the display module 5 (the first image TX1 and the second image TX2), the luminous brightness of each OLED light-emitting element changes proportionally when displaying the first image TX1 and when displaying the second image TX2, thereby achieving the alternating bright / dark changes of the display screen of the display module 5 along with the user's heart rate. During the heart rate detection process, the user can intuitively see the heart rate parameters (such as the time it takes for one heartbeat, etc.) by watching the display screen of the display module 5.
[0146] In some examples, while proportionally adjusting the first voltage signals VDD corresponding to the display screen of the display module 5 (the first image TX1 and the second image TX2), the data signals Data corresponding to the display screen of the display module 5 (the first image TX1 and the second image TX2) can also be adjusted so that the display content of the first image TX1 and the second image TX2 are different. In this way, the display content and display brightness of the first image TX1 and the second image TX2 both change, so that the user can obtain real-time heart rate parameters through changes in the display screen and brightness.
[0147] In some embodiments, the display module 5 may be an OLED display module or an MLED display module. As shown in Figures 9 and 10 , the first display drive signal includes light-emitting control signals EM / OE. The duty ratio of each light-emitting control signal EM / OE corresponding to the first image TX1 is equal to the duty ratio of each light-emitting control signal EM / OE corresponding to the second image TX2, and the ratio is not equal to 1.
[0148] For example, as shown in Figures 9 and 10, during the display time t1 of the first image TX1, the duty cycle of the light-emitting control signal EM / OE is B1; during the display time t2 of the second image TX2, the duty cycle of the light-emitting control signal EM / OE is B2, and B1 / B2≠1. In this way, the proportion of the light-emitting duration of the display module 5 during the display time t1 of the first image TX1 and the proportion of the light-emitting duration during the display time t2 of the second image TX2 are different. Therefore, when the user views the display module 5, he or she can observe the brightness changes when the first image TX1 and the second image TX2 are displayed. During the heart rate detection process, the user can intuitively see the heart rate information (such as the time it takes for one heartbeat, etc.) by viewing the display screen of the display module 5.
[0149] In some examples, while proportionally adjusting the light-emitting control signals EM / OE corresponding to the display screen of the display module 5 (the first image TX1 and the second image TX2), the data signals Data corresponding to the display screen of the display module 5 can also be adjusted so that the display content of the first image TX1 and the second image TX2 are different. In this way, the display content and display brightness of the first image TX1 and the second image TX2 both change, allowing the user to obtain real-time heart rate information through changes in the display screen and brightness.
[0150] For example, a first image TX1 includes x frames of images, and a second image TX2 includes y frames of images. For each of the x frames of images in the first image TX1, the number of operating levels of the light-emitting control signal EM / OE corresponding to each frame is a1, and the duration of each operating level of the light-emitting control signal EM / OE is a2. For each of the y frames of images in the second image TX2, the number of operating levels of the light-emitting control signal EM / OE corresponding to each frame is b1, and the duration of each operating level of the light-emitting control signal EM / OE is b2.
[0151] On this basis, by changing the duration of the effective level of the light-emitting control signal EM / OE corresponding to each frame of the image, the screen display brightness of the display module 5 can be changed. The duration of the effective level of the light-emitting control signal EM / OE can be changed, for example, in the following two ways.
[0152] In some examples, the number of operating levels of the light emitting control signals EM / OE corresponding to the first image TX1 is different from the number of operating levels of the light emitting control signals EM / OE corresponding to the second image TX2 .
[0153] As shown in FIG9 , a1≠b1, a2=b2. Display time t1 is the same as display time t2, for example. The number of operating levels of the light-emitting control signal EM / OE in display time t1 is different from the number of operating levels of the light-emitting control signal EM / OE in display time t2; the duration of the operating level of each light-emitting control signal EM / OE in display time t1 is the same as the duration of the operating level of each light-emitting control signal EM / OE in display time t2. In this way, the total light-emitting duration of the display module 5 is different in different display times (display time t1 and display time t2), so that the display brightness of the display screen of the display module 5 in display time t1 and display time t2 is different.
[0154] In other examples, the duration of the working level of each light emitting control signal EM / OE corresponding to the first image TX1 is different from the duration of the working level of each light emitting control signal EM / OE corresponding to the second image TX2.
[0155] As shown in FIG10 , a1=b1, a2≠b2. Display time t1 is the same as display time t2, for example. The number of light-emitting control signals EM / OE in display time t1 is the same as the number of light-emitting control signals EM / OE in display time t2; the duration of the operating level of each light-emitting control signal EM / OE in display time t1 is different from the duration of the operating level of each light-emitting control signal EM / OE in display time t2. In this way, the total light-emitting duration of the display module 5 is different in different display times (display time t1 and display time t2), so that the display brightness of the display screen of the display module 5 in display time t1 and display time t2 is different.
[0156] It should be noted that, at least one of the duration of the operating levels of the light-emitting control signals EM / OE corresponding to the first image TX1 and the second image TX2, and the number of operating levels of the light-emitting control signals EM / OE corresponding to the first image TX1 and the second image TX2, changes. Accordingly, the display brightness of the first image TX1 and the second image TX2 is different.
[0157] It is understandable that, to achieve a display effect in which the first image TX1 and the second image TX2 display different brightnesses, the duration and number of the operating levels of the light emitting control signals EM / OE corresponding to the first image TX1 and the second image TX2 can be changed. Specific adaptive design can be performed according to actual needs.
[0158] In some embodiments, the display module 5 may be an MLED display module. As shown in Figures 9 and 10 , the first display drive signal includes a power supply voltage signal VCC. The duty cycle of each power supply voltage signal VCC corresponding to the first image TX1 and the duty cycle of each power supply voltage signal VCC corresponding to the second image TX2 are equal in ratio, and the ratio is not equal to 1.
[0159] Exemplarily, as shown in FIG9 and FIG10, during the display time t1 of the first image TX1, the duty cycle of the power supply voltage signal VCC is C1; during the display time t2 of the second image TX2, the duty cycle of the power supply voltage signal VCC is C2, and C1 / C2≠1.
[0160] When the power supply voltage provided by the power supply voltage signal VCC applied to the MLED light-emitting element is less than the turn-on voltage of the MLED light-emitting element (the power supply voltage signal VCC is at a non-working level), the MLED light-emitting element is turned off; when the power supply voltage provided by the power supply voltage signal VCC applied to the MLED light-emitting element is greater than or equal to the turn-on voltage of the MLED light-emitting element (the power supply voltage signal VCC is at a working level), the MLED light-emitting element is turned on and emits light.
[0161] In each display frame, the longer the power supply voltage signal VCC is at the operating level, the longer the MLED light-emitting element is illuminated within the display frame, and correspondingly, the brighter the screen display brightness. By changing the duty cycle of each power supply voltage signal VCC corresponding to the display screen of the display module 5 (the first image TX1 and the second image TX2), the display module 5's illumination duration during the display time t1 of the first image TX1 and the illumination duration during the display time t2 of the second image TX2 are different. This allows the user to observe the brightness changes when the first image TX1 and the second image TX2 are displayed when viewing the display module 5. During the heart rate detection process, the user can intuitively see the heart rate information (such as the time it takes for one heartbeat, etc.) by viewing the display screen of the display module 5.
[0162] In some examples, when the display module 5 alternately displays the first image TX1 and the second image TX2, the display content and display brightness of the first image TX1 and the second image TX2 change, allowing the user to obtain real-time heart rate information through changes in the display screen and brightness.
[0163] Exemplarily, a first image TX1 includes x frames of images, and a second image TX2 includes y frames of images. Of the x frames of images included in the first image TX1, each frame corresponds to a number c1 of operating levels of the power supply voltage signal VCC, and the duration of each operating level of the power supply voltage signal VCC is c2. Of the y frames of images included in the second image TX2, each frame corresponds to a number d1 of operating levels of the power supply voltage signal VCC, and the duration of each operating level of the power supply voltage signal VCC is d2.
[0164] In some embodiments, as shown in Figures 11 and 12, the processor 3 is further configured to collect the user's heart rate parameters within a set period Ts based on the heart rate parameters, generate a second control signal containing the heart rate parameters, and send the second control signal to the display driver 4. The display driver 4 is further configured to generate a second display drive signal based on the second control signal to control the display module 5 to display the image TX0 containing the heart rate parameters on the first image TX1 and / or the second image TX2.
[0165] Exemplarily, the image TX0 including the heart rate parameters may be displayed on the first image TX1; or displayed on the second image TX2; or the image TX0 including the heart rate parameters may be displayed on both the first image TX1 and the second image TX2.
[0166] For example, the heart rate parameter includes the number of heartbeats per unit time (eg, one minute). The entire heart rate detection process includes a plurality of set periods Ts, each of which includes at least one display period T, for example.
[0167] When performing heart rate detection, the user's heart rate can be obtained by detecting the number of heartbeats in one minute; the user's real-time heart rate can also be obtained by deriving the number of heartbeats in one minute by detecting the duration of each heartbeat. During the heart rate detection process, each set period Ts corresponds to the time of one heartbeat, for example. Based on the duration of the current set period Ts, the current real-time heart rate can be derived. The heart rate parameters include the current real-time heart rate derived based on the time of one heartbeat.
[0168] For example, if the duration of the first set period Ts is 1 second, then the corresponding user's current real-time heart rate is 60 beats / minute; if the duration of the second set period Ts is 0.8 seconds, then the corresponding user's current real-time heart rate is 75 beats / minute. The processor 3 can count the user's heart rate parameters within the set period Ts based on the heart rate parameters, and the display module 5 displays the image TX0 containing the real-time heart rate parameters under the control of the second display drive signal. In this way, during the heart rate detection process, the user can not only obtain the heart rate parameters through the switching frequency of the first image TX1 and the second image TX2 displayed by the display module 5, but also obtain the real-time heart rate parameters through the image TX0 containing the heart rate parameters displayed by the display module 5.
[0169] In some examples, as shown in FIG. 11 , the image TX0 containing the real-time heart rate information may be a numerical text displaying the corresponding real-time heart rate information.
[0170] In other examples, as shown in FIG12 , the image TX0 containing real-time heart rate information may display not only numerical text corresponding to the real-time heart rate information, but also an electrocardiogram or a heart rate waveform corresponding to the real-time heart rate information.
[0171] In some embodiments, as shown in FIG. 11 and FIG. 12 , the area of the image TX0 containing the heart rate parameter is smaller than the area of the first image TX1 and / or the second image TX2 .
[0172] For example, when image TX0 containing heart rate parameters is displayed on first image TX1, the area of image TX0 containing heart rate parameters is smaller than that of first image TX1. When image TX0 containing heart rate parameters is displayed on second image TX2, the area of image TX0 containing heart rate parameters is smaller than that of second image TX2. When image TX0 containing heart rate parameters is displayed on both first image TX1 and second image TX2, the area of image TX0 containing heart rate parameters is smaller than that of first image TX1 and smaller than that of second image TX2.
[0173] By making the area of the image TX0 containing the heart rate parameters smaller than the area of the first image TX1 and / or the second image TX2, during the heart rate detection process, the alternatingly displayed first image TX1 and second image TX2 will not be completely blocked by the image TX0 containing the heart rate parameters. When the user views the display module 5, even with the presence of the image TX0 containing the heart rate parameters, the user can still observe the alternating changes of the first image TX1 and the second image TX2.
[0174] In this way, when the user watches the display module 5, he can not only obtain the real-time heart rate information through the changing frequency of the first image TX1 and the second image TX2, but also obtain the real-time heart rate information through the image TX0 containing the heart rate parameters, thereby improving the interactive performance between the electronic device 10 and the user.
[0175] In some embodiments, as shown in FIG. 11 and FIG. 12 , within a display period T, the display brightness of the image TX0 containing the heart rate parameters remains unchanged.
[0176] During the heart rate detection process, the first image TX1 and the second image TX2 are displayed alternately, and the display screens and / or display brightness of the first image TX1 and the second image TX2 are different. At the same time, the display brightness of the image TX0 containing the heart rate parameters displayed on the first image TX1 and / or the second image TX2 remains unchanged. This helps the user obtain real-time heart rate information by watching the image TX0 containing the heart rate parameters displayed on the display module 5 during the heart rate detection process.
[0177] It should be noted that, during the heart rate detection process, the change of the display screen of the display module 5 (change of display content and / or display brightness) can be implemented according to at least one of the above embodiments.
[0178] For example, within a display period T, the display brightness of the image TX0 containing the heart rate parameters may also change with the alternation of the first image TX1 and the second image TX2.
[0179] In some embodiments, the fingerprint recognition module 1 is an optical fingerprint recognition module.
[0180] Exemplarily, the press-type optical fingerprint recognition module includes, for example, an optical fingerprint sensor.
[0181] In some examples, the user places a finger on the fingerprint recognition module 1, and the optical fingerprint sensor can obtain the user's fingerprint information based on changes in the absorption rate and reflectivity of light by various parts of the user's finger.
[0182] In the process of acquiring the user's fingerprint information, the fingerprint recognition module 1 dynamically detects valid fingerprint image information at a set frame rate. For example, the fingerprint recognition module 1 recognizes 60 frames of fingerprint images per second.
[0183] During the entire heart rate detection process, the working state of the fingerprint recognition module 1 is switched to the second working state to obtain blood flow information in the user's blood vessels. The processor 3 sends a second control signal to the display driver 4 according to the blood flow information. The display driver 4 generates a first display drive signal according to the second control signal to control the display module 5 to alternately switch the first image TX1 and the second image TX2 at a frequency matching the user's heart rate information.
[0184] During this process, if the refresh rate of the display screen of the display module 5 is inconsistent with the frame rate of the fingerprint recognition module 1, it may cause "tearing" of the display screen of the display module 5.
[0185] For example, processor 3 obtains blood flow information within the user's blood vessels acquired by fingerprint recognition module 1. The blood flow information includes multiple fingerprint images captured by fingerprint recognition module 1, each with a frame rate of 60 frames per second. Display driver 4 generates a first display drive signal based on a second control signal from processor 3, and display module 5 displays an image (alternating between first image TX1 and second image TX2) based on the first display drive signal.
[0186] The first display drive signal includes a data signal Data. The display module 5 receives and processes the data signal Data to display the image corresponding to the data signal Data. If the speed at which the display driver 4 generates the data signal Data corresponding to a frame of display image is inconsistent with the speed at which the display module 5 processes the data signal Data corresponding to a frame of display image to display the image, the image displayed by the display module 5 may exhibit "screen tearing" issues.
[0187] Based on this, in some embodiments of the present disclosure, as shown in FIG13 , the fingerprint recognition module 1 collects blood flow information within the user's blood vessels, including: collecting multiple images containing blood flow information. After the processor 3 determines the heart rate information, the touch controller 2 is further configured to obtain the frame rate of the multiple images containing the blood flow information and send the frame rate to the processor 3; the processor 3 is further configured to send a vertical synchronization signal Vsync to the display driver 4, the vertical synchronization signal Vsync being used to indicate the frame rate of the multiple images containing the blood flow information; and the display driver 4 is further configured to generate a negative feedback signal TE based on the refresh rate of the display module 5 and send it to the processor 3.
[0188] The processor 3 is also configured to generate an adjustment signal according to the frame rate and refresh rate; the display driver 4 is also configured to adjust the refresh rate of the display module 5 under the control of the adjustment signal so that the refresh rate of the first image TX1 and the second image TX2 displayed by the display module 5 matches the frame rate.
[0189] As shown in FIG13 , the second control signal sent by processor 3 to display driver 4 includes an image transmission signal MIPI, which includes image information including blood flow information. For example, processor 3 transmits multiple images including blood flow information to display driver 4 frame by frame via the image transmission signal MIPI. Display driver 4 transmits data signals Data corresponding to the multiple images including blood flow information to display module 5. Display module 5 generates display images (first image TX1 and / or second image TX2, third image TX3, etc.) frame by frame based on the data signals Data.
[0190] The refresh rate of the display module 5 is adjusted by the processor 3 so that the processing speed of each frame of the image by the display module 5 is consistent with the speed at which the processor 3 sends each frame of the image containing blood flow information to the display driver 4. While ensuring the quality of the display image of the display module 5, it can also ensure that the changes in the display image of the display module 5 (the switching frequency of the image TX2 and the second image TX2) can be synchronized with the user's heart rate parameters.
[0191] In some embodiments, as shown in Figures 14 and 15, the display driver 4 is further configured to generate a third display drive signal according to the detection preparation instruction, and send the third display drive signal to the display module 5 to control the display module 5 to display the third image TX3; the detection preparation instruction is generated before the heart rate detection instruction.
[0192] Exemplarily, based on the foregoing, when the displayed contents of the first image TX1 and the second image TX2 are the same, the third image TX3 may be the same as the displayed contents of either the first image TX1 or the second image TX2; or, the displayed contents of the third image TX3 are different from both the first image TX1 and the second image TX2.
[0193] In the case where the display brightness of the displayed content of the first image TX1 and the second image TX2 is different, the third image TX3 can be the same as the display brightness of either the first image TX1 or the second image TX2; or, the display brightness of the content displayed by the third image TX3 is different from both the first image TX1 and the second image TX2.
[0194] For example, the user triggers a function button on the electronic device 10 to inform the electronic device 10 that it is ready to detect the user's heart rate. At this point, the processor 3 generates and issues a detection preparation instruction. The user triggering the function button on the electronic device can be when the electronic device 10 is loaded with an application for performing heart rate detection, and the user clicks on the application icon to open the application, which is considered to be triggering the function button on the electronic device 10. The display module 5 displays the third image TX3. After the fingerprint recognition module 1 begins collecting blood flow information in the user's blood vessels, the display module 5 alternately displays the first image TX1 and the second image TX2 based on the user's heart rate information.
[0195] When the display module 5 displays the third image TX3, the fingerprint recognition module 1 is in a detection preparation state, and starts to collect blood flow information in the user's blood vessels after receiving a heart rate detection instruction to perform heart rate detection.
[0196] It is understandable that when the fingerprint recognition module 1 starts to collect blood flow information in the user's blood vessels in response to the heart rate detection instruction, if the user does not place his finger (or a part of the body where there are blood vessels under the skin, such as the earlobe) on the fingerprint recognition module 1 in time at the start moment, then the user's heart rate information generated by the processor 3 is inaccurate, and no actual heart rate information is obtained during the period from the time the fingerprint recognition module 1 starts collecting information to the time the user places his finger on the fingerprint recognition module 1.
[0197] Exemplarily, when the display module 5 displays the third image TX3, the triggering conditions for the processor 3 to send the heart rate detection instruction include the following situations.
[0198] For example, after the display module 5 displays the third image TX3 for a third set time period (eg, 3 seconds), the processor 3 sends a heart rate detection instruction to the fingerprint recognition module 1 .
[0199] For another example, when the display module 5 displays the third image TX3, the user touches the information collection area C with a finger, and the processor 3 obtains the time when the user touches the information collection area C. When the touch time is greater than the fourth set time length, the processor 3 sends a heart rate detection instruction to the fingerprint recognition module 1.
[0200] Before the fingerprint recognition module 1 starts collecting blood flow information, a certain amount of preparation time is reserved for the user. During this period, the user places the finger on the fingerprint recognition module 1 and keeps touching the fingerprint recognition module 1 during the heart rate detection process. This can ensure that when the fingerprint recognition module 1 starts collecting information, a part of the user's body is already placed on the fingerprint recognition module 1, thereby ensuring the accuracy of the blood flow information collected by the fingerprint recognition module 1; at the same time, it can effectively prevent the user from accidentally touching the fingerprint recognition module 1 before starting the heart rate detection and starting to collect information before the user is ready.
[0201] For example, before processor 3 sends a heart rate detection instruction to fingerprint recognition module 1, processor 3 is further configured to send a timing display drive signal to display driver 4 to control display module 5 to display countdown information. When the countdown information reaches 0, processor 3 sends a heart rate detection instruction to fingerprint recognition module 1, and fingerprint recognition module 1 begins collecting blood flow information in the user's blood vessels.
[0202] In this way, before the fingerprint recognition module 1 starts collecting blood flow information in the user's blood vessels, the user can know the start time by watching the display screen of the display module 5, so that the user can place the finger or other body part on the fingerprint recognition module 1 before starting the detection, thereby ensuring the accuracy of the blood flow information collected by the fingerprint recognition module 1.
[0203] It should be noted that this is merely an exemplary description and not a limitation of the present disclosure, and the specific method of issuing control instructions (such as heart rate detection instructions) can be adaptively designed according to actual needs.
[0204] Some embodiments of the present disclosure further provide a heart rate detection method, which is applied to the electronic device provided in the above embodiments. As shown in FIG16 , the heart rate detection method includes at least steps S1 to S4.
[0205] S1. As shown in FIG1 , the touch controller 2 sends a first control signal to the fingerprint recognition module 1 in response to a heart rate detection instruction, so as to control the fingerprint recognition module 1 to collect blood flow information in the user's blood vessels.
[0206] S2. As shown in FIG1 , the processor 3 obtains blood flow information and determines the user's heart rate information based on the blood flow information; the processor also generates a second control signal according to the user's heart rate information and sends the second control signal to the display driver 4.
[0207] S3. As shown in FIG5 and FIG7, the display driver 4 generates a first display driving signal according to the second control signal to control the display module 5 to alternately display the first image TX1 and the second image TX2. The switching frequency of the first image TX1 and the second image TX2 matches the user's heart rate information.
[0208] The heart rate detection method provided by some embodiments of the present disclosure can detect the user's heart rate through the joint action of the fingerprint detection module 1, the touch controller 2 and the processor 3, and can enable the user to intuitively see the heartbeat corresponding to the heart rate information during the heart rate detection process through the changes in the display screen of the display module 5 (for example, alternating display of the first image and the second image). The switching frequency of the display screen of the display module 5 is the same as the user's heartbeat frequency, so that the display module 5 displays the heartbeat change rhythm at the same frequency.
[0209] Compared to displaying the heart rate test results through the display module 5 after the heart rate test is completed, the heart rate detection method provided by some embodiments of the present disclosure is used. The display screen of the display module 5 can interact with the user's heart rate in real time, allowing the user to obtain heart rate information in real time through changes in the display screen of the display module 5 during the heart rate detection process, thereby optimizing the interactivity with the user during the heart rate detection process.
[0210] In some embodiments, as shown in FIG17 , the heart rate detection method further includes steps S4 and S5 .
[0211] S4 . The processor 3 counts the user's heart rate parameters within the set period Ts according to the user's heart rate information, generates a third control signal including the heart rate parameters, and sends the third control signal to the display driver 4 .
[0212] S5. As shown in FIG. 11 and FIG. 12 , the display driver 4 generates a second display driving signal according to the third control signal to control the display module 5 to display the image T0 including the heart rate parameters on the first image TX1 and / or the second image TX2.
[0213] When performing heart rate detection, the user's heart rate information can be obtained by detecting the number of heartbeats in one minute; the number of heartbeats in one minute can also be deduced by detecting the duration of each heartbeat to obtain the user's real-time heart rate; in the process of heart rate detection, each set period Ts corresponds to the time of one heartbeat, for example, and the current real-time heart rate can be deduced based on the duration of the current set period Ts.
[0214] For example, if the first set period Ts is 1 second, then the corresponding user's current real-time heart rate is 60 beats / minute; if the second set period Ts is 0.8 seconds, then the corresponding user's current real-time heart rate is 75 beats / minute. The processor 3 can calculate the user's heart rate parameters within the set period Ts based on the heart rate information, and the display module 5 displays the image TX0 containing the real-time heart rate information under the control of the second display drive signal. In this way, during the heart rate detection process, the user can not only obtain the heart rate information through the switching frequency of the first image TX1 and the second image TX2 displayed by the display module 5, but also obtain the real-time heart rate information through the image TX0 containing the heart rate information displayed by the display module 5.
[0215] In some embodiments, as shown in FIG18 , before step S1 , the heart rate detection method further includes step S0 .
[0216] S0: The display driver 4 generates a third display driving signal according to the detection preparation instruction, and sends the third display driving signal to the display module 5 to control the display module 5 to display the third image TX3. The detection preparation instruction is issued before the heart rate detection instruction.
[0217] By adopting the above technical solution, a certain preparation time is reserved for the user before the fingerprint recognition module 1 starts collecting blood flow information. During this period, the user places the finger on the fingerprint recognition module 1 and keeps touching the fingerprint recognition module 1 during the heart rate detection process. This can ensure that when the fingerprint recognition module 1 starts collecting information, the user's body part is already placed on the fingerprint recognition module 1, thereby ensuring the accuracy of the blood flow information collected by the fingerprint recognition module 1.
[0218] At the same time, when the display module 5 displays the third image TX3, the processor 3 sends a heart rate detection instruction to the fingerprint recognition module 1 in response to the touch time when the time the user touches the information collection area C is greater than the fourth set time. This can effectively prevent the user from accidentally touching the fingerprint recognition module 1 before starting the heart rate detection and starting to collect information before the user is ready.
[0219] Please refer to the above description of the relevant parts of the third image TX3 for details, which will not be repeated here.
[0220] In some embodiments, in step S1, the fingerprint recognition module 1 collects blood flow information in the user's blood vessels, including: collecting multiple images containing blood flow information. Based on this, the heart rate detection method further includes steps S6 to S10.
[0221] S6. After the processor 3 determines the heart rate information, the touch controller 2 obtains the frame rates of multiple images containing blood flow information and sends the frame rates to the processor 3.
[0222] S7 . The processor 3 sends a vertical synchronization signal Vsync to the display driver 4 . The vertical synchronization signal Vsync is used to indicate the frame rate of the multiple images containing the blood flow information.
[0223] S8 . The display driver 4 generates a negative feedback signal TE according to the refresh rate of the display module 5 and sends it to the processor 3 .
[0224] S9 . The processor 3 generates an adjustment signal according to the frame rate and refresh rate, and sends the adjustment signal to the display driver 4 .
[0225] S10 , the display driver 4 adjusts the refresh rate of the display module 5 under the control of the adjustment signal, so that the refresh rates of the first image TX1 and the second image TX2 displayed by the display module 5 match the frame rate.
[0226] It should be noted that the above step numbers are only used to distinguish the method steps and are not used to limit the execution order of the method steps.
[0227] As shown in FIG13 , the second control signal sent by processor 3 to display driver 4 includes an image transmission signal MIPI, which includes image information including blood flow information. For example, processor 3 transmits multiple images including blood flow information to display driver 4 frame by frame via the image transmission signal MIPI. Display driver 4 transmits data signals Data corresponding to the multiple images including blood flow information to display module 5. Display module 5 generates display images (first image TX1 and / or second image TX2, third image TX3, etc.) frame by frame based on the data signals Data.
[0228] The refresh rate of the display module 5 is adjusted by the processor 3 so that the processing speed of each frame of the image by the display module 5 is consistent with the speed at which the processor 3 sends each frame of the image containing blood flow information to the display driver 4. While ensuring the quality of the display image of the display module 5, it can also ensure that the changes in the display image of the display module 5 (there is a switching frequency between the image TX2 and the second image TX2) can be synchronized with the user's heart rate information.
[0229] For details, please refer to the description of the synchronous adjustment of frame rate and refresh rate in the previous article. I will not go into details here.
[0230] Some embodiments of the present disclosure provide a computer-readable storage medium (e.g., a non-transitory computer-readable storage medium), which stores computer program instructions. When the computer program instructions are executed on a real-time computer (e.g., electronic device 10), the computer executes one or more steps S0 to S8 of the heart rate detection method described in any of the above embodiments.
[0231] Exemplarily, the above-mentioned computer-readable storage media may include, but are not limited to: magnetic storage devices (e.g., hard disks, floppy disks, or magnetic tapes, etc.), optical disks (e.g., CDs (Compact Disks), DVDs (Digital Versatile Disks), etc.), smart cards, and flash memory devices (e.g., EPROMs (Erasable Programmable Read-Only Memory), cards, sticks, or key drives, etc.). The various computer-readable storage media described in the present disclosure may represent one or more devices and / or other machine-readable storage media for storing information. The term "machine-readable storage medium" may include, but is not limited to, wireless channels and various other media capable of storing, containing, and / or carrying instructions and / or data.
[0232] Some embodiments of the present disclosure further provide a computer program product, for example, stored on a non-transitory computer-readable storage medium. The computer program product includes computer program instructions that, when executed on a computer (e.g., an electronic device), cause the computer to perform one or more of steps S0 to S8 of the heart rate detection method described in the above embodiments.
[0233] Some embodiments of the present disclosure further provide a computer program. When the computer program is executed on a computer (eg, an electronic device), the computer program causes the computer to execute one or more steps S0 to S8 of the heart rate detection method described in the above embodiment.
[0234] The beneficial effects of the above-mentioned computer-readable storage medium, computer program product and computer program are the same as the beneficial effects of the heart rate detection method described in some of the above-mentioned embodiments, and will not be repeated here.
[0235] The above description is merely a specific embodiment of the present disclosure, but the scope of protection of the present disclosure is not limited thereto. Any changes or substitutions that a person skilled in the art can conceive within the technical scope disclosed in the present disclosure should be included within the scope of protection of the present disclosure. Therefore, the scope of protection of the present disclosure should be based on the scope of protection of the claims.
Claims
1. An electronic device, comprising: Fingerprint recognition module, touch controller, processor, display driver and display module; The touch controller is configured to send a first control signal to the fingerprint recognition module in response to a heart rate detection instruction, so as to control the fingerprint recognition module to collect blood flow information in a user's blood vessel; The processor is configured to obtain the blood flow information, and determine the heart rate information of the user based on the blood flow information; and, generating a second control signal according to the heart rate information, and sending the second control signal to the display driver; The display driver is configured to generate a first display driving signal according to the second control signal to control the display module to alternately display a first image and a second image, wherein a switching frequency between the first image and the second image matches the heart rate information.
2. The electronic device according to claim 1, wherein: The first display driving signal includes a plurality of display cycles, each display cycle includes a display time of the first image and a display time of the second image; In one display period, the display brightness of the first image and the second image are different.
3. The electronic device according to claim 2, wherein: The first display driving signal includes a data signal, and a ratio of each data signal corresponding to the first image to each data signal corresponding to the second image is equal, and the ratio is not equal to 1.
4. The electronic device according to claim 3, wherein: A data voltage value corresponding to each data signal corresponding to the first image is different from a data voltage value corresponding to each data signal corresponding to the second image.
5. The electronic device according to claim 2, wherein: The first display driving signal includes a light emitting control signal, and a ratio of a duty cycle of each light emitting control signal corresponding to the first image and a ratio of a duty cycle of each light emitting control signal corresponding to the second image are equal, and the ratio is not equal to 1.
6. The electronic device according to claim 5, wherein: The number of operating levels of each light emitting control signal corresponding to the first image is different from the number of operating levels of each light emitting control signal corresponding to the second image.
7. The electronic device according to claim 5, wherein: The duration of the working level of each light emitting control signal corresponding to the first image is different from the duration of the working level of each light emitting control signal corresponding to the second image.
8. The electronic device according to claim 1, wherein: In a display cycle, the first image and the second image display different contents.
9. The electronic device according to any one of claims 1 to 8, wherein: The processor is further configured to count the heart rate parameters of the user within a set period according to the heart rate information, generate a third control signal including the heart rate parameters, and send the third control signal to the display driver; The display driver is further configured to generate a second display driving signal according to the third control signal to control the display module to display an image including the heart rate parameters on the first image and / or the second image.
10. The electronic device according to claim 9, wherein: The area of the image containing the heart rate parameters is smaller than the area of the first image and / or the second image.
11. The electronic device according to claim 9 or 10, wherein: In one display cycle, the display brightness of the image containing the heart rate parameters remains unchanged.
12. The electronic device according to any one of claims 1 to 11, wherein: The fingerprint recognition module collects blood flow information in the user's blood vessels including: collecting a plurality of images containing the blood flow information; After the processor determines the heart rate information, The touch controller is further configured to obtain a frame rate of the plurality of images containing blood flow information, and send the frame rate to the processor; The processor is further configured to send a vertical synchronization signal to the display driver, wherein the vertical synchronization signal is used to indicate a frame rate of the plurality of images containing the blood flow information; The display driver is further configured to generate a negative feedback signal according to a refresh rate of the display module and send the negative feedback signal to the processor; The processor is further configured to generate an adjustment signal according to the frame rate and the refresh rate; The display driver is further configured to adjust the refresh rate of the display module under the control of the adjustment signal so that the refresh rates of the first image and the second image displayed by the display module match the frame rate.
13. The electronic device according to any one of claims 1 to 12, wherein: The display driver is further configured to generate a third display driving signal according to the detection preparation instruction to control the display module to display a third image; The detection preparation instruction is issued before the heart rate detection instruction.
14. A heart rate detection method, comprising: The touch controller sends a first control signal to the fingerprint recognition module in response to the heart rate detection instruction, so as to control the fingerprint recognition module to collect blood flow information in the user's blood vessels; The processor acquires the blood flow information and determines the heart rate information of the user based on the blood flow information; the processor also generates a second control signal according to the heart rate information and sends the second control signal to the display driver; The display driver generates a first display driving signal according to the second control signal to control the display module to alternately display a first image and a second image, and a switching frequency between the first image and the second image matches the heart rate information.
15. The method according to claim 14, further comprising: The processor counts the heart rate parameters of the user within a set period according to the heart rate information, generates a third control signal including the heart rate parameters, and sends the third control signal to the display driver; The display driver generates a second display driving signal according to the third control signal to control the display module to display an image including the heart rate parameter on the first image and / or the second image.
16. The method according to claim 14 or 15, wherein: The display driver generates a third display driving signal according to the detection preparation instruction to control the display module to display a third image; the detection preparation instruction is issued before the heart rate detection instruction.
17. The method according to any one of claims 14 to 16, wherein: The fingerprint recognition module collects blood flow information in the user's blood vessels including: collecting a plurality of images containing the blood flow information; After the processor determines the heart rate information, The touch controller acquires the frame rates of the plurality of images containing blood flow information, and sends the frame rates to the processor; The processor sends a vertical synchronization signal to the display driver, wherein the vertical synchronization signal is used to indicate a frame rate of the plurality of images containing the blood flow information; The display driver generates a negative feedback signal according to the refresh rate of the display module and sends it to the processor; The processor generates an adjustment signal according to the frame rate and the refresh rate; The display driver adjusts the refresh rate of the display module under the control of the adjustment signal so that the refresh rates of the first image and the second image displayed by the display module match the frame rate.
18. A computer readable storage medium having computer program instructions stored thereon, wherein: When the computer program instructions are executed on a computer, the computer is caused to execute one or more steps of the heart rate detection method according to any one of claims 14 to 17.