Heart rate detection method and device, computer readable storage medium and electronic device

Abstract

The present disclosure provides a heart rate detection method, a heart rate detection device, a computer readable storage medium and an electronic device, which are applied to a mobile terminal and relate to the technical field of computers. The heart rate detection method comprises: in response to a heart rate detection trigger event, acquiring a ballistocardiogram signal and detecting a user motion state according to the ballistocardiogram signal; and in the case that the user motion state meets the heart rate detection requirement, determining a heart rate by using the acquired ballistocardiogram signal. The present disclosure can expand the range of devices used for detecting heart rates.

Description

Technical Field

[0001] This disclosure relates to the field of computer technology, and more specifically, to a heart rate detection method, a heart rate detection device, a computer-readable storage medium, and an electronic device. Background Technology

[0002] As one of the important biological indicators of the human body, heart rate can reflect a user's physiological condition. Currently, some technologies use PPG (photoplethysmograph) to detect blood fluctuations and calculate heart rate.

[0003] However, the survey found that some users were not comfortable with PPG-based heart rate detection. Summary of the Invention

[0004] This disclosure provides a heart rate detection method, a heart rate detection device, a computer-readable storage medium, and an electronic device, thereby overcoming, at least to some extent, the problem that some users are not comfortable with current heart rate detection methods.

[0005] According to a first aspect of this disclosure, a heart rate detection method is provided for use in a mobile terminal. The heart rate detection method includes: responding to a heart rate detection trigger event, acquiring a cardiac impulse signal, and detecting the user's motion state based on the cardiac impulse signal; and determining the heart rate using the acquired cardiac impulse signal when the user's motion state meets the heart rate detection requirements.

[0006] According to a second aspect of this disclosure, a heart rate detection method is provided, applied to a mobile terminal. The heart rate detection method includes: responding to a heart rate detection trigger operation, acquiring a cardiac impulse signal, and detecting the user's movement state based on the cardiac impulse signal; issuing a reminder message if the user's movement state does not meet the heart rate detection requirements; displaying multiple heart rate detection results after a predetermined time if the user's movement state meets the heart rate detection requirements; determining a final heart rate detection result based on the multiple heart rate detection results, and displaying the final heart rate detection result.

[0007] According to a third aspect of this disclosure, a heart rate detection device is provided, which is applied to a mobile terminal, comprising: a motion detection module, configured to respond to a heart rate detection trigger event, acquire a cardiac impact signal, and detect the user's motion state based on the cardiac impact signal; and a heart rate determination module, configured to determine the heart rate using the acquired cardiac impact signal when the user's motion state meets the heart rate detection requirements.

[0008] According to a fourth aspect of this disclosure, a heart rate detection device is provided, applied to a mobile terminal, comprising: a trigger response module, configured to respond to a heart rate detection trigger operation, acquire a cardiac impulse signal, and detect the user's movement state based on the cardiac impulse signal, and issue a reminder message if the user's movement state does not meet the heart rate detection requirements; a first result display module, configured to display multiple heart rate detection results after a predetermined time if the user's movement state meets the heart rate detection requirements; and a second result display module, configured to determine a final heart rate detection result based on the multiple heart rate detection results and display the final heart rate detection result.

[0009] According to a fifth aspect of this disclosure, a computer-readable storage medium is provided having a computer program stored thereon that, when executed by a processor, implements the heart rate detection method described above.

[0010] According to a sixth aspect of this disclosure, an electronic device is provided, including a processor and a memory for storing one or more programs, which, when executed by the processor, cause the electronic device to implement the heart rate detection method described above.

[0011] In some embodiments of this disclosure, the mobile terminal responds to a heart rate detection trigger event, acquires a cardiac impact signal, detects the user's motion state based on the cardiac impact signal, and determines the heart rate using the acquired cardiac impact signal when the user's motion state meets the heart rate detection requirements. On one hand, this disclosure's solution determines the heart rate based on the cardiac impact signal, which is more user-friendly for users who are not comfortable with light detection, thus improving the utilization rate of the mobile terminal's heart rate detection function and expanding the range of devices used for heart rate detection. On the other hand, this disclosure's solution first detects the user's motion state, and then determines the heart rate when the user's motion state meets the heart rate detection requirements. Therefore, it avoids the influence of user motion on the cardiac impact signal, improving the accuracy of heart rate detection.

[0012] It should be understood that the above general description and the following detailed description are exemplary and explanatory only, and are not intended to limit this disclosure. Attached Figure Description

[0013] The accompanying drawings, which are incorporated in and form part of this specification, illustrate embodiments consistent with this disclosure and, together with the description, serve to explain the principles of this disclosure. It is obvious that the drawings described below are merely some embodiments of this disclosure, and those skilled in the art can obtain other drawings based on these drawings without any inventive effort. In the drawings:

[0014] Figure 1 A schematic diagram of an internal impulse signal during a sampling period is shown;

[0015] Figure 2 A schematic diagram of a mobile terminal including the heart rate detection function according to an embodiment of the present disclosure is shown;

[0016] Figure 3 A flowchart illustrating a heart rate detection method according to an exemplary embodiment of the present disclosure is shown schematically;

[0017] Figure 4 A schematic diagram of the interface for displaying intermediate heart rate detection results on a mobile terminal according to an embodiment of the present disclosure is shown;

[0018] Figure 5 A schematic diagram of the interface for displaying the final heart rate detection result on a mobile terminal according to an embodiment of the present disclosure is shown;

[0019] Figure 6 An interactive schematic diagram of heart rate detection according to an embodiment of this disclosure is shown;

[0020] Figure 7 A flowchart illustrating a heart rate detection method according to another exemplary embodiment of this disclosure is shown schematically;

[0021] Figure 8 A block diagram of a heart rate detection device according to a first exemplary embodiment of the present disclosure is shown schematically;

[0022] Figure 9 A block diagram of a heart rate detection device according to a second exemplary embodiment of the present disclosure is shown schematically;

[0023] Figure 10 A block diagram of a heart rate detection device according to a third exemplary embodiment of the present disclosure is shown schematically;

[0024] Figure 11 A block diagram of a heart rate detection device according to a fourth exemplary embodiment of the present disclosure is shown schematically;

[0025] Figure 12 A block diagram of a heart rate detection device according to a fifth exemplary embodiment of the present disclosure is shown schematically;

[0026] Figure 13 A block diagram of a heart rate detection device according to a sixth exemplary embodiment of the present disclosure is shown schematically;

[0027] Figure 14 A block diagram of an electronic device according to an exemplary embodiment of the present disclosure is shown schematically. Detailed Implementation

[0028] Example embodiments will now be described more fully with reference to the accompanying drawings. However, example embodiments can be implemented in many forms and should not be construed as limited to the examples set forth herein; rather, these embodiments are provided to make this disclosure more comprehensive and complete, and to fully convey the concept of the example embodiments to those skilled in the art. The described features, structures, or characteristics can be combined in any suitable manner in one or more embodiments. In the following description, numerous specific details are provided to give a full understanding of embodiments of this disclosure. However, those skilled in the art will recognize that the technical solutions of this disclosure can be practiced with one or more of the specific details omitted, or other methods, components, apparatus, steps, etc., can be employed. In other instances, well-known technical solutions are not shown or described in detail to avoid obscuring various aspects of this disclosure.

[0029] Furthermore, the accompanying drawings are merely illustrative of this disclosure and are not necessarily drawn to scale. The same reference numerals in the drawings denote the same or similar parts, and therefore repeated descriptions of them will be omitted. Some block diagrams shown in the drawings are functional entities and do not necessarily correspond to physically or logically independent entities. These functional entities may be implemented in software, in one or more hardware modules or integrated circuits, or in different network and / or processor devices and / or microcontroller devices.

[0030] The flowcharts shown in the accompanying drawings are merely illustrative and do not necessarily include all steps. For example, some steps may be broken down, while others may be combined or partially combined; therefore, the actual execution order may change depending on the specific circumstances. Furthermore, all terms such as "first," "second," and "third" used below are for distinction purposes only and should not be construed as limiting the scope of this disclosure.

[0031] In some technologies, PPG detection is used to detect a user's heart rate. However, some users are not used to the lighting conditions used in PPG detection, resulting in low usage of the heart rate detection function and hindering product promotion.

[0032] This disclosure provides a novel heart rate detection scheme based on cardiac impulse signals and combined with a strategy for detecting and displaying responses. The heart rate detection process is simple, easy to implement, and highly accurate.

[0033] Ballistocardiogram (BCG) signals are physiological signals reflecting the vibrations in the body caused by the heartbeat. Data can be collected in a non-intrusive, non-contact manner. In normal individuals, the BCG signal is synchronized with the heartbeat and is repetitive.

[0034] Figure 1An example is shown, illustrating the curve of a periodic internal impulse signal. (Reference) Figure 1 The curve can include characteristic positions such as H, I, J, K, L, M, and N, which correspond to the extreme points of the cardiac impact signal. Among them, point J corresponds to the peak with the largest amplitude. Therefore, by calculating the interval between the peaks at point J in two adjacent sampling periods as a heartbeat cycle, the real-time heart rate can be determined using this heartbeat cycle. In addition, the difference between I and J in each cycle can represent the magnitude of the contractile force of the heart pumping blood.

[0035] It should be noted that, Figure 1 The figure only shows the curve of the cardiac impact signal corresponding to one sampling period. With continuous sampling, a continuous cardiac impact signal can be obtained, and thus the real-time heart rate can be detected.

[0036] Figure 2 A schematic block diagram of a mobile terminal implementing the heart rate detection scheme of the present disclosure is shown.

[0037] refer to Figure 2 The mobile terminal 2 may include a heart rate detection device 20, a user interface 21, and a sensor 22. The user interface 21 may include, but is not limited to, a touchscreen, and the sensor 22 may include an inertial sensor, which may include an accelerometer and / or a gyroscope. Additionally, the sensor 22 may also include a piezoelectric sensor.

[0038] In this disclosed heart rate detection scheme, firstly, the user can trigger a heart rate detection event through the user interaction terminal 21. For example, the user clicks to enter the heart rate detection interface.

[0039] Next, the heart rate detection device 20 can respond to a heart rate detection trigger event and acquire sensing data from the sensor 22 to achieve real-time acquisition of cardiac impulse signals. For example, accelerometers and gyroscopes can acquire similar data. Figure 1 The cardiac impact signal shown is illustrated. For example, piezoelectric sensors can convert periodic human vibration signals into signals such as... Figure 1 The cardiac impact signal shown.

[0040] Subsequently, the heart rate detection device 20 can detect the user's exercise state based on the cardiac impact signal. If the user's exercise state meets the heart rate detection requirements, the heart rate detection device 20 uses the real-time acquired cardiac impact signal to determine the heart rate and displays the determined heart rate to the user through the user interaction terminal 21.

[0041] The heart rate detection method of this disclosure is executed by a mobile terminal, meaning that the mobile terminal can execute each step of the heart rate detection method of this disclosure. In this case, the heart rate detection device described below can be configured in the mobile terminal.

[0042] The mobile terminals described in this disclosure include, but are not limited to, smartphones, tablets, and smart wearable devices.

[0043] Figure 3 A flowchart illustrating an exemplary embodiment of a heart rate detection method according to this disclosure is shown schematically. Reference Figure 3 The heart rate detection method may include the following steps:

[0044] S32. Respond to the heart rate detection trigger event, acquire the cardiac impact signal, and detect the user's movement status based on the cardiac impact signal.

[0045] In exemplary embodiments of this disclosure, the heart rate detection trigger event can be any event used to trigger the heart rate detection process; that is, when the heart rate detection trigger event occurs, the heart rate detection process of this disclosure begins to execute. This disclosure does not limit the heart rate detection trigger event; for example, in the health app interface of a mobile terminal, the user clicks the heart rate detection button; or, for example, the mobile terminal enters the heart rate detection interface.

[0046] In an exemplary embodiment of this disclosure, the user's motion state can characterize the degree of swaying of the user's body.

[0047] When a heart rate detection event is detected on the mobile terminal, the cardiac impulse signal can be acquired. Specifically, the cardiac impulse signal can be acquired in real time.

[0048] According to some embodiments of this disclosure, a mobile terminal can obtain cardiac impact signals by means of its equipped inertial sensors. The inertial sensors may include accelerometers and / or gyroscopes. Accelerometers and gyroscopes can acquire cardiac impact signals of the same form, one cycle of which is as follows: Figure 1 As shown.

[0049] In addition, in response to a heart rate detection trigger event, the parameters of the inertial sensor can be adjusted, and the cardiac impulse signal can be determined based on the adjusted inertial sensor values. Specifically, the range of the inertial sensor can be reduced to decrease data noise and improve the accuracy of heart rate detection.

[0050] It should be noted that in the embodiment of adjusting parameter values, after the final heart rate detection result is determined, that is, after the heart rate detection is stopped, the parameters can be restored to the parameter values ​​before adjustment to meet the needs of other scenarios (e.g., step count measurement).

[0051] Since most mobile devices are equipped with inertial sensors, using the sensing results of inertial sensors for heart rate detection also reduces hardware costs.

[0052] According to other embodiments of this disclosure, the mobile terminal can also obtain cardiac impact signals by means of a piezoelectric sensor it is equipped with. The heartbeat causes periodic vibrations in the user's body, and the piezoelectric sensor can convert these periodic vibrations into cardiac impact signals.

[0053] Similarly, in response to a heart rate detection trigger event, the parameter values ​​of the piezoelectric sensor can be adjusted, and after the heart rate detection result is determined, the parameters can be restored to the previous values.

[0054] After the cardiac impact signal is determined, the mobile terminal can detect the user's motion status based on the real-time acquired cardiac impact signal.

[0055] According to some embodiments of this disclosure, firstly, a mobile terminal can extract feature points from a cardiac impact signal, wherein the feature points include extreme points of the cardiac impact signal. For example, corresponding to... Figure 1 The feature locations shown are H, I, J, K, L, M, N, etc.

[0056] Next, the mobile terminal calculates motion evaluation values ​​based on feature points, for example, using the interval between the peaks of point J in two adjacent cycles as the motion evaluation value. In this case, the time corresponding to the interval is used to characterize the motion evaluation value.

[0057] Then, the exercise evaluation value is compared with the exercise threshold, and the user's exercise status is determined based on the comparison result. Specifically, if the exercise evaluation value is less than the exercise threshold, it means that the user is not shaking or the shaking degree is small, and the user's exercise status meets the requirements for heart rate detection; if the exercise evaluation value is greater than or equal to the exercise threshold, it means that the user is shaking a lot, and the user's exercise status does not meet the requirements for heart rate detection.

[0058] This disclosure does not impose any restrictions on the motion threshold. In the case where time is used as the criterion for judgment, the motion threshold can be a preset time threshold.

[0059] According to other embodiments of this disclosure, the user's motion state can be determined using the energy value generated by the sensor. Taking an inertial sensor as an example, the energy value generated by the sensor can be characterized by the following formula:

[0060]

[0061] Where x, y, and z are the data generated by each axis of the accelerometer or gyroscope sensor, and N represents the total number of data points calculated.

[0062] Similarly, an energy threshold can be preset, and the calculated energy value can be compared with the energy threshold to determine the user's motion state based on the comparison result.

[0063] Furthermore, if, within a first preset time period after the heart rate detection trigger event occurs, the heart rate detection is stopped if the user's movement state does not meet the heart rate detection requirements, then the heart rate detection is stopped. In some embodiments, in this case, the mobile terminal may output an interface indicating that there is no detection result or the detection has failed.

[0064] This disclosure does not limit the specific value of the first preset time period. For example, the first preset time period can be set to 60 seconds. That is, in response to the heart rate detection trigger event, a 60-second countdown is started. If, during the countdown, the user's movement state is found to be inconsistent with the heart rate detection requirements, the mobile terminal stops heart rate detection when the countdown ends. If, during the countdown, the user's movement state is found to be consistent with the heart rate detection requirements, the countdown is canceled or stopped to proceed with the subsequent heart rate detection process of this disclosure.

[0065] Additionally, within the first preset time period after the heart rate detection trigger event, if the user's movement status is detected as not meeting the heart rate detection requirements, a reminder message will be issued. This reminder message may take the form of one or a combination of voice announcements, text messages, or mobile device vibration, to remind the user to remain still.

[0066] Regarding the timing of issuing reminder messages, in one embodiment, a reminder message can be issued every time the user's activity status is detected as not meeting the heart rate detection requirements. In another embodiment, a reminder message can be issued at predetermined intervals (e.g., 5 seconds) to reduce user annoyance.

[0067] S34. When the user's exercise state meets the heart rate detection requirements, the heart rate is determined using the acquired cardiac impact signal.

[0068] Regarding the process of determining heart rate using cardiac impact signals, as mentioned above, the time interval between the extreme points of maximum amplitude in each sampling period can be used for estimation.

[0069] For continuous cardiac impulse signals, filtering processes such as bandpass filtering can be used to identify signals generated over a period of time. Figure 1 The heart rate value can be obtained by determining the number of impact peaks shown, or by using Fourier transform to determine the frequency of the heart rate in the frequency domain.

[0070] Once the mobile terminal determines that the user's activity state meets the heart rate detection requirements, the heart rate can be determined using the real-time acquired cardiac impulse signal. In other words, the cardiac impulse signal used to determine the heart rate is the one acquired in real time after the heart rate detection requirements are met.

[0071] Starting from the moment the user's exercise state begins to meet the heart rate detection requirements, cardiac impulse signals over a second preset time period are acquired in real time. Based on the cardiac impulse signals within this second preset time period, a first heart rate detection result is determined and displayed. This disclosure does not limit the second preset time period; for example, it can be within 8 seconds from the moment the heart rate detection requirements are met. That is, timing begins from the moment the user's exercise state begins to meet the heart rate detection requirements, and the first heart rate detection result is determined using the cardiac impulse signals acquired within these 8 seconds. For the user, the first heart rate detection result displayed on the mobile terminal can be seen 8 seconds after the user's exercise state begins to meet the heart rate detection requirements. Furthermore, in some embodiments, the second preset time period may be consistent with the aforementioned first preset time period.

[0072] The heart rate detection results described in this disclosure include at least a heart rate value. In addition, they may include normal or abnormal detection states. Specifically, a normal detection state corresponds to a user's activity state that meets the heart rate detection requirements; an abnormal detection state corresponds to a user's activity state that does not meet the heart rate detection requirements.

[0073] In some embodiments of this disclosure, the mobile terminal can denoise the cardiac impact signal within a second preset time period and determine a first heart rate detection result based on the denoised cardiac impact signal. For example, the cardiac impact signal can be denoised using a motion threshold. The motion threshold used here can be different from or the same as the motion threshold used to determine whether the heart rate detection requirements are met. This disclosure does not impose any restrictions on this.

[0074] The first heart rate reading is the first heart rate result displayed to the user. By using cardiac impulse signals within a second preset time period to determine the first heart rate reading for display, this method of accumulating data and performing statistical analysis improves the reliability of the displayed heart rate results.

[0075] After the second preset time period, the mobile terminal continues to acquire cardiac impulse signals in real time. Using these signals, a second heart rate detection result is determined and displayed in real time. It should be noted that because the second heart rate detection result is determined in real time, there are multiple possible second heart rate detection results. This means the mobile terminal can continuously refresh the display interface to continuously show the determined second heart rate detection results in real time.

[0076] According to some embodiments of this disclosure, the mobile terminal can compare the heart rate value included in the second heart rate detection result with a heart rate threshold range in real time, and count the number of heart rate values ​​within the heart rate threshold range. That is, once a heart rate value falls into the heart rate threshold range, the count is incremented by 1, and the number of heart rate values ​​within the heart rate threshold range is determined in real time by accumulation. This disclosure does not limit the heart rate threshold range; it can be a pre-set threshold range representing the accuracy of the heart rate value. That is, if the heart rate value falls into the heart rate threshold range, it indicates that the heart rate value is accurate; if it does not fall into the heart rate threshold range, it indicates that the user may be shaking, causing a decrease in the accuracy of the heart rate value.

[0077] When the number of heart rate values ​​within the heart rate threshold range is greater than or equal to the quantity threshold, the mobile terminal can determine a third heart rate detection result based on the first and second heart rate detection results, stop heart rate detection, and display the third heart rate detection result. The third heart rate detection result is the final determined heart rate detection result. Furthermore, this embodiment does not limit the specific value of the quantity threshold.

[0078] Specifically, the heart rate values ​​contained in the first heart rate detection result and the heart rate values ​​contained in the second heart rate detection result can be obtained, and the average of the heart rate values ​​contained in the first heart rate detection result and the second heart rate detection result can be calculated as the heart rate value contained in the third heart rate detection result.

[0079] Understandably, if the number of heart rate values ​​within the heart rate threshold range is less than the number threshold, the process of determining and displaying the second heart rate detection result continues.

[0080] According to some other embodiments of this disclosure, the mobile terminal can compare the heart rate value contained in the second heart rate detection result with the heart rate threshold range in real time, and count the number of heart rate values ​​within the heart rate threshold range.

[0081] Within a third preset time period following the second preset time period, if the number of heart rate values ​​within the heart rate threshold range is greater than or equal to the number threshold, then when the number of heart rate values ​​within the heart rate threshold range is greater than or equal to the number threshold, the mobile terminal can determine a third heart rate detection result based on the first and second heart rate detection results, stop heart rate detection, and display the third heart rate detection result. In this embodiment, the third preset time period is not limited; for example, it can be 17 seconds from the end of the second preset time period. Alternatively, a total time period, such as 25 seconds, can be pre-configured, and this 25 seconds can be divided into the second and third preset time periods to execute different processing procedures.

[0082] After a third preset time period following a second preset time period, if the number of heart rate values within the heart rate threshold range is less than the number threshold, the mobile terminal can determine a third heart rate detection result according to the first heart rate detection result and the second heart rate detection result, stop heart rate detection and display the third heart rate detection result. That is, even if the number of high-accuracy heart rate values does not reach the number threshold, the mobile terminal will also calculate the third heart rate detection result when the third preset time period ends.

[0083] Similarly, in these embodiments, the third heart rate detection result is the finally determined heart rate detection result. In addition, the mobile terminal can calculate the average value of the heart rate values included in the first heart rate detection result and the heart rate values included in the second heart rate detection result, and use the average value as the heart rate value included in the third heart rate detection result.

[0084] According to some other embodiments of the present disclosure, after a third preset time period following a second preset time period, the mobile terminal can determine a third heart rate detection result according to the first heart rate detection result and the second heart rate detection result, stop heart rate detection and display the third heart rate detection result.

[0085] Similarly, in these embodiments, the third heart rate detection result is the finally determined heart rate detection result. In addition, the mobile terminal can calculate the average value of the heart rate values included in the first heart rate detection result and the heart rate values included in the second heart rate detection result, and use the average value as the heart rate value included in the third heart rate detection result.

[0086] Furthermore, in the above embodiments where the third heart rate detection result is determined, the mobile terminal can also acquire heart rate health information corresponding to the third heart rate detection result and display the heart rate health information. Wherein, the heart rate health information includes but is not limited to causes of high heart rate and corresponding health reminders, causes of low heart rate and corresponding health reminders, and popular science information about heart rate.

[0087] When the heart rate health information is obtained through web search, the source of the heart rate health information can also be displayed, which is not limited in the present disclosure.

[0088] To better illustrate the effects of the embodiments of the present disclosure, Figure 4 a schematic diagram of an interface for displaying an intermediate heart rate detection result by the mobile terminal according to an embodiment of the present disclosure is shown, wherein the intermediate heart rate detection result may be the aforementioned first heart rate detection result or the second heart rate detection result.

[0089] Reference is made to Figure 4 , in addition to the real-time detected heart rate value, the interface of the mobile terminal can also display the remaining detection time, which corresponds to the countdown result of the aforementioned third preset time period. In addition, prompt text such as "Please keep still and do not speak" can also be displayed to ensure the accuracy of heart rate testing as much as possible.

[0090] Figure 5 A schematic diagram of the interface of a mobile terminal displaying the final heart rate detection result is shown in an embodiment of the present disclosure. The final heart rate detection result corresponds to the third heart rate detection result described above.

[0091] refer to Figure 5 In addition to displaying the average heart rate value of this test, the mobile terminal interface can also display information such as the test time and heart rate science.

[0092] Furthermore, before the final heart rate detection result is determined, the mobile terminal can respond to a heart rate detection stop time and stop heart rate detection. This heart rate detection stop event can be the mobile terminal's onPause event, for example, when the heart rate test interface returns to the background, or when the user clicks a notification to switch to another application or task. This disclosure does not impose specific limitations on heart rate detection events.

[0093] The following will refer to Figure 6 The interactive process of detecting heart rate in an embodiment of this disclosure is described by way of example.

[0094] In step S602, the user uses the AI ​​(Artificial Intelligence) assistant on the mobile terminal to determine whether the mobile terminal supports heart rate detection.

[0095] In step S604, when the AI ​​assistant determines that the mobile terminal supports heart rate detection, it will launch the corresponding health app and begin heart rate detection.

[0096] In step S606, the health app will execute a countdown timer of 60 seconds, meaning that the heart rate detection task will end after 60 seconds.

[0097] In step S608, the health app registers the sensors with the system.

[0098] In step S610, the system activates the sensor for sensing and controls it to automatically shut down after 90 seconds.

[0099] In step S612, the system can return the data sensed by the sensor to the health app.

[0100] In step S614, the health app sends the data used to calculate the heart rate to the algorithm module of this embodiment of the disclosure, and the algorithm module calculates the heart rate.

[0101] In step S616, the algorithm module returns the heart rate result to the health app.

[0102] In step S618, the health app displays the heart rate results to the user through the interface and can store the heart rate results in the database for subsequent heart rate comparison, analysis and other tasks.

[0103] The heart rate detection method of this disclosure utilizes inertial sensors or piezoelectric sensors typically equipped in mobile terminals to obtain cardiac impulse signals, expanding the range of devices that can be used for heart rate detection. This is particularly beneficial for users who are not comfortable with PPG light detection, improving product usability. Furthermore, the heart rate determination strategy based on the above embodiments can improve the accuracy of heart rate detection.

[0104] Furthermore, this disclosure also provides another heart rate detection method for mobile terminals, referencing... Figure 7 The heart rate detection method may include the following steps:

[0105] S72. Respond to the heart rate detection trigger operation, acquire the cardiac impact signal, and detect the user's movement status based on the cardiac impact signal. If the user's movement status does not meet the heart rate detection requirements, issue a reminder message.

[0106] In exemplary embodiments of this disclosure, the heart rate detection trigger event can be any event used to trigger the heart rate detection process; that is, when the heart rate detection trigger event occurs, the heart rate detection process of this disclosure begins to execute. This disclosure does not limit the heart rate detection trigger event; for example, in the health app interface of a mobile terminal, the user clicks the heart rate detection button; or, for example, the mobile terminal enters the heart rate detection interface.

[0107] The form of the reminder message may include one or a combination of voice broadcast, text message reminder, and mobile terminal vibration, to remind the user to keep their body still.

[0108] S74. If the user's exercise state meets the heart rate detection requirements, after a predetermined time, display multiple heart rate detection results respectively.

[0109] This predetermined duration can correspond to the second preset time period mentioned above. For example, starting from the moment when the user's exercise state begins to meet the heart rate detection requirements, after 8 seconds, the mobile terminal can continuously display multiple heart rate detection results, for example, by refreshing the interface.

[0110] S76. Determine the final heart rate detection result based on multiple heart rate detection results, and display the final heart rate detection result.

[0111] As described in step S34 above, by limiting the number of heart rate values ​​within the third preset time period and / or the number of heart rate values ​​within the heart rate threshold range, the final heart rate detection result can be determined based on the determined multiple heart rate detection results, and the final heart rate detection result can be displayed on the interface. That is to say, the content displayed at this time is locked, even the final heart rate detection result.

[0112] Taking a mobile phone as an example, a user holds the phone and clicks the heart rate detection button on the health app interface to enter the heart rate detection page. At this time, the phone continuously judges whether the user's exercise state meets the heart rate detection requirements through data sensed by the inertial sensor. If the heart rate detection requirements are met, the heart rate is determined through cardiac impulse signals.

[0113] For users, after clicking to enter the heart rate detection page, if the user's exercise status meets the heart rate detection requirements, the mobile phone page will refresh the heart rate detection results in real time after a predetermined period of time, and finally display a fixed final heart rate detection result, thus ending the heart rate detection.

[0114] It should be noted that although the steps of the method in this disclosure are described in a specific order in the accompanying drawings, this does not require or imply that the steps must be performed in that specific order, or that all the steps shown must be performed to achieve the desired result. Additional or alternative steps may be omitted, multiple steps may be combined into one step, and / or a step may be broken down into multiple steps.

[0115] Furthermore, this example embodiment also provides a heart rate detection device for use in a mobile terminal.

[0116] Figure 8 A block diagram of a heart rate detection device according to an exemplary embodiment of the present disclosure is illustrated schematically. Reference Figure 8 The heart rate detection device 8 according to an exemplary embodiment of the present disclosure may include a motion detection module 81 and a heart rate determination module 83.

[0117] Specifically, the motion detection module 81 can be used to respond to a heart rate detection trigger event, acquire a cardiac impact signal, and detect the user's motion state based on the cardiac impact signal; the heart rate determination module 83 can be used to determine the heart rate using the acquired cardiac impact signal when the user's motion state meets the heart rate detection requirements.

[0118] According to exemplary embodiments of this disclosure, reference is made to Figure 9 Compared to the heart rate detection device 8, the heart rate detection device 9 may also include a detection stop module 91.

[0119] Specifically, the detection stop module 91 can be configured to: within the first preset time period after the heart rate detection trigger event occurs, if it is detected that the user's movement state does not meet the heart rate detection requirements, then stop the heart rate detection.

[0120] According to exemplary embodiments of this disclosure, reference is made to Figure 10 Compared to the heart rate detection device 9, the heart rate detection device 10 may also include an alert module 101.

[0121] Specifically, the reminder module 101 can be configured to: within a first preset time period after the heart rate detection trigger event occurs, if it is detected that the user's exercise state does not meet the heart rate detection requirements, then issue a reminder message.

[0122] According to an exemplary embodiment of this disclosure, the motion detection module 81 can be configured to perform: extracting feature points from a cardiac impact signal, the feature points including extreme points of the cardiac impact signal; calculating a motion evaluation value based on the feature points; comparing the motion evaluation value with a motion threshold, and determining the user's motion state based on the comparison result; wherein, if the motion evaluation value is less than the motion threshold, the user's motion state meets the heart rate detection requirements.

[0123] According to an exemplary embodiment of this disclosure, the heart rate determination module 83 can be configured to perform: acquiring cardiac impulse signals within a second preset time period in real time from the moment when the user's exercise state begins to meet the heart rate detection requirements; determining a first heart rate detection result based on the cardiac impulse signals within the second preset time period; and displaying the first heart rate detection result.

[0124] According to an exemplary embodiment of the present disclosure, the process by which the heart rate determination module 83 determines the first heart rate detection result can be configured to perform: denoising the cardiac impulse signal within a second preset time period, and determining the first heart rate detection result based on the denoised cardiac impulse signal.

[0125] According to an exemplary embodiment of the present disclosure, the heart rate determination module 83 may also be configured to perform: after a second preset time period, acquire a cardiac impulse signal in real time; use the acquired cardiac impulse signal to determine a second heart rate detection result, and display the second heart rate detection result in real time.

[0126] According to an exemplary embodiment of the present disclosure, the heart rate determination module 83 may also be configured to perform: comparing the heart rate value contained in the second heart rate detection result with a heart rate threshold range; when the number of heart rate values ​​within the heart rate threshold range is greater than or equal to a quantity threshold, determining a third heart rate detection result based on the first heart rate detection result and the second heart rate detection result, stopping heart rate detection and displaying the third heart rate detection result.

[0127] According to an exemplary embodiment of this disclosure, the heart rate determination module 83 may further be configured to perform: comparing the heart rate value contained in the second heart rate detection result with a heart rate threshold range; within a third preset time period after the second preset time period, if the number of heart rate values ​​within the heart rate threshold range is greater than or equal to a quantity threshold, then when the number of heart rate values ​​within the heart rate threshold range is greater than or equal to the quantity threshold, determining a third heart rate detection result based on the first heart rate detection result and the second heart rate detection result, stopping heart rate detection, and displaying the third heart rate detection result; after the third preset time period after the second preset time period, if the number of heart rate values ​​within the heart rate threshold range is less than a quantity threshold, then determining a third heart rate detection result based on the first heart rate detection result and the second heart rate detection result, stopping heart rate detection, and displaying the third heart rate detection result.

[0128] According to an exemplary embodiment of the present disclosure, the heart rate determination module 83 may also be configured to perform: after a third preset time period following a second preset time period, determine a third heart rate detection result based on the first heart rate detection result and the second heart rate detection result, stop heart rate detection, and display the third heart rate detection result.

[0129] According to an exemplary embodiment of the present disclosure, the process by which the heart rate determination module 83 determines the third heart rate detection result can be configured to perform: obtaining the heart rate value contained in the first heart rate detection result and the heart rate value contained in the second heart rate detection result; calculating the average of the heart rate value contained in the first heart rate detection result and the heart rate value contained in the second heart rate detection result as the heart rate value contained in the third heart rate detection result.

[0130] According to an exemplary embodiment of this disclosure, the heart rate determination module 83 may also be configured to perform: upon determining a third heart rate detection result, acquire heart rate health information corresponding to the third heart rate detection result and display the heart rate health information.

[0131] According to an exemplary embodiment of this disclosure, the detection stop module 91 may also be configured to perform: in response to a heart rate detection stop event, stop heart rate detection.

[0132] According to exemplary embodiments of this disclosure, reference is made to Figure 11 Compared to the heart rate detection device 8, the heart rate detection device 11 may also include a parameter adjustment module 111.

[0133] Specifically, the parameter adjustment module 111 can be configured to: respond to a heart rate detection trigger event, adjust the parameter values ​​of the mobile terminal's sensor to determine the cardiac impulse signal based on the sensor's sensing results after adjusting the parameter values; and restore the sensor parameters to the parameter values ​​before adjustment after stopping heart rate detection.

[0134] According to exemplary embodiments of the present disclosure, the sensors of the mobile terminal include inertial sensors or piezoelectric sensors.

[0135] Furthermore, this example embodiment also provides another heart rate detection device for use in mobile terminals.

[0136] Figure 12 A block diagram of a heart rate detection device according to another exemplary embodiment of this disclosure is illustrated schematically. (Reference) Figure 12 According to an exemplary embodiment of the present disclosure, the heart rate detection device 12 may include a trigger response module 121, a first result display module 123, and a second result display module 125.

[0137] Specifically, the trigger response module 121 can be used to respond to the heart rate detection trigger operation, acquire the cardiac impact signal, and detect the user's movement state based on the cardiac impact signal. If the user's movement state does not meet the heart rate detection requirements, a reminder message is issued. The first result display module 123 can be used to display multiple heart rate detection results after a predetermined time when the user's movement state meets the heart rate detection requirements. The second result display module 125 can be used to determine the final heart rate detection result based on the multiple heart rate detection results and display the final heart rate detection result.

[0138] According to an exemplary embodiment of this disclosure, the heart rate detection triggering operation includes the user clicking to enter the heart rate detection interface.

[0139] According to exemplary embodiments of this disclosure, reference is made to Figure 13 Compared to the heart rate detection device 12, the heart rate detection device 13 may also include an interface exit module 131.

[0140] Specifically, the interface exit module 131 can be configured to perform: respond to the heart rate detection stop operation and exit the heart rate detection interface.

[0141] Since the functional modules of the heart rate detection device in this embodiment are the same as those in the above-described method embodiments, they will not be described again here.

[0142] Figure 14 A schematic diagram is shown that is suitable for implementing exemplary embodiments of the present disclosure. The mobile terminal of the exemplary embodiments of the present disclosure can be configured as follows: Figure 14 In the form of. It should be noted that, Figure 14 The electronic device shown is merely an example and should not be construed as limiting the functionality and scope of the embodiments disclosed herein.

[0143] The electronic device disclosed herein includes at least a processor and a memory, the memory being used to store one or more programs, which, when executed by the processor, enable the electronic device to implement the heart rate detection method of the exemplary embodiments of this disclosure.

[0144] Specifically, such as Figure 14 As shown, the electronic device 140 may include: a processor 1410, internal memory 1421, external memory interface 1422, Universal Serial Bus (USB) interface 1430, charging management module 1440, power management module 1441, battery 1442, antenna 1, antenna 2, mobile communication module 1450, wireless communication module 1460, audio module 1470, sensor module 1480, display screen 1490, camera module 1491, indicator 1492, motor 1493, buttons 1494, and a Subscriber Identification Module (SIM) card interface 1495, etc. The sensor module 1480 may include depth sensors, pressure sensors, gyroscope sensors, barometric pressure sensors, magnetic sensors, accelerometers, distance sensors, proximity sensors, fingerprint sensors, temperature sensors, piezoelectric sensors, touch sensors, ambient light sensors, and bone conduction sensors, etc.

[0145] It is understood that the structures illustrated in the embodiments of this disclosure do not constitute a specific limitation on the electronic device 140. In other embodiments of this disclosure, the electronic device 140 may include more or fewer components than illustrated, or combine some components, or split some components, or have different component arrangements. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

[0146] Processor 1410 may include one or more processing units, such as an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural network processing unit (NPU). Different processing units may be independent devices or integrated into one or more processors. Additionally, processor 1410 may include memory for storing instructions and data.

[0147] Internal memory 1421 can be used to store computer executable program code, including instructions. Internal memory 1421 may include a program storage area and a data storage area. External memory interface 1422 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of electronic device 140.

[0148] This disclosure also provides a computer-readable storage medium, which may be included in the electronic device described in the above embodiments; or it may exist independently and not assembled into the electronic device.

[0149] Computer-readable storage media can be, for example—but not limited to—electrical, magnetic, optical, electromagnetic, infrared, or semiconductor systems, apparatuses, or devices, or any combination thereof. More specific examples of computer-readable storage media may include, but are not limited to: electrical connections having one or more wires, portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination thereof. In this disclosure, a computer-readable storage medium can be any tangible medium that contains or stores a program that can be used by or in conjunction with an instruction execution system, apparatus, or device.

[0150] A computer-readable storage medium can be sent, propagated, or transmitted for use by or in connection with an instruction execution system, apparatus, or device. The program code contained on the computer-readable storage medium can be transmitted using any suitable medium, including but not limited to: wireless, wireline, optical fiber, RF, etc., or any suitable combination thereof.

[0151] A computer-readable storage medium carries one or more programs that, when executed by an electronic device, cause the electronic device to perform the methods described in the embodiments of this disclosure.

[0152] The flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of this disclosure. In this regard, each block in a flowchart or block diagram may represent a module, segment, or portion of code containing one or more executable instructions for implementing a specified logical function. It should also be noted that in some alternative implementations, the functions indicated in the blocks may occur in a different order than those indicated in the drawings. For example, two consecutively indicated blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in a block diagram or flowchart, and combinations of blocks in a block diagram or flowchart, may be implemented using a dedicated hardware-based system that performs the specified function or operation, or using a combination of dedicated hardware and computer instructions.

[0153] The units described in the embodiments of this disclosure can be implemented in software or hardware, and the described units can also be located in a processor. The names of these units do not necessarily limit the unit itself.

[0154] From the above description of the embodiments, those skilled in the art will readily understand that the exemplary embodiments described herein can be implemented by software or by combining software with necessary hardware. Therefore, the technical solutions according to the embodiments of this disclosure can be embodied in the form of a software product, which can be stored in a non-volatile storage medium (such as a CD-ROM, USB flash drive, external hard drive, etc.) or on a network, including several instructions to cause a computing device (such as a personal computer, server, terminal device, or network device, etc.) to execute the methods according to the embodiments of this disclosure.

[0155] Furthermore, the above figures are merely illustrative of the processes included in the method according to exemplary embodiments of this disclosure and are not intended to be limiting. It is readily understood that the processes shown in the above figures do not indicate or limit the temporal order of these processes. Additionally, it is readily understood that these processes may be executed synchronously or asynchronously, for example, in multiple modules.

[0156] It should be noted that although several modules or units for the device used to perform actions have been mentioned in the detailed description above, this division is not mandatory. In fact, according to embodiments of this disclosure, the features and functions of two or more modules or units described above can be embodied in one module or unit. Conversely, the features and functions of one module or unit described above can be further divided and embodied by multiple modules or units.

[0157] Other embodiments of this disclosure will readily occur to those skilled in the art upon consideration of the specification and practice of the disclosure herein. This application is intended to cover any variations, uses, or adaptations of this disclosure that follow the general principles of this disclosure and include common knowledge or customary techniques in the art not disclosed herein. The specification and examples are to be considered exemplary only, and the true scope and spirit of this disclosure are indicated by the claims.

[0158] It should be understood that this disclosure is not limited to the precise structures described above and shown in the accompanying drawings, and various modifications and changes can be made without departing from its scope. The scope of this disclosure is limited only by the appended claims.

Claims

1. A heart rate detection method, characterized in that, The heart rate detection method, applied to mobile terminals, includes: In response to a heart rate detection trigger event, the system acquires a cardiac impact signal, adjusts the parameter values ​​of the sensor in the mobile terminal, and determines the cardiac impact signal based on the sensor's sensing results after adjusting the parameter values. Detecting a user's motion state based on the cardiac impact signal includes: extracting feature points from the cardiac impact signal, the feature points including the extreme points of the cardiac impact signal; calculating a motion evaluation value based on the feature points; comparing the motion evaluation value with a motion threshold, and determining the user's motion state based on the comparison result; wherein, if the motion evaluation value is less than the motion threshold, the user's motion state meets the heart rate detection requirements; When the user's movement state meets the heart rate detection requirements, the heart rate is determined using the acquired cardiac impulse signal; And after stopping heart rate monitoring, the parameters of the sensor are restored to their previous values.

2. The heart rate detection method according to claim 1, characterized in that, The heart rate detection method also includes: If the user's movement state does not meet the heart rate detection requirements within a first preset time period after the heart rate detection trigger event occurs, then the heart rate detection will be stopped.

3. The heart rate detection method according to claim 2, characterized in that, The heart rate detection method also includes: If, within the first preset time period following the occurrence of the heart rate detection trigger event, the user's movement state is detected as not meeting the heart rate detection requirements, a reminder message is issued.

4. The heart rate detection method according to claim 1, characterized in that, When the user's movement state meets the heart rate detection requirements, determining the heart rate using the acquired cardiac impulse signal includes: From the moment when the user's exercise state begins to meet the heart rate detection requirements, acquire the cardiac impact signal within a second preset time period; Based on the cardiac impact signal within the second preset time period, the first heart rate detection result is determined and displayed.

5. The heart rate detection method according to claim 4, characterized in that, Based on the cardiac impulse signals within the second preset time period, the first heart rate detection result is determined, including: The cardiac impulse signal within the second preset time period is denoised, and the first heart rate detection result is determined based on the denoised cardiac impulse signal.

6. The heart rate detection method according to claim 4, characterized in that, The heart rate detection method also includes: After the second preset time period, the cardiac impact signal is acquired in real time; The acquired cardiac impulse signal is used to determine the second heart rate detection result, and the second heart rate detection result is displayed in real time.

7. The heart rate detection method according to claim 6, characterized in that, The heart rate detection method also includes: Compare the heart rate value contained in the second heart rate detection result with the heart rate threshold range; When the number of heart rate values ​​within the heart rate threshold range is greater than or equal to the number threshold, a third heart rate detection result is determined based on the first heart rate detection result and the second heart rate detection result, heart rate detection is stopped, and the third heart rate detection result is displayed.

8. The heart rate detection method according to claim 6, characterized in that, The heart rate detection method also includes: Compare the heart rate values ​​included in the second heart rate detection results with the heart rate threshold range; Within a third preset time period following the second preset time period, if the number of heart rate values ​​within the heart rate threshold range is greater than or equal to the number threshold, then when the number of heart rate values ​​within the heart rate threshold range is greater than or equal to the number threshold, a third heart rate detection result is determined based on the first heart rate detection result and the second heart rate detection result, heart rate detection is stopped, and the third heart rate detection result is displayed. After a third preset time period following the second preset time period, if the number of heart rate values ​​within the heart rate threshold range is less than the number threshold, then a third heart rate detection result is determined based on the first heart rate detection result and the second heart rate detection result, heart rate detection is stopped, and the third heart rate detection result is displayed.

9. The heart rate detection method according to claim 6, characterized in that, The heart rate detection method also includes: After a third preset time period following the second preset time period, a third heart rate detection result is determined based on the first heart rate detection result and the second heart rate detection result. Heart rate detection is then stopped and the third heart rate detection result is displayed.

10. The heart rate detection method according to any one of claims 7 to 9, characterized in that, The third heart rate detection result is determined based on the first heart rate detection result and the second heart rate detection result, including: Obtain the heart rate value contained in the first heart rate detection result and the heart rate value contained in the second heart rate detection result; The average of the heart rate values ​​contained in the first heart rate detection result and the heart rate values ​​contained in the second heart rate detection result is calculated as the heart rate value contained in the third heart rate detection result.

11. The heart rate detection method according to any one of claims 7 to 9, characterized in that, The heart rate detection method includes: When the third heart rate detection result is determined, the heart rate health information corresponding to the third heart rate detection result is obtained and displayed.

12. The heart rate detection method according to claim 1, characterized in that, The heart rate detection method also includes: In response to a heart rate monitoring stop event, stop heart rate monitoring.

13. The heart rate detection method according to claim 1, characterized in that, The sensors in the mobile terminal include inertial sensors or piezoelectric sensors.

14. A heart rate detection method, characterized in that, The heart rate detection method, applied to mobile terminals, includes: In response to a heart rate detection trigger operation, the parameter values ​​of the sensor on the mobile terminal are adjusted, and the cardiac impulse signal is obtained based on the sensor's sensing results after the parameter values ​​are adjusted. Detecting a user's motion state based on the cardiac impact signal includes: extracting feature points from the cardiac impact signal, the feature points including the extreme points of the cardiac impact signal; calculating a motion evaluation value based on the feature points; comparing the motion evaluation value with a motion threshold, and determining the user's motion state based on the comparison result; If the user's exercise status does not meet the heart rate detection requirements, a reminder message will be issued; When the user's movement state meets the heart rate detection requirements, the heart rate is determined using the acquired cardiac impulse signal, and multiple heart rate detection results are displayed after a predetermined time. The final heart rate detection result is determined based on the multiple heart rate detection results, and the final heart rate detection result is displayed. And after stopping heart rate monitoring, the parameters of the sensor are restored to their previous values.

15. The heart rate detection method according to claim 14, characterized in that, The heart rate detection trigger operation includes the user clicking to enter the heart rate detection interface.

16. The heart rate detection method according to claim 15, characterized in that, The heart rate detection method also includes: The heart rate detection operation will stop upon response, and the heart rate detection interface will be exited.

17. A heart rate detection device, characterized in that, The heart rate detection device, applied to a mobile terminal, includes: The motion detection module is used to respond to heart rate detection trigger events, acquire cardiac impact signals, and detect the user's motion status based on the cardiac impact signals. The heart rate determination module is used to determine the heart rate using the acquired cardiac impact signal when the user's exercise state meets the heart rate detection requirements. The motion detection module is also used to extract feature points from the cardiac impact signal, including the extreme points of the cardiac impact signal; calculate a motion evaluation value based on the feature points; compare the motion evaluation value with a motion threshold, and determine the user's motion state based on the comparison result; wherein, if the motion evaluation value is less than the motion threshold, the user's motion state meets the heart rate detection requirements. The parameter adjustment module is used to respond to a heart rate detection trigger event, adjust the parameter values ​​of the mobile terminal's sensor, determine the cardiac impulse signal based on the sensor's sensing results after adjusting the parameter values, and restore the sensor parameters to the parameter values ​​before adjustment after stopping heart rate detection.

18. A heart rate detection device for implementing the heart rate detection method as described in claim 14, characterized in that, The heart rate detection device, applied to a mobile terminal, includes: The trigger response module is used to respond to the heart rate detection trigger operation, acquire the cardiac impact signal, and detect the user's exercise state based on the cardiac impact signal. If the user's exercise state does not meet the heart rate detection requirements, a reminder message is issued. The first result display module is used to display multiple heart rate detection results after a predetermined time, provided that the user's exercise state meets the heart rate detection requirements. The second result display module is used to determine the final heart rate detection result based on the multiple heart rate detection results and to display the final heart rate detection result.

19. A computer-readable storage medium having a computer program stored thereon, characterized in that, When the program is executed by the processor, it implements the heart rate detection method as described in any one of claims 1 to 16.

20. An electronic device, characterized in that, include: processor; A memory for storing one or more programs that, when executed by the processor, cause the electronic device to implement the heart rate detection method as described in any one of claims 1 to 16.

Images