Method and electronic device for key interaction

By using non-array sensors to detect sliding operations, and combining multiple signal types and separately configured modules, the miniaturization problem of button modules after integrating more functions has been solved, improving recognition efficiency and user experience.

CN122308700APending Publication Date: 2026-06-30HUAWEI TECH CO LTD

Patent Information

Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
HUAWEI TECH CO LTD
Filing Date
2024-12-30
Publication Date
2026-06-30

AI Technical Summary

Technical Problem

In the existing technology, it is difficult to miniaturize the buttons of electronic devices without increasing the user's learning cost after integrating more functions. In addition, existing array sensors occupy a lot of space, which affects the reduction of device size.

Method used

The button module uses a non-array sensor to detect sliding operations. It uses a separate transmitting and receiving module to identify the sliding direction and combines multiple signal types to identify the sliding operation, thereby reducing signal processing load and device response time.

Benefits of technology

This technology enables the miniaturization of button modules, improves the efficiency and accuracy of user operation recognition, simplifies operation methods, enhances user experience, and allows for a more compact device layout.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN122308700A_ABST
    Figure CN122308700A_ABST
Patent Text Reader

Abstract

This application provides a method for button interaction and an electronic device. The electronic device may include a button module containing a non-array sensor. The non-array sensor can determine whether the user's operation on the button module is a sliding operation by detecting a first signal. Based on this method of detecting sliding operations, the non-array sensor occupies less space in the button module, which is beneficial for miniaturizing the button module. In addition, the button module can also detect and recognize user tap operations, and the electronic device can make different types of responses based on the recognition results of the user's operation type by the button module, enriching the user experience.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This application relates to the field of terminal device software, and more specifically, to a method for button interaction and an electronic device. Background Technology

[0002] Electronic devices such as mobile phones, tablets, and headphones can include touch buttons and mechanical buttons. When a user presses or slides these buttons, the electronic device can make a corresponding response.

[0003] When buttons integrate more functions, it is necessary to provide a button interaction method that supports the miniaturization of buttons and electronic devices containing buttons without increasing the user's learning cost. Summary of the Invention

[0004] This application provides a method for button interaction and an electronic device. The button module of the electronic device can detect a first signal through an internal non-array sensor. This first signal can be used to determine whether the user's operation is a sliding operation. If it is determined to be a sliding operation, the electronic device can make a response corresponding to the sliding operation. Compared with array sensors, the button interaction method provided by this application helps to reduce the space occupied by the button module and helps to control the size of the electronic device.

[0005] In a first aspect, a method for button interaction is provided, applied to an electronic device, the electronic device including a button module, the button module including a first sensor composed of a first sensing element, the method including: receiving a first operation applied to the button module; detecting a first signal through the first sensing element; determining the first operation as a sliding operation based on the first signal; and performing a response operation corresponding to the sliding operation.

[0006] In some scenarios, a first sensor containing a first sensing element can be considered a non-array sensor. An array sensor can contain multiple sensing elements arranged in an array, and the array sensor can detect signals at multiple different locations through these sensing elements; a first sensor, on the other hand, can detect signals at the same location through a single sensing element.

[0007] In one possible implementation, the first sensor can be either an active sensor or a passive sensor. If the first sensor is an active sensor, the first signal can be a signal emitted by the first sensor and reflected by the object being measured. If the first sensor is a passive sensor, the first signal can be a signal emitted by the object being measured itself or a signal caused by the object being measured.

[0008] Understandably, electronic devices can also identify user button presses by using signals detected by the first sensor.

[0009] As an example, the first signal here can be signal Sg2 or signal Sg3 as described later, or it can be signal Sga or signal Sgc as described later. This example also applies to the related schemes regarding the first signal described below.

[0010] In array sensors containing multiple sensing elements, spacing is provided between the sensing elements. This type of sensor occupies a relatively large area in the plane where the sensing elements are arranged. The first sensor involved in the above solution includes only one first sensing element, without involving multiple sensing elements or spacing between them. This type of sensor has a compact structure. Button modules containing this type of sensor are smaller in size, which is beneficial for miniaturizing electronic devices.

[0011] In conjunction with the first aspect, in some implementations of the first aspect, determining the first operation as a sliding operation based on the first signal includes: determining the first operation as the sliding operation based on a reference intensity of the first signal, a measured intensity of the first signal, and a change in the measured intensity of the first signal, wherein the reference intensity is the intensity of the first signal when the user does not operate the button module.

[0012] In one possible implementation, the change in the measured intensity of the first signal can be understood as the change in the measured intensity of the first signal over time, or the relationship between the measured intensity of the first signal and time.

[0013] In one possible implementation, the first sensor can be an active sensor, in which case the reference strength of the first signal can be the strength of the signal emitted by the first sensor (such as electromagnetic waves, sound waves, etc.); or, the first sensor can be a passive sensor, in which case the reference strength of the first signal can be the strength of the signal when no signal is received from the object being measured.

[0014] In one possible implementation, the reference strength of the first signal can be the measured value of the first signal when the user does not operate the button module, or the reference strength of the first signal can be a default value, which can be included in the hardware information of the device when the electronic device is manufactured.

[0015] In one possible implementation, the measured intensity of the first signal can be the intensity of the first signal at a determined position detected by the first sensing element, and the change in the measured intensity of the first signal can include the change in the intensity of the first signal at the determined position during the sliding operation.

[0016] In one possible implementation, the sliding operation includes a sliding operation along a first direction and a sliding operation along a second direction. Correspondingly, the change in the measured intensity of the first signal includes a first change and a second change. In other words, the electronic device can identify the user's sliding operation along the first direction based on the reference intensity of the first signal, the measured intensity of the first signal, and the first change. The electronic device can also identify the user's sliding operation along the second direction based on the reference intensity of the first signal, the measured intensity of the first signal, and the second change.

[0017] Compared to identifying user swipe gestures by detecting signal distribution using array sensors, this technical solution identifies user swipe gestures by detecting signal intensity changes at the same location using non-array sensors. This reduces the amount of signals that the electronic device needs to collect and process during user gesture recognition, shortens the signal processing time, improves the efficiency of user gesture recognition, and reduces the device's response time.

[0018] In conjunction with the first aspect, in some implementations of the first aspect, the first sensing element includes a transmitting module and a receiving module, the transmitting module and the receiving module being separately configured, the transmitting module being used to transmit a reference signal, and the receiving module being used to receive the first signal, the reference signal corresponding to the first signal.

[0019] In some scenarios, the first sensor can be regarded as an active sensor.

[0020] In some examples, the transmitting and receiving modules of the first sensing element can be located far apart from each other.

[0021] In one possible implementation, the contact surface of the button module is longer in the third direction and shorter in the fourth direction. The transmitting and receiving modules of the first sensing element can be positioned along the third direction and close to the outer periphery of the contact surface of the button module.

[0022] In one possible implementation, the first sensor can be a PPG sensor, the transmitting module can be the light source of the PPG sensor (such as a light-emitting diode, a vertical-cavity surface-emitting laser, etc.), and the receiving module can be the photodiode of the PPG sensor.

[0023] In one possible implementation, the first signal can be a reference signal that is reflected by the object under test and then received by the receiving module.

[0024] In this technical solution, the transmitting module and receiving module of the first sensor are set up separately. On the one hand, this is conducive to the efficient use of the internal space of the button module. On the other hand, based on the separate transmitting and receiving modules, the intensity change of the first signal detected by the first sensor may be different when sliding from the position closer to the transmitting module to the position closer to the receiving module and when sliding from the position closer to the receiving module to the position closer to the transmitting module. In other words, this method of separating the transmitting and receiving modules is conducive to the electronic device's recognition of sliding operations in different directions.

[0025] In conjunction with the first aspect, in some implementations of the first aspect, determining the first operation as the sliding operation based on the first signal includes: determining the first operation as the sliding operation based on the position of the transmitting module, the position of the receiving module, and the first signal.

[0026] In one possible implementation, the electronic device can determine that the first operation is a sliding operation based on the position of the transmitting module, the position of the receiving module, the reference strength of the first signal, the measured strength of the first signal, and the intensity change of the measured strength of the first signal.

[0027] In one possible implementation, the electronic device can determine whether the first operation is a sliding operation along a first direction or a sliding operation along a second direction based on the position of the transmitting module, the position of the receiving module, and the first signal. The first direction and the second direction can be two opposite directions.

[0028] This technical solution combines the positions of the transmitting module, the receiving module, and a first signal to identify sliding operations. The positions of the transmitting and receiving modules can be considered static information (information that does not change over time), while the first signal can be considered dynamic information (information that may change over time). Compared to array sensors that use signals from multiple different positions to identify sliding operations, where all signals are dynamic information, this technical solution requires processing less dynamic information to identify sliding operations, thus improving the efficiency of electronic devices in recognizing sliding operations.

[0029] In conjunction with the first aspect, in some implementations of the first aspect, the button module further includes a second sensor, which determines the first operation as a sliding operation based on the first signal, including: determining the first operation as the sliding operation based on the first signal and the second signal, wherein the second signal is detected by the second sensor and the second signal is a signal of a different type from the first signal.

[0030] In one possible implementation, the first signal is one of the following, and the second signal is another of the following: pressure signal, light signal, capacitance signal, elastic wave signal, ultrasonic signal, millimeter wave signal, electromagnetic wave signal of different frequency bands (such as Bluetooth signal, star flash signal, ultra-wideband signal, near field communication signal, etc.).

[0031] In one possible implementation, the second sensor may consist of a second sensing element.

[0032] In some scenarios, a second sensor containing a second sensing element can be considered a non-array sensor. The second sensor is smaller in size and occupies less space in the button module.

[0033] In another possible implementation, the second sensor can be an array sensor.

[0034] In one possible implementation, the second sensor and the first sensor can be stacked, or the first sensor and the second sensor can be stacked along a direction perpendicular to the contact surface of the button module.

[0035] In one possible implementation, the first sensor can be a non-array PPG sensor and the second sensor can be a non-array pressure sensor; alternatively, the first sensor can be a non-array pressure sensor and the second sensor can be a non-array PPG sensor.

[0036] As an example, the second signal here can be signal Sg2 or signal Sg3 as described later, or it can be signal Sga or signal Sgc as described later. This example also applies to the related schemes regarding the second signal described below.

[0037] As an example, the first signal mentioned above can be signal Sg2 mentioned later, and the second signal can be signal Sg3 mentioned later; or, the first signal can be signal Sg3 mentioned later, and the second signal can be signal Sg2 mentioned later.

[0038] As an example, the first signal mentioned above can be the signal Sga mentioned later, and the second signal can be the signal Sgc mentioned later; or, the first signal can be the signal Sgc mentioned later, and the second signal can be the signal Sga mentioned later.

[0039] The above example also applies to the related schemes regarding the first and second signals discussed below.

[0040] This technical solution identifies user swipe operations using two different types of signals. Compared to methods that rely on only one signal, this adds another dimension to the identification process. Furthermore, the probability of interference between different signal types is low. Implementing this solution improves the accuracy and efficiency of electronic devices in recognizing user swipe operations. In addition, different signal types correspond to different types of sensors. Compared to multiple sensors of the same type, different types of sensors are easier to coordinate with each other, which facilitates a more rational layout of different electronic components within the button module, a more compact layout of these components, and ultimately, the miniaturization of the button module.

[0041] In conjunction with the first aspect, in some implementations of the first aspect, determining the first operation as the sliding operation based on the first signal and the second signal includes: determining the first operation as the sliding operation when the measured intensity of the first signal first increases and then decreases and the measured intensity of the second signal first increases and then decreases within a first time period.

[0042] In one possible implementation, the first duration here can be a period of time or the entire duration during which the user operates the button module.

[0043] In one possible implementation, the first duration is greater than or equal to a first duration threshold and less than or equal to a second duration threshold.

[0044] In one possible implementation, during a first duration, if the measured intensity of the first signal increases and then decreases according to a first change pattern and the intensity of the second signal increases and then decreases according to a second change pattern, the electronic device can determine that the first operation is a sliding operation along a first direction; if the measured intensity of the first signal increases and then decreases according to a third change pattern and the intensity of the second signal increases and then decreases according to a fourth change pattern, the electronic device can determine that the first operation is a sliding operation along a second direction; wherein the first direction and the second direction are two opposite directions.

[0045] This technical solution specifically provides a method for identifying sliding operations by combining the measured intensity changes of a first signal and a second signal, which is beneficial to the implementation of this technical solution. Furthermore, the range of the first duration will affect the accuracy of user operation recognition. If the first duration is too short, the sensor will collect too few signals, resulting in low accuracy of user operation recognition; if the first duration is too long, the sensor will collect too many signals, requiring more signal processing, which is detrimental to improving the efficiency of the device in recognizing user operations.

[0046] In conjunction with the first aspect, in some implementations of the first aspect, the button module further includes a third sensor, which includes multiple electrodes, one of which is located on the contact surface of the button module. The method further includes: detecting an electrocardiogram (ECG) signal and / or a bioimpedance signal through the third sensor; and determining that the first operation has been detected when the ECG signal meets a first preset requirement and / or the bioimpedance signal meets a second preset requirement.

[0047] In some scenarios, the determination of detecting the first operation in this technical solution can also be understood as detecting that the button module has not been erroneously operated.

[0048] In one possible implementation, the third sensor can be an electrocardiogram sensor and / or a bioimpedance sensor.

[0049] In one possible implementation, the third sensor can also be used to detect physiological signals such as the user's electrocardiogram signal.

[0050] In one possible implementation, the first preset requirement can be the ability to identify the user's heart rate, and the second preset requirement can be that the bioimpedance is greater than or equal to an impedance threshold.

[0051] In one possible implementation, before detecting the first signal, the electronic device can detect electrocardiogram signals and / or bioimpedance signals through a third sensor to identify whether there is a genuine user operation, or in other words, to identify whether the button module has been accidentally touched; if it is determined that there is a genuine user operation based on the detection results of the third sensor, the electronic device can identify the user's operation through the aforementioned first sensor.

[0052] In this technical solution, the electrodes of the third sensor used to identify actual user operations are placed on the contact surface of the button module. This enriches the functionality of the button module while making efficient use of its contact surface and reducing the volume occupied by the third sensor within the button module. Furthermore, before identifying the type of user operation, it first checks whether the button module has been accidentally touched. This reduces power consumption waste caused by the frequent identification of user operation types (including signal acquisition and processing) and also helps lower the probability of accidental button touches.

[0053] In conjunction with the first aspect, in some implementations of the first aspect, the button module includes a first functional mode and a second functional mode, the first functional mode being used to detect the sliding operation, and the second functional mode being used to detect user operations different from the sliding operation. The method further includes: accepting a first switching operation; switching the button module from the first functional mode to the second functional mode; and / or, accepting a second switching operation; switching the button module from the second functional mode to the first functional mode.

[0054] In some scenarios, the first function mode can be called the crown mode, and the second function mode can be called the single-key mode.

[0055] In one possible implementation, the electronic device can recognize the first and second switching operations through the screen component. In other words, the first and second switching operations can be operations performed on the screen component, such as selecting function options through the screen component.

[0056] In one possible implementation, the electronic device can identify the first and second switching operations described above through a motion sensor. In other words, the first and second switching operations can be operations performed on the motion sensor, such as gesture operations.

[0057] In one possible implementation, the electronic device can recognize the first switching operation and the second switching operation through the button module. In other words, the first switching operation and the second switching operation can be operations performed on the button module, such as double-clicking the button module.

[0058] In conjunction with the first aspect, in some implementations of the first aspect, the first functional mode is also used to detect a first type of tap operation, and the second functional mode is used to detect a second type of tap operation, wherein the first type of tap operation is different from the second type of tap operation.

[0059] In one possible implementation, the first type of tap operation can be a light tap operation, such as a light short tap or a light long tap; the second type of tap operation can be a heavy tap operation, such as a heavy short tap or a heavy long tap.

[0060] In one possible implementation, the first type of tap operation can be a short tap operation, such as a light short tap operation or a heavy short tap operation; the second type of tap operation can be a long tap operation, such as a light long tap operation or a heavy long tap operation.

[0061] A button module can have multiple function modes, each enabling different interactive functions. This technical solution provides a method for switching the function modes of a button module, which simplifies its operation, improves the efficiency of users inputting information into electronic devices via the button module, and enhances the user experience.

[0062] In conjunction with the first aspect, in some implementations of the first aspect, the electronic device further includes a knob and / or a first button, the first button being different from the button module. The method further includes: when the button module is slidable to achieve a first function, rotating the knob is configured to achieve a second function; and / or, when the button module is slidable to achieve the first function, sliding the first button is configured to achieve the second function; wherein the first function is different from the second function.

[0063] The first button can be a button that can recognize swipe gestures.

[0064] In one possible implementation, the structure of the first button can be the same as that of the button module. In other words, the electronic device may include a first button module and a second button module, wherein the first button module may refer to the button module in the above technical solution, and the second button module may refer to the first button in the above technical solution.

[0065] In one possible implementation, the structure of the first button can be different from the button module. For example, the first button may include an array sensor (such as a pressure sensor array, a capacitance sensor array, a PPG sensor array, etc.).

[0066] In one possible implementation, the first function can be a left-right page turning function, and the second function can be a up-down page turning function; or, the first function can be an up-down page turning function, and the second function can be a left-right page turning function.

[0067] In electronic devices that include multiple buttons or knobs capable of recognizing user swipes, the user's swipe operation and knob rotation can be used to achieve different functions. When a user sets one component to perform one function, the electronic device can set another component to perform a different function. Implementing this technical solution simplifies the process of setting the functions of multiple components on an electronic device, thus improving the user experience. Furthermore, users can set the same component to perform different functions, enriching their personalized experience.

[0068] In conjunction with the first aspect, in some implementations of the first aspect, the method further includes: receiving a second operation applied to the button module, the second operation including the sliding operation; performing one or more of the following: displaying a target interface; playing target audio; and vibrating a motor.

[0069] In this technical solution, electronic devices can respond to user actions on the button module through one or more of the following methods: visual, auditory, and tactile, which helps to improve the interactive experience between users and electronic devices.

[0070] In conjunction with the first aspect, in some implementations of the first aspect, the second operation includes a pressing action and a lifting action, and the vibration motor includes: in response to the pressing action, vibrating the motor in a first manner; and / or, in response to the lifting action, vibrating the motor in a second manner. The first and second manners may be the same or different.

[0071] In one possible implementation, the second operation can be a sliding operation.

[0072] In conjunction with the first aspect, in some implementations of the first aspect, the second operation further includes a first action that occurs after the pressing action and before the lifting action, the first action being different from the pressing action or the lifting action, and the vibration motor further includes: vibrating the motor in a third manner in response to the first action.

[0073] The third method may be the same as or different from the first method, and may be the same as or different from the second method; this application does not limit this.

[0074] Understandably, in one possible implementation, when the second operation is a swipe, the first action can be the swiping motion of a finger on the button module. Therefore, this solution can provide feedback for each action within an operation, allowing the user to clearly perceive the device's response to each action. Understandably, this user perception will be more pronounced when the first, second, and third methods are different from each other.

[0075] In conjunction with the first aspect, in some implementations of the first aspect, the first aspect includes at least one of the following: a first vibration waveform, a first vibration duration, a first vibration intensity, and a first vibration interval; the second aspect includes at least one of the following: a second vibration waveform, a second vibration duration, a second vibration intensity, and a second vibration interval.

[0076] In some scenarios, a vibration waveform can be understood as the relationship between vibration intensity and time, or as the way vibration intensity changes.

[0077] In this technical solution, the electronic device can simulate the actual operation of the user on the button module through the motor. When the user operates the button module, he / she can receive more realistic tactile feedback, which is conducive to improving the user experience.

[0078] In conjunction with the first aspect, in some implementations of the first aspect, playing the target audio includes: playing the target audio in a fourth manner, the fourth manner being determined based on at least one of the operating force, operating time, and number of operations of the second operation.

[0079] Understandably, in one possible implementation, playing the target audio can be similar to a vibration motor, responding and playing in real time with each action of the second operation to provide feedback to the user; in another possible implementation, the target audio can be played after the second operation is completed, that is, in this implementation, playing the target audio is the triggering result of the second operation.

[0080] In conjunction with the first aspect, in some implementations of the first aspect, the fourth method includes at least one of the following: a first loudness, a first playback duration, and a first waveform, wherein the first loudness corresponds to the operation intensity, the first playback duration corresponds to the operation time, and the first waveform corresponds to the number of operations.

[0081] In one possible implementation, the second operation can be the operation of pressing a button module.

[0082] Taking keystrokes as an example, some operations on the button module rely on motor vibration for feedback, which is not easily perceived by the user. In such cases, playing audio feedback improves user perception and enhances the interactive experience. Furthermore, by playing audio that simulates actual user actions, users receive more realistic auditory feedback when operating the button module, further improving the user experience.

[0083] In conjunction with the first aspect, in some implementations of the first aspect, detecting the first signal through the first sensing element includes: detecting the first signal through the first sensing element at a first frequency; and detecting the first signal through the first sensing element at a second frequency if the intensity of the first signal is greater than or equal to an intensity threshold; wherein the second frequency is higher than the first frequency.

[0084] When detecting the first signal at a first frequency, the first sensor acquires signals at a lower frequency, resulting in lower power consumption. In some scenarios, this mode can be called a low-power mode. When detecting the second signal at a second frequency, the first sensor acquires signals at a higher frequency, enabling it to respond quickly to user actions. In some scenarios, this mode can be called a high-performance mode.

[0085] In one possible implementation, the electronic device can detect the first signal using a first frequency when the user uses it at a low frequency, and detect the first signal using a second frequency when the user uses it at a high frequency.

[0086] In one possible implementation, the electronic device can detect the first signal using a first frequency when the battery is low, and detect the first signal using a second frequency when the battery is high.

[0087] The button module can detect user operations at different frequencies, which helps to improve the applicability of the button module in different application scenarios and enhance the user experience in different application scenarios.

[0088] In one possible implementation, the first sensor further includes a reporting module, and the method further includes: sending first information through the reporting module, the first information indicating one or more of the following: whether the measured intensity of the first signal is greater than or equal to an intensity threshold; the duration for which the measured intensity of the first signal is greater than or equal to the intensity threshold; the number of times the measured intensity of the first signal is greater than or equal to the intensity threshold; and / or sending second information through the reporting module, the second information including the measured intensity of the first signal.

[0089] In some scenarios, an interrupt event can be triggered if the measured strength of the first signal is greater than or equal to a strength threshold. Based on this, the above technical solution can also be understood as follows: the first information can be used to indicate: whether an interrupt event has occurred, the duration of the interrupt event, and the number of times the interrupt event has occurred.

[0090] When the reporting module reports information related to interrupt events, it performs reporting operations fewer times, resulting in lower power consumption. When the reporting module reports information related to the measured strength of the first signal, it performs reporting operations more frequently, enabling the electronic device to promptly recognize user actions and respond accordingly.

[0091] In conjunction with the first aspect, in some implementations of the first aspect, the method further includes: receiving a third operation applied to the button module; detecting the user's physiological data, which includes one or more of the following: blood pressure, blood glucose, blood oxygen content, heart rate, uric acid, emotional stress, body temperature, and respiratory rate; and displaying a first interface, which includes the detection results of the physiological data.

[0092] In one possible implementation, the third operation can be an operation on the contact surface of a continuously dummy button module.

[0093] In one possible implementation, upon receiving a first third operation applied to the button module, the electronic device can detect the user's physiological data; upon receiving a second third operation applied to the button module, the electronic device can display the aforementioned first interface.

[0094] In conjunction with the first aspect, in some implementations of the first aspect, the method further includes: receiving a fourth operation applied to the button module; displaying a second interface, the second interface including a screenshot of the electronic device.

[0095] In one possible implementation, the fourth operation could be a double-click operation on the button module.

[0096] In this technical solution, the electronic device can respond to specific user operations, which helps to enrich the user's personalized experience.

[0097] For detailed explanations and descriptions of the beneficial effects of the following technical solutions, please refer to the relevant content in the first aspect; they will not be repeated hereafter.

[0098] In a second aspect, a button-interactive device is provided, the device including a button module, the button module including a first sensor composed of a first sensing element, the device further including an acquisition module and a processing module, the acquisition module being configured to: receive a first operation applied to the button module; detect a first signal through the first sensing element; the processing module being configured to: determine the first operation as a sliding operation based on the first signal; and execute a response operation corresponding to the sliding operation.

[0099] In conjunction with the second aspect, in some implementations of the second aspect, the processing module is specifically used to: determine the first operation as the sliding operation based on the reference strength of the first signal, the measured strength of the first signal, and the change in the measured strength of the first signal, wherein the reference strength is the strength of the first signal when the user does not operate the button module.

[0100] In conjunction with the second aspect, in some implementations of the second aspect, the first sensing element includes a transmitting module and a receiving module, the transmitting module and the receiving module being separately configured, the transmitting module being used to transmit a reference signal, and the receiving module being used to receive the first signal, the reference signal corresponding to the first signal.

[0101] In conjunction with the second aspect, in some implementations of the second aspect, the processing module is specifically used to: determine the first operation as the sliding operation based on the position of the sending module, the position of the receiving module, and the first signal.

[0102] In conjunction with the second aspect, in some implementations of the second aspect, the button module further includes a second sensor, and the processing module is specifically used to: determine the first operation as the sliding operation based on the first signal and the second signal, wherein the second signal is detected by the second sensor and the second signal is a signal of a different type from the first signal.

[0103] In conjunction with the second aspect, in some implementations of the second aspect, the processing module is specifically used to: determine the first operation as the sliding operation when the measured intensity of the first signal first increases and then decreases and the measured intensity of the second signal first increases and then decreases within a first time period.

[0104] In conjunction with the second aspect, in some implementations of the second aspect, the button module further includes a third sensor, which includes multiple electrodes. One electrode of the third sensor is located on the contact surface of the button module. The acquisition module is further configured to: detect the electrocardiogram signal and / or the bioimpedance signal through the third sensor; the processing module is further configured to: determine that the first operation has been detected when the electrocardiogram signal meets a first preset requirement and / or the bioimpedance signal meets a second preset requirement.

[0105] In conjunction with the second aspect, in some implementations of the second aspect, the button module includes a first functional mode and a second functional mode. The first functional mode is used to detect the sliding operation, and the second functional mode is used to detect user operations different from the sliding operation. The acquisition module is further used to: accept a first switching operation; the processing module is further used to: switch the button module from the first functional mode to the second functional mode; and / or, the acquisition module is further used to: accept a second switching operation; the processing module is further used to: switch the button module from the second functional mode to the first functional mode.

[0106] In conjunction with the second aspect, in some implementations of the second aspect, the first functional mode is also used to detect a first type of tap operation, and the second functional mode is used to detect a second type of tap operation, wherein the first type of tap operation is different from the second type of tap operation.

[0107] In conjunction with the second aspect, in some implementations of the second aspect, the electronic device further includes a knob and / or a first button, the first button being different from the button module, and the processing module is further configured to: when the button module is slidable to achieve a first function, set the knob to be rotated to achieve a second function; and / or, when the button module is slidable to achieve a first function, set the first button to be slidable to achieve a second function; wherein the first function is different from the second function.

[0108] In conjunction with the second aspect, in some implementations of the second aspect, the acquisition module is further configured to: receive a second operation applied to the button module, the second operation including the sliding operation; the processing module is further configured to: perform one or more of the following: display a target interface; play target audio; vibrate a motor.

[0109] In conjunction with the second aspect, in some implementations of the second aspect, the second operation includes a pressing action and a lifting action, and the processing module is specifically configured to: vibrate the motor in a first manner in response to the pressing action; and / or, vibrate the motor in a second manner in response to the lifting action.

[0110] In conjunction with the second aspect, in some implementations of the second aspect, the second operation further includes a first action, which is after the pressing action and before the lifting action, and is different from the pressing action or the lifting action. The processing module is also configured to: vibrate the motor in a third manner in response to the first action.

[0111] In conjunction with the second aspect, in some implementations of the second aspect, the first aspect includes at least one of the following: a first vibration waveform, a first vibration duration, a first vibration intensity, and a first vibration interval; and the second aspect includes at least one of the following: a second vibration waveform, a second vibration duration, a second vibration intensity, and a second vibration interval.

[0112] In conjunction with the second aspect, in some implementations of the second aspect, the processing module is specifically used to: play the target audio in a fourth manner, wherein the fourth manner is determined based on at least one of the operation intensity, operation time, and operation number of the second operation.

[0113] In conjunction with the second aspect, in some implementations of the second aspect, the fourth method includes at least one of the following: a first loudness, a first playback duration, and a first waveform, wherein the first loudness corresponds to the operation intensity, the first playback duration corresponds to the operation time, and the first waveform corresponds to the number of operations.

[0114] In conjunction with the second aspect, in some implementations of the second aspect, the acquisition module is specifically used to: detect the first signal at a first frequency through the first sensing element; and if the intensity of the first signal is greater than or equal to an intensity threshold, detect the first signal at a second frequency through the first sensing element; wherein the second frequency is higher than the first frequency.

[0115] In conjunction with the second aspect, in some implementations of the second aspect, the acquisition module is further configured to: receive a third operation applied to the button module; detect the user's physiological data, which includes one or more of the following: blood pressure, blood sugar, blood oxygen content, heart rate, uric acid, emotional stress, body temperature, and respiratory rate; the processing module is further configured to: display a first interface, which includes the detection results of the physiological data.

[0116] In conjunction with the second aspect, in some implementations of the second aspect, the acquisition module is further configured to: receive a fourth operation applied to the button module; the processing module is further configured to: display a second interface, the second interface including a screenshot of the electronic device.

[0117] Thirdly, an electronic device is provided, comprising a processor and a memory storing program instructions. The electronic device also includes a button module comprising a first sensor consisting of a first sensing element. The processor is configured to: receive a first operation applied to the button module; detect a first signal through the first sensing element; determine that the first operation is a sliding operation based on the first signal; and execute a response operation corresponding to the sliding operation.

[0118] In conjunction with the third aspect, in some implementations of the third aspect, the processor is specifically used to: determine the first operation as the sliding operation based on the reference strength of the first signal, the measured strength of the first signal, and the change in the measured strength of the first signal, wherein the reference strength is the strength of the first signal when the user does not operate the button module.

[0119] In conjunction with the third aspect, in some implementations of the third aspect, the first sensing element includes a transmitting module and a receiving module, the transmitting module and the receiving module being separately configured, the transmitting module being used to transmit a reference signal, and the receiving module being used to receive the first signal, the reference signal corresponding to the first signal.

[0120] In conjunction with the third aspect, in some implementations of the third aspect, the processor is specifically used to: determine the first operation as the sliding operation based on the position of the transmitting module, the position of the receiving module, and the first signal.

[0121] In conjunction with the third aspect, in some implementations of the third aspect, the button module further includes a second sensor, and the processor is specifically used to: determine the first operation as the sliding operation based on the first signal and the second signal, wherein the second signal is detected by the second sensor and the second signal is a signal of a different type from the first signal.

[0122] In conjunction with the third aspect, in some implementations of the third aspect, the processor is specifically used to: determine the first operation as the sliding operation when the measured intensity of the first signal first increases and then decreases and the measured intensity of the second signal first increases and then decreases within a first time period.

[0123] In conjunction with the third aspect, in some implementations of the third aspect, the button module further includes a third sensor, which includes multiple electrodes, one of which is located on the contact surface of the button module. The processor is further configured to: detect the electrocardiogram signal and / or the bioimpedance signal through the third sensor; and determine that the first operation has been detected if the electrocardiogram signal meets a first preset requirement and / or the bioimpedance signal meets a second preset requirement.

[0124] In conjunction with the third aspect, in some implementations of the third aspect, the button module includes a first functional mode and a second functional mode. The first functional mode is used to detect the sliding operation, and the second functional mode is used to detect user operations different from the sliding operation. The processor is further configured to: accept a first switching operation; switch the button module from the first functional mode to the second functional mode; and / or, the processor is further configured to: accept a second switching operation; switch the button module from the second functional mode to the first functional mode.

[0125] In conjunction with the third aspect, in some implementations of the third aspect, the first functional mode is also used to detect a first type of tap operation, and the second functional mode is used to detect a second type of tap operation, wherein the first type of tap operation is different from the second type of tap operation.

[0126] In conjunction with the third aspect, in some implementations of the third aspect, the electronic device further includes a knob and / or a first button, the first button being different from the button module, and the processor is further configured to: when the button module is slidable to achieve a first function, set the knob to rotate to achieve a second function; and / or, when the button module is slidable to achieve a first function, set the first button to slide to achieve a second function; wherein the first function is different from the second function.

[0127] In conjunction with the third aspect, in some implementations of the third aspect, the processor is further configured to: receive a second operation applied to the button module, the second operation including the sliding operation; perform one or more of the following: display a target interface; play target audio; vibrate a motor.

[0128] In conjunction with the third aspect, in some implementations of the third aspect, the second operation includes a pressing action and a lifting action, and the processor is specifically configured to: vibrate the motor in a first manner in response to the pressing action; and / or, vibrate the motor in a second manner in response to the lifting action.

[0129] In conjunction with the third aspect, in some implementations of the third aspect, the second operation further includes a first action that occurs after the pressing action and before the lifting action, the first action being different from the pressing action or the lifting action, and the processor is further configured to: vibrate the motor in a third manner in response to the first action.

[0130] In conjunction with the third aspect, in some implementations of the third aspect, the first aspect includes at least one of the following: a first vibration waveform, a first vibration duration, a first vibration intensity, and a first vibration interval; the second aspect includes at least one of the following: a second vibration waveform, a second vibration duration, a second vibration intensity, and a second vibration interval.

[0131] In conjunction with the third aspect, in some implementations of the third aspect, the processor is specifically used to: play the target audio in a fourth manner, the fourth manner being determined based on at least one of the operating force, operating time, and number of operations of the second operation.

[0132] In conjunction with the third aspect, in some implementations of the third aspect, the fourth method includes at least one of the following: a first loudness, a first playback duration, and a first waveform, wherein the first loudness corresponds to the operation intensity, the first playback duration corresponds to the operation time, and the first waveform corresponds to the number of operations.

[0133] In conjunction with the third aspect, in some implementations of the third aspect, the processor is specifically configured to: detect the first signal at a first frequency via the first sensing element; and, if the intensity of the first signal is greater than or equal to an intensity threshold, detect the first signal at a second frequency via the first sensing element; wherein the second frequency is higher than the first frequency.

[0134] In conjunction with the third aspect, in some implementations of the third aspect, the processor is further configured to: receive a third operation applied to the button module; detect the user's physiological data, which includes one or more of the following: blood pressure, blood glucose, blood oxygen content, heart rate, uric acid, emotional stress, body temperature, and respiratory rate; and display a first interface, which includes the detection results of the physiological data.

[0135] In conjunction with the third aspect, in some implementations of the third aspect, the processor is also configured to: receive a fourth operation applied to the button module; and display a second interface including a screenshot of the electronic device.

[0136] Fourthly, a computer program product is provided, comprising computer program code that, when run on a computer, causes the methods in the first aspect and any possible implementation thereof to be executed.

[0137] Fifthly, a computer-readable storage medium is provided that stores computer program code, which, when run on a computer, causes the methods in the first aspect and any possible implementation thereof to be executed.

[0138] In a sixth aspect, a chip is provided, including a processor for reading instructions stored in a memory, wherein when the processor executes the instructions, the chip implements the methods of the first aspect and any possible implementation thereof. Attached Figure Description

[0139] Figure 1 This is a schematic diagram of the hardware architecture of an electronic device provided in an embodiment of this application.

[0140] Figure 2 This is a schematic diagram of the software architecture of an electronic device provided in an embodiment of this application.

[0141] Figure 3 This is a functional block diagram of a button module provided in an embodiment of this application.

[0142] Figure 4 This is a method for button interaction provided in an embodiment of this application.

[0143] Figure 5 It is a graph showing the relationship between the pressure detected by the button module and time in a button event.

[0144] Figure 6 This is a schematic diagram of a sliding event process.

[0145] Figure 7 yes Figure 6 The graph shown illustrates the relationship between light intensity detected by the button module and time during the sliding event.

[0146] Figure 8 yes Figure 6 The graph shown illustrates the relationship between pressure and time detected by the button module during a sliding event.

[0147] Figure 9 This is a schematic diagram of another type of sliding event process.

[0148] Figure 10 yes Figure 9 The graph shown illustrates the relationship between light intensity detected by the button module and time during the sliding event.

[0149] Figure 11 yes Figure 9 The graph shown illustrates the relationship between pressure and time detected by the button module during a sliding event.

[0150] Figure 12 This is a schematic diagram of a watch provided in an embodiment of this application.

[0151] Figure 13 This is a waveform diagram of motor vibration versus time provided in an embodiment of this application.

[0152] Figure 14 This is a graph showing the relationship between light intensity detected by the button module and time during a button event provided in an embodiment of this application.

[0153] Figure 15 This is a graph showing the relationship between pressure and time detected by the button module in a button event provided in an embodiment of this application.

[0154] Figure 16This is a waveform diagram showing the relationship between time and audio waveform of a speaker playback provided in an embodiment of this application.

[0155] Figures 17 to 23 This is a schematic diagram of a type of graphical interface with button interaction provided in an embodiment of this application.

[0156] Figures 24 to 26 This is a schematic diagram of another type of graphical interface with button interaction provided in the embodiments of this application.

[0157] Figure 27 This is another method of button interaction provided in the embodiments of this application.

[0158] Figure 28 This is yet another method of button interaction provided in the embodiments of this application.

[0159] Figure 29 This is yet another method of button interaction provided in the embodiments of this application.

[0160] Figure 30 This application provides a method for switching button function modes.

[0161] Figure 31 This is another method for switching button function modes provided in the embodiments of this application.

[0162] Figure 32 This is yet another method for switching button function modes provided in the embodiments of this application.

[0163] Figure 33 This is yet another method of button interaction provided in the embodiments of this application.

[0164] Figures 34 to 38 This is a schematic diagram of the graphical interface during the button interaction process provided in the embodiments of this application.

[0165] Figure 39 This is a schematic diagram of the structure of a button module provided in an embodiment of this application.

[0166] Figure 40 This is a schematic diagram of the structure of an earphone provided in an embodiment of this application.

[0167] Figure 41 This is a schematic diagram of the structure of a pair of glasses provided in an embodiment of this application.

[0168] Figure 42 This is a schematic diagram of the structure of a ring provided in an embodiment of this application.

[0169] Figure 43 This is a schematic diagram of a button interaction device provided in an embodiment of this application.

[0170] Figure 44 This is a schematic diagram of an electronic device provided in an embodiment of this application. Detailed Implementation

[0171] The technical solutions in this application will now be described with reference to the accompanying drawings.

[0172] The terminology used in the following embodiments is for the purpose of describing particular embodiments only and is not intended to be limiting of this application. As used in the specification and appended claims of this application, the singular expressions “a,” “an,” “the,” “the,” “the,” and “this” are intended to also include expressions such as “one or more,” unless the context clearly indicates otherwise. It should also be understood that in the following embodiments of this application, “at least one” and “one or more” refer to one, two, or more than two. The term “and / or” is used to describe the relationship between related objects, indicating that three relationships may exist; for example, A and / or B can indicate: A alone, A and B simultaneously, or B alone, where A and B can be singular or plural. The character “ / ” generally indicates that the preceding and following related objects are in an “or” relationship.

[0173] References to "one embodiment" or "some embodiments" as described in this specification mean that one or more embodiments of this application include a specific feature, structure, or characteristic described in connection with that embodiment. Therefore, the phrases "in one embodiment," "in some embodiments," "in other embodiments," "in still other embodiments," etc., appearing in different parts of this specification do not necessarily refer to the same embodiment, but rather mean "one or more, but not all, embodiments," unless otherwise specifically emphasized. The terms "comprising," "including," "having," and variations thereof mean "including but not limited to," unless otherwise specifically emphasized.

[0174] The methods provided in this application can be applied to electronic devices such as mobile phones, tablets, wearable devices, in-vehicle devices, augmented reality (AR) / virtual reality (VR) devices, laptops, ultra-mobile personal computers (UMPCs), netbooks, and personal digital assistants (PDAs). This application does not impose any restrictions on the specific type of electronic device.

[0175] For example, Figure 1A schematic diagram of the structure of electronic device 100 is shown. Electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, antenna 1, antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, a headphone jack 170D, a sensor module 180, buttons 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc. The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, an electrocardiogram (ECG) sensor 180C, a magnetic sensor 180D, an accelerometer sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a photoplethysmogram (PPG) sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, etc.

[0176] In some examples, electronic device 100 may also include a capacitive sensor (capacitive touch sensor).

[0177] As one implementation, the pressure sensor 180A described above can be a piezoresistive pressure sensor or a piezoelectric pressure sensor. The pressure sensor 180A can be used to detect pressure data at one or more locations, or in other words, it can be used to detect pressure data at a single location or in a specific area.

[0178] In one implementation, the PPG sensor 180H may include one or more light-emitting elements as a light source. The light-emitting element may be a light-emitting diode (LED) or a vertical-cavity surface-emitting laser (VCSEL). The PPG sensor 180H may also include one or more photodiodes (PDs) as light detection elements. The multiple light-emitting elements may be arranged in an array to form a light-emitting element array, and the multiple photodiodes may be arranged in an array to form a photodiode array.

[0179] In some examples, multiple sensors within an electronic device 100 can work together to form a sensor module that can perform the functions of the multiple sensors it contains.

[0180] As an example, the electronic device 100 may include a button module, which may include a pressure sensor 180A, an ECG sensor 180C, and a PPG sensor 180H. One electrode of the ECG sensor 180C may be located on the surface of the contact surface of the button module. When a user presses the button, the ECG sensor can detect the user's electrocardiogram signal through the electrode, the pressure sensor 180A can detect the magnitude of the pressure applied by the user pressing the button, and the light emitted by the light-emitting element in the PPG sensor 180H can be received by a photodiode after being reflected by the human body, thereby enabling the detection of the corresponding light signal.

[0181] It is understood that the structures illustrated in the embodiments of this application do not constitute a specific limitation on the electronic device 100. In other embodiments of this application, the electronic device 100 may include more or fewer components than illustrated, or combine some components, or split some components, or have different component arrangements. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

[0182] Processor 110 may include one or more processing units, such as: application processor (AP), modem processor, graphics processing unit (GPU), image signal processor (ISP), controller, memory, video codec, digital signal processor (DSP), baseband processor, and / or neural network processing unit (NPU), etc. Different processing units may be independent devices or integrated into one or more processors.

[0183] The controller can be the nerve center and command center of the electronic device 100. The controller can generate operation control signals according to the instruction opcode and timing signals to complete the control of fetching and executing instructions.

[0184] The processor 110 may also include a memory for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. This memory can store instructions or data that the processor 110 has just used or that are used repeatedly. If the processor 110 needs to use the instruction or data again, it can retrieve it directly from the memory. This avoids repeated accesses, reduces the waiting time of the processor 110, and thus improves the efficiency of the system.

[0185] In some embodiments, the processor 110 may include one or more interfaces. Interfaces may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface, etc.

[0186] USB port 130 is a USB standard compliant interface, specifically a Mini USB port, Micro USB port, USB Type-C port, etc. USB port 130 can be used to connect a charger to charge electronic device 100, and can also be used for data transfer between electronic device 100 and peripheral devices. It can also be used to connect headphones for audio playback. This interface can also be used to connect other electronic devices, such as AR devices.

[0187] It is understood that the interface connection relationships between the modules illustrated in the embodiments of this application are merely illustrative and do not constitute a structural limitation on the electronic device 100. In other embodiments of this application, the electronic device 100 may also employ different interface connection methods or combinations of multiple interface connection methods as described in the above embodiments.

[0188] The charging management module 140 receives charging input from a charger. The charger can be a wireless charger or a wired charger. In some wired charging embodiments, the charging management module 140 receives charging input from the wired charger via the USB interface 130. In some wireless charging embodiments, the charging management module 140 receives wireless charging input via the wireless charging coil of the electronic device 100. While charging the battery 142, the charging management module 140 can also supply power to the electronic device via the power management module 141.

[0189] The power management module 141 connects the battery 142, the charging management module 140, and the processor 110. The power management module 141 receives input from the battery 142 and / or the charging management module 140, providing power to the processor 110, internal memory 121, external memory, display screen 194, camera 193, and wireless communication module 160, etc. The power management module 141 can also monitor parameters such as battery capacity, battery cycle count, and battery health status (leakage current, impedance). In some other embodiments, the power management module 141 may also be located within the processor 110. In other embodiments, the power management module 141 and the charging management module 140 may be located in the same device.

[0190] The wireless communication function of electronic device 100 can be realized through antenna 1, antenna 2, mobile communication module 150, wireless communication module 160, modem processor and baseband processor, etc.

[0191] Antenna 1 and antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in electronic device 100 can be used to cover one or more communication frequency bands. Different antennas can also be multiplexed to improve antenna utilization. For example, antenna 1 can be multiplexed as a diversity antenna for a wireless local area network. In some other embodiments, the antennas can be used in conjunction with tuning switches.

[0192] The mobile communication module 150 can provide solutions for wireless communication, including 2G / 3G / 4G / 5G, applied to the electronic device 100. The mobile communication module 150 may include at least one filter, switch, power amplifier, low noise amplifier (LNA), etc.

[0193] The wireless communication module 160 can provide solutions for wireless communication applications on the electronic device 100, including wireless local area networks (WLANs) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), and infrared (IR) technologies. The wireless communication module 160 can be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via antenna 2, performs frequency modulation and filtering of the electromagnetic wave signals, and sends the processed signal to processor 110. The wireless communication module 160 can also receive signals to be transmitted from processor 110, perform frequency modulation and amplification, and convert them into electromagnetic waves for radiation via antenna 2.

[0194] Electronic device 100 implements display functions through a GPU, a display screen 194, and an application processor. The GPU is a microprocessor for image processing, connected to the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations and for graphics rendering. Processor 110 may include one or more GPUs, which execute program instructions to generate or modify display information.

[0195] Display screen 194 is used to display images, videos, etc. Display screen 194 includes a display panel. The display panel may be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), a miniature LED, a microLED, a quantum dot light-emitting diode (QLED), etc. In some embodiments, electronic device 100 may include one or N displays 194, where N is a positive integer greater than 1.

[0196] Electronic device 100 can perform shooting functions through ISP, camera 193, video codec, GPU, display 194 and application processor.

[0197] The ISP (Image Signal Processor) is used to process data fed back from the camera 193. For example, when taking a picture, the shutter is opened, and light is transmitted through the lens to the camera's photosensitive element. The light signal is converted into an electrical signal, and the camera's photosensitive element transmits the electrical signal to the ISP for processing, transforming it into an image visible to the naked eye. The ISP can also perform algorithmic optimization of image noise, brightness, and skin tone. The ISP can also optimize parameters such as exposure and color temperature of the shooting scene. In some embodiments, the ISP can be set in the camera 193.

[0198] Camera 193 is used to capture still images or videos. An object is projected onto a photosensitive element by generating an optical image through the lens. The photosensitive element can be a charge-coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the light signal into an electrical signal, which is then passed to an ISP for conversion into a digital image signal. The ISP outputs the digital image signal to a DSP for processing. The DSP converts the digital image signal into image signals in standard RGB, YUV, or other formats. In some embodiments, the electronic device 100 may include one or N cameras 193, where N is a positive integer greater than 1.

[0199] Digital signal processors (DSPs) are used to process digital signals. Besides digital image signals, they can also process other digital signals. For example, when electronic device 100 selects a frequency, the DSP can perform Fourier transforms on the frequency energy.

[0200] Video codecs are used to compress or decompress digital video. Electronic device 100 may support one or more video codecs. Thus, electronic device 100 can play or record videos in various encoding formats, such as Moving Picture Experts Group (MPEG) 1, MPEG 2, MPEG 3, MPEG 4, etc.

[0201] An NPU (Neural Processing Unit) is a computational processor for neural networks (NNs). By borrowing the structure of biological neural networks, such as the transmission patterns between neurons in the human brain, it can rapidly process input information and continuously learn on its own. NPUs enable intelligent cognitive applications in electronic devices, such as image recognition, facial recognition, speech recognition, and text understanding.

[0202] The external storage interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 100. The external memory card communicates with the processor 110 through the external storage interface 120 to perform data storage functions. For example, music, video, and other files can be saved on the external memory card.

[0203] Internal memory 121 can be used to store computer executable program code, which includes instructions. Processor 110 executes various functional applications and data processing of electronic device 100 by running the instructions stored in internal memory 121. Internal memory 121 may include a program storage area and a data storage area. The program storage area may store the operating system, at least one application program required for a function (such as sound playback, image playback, etc.), etc. The data storage area may store data created during the use of electronic device 100 (such as audio data, phonebook, etc.). Furthermore, internal memory 121 may include high-speed random access memory and may also include non-volatile memory, such as at least one disk storage device, flash memory device, universal flash storage (UFS), etc.

[0204] Electronic device 100 can implement audio functions, such as music playback and recording, through audio module 170, speaker 170A, receiver 170B, microphone 170C, headphone jack 170D, and application processor.

[0205] The audio module 170 is used to convert digital audio information into analog audio signals for output, and also to convert analog audio input into digital audio signals. The audio module 170 can also be used for encoding and decoding audio signals. In some embodiments, the audio module 170 may be located in the processor 110, or some functional modules of the audio module 170 may be located in the processor 110.

[0206] Buttons 190 include a power button, volume buttons, etc. Buttons 190 can be mechanical buttons or touch-sensitive buttons. Electronic device 100 can receive button input and generate key signal inputs related to user settings and function control of electronic device 100.

[0207] The software system of electronic device 100 can adopt a layered architecture, event-driven architecture, microkernel architecture, microservice architecture, or cloud architecture. This application embodiment uses the layered architecture Android system as an example to exemplify the software structure of electronic device 100.

[0208] Figure 2This is a software structure block diagram of an electronic device 100 according to an embodiment of this application. The layered architecture divides the software into several layers, each with a clear role and function. Layers communicate with each other through software interfaces. In some embodiments, the Android system is divided into four layers, from top to bottom: the application layer, the application framework layer, the Android runtime and system libraries, and the kernel layer. The application layer may include a series of application packages.

[0209] like Figure 2 As shown, the application package may include applications such as camera, gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video, and SMS.

[0210] The application framework layer provides application programming interfaces (APIs) and a programming framework for applications in the application layer. The application framework layer includes some predefined functions.

[0211] like Figure 2 As shown, the application framework layer may include a window manager, content provider, view system, phone manager, resource manager, notification manager, etc.

[0212] The window manager is used to manage windowed applications. It can retrieve screen size, determine the presence of a status bar, lock the screen, and capture screenshots, among other things.

[0213] Content providers store and retrieve data, making that data accessible to applications. This data may include videos, images, audio, made and received phone calls, browsing history and bookmarks, phone books, etc.

[0214] A view system includes visual controls, such as controls for displaying text and controls for displaying images. View systems can be used to build applications. A display interface can consist of one or more views. For example, a display interface including a text notification icon could include views for displaying text and views for displaying images.

[0215] The phone manager is used to provide communication functions for electronic device 100. For example, it manages call status (including connection and disconnection).

[0216] The file explorer provides applications with various resources, such as localized strings, icons, images, layout files, video files, and more.

[0217] The notification manager allows applications to display notifications in the status bar. These notifications can be used to deliver informational messages and can disappear automatically after a short pause, requiring no user interaction. For example, the notification manager can be used to notify users of completed downloads or message alerts. The notification manager can also display notifications as icons or scrolling text in the top status bar, such as notifications from background applications, or as dialog boxes on the screen. Examples include displaying text messages in the status bar, emitting sounds, vibrating electronic devices, and flashing indicator lights.

[0218] The Android runtime consists of core libraries and a virtual machine. The Android runtime is responsible for scheduling and managing the Android system.

[0219] The core library consists of two parts: one part is the functionalities that need to be called by the Java language, and the other part is the Android core library.

[0220] The application layer and application framework layer run in a virtual machine. The virtual machine executes the Java files of the application layer and application framework layer as binary files. The virtual machine is used to perform functions such as object lifecycle management, stack management, thread management, security and exception management, and garbage collection.

[0221] System libraries can include multiple functional modules. For example: surface manager, media libraries, 3D graphics processing libraries (e.g., OpenGL ES), 2D graphics engines (e.g., SGL), etc.

[0222] The Surface Manager is used to manage the display subsystem and provides the blending of 2D and 3D layers for multiple applications.

[0223] The media library supports playback and recording of various common audio and video formats, as well as still image files. It supports multiple audio and video encoding formats, such as MPEG4, H.264, MP3, AAC, AMR, JPG, and PNG.

[0224] The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, compositing, and layer processing.

[0225] A 2D graphics engine is a graphics engine for 2D drawing.

[0226] The kernel layer is the layer between hardware and software. It contains at least display drivers, camera drivers, audio drivers, and sensor drivers. Sensor drivers acquire and process data collected by sensors. They also provide application programming interfaces (APIs) that can be called by the operating system and applications, allowing them to read the processed sensor data.

[0227] As an example, the driver for pressure sensor 180A mentioned earlier can be used to read the pressure data detected by the pressure sensor and perform preliminary filtering to remove noise. The driver for pressure sensor 180A can also provide an application programming interface (API) for the operating system and applications, enabling them to access and process the pressure data. Furthermore, the driver can trigger an event notification when the pressure data reaches a preset threshold, instructing the application to perform appropriate processing. The driver for pressure sensor 180A can also be used to control its power consumption; for example, setting the pressure sensor 180A to a low-power mode when frequent data reading is not required, and quickly waking the sensor when data reading is needed to ensure real-time data transmission.

[0228] As an example, the driver for the ECG sensor 180C mentioned above can be used to initialize the ECG sensor 180C when the electronic device 100 starts up, setting the operating mode, sampling rate, etc. of the ECG sensor 180C; the sensor driver can also be used to read the user's electrocardiogram (ECG) signal from the ECG electrodes and amplify the signal; the sensor driver can also be used to filter the acquired ECG signal to improve the signal quality; the sensor driver can also provide an application programming interface for the operating system and applications to access and acquire the aforementioned ECG signal data; the sensor driver can also be used to trigger event notifications to notify the applications to perform corresponding processing; the sensor driver can also be used for power consumption management of the ECG sensor 180C, etc.

[0229] As an example, the driver for the PPG sensor 180H mentioned above can be used to configure the operating parameters of the PPG sensor 180H (such as the luminous intensity of the light-emitting diode, the sensitivity of the photodiode, etc.) according to the needs of the application scenario; the sensor driver can also be used to read the light intensity data detected by the photodiode; the sensor driver can also be used to filter the aforementioned light intensity data to remove ambient light interference, etc.; the sensor driver can also be used to provide an application programming interface for the operating system and applications to access and process the data collected by the PPG sensor 180H; the sensor driver can also be used to trigger event notifications to notify the application to perform corresponding processing; the sensor driver can also be used for power consumption management of the PPG sensor 180H, etc.

[0230] As an example, the sensor driver for the capacitive sensor mentioned above can be used to configure the operating parameters of the capacitive sensor (such as touch sensitivity, scanning frequency, etc.) according to the needs of the application scenario; the sensor driver can also determine the touch position and recognize touch gestures (such as swiping, zooming, rotating, etc.) by detecting changes in capacitance on the sensor; the sensor driver can also filter the acquired capacitive signal to remove noise and interference and improve the purity of the signal; the sensor driver can also be used to trigger event notifications to notify the application to perform corresponding processing; the sensor driver can also be used for power consumption management of the capacitive sensor, etc.

[0231] It should be understood that the technical solutions in the embodiments of this application can be used in systems such as Android, iOS, and HarmonyOS.

[0232] like Figure 3 The diagram shown is a schematic block diagram of a button module 10 provided in an embodiment of this application. The button module 10 may include a detection module 12 and a detection module 14. When the user operates the button module 10 (e.g., presses, touches, etc.), the detection module 12 and the detection module 14 can detect the corresponding signal.

[0233] In some examples, the button module 10 can be a mechanical button or a touch button. The button module 10 can include a contact surface that is easy for the user to press or touch. The user can operate the button module 10 by pressing or touching the contact surface.

[0234] For example, the button module 10 can be a mechanical button. The user can operate the button module 10 by pressing the contact surface of the mechanical button. When the user's pressing operation is detected, the button module 10 can trigger a button event.

[0235] For example, the button module 10 can be a touch button. Users can operate the button module 10 by touching the contact surface of the touch button. When the user's touch operation is detected, the button module 10 can trigger a button event.

[0236] In some scenarios, touching the contact surface of a touch button and pressing the contact surface of a mechanical button can both be considered trigger operations. For ease of explanation, unless otherwise specified, touch operations and pressing operations will not be distinguished in the following examples and will be uniformly represented as tap operations. In addition, users can also control the buttons by sliding the contact surface of the touch button or the contact surface of the mechanical button. The following operations performed by the user on the button module 10 (including tap operations, sliding operations, etc.) will be uniformly represented as trigger operations.

[0237] The trigger operation is initiated by the user and represents the user's intention to operate the button module 10. A button event reflects the change in the internal state of the electronic device when the user operates the button module 10. In other words, a button event can be understood as the electronic device's representation of the user's action on the button module 10. The electronic device can identify the trigger operation by detecting the button event corresponding to it and respond accordingly.

[0238] As an example, the above button events can be tap events or swipe events.

[0239] For example, a tap event can include: a dash event, a light tap event, a heavy tap event, a short tap event, a long press event, a single tap event, a double tap event, a triple tap event, etc. The triggering operation corresponding to the tap event can include: a dash operation, a light tap operation, a heavy press operation, a short tap operation, a long press operation, a single tap operation, a double tap operation, a triple tap operation, etc.

[0240] For example, swipe events can include: swipe up, swipe down, swipe left, swipe right, short swipe, and long swipe. The corresponding triggering operations can include: swipe up, swipe down, swipe left, swipe right, short swipe, and long swipe.

[0241] In some examples, the detection module 12 can be used to detect a signal Sg1, which can be used to determine whether a genuine user operation exists. Here, a genuine user operation is relative to the case of accidental touch of the button module 10, and a genuine user operation can correspond to the user's intention to use the button module 10. For example, during actual use of the button module 10, the user will press or touch the contact surface, thereby generating a genuine button event.

[0242] As an example, signal Sg1 may include biological signals, such as human electrocardiogram signals, human bioimpedance signals, etc.

[0243] As an implementation, the button module 10 may include multiple electrodes, wherein one electrode (electrode Na) may be located on the contact surface of the button module 10, and another electrode (electrode Nb) may be located at other locations on the electronic device containing the button module 10 that can contact the user's skin. When the user uses the button module 10, the user's right hand can contact the aforementioned electrode Na, and the other electrode Nb can contact other parts of the user's body (e.g., the wrist of the left hand, face, etc.), and the two electrodes can conduct electricity through the human body. Based on this, the button module 10 can detect electrocardiogram signals and / or bioimpedance signals of the human body through these two electrodes.

[0244] As an example, signal Sg1 may include pressure signal and capacitance signal.

[0245] As an implementation, the button module 10 may include a pressure sensor and a capacitance sensor. By combining the pressure signal detected by the pressure sensor array and the capacitance signal detected by the capacitance sensor, it can be determined whether there is a real user operation.

[0246] As an example, signal Sg1 may also include biological signals and one or more of the following signals: pressure signals, capacitance signals, temperature signals, light signals, etc.

[0247] In some examples, the detection module 14 can be used to detect signals Sg2 and Sg3, which can be used to determine the type of triggering operation.

[0248] For example, signals Sg2 and Sg3 can be any of the following: pressure signals, light signals, capacitance signals, elastic wave signals, ultrasonic signals, millimeter wave signals, electromagnetic wave signals of different frequency bands (such as Bluetooth signals, star flash signals, ultra-wideband signals, near-field communication signals), etc.

[0249] Here, pressure signals can contain information such as pressure values; light signals can contain information such as light intensity; elastic wave signals can contain information such as the amplitude, frequency, and waveform of elastic waves; capacitance signals can contain information such as capacitance values; ultrasonic signals can contain information such as the amplitude, frequency, and waveform of ultrasonic waves; millimeter wave signals can contain information such as the amplitude, frequency, and waveform of millimeter waves; and electromagnetic wave signals can contain information such as the amplitude, frequency, and waveform of electromagnetic waves.

[0250] One possibility is that the triggering action described above could be a tap.

[0251] In some examples, the button module 10 can determine whether the triggering operation is a tap operation and the type of tap operation based on the signal detected at the same position on the contact surface. Specifically, the detection module 14 can identify a tap operation based on the signal at the same position on the contact surface at different times. In other words, the detection module 14 can identify a tap operation based on the change in the signal at the same position on the contact surface.

[0252] As an example, signal Sg2 can be the pressure signal at position Ps1 on the contact surface of button module 10 at time t11, and signal Sg3 can be the pressure signal at the aforementioned position Ps1 at time t12. The time interval between time t11 and time t12 can be Δt1. In other words, the electronic device can identify the user's tap operation by detecting the pressure signals at the same position on the contact surface at different times using button module 10. Or, the electronic device can identify the tap operation based on the pressure signals at the same position on button module 10 at different times.

[0253] For example, if the pressure values ​​indicated by both signal Sg2 and signal Sg3 are less than or equal to the pressure threshold PrTh11, and Δt1 is less than the duration threshold TiTh11, the electronic device can determine that a light press operation has been detected; if the pressure values ​​indicated by both signal Sg2 and signal Sg3 are greater than or equal to the pressure threshold PrTh12, and Δt1 is less than or equal to the duration threshold TiTh12, the electronic device can determine that a heavy press operation has been detected. Here, the pressure threshold PrTh11 can be less than the pressure threshold PrTh12.

[0254] For example, if the pressure values ​​indicated by signals Sg2 and Sg3 are both greater than or equal to the pressure threshold PrTh21 and less than the pressure threshold PrTh22, and Δt1 is less than or equal to the duration threshold TiTh21, the electronic device can determine that a short press operation has been detected; if the pressure values ​​indicated by signals Sg2 and Sg3 are both greater than or equal to the pressure threshold PrTh21, and Δt1 is greater than the duration threshold TiTh22, the electronic device can determine that a long press operation has been detected. Here, the duration threshold TiTh21 can be less than the duration threshold TiTh22.

[0255] As an example, Figure 4 The diagram illustrates the relationship between pressure detected by the pressure sensor and time during a single key press event. As an example, the pressure F detected by the pressure sensor is approximately related to time t by the formula: F = g(t). After the user's finger touches the contact surface of the key module 10, the pressure F detected by the pressure sensor gradually increases, reaching a maximum value Fm before gradually decreasing. The stage where the pressure gradually rises from zero to the maximum value Fm can be called stage St1, and the stage where the pressure gradually decreases from the maximum value Fm to zero can be called stage St2.

[0256] In some examples, the electronic device can determine the type of tap operation based on the magnitude of the pressure applied by the user to the contact surface of the button module 10 and / or the duration of the trigger operation.

[0257] Here, the hold time of the trigger operation can refer to the time interval between two preset pressure thresholds in a single trigger operation. Combined with... Figure 4 One of the aforementioned two pressure thresholds can be a pressure value F1, and the other can be a pressure value F3. That is, the holding time of the trigger operation can be understood as the time interval (Δt) between the moment when the pressure value F detected by the pressure sensor rises to pressure value F1 (t1) and the moment when it falls to pressure value F3 (t3). In one possible implementation, pressure value F1 can be greater than pressure value F3. For example, pressure value F1 can be 120 gF, and pressure value F3 can be 90 gF.

[0258] For example, the electronic device can determine a dummy action or a pressing action based on the magnitude of the pressure applied by the user to the contact surface of the button module 10.

[0259] For example, combining Figure 4 When the pressure F detected by the pressure sensor is greater than 20gF and less than or equal to 60gF, the electronic device can determine that the trigger operation is a dummy action; when the pressure F is greater than 60gF, the electronic device can determine that the trigger operation is a pressing action.

[0260] For example, the electronic device can determine a dummy press, a light press, or a hard press based on the maximum value Fm of the pressure applied by the user to the contact surface of the button module 10.

[0261] For example, if the maximum value Fm is less than or equal to 60gF, the electronic device can determine that the trigger operation is a dummy press; if the maximum value Fm is greater than 60gF and less than or equal to 200gF, the trigger operation is determined to be a light press; if the maximum value Fm is greater than 200gF, the electronic device can determine that the trigger operation is a hard press.

[0262] For example, the electronic device can determine a dummy press, a light press, or a hard press based on the magnitude of the pressure applied by the user to the contact surface of the button module 10 and the duration of the trigger operation.

[0263] For example, if the pressure F detected by the pressure sensor is greater than 20gF and less than or equal to 60gF, and the holding time of the trigger operation is greater than 1 second, the electronic device can determine that the trigger operation is a light press; if the pressure F is greater than 60gF and less than or equal to 200gF, and the holding time of the trigger operation is less than or equal to 1 second, the electronic device can determine that the trigger operation is a light press; if the pressure F is greater than 200gF and the duration of the trigger operation is less than or equal to 1 second, the electronic device can determine that the trigger operation is a hard press.

[0264] For example, an electronic device can determine a short press or a long press action based on the duration of the triggered operation.

[0265] For example, if the holding time of the triggered operation is less than or equal to 1 second, the electronic device can determine that the triggered operation is a short press; if the holding time of the triggered operation is greater than 1 second, the electronic device can determine that the triggered operation is a long press.

[0266] For example, an electronic device may also determine whether a triggering action is a tapping or clicking action based on the duration of the triggering action.

[0267] For example, if the duration of the triggered action is less than or equal to 0.2 seconds (or 0.5 seconds), the electronic device can determine that the triggered action is a tap; if the duration of the triggered action is greater than 0.2 seconds (or 0.5 seconds), the electronic device can determine that the triggered action is a click.

[0268] In some examples, electronic devices can determine whether an action is a single click, double click, or multi-click based on whether there are consecutive taps. Alternatively, electronic devices can determine whether the triggered action is a single click, double click, or multi-click based on the time interval between two key events.

[0269] As an example, the time interval between two button events can be the time difference between the moments when the pressure sensor detects the maximum pressure Fm in the two button events.

[0270] For example, if the time interval between two key events is less than or equal to 0.5 seconds, the electronic device can determine that the triggered operation is a double-click action; if the time interval between two key events is greater than 0.5 seconds, the electronic device can determine that the triggered operation is a double-click action; if the time interval between two adjacent key events in three or more key events is less than or equal to 0.5 seconds, the electronic device can determine that the triggered operation is a multi-click action.

[0271] As an example, signal Sg2 can be the light signal at position Ps2 on the contact surface of button module 10 at time t21, and signal Sg3 can be the light signal at the aforementioned position Ps2 at time t22. The time interval between time t21 and time t22 can be Δt2. In other words, the electronic device can identify the user's tap operation by detecting the light signals at the same position on the contact surface at different times using button module 10. Or, the electronic device can identify the tap operation based on the light signals at the same position on button module 10 at different times.

[0272] As a implementation, if the light intensity indicated by both signal Sg2 and signal Sg3 is less than or equal to the light intensity threshold LtTh11, and Δt2 is less than the duration threshold TiTh31, the electronic device can determine that a light press operation has been detected; if the light intensity indicated by both signal Sg2 and signal Sg3 is greater than or equal to the light intensity threshold LtTh12, and Δt2 is less than or equal to the duration threshold TiTh32, the electronic device can determine that a heavy press operation has been detected. Here, the light intensity threshold LtTh11 is less than the light intensity threshold LtTh12.

[0273] As a implementation, if the light intensity indicated by both signal Sg2 and signal Sg3 is greater than or equal to the light intensity threshold LtTh21 and less than the light intensity threshold LtTh22, and Δt2 is less than or equal to the duration threshold TiTh41, the electronic device can determine that a short press operation has been detected; if the light intensity indicated by both signal Sg2 and signal Sg3 is greater than or equal to the light intensity threshold LtTh21, and Δt2 is greater than the duration threshold TiTh42, the electronic device can determine that a long press operation has been detected. Here, the duration threshold TiTh42 is greater than the duration threshold TiTh41.

[0274] As an example, signal Sg2 can be the elastic wave signal at position Ps3 on the contact surface of button module 10 at time t31, and signal Sg3 can be the elastic wave signal at the aforementioned position Ps3 at time t32. In other words, the electronic device can identify the user's tap operation by detecting the elastic wave signal at the same position on the contact surface of button module 10. Or, the electronic device can identify the tap operation based on the elastic wave signal at the same position on button module 10 at different times.

[0275] As an example, signal Sg2 can be the capacitance signal at position Ps4 on the contact surface of button module 10 at time t41, and signal Sg3 can be the capacitance signal at the aforementioned position Ps4 at time t42. In other words, the electronic device can identify the user's tap operation by detecting the capacitance signal at the same position on the contact surface of button module 10. Or, the electronic device can identify the tap operation based on the capacitance signal at the same position on button module 10 at different times.

[0276] In some examples, to improve the accuracy of recognizing tap operations, the button module can determine whether the trigger operation is a tap operation and the type of tap operation based on signals detected at multiple locations on the contact surface.

[0277] For example, the signals Sg2 and Sg3 mentioned above can be signals detected at different locations but at the same time. For instance, signal Sg2 can be the signal detected by the detection module 14 at position Ps51 on the contact surface at time t5, and signal Sg3 can be the signal detected by the detection module 14 at position Ps52 on the contact surface at time t5.

[0278] As an example, if the trigger operation at time t5 and position Ps51 indicated by signal Sg2 is a tap operation and the trigger operation at time t5 and position Ps52 indicated by signal Sg3 is also a tap operation, the button module 10 can determine that the trigger operation at time t5 is a tap operation.

[0279] Similarly, when signals Sg2 and Sg3 indicate that the tap operation at position Ps51 and the tap operation at position Ps52 are both of the same type of tap operation, the button module 10 can determine that the tap operation at time t5 is of the aforementioned tap operation type.

[0280] One possibility is that the triggering operation described above could be a sliding operation.

[0281] In some examples, the button module 10 can identify the sliding operation and its type based on signal changes at the same location on the contact surface. Specifically, the detection module 14 can detect signal changes at the same location on the contact surface over a period of time to identify the sliding operation.

[0282] For example, the detection module 14 can collect signals multiple times within the time period Δt3. For instance, signal Sg2 can be the signal detected at time t61 and position Ps6 on the contact surface within the time period Δt3, and signal Sg3 can be the signal detected at time t62 and position Ps6 on the contact surface within the time period Δt3. The button module 10 can identify the sliding operation as any of the following based on the intensity change of the signal at position Ps6 within the time period Δt3: upward sliding operation, downward sliding operation, left sliding operation, and right sliding operation, etc.

[0283] For example, if the signal strength at position Ps6 changes according to pattern Cm1 within time period Δt3, the button module 10 can determine that the sliding operation is an upward sliding operation; if the signal strength at position Ps6 changes according to pattern Cm2 within time period Δt3, the button module 10 can determine that the sliding operation is a downward sliding operation; if the signal strength at position Ps6 changes according to pattern Cm3 within time period Δt3, the button module 10 can determine that the sliding operation is a leftward sliding operation; and if the signal strength at position Ps6 changes according to pattern Cm4 within time period Δt3, the button module 10 can determine that the sliding operation is a rightward sliding operation.

[0284] Among them, the change methods Cm1, Cm2, Cm3 and Cm4 are different. The different change methods will be explained in detail below and will not be elaborated here.

[0285] In some examples, the button module 10 can identify sliding operations and their types based on signal changes at multiple locations on the contact surface. Specifically, the detection module 14 can identify sliding operations by detecting signal changes at different locations within a region on the contact surface over a period of time.

[0286] For example, the detection module 14 can collect signals from different positions within region Ar1 on the contact surface multiple times during the time period Δt4. For instance, signal Sg2 may include signals Sg21 and Sg22, and signal Sg3 may include signals Sg31 and Sg32. Signal Sg21 can be the signal detected at position Ps71 within region Ar1 at time t71, and signal Sg22 can be the signal detected at position Ps71 within region Ar1 at time t72. Similarly, signal Sg31 can be the signal detected at position Ps72 within region Ar1 at time t71, and signal Sg32 can be the signal detected at position Ps72 within region Ar1 at time t72. The button module 10 can identify the sliding operation as any of the following based on the aforementioned signals Sg21, Sg22, Sg31, and Sg32: an upward sliding operation, a downward sliding operation, a leftward sliding operation, and a rightward sliding operation.

[0287] In one possible implementation, the aforementioned signals Sg2, Sg21, Sg22, Sg3, Sg31, and Sg32 can be one or more of the following: pressure signals, optical signals, capacitance signals, elastic wave signals, ultrasonic signals, millimeter wave signals, and electromagnetic wave signals of different frequency bands (such as Bluetooth signals, stroboscopic signals, ultra-wideband signals, and near-field communication signals).

[0288] In the above-mentioned schemes for recognizing sliding operations, the accuracy of the scheme that identifies sliding operations by changes in signals at the same location may be low, while the scheme that identifies sliding operations by changes in signals at multiple locations within a region requires a large amount of data to be collected and processed, and the efficiency of recognizing sliding operations may be low. In addition, for the scheme that detects signals at multiple locations within a region, the sensor used to collect the signals needs to contain a large number of sensing elements, and these sensing elements need to be distributed in the same plane. The plane containing the multiple sensing elements is roughly parallel to the contact surface of the button module 10, which limits the miniaturization of the button module 10.

[0289] In order to improve the efficiency of sliding operation recognition without reducing the accuracy of sliding operation recognition, and also to reduce the size of the button module 10, in some examples, the signals Sg2 and Sg3 used to recognize sliding operations can be different types of signals. In other words, the button module 10 can recognize sliding operations based on multiple types of signals.

[0290] In some examples, the button module 10 may also include a detection module 16, which can be used to detect signal Sg3, while the aforementioned detection module 14 can be used to detect signal Sg2. Signals Sg2 and Sg3 may be of different types. As one implementation, the structural components included in the detection module 14 may be stacked with the structural components included in the detection module 16, wherein the stacking direction may be approximately along the normal of the contact surface of the button module 10.

[0291] For example, signal Sg2 can be a signal of type Kd1 detected by the detection module 14 at position Ps81 on the contact surface; signal Sg3 can be a signal of type Kd2 detected by the detection module 16 at position Ps82 on the contact surface. The button module 10 can combine the detection results of the aforementioned signal of type Kd1 at different times and the detection results of the signal of type Kd2 at different times to identify the sliding operation.

[0292] The details of the button module 10's combination of multiple signal recognition methods for sliding operations will be explained in detail below and will not be elaborated here.

[0293] The button module 10 can combine signals detected by multiple sensors to determine sliding operations, which can improve the accuracy of recognizing sliding operations to a certain extent. In addition, multiple sensors can be stacked along the thickness direction of the button module 10, which also helps to reduce the size of the button module 10 to some extent.

[0294] From an implementation perspective, the detection modules 12, 14 and 16 mentioned above can all include sensors, and these detection modules can detect the corresponding signals through the sensors.

[0295] For example, the detection module 12 described above may include an ECG sensor. This ECG sensor can be used to detect electrocardiogram (ECG) signals generated by the heart. As an example, the ECG sensor may include multiple detection electrodes that can contact different parts of the body. Since ECG signals generate different potentials at different parts of the body, by collecting and analyzing ECG signals from different locations using multiple detection electrodes, the user's cardiac electrical activity can be determined, and an electrocardiogram (ECG) of the user can be output.

[0296] Typically, ECG sensors detect electrocardiogram (ECG) signals based on the potential differences generated by the heart in different parts of the body. When using an ECG sensor with two electrodes, the greater the distance between the parts of the body wearing the electrodes, the more significant the potential difference detected between them. In this case, it is easier to analyze the user's heart rate from the ECG signal. Conversely, the closer the parts of the body wearing the electrodes, the smaller the potential difference detected between them. In this case, the ECG signal reflects more noise and cannot accurately reflect the user's heart rate.

[0297] As an example, one electrode (electrode Na) of the ECG sensor can be in contact with the skin of the user's left arm (e.g., region Ar2) (e.g., the device containing the button module 10 can be a watch, in which case electrode Na can be located at the position where the watch body contacts the user's wrist skin (e.g., electrode Na is located on the bottom of the watch)), and the other electrode (electrode Nb) of the ECG sensor can be disposed on the contact surface of the button module 10.

[0298] For example, the detection module 12 described above may include a bioimpedance sensor. This bioimpedance sensor can be used to measure the electrical properties of human tissues or cells. As an example, the bioimpedance sensor may include multiple electrodes that can contact the user's skin and are used to apply an excitation current to the contact area; these electrodes can also detect a voltage signal at the contact area corresponding to the aforementioned excitation current; based on the excitation current and the detected voltage signal, the bioimpedance of the human body part in contact with the bioimpedance sensor can be determined.

[0299] Components in the human body, such as cell membranes, cytosolic fluid, blood vessels, and fat, can exhibit impedance effects under electrical excitation. The impedance of different parts of the body can be viewed as couplings of capacitors and resistors of varying magnitudes. Due to differences in the water, fat, muscle, and bone content of different parts of the body, the equivalent impedance exhibited by different parts under the same electrical excitation varies. Therefore, a bioimpedance sensor in an electronic device applies an excitation current to different parts of the body and detects the corresponding bioimpedance signals to determine the bioimpedance of each part. If the distance between the two detection electrodes of the bioimpedance sensor and the body part they contact is short, there is less body tissue between the two electrodes, resulting in a lower detected bioimpedance; conversely, if the distance between the two detection electrodes and the body part they contact is long, there is more body tissue between the two electrodes, resulting in a higher detected bioimpedance.

[0300] As an example, one electrode (electrode Nc) of the bioimpedance sensor can contact the skin of the user's left arm (e.g., region Ar3), and the other electrode (electrode Nd) can be disposed on the contact surface of the button module 10.

[0301] For example, the detection module 12 may include a pressure sensor and a capacitance sensor. When a user presses the contact surface of the button module 10, the intensity of the pressure signal detected by the pressure sensor will change, and the distance between the two plates of the capacitor contained in the capacitance sensor will change. The capacitance signal detected by the capacitance sensor will also change accordingly. The button module 10 can determine whether there is a real user operation based on these two signals.

[0302] For example, the detection module 12 may further include a temperature sensor, a PPG sensor, etc. When a user presses the contact surface of the button module 10, the temperature detected by the temperature sensor will change due to the user's body temperature; the light emitted by the light-emitting element of the PPG sensor is reflected by the user's finger, and more light can be received by the light detection element of the PPG sensor, thus changing the light intensity detected by the PPG sensor. The button module 10 can determine whether there is a real user operation based on multiple of the aforementioned detection results of electrocardiogram signals, bioimpedance signals, pressure signals, capacitance signals, temperature, and light intensity.

[0303] Both the detection module 14 and the detection module 16 mentioned above can include different types of sensors. The ways in which different types of sensors detect the above signals Sg2 and / or Sg3 will also differ. For ease of explanation, the sensors will be briefly introduced below.

[0304] Based on the source of the detected signal, sensors can be divided into active sensors and passive sensors.

[0305] For example, an active sensor may include a transmitting module and a receiving module. The transmitting module can be used to transmit energy (such as electromagnetic waves, sound waves, etc.) to the object being measured, and the receiving module can be used to detect the energy reflected by the object being measured. The energy transmitted by the transmitting module and the energy detected by the receiving module can be represented in the form of transmitted signals and received signals, respectively, and the difference between the transmitted signals and received signals can be used to identify the object being measured.

[0306] For example, active sensors may include one or more of the following: PPG sensors, ultrasonic sensors, elastic wave sensors, millimeter wave sensors, and electromagnetic wave sensors (such as Bluetooth, stroboscopic, ultra-wideband, near-field communication, etc.).

[0307] For example, a passive sensor can detect signals from the object being tested. These signals can be signals originating from the object itself (e.g., electrocardiogram signals, bioimpedance signals, etc.) or signals generated by the object (e.g., generated by pressing a button). These signals can be used to identify the object being tested.

[0308] For example, passive sensors may include one or more of the following: pressure sensors, capacitive sensors, ECG sensors, bioimpedance sensors, infrared sensors, thermocouples, piezoelectric sensors, etc.

[0309] Based on the arrangement of the sensing elements that make up the sensor, sensors can be divided into array sensors and non-array sensors.

[0310] For example, an array sensor may include multiple sensing elements arranged in a two-dimensional or three-dimensional spatial distribution. Adjacent sensing elements are spaced apart. Each sensing element in the array sensor can acquire a signal, allowing the array sensor to acquire multiple signals simultaneously. These multiple signals could, for example, be signals from different locations within a region.

[0311] For example, an array sensor may include one or more of the following: pressure sensor array, capacitance sensor array, PPG sensor array, elastic wave sensor array, etc.

[0312] For example, a non-array sensor may include a small number of sensing elements (e.g., one, two, etc.), which limits the number of signals that the non-array sensor can acquire at the same time. For example, a non-array sensor can acquire signals from one or two locations at the same time.

[0313] Generally speaking, most array sensors can be manufactured in a non-array form. In other words, the pressure sensors, capacitance sensors, PPG sensors, elastic wave sensors, etc. mentioned above can all be non-array sensors.

[0314] For example, the detection module 14 may include an array sensor, such as any one of a pressure sensor array, a capacitance sensor array, a PPG sensor array, an elastic wave sensor array, or a piezoelectric sensor array. In this case, the detection module 14 can detect changes in signal strength at different locations within a region on the contact surface of the button module 10.

[0315] For example, the detection module 16 may include an array sensor, such as any one of a pressure sensor array, a capacitance sensor array, a PPG sensor array, an elastic wave sensor array, or a piezoelectric sensor array. In this case, the detection module 16 can detect changes in signal strength at different locations within a region on the contact surface of the button module 10.

[0316] For example, the detection module 14 may include a non-array sensor, such as any one of a non-array pressure sensor, a non-array capacitive sensor, a non-array PPG sensor, a non-array elastic wave sensor, or a non-array piezoelectric sensor. In this case, the detection module 14 can detect the signal strength at the same position on the contact surface of the button module 10 at different times.

[0317] For example, the detection module 16 may include a non-array sensor, such as any one of a non-array pressure sensor, a non-array capacitive sensor, a non-array PPG sensor, a non-array elastic wave sensor, or a non-array piezoelectric sensor. In this case, the detection module 16 can detect the signal strength at the same position on the contact surface of the button module 10 at different times.

[0318] When the detection module 14 or the detection module 16 includes an array sensor, the button module 10 can identify the sliding operation based on the change in signal intensity at different positions in a region on the contact surface of the button module 10 detected by the array sensor.

[0319] For example, the detection module 14 or the detection module 16 includes a pressure sensor array, and the button module 10 can identify sliding operations based on the intensity changes of signals corresponding to multiple positions detected by the pressure sensor array.

[0320] When both detection module 14 and detection module 16 are non-array sensors, they can be used to collect different types of signals. The button module 10 can identify sliding operations based on the changes in the intensity of these two types of signals.

[0321] For example, the detection module 14 may include a non-array pressure sensor, the detection module 16 may include a non-array PPG sensor, and the button module 10 can identify the sliding operation based on the intensity change of the pressure signal detected by the pressure sensor and the intensity change of the light signal detected by the PPG sensor.

[0322] When one of the detection modules 14 and 16 is an array sensor and the other is a non-array sensor, these two detection modules can be used to collect different types of signals. The button module 10 can combine the intensity changes of one signal at multiple locations in a region within a certain time period with the intensity changes of another signal at the same location to identify sliding operations.

[0323] In one possible implementation, the button module 10 may further include a motor. When the button module 10 detects a tap or slide operation, the button module 10 may activate the motor to vibrate, so that the user can perceive the response of the electronic device 100 to the user's operation.

[0324] In one possible implementation, the button module 10 may also include a speaker. When the button module 10 detects a tap or swipe operation, the button module 10 may call the speaker to play audio so that the user can perceive the response of the electronic device 100 to the user's operation.

[0325] Based on the above button module 10, such as Figure 5 The illustration shows a button interaction method provided in an embodiment of this application. The electronic device can detect various types of signals through the button module 10 and determine whether a button event has occurred based on the detection results of these signals. If a button event is detected, the electronic device can make one or more types of responses such as visual, auditory, or tactile.

[0326] S101, the electronic device detects signal Sga through button module 10.

[0327] In some examples, the signal Sga can be one or more of the following: pressure signal, light signal, capacitance signal, elastic wave signal, ultrasonic signal, millimeter wave signal, electromagnetic wave signal of different frequency bands (such as Bluetooth signal, star flash signal, ultra-wideband signal, near field communication signal).

[0328] In some examples, the button module 10 may include a sensor Ss1, through which the aforementioned signal Sga can be detected.

[0329] For example, the sensor Ss1 can be any of the following: pressure sensor, capacitive sensor, ECG sensor, bioimpedance sensor, infrared sensor, thermocouple, piezoelectric sensor, PPG sensor, ultrasonic sensor, elastic wave sensor, millimeter wave sensor, electromagnetic wave sensor, etc.

[0330] In conjunction with the preceding text Figure 3The description of the button module 10 shown here can be understood to mean that the signal Sga here can be an example of the signal Sg2 or signal Sg3 mentioned above.

[0331] In some examples, before detecting signal Sga, the electronic device can detect signal Sgb via button module 10, which can be used to determine whether there is a genuine user operation. In other words, signal Sgb can be used to determine whether button module 10 has been accidentally pressed.

[0332] One possibility is that the signal Sgb may include an electrocardiogram (ECG) signal.

[0333] As one implementation, the button module 10 may include an ECG sensor, which can detect the user's electrocardiogram (ECG) signal. The ECG signal can be used to determine whether there is a genuine user operation, or in other words, whether the button module 10 has been accidentally pressed.

[0334] For example, when an electrocardiogram (ECG) signal is detected, the electronic device can determine that a real user operation has been detected, or in other words, the electronic device can determine that the button module 10 has not been accidentally touched; conversely, when an ECG signal cannot be detected, the electronic device can determine that no real user operation has been detected, or in other words, the electronic device can determine that the button module 10 has been accidentally touched.

[0335] For example, when the electrocardiogram (ECG) signal can be used to determine the user's heart rate, the electronic device can determine that a real user operation has been detected, or in other words, the electronic device can determine that the button module 10 has not been accidentally touched; conversely, when the ECG signal cannot determine the user's heart rate, the electronic device can determine that no real user operation has been detected, or in other words, the electronic device can determine that the button module 10 has been accidentally touched.

[0336] As an example, one electrode (electrode Na) of the ECG sensor can be in contact with the skin of the user's left arm (e.g., region Ar2), and the other electrode (electrode Nb) of the ECG sensor can be disposed on the contact surface of the button module 10.

[0337] One possible scenario is that the contact surface of the button module 10 is squeezed by an object. In this case, there is no conductivity between the two electrodes of the ECG sensor, and the signal detected by the ECG sensor cannot determine the user's heart rate. Based on this, it can be determined that there is no real user operation, or that the button module 10 was accidentally touched.

[0338] One possible scenario is that the skin on the back of the user's left hand (area Ar4) comes into contact with electrode Nb. This could be considered a false touch, and the user may not have intended to operate the electronic device. Electrodes Na and Nb are connected via the human body located between the left arm and the back of the left hand. However, the distance between the aforementioned areas Ar2 and Ar4 is relatively short, preventing the electronic device from detecting the user's ECG signal. Alternatively, the electronic device may not be able to determine the user's heart rate based on the ECG signal detected by the ECG sensor. Therefore, it can be determined that there was no genuine user operation, or that the button module 10 was falsely touched.

[0339] One possible scenario is that the skin of the user's right hand fingers (area Ar5) comes into contact with electrode Nb. This could be considered an actual pressing or touching action by the user, indicating an intention to operate the electronic device. Electrodes Na and Nb are connected via the human body located between the left arm and right hand fingers. The distance between areas Ar2 and Ar5 is relatively large, allowing the electronic device to detect the user's electrocardiogram (ECG) signal. Alternatively, the electronic device can determine the user's heart rate based on the ECG signal detected by the ECG sensor, thus confirming either a genuine user action or that the button module 10 was not accidentally pressed.

[0340] One possibility is that the signal Sgb may include a bioimpedance signal.

[0341] As one implementation, the button module 10 may include a bioimpedance sensor, which can detect the bioimpedance signal of a human body. This bioimpedance signal can be used to determine whether there is a genuine user interaction, or in other words, whether the button module 10 has been accidentally pressed.

[0342] For example, if the magnitude of the bioimpedance determined by the bioimpedance signal falls within the range Rg0, the electronic device can determine that a real user operation has been detected, or in other words, the electronic device can determine that the button module 10 has not been accidentally touched; conversely, if the magnitude of the bioimpedance determined by the bioimpedance signal does not fall within the range Rg1, the electronic device can determine that no real user operation has been detected, or in other words, the electronic device can determine that the button module 10 has been accidentally touched.

[0343] As an example, one electrode (electrode Nc) of the bioimpedance sensor can contact the skin of the user's left arm (e.g., region Ar3), and the other electrode (electrode Nd) can be disposed on the contact surface of the button module 10.

[0344] One possible scenario is that the contact surface of the button module 10 is squeezed by an object. In this case, there is no conductivity between the two electrodes of the bioimpedance sensor, and the impedance value indicated by the signal detected by the bioimpedance sensor tends to infinity. Based on this, it can be determined that there is no real user operation, or that the button module 10 was accidentally touched.

[0345] One possible scenario is that the skin on the back of the user's left hand (area Ar6) comes into contact with electrode Nd. This could be considered a false touch event, and the user may not have intended to operate the electronic device. Electrodes Nc and Nd are connected by human tissue located between the left forearm and the back of the left hand. The bioimpedance of the human tissue between these two parts is low (e.g., less than the bioimpedance threshold BiTh1), thus it can be determined that there was no real user operation, or that the button module 10 was falsely touched.

[0346] One possible scenario is that the skin of the user's right hand fingers (area Ar7) comes into contact with electrode Nd. This could be considered an actual pressing or touching operation by the user, indicating an intention to operate the electronic device. Electrodes Nc and Nd are connected via human tissue located between the left forearm and right hand fingers. The bioimpedance of this tissue is relatively high (e.g., greater than or equal to the bioimpedance threshold BiTh1), allowing the electronic device to determine whether a genuine user operation has occurred, or whether the button module 10 has been accidentally touched.

[0347] In conjunction with the preceding text Figure 3 The description of button module 10 shown here can be understood as follows: the signal Sgb here can be an example of the signal Sg1 mentioned above.

[0348] S102, the electronic device determines the trigger operation based on the signal Sga.

[0349] One possibility is that the triggering operation described above can be a tap operation. Examples include a light tap, a quick tap, a heavy tap, a short tap, a long press, a single tap, and a double tap. The corresponding button event can be called a tap event, such as a light tap event, a quick tap event, a heavy tap event, a short tap event, a long press event, a single tap event, and a double tap event.

[0350] In some examples, the electronic device can determine that the triggered operation is a tap operation based on the signal Sga, or in other words, the electronic device can determine that the key event is a tap event based on the signal Sga.

[0351] For details on how electronic devices determine the trigger action as a tap based on the SGA signal, please refer to the previous text. Figure 3 and Figure 4 The relevant explanations will not be repeated here.

[0352] One possibility is that the triggering operation described above can be a swipe operation. For example, an upward swipe, a downward swipe, a short swipe, a long swipe, etc. The corresponding button event can be called a swipe event, such as an upward swipe event, a downward swipe event, a short swipe event, a long swipe event, etc.

[0353] Electronic devices can determine whether a trigger operation is a sliding operation based on the signal Sga, or in other words, electronic devices can determine whether a button event is a sliding event based on the signal Sga.

[0354] In some examples, the electronic device can determine that the trigger operation is a sliding operation based on the reference strength of signal Sga, the measured strength of signal Sga, and the change in the measured strength of signal Sga, wherein the reference strength of signal Sga is the strength of signal Sga when the user does not operate the button module.

[0355] For example, the sensor Ss1 used to detect the signal Sga can be an active sensor, in which case the reference strength of the signal Sga can be the strength of the signal emitted by the sensor Ss1 (such as electromagnetic waves, sound waves, etc.); or, the sensor Ss1 can be a passive sensor, in which case the reference strength of the signal Sga can be the strength of the signal when no signal is received from the object being measured.

[0356] Alternatively, the reference strength of signal Sga can be the measured value of signal Sga when the user does not operate the button module, or the reference strength of signal Sga can be a default value, which can be included in the hardware information of the device when it leaves the factory.

[0357] As an example, the sensor Ss1 used to detect the signal Sga can be an array sensor, and the signal Sga can be signals from multiple locations within a region on the contact surface of the button module 10 (e.g., pressure signals, light signals, elastic wave signals, capacitance signals, etc.). In this case, the electronic device can identify a sliding operation based on the distribution of signal intensity within a region on the contact surface of the button module 10 and the change of the signal intensity distribution over time. Alternatively, the electronic device can identify a sliding event based on the distribution of signal intensity within the same region on the contact surface of the button module 10 at different times.

[0358] In one implementation, the electronic device can determine the starting position of the user operation based on the distribution of the signal Sga in the area Ar8 on the contact surface of the button module 10 at time t81, and determine the ending position of the user operation based on the distribution of the signal Sga in the area Ar8 on the contact surface of the button module 10 at time t82. Combining the aforementioned starting and ending positions, the distance of the user operation can be determined. Combining the time interval between time t81 and time t82, the speed of the user operation can be determined. If the distance of the user operation is greater than or equal to a distance threshold DtTh1 and the speed of the user operation is greater than or equal to a speed threshold VcTh1, the electronic device can determine that a sliding operation has been detected, or in other words, the electronic device can determine that a sliding event has been triggered.

[0359] Based on the determined sliding operation, the electronic device can combine the aforementioned start position and end position to determine the user's operation direction, thereby determining whether the sliding operation is an upward sliding operation, a downward sliding operation, etc.

[0360] Based on the determined sliding operation, the electronic device can determine whether the sliding operation is a short sliding operation or a long sliding operation according to the relationship between the distance of the user's operation and the reference distance.

[0361] As an example, if the distance of the user's operation is less than or equal to the reference distance, the electronic device can determine that the swipe operation is a short swipe operation; if the distance of the user's operation is greater than the reference distance, the electronic device can determine that the swipe operation is a long swipe operation.

[0362] As an example, the sensor Ss1 used to detect the signal Sga can be a non-array sensor, and the signal Sga can be a signal at a position on the contact surface of the button module 10 (e.g., pressure signal, light signal, elastic wave signal, capacitance signal, etc.).

[0363] As one implementation, the electronic device can determine the rate of change of the measured intensity of the signal Sga over time (hereinafter referred to as the rate of change of the measured intensity) based on the reference intensity, the measured intensity, and the change of the measured intensity of the signal Sga. Based on this, the electronic device can determine whether the triggering operation is a sliding operation and the type of sliding operation based on the rate of change of the measured intensity of the signal Sga.

[0364] Similar to a tap operation, during a swipe operation, the measured intensity of signal Sga experiences a process of rising from a reference intensity to a peak intensity, and then decreasing from the peak intensity back to the reference intensity. By acquiring the change in the measured intensity of signal Sga during the rising process, the growth rate k1 of the measured intensity of signal Sga during this process can be determined; by acquiring the change in the measured intensity of signal Sga during the falling process, the attenuation rate k2 of the measured intensity of signal Sga during this process can be determined. The electronic device can determine whether the trigger operation is a swipe operation and the direction of the swipe operation based on the aforementioned growth rate k1 and / or attenuation rate k2 of the measured intensity of signal Sga.

[0365] For example, if the measured intensity growth rate k1 of signal Sga belongs to the range Rg1, and / or the measured intensity decay rate k2 of signal Sga belongs to the range Rg2, the triggering operation is determined to be a sliding operation.

[0366] For example, if the measured intensity growth rate k1 of signal Sga belongs to the range Rg11, and / or the measured intensity decay rate k2 of signal Sga belongs to the range Rg21, the triggering operation is determined to be a sliding operation along direction Da; if the measured intensity growth rate k1 of signal Sga belongs to the range Rg12, and / or the measured intensity decay rate k2 of signal Sga belongs to the range Rg22, the triggering operation is determined to be a sliding operation along direction Db; where direction Da and direction Db are two opposite directions.

[0367] It is understandable that the ranges Rg11 and Rg12 mentioned above both belong to the range Rg1, and the ranges Rg21 and Rg22 both belong to the range Rg2.

[0368] For example, the contact surface of the button module 10 can be similar to a rectangle, and the aforementioned direction Da or direction Db can be along the longer side of the rectangle.

[0369] For example, an electronic device can determine the measured intensity of signal Sga corresponding to the start position and the measured intensity of signal Sga corresponding to the end position of the user's operation based on the changes in the measured intensity of signal Sga. Combined with a reference intensity of signal Sga, the starting and ending positions of the user's operation can be determined, thereby approximating the distance of the user's swipe operation. Based on this, the electronic device can determine whether the user's swipe operation is a short swipe or a long swipe.

[0370] As an example, the sensor Ss1 used to detect the signal Sga can be a non-array sensor and is an active sensor. In this case, the sensor Ss1 can include a transmitting module and a receiving module, wherein the transmitting module and the receiving module can be set separately. For example, the transmitting module can be located near one end of the contact surface of the button module 10, and the receiving module can be located near the other end of the contact surface of the button module 10. The transmitting module is used to transmit a reference signal, and the receiving module is used to receive the signal Sga corresponding to the reference signal.

[0371] For example, the contact surface of the button module 10 can be similar to a rectangle or an ellipse, with a longer dimension in one direction (e.g., the characteristic direction) and a shorter dimension in another direction (e.g., the non-characteristic direction). The aforementioned transmitting and receiving modules can be arranged along the characteristic direction of the contact surface, and the transmitting and receiving modules can be spaced apart from each other and close to the edge of the contact surface.

[0372] For example, the contact surface of the button module 10 can be similar to a circle or a positive direction. In this case, the aforementioned transmitting module and receiving module can be arranged along the diameter direction of the circular contact surface and far apart from each other. Alternatively, the aforementioned transmitting module and receiving module can be arranged along the direction of the axis of symmetry of the contact surface and far apart from each other.

[0373] In one implementation, the aforementioned sensor Ss1 can be a PPG sensor, the aforementioned transmitting module can be a light-emitting element of the PPG sensor (such as a light-emitting diode, a vertical cavity surface-emitting laser, etc.), and the aforementioned receiving module can be a photodiode of the PPG sensor.

[0374] In the above example, the electronic device can determine whether the triggering operation is a sliding operation and the type of sliding operation based on the position of the transmitting module, the position of the receiving module, the reference strength of the signal Sga, the measured strength of the signal Sga, and the change in the measured strength of the signal Sga.

[0375] Similar to a tap operation, during a swipe operation, the measured intensity of signal Sga experiences a process of rising from a reference intensity to a peak intensity, and then falling back to the reference intensity. By acquiring the change in the measured intensity of signal Sga during the rising process, the growth rate k3 of the measured intensity of signal Sga during this process can be determined; by acquiring the change in the measured intensity of signal Sga during the falling process, the attenuation rate k4 of the measured intensity of signal Sga during this process can be determined. The electronic device can determine whether the trigger operation is a swipe operation and the direction of the swipe operation based on the aforementioned growth rate k3 and / or attenuation rate k4 of the measured intensity of signal Sga.

[0376] For example, if the measured intensity growth rate k3 of signal Sga belongs to the range Rg3, and / or the measured intensity decay rate k4 of signal Sga belongs to the range Rg4, the triggering operation is determined to be a sliding operation.

[0377] For example, if the measured strength growth rate k3 of signal Sga belongs to the range Rg31, and / or the measured strength attenuation rate k4 of signal Sga belongs to the range Rg41, the triggering operation is determined to be a sliding operation along direction Dc; if the measured strength growth rate k3 of signal Sga belongs to the range Rg32, and / or the measured strength attenuation rate k4 of signal Sga belongs to the range Rg42, the triggering operation is determined to be a sliding operation along direction Dd; wherein, direction Dc can be the direction from the transmitting module to the receiving module, and direction Dd can be the direction from the receiving module to the transmitting module.

[0378] It is understandable that the ranges Rg31 and Rg32 mentioned above both belong to the range Rg3, and the ranges Rg41 and Rg42 both belong to the range Rg4.

[0379] For example, the contact surface of the button module 10 can be similar to a rectangle, and the aforementioned direction Dc or direction Dd can be along the longer side of the rectangle.

[0380] For example, an electronic device can determine the measured intensity of signal Sga corresponding to the start position and the measured intensity of signal Sga corresponding to the end position of the user's operation based on the changes in the measured intensity of signal Sga. Combined with a reference intensity of signal Sga, the starting and ending positions of the user's operation can be determined, thereby approximating the distance of the user's swipe operation. Based on this, the electronic device can determine whether the user's swipe operation is a short swipe or a long swipe.

[0381] As an implementation, during the user's use of the button module 10, the electronic device can record the relationship between the user's operation and the measured strength of the aforementioned signal Sga. Through the accumulation of a large amount of data and with the help of machine learning and other methods, the following mapping relationship R1 between the user's sliding operation and the signal Sga can be established:

[0382] X1→Y1

[0383] X1 may include one or more of the following: information on the reference strength of signal Sga, information on the measured strength of signal Sga, and information on the relationship between signal Sga and time; Y1 may include one or more of the following: whether a sliding operation was detected, and the type of sliding operation.

[0384] With the help of the above mapping relationship R1, electronic devices can more effectively and accurately identify the user's swipe operation.

[0385] In some examples, the button module 10 may include sensors Ss1 and Ss2, wherein sensor Ss1 can be used to detect the aforementioned signal Sga, and sensor Ss2 can be used to detect signal Sgc. Signals Sga and Sgc can be different types of signals.

[0386] For example, at least one of the sensors Ss1 and Ss2 described above can be an array sensor. In this case, the electronic device can determine that the triggering operation is a sliding operation based on the signal detected by the array sensor. This part can be referred to in the description above, and will not be repeated here.

[0387] In conjunction with the preceding text Figure 3 The description of the button module 10 shown here can be understood as follows: the signal Sga can be an example of the signal Sg2 mentioned above, and the signal Sgc can be an example of the signal Sg3 mentioned above; or, the signal Sga can be an example of the signal Sg3 mentioned above, and the signal Sgc can be an example of the signal Sg2 mentioned above.

[0388] For example, both the aforementioned sensor Ss1 and sensor Ss2 can be non-array sensors.

[0389] For example, signal Sga can be one of the following signals, and signal Sgc can be another of the following signals: pressure signal, light signal, elastic wave signal, electromagnetic wave signal, capacitance signal, ultrasonic signal, etc.; sensor Ss1 and sensor Ss2 can be sensors used to detect the corresponding type of signal.

[0390] In some examples, the electronic device can determine that the triggering operation is a sliding operation based on the signals Sga and Sgc.

[0391] For example, an electronic device can determine that the triggering operation is a sliding operation based on the reference strength of signal Sga, the measured strength of signal Sga and the change in the measured strength of signal Sga, as well as the reference strength of signal Sgc, the measured strength of signal Sgc and the change in the measured strength of signal Sgc.

[0392] As an example, within a duration Δt5, the measured intensity of signal Sga first increases and then decreases, and the measured intensity of signal Sgc first increases and then decreases. The electronic device can determine that the triggering operation is a sliding operation.

[0393] For example, if the measured growth rate k5 of the signal Sga is within the range Rg5 and the measured growth rate k6 of the signal Sgc is within the range Rg6, the electronic device can determine that the triggering operation is a sliding operation.

[0394] For example, if the attenuation rate k7 of the measured intensity of signal Sga is within the range Rg7, and the attenuation rate k8 of the measured intensity of signal Sgc is within the range Rg8, the electronic device can determine that the triggering operation is a sliding operation.

[0395] For example, if the measured intensity growth rate k5 of signal Sga is within the range Rg5 and the measured intensity attenuation rate k8 of signal Sgc is within the range Rg8, the electronic device can determine that the triggering operation is a sliding operation.

[0396] For example, if the attenuation rate k7 of the measured intensity of signal Sga is within the range Rg7, and the growth rate k6 of the measured intensity of signal Sgc is within the range Rg6, the electronic device can determine that the triggering operation is a sliding operation.

[0397] For example, a sliding operation can be determined to be a sliding operation along the direction De in the following cases:

[0398] The measured intensity growth rate k5 of signal Sga belongs to the range Rg51; the measured intensity growth rate k6 of signal Sgc belongs to the range Rg61; or, the measured intensity attenuation rate k7 of signal Sga belongs to the range Rg71; the measured intensity attenuation rate k8 of signal Sgc belongs to the range Rg81; or, the measured intensity growth rate k5 of signal Sga belongs to the range Rg51; the measured intensity attenuation rate k8 of signal Sgc belongs to the range Rg81; or, the measured intensity growth rate k6 of signal Sgc belongs to the range Rg61; the measured intensity attenuation rate k7 of signal Sga belongs to the range Rg71.

[0399] For example, a sliding operation can be determined to be a sliding operation along the direction Df in the following cases:

[0400] The measured intensity growth rate k5 of signal Sga falls within the range Rg52; the measured intensity growth rate k6 of signal Sgc falls within the range Rg62; or, the measured intensity attenuation rate k7 of signal Sga falls within the range Rg72; the measured intensity attenuation rate k8 of signal Sgc falls within the range Rg82; or, the measured intensity growth rate k5 of signal Sga falls within the range Rg52; the measured intensity attenuation rate k8 of signal Sgc falls within the range Rg82; or, the measured intensity growth rate k6 of signal Sgc falls within the range Rg62; the measured intensity attenuation rate k8 of signal Sgc falls within the range Rg82.

[0401] In the above examples, the ranges Rg51 and Rg52 can be different, the ranges Rg61 and Rg62 can be different, the ranges Rg71 and Rg72 can be different, and the ranges Rg81 and Rg82 can be different.

[0402] It is understandable that the ranges Rg51 and Rg52 mentioned above both belong to the range Rg5, and the ranges Rg61 and Rg62 both belong to the range Rg6. The ranges Rg71 and Rg72 mentioned above both belong to the range Rg7, and the ranges Rg81 and Rg82 both belong to the range Rg8.

[0403] For example, the electronic device can determine the measured intensity of signal Sga corresponding to the start position and the end position of the user's operation based on the changes in the measured intensity of signal Sga. Combined with a reference intensity of signal Sga, the start and end positions of the user's operation can be determined, thus approximating the distance of the user's swipe operation. Based on this, the electronic device can determine whether the user's swipe operation is a short swipe or a long swipe. And / or,

[0404] Electronic devices can determine the measured strength of the signal Sgc corresponding to the starting position and ending position of the user's operation based on the changes in the measured strength of the signal Sgc. By combining this with a reference strength of the signal Sgc, the starting and ending positions of the user's operation can be determined, thus approximating the distance of the user's swipe operation. Based on this, the electronic device can determine whether the user's swipe operation is a short swipe or a long swipe.

[0405] As an implementation, during the user's use of the button module 10, the electronic device can record the relationship between the user's operation and the measured strength of the signal Sga and the signal Sgc. Through the accumulation of a large amount of data and with the help of machine learning and other methods, the following mapping relationship R2 between the user's sliding operation and the signals Sga and Sgc can be established:

[0406] X2→Y2

[0407] X2 may include one or more of the following: information on the reference strength of signal Sga, information on the measured strength of signal Sga, information on the relationship between signal Sga and time, information on the reference strength of Sgc, information on the measured strength of signal Sgc, and information on the relationship between signal Sgc and time; Y2 may include one or more of the following: whether a sliding operation was detected, and the type of sliding operation.

[0408] With the help of the above mapping relationship R2, electronic devices can more effectively and accurately identify the user's swipe operation.

[0409] As an example, signal Sga may include a pressure signal at position Ps91 on the contact surface of button module 10, and signal Sgc may include a light signal at position Ps92 on the contact surface of button module 10.

[0410] refer to Figure 6The button module 10 may include a pressure sensor 24 and a PPG sensor 23 stacked together. The PPG sensor 23 may be located on the side of the pressure sensor 24 closer to the user's finger. The pressure sensor 24 can be used to detect the pressure signal at the aforementioned position Ps91, and the PPG sensor 23 can be used to detect the light signal at the aforementioned position Ps92.

[0411] The PPG sensor 23 includes a light-emitting diode 23-1 and a photodiode 23-2. The PPG sensor 23 can be used to detect the intensity of light detected by the photodiode 23-2; in other words, the light intensity detected by the PPG sensor 23 corresponds to the position of the photodiode 23-2. In other words, the PPG sensor 23 can be considered a non-array PPG sensor. In some scenarios, the photodiode 23-2 can be considered a sensing element.

[0412] For example, the aforementioned position Ps91 can be located in the middle region of the contact surface of the button module 10. For instance, position Ps91 can be approximately in... Figure 6 The location of midpoint S2 or in the following text Figure 9 The position of midpoint S5. In some scenarios, this pressure sensor 24 can be considered as a non-array pressure sensor.

[0413] As the user's finger slides from right to left across the contact surface of the button module 10, it slides from the side of the PPG sensor 23 closest to the light-emitting diode 23-1 to the side closest to the photodiode 23-2. Figure 6 The illustration in Figure 6-1 In the middle, the contact position between the user's finger and the contact surface of the button module 10 is point S1, which is roughly located to the right of the light-emitting diode 23-1; Figure 6 The illustration in Figure 6-2 In the middle, the contact position between the user's finger and the contact surface of the button module 10 is point S2, which is roughly located between the light-emitting diode 23-1 and the photodiode 23-2; Figure 6 The illustration in Figure 6-3 In the middle, the contact position between the user's finger and the contact surface of the button module 10 is point S3, which is roughly located to the left of the photodiode 23-2.

[0414] At point S1, the light emitted by LED 23-1 is almost not reflected by the user's finger to photodiode 23-2, and the light intensity detected by photodiode 23-2 is the weakest. At point S2, most of the light emitted by LED 23-1 is reflected by the user's finger to photodiode 23-2, and the light intensity detected by photodiode 23-2 is the strongest. At point S3, a small portion of the light emitted by LED 23-1 is reflected by the user's finger to photodiode 23-2, and the light intensity detected by photodiode 23-2 is between the light intensity corresponding to point S1 and the light intensity corresponding to point S2.

[0415] Figure 7 The image shown is related to Figure 6 The graph shows the relationship between light intensity detected by PPG sensor 23 and time during the corresponding sliding operation. (See figure.) Figure 7 As shown, during the process of the user's finger moving from point S1 to point S2 and then to point S3, the light intensity detected by the PPG sensor 23 changes from first increasing to then decreasing.

[0416] For pressure sensor 24, at point S1, the user's finger has just touched the contact surface, and point S1 is far from position Ps91, so the pressure detected by pressure sensor 24 is relatively small; at point S2, the user's finger is roughly directly above pressure sensor 24, and point S2 is close to position Ps91, so the pressure detected by pressure sensor 24 is the maximum; at point S3, the user's finger is about to leave the contact surface, and point S3 is far from position Ps91, so the pressure detected by pressure sensor 24 decreases.

[0417] Figure 8 The image shown is related to Figure 6 The graph shows the relationship between pressure detected by pressure sensor 24 and time during the corresponding sliding operation. (See figure.) Figure 8 As shown, during the process of the user's finger moving from point S1 through point S2 to point S3, the pressure value detected by the pressure sensor 24 first increases and then decreases.

[0418] refer to Figure 9 During the process of sliding from left to right on the contact surface of the button module 10, the user's finger slides from the side of the PPG sensor 23 closer to the photodiode 23-2 to the side closer to the light-emitting diode 23-1. Figure 9 The illustration in Figure 9-1 In the middle, the contact position between the user's finger and the contact surface of the button module 10 is point S4, which is roughly located to the left of the photodiode 23-2; Figure 9 The illustration in Figure 9-2 In the middle, the contact position between the user's finger and the contact surface of the button module 10 is point S5, which is roughly located between the light-emitting diode 23-1 and the photodiode 23-2; Figure 9The illustration in Figure 9-3 In the middle, the contact position between the user's finger and the contact surface of the button module 10 is point S6, which is roughly located to the right of the light-emitting diode 23-1.

[0419] At point S4, a small portion of the light emitted by LED 23-1 is reflected by the user's finger to photodiode 23-2; at point S5, most of the light emitted by LED 23-1 is reflected by the user's finger to photodiode 23-2, and the light intensity detected by photodiode 23-2 is the strongest; at point S6, almost no light emitted by LED 23-1 is reflected by the user's finger to photodiode 23-2, and the light intensity detected by photodiode 23-2 is the weakest.

[0420] Figure 10 The image shown is related to Figure 9 The graph shows the relationship between light intensity detected by PPG sensor 23 and time during the corresponding sliding operation. (See figure.) Figure 10 As shown, during the process of moving from point S4 to point S5 and then to point S6, the light intensity detected by PPG sensor 23 changes from first increasing to then decreasing.

[0421] For pressure sensor 24, at point S4, the user's finger has just touched the contact surface, and point S4 is relatively far from position Ps91, so pressure sensor 24 detects that the user's pressure is low; at point S5, the user's finger is roughly directly above pressure sensor 24, and point S5 is relatively close to position Ps91, so pressure sensor 24 detects that the user's pressure is maximum; at point S6, the user's finger is about to leave the contact surface, and point S6 is relatively far from position Ps91, so pressure sensor 24 detects that the user's pressure is decreasing.

[0422] Figure 11 The image shown is related to Figure 9 The graph shows the relationship between pressure detected by pressure sensor 24 and time during the corresponding sliding operation. (See figure.) Figure 11 As shown, during the process of the user's finger moving from point S4 to point S5 and then to point S6 on the contact surface of the button module 10, the pressure value detected by the pressure sensor 24 first increases and then decreases.

[0423] Combination Figures 6 to 11One possible scenario is that during the sliding operation, the pressure value indicated by the pressure signal detected by the pressure sensor 24 gradually increases, and the light intensity indicated by the light signal detected by the PPG sensor 23 gradually increases. Another possible scenario is that during the sliding operation, the pressure value indicated by the pressure signal detected by the pressure sensor 24 first increases and then decreases, and the light intensity indicated by the light signal detected by the PPG sensor 23 first increases and then decreases. Yet another possible scenario is that during the sliding operation, the pressure value indicated by the pressure signal detected by the pressure sensor 24 gradually decreases, and the light intensity indicated by the light signal detected by the PPG sensor 23 gradually decreases. In all of these scenarios, the electronic device can confirm that a sliding operation has been detected.

[0424] Based on the detected sliding operation, the starting and ending positions of the user's operation can be determined by combining the installation positions of the pressure sensor 24 and the PPG sensor 23 on the button module 10, the pressure signal detected by the pressure sensor 24, and the light signal detected by the PPG sensor 23. Thus, it can be determined whether the detected sliding operation is a sliding operation from left to right or from right to left.

[0425] As an example, signal Sga may include a pressure signal at position Ps101 on the contact surface of button module 10, and signal Sgc may include an elastic wave signal (or capacitance signal) at position Ps102. In other words, the electronic device can determine the sliding operation based on the change in pressure signal at one position and the change in elastic wave signal (or capacitance signal) at another position on the contact surface of button module 10 over a period of time.

[0426] As an example, signal Sga may include the optical signal at position Ps111 on the contact surface of button module 10, and signal Sgc may include the elastic wave signal (or capacitance signal) at position Ps112. In other words, the electronic device can determine the sliding operation based on the change in the optical signal at one position and the change in the elastic wave signal (or capacitance signal) at another position on the contact surface of button module 10 over a period of time.

[0427] S103, the electronic device performs a response operation based on the trigger operation.

[0428] Here, the response operation can correspond to the trigger operation or key event; in other words, in response to the trigger operation or key event, the electronic device performs the response operation.

[0429] In some examples, the aforementioned response operations may include one or more of the following: displaying an interface, playing audio, or a vibration motor. In other words, upon receiving a trigger operation, the electronic device may provide the user with one or more of the following: visual, auditory, or tactile feedback. The following describes these three types of feedback separately. It is understood that the electronic device may provide only one type of feedback or multiple types of feedback; this application does not impose any limitations on this.

[0430] As one possible implementation, the aforementioned electronic device can be, for example... Figure 12 The above response operation is described below using watch 300 as the main example.

[0431] In some examples, such as Figure 12 As shown, the watch 300 may include a watch body 301 and a watch strap 302. The watch strap 302 may be fixed relative to the watch body 301 and is used to wear the watch 300 on the user's wrist. The watch body 301 may include the aforementioned button module 10. For example, the side wall of the watch body 301 may include an opening through which part or all of the button module 10 may extend out of the watch body 301.

[0432] As an example, watch 300 may include a display screen 303, which may be fixed to watch body 301. The display screen 303 may be used to display the graphical user interface of watch 300. When user operation of button module 10 is detected, watch 300 may change the content displayed on display screen 303, thereby providing visual feedback.

[0433] As an example, watch 300 may also include a motor 305, which may be located inside watch case 301. As one implementation, the motor 305 may be positioned close to button module 10. Alternatively, the motor 305 may be integrated inside button module 10. Upon detecting user operation of button module 10, watch 300 may trigger motor 305 to vibrate, providing tactile feedback.

[0434] As an example, the watch 300 may also include one or more speakers 306, which may be located inside the watch case 301. Alternatively, the speaker 306 may be integrated inside the button module 10. Upon detecting user operation of the button module 10, the watch 300 may trigger the speaker 306 to play audio to provide auditory feedback.

[0435] As an example, the watch 300 may also include a crown 304, which may also be located on the side wall of the watch case 301. The crown 304 may be located on the same side of the watch case 301 as the button module 10, or the crown 304 and the button module 10 may be located on opposite sides of the watch case 301.

[0436] For example, the crown 304 may include a knob, by which the adjustment, selection and other functions of the watch 300 can be realized.

[0437] One possibility is that the surface of the crown 304 may be provided with a detection element, which can be used to detect the user's touch of the crown 304. As an example, the detection element may be located on the end face of the end of the crown 304 that extends out of the watch body 301.

[0438] One possibility is that the crown 304 may include an elastic structure that can deform when the user presses one end of the crown 304, and accordingly, the crown 304 can be displaced toward the watch body 301; when the user removes the pressure applied to the end of the crown 304, the elastic structure returns to its original shape, and the crown 304 can be displaced away from the watch body 301 under the action of the elastic structure, returning to the position before the user pressed it.

[0439] In the case where watch 300 includes both crown 304 and button module 10, one possibility is that the functions of crown 304 and button module 10 can complement each other, or that the functions of crown 304 and button module 10 do not overlap, or that crown 304 and button module 10 do not contain the same functions.

[0440] For example, rotating the crown 304 can achieve along Figure 12 The adjustment function of D1 in the center direction, the contact surface of the sliding button module 10 can realize the adjustment along the direction D1. Figure 12 The adjustment function of direction D2 is provided, and directions D1 and D2 can be perpendicular to each other. The adjustment functions achievable by rotating the crown 304 and the adjustment functions achievable by the contact surface of the sliding button module 10 will be explained in detail below and will not be elaborated here.

[0441] In the case where the watch 300 includes both a crown 304 and a button module 10, one possibility is that the functions of the crown 304 and the button module 10 can be partially or completely interchangeable, or that there is an overlap between the functions of the crown 304 and the button module 10, or that the crown 304 and the button module 10 can contain the same functions.

[0442] For example, the function that can be achieved by pressing the end of the crown 304 can be the same as the function that can be achieved by pressing the contact surface of the button module 10.

[0443] For example, the rotating crown 304 and the sliding button module 10 can perform the same functions.

[0444] For example, the watch 300 may also include a button (e.g., referred to as button 320) that is different from the aforementioned button module 10, which may be a mechanical button or a touch button.

[0445] One possibility is that button 320 can perform the same detection function as button module 10, or that button 320 can support the detection of tap and swipe operations.

[0446] For example, button 320 may have the same structure as button module 10; in other words, in this case, watch 300 may include two button modules 10.

[0447] For example, button 320 may have a different structure from button module 10. For instance, button 320 may include one or more array sensors, while button module 10 may include one or more non-array sensors.

[0448] If button 320 can recognize tap and / or swipe operations, one possibility is that the user can achieve different functions by operating button 320 and button module 10. Alternatively, if button 320 and button module 10 detect the same type of trigger operation, watch 300 can perform different response operations.

[0449] For example, the function that can be achieved by pressing button 320 may be different from the function that can be achieved by pressing the contact surface of button module 10.

[0450] For example, the functions that the sliding button 320 and the sliding button module 10 can perform may be different.

[0451] If button 320 can also recognize tap and / or swipe operations, one possibility is that the user can achieve the same function by operating button 320 and button module 10. Alternatively, if button 320 and button module 10 detect the same type of trigger operation, watch 300 can perform the same response operation.

[0452] For example, the function that can be achieved by pressing button 320 can be the same as the function that can be achieved by pressing the contact surface of button module 10.

[0453] For example, the sliding button 320 and the sliding button module 10 can perform the same functions.

[0454] For details regarding the functions of button module 10 and button 320, please refer to the above description of the functions of button module 10 and crown 304.

[0455] In some examples, the above response actions include one or more of the following: playing audio, displaying an interface, or a vibration motor.

[0456] As one implementation, when a trigger operation is detected, the electronic device can vibrate the motor according to a preset mode PsM1, which may include one or more of the following: vibration waveform, vibration intensity, vibration duration, or vibration interval.

[0457] In one possible implementation, the preset mode PsM1 can correspond to the action contained in the triggering operation.

[0458] As an example, the triggering operation can include a pressing action and a lifting action. The aforementioned preset methods can include method M1 and method M2, where method M1 corresponds to the user's pressing action and method M2 corresponds to the user's lifting action. Here, the triggering operation can include a swipe operation and a tap operation; in other words, both swipe and tap operations include pressing and lifting actions.

[0459] For example, mode M1 may include one or more of vibration waveform Vw1, vibration intensity Vs1, vibration duration Vt1 or vibration interval Vi1; mode M2 ​​may include one or more of vibration waveform Vw2, vibration intensity Vs2, vibration duration Vt2 or vibration interval Vi2.

[0460] For example, Figure 13 Two schematic diagrams of motor vibration waveforms are provided as examples, wherein the waveform on the left can be used as an example of the aforementioned vibration waveform Vw1, and the waveform on the right can be used as an example of the aforementioned vibration waveform Vw2. For example, the vibration duration Vt1 can be 16.8 milliseconds, and the vibration duration Vt2 can be 12.6 milliseconds; the vibration interval Vi1 can be 2 milliseconds, and the vibration interval Vi2 can be 1.5 milliseconds; the vibration intensity Vs1 can be 0.6 gF, and the vibration intensity Vs2 can be 0.4 gF.

[0461] As an example, when the triggering operation is a sliding operation, the triggering operation may also include an action G1 (such as a hold action or a move action), which is performed after the aforementioned pressing action and before the lifting action. The aforementioned preset method may also include method M3, which may be different from the aforementioned method M1 or method M2.

[0462] For example, mode M3 may include one or more of the following: vibration waveform Vw3, vibration intensity Vs3, vibration duration Vt3, or vibration interval Vi3. For instance, vibration duration Vt3 may be 30.0 milliseconds, vibration interval Vi3 may be 0.5 milliseconds, and vibration intensity Vs3 may be 0.5 gF.

[0463] For different actions involved in the same operation, the watch 300 can provide different types of vibration feedback, allowing users to more clearly perceive the response at different stages during the operation of the button module 10, and to better understand the currently detected action, thus improving the user experience of using the button module 10.

[0464] As one implementation, upon detecting a trigger operation, the electronic device can play audio according to a preset mode PsM2, which may include one or more of waveform, loudness, duration, or number of times.

[0465] In one possible implementation, the preset mode PsM2 can correspond to the trigger operation. As an example, the loudness of the audio can correspond to the intensity of the trigger operation, the duration of the audio can correspond to the duration of the trigger operation, and the number of times the audio is played can correspond to the number of times the trigger operation is performed.

[0466] As an implementation, the loudness of the audio can be positively correlated with the intensity of the triggering operation, the duration of the audio can be positively correlated with the duration of the triggering operation, and the number of times the audio is played can be positively correlated with the number of times the triggering operation is performed.

[0467] Taking a double-click operation (or a double-tap operation) as an example, Figure 14 An example is provided showing the relationship between light intensity and time detected by the PPG sensor in the case of double-clicking the button module 10.

[0468] In a single double-click operation, the duration of the double-click operation is duration T1, the time interval between two click operations is time interval δ1, the maximum light intensity corresponding to a single click operation is h1, and the area enclosed by the light intensity change curve detected by the PPG sensor and the time axis during a single click operation is A1.

[0469] Similarly, Figure 15 An example is provided showing the relationship between the pressure value detected by the pressure sensor and time when the button module 10 is double-clicked.

[0470] In a single double-click operation, the duration of the double-click operation is duration T2, the time interval between the two click operations is time interval δ2, the maximum pressure value corresponding to a single click operation is h2, and the area enclosed by the pressure value change curve detected by the pressure sensor and the time axis in a single click operation is A2.

[0471] As an example, Figure 16The diagram illustrates the relationship between the waveform of audio played by an electronic device and time during a single double-click operation. A complete sine curve in the diagram corresponds to one audio playback. The duration of two audio playbacks can be denoted as duration T3, the time interval between the two playbacks as time interval δ3, the amplitude of one audio playback as h3, and the area enclosed by the waveform of one audio playback and the time axis as A3.

[0472] As an example of how the way audio is played corresponds to the user's actions, the aforementioned duration T3 can be positively correlated with the aforementioned duration T1 and / or duration T2, the aforementioned time interval δ3 can be positively correlated with the aforementioned time interval δ1 and / or time interval δ2, the aforementioned amplitude h3 can be positively correlated with the aforementioned maximum light intensity h1 and / or maximum pressure h2, and the aforementioned area A3 can be positively correlated with the aforementioned area A1 and / or area A2.

[0473] For example, when the user presses the button module 10 with greater downward pressure, the light intensity detected by the PPG sensor is greater, the pressure value detected by the pressure sensor is greater, and the amplitude of the audio corresponding to the trigger operation can be greater; conversely, when the user presses the button module 10 with less downward pressure, the light intensity detected by the PPG sensor is less, the pressure value detected by the pressure sensor is less, and the amplitude of the audio corresponding to the trigger operation can be less.

[0474] For example, when the user presses the button module 10 for a longer period of time, the duration of light intensity greater than or equal to the light intensity threshold detected by the PPG sensor can be longer, the duration of pressure greater than or equal to the pressure threshold detected by the pressure sensor can be longer, and the playback duration of the audio corresponding to the trigger operation can be longer. Conversely, when the user presses the button module 10 for a shorter period of time, the duration of light intensity greater than or equal to the light intensity threshold detected by the PPG sensor can be shorter, the duration of pressure greater than or equal to the pressure threshold detected by the pressure sensor can be shorter, and the playback duration of the audio corresponding to the trigger operation can be shorter.

[0475] For example, when the time interval between two consecutive operation of the button module 10 is short, the time interval between two adjacent maximum light intensity values ​​detected by the PPG sensor is short, the time interval between two adjacent maximum pressure values ​​detected by the pressure sensor is short, and the time interval between the two audio signals corresponding to the two trigger operations is short. In other words, the electronic device plays the aforementioned two audio signals at a higher frequency. Conversely, when the time interval between two consecutive operation of the button module 10 is long, the time interval between two adjacent maximum light intensity values ​​detected by the PPG sensor is long, the time interval between two adjacent maximum pressure values ​​detected by the pressure sensor is long, and the time interval between the two audio signals corresponding to the two trigger operations is long. In other words, the electronic device plays the aforementioned two audio signals at a lower frequency.

[0476] For example, T3 can be 0.1×T1, 0.05×T2, 0.15×(T1+T2), etc.; δ3 can be δ1, δ2, 0.5×(δ1+δ2), etc.; h3 can be e1×h1, e2×h2, e3×h1+e4×h2, etc., where e1, e2, e3, and e4 are all greater than zero; and A3 can be f1×A1, f2×A2, f3×A1+f4×A2, etc., where f1, f2, f3, and f4 are all greater than zero.

[0477] In some examples, the response of the electronic device's display interface can be related to the application scenario of the electronic device. The following describes in detail how electronic devices display different interfaces based on different button events, taking into account different application scenarios.

[0478] When the button event is a tap event, the user can launch the target application by pressing the button module 10. In other words, when a tap event is detected, the watch 300 can launch the target application indicated by the tap event. Alternatively, the tap event can be associated with the target application.

[0479] For example, in response to a user clicking the button module 10, the watch 300 can display as follows: Figure 17 The interface 201 shown can be used to activate sports-related functions, such as outdoor running activity recording, swimming activity recording, and golf activity recording. For example, upon completion of exercise, in response to the user clicking the button module 10, the watch 300 can display... Figure 17 The interface 202 shown can be used to display the user's exercise records, such as running time, swimming distance, golf score, etc.

[0480] As one implementation, when a user clicks the button module 10, in response to the pressing action during the user's click, the watch 300 can control the motor 305 to vibrate in the manner described above M1; in response to the lifting action during the user's click, the watch 300 can control the motor 305 to vibrate in the manner described above M2.

[0481] As an example, when the watch 300 receives an incoming call, the user can answer the call by clicking the button module 10.

[0482] For example, in response to a user clicking the button module 10, the watch 300 can display as follows: Figure 18 The interface 203 shown can be used to activate sleep-related functions, such as sleep quality detection and sleep intervention. For example, upon completion of sleep quality detection, in response to the user clicking the button module 10, the watch 300 can display the following... Figure 18 The interface 204 shown can be used to display the results of sleep quality testing. For example, the interface 204 may include one or more of the following: the duration of different sleep stages during the user's sleep, the total duration of the user's sleep, the user's sleep quality score, and possible sleep problems of the user.

[0483] For example, in response to a user double-clicking (or pressing) the button module 10, the watch 300 can display as follows: Figure 19 The interface 205 shown can be used to enable functions related to online payment, such as transportation card function, payment QR code function, etc.

[0484] As an example, when the watch 300 receives an incoming call, the user can hang up the call by clicking the button module 10.

[0485] As one implementation, when the user double-clicks (or presses) the button module 10, the watch 300 can control the motor 305 to vibrate in the manner described above M1 in response to the user's pressing action during operation; and the watch 300 can control the motor 305 to vibrate in the manner described above M2 in response to the user's lifting action during operation.

[0486] For example, in response to a user's double-click operation of the button module 10, the watch 300 can display as follows: Figure 20The interface shown is 206 or 207, both of which can include a screenshot of the currently displayed interface of the watch 300. Interface 206 can include a screenshot of the main interface of the watch 300, and interface 207 can include a screenshot of the display interface of the watch 300's sports application. Alternatively, in response to the user's double-click operation of the button module 10, the watch 300 can take a screenshot of the currently displayed interface.

[0487] As an implementation, both interface 206 and interface 207 can include a "share" control 711, which allows users to share screenshots by selecting the "share" control 711.

[0488] Alternatively, interfaces 206 and 207 may not include the "share" control 711. In this case, in response to the user's double-click operation of the button module 10, the watch 300 can obtain a screenshot of the currently displayed interface and share the screenshot directly according to the set path. Here, the set path can be a path set by the user, or it can be a default path. For example, the set path can be social media, email, near-field communication, Bluetooth, star flash, etc.

[0489] For example, after the user finishes exercising, in response to the user's double-click operation of the button module 10, the watch 300 can display the interface of the sports application and take a screenshot of the interface. The interface or the screenshot of the interface may include the user's heart rate information, stride information, pace information, etc. during the exercise.

[0490] For example, when the watch 300 displays an interface containing location-related information (such as the interface of a map application), in response to the user's double-click operation of the button module 10, the watch 300 can directly share a screenshot containing the aforementioned location-related information to social media.

[0491] As an example, if the watch 300 includes a camera, in response to the user's double-click operation of the button module 10, the watch 300 can use the aforementioned camera to take a picture.

[0492] For example, in response to a user's long press of button module 10, watch 300 can display as follows: Figure 21 The interface 208 shown can be the interface of the voice assistant application of the watch 300. In other words, in response to the user's operation of long-pressing the button module 10, the watch 300 can call up and display the voice assistant application.

[0493] As one implementation, when the user presses and holds the button module 10, the watch 300 can control the motor 305 to vibrate in the manner described above M1 in response to the user's pressing action during operation; and in response to the user's lifting action during operation, the watch 300 can control the motor 305 to vibrate in the manner described above M2.

[0494] For example, in response to a user's double-tapping of the button module 10, the watch 300 can display an interface related to the artificial intelligence model. As an example, when the watch 300 displays an image, in response to the user's double-tapping of the button module 10, the watch 300 can display function controls such as image recognition and image editing, which can be implemented based on the aforementioned artificial intelligence model. As an example, when the watch 300 displays a document, in response to the user's double-tapping of the button module 10, the watch 300 can display function controls such as document organization and document expansion, which can also be implemented based on the aforementioned artificial intelligence model.

[0495] As an implementation, when the user taps the button module 10 twice in succession, the speaker 306 of the watch 300 can play an audio sound similar to "ding-ding" or "dong-dong" to prompt the user that the artificial intelligence model processing function has been invoked.

[0496] For example, in response to a user continuously pressing the button module 10 within a certain time range, the watch 300 can display as follows: Figure 22 The interface 209 shown can be used to detect the user's physiological data, such as blood pressure, heart rate, heart rate variability, blood oxygen saturation, respiratory rate, uric acid, emotional stress, and body temperature. For example, this interface 209 can be called a "micro-health check" interface. Upon completion of the physiological data detection, in response to the user's continuous pressing of the button module 10 within a specified time range, the watch 300 can display the physiological data detection results. For example, the watch 300 can display... Figure 22 Interface 210 in the interface can be used to display the user's blood oxygen saturation test results. As one implementation, the user can re-measure blood oxygen saturation by selecting the "Measure" control on interface 210, or by selecting controls such as "Calibrate Measurement" on interface 210.

[0497] One possibility is that the button module 10 may include a pressure sensor that can be used to detect the user's blood pressure. In this case, the watch 300 can also detect the user's blood pressure through the button module 10 during the process of detecting the user's physiological data. Upon completion of physiological data detection, in response to the user's continuous pressing of the button module 10 within a given time frame, the watch 300 can display the following: Figure 22Interface 211 in the interface can be used to display the user's blood pressure measurement results. As an alternative, the user can also perform a blood pressure measurement again by selecting controls such as "calibrate measurement" on interface 211.

[0498] As an example, during the process of the button module 10 detecting the user's blood pressure using a pressure sensor, the user's finger can remain pressed on the button module 10. In this case, the button module 10 can temporarily stop detecting button events through the pressure sensor. After the blood pressure detection is completed, the button module 10 can resume detecting button events through the pressure sensor.

[0499] One possibility is that the watch 300 may include a PPG sensor that can be used to measure the user's heart rate. In this case, the watch 300 can detect the user's heart rate while detecting the user's physiological data. Upon completion of physiological data detection, in response to the user's continuous pressing of the button module 10 within a given time period, the watch 300 may display the following: Figure 22 The interface 212 shown can be used to display the user's heart rate detection results. As one implementation, the user can perform a second heart rate measurement by selecting controls such as "Measure" on interface 212.

[0500] For example, in response to a user pressing the button module 10, the watch 300 can display as follows: Figure 23 The interface 213 shown can be a multitasking interface for the watch 300. Interface 213 may include controls 712 and 713, where control 712 can be used to indicate the application currently displayed in the foreground of the watch 300, and control 713 can be used to indicate the application currently running in the background of the watch 300. As an example, a user can use this interface 213 to switch a background task to the foreground. Alternatively, a user can use this interface 213 to control the watch 300 to display tasks currently running in the background.

[0501] As a result, the watch 300 can provide different types of feedback depending on the duration of the user's operation on the button module 10.

[0502] For example, if a user's dummy tap is detected, and the duration of the dummy tap is greater than 1 second and less than or equal to 2 seconds, the watch 300 can indicate that a dummy tap has been detected (e.g., by vibrating the motor 305 with a small amplitude); if the duration of the dummy tap is greater than 2 seconds and less than or equal to 3 seconds, the watch 300 can display an operation guidance interface related to physiological data detection (e.g., indicating that a relatively still state should be maintained during the measurement of the electrocardiogram); if the duration of the dummy tap is greater than 3 seconds, the watch 300 can begin measuring the user's physiological data.

[0503] For example, when a user touches the contact surface of the button module 10, the motor of the watch 300 can vibrate with a small amplitude; when a user touches the contact surface of the button module 10 for 0.5 seconds, the watch 300 can display the aforementioned... Figure 22 The interface 209 shown; when the watch 300 detects that the user has touched the contact surface of the button module 10 for 1 second, the watch 300 can display the detection items related to the micro-physical examination and prompt the user to perform physiological data detection in the prescribed manner. For example, the watch 300 can prompt the user to keep their finger still; the user can keep their finger in continuous contact with the contact surface of the button module 10 and keep it still to perform physiological data detection; when the user completes the measurement of multiple physiological data according to the prompts of the watch 300, the watch 300 can display the measurement results of the physiological data, such as displaying the micro-physical examination report, etc.

[0504] As a result, before detecting the user's virtual operation and performing physiological data measurement, the motor 305 of the watch 300 can vibrate continuously according to the vibration mode Vm1 to prompt the user that physiological data measurement is about to begin; when performing physiological data measurement, the motor 305 can stop vibrating to indicate that physiological data is being measured.

[0505] When the button event is a sliding event, the user can adjust the functions of the watch 300 by sliding the button module 10.

[0506] For example, a user can select one option from multiple options by sliding the button module 10, or the user can adjust the content of an option by sliding the button module 10.

[0507] For example, a user can adjust the function along direction Dg (e.g., page up / down) by sliding the button module 10, or the user can adjust the function along direction Dh (e.g., page down / left) by sliding the button module 10. Directions Dg and Dh can be two perpendicular directions. As an example, the aforementioned adjustment function along direction Dg can be used to control the switching between different interfaces on the watch 300 or the adjustment of function controls within the interface; the aforementioned adjustment function along direction Dh can be used to control the adjustment of function controls within the interface on the watch 300 or the switching between different interfaces.

[0508] For example, such as Figure 24The interface 214 shown can be considered the playback interface of the "Music" application on the watch 300. In response to the user swiping up on the button module 10, the watch 300 can play the previous track; in response to the user swiping down on the button module 10, the watch 300 can play the next track. In other words, swiping up on the button module 10 functions as tapping the "Previous" button 721 on the interface 214, and swiping down on the button module 10 functions as tapping the "Next" button 722 on the interface 214.

[0509] For example, in response to a user's sliding button module 10, the watch 300 can display as follows: Figure 24 The interface 215 shown can be used to adjust the volume of the watch 300. For example, in response to the user sliding the button module 10 upwards, the watch 300 can increase the current device volume; in response to the user sliding the button module 10 downwards, the watch 300 can decrease the current device volume. In other words, sliding the button module 10 upwards functions as pressing the "volume +" button 723 on the interface 215, and sliding the button module 10 downwards functions as pressing the "volume -" button 724 on the interface 215. Alternatively, sliding the button module 10 upwards functions as sliding the "volume adjustment" control 714 upwards, and sliding the button module 10 downwards functions as sliding the "volume adjustment" control 714 downwards.

[0510] For example, such as Figure 25 The interface 216 shown can be considered as the interface of the "map" application of the watch 300. In response to the user's sliding button module 10, the watch 300 can zoom in or out of the interface 216. In other words, sliding the button module 10 upwards functions as clicking the "zoom in" button 725 on the interface 216, and sliding the button module 10 downwards functions as clicking the "zoom out" button 726 on the interface 216.

[0511] Alternatively, in response to the user's sliding button module 10, the watch 300 can adjust the map position displayed on the interface 216. For example, in response to the user's upward sliding button module 10, the watch 300 can display a map at a position one unit above the position displayed on the interface 216; in response to the user's downward sliding button module 10, the watch 300 can display a map at a position one unit below the position displayed on the interface 216. In other words, sliding the button module 10 upward can achieve the function of dragging the interface 216 downward, and sliding the button module 10 downward can achieve the function of dragging the interface 216 upward.

[0512] For example, such as Figure 26The interface 217 shown can be regarded as the interface 217 of the "diving" application of the watch 300. The interface 217 can be used to set the bottom dwell time. The interface 217 may include adjustment buttons 731, 732 and 733. The values ​​of these three adjustment buttons can be set separately, and the bottom dwell time can be determined according to the values ​​of these three adjustment buttons.

[0513] As an example, in response to a user's sliding operation of button module 10, watch 300 can switch the currently selected adjustment button on interface 217. For instance, in response to a user's downward sliding operation of button module 10, watch 300 can switch the currently selected adjustment button from adjustment button 731 to adjustment button 732; in response to a user's upward sliding operation of button module 10, watch 300 can switch the currently selected adjustment button from adjustment button 733 to adjustment button 732.

[0514] Alternatively, in response to the user's sliding operation of button module 10, watch 300 can adjust the value of the currently selected adjustment button. For example, if the currently selected adjustment button is adjustment button 732, in response to the user's sliding operation of button module 10 upward, watch 300 can increase the value in adjustment button 732 (e.g., from "2" to "3"); in response to the user's sliding operation of button module 10 downward, watch 300 can decrease the value in adjustment button 732 (e.g., from "2" to "1").

[0515] Similarly, such as Figure 26 The interface 218 shown can be considered another interface of the "diving" application of the watch 300, and interface 218 can be used to set the diving depth. As an example, in response to the user's operation of sliding the button module 10, the watch 300 can adjust the value of the diving depth adjustment button 734. For example, in response to the user's operation of sliding the button module 10 upward, the watch 300 can increase the value in the adjustment button 734, and in response to the user's operation of sliding the button module 10 downward, the watch 300 can decrease the value in the adjustment button 734.

[0516] Similarly, such as Figure 26 The interface 219 shown can be considered another interface for the "diving" application of the watch 300. Interface 219 can be used to set the air consumption rate. As an example, in response to the user's operation of sliding the button module 10 upwards or downwards, the watch 300 can switch the currently selected adjustment button from adjustment button 735 to adjustment button 736, or vice versa. As an example, in response to the user's operation of sliding the button module 10, the watch 300 can change the value of the currently selected adjustment button on interface 219.

[0517] As an example, watch 300 may be waterproof, allowing users to operate button module 10 underwater to select and adjust the functions of watch 300.

[0518] The button module 10 can identify user operations by detecting different types of signals. The detection and processing methods of these signals by the button module 10 will affect the power consumption of the button module 10.

[0519] In some examples, one or more sensors included in the button module 10 can detect signals used to indicate user operation at a lower frequency. In this case, the power consumption of the sensors acquiring signals is lower, the power consumption of the button module 10 processing signals is also lower, and the overall power consumption of the button module 10 is lower. In some scenarios, this low-power operation mode of the button module 10 can be referred to as a low-power mode or power-saving mode, etc.

[0520] In some examples, one or more sensors included in the button module 10 can detect signals used to indicate user operations at a higher frequency. In this case, the sensors can acquire the aforementioned signals in a timely manner, and the button module 10 and the electronic device containing the button module 10 can respond to the user's operations promptly. In some scenarios, this high-frequency signal acquisition mode of the button module 10 can be referred to as polling mode or high-performance mode, etc.

[0521] like Figure 27 The illustration shows another method for button interaction provided in this application embodiment. The button module 10 can adjust the frequency of detecting the target signal and the way of reporting information related to the target signal according to the device status information, the device application scenario, and the user's usage habits, thereby improving the applicability of the button module 10 in different application scenarios and enhancing the user experience of the button module 10 in different application scenarios.

[0522] S401, sensor Sa uses frequency F1 to detect the target signal;

[0523] Here, sensor Sa refers to any of the sensors included in the button module 10, such as pressure sensors, capacitive sensors, ECG sensors, bioimpedance sensors, infrared sensors, thermocouples, piezoelectric sensors, PPG sensors, ultrasonic sensors, elastic wave sensors, millimeter wave sensors, and electromagnetic wave sensors mentioned above.

[0524] Here, the target signal refers to the signal detected by the aforementioned sensor, or in other words, the target signal corresponds to the aforementioned sensor. For example, the target signal can be any of the pressure signal, capacitance signal, elastic wave signal, ultrasonic signal, bioimpedance signal, etc. mentioned above.

[0525] For example, the value of frequency F1 can be relatively small, such as 10Hz, 20Hz, 25Hz, etc. When sensor Sa uses frequency F1 to detect the target signal, the power consumption of sensor Sa is low, and sensor Sa is not sensitive to user operations on button module 10.

[0526] One possibility is that the aforementioned frequency F1 can be the default value for the frequency at which sensor Sa detects the target signal. In other words, more generally, sensor Sa can detect the target signal at a lower frequency. This can reduce the power consumption of the button module 10 due to detecting the target signal to some extent, thereby improving the energy efficiency of the electronic device.

[0527] One possibility is that the sensor Sa can also detect the target signal at a higher frequency. In this case, the electronic device is more efficient at recognizing user operations and can respond to button presses more promptly.

[0528] In some examples, sensor Sa can determine whether to use frequency F1 to detect the target signal based on whether an interrupt event is triggered. Specifically, if no interrupt event is triggered, sensor Sa uses frequency F1 to detect the target signal; otherwise, sensor Sa uses frequency F2 to detect the target signal, where frequency F2 is greater than frequency F1.

[0529] For example, the aforementioned interruption event can be determined based on the relationship between the strength of the target signal and a strength threshold. For instance, if the strength of the target signal is less than the strength threshold, no interruption event is triggered; if the strength of the target signal is greater than or equal to the strength threshold, an interruption event is triggered.

[0530] For example, the aforementioned interruption event can be determined based on signals detected by other sensors. For instance, the button module 10 may also include a sensor Sb, and the interruption event can be determined based on signals detected by the sensor Sb.

[0531] In some examples, sensor Sa can determine whether to use frequency F1 to detect the target signal based on the status information of the electronic device containing button module 10. Alternatively, the electronic device can control sensor Sa to use frequency F1 to detect the target signal based on the status information.

[0532] For example, the status information of the aforementioned electronic device may include one or more of the following: remaining battery power, processor operating status, device usage mode, currently running applications, etc.

[0533] For example, when the remaining power of an electronic device is below or equal to a power threshold (e.g., 20%), sensor Sa can use frequency F1 to detect the target signal.

[0534] For example, when the processor of an electronic device is in an idle or hibernation state, or when the operating frequency of the processor core of the electronic device is below a frequency threshold (e.g., 25% of the maximum operating frequency), the sensor Sa can use frequency F1 to detect the target signal.

[0535] For example, when an electronic device is in "Do Not Disturb," "Sleep," "Sports," or "Power Saving" mode, sensor Sa can use frequency F1 to detect the target signal.

[0536] For example, if the currently running application does not support or does not require control via button module 10, sensor Sa can use frequency F1 to detect the target signal.

[0537] In some examples, sensor Sa can determine whether to use frequency F1 to detect the target signal based on the user's usage habits. Alternatively, the electronic device can control sensor Sa to use frequency F1 to detect the target signal based on the user's usage habits.

[0538] For example, a user's usage habits can be related to time, location, etc. As an implementation, the aforementioned location can be determined based on the electronic device's GPS sensors, etc.

[0539] For example, between 9:00 PM and 8:00 AM, users use electronic devices less frequently, and during this period, sensor Sa can use frequency F1 to detect target signals.

[0540] For example, when a user is in an office and uses electronic devices less frequently, sensor Sa can use frequency F1 to detect the target signal.

[0541] In some examples, sensor Sa can determine whether to use frequency F1 to detect the target signal based on the user's activity status. Alternatively, the electronic device can control sensor Sa to use frequency F1 to detect the target signal based on the user's activity status.

[0542] For example, a user's activity state may include: motion state, sleep state, resting state, etc. As an implementation, the user's aforementioned activity state can be determined based on the electronic device's accelerometer, magnetometer, gyroscope, PPG sensor, etc.

[0543] For example, when a user is in motion (such as running, swimming, etc.), the frequency of the user's use of electronic devices is low. In this case, sensor Sa can use frequency F1 to detect the target signal.

[0544] For example, when a user is asleep, the frequency of their use of electronic devices is low. In this case, sensor Sa can use frequency F1 to detect the target signal.

[0545] S402, when the measured intensity of the target signal is greater than or equal to the intensity threshold, the sensor Sa uses frequency F2 to detect the target signal.

[0546] In some examples, a target signal strength greater than or equal to a strength threshold can be considered an interruption event. Based on this, the above scheme can also be understood as follows: in the event of an interruption event, sensor Sa uses frequency F2 to detect the target signal.

[0547] Depending on the type of target signal, the intensity of the target signal can have different meanings.

[0548] For example, the target signal can be a pressure signal. In this case, the intensity of the target signal can be understood as the magnitude of the pressure acting on the contact surface of the button module 10 detected by the pressure sensor.

[0549] For example, the target signal can be a light signal. In this case, the intensity of the target signal can be understood as the intensity of the light detected by the photodiode of the PPG sensor.

[0550] For example, the target signal can be a capacitance signal. In this case, the strength of the target signal can be understood as the magnitude of the capacitance value detected by the capacitance sensor.

[0551] In some examples, sensor Sa can report information 801 to the processor of an electronic device, which can be used to indicate that the strength of the target signal is greater than or equal to a strength threshold, or the signal 801 can be used to indicate the aforementioned interruption event; upon receiving information 801, the aforementioned processor can send information 802 to sensor Sa, which can be used to indicate that the target signal is detected using frequency F2.

[0552] As an example, the aforementioned processor can be located within the button module 10.

[0553] For example, the processor mentioned above can be one or more of the following: central processing unit (CPU), micro controller unit (MCU), field-programmable gate array (FPGA), etc.

[0554] When the strength of the target signal is greater than or equal to the strength threshold, or in other words, when an interrupt event is triggered, the user may be operating the button module 10, for example, by pressing or sliding on the contact surface of the button module 10. In this case, using a higher frequency to detect the target signal allows for timely detection of the user's operation, enabling the electronic device to respond promptly.

[0555] S403, sensor Sa reports information 803, which is used to indicate the target signal.

[0556] As an example, sensor Sa can report information 803 to the processor of an electronic device (such as a central processing unit, microcontroller, field programmable gate array, etc.).

[0557] In some examples, the information 803 above can be used to indicate one or more of the following: whether the measured intensity of the target signal is greater than or equal to an intensity threshold; the duration for which the measured intensity of the target signal is greater than or equal to an intensity threshold; and the number of times the measured intensity of the target signal is greater than or equal to an intensity threshold. In other words, the information 803 above can be used to indicate one or more of the following: whether an interruption event occurs, the duration of the interruption event, and the number of times the interruption event occurs.

[0558] By reporting information related to interrupt events, sensor Sa performs reporting operations less frequently, resulting in lower power consumption from the reporting operations.

[0559] In some examples, the above information 803 may include the measured intensity of the target signal.

[0560] By reporting the measured intensity of the target signal, the electronic device can obtain the detection results of the sensor Sa more promptly, and can promptly identify the user's operation and respond accordingly.

[0561] In some examples, the processor of the electronic device can determine the key events detected by the key module 10 based on the information 803 above, and recognize the user's operation, thereby responding accordingly.

[0562] For information on how electronic devices determine key events or identify trigger operations, please refer to the previous text; it will not be repeated here. The methods by which electronic devices respond to user actions can also be found in the previous text.

[0563] In some examples, the electronic device can continuously acquire signals detected by the button module 10 for a preset duration and determine whether a button event is triggered. If no button event is triggered within the preset duration, the electronic device can control the sensor Sa to detect the target signal at a frequency F1.

[0564] Electronic devices can promptly control the sensor Sa to recover and detect target signals at a lower frequency, which helps control the power consumption of the button module 10 and improves the energy utilization efficiency of electronic devices.

[0565] For example, such as Figure 28 As shown, when the button module 10 includes a pressure sensor and / or a PPG sensor, the electronic device can control the pressure sensor to detect pressure signals at a lower frequency of 10Hz.

[0566] When the pressure signal indicates that the pressure value is greater than or equal to the pressure threshold, the electronic device can control the PPG sensor to detect the light signal and control the pressure sensor to detect the pressure signal at a higher frequency of 50Hz; when the pressure signal indicates that the pressure value is less than the pressure threshold, the electronic device can control the pressure sensor to still detect the pressure signal at a lower frequency of 10Hz and control the PPG sensor not to detect the light signal.

[0567] The electronic device can identify key events based on pressure signals and / or light signals according to the method described above, and execute corresponding response operations. If no new key event is detected within a preset time period, the electronic device can control the pressure sensor to detect pressure signals at a frequency of 10Hz; if a new key event is detected within the preset time period, the electronic device can identify the new key event and continue to execute the corresponding response operation.

[0568] The above examples illustrate various interaction methods that the button module 10 can implement. To simplify button operation, or to better integrate the interaction methods of the button module 10 with other interaction methods (such as a crown) included in the electronic device, this application provides the following... Figure 29 The button interaction method shown allows users to switch between button interaction methods or button function modes. The various interaction methods of the electronic device can work together, making the electronic device more efficient at acquiring user input and providing a better user experience.

[0569] S201, the electronic device accepts the user's switching operation.

[0570] In some examples, the button module 10 may include function mode Fm1 and function mode Fm2, and the user's switching operation can be used to switch between function mode Fm1 and function mode Fm2.

[0571] For example, function mode Fm1 can be used to detect swipe events (such as swipe up or swipe down events), and function mode Fm2 can be used to detect tap events.

[0572] In some scenarios, function mode Fm1 can be called "crown mode," and function mode Fm2 can be called "single-button mode." In other words, in function mode Fm1, button module 10 can perform functions similar to a crown, and in function mode Fm2, button module 10 can perform functions similar to a button.

[0573] For example, function mode Fm1 can be used to detect a first type of tap event, and function mode Fm2 can be used to detect a second type of tap event.

[0574] As an example, the first type of tap event can include one or more of the following: tap, hard press, short press, long press, dash, single click, double click, etc.; as an example, the second type of tap event can include one or more of the following: tap, hard press, short press, long press, dash, single click, double click, etc. The first type of tap event and the second type of tap event are different.

[0575] For example, the first type of tap event can include light short press events, light long press events, etc., and the second type of tap event can include heavy short press events, heavy long press events, etc. In other words, in function mode Fm1, the button module 10 can be used to respond to the user's light tap operation, and in function mode Fm2, the button module 10 can be used to respond to the user's heavy tap operation. Alternatively, the first type of tap event can include heavy short press events, heavy long press events, etc., and the second type of tap event can include light short press events, light long press events, etc. In other words, in function mode Fm1, the button module 10 can be used to respond to the user's heavy tap operation, and in function mode Fm2, the button module 10 can be used to respond to the user's light tap operation.

[0576] For example, the first type of tap event can include: a light short press event, a strong short press event, etc., and the second type of tap event can include: a light long press event, a strong long press event, etc. In other words, in function mode Fm1, the button module 10 can be used to respond to shorter tap operations by the user, and in function mode Fm2, the button module 10 can be used to respond to longer tap operations by the user. Alternatively, the first type of tap event can include: a light long press event, a strong long press event, etc., and the second type of tap event can include: a light short press event, a strong short press event, etc. In other words, in function mode Fm1, the button module 10 can be used to respond to longer tap operations by the user, and in function mode Fm2, the button module 10 can be used to respond to shorter tap operations by the user.

[0577] For example, in function mode Fm1, in response to the user's sliding operation of button module 10, the electronic device can perform adjustment along direction Dg (e.g., page up / down); in function mode Fm2, in response to the user's sliding operation of button module 10, the electronic device can perform adjustment along direction Dh (e.g., page down / left). In other words, the user can switch button module 10 from adjustment mode along direction Dg to adjustment mode along direction Dh, or switch button module 10 from adjustment mode along direction Dh to adjustment mode along direction Dg. One possibility is that the aforementioned directions Dg and Dh can be two mutually perpendicular directions.

[0578] It is understandable that, in different application scenarios or within different applications, the aforementioned adjustment along direction Dg or along direction Dh can achieve different functions. Related content can be found in the preceding text. Figures 24 to 26 The relevant content will not be elaborated here.

[0579] In some examples, the switching operation can be an operation applied to button module 10. For example, a short press of button module 10, a long press of button module 10, a double tap of button module 10, a triple tap of button module 10, etc.

[0580] In some examples, the toggle operation can be an action applied to the crown 304. For example, long-pressing the crown 304, double-clicking the crown, etc.

[0581] In some examples, the switching operation can be a combination of operations acting on the button module 10 and the crown 304. For example, simultaneously pressing the crown 304 and the button module 10 briefly, or simultaneously pressing the crown 304 and the button module 10 for a long time, etc.

[0582] In some examples, the switching operation can be a gesture operation. As an example, the switching operation can include gesture operation Gs1 and gesture operation Gs2, where gesture operation Gs1 can be used to switch the button module 10 from function mode Fm1 to function mode Fm2, and gesture operation Gs2 can be used to switch the button module 10 from function mode Fm2 to function mode Fm1.

[0583] For example, gesture operation Gs1 can be a fist clenching operation, and gesture operation Gs2 can be an open palm operation. Alternatively, gesture operation Gs1 can be a palm upward movement operation, and gesture operation Gs2 can be a palm downward movement operation. Alternatively, gesture operation Gs1 can be a palm-up rotation operation, and gesture operation Gs2 can be a palm-down rotation operation. Alternatively, gesture operation Gs1 can be a finger-spreading operation, and gesture operation Gs2 can be a finger-joining operation. Alternatively, both gesture operation Gs1 and gesture operation Gs2 can be used to shake the watch 300.

[0584] In practice, the watch 300 can detect the above-mentioned gesture operations through its own accelerometer, magnetometer, gyroscope, camera, and PPG sensor included in the button module 10, and complete the switching of the function mode of the button module 10.

[0585] In some examples, the electronic device may include a selection interface for choosing between function mode Fm1 and function mode Fm2, and the aforementioned switching operation may be an operation performed on this selection interface. Further details regarding the aforementioned selection interface can be found in the description below.

[0586] S202, the electronic device switches the button module 10 from function mode Fm1 to function mode Fm2.

[0587] For example, such as Figure 30 As shown, in response to a user's double-click operation of the button module 10, the electronic device can display information 811, which can be used to indicate that the function mode of the button module 10 has been switched. For example, the information 811 can be used to indicate that the button module 10 has switched from the aforementioned function mode Fm1 to function mode Fm2, or the information 811 can be used to indicate that the button module 10 has switched from the aforementioned function mode Fm2 to function mode Fm1.

[0588] For example, such as Figure 31 As shown, in response to the user's palm raising operation, the electronic device can display information 812, which can be used to indicate that the function mode of the button module 10 has been switched to function mode Fm1; in response to the user's palm lowering operation, the electronic device can display information 813, which can be used to indicate that the function mode of the button module 10 has been switched to function mode Fm2.

[0589] For example, such as Figure 32 As shown, the electronic device can display interface 220 and interface 221, which can be used to switch the function modes of the button module 10.

[0590] For example, interface 220 can be used to enable the button module 10 to detect the first type of tap event and swipe event, interface 220 can also be used to enable the button module 10 to detect the second type of tap event, and interface 220 can also be used to enable both of the aforementioned functions simultaneously. As an implementation, interface 220 may include function switch 737 and function switch 738. When function switch 737 is enabled, button module 10 can be used to detect the aforementioned first type of tap event and swipe event; when function switch 738 is enabled, button module 10 can be used to detect the aforementioned second type of tap event; when function switches 737 and 738 are enabled simultaneously, button module 10 can be used to detect the first type of tap event, the second type of tap event, and swipe event.

[0591] For example, interface 221 can be used to select the sliding function of button module 10, such as sliding button module 10 to turn pages up and down, or sliding button module 10 to turn pages left and right. As an implementation, interface 221 may include function option 741 and function option 742. When function option 741 is selected, button module 10 can be used to turn pages up and down; when function option 742 is selected, button module 10 can be used to turn pages left and right.

[0592] One possibility is that, with function switch 737 turned on, the electronic device can display something like... Figure 32 The interface 222 shown can be used to select the sliding function of the button module 10.

[0593] For example, similar to the aforementioned interface 221, interface 222 may include function option 743 and function option 744. When function option 743 is selected, the button module 10 can be used to turn pages up and down; when function option 744 is selected, the button module 10 can be used to turn pages left and right.

[0594] One possibility is that the electronic device may include a crown 304 and the aforementioned button module 10. Users can turn pages up and down or left and right by rotating the crown 304, or they can turn pages up and down or left and right by using the button module 10.

[0595] One possibility is that the electronic device may include the aforementioned button module 10 and another button that supports sliding function (such as the button 320 mentioned above). The button module 10 enables the function of turning pages up and down or left and right, and the aforementioned button 320 can also enable the function of turning pages up and down or left and right.

[0596] In practice, the aforementioned button 320 can detect the user's swiping operation through a sensor array, thereby supporting the swiping function.

[0597] One possibility is that the electronic device may include two of the aforementioned button modules 10, such as button module 10a and button module 10b. These two button modules have similar functions; for example, both button module 10a and button module 10b can be used to implement the function of turning pages up and down or left and right.

[0598] In both of the above situations, the function of the rotating crown 304 may overlap with the function of the sliding button module 10, the function of the sliding button module 10a may overlap with the function of the sliding button module 10b, and the function of the sliding button module 10 may overlap with the function of the sliding button 320.

[0599] To improve the efficiency of electronic devices in acquiring user input information and enhance the user experience, as a feasible approach, when the sliding function of the button module 10 is set, the electronic device can correspondingly set the function of rotating the crown 304; when the function of rotating the crown 304 is set, the electronic device can correspondingly set the sliding function of the button module 10; when the sliding function of the button module 10a is set, the electronic device can correspondingly set the sliding function of the button module 10b; when the sliding function of the button module 10 is set, the electronic device can correspondingly set the sliding function of the button 320.

[0600] For example, if the sliding function of the button module 10 is set to page up and down, the electronic device can correspondingly set the rotation function of the crown 304 to page down and right. Alternatively, if the sliding function of the button module 10 is set to page down and right, the electronic device can correspondingly set the rotation function of the crown 304 to page up and down.

[0601] Similarly, when the crown 304 is set to rotate up and down for page turning, the electronic device can correspondingly set the sliding function of the button module 10 to slide left and right for page turning. Alternatively, when the crown 304 is set to rotate left and right for page turning, the electronic device can correspondingly set the sliding function of the button module 10 to slide up and down for page turning.

[0602] For example, if the sliding function of button module 10a is set to page up and down, the electronic device can correspondingly set the sliding function of button module 10b to page left and right. Alternatively, if the sliding function of button module 10a is set to page left and right, the electronic device can correspondingly set the sliding function of button module 10b to page up and down.

[0603] For example, if the sliding function of button module 10 is set to page up and down, the electronic device can correspondingly set the sliding function of button 320 to page down and right. Or, if the sliding function of button module 10 is set to page down and right, the electronic device can correspondingly set the sliding function of button 320 to page up and down.

[0604] Similarly, if the user sets the sliding function of button 320 to page up and down, the electronic device can correspondingly set the sliding function of button module 10 to page down and right. Alternatively, if the user sets the sliding function of button 320 to page down and right, the electronic device can correspondingly set the sliding function of button module 10 to page up and down.

[0605] In conjunction with the preceding text Figure 24 On the interface 214 shown, the user can slide the button module 10 to select the previous or next track, and rotate the crown 304 to increase or decrease the volume. Alternatively, the user can slide the button module 10 to increase or decrease the volume, and rotate the crown 304 to select the previous or next track.

[0606] In conjunction with the preceding text Figure 25 As shown in interface 216, users can zoom in or out of the map by sliding the button module 10a, and adjust the map position by sliding the button module 10b. Alternatively, users can adjust the map position by sliding the button module 10a, and zoom in or out of the map by sliding the button module 10b.

[0607] In conjunction with the preceding text Figure 26 As shown in interface 217, users can select adjustment buttons 731, 732, and 733 by sliding the button module 10, and adjust the values ​​of the adjustment buttons by sliding the button 320. Alternatively, users can select adjustment buttons 731, 732, and 733 by sliding the button 320, and adjust the values ​​of the adjustment buttons by sliding the button module 10.

[0608] Electronic devices can switch the function mode of button module 10 in response to user switching operations, which helps to improve the applicability of button module 10 in different application scenarios. When electronic devices include other interaction methods, the function of button module 10 can cooperate with other interaction methods to improve the user's interactive experience of using electronic devices.

[0609] To enable users to quickly become familiar with the operation and functions of the button module 10 when first using the electronic device, such as... Figure 33 The illustration shows another interaction method provided in this application embodiment. In this interaction method, the electronic device can provide feedback information based on the user's operation of the button module 10, so that the user can more intuitively feel the deviation between the current operation and the target operation, and become familiar with the use of the button module 10 more quickly.

[0610] For example, the applications that help users become familiar with the use of the button module 10 can be bouncing games, shooting games, throwing games, ball games, etc. In these applications, the button module 10 can perform specific functions; in other words, when users use these applications, the button module 10 can perform the aforementioned specific functions. In other words, these applications can be adapted to the button module 10. The button module 10 can also be adapted to different applications, allowing it to perform different control functions in different applications.

[0611] As a result, the strength of the signal detected by the button module 10 can be positively correlated with the bouncing height of the controlled object in a bouncing game, or the sliding distance of the user's sliding operation detected by the button module 10 can be positively correlated with the bouncing height of the controlled object in a bouncing game.

[0612] As a result, the strength of the signal detected by the button module 10 can be positively correlated with the initial speed of the controlled object in shooting games, throwing games, ball games, etc., or the sliding distance of the user's sliding operation detected by the button module 10 can be positively correlated with the initial speed of the controlled object in shooting games, throwing games, ball games, etc., the moving distance of the controlled object, etc.

[0613] S301, Electronic device display interface 821, the interface 821 includes information 814 for instructing target operation.

[0614] The target operation can be understood as a preset tap or swipe operation. One possibility is that the target operation can be a tap or swipe operation that the button module 10 can recognize.

[0615] In some examples, the target action may include one or more of the following: tap, hard press, short press, long press, swipe, double tap, etc.

[0616] In some examples, interface 821 can be understood as the interface of an application used to assist a user in familiarizing themselves with the use of button module 10. For example, interface 821 can be used to assist a user in familiarizing themselves with the force applied to press button module 10. For example, interface 821 can be used to assist a user in familiarizing themselves with the time interval between two consecutive clicks (e.g., double-clicks) of button module 10 during continuous click (e.g., double-click) operations. For example, interface 821 can be used to assist a user in familiarizing themselves with the sliding distance on button module 10 during sliding operations.

[0617] As an example, such as Figure 34The diagram shows the interface 223 of application App1. Interface 223 may include a control 751, which can be used to indicate the numerical value of the pressure applied by the user to the button module 10 detected by the electronic device, or it can also be used to indicate the sliding distance of the user on the contact surface of the button module 10 detected by the electronic device. Interface 223 may also include multiple controls 752A and 752B to indicate the target operation to be detected. For example, controls 752A and 752B may be circular, and the circle may include text information indicating the target operation, such as "light press", "swipe", "double click", "long press", "swipe", etc. In some examples, the user can train the use of the button module 10, for example, by pressing or sliding the button module 10. When the target operation displayed on interface 223 is detected, the interface 223 may prompt the corresponding target operation.

[0618] As an example, such as Figure 35 The diagram shows the interface 224 of application App2. This interface 224 may include a control 753, which can be used to indicate the target operation to be detected. For example, the control 753 can be circular, and the circle may contain text information indicating the target operation, such as "tap," "swipe," "double-tap," or "long press." The control 753 can gradually move from the top to the bottom of the interface 224. The user needs to complete the target operation before the control 753 touches the bottom of the interface 224. In some examples, the user can train the button module 10. Target operations may randomly appear on the interface 224. When the user performs the corresponding action within a specified time, a "capture successful" message will be displayed; if the user performs an incorrect action or the action times out, a "capture failed" message will be displayed.

[0619] As an example, such as Figure 36 The image shown is the interface 225 of application App3. Application App3 can be understood as a game application based on detecting pressure signals (or light signals, capacitive signals, elastic wave signals, etc.) acting on the button module 10. Application App3 can be used as an example of the aforementioned bouncing game application.

[0620] For example, interface 225 may include an active control 754, which the electronic device can convert the intensity of pressure signals, etc., detected by the button module 10 into the movement height of the active control 754. Alternatively, the electronic device can convert the sliding distance of a sliding operation detected by the button module 10 into the movement height of the active control 754. Interface 225 may also include an obstacle control 755, which may have a certain height. One possibility is that the height of the obstacle control 755 may correspond to the target operation to be detected. For example, an obstacle with a height of h111 corresponds to a light press operation, and an obstacle with a height of h112 corresponds to a hard press operation, where h111 is less than h112. As another example, an obstacle with a height of h113 corresponds to a short slide operation, and an obstacle with a height of h114 corresponds to a long slide operation, where h113 is less than h114.

[0621] In some examples, users can train themselves to use the button module 10, for example, by controlling the magnitude of the force applied to the button module 10 or controlling the distance slid on the button module 10 to control the height of the control 754 to avoid different obstacles.

[0622] As an example, such as Figure 37 The image shows the interface 226 of application App4, which can be understood as a game application based on detecting light signals (pressure signals, capacitance signals, elastic wave signals, etc.) acting on the button module 10. Application App3 can be seen as another example of the aforementioned bouncing game application.

[0623] For example, interface 226 may include active control 756, and the electronic device can convert the intensity of light signals, etc., detected by button module 10 into the movement height of active control 756. Alternatively, the electronic device can convert the sliding distance of a sliding operation detected by button module 10 into the movement height of active control 756. Interface 226 may also include control 757 (or step 757) and control 758 (or step 758), with a certain height difference H between control 757 and control 758. One possibility is that this height difference H can correspond to the target operation to be detected. For example, when the height difference H is h13, the height difference H can correspond to a light press operation; when the height difference H is h14, the height difference H can correspond to a hard press operation. Here, h13 is less than h14. As another example, when the height difference H is h15, the height difference H can correspond to a short slide operation; when the height difference H is h16, the height difference H can correspond to a long slide operation. Here, h15 is less than h16.

[0624] In some examples, users can train themselves to use the button module 10, for example, by controlling the magnitude of the force applied to the button module 10 or by controlling the distance slid on the button module 10 to control the height of the control 756, thereby jumping between different steps (such as the aforementioned steps 757, steps 758, etc.).

[0625] As an example, such as Figure 38 The image shown is the interface 227 of application App5, which can be understood as a game application based on detecting the movement distance of the sliding button module 10.

[0626] For example, interface 227 may include active control 759, which the electronic device can convert the movement distance of a sliding operation on the contact surface detected by button module 10 into the movement distance of active control 759. Before user operation, active control 759 may be located at an initial position Ps121, and the user can move active control 759 from the initial position Ps121 to the target position Ps122 by sliding button module 10. One possibility is that the distance H between the initial position Ps121 and the target position Ps122 can correspond to the target operation to be detected. For example, distance H may correspond to the shortest movement distance that can be recognized as a sliding operation by the electronic device.

[0627] S302, the electronic device receives user input applied to the button module 10.

[0628] In some examples, a user action can be understood as an operation performed by the user in reference to information on the aforementioned interface 821. For example, a user action can be a reference to... Figure 34 The tap operation performed in the middle interface 223. For example, user actions can be referenced. Figure 36 The re-press operation performed in interface 225. For example, the user operation can be referenced. Figure 38 The operation of the upward sliding button module 10 is performed by the middle interface 227.

[0629] It is understandable that there may be a discrepancy between the user operation and the target operation, or that the user operation may not be recognized as the target operation by the electronic device. For example, the user may apply too much pressure to the button module 10 when pressing lightly, apply too little pressure to the button module 10 when pressing hard, or slide too little distance when swiping upwards on the button module 10.

[0630] S303, the electronic device detects signals Sga and / or Sgc corresponding to user operations.

[0631] Here, signals Sga and / or Sgc can be used to identify key press events generated by user operations in S302. In other words, signals Sga and / or Sgc can be used to identify user operations in S302.

[0632] In some examples, signals Sga and Sgc can be any of the following signals: pressure signal, light signal, elastic wave signal, capacitance signal, etc. A detailed description of identifying key events based on signals Sga and Sgc can be found in the preceding text and will not be repeated here.

[0633] S304, Electronic device displays information 815, which indicates whether a target operation has been detected.

[0634] One possibility is that the electronic device identifies the user operation in S302 as a target operation based on the signal Sga and / or the signal Sgc. In this case, the electronic device can display information 815 indicating that the target operation has been detected.

[0635] One possibility is that the electronic device identifies the user operation in S302 as not belonging to the target operation based on the signal Sga and / or the signal Sgc. In this case, the electronic device can display information 815 to indicate that no target operation was detected.

[0636] As an example, combined Figure 34 In interfaces 223 and 228, when a user presses button module 10 with pressure F, if the pressure F falls within the range of pressure values ​​corresponding to a light press operation, the electronic device can highlight control 752A to indicate a light press operation has been detected. If the pressure F does not fall within the range of pressure values ​​corresponding to a light press operation (e.g., less than the lower limit of the range), the electronic device can not highlight control 752A to indicate a light press operation has not been detected. Similarly, if the sliding distance of a user's sliding operation falls within a certain range, the electronic device can highlight control 752B to indicate a sliding operation has been detected. If the sliding distance of a user's sliding operation does not fall within a certain range, the electronic device can not highlight control 752B to indicate a sliding operation has not been detected.

[0637] As an example, combined Figure 35In interfaces 224 and 229, if the time interval between two clicks on button module 10 falls within the range of two clicks on button module 10 in a double-click operation, the electronic device can display a "smiley face" to indicate that a double-click operation has been detected; if the time interval between two clicks on button module 10 does not fall within the aforementioned range, the electronic device can display a "crying face" to indicate that a double-click operation has not been detected. Similarly, if the swipe distance of a user's swipe operation falls within the specified range, the electronic device can display a "smiley face" to indicate that a swipe operation has been detected; if the swipe distance does not fall within the specified range, the electronic device can display a "crying face" to indicate that a swipe operation has not been detected.

[0638] As an example, combined Figure 36 In interfaces 225 and 230, when the user presses button module 10 with pressure F, if the pressure F falls within the range of pressure values ​​corresponding to a hard press operation, the electronic device may not display text similar to "Challenge Failed" to indicate that a hard press operation was detected; if the pressure F does not fall within the range of pressure values ​​corresponding to a hard press operation (e.g., less than the lower limit of the range of pressure values ​​corresponding to a hard press operation), the electronic device may display text similar to "Challenge Failed" to indicate that a hard press operation was not detected. Similarly, if the user's sliding distance falls within the range of distances, the electronic device may not display text similar to "Challenge Failed" to indicate that a sliding operation was detected; if the user's sliding distance does not fall within the range of distances, the electronic device may display text similar to "Challenge Failed" to indicate that a sliding operation was not detected.

[0639] As an example, combined Figure 37 In interfaces 226 and 231, when the user presses button module 10 with pressure F, if the pressure F falls within the range of pressure values ​​corresponding to a light press operation, the electronic device may not display text similar to "Challenge Failed" to indicate that a light press operation was detected; if the pressure F does not fall within the range of pressure values ​​corresponding to a light press operation (e.g., less than the lower limit of the range of pressure values ​​corresponding to a light press operation), the electronic device may display text similar to "Challenge Failed" to indicate that a light press operation was not detected. Similarly, if the user's sliding distance falls within the range of distance values ​​for a sliding operation, the electronic device may not display text similar to "Challenge Failed" to indicate that a sliding operation was detected; if the user's sliding distance falls outside the range of distance values ​​for a sliding operation, the electronic device may display text similar to "Challenge Failed" to indicate that a sliding operation was not detected.

[0640] As an example, combined Figure 38In interfaces 227 and 232, when the user moves the active control 759 to the target position Ps122 by sliding the button module 10, the electronic device can display text similar to "Challenge Successful" to indicate that an upward sliding operation was detected; when the user moves the active control 759 to a position other than the target position Ps122 by sliding the button module 10, the electronic device can display text similar to "Challenge Failed" to indicate that no upward sliding operation was detected.

[0641] Electronic devices can provide a variety of interactive methods to help users become familiar with the functions of button module 10. While introducing the functions of button module 10, they also enhance the fun of the user familiarization process and improve the user experience.

[0642] Figure 39 The diagram shown is a schematic representation of a button module 10 provided in an embodiment of this application. In some examples, the button module 10 may include a bracket 21, a glass cover 22, a PPG sensor 23, a pressure sensor 24, and a circuit board 25.

[0643] As an example, the bracket 21 can be used to fix various structural components included in the button module 10, such as the aforementioned glass cover 22, PPG sensor 23, pressure sensor 24, and circuit board 25. Exemplarily, the bracket 21 can be composed of a low-density polymer material, which can reduce the overall weight of the button module 10 to some extent.

[0644] As an example, the glass cover 22, PPG sensor 23, pressure sensor 24, and circuit board 25 can be stacked sequentially along the thickness direction D3 of the button module 10. Alternatively, the glass cover 22 can be the outermost part of the button module 10 and be used for contact with the user's fingers, etc. The PPG sensor 23 can be positioned close to the glass cover 22, the pressure sensor 24 can be located on the side of the PPG sensor 23 away from the glass cover 22, and the circuit board 25 can be located on the side of the pressure sensor 24 away from the PPG sensor 23.

[0645] In some examples, the side of the glass cover 22 away from the PPG sensor 23 may be provided with a conductive layer 22-1. This conductive layer 22-1 may be part of the detection module 12 mentioned above, or it may serve as an electrode of the ECG sensor or bioimpedance sensor. Exemplarily, to reduce the adverse effect of the conductive layer 22-1 on the light emitted by the PPG sensor 23, the conductive layer 22-1 may be composed of a conductive material with a light transmittance greater than or equal to a transmittance threshold (e.g., 95%), such as indium tin oxide.

[0646] In some examples, the PPG sensor 23 may include a light-emitting diode 23-1, a photodiode 23-2, and a circuit board 23-3. The light-emitting diode 23-1 can be used to emit light for detecting the user's physiological data, the photodiode 23-2 can be used to receive the light reflected by the human body, and the circuit board 23-3 can be electrically connected to the aforementioned light-emitting diode 23-1 and photodiode 23-2 and used to control these two electronic components.

[0647] In some examples, the button module 10 may further include a strain gauge 26, which may be located below the aforementioned circuit board 23-3. The strain gauge 26 provides support when the user operates the button module 10. When the user presses the button module 10, the strain gauge 26 deforms. As an example, the aforementioned pressure sensor 24 may be attached to the side of the strain gauge 26 facing away from the circuit board 23-3. The pressure sensor 24 can detect the deformation of the strain gauge 26 to determine the magnitude of the pressure applied by the user to the button module 10.

[0648] In some examples, one end of the circuit board 25 may be electrically connected to electronic components in the button module 10 (such as the aforementioned circuit boards 23-3, etc.), and the other end may include one or more interfaces that can be electrically connected to the motherboard of the electronic device, etc.

[0649] In some examples, the button module 10 may also include a Fresnel membrane 27, which may be located on the side of the light-emitting diode 23-1 facing the glass cover 22. The Fresnel membrane 27 may be used to adjust the propagation path of the light emitted by the light-emitting diode 23-1.

[0650] In some examples, the button module 10 may also include one or more adhesive layers, which can be used to fix various structural components within the button module 10 relative to each other. For example, the button module 10 may include adhesive layer 28a and adhesive layer 28b, wherein adhesive layer 28a may be located on the side of the glass cover 22 facing the PPG sensor 23, and adhesive layer 28a may be used to fix the glass cover 22 relative to the bracket 21; adhesive layer 28b may be located on the side of the PPG sensor 23 facing the glass cover 22, and adhesive layer 28b may be used to fix the PPG sensor 23 relative to the bracket 21.

[0651] When the button module 10 is a mechanical button, it may also include an elastic structural component, such as a button cup or a spring, which can deform under force when the user presses the button module 10. When the button module 10 is a touch button, it may also include a motor, which can vibrate in a preset manner to provide feedback to the user's touch operation when the user touches the button module 10.

[0652] like Figure 40 As shown in the illustration, this application also provides a wireless earphone 400, which may include an earphone body 401 and an earphone case 402. The earphone case 402 can be used to store the earphone body 401 and charge the earphone body 401. At least one of the two earphone bodies 401 may include the aforementioned button module 10. Users can use the button module 10 to adjust the volume of the earphone 400, change the currently playing track, answer or hang up calls, etc.

[0653] In one implementation, the button module 10 may include the detection module 12 mentioned above. One of the two electrodes of the detection module 12 may be located on the contact surface of the button module 10, and the other electrode of the detection module 12 may be located at another position on the surface of the earphone 400. One possibility is that, with the help of the detection module 12, the earphone 400 can detect the user's electrocardiogram signal, and the earphone 400 can also identify whether the button module 10 has been accidentally pressed.

[0654] In some examples, the headphones 400 may also include one or more electronic components such as speakers, microphones, batteries, circuit boards, and antennas, which are not limited in this application.

[0655] like Figure 41 As shown in the illustration, this application also provides a pair of glasses 500, which may include components such as lenses 501, frames 502, nose pads 503, and temples 504. The glasses 500 may also include the aforementioned button module 10, which may be located in a position on the frame 502 or temples 504 of the glasses 500 for easy pressing and touching by the user. For example, the glasses 500 can be used for playing audio and making calls. In this case, the user can use the aforementioned button module 10 to adjust the audio playback volume, change the currently playing track, answer or hang up calls, etc.

[0656] In one implementation, the button module 10 may include the detection module 12 mentioned above. One of the two electrodes of the detection module 12 may be located on the contact surface of the button module 10, and the other electrode of the detection module 12 may be located on the inner side of the temple 504 where it contacts the user's head skin, or the other electrode may be located on the side of the nose pad 503 facing the user's nose. One possibility is that, with the aid of the detection module 12, the glasses 500 can detect the user's electrocardiogram signal, and the glasses 500 can also identify whether the button module 10 has been accidentally pressed.

[0657] In some examples, the glasses 500 may also include one or more electronic components such as a camera, speaker, microphone, battery, circuit board, and antenna, which are not limited in this application.

[0658] like Figure 42 As shown, this application embodiment also provides a ring 600, which may include the above-described button module 10. Exemplarily, the button module 10 may be located on the outer side of the ring 600 at a position convenient for the user to press or touch, such as on the outer wall 601 of the ring 600.

[0659] In one implementation, the button module 10 may include the detection module 12 described above. One of the two electrodes of the detection module 12 may be located on the contact surface of the button module 10, and the other electrode of the detection module 12 may be located on the inner wall 602 of the ring 600. When the user wears the ring 600, the electrode located on the inner wall 602 may come into contact with the user's skin. One possibility is that, with the aid of the detection module 12, the ring 600 can detect the user's electrocardiogram (ECG) signal, and the ring 600 can also identify whether the button module 10 has been accidentally pressed.

[0660] In some examples, the ring 600 may also include one or more electronic components such as an accelerometer, a magnetometer, a battery, a circuit board, and an antenna, which is not limited in this application.

[0661] Based on the same inventive concept, such as Figure 43 As shown in the illustration, this application also provides a button-interaction device 4300. This device 4300 can possess the functions of an electronic device described in the above method embodiments and can be used to execute the steps performed by the functions of the electronic device in the above method embodiments. This function can be implemented in hardware, or in software, or by hardware executing corresponding software. The hardware or software includes one or more modules corresponding to the above functions.

[0662] In one possible implementation, the button interaction device 4300 may include an acquisition module 4310 and a processing module 4320, which are coupled to each other.

[0663] In some examples, the acquisition module 4310 can be used to support the operation of the electronic device detecting signals Sga, Sgc, etc. in the foregoing embodiments.

[0664] The processing module 4320 is used to support the electronic device in performing the processing actions in the above method embodiments, such as identifying the operation type based on the detected signal.

[0665] Optionally, the button interaction device 4300 may further include a storage unit 4330 for storing the program code and data of the button interaction device 4300.

[0666] Figure 44 An electronic device 4400 provided in this application embodiment is shown in the figure. The electronic device 4400 includes at least one processor 4410 and a transceiver 4420. The processor 4410 is coupled to a memory and is used to execute instructions stored in the memory to control the transceiver 4420 to transmit and / or receive signals.

[0667] Optionally, the electronic device 4400 also includes a memory 4430 for storing instructions.

[0668] In some embodiments, the processor 4410 and the memory 4430 can be combined into a single processing device, with the processor 4410 executing program code stored in the memory 4430 to achieve the aforementioned functions. In specific implementations, the memory 4430 can be integrated into the processor 4410 or independent of the processor 4410.

[0669] In some embodiments, transceiver 4420 may include a receiver and a transmitter.

[0670] The transceiver 4420 may further include an antenna, and the number of antennas may be one or more. The transceiver 4420 may be a communication interface or an interface circuit.

[0671] When the electronic device 4400 is a chip, the chip includes a transceiver module and a processing module. The transceiver module can be an input / output circuit or a communication interface; the processing module can be a processor, microprocessor, or integrated circuit integrated on the chip.

[0672] This embodiment also provides a computer-readable storage medium storing computer instructions. When the computer instructions are executed on an electronic device, the electronic device performs the aforementioned method steps to implement the button interaction method in the above embodiment.

[0673] This embodiment also provides a computer program product that, when run on a computer, causes the computer to perform the aforementioned steps to implement the key interaction method described in the above embodiment.

[0674] Furthermore, embodiments of this application also provide an apparatus, which may specifically be a chip, component, or module. The apparatus may include a connected processor and a memory. The memory stores computer execution instructions. When the apparatus is running, the processor can execute the computer execution instructions stored in the memory to cause the chip to perform the key interaction methods described in the above-described method embodiments.

[0675] Those skilled in the art will recognize that the units and algorithm steps of the various examples described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are implemented in hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this application.

[0676] Those skilled in the art will understand that, for the sake of convenience and brevity, the specific working processes of the systems, devices, and units described above can be referred to the corresponding processes in the foregoing method embodiments, and will not be repeated here.

[0677] In the several embodiments provided in this application, it should be understood that the disclosed systems, apparatuses, and methods can be implemented in other ways. For example, the apparatus embodiments described above are merely illustrative. For instance, the division of detection units is only a logical functional division, and in actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed. Furthermore, the coupling or direct coupling or communication connection shown or discussed may be through some interfaces; the indirect coupling or communication connection between apparatuses or units may be electrical, mechanical, or other forms.

[0678] The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the units can be selected to achieve the purpose of this embodiment according to actual needs.

[0679] In addition, the functional units in the various embodiments of this application can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit.

[0680] If the aforementioned functions are implemented as software functional units and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, or a portion of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of this application. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, read-only memory (ROM), random access memory (RAM), magnetic disks, or optical disks.

[0681] The above description is merely a specific embodiment of this application, but the scope of protection of this application is not limited thereto. Any variations or substitutions that can be easily conceived by those skilled in the art within the scope of the technology disclosed in this application should be included within the scope of protection of this application. Therefore, the scope of protection of this application should be determined by the scope of the claims.

Claims

1. A method for button interaction, applied to electronic devices, characterized in that, The electronic device includes a button module, the button module including a first sensor composed of a first sensing element, and the method includes: Receive a first operation applied to the button module; The first signal is detected by the first sensing element; Based on the first signal, the first operation is determined to be a sliding operation; Perform a response operation, which corresponds to the sliding operation.

2. The method according to claim 1, characterized in that, Determining that the first operation is a sliding operation based on the first signal includes: The first operation is determined to be the sliding operation based on the reference strength of the first signal, the measured strength of the first signal, and the change in the measured strength of the first signal. The reference strength is the strength of the first signal when the user does not operate the button module.

3. The method according to claim 1 or 2, characterized in that, The first sensing element includes a transmitting module and a receiving module, wherein the transmitting module and the receiving module are separately configured. The transmitting module is used to transmit a reference signal, and the receiving module is used to receive the first signal. The reference signal corresponds to the first signal.

4. The method according to claim 3, characterized in that, Determining that the first operation is the sliding operation based on the first signal includes: Based on the position of the sending module, the position of the receiving module, and the first signal, the first operation is determined to be the sliding operation.

5. The method according to any one of claims 1 to 4, characterized in that, The button module also includes a second sensor. Determining that the first operation is a sliding operation based on the first signal includes: The first operation is determined to be the sliding operation based on the second signal and the first signal. The second signal is detected by the second sensor and is a signal of a different type from the first signal.

6. The method according to claim 5, characterized in that, Determining the first operation as the sliding operation based on the second signal and the first signal includes: If, within a first time period, the measured intensity of the first signal first increases and then decreases, and the measured intensity of the second signal first increases and then decreases, then the first operation is determined to be the sliding operation.

7. The method according to any one of claims 1 to 6, characterized in that, The button module further includes a third sensor, which includes multiple electrodes, one electrode of which is located on the contact surface of the button module. The method further includes: The third sensor detects electrocardiogram signals and / or bioimpedance signals. If the electrocardiogram signal meets the first preset requirement and / or the bioimpedance signal meets the second preset requirement, it is determined that the first operation has been detected.

8. The method according to any one of claims 1 to 7, characterized in that, The button module includes a first function mode and a second function mode. The first function mode is used to detect the sliding operation, and the second function mode is used to detect user operations different from the sliding operation. The method further includes: Accept the first handover operation; Switch the button module from the first function mode to the second function mode; and / or, Accept the second handover operation; Switch the button module from the second function mode to the first function mode.

9. The method according to claim 8, characterized in that, The first functional mode is also used to detect a first type of tap operation, and the second functional mode is used to detect a second type of tap operation, wherein the first type of tap operation is different from the second type of tap operation.

10. The method according to any one of claims 1 to 9, characterized in that, The electronic device further includes a knob and / or a first button, wherein the first button is different from the button module, and the method further includes: When the sliding button module is used to achieve the first function, the knob is rotated to achieve the second function; and / or, When the sliding button module is used to implement the first function, the sliding first button is set to implement the second function. The first function is different from the second function.

11. The method according to any one of claims 1 to 10, characterized in that, The method further includes: The second operation is performed on the button module, the second operation including the sliding operation; Perform one or more of the following: display the target interface; play the target audio; vibrate the motor.

12. The method according to claim 11, characterized in that, The second operation includes a pressing action and a lifting action, and the vibration motor includes: In response to the press action, the motor vibrates in a first manner; and / or, In response to the lifting action, the motor vibrates in a second manner.

13. The method according to claim 12, characterized in that, The second operation further includes a first action, which occurs after the pressing action and before the lifting action, and the first action is different from either the pressing action or the lifting action. The vibration motor further includes: In response to the first action, the motor vibrates in a third manner.

14. The method according to claim 12 or 13, characterized in that, The first method includes at least one of the following: a first vibration waveform, a first vibration duration, a first vibration intensity, and a first vibration interval; the second method includes at least one of the following: a second vibration waveform, a second vibration duration, a second vibration intensity, and a second vibration interval.

15. The method according to any one of claims 11 to 14, characterized in that, The target audio to be played includes: The target audio is played in a fourth manner, wherein the fourth manner is determined based on at least one of the operating force, operating time, and number of operations of the second operation.

16. The method according to claim 15, characterized in that, The fourth method includes at least one of the following: a first loudness, a first playback duration, and a first waveform. Wherein, the first loudness corresponds to the operation intensity, the first playback duration corresponds to the operation time, and the first waveform corresponds to the number of operations.

17. The method according to any one of claims 1 to 16, characterized in that, The detection of the first signal through the first sensing element includes: The first signal is detected at a first frequency by the first sensing element; When the intensity of the first signal is greater than or equal to the intensity threshold, the first signal is detected by the first sensing element at a second frequency; The second frequency is higher than the first frequency.

18. The method according to any one of claims 1 to 17, characterized in that, The method further includes: Accept a third operation performed on the button module; The system detects the user's physiological data, which includes one or more of the following: blood pressure, blood sugar, blood oxygen, heart rate, uric acid, emotional stress, body temperature, respiratory rate, and blood oxygen content. The first interface is displayed, which includes the detection results of the physiological data.

19. The method according to any one of claims 1 to 18, characterized in that, The method further includes: Receive a fourth operation performed on the button module; A second interface is displayed, which includes a screenshot of the electronic device.

20. An electronic device, characterized in that, The device includes a processor and a memory, the memory storing program instructions, and the processor executing the program instructions to cause the electronic device to perform the method of any one of claims 1 to 19.

21. The electronic device according to claim 20, characterized in that, The electronic device is any one of the following: headphones, glasses, ring, watch, or bracelet.

22. An apparatus, characterized in that, Includes a button module for implementing the method of any one of claims 1 to 19.

23. A computer-readable storage medium, characterized in that, It stores a computer program thereon, which, when executed by a computer, enables the implementation of the method according to any one of claims 1 to 19.

24. A computer program product, characterized in that, It includes computer program code that, when run on a computer, causes the method of any one of claims 1 to 19 to be performed.

25. A chip, characterized in that, The device includes a processor and a memory, the memory storing program instructions, and the processor executing the program instructions to cause the electronic device to perform the method of any one of claims 1 to 19.