Touch feedback method, electronic device, storage medium, and program product
By recognizing the type of touch operation in the virtual button area, the problems of large virtual button space occupation and poor appearance consistency are solved, and rich touch feedback and improved user experience are achieved.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- BEIJING XIAOMI MOBILE SOFTWARE CO LTD
- Filing Date
- 2024-12-27
- Publication Date
- 2026-06-30
AI Technical Summary
In the existing technology, virtual buttons occupy more physical space on electronic devices and affect the consistency of appearance, making it difficult to achieve rich control while maintaining the consistency of appearance and relatively small space.
By detecting touch operations in the virtual button area, it can identify whether the operation is performed by a single finger or multiple fingers, determine the function triggered by the touch operation, and execute the corresponding target function. The function of a single finger touch is independent of its position, while the function of multiple finger touches is determined based on the combined operation information.
Without increasing the size of the virtual button area, it improves the diversity of touch feedback, reduces accidental touches and the impact on appearance consistency, and enhances the user experience.
Smart Images

Figure CN122308695A_ABST
Abstract
Description
Technical Field
[0001] This disclosure relates to the field of terminal technology, and in particular to touch feedback methods, electronic devices, storage media, and software products. Background Technology
[0002] With the continuous development and advancement of terminal technology, electronic devices such as smartphones and tablets have become indispensable tools in people's lives. To meet people's requirements for the appearance and waterproof performance of terminals, virtual buttons are usually set on electronic devices to replace physical buttons.
[0003] To achieve different button functions, multiple virtual buttons are typically set up on electronic devices. These virtual buttons are often distinguished by their appearance to allow users to quickly identify them. However, this method of setting up virtual buttons requires more physical space on the electronic device and can also affect the overall aesthetic consistency of the device. Summary of the Invention
[0004] To overcome the problems existing in related technologies, this disclosure provides a touch feedback method, an electronic device, a storage medium, and a program product.
[0005] According to a first aspect of the present disclosure, a touch feedback method is provided, comprising:
[0006] When a touch operation is detected on the virtual button area of an electronic device, it is determined whether the touch operation was performed by a single finger;
[0007] If the touch operation is performed by a single finger, determine the first target function triggered by the touch operation; wherein, the first target function is independent of the position of the touch operation on the virtual button area;
[0008] Perform the first objective function.
[0009] In some embodiments, when a touch operation is detected acting on a virtual button area of an electronic device, determining whether the touch operation was performed by a single finger includes:
[0010] Acquire the first sensing data collected by multiple sensors within the virtual button area;
[0011] When it is determined that a first sub-touch operation has been detected based on the first sensing data, second sensing data collected by multiple sensors within a first time range is acquired.
[0012] Based on the second sensor data, determine whether at least one second sub-touch operation is detected while the first sub-touch operation continues to act on the virtual button area;
[0013] Based on the detection results of at least one second sub-touch operation, determine whether the touch operation was performed by a single finger.
[0014] In some embodiments, the method further includes:
[0015] If the touch operation is performed by multiple fingers, determine the operation information of the first sub-touch operation and at least one second sub-touch operation;
[0016] Based on the operation information of the first sub-touch operation and at least one second sub-touch operation, a second target function is determined from a plurality of preset combination button functions; wherein, each combination button function corresponds to a combination operation information, and the combination operation information includes the operation information of at least two sub-touch operations; the operation information of at least one sub-touch operation is different in the combination operation information corresponding to different combination button functions;
[0017] Perform the second objective function.
[0018] In some embodiments, the method further includes:
[0019] Based on the first sensor data and the second sensor data, determine the operation type of the first sub-touch operation and at least one second sub-touch operation;
[0020] Based on the operation information of a first sub-touch operation and at least one second sub-touch operation, a second target function is determined from a plurality of preset combination key functions, including at least one of the following:
[0021] If the operation type of the first sub-touch operation and at least one second sub-touch operation is a press operation, the second target function is determined based on the first sub-area of the virtual button area where the first sub-touch operation is applied and the second sub-area of the virtual button area where at least one second sub-touch operation is applied.
[0022] If the operation type of the first sub-touch operation and at least one second sub-touch operation is a sliding operation, the second target function is determined according to the first sliding direction of the first sub-touch operation and the second sliding direction of at least one second sub-touch operation;
[0023] If the operation types of the first sub-touch operation and at least one second sub-touch operation include sliding operation and pressing operation, the second target function is determined according to the target sliding direction of the sliding operation and the target sub-area of the virtual button area where the pressing operation is applied.
[0024] In some embodiments, determining whether a touch operation is performed by a single finger based on the detection result of at least one second sub-touch operation includes:
[0025] If at least one second sub-touch operation is detected, it is determined that the first sub-touch operation is applied to a first sub-region of the virtual button area, and at least one second sub-touch operation is applied to a second sub-region of the virtual button area; wherein, the virtual button area includes multiple sub-regions;
[0026] If the first sub-region and the second sub-region are different sub-regions of the virtual button area, it is determined that the touch operation is performed by multiple fingers.
[0027] If the first sub-region and the second sub-region are the same sub-region of the virtual button area, it is determined that the touch operation is performed by a single finger.
[0028] In some embodiments, if the first sub-region and the second sub-region are the same sub-region of the virtual button area, determining that the touch operation is performed by a single finger includes:
[0029] If the operation type of the first sub-touch operation and at least one second sub-touch operation includes a press operation, and the first sub-region and the second sub-region are the same sub-region of the virtual button area, it is determined that the touch operation is a press operation performed by a single finger.
[0030] According to a second aspect of the present disclosure, an electronic device is provided, the electronic device including a virtual button area, and further comprising:
[0031] A sensor module is fixedly installed in the virtual button area; the sensor module includes multiple sensors for detecting touch operations applied to the virtual button area;
[0032] The first processing module, connected to the sensor module, is used to determine whether the touch operation was performed by a single finger when the sensor module detects a touch operation.
[0033] A control module, connected to a first processing module, is used to determine a first target function triggered by a touch operation if the touch operation is performed by a single finger; and to execute the first target function; wherein the first target function is independent of the position of the touch operation on the virtual button area.
[0034] In some embodiments, the sensor module includes:
[0035] The first sensing layer is located close to the virtual button area. The first sensing layer includes multiple capacitive sensors, which are arranged along the length of the virtual button area.
[0036] The second sensing layer is stacked on top of the first sensing layer. The second sensing layer includes multiple pressure sensors arranged along the length of the virtual button area.
[0037] In some embodiments, the electronic device further includes:
[0038] The second processing module is connected to the first processing module and is used to control the first processing module to perform a reset operation when a fault is detected in the first processing module.
[0039] In some embodiments, the electronic device further includes:
[0040] A first power supply module is connected to the sensor module, the first processing module, and the second processing module, and is used to supply power to the sensor module, the first processing module, and the second processing module when the electronic device is in a powered-off state.
[0041] According to a third aspect of the present disclosure, a non-transitory computer-readable storage medium is provided, the storage medium storing a computer program or instructions that, when executed by a processor, implement the steps of the method described in the first aspect of the present disclosure.
[0042] According to a fourth aspect of the present disclosure, a computer program product is provided, including a computer program or instructions, which, when executed by a processor, implement the steps of the method described in the first aspect of the present disclosure.
[0043] The technical solutions provided by the embodiments of this disclosure may include the following beneficial effects:
[0044] This embodiment of the disclosure can identify whether a touch operation performed by a single finger or multiple fingers is detected when a user operates on the virtual button area of an electronic device. When it is determined that the touch operation is performed by a single finger, a first target function triggered by the touch operation is determined and executed in response to the user's touch operation. Since the first target function triggered by a touch operation performed by a single finger is independent of the position of the touch operation on the virtual button area, the button function triggered when the user touches any position on the virtual button area with a single finger is the same button function (i.e., the first target function). Thus, even if the virtual buttons of the electronic device are not visually distinguishable, accidental touches will not occur, thereby reducing the impact on the aesthetic consistency of the electronic device.
[0045] It should be understood that the above general description and the following detailed description are exemplary and explanatory only, and are not intended to limit this disclosure. Attached Figure Description
[0046] The accompanying drawings, which are incorporated in and form a part of this specification, illustrate embodiments consistent with this disclosure and, together with the description, serve to explain the principles of this disclosure.
[0047] Figure 1This is a schematic diagram of a virtual button according to an exemplary embodiment. Figure 1 ;
[0048] Figure 2 This is a flowchart illustrating a touch feedback method according to an exemplary embodiment;
[0049] Figure 3 This is a schematic diagram of a virtual button according to an exemplary embodiment. Figure 2 ;
[0050] Figure 4 This is a schematic diagram of the structure of an electronic device according to an exemplary embodiment. Figure 1 ;
[0051] Figure 5 This is a schematic diagram of the output signal of a signal port of a first processing module according to an exemplary embodiment. Figure 1 ;
[0052] Figure 6 This is a schematic diagram of the output signal of a signal port of a first processing module according to an exemplary embodiment. Figure 2 ;
[0053] Figure 7 This is a schematic diagram illustrating a connection method between a sensor module and a virtual button area according to an exemplary embodiment;
[0054] Figure 8 This is a schematic diagram illustrating the correspondence between a sensor module and a virtual button area according to an exemplary embodiment;
[0055] Figure 9 This is a schematic diagram illustrating a sensor module according to an exemplary embodiment;
[0056] Figure 10 This is a schematic diagram of the structure of an electronic device according to an exemplary embodiment. Figure 2 ;
[0057] Figure 11 This is a schematic diagram of the structure of an electronic device according to an exemplary embodiment. Figure 3 ;
[0058] Figure 12 This is a structural block diagram of an electronic device according to an exemplary embodiment. Detailed Implementation
[0059] Exemplary embodiments will now be described in detail, examples of which are illustrated in the accompanying drawings. When the following description relates to the drawings, unless otherwise indicated, the same numerals in different drawings denote the same or similar elements. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with this disclosure. Rather, they are merely examples of apparatuses and methods consistent with some aspects of this disclosure as detailed in the appended claims.
[0060] The diversification and virtualization of buttons on electronic devices such as smartphones and tablets has become a clear trend for future development. By replacing physical buttons with virtual ones, electronic devices can achieve greater design flexibility and richer human-computer interaction.
[0061] In some embodiments, the virtual button area of an electronic device typically physically separates different pressing areas, or uses obvious differences in appearance or texture to distinguish different pressing areas for user operation. Furthermore, each virtual button corresponds to only one button function. For example... Figure 1 As shown, Figure 1 This is a schematic diagram of a virtual button according to an exemplary embodiment. Figure 1 The volume down (Vol-) button and the power (PWR) button are clearly physically separated, and pressing a specific area of the virtual button area will only produce a specific response.
[0062] In the above solutions, the virtual button area needs to occupy more physical space on the electronic device to accommodate the pressing areas corresponding to multiple button functions. Furthermore, the electronic device needs to have a significantly different appearance so that users can quickly locate the corresponding virtual buttons, but this also affects the innovativeness of the electronic device's design. If the virtual button area supports sliding controls and is physically divided into multiple independent sub-areas, the sliding range of each sub-area will be relatively short.
[0063] In summary, virtual buttons in related technologies struggle to achieve a wide range of controls while maintaining a consistent appearance and a relatively small overall footprint.
[0064] This disclosure provides a touch feedback method. Figure 2 This is a flowchart illustrating a touch feedback method according to an exemplary embodiment. Figure 2 As shown, the method mainly includes the following steps:
[0065] Step S201: When a touch operation is detected on the virtual button area of the electronic device, determine whether the touch operation is performed by a single finger;
[0066] Step S202: If the touch operation is performed by a single finger, determine the first target function triggered by the touch operation; wherein, the first target function is independent of the position of the touch operation on the virtual button area;
[0067] Step S203: Execute the first target function.
[0068] The touch feedback method shown in this embodiment can be applied to electronic devices, which can be mobile terminals such as smartphones, tablets, laptops, smart TVs, wearable devices, and in-vehicle devices. Alternatively, the electronic device can be a fixed terminal, such as a smart large-screen device or a desktop computer.
[0069] It should be noted that electronic devices may include a virtual button area, which can be integrated with the bezel of the electronic device, such as... Figure 3 As shown, Figure 3 This is a schematic diagram of a virtual button according to an exemplary embodiment. Figure 2 Alternatively, the virtual button area can also be a separate section.
[0070] Furthermore, electronic devices can be equipped with multiple sensors, positioned close to the virtual button area. Understandably, this allows the electronic device to detect touch activity on the virtual button area in real time using these multiple sensors.
[0071] Here, the sensor can be a pressure sensor, a capacitive sensor, and / or an ultrasonic sensor, etc. Understandably, if the sensor is a capacitive sensor, the user's finger touching the virtual button area can be detected based on the capacitance value sensed by the capacitive sensor at the virtual button area. Alternatively, if the sensor is a pressure sensor, the user's finger touching the virtual button area can be detected based on the pressure value sensed by the pressure sensor at the virtual button location.
[0072] In some embodiments, the virtual button area may be disposed on the side frame of the electronic device, and multiple sensors of the electronic device may be arranged along the length direction of the virtual button area.
[0073] In step S201, the user's touch on the virtual button area can be detected by the sensor in the electronic device; and when the user's touch operation on the virtual button area is detected, it is determined whether the detected touch operation is performed by a single finger or by multiple fingers.
[0074] It should be noted that a touch operation performed by a single finger can be understood as the user making contact with the virtual button area with one finger. A touch operation performed by multiple fingers can be understood as the user making contact with the virtual button area with more than one finger.
[0075] Electronic devices can determine whether a user's touch operation on the virtual button area has been detected, and whether the detected touch operation is performed by a single finger, based on the sensing data collected by multiple sensors in the virtual button area.
[0076] The button functions triggered by a touch operation performed by a single finger differ from those triggered by a touch operation performed by multiple fingers. Therefore, when a user's touch operation on the virtual button area is detected, it is necessary to further determine whether the detected touch operation was performed by a single finger or multiple fingers. In this way, without increasing the size of the virtual button area, different button functions can be triggered by distinguishing between single-finger and multi-finger touches, thereby improving the diversity of touch feedback in electronic devices.
[0077] In step S202, if it is determined that the detected touch operation is performed by a single finger, the electronic device can determine the first target function triggered by the touch operation.
[0078] It is worth noting that, in this embodiment, the first target function triggered by a touch operation performed by a single finger is independent of the location of the touch operation within the virtual button area. It is understood that if a user touches any location within the virtual button area with a single finger, the electronic device will execute the same button function, i.e., the first target function. For example, the virtual button area may include three sub-areas; regardless of which of these three sub-areas the user touches with a single finger, the electronic device will execute the button function corresponding to the power button.
[0079] It's important to note that the virtual button area of electronic devices is typically divided into multiple sub-areas, each corresponding to a single virtual button. Users can then trigger the function of the corresponding virtual button by touching a specific sub-area. For example, the virtual button area might have three sub-areas, corresponding to the volume up, volume down, and power buttons. In such cases, the multiple sub-areas are usually visually distinct to help users quickly identify the corresponding virtual buttons and reduce accidental touches. However, this can also affect the overall aesthetic consistency of the electronic device.
[0080] Therefore, in order to reduce accidental touches by users without compromising the appearance consistency of electronic devices, embodiments of this disclosure can make the button function corresponding to a touch operation performed by a single finger independent of the touch position of the touch operation in the virtual button area. Thus, when a user touches any position in the virtual button area with a single finger, the button function triggered is the same (i.e., the first target function). In this way, even if the various sub-areas of the virtual buttons on the electronic device are not visually distinguishable, accidental touches will not occur.
[0081] In some embodiments, when it is determined that the touch operation is performed by a single finger, the operation type of the touch operation can be determined, and the first target function triggered by the touch operation can be determined based on the operation type. The first target function triggered by the touch operation differs depending on the operation type of the touch operation performed by a single finger.
[0082] In this embodiment, although the first target function triggered by a touch operation performed by a single finger is independent of the position of the touch operation on the virtual button area, the first target function triggered by a touch operation performed by a single finger is related to the type of touch operation. That is, different types of touch operations trigger different first target functions.
[0083] In one embodiment, the touch operation type performed by a single finger may include: pressing, swiping, and / or long-pressing. The first target function triggered by a pressing operation performed by a single finger may be the function of locking or waking the screen; the first target function triggered by a swiping operation performed by a single finger may be the function of adjusting the volume; and the first target function triggered by a long-pressing operation performed by a single finger may be the function of turning the device on or off.
[0084] Therefore, when an electronic device determines that a touch operation is performed by a single finger, it can determine the operation type of the touch operation and, based on the operation type, determine the first target function triggered by the touch operation. This reduces accidental touches without compromising the aesthetic consistency of the electronic device and also enhances the diversity of its touch feedback.
[0085] In step S203, after determining the first target function triggered by the touch operation performed by a single finger, the electronic device can perform the first target function in response to the user's touch operation.
[0086] This embodiment of the disclosure can identify whether a touch operation performed by a single finger or multiple fingers is detected when a user operates on the virtual button area of an electronic device. When it is determined that the touch operation is performed by a single finger, a first target function triggered by the touch operation is determined and executed in response to the user's touch operation. Since the first target function triggered by a touch operation performed by a single finger is independent of the position of the touch operation on the virtual button area, the button function triggered when the user touches any position on the virtual button area with a single finger is the same button function (i.e., the first target function). Thus, even if the virtual buttons of the electronic device are not visually distinguishable, accidental touches will not occur, thereby reducing the impact on the aesthetic consistency of the electronic device.
[0087] In some embodiments, when a touch operation is detected acting on a virtual button area of an electronic device, determining whether the touch operation was performed by a single finger includes:
[0088] Acquire the first sensing data collected by multiple sensors within the virtual button area;
[0089] When it is determined that a first sub-touch operation has been detected based on the first sensing data, second sensing data collected by multiple sensors within a first time range is acquired.
[0090] Based on the second sensor data, determine whether at least one second sub-touch operation is detected while the first sub-touch operation continues to act on the virtual button area;
[0091] Based on the detection results of at least one second sub-touch operation, determine whether the touch operation was performed by a single finger.
[0092] In this embodiment of the disclosure, during the user's use of the electronic device, first sensing data collected by multiple sensors in the virtual button area can be obtained to determine the user's touch behavior on the virtual button area based on the first sensing data.
[0093] After acquiring first sensing data from multiple sensors, it can be determined whether the first sensing data meets the touch operation recognition conditions, thereby determining whether user touch on the virtual button area has been detected. In one embodiment, the electronic device can determine the touch pressure based on the first sensing data; if the touch pressure is greater than a first threshold, it is determined that user touch on the virtual button area has been detected.
[0094] To better illustrate the process by which an electronic device determines whether a touch operation is performed by a single finger, embodiments of this disclosure introduce sub-touch operations. A sub-touch operation can be considered as a touch by a user's finger on a virtual button area. It is understood that a touch operation performed by multiple fingers can be considered as consisting of multiple sub-touch operations simultaneously acting on the virtual button area. A touch operation performed by a single finger can be considered as consisting of a single sub-touch operation acting on the virtual button area.
[0095] Here, the first sub-touch operation can be understood as the operation performed by the first finger (hereinafter referred to as the first finger) that first touches the virtual button area when the user performs a touch operation on the virtual button area. The second sub-touch operation can be understood as the operation performed by the second finger (hereinafter referred to as the second finger) that subsequently touches the virtual button area when the user performs a touch operation on the virtual button area.
[0096] When an electronic device determines that it has detected a first sub-touch operation by a user on a virtual button area based on first sensing data detected by multiple sensors, it can continue to acquire second sensing data collected by multiple sensors within a first time range.
[0097] Here, the first time range can be set according to actual needs, and this embodiment of the disclosure does not limit it. For example, the first time range can be 0.5 seconds or 1 second. The second sensing data collected by multiple sensors within the first time range is used by the electronic device to determine whether a second finger is touching the virtual button area at the same time as the user's first finger touches the virtual button area.
[0098] The electronic device can determine, based on the second sensor data, whether at least one second sub-touch operation is detected while the first sub-touch operation continues to act on the virtual button area, so as to determine, based on the detection result of the second sub-touch operation, whether the detected touch operation is a touch operation performed by a single finger or a touch operation performed by multiple fingers.
[0099] Here, the first sub-touch operation continuing to act on the virtual button area can be understood as the user not withdrawing the first sub-touch operation on the virtual button area, or the user's first finger remaining in contact with the virtual button area.
[0100] Within the first time frame after detecting the first sub-touch operation, if at least one second sub-touch operation is detected while the first sub-touch operation continues to act on the virtual button area, it can be considered that the first sub-touch operation and at least one second sub-touch operation act on the virtual button area simultaneously. That is, the electronic device can determine that the detected touch operation is a touch operation performed by multiple fingers.
[0101] Within a first time frame after detecting a first sub-touch operation, if no second sub-touch operation is detected while the first sub-touch operation continues to act on the virtual button area, or if at least one second sub-touch operation is detected after the first sub-touch operation is released, the electronic device can determine that no second finger touched the virtual button area simultaneously with the user's first finger touching the virtual button area; that is, the detected touch operation was performed by a single finger. It is understood that, in this embodiment, when determining that a first sub-touch operation has been detected based on first sensing data, it continues to acquire second sensing data detected by multiple sensors within a first time frame. Based on the second sensing data, it determines whether at least one second sub-touch operation can be detected while the first sub-touch operation continues to act on the virtual button area, thereby determining whether the touch operation was performed by a single finger. Thus, in the case of identifying touch operations performed by multiple fingers, limiting the time interval between detecting the first and second sub-touch operations within a first time frame satisfies the actual situation of users performing multi-finger touches on the virtual button area, while also reducing erroneous identification of touch operations and improving the user experience.
[0102] In some embodiments, the method further includes:
[0103] If the touch operation is performed by multiple fingers, determine the operation information of the first sub-touch operation and at least one second sub-touch operation;
[0104] Based on the operation information of the first sub-touch operation and at least one second sub-touch operation, a second target function is determined from a plurality of preset combination button functions; wherein, each combination button function corresponds to a combination operation information, and the combination operation information includes the operation information of at least two sub-touch operations; the operation information of at least one sub-touch operation is different in the combination operation information corresponding to different combination button functions;
[0105] Perform the second objective function.
[0106] In this embodiment of the disclosure, when the electronic device determines that the touch operation is performed by multiple fingers, it can determine the operation information of a first sub-touch operation and at least one second sub-touch operation based on the first sensing data and the second sensing data.
[0107] Here, operation information may include, but is not limited to: touch location, touch duration, and / or operation direction.
[0108] For touch operations performed by multiple fingers, electronic devices can be pre-configured with multiple key combinations, each corresponding to a unique operation. This operation information can include information for at least two sub-touch operations. It should be noted that different key combinations will have at least one different sub-touch operation within their corresponding operation information. In other words, each operation uniquely corresponds to a single key combination.
[0109] Here, the combination operation information corresponding to each combination key function can be the system default setting or the user-defined setting, and this embodiment does not limit this.
[0110] In some embodiments, the combined operation information corresponding to the combined button function is composed of a combination of operation information of the same type from at least two sub-touch operations, or it is composed of a combination of operation information of different types from at least two sub-touch operations. For example, the combined operation information corresponding to the combined button function is composed of a combination of the touch positions of at least two sub-touch operations. Another example is that the combined operation information corresponding to the combined button function is composed of the touch positions and touch durations of at least two sub-touch operations.
[0111] In some embodiments, the combined operation information corresponding to different combination button functions can be composed of operation information of different numbers of sub-touch operations. For example, the combined operation information corresponding to combination button function 1 can be composed of operation information of two sub-touch operations, and the combined operation information corresponding to combination button function 2 can be composed of operation information of three sub-touch operations.
[0112] After determining the operation information of a first sub-touch operation and at least one second sub-touch operation, the electronic device can, based on a first combination of information consisting of the operation information of the first sub-touch operation and at least one second sub-touch operation, and the combination operation information corresponding to multiple combination button functions, determine the combination button function matching the first combination information, and identify the combination button function as the second target function triggered by the touch operation performed by multiple fingers. After determining the second target function, the electronic device can execute the second target function in response to the touch operation.
[0113] In this embodiment of the disclosure, for touch operations performed by multiple fingers, the electronic device pre-sets multiple combination button functions and corresponding combination operation information. Since the combination operation information corresponding to the combination button functions can be flexibly combined from the operation information of at least two sub-touch operations, the electronic device can provide users with more button functions without increasing the size of the virtual button area, thereby improving the diversity of the electronic device's touch feedback.
[0114] In some embodiments, the method further includes:
[0115] Based on the first sensor data and the second sensor data, determine the operation type of the first sub-touch operation and at least one second sub-touch operation;
[0116] Based on the operation information of a first sub-touch operation and at least one second sub-touch operation, a second target function is determined from a plurality of preset combination key functions, including at least one of the following:
[0117] If the operation type of the first sub-touch operation and at least one second sub-touch operation is a press operation, the second target function is determined based on the first sub-area of the virtual button area where the first sub-touch operation is applied and the second sub-area of the virtual button area where at least one second sub-touch operation is applied.
[0118] If the operation type of the first sub-touch operation and at least one second sub-touch operation is a sliding operation, the second target function is determined according to the first sliding direction of the first sub-touch operation and the second sliding direction of at least one second sub-touch operation;
[0119] If the operation types of the first sub-touch operation and at least one second sub-touch operation include sliding operation and pressing operation, the second target function is determined according to the target sliding direction of the sliding operation and the target sub-area of the virtual button area where the pressing operation is applied.
[0120] In this embodiment of the disclosure, before determining the second target function, the electronic device may also determine the operation type of the first sub-touch operation and at least one second sub-touch operation based on the first sensing data and the second sensing data.
[0121] Here, the first sub-touch operation or the second sub-touch operation may include multiple sub-touch operations of different operation types, and the recognition conditions corresponding to different operation types of sub-touch operations are different. By determining whether the first sensing data and the second sensing data meet the recognition conditions of multiple different operation types of sub-touch operations, if the first sensing data and the second sensing data meet one of the multiple recognition conditions, the operation type of the detected first sub-touch operation and / or second sub-touch operation can be determined.
[0122] In some embodiments, the touch pressure of the first sub-touch operation applied to the virtual button area can be determined based on the first sensing data and the second sensing data. If the touch pressure applied to the virtual button area is greater than or equal to a first threshold, the detected first sub-touch operation is determined to be a press operation. If the touch pressure applied to the virtual button area is less than the first threshold, the detected first sub-touch operation is determined to be a press operation.
[0123] Similarly, the touch pressure of the second sub-touch operation on the virtual button area can be determined based on the first and second sensor data. If the touch pressure on the virtual button area is greater than or equal to the first threshold, the detected second sub-touch operation is determined to be a press operation. If the touch pressure on the virtual button area is less than the first threshold, the detected second sub-touch operation is determined to be a press operation.
[0124] Here, the first threshold can be set according to actual needs.
[0125] In some embodiments, the position change of the first sub-touch operation on the virtual button area can be determined based on the first sensing data and the second sensing data within a second time range; if the position change of the first sub-touch operation is greater than or equal to a second threshold, it is determined that the detected first sub-touch operation is a sliding operation; if the position change of the first sub-touch operation is less than the second threshold, it is determined that the detected first sub-touch operation is not a sliding operation.
[0126] Similarly, based on the first and second sensor data, the position change of the contact point of the second sub-touch operation on the virtual button area within the second time range can be determined; if the position change of the second sub-touch operation is greater than the second threshold, the detected second sub-touch operation is determined to be a sliding operation; if the position change of the second sub-touch operation is less than the second threshold, the detected second sub-touch operation is determined to be a sliding operation.
[0127] Here, the second threshold can be set according to actual needs.
[0128] The contact point for the first or second sub-touch operation on the virtual button area can be the center point of the contact area where the user's finger contacts the virtual button area.
[0129] In some embodiments, the multiple sensors in the virtual button area can be capacitive sensors. The electronic device can define the coordinates of the virtual button area as a number axis by calibrating the coordinates of the capacitive sensors at different locations. Assume that the length of sliding from the bottom to the top is [0, 100]. The sliding resolution step = 1. When the first sub-touch operation is detected, the position of the contact point of the first sub-touch operation on the virtual button area is recorded as coordinate a0 (a0∈[0,100]), and the coordinates of the contact point of the first sub-touch operation on the virtual button area within the second time range ΔT0 are recorded as x. If the change in position of the contact point of the first sub-touch operation within the second time range exceeds the second threshold Δd0, i.e., x-a0|≥Δd0, it can be determined that the user's first finger has started sliding on the virtual button area, that is, the first sub-touch operation is a sliding operation.
[0130] Similarly, when a second sub-touch operation is detected, the position of the contact point of the second sub-touch operation on the virtual button area is recorded as coordinate b0 (b0∈[0,100]), and the coordinate of the contact point of the second sub-touch operation on the virtual button area within the second time range △T0 is recorded as y. If the change in position of the contact point of the second sub-touch operation within the second time range exceeds the second threshold △d0, i.e. |y-b0|≥△d0, it can be determined that the user's second finger is also sliding on the virtual button area, that is, the second sub-touch operation is a sliding operation.
[0131] After determining the operation type of the first sub-touch operation and at least one second sub-touch operation, if the operation type of the first sub-touch operation and at least one second sub-touch operation are both press operations, the touch position of the first sub-touch operation and at least one second sub-touch operation can be determined.
[0132] In this embodiment, the virtual button area may include multiple sub-regions, each sub-region may correspond to multiple sensors, and the multiple sensors corresponding to different sub-regions are at least partially different. It is understood that the sensor at the connection point of two sub-regions can be used as the sensor corresponding to those two sub-regions.
[0133] The multiple sensors corresponding to a sub-region can be understood as multiple sensors located adjacent to the sub-region. The electronic device can determine the touch position of the first sub-touch operation and the second sub-touch operation based on the first and second sensing data collected by the multiple sensors located adjacent to each sub-region.
[0134] Understandably, multiple sensors in the virtual button area can be pre-numbered, and the relationship between each sub-area and its adjacent sensors can be established based on the location of the multiple sensors and the location of each sub-area in the virtual button area. This allows the touch status of each sub-area to be determined in subsequent processing based on the sensor data collected by the multiple sensors and the relationship between the sub-area and the sensors.
[0135] If, based on the first sensing data and the second sensing data, it is determined that a first sub-touch operation is applied to a first sub-region and at least one second sub-touch operation is applied to a second sub-region, the electronic device can determine a second target function based on the first sub-region and at least one second sub-region.
[0136] It should be noted that, in this embodiment of the present disclosure, for press operations performed by multiple fingers, the combination operation information of multiple combination button functions pre-set by the electronic device is composed of at least two sub-touch operations acting on sub-regions of the virtual button area. The electronic device can determine the matching combination operation information from multiple combination operation information based on the first sub-region and at least one second sub-region, and determine the combination button function corresponding to the matching combination operation information as the second target function.
[0137] In one example, the virtual button area may include three sub-areas: upper, middle, and lower. For a press operation, the operation information and corresponding button functions are shown in Table 1. It is understood that if the touch operation detected by the electronic device is performed by a single finger, and this touch operation is applied to any one of the upper, middle, or lower sub-areas, the touch operation triggers the power button function. If the touch operation detected by the electronic device is performed by multiple fingers, where the first and second sub-touch operations are applied to the upper and middle sub-areas, the touch operation triggers combination button function 1. Where the first and second sub-touch operations are applied to the upper and lower sub-areas, the touch operation triggers combination button function 2. Where the first and second sub-touch operations are applied to the middle and lower sub-areas, the touch operation triggers combination button function 3.
[0138] Table 1
[0139] Touch position Button Functions (Top, Middle) Combination key function 1 (up and down) Combination key function 2 (Middle, Bottom) Combination button function 3 Top or Middle or Bottom Power button function
[0140] If the operation type of the first sub-touch operation and at least one second sub-touch operation is a sliding operation, the sliding direction of the first sub-touch operation and at least one second sub-touch operation can be determined.
[0141] It is understandable that the first sliding direction of the first sub-touch operation and the second sliding direction of at least one second sub-touch operation can be determined based on the change in the position coordinates of the contact points of the first and second sub-touch operations on the virtual button area over time. When the first sliding direction of the first sub-touch operation and the second sliding direction of at least one second sub-touch operation are determined based on the first and second sensor data, the electronic device can determine a second target function based on the first sliding direction and at least one second sliding direction.
[0142] It should be noted that, in this embodiment of the present disclosure, for swipe operations performed by multiple fingers, the combination operation information of multiple pre-set combination button functions of the electronic device is composed of the swiping directions of at least two sub-touch operations in the virtual button area. The electronic device can determine the matching combination operation information from the multiple combination operation information based on the first swiping direction and at least one second swiping direction, and determine the combination button function corresponding to the matching combination operation information as the second target function.
[0143] In one example, for a swipe operation, the operation information and corresponding key functions are shown in Table 2. It can be understood that if the touch operation detected by the electronic device is a swipe operation performed by a single finger, and the swipe direction is a single-finger upward swipe or a single-finger downward swipe, the key function triggered by the swipe operation could be volume up / down or image zoom. If the touch operation detected by the electronic device is a swipe operation performed by multiple fingers, where the first swipe direction and the second swipe direction are upward swipe and downward swipe, the touch operation triggers a combination key function 4. Where the first swipe direction and the second swipe direction are both upward swipes, the touch operation triggers a combination key function 5. Where the first swipe direction and the second swipe direction are both downward swipes, the touch operation triggers a combination key function 6.
[0144] Table 2
[0145] Sliding direction Button Functions (Swipe up, swipe down) Combination key function 4 (swipe up, slide up) Combination key function 5 (Slide, slide) Combination button functions 6 Swipe up with one finger or swipe down with one finger Volume up / down or image zoom function
[0146] If the operation types of the first sub-touch operation and at least one second sub-touch operation include sliding operation and pressing operation, the target sliding direction of the sliding operation in the virtual button area and the target sub-area of the pressing operation in the virtual button area can be determined.
[0147] Here, the first sub-touch operation can be a sliding operation or a pressing operation. Based on this, the second sub-touch operation can be a pressing operation or a sliding operation. That is, the operation type of the first sub-touch operation is different from that of the second sub-touch operation.
[0148] Based on the first and second sensing data, the electronic device determines the target sliding direction of the sliding operation in the first sub-touch operation and at least one second sub-touch operation, and the target sub-area of the pressing operation in the first sub-touch operation and at least one second sub-touch operation, and can determine the second target function based on the target sliding direction and the target sub-area.
[0149] It should be noted that, in this embodiment of the present disclosure, for touch operations performed by multiple fingers, the combination operation information of multiple pre-set combination button functions of the electronic device is composed of the sliding direction and touch position of at least two sub-touch operations in the virtual button area. The electronic device can determine the matching combination operation information from multiple combination operation information according to the target sliding direction and the target sub-area, and determine the combination button function corresponding to the matching combination operation information as the second target function.
[0150] In one example, for a multi-finger touch operation, the two sub-touch operations include a swipe and a press. The combined operation information and corresponding key combinations are shown in Table 3. It can be understood that in the three cases where the target swipe direction is upward and the target sub-areas are upper, middle, and lower, the touch operation triggers key combinations 7 to 9. In the three cases where the target swipe direction is downward and the target sub-areas are upper, middle, and lower, the touch operation triggers key combinations 10 to 12.
[0151] Table 3
[0152] Slide direction, touch position Button Functions (swipe up, up) Combination button functions 7 (swipe up, middle) Combination button functions 8 (Swipe up, swipe down) Combination key functions 9 (Slide down, then up) Combination button functions 10 (Slide, Middle) Combination key function 11 (Slide down) Combination key functions 12
[0153] This disclosure provides different combination operation information and corresponding combination key functions for different operation types of touch operations performed by multiple fingers. This allows for the determination of the combination key function triggered by the touch operation based on the operation information of the user's first sub-touch operation and at least one second sub-touch operation, thereby improving the diversity of touch feedback in electronic devices.
[0154] In some embodiments, determining whether a touch operation is performed by a single finger based on the detection result of at least one second sub-touch operation includes:
[0155] If at least one second sub-touch operation is detected, it is determined that the first sub-touch operation is applied to a first sub-region of the virtual button area, and at least one second sub-touch operation is applied to a second sub-region of the virtual button area; wherein, the virtual button area includes multiple sub-regions;
[0156] If the first sub-region and the second sub-region are different sub-regions of the virtual button area, it is determined that the touch operation is performed by multiple fingers.
[0157] If the first sub-region and the second sub-region are the same sub-region of the virtual button area, it is determined that the touch operation is performed by a single finger.
[0158] In this embodiment of the disclosure, after determining that at least one second sub-touch operation has been detected based on the second sensing data, it can be determined, based on the first sensing data and the second sensing data, that the first sub-touch operation is acting on a first sub-region of the virtual button area and that at least one second sub-touch operation is acting on a second sub-region of the virtual button area.
[0159] The type of touch operation (whether performed by multiple fingers or a single finger) can be determined by whether the first and second sub-regions overlap. If the first and second sub-regions are different sub-regions of the virtual button area, the touch operation can be identified as performed by multiple fingers. If the first and second sub-regions are the same sub-region of the virtual button area, the touch operation can be identified as performed by a single finger.
[0160] In this embodiment of the disclosure, even if it is determined that a second sub-touch operation has been detected based on the second sensing data, it is still necessary to further determine whether the second sub-region acted by the second sub-touch operation is the same as the first sub-region acted by the first sub-touch operation, so as to determine whether the touch operation is a touch operation performed by multiple fingers.
[0161] It's important to note that when a user performs multi-finger touches on the virtual button area of an electronic device, the touch positions of the multiple fingers on the virtual button area are usually different. However, when a user performs a single-finger touch on the virtual button area, due to factors such as grip posture or improper operation, the sensors on the virtual button area may detect both a first and a second sub-touch operation. In this case, the touch positions of the first and second sub-touch operations are very close. To reduce the likelihood of this touch operation being mistakenly identified as a multi-finger touch, the electronic device can, after detecting at least one second sub-touch operation, determine whether the touch operation was performed by multiple fingers by checking whether the second sub-area of the second sub-touch operation is the same as the first sub-area of the first sub-touch operation.
[0162] In some embodiments, if the first sub-region and the second sub-region are the same sub-region of the virtual button area, determining that the touch operation is performed by a single finger includes:
[0163] If the operation type of the first sub-touch operation and at least one second sub-touch operation includes a press operation, and the first sub-region and the second sub-region are the same sub-region of the virtual button area, it is determined that the touch operation is a press operation performed by a single finger.
[0164] In this embodiment of the disclosure, when it is determined from the second sensing data that at least one second sub-touch operation has been detected, and the second sub-region where the second sub-touch operation is applied is the same sub-region of the virtual button area as the first sub-touch operation is applied to the first sub-touch operation, the operation type of the first sub-touch operation and at least one second sub-touch operation can be determined from the first sensing data and the second sensing data.
[0165] If the operation type of the first sub-touch operation and at least one second sub-touch operation includes a press operation, the touch operation can be determined as a press operation performed by a single finger to perform the first target function corresponding to the press operation performed by a single finger.
[0166] Understandably, even if the operation type of the first sub-touch operation and at least one second sub-touch operation also includes a swipe operation, the electronic device will not respond to the swipe operation.
[0167] It should be noted that when users interact with electronic devices, improper grip or operation may cause the sensor to detect swiping and pressing actions within the same sub-area. For example, when a user presses a virtual button area with their first finger, a change in grip may alter the contact point between the finger and the button area, causing the sensor to detect both swiping and pressing actions within the same sub-area. In such cases, the touch action can be identified as a single-finger press, and a single-finger press action can be responded to, reducing the likelihood of incorrect touch operation recognition.
[0168] In some embodiments, the method further includes:
[0169] When a touch operation is detected on the virtual button area, the vibration feedback unit within the virtual button area is controlled to output a vibration wave.
[0170] In this embodiment of the disclosure, when the electronic device detects a user's touch operation on the virtual button area, it outputs a vibration wave through a vibration feedback unit so that the user can clearly perceive that the area currently being touched by the finger is the virtual button area of the electronic device.
[0171] In some embodiments, when the electronic device determines that the touch operation is performed by a single finger, it controls the vibration feedback unit to output a first vibration wave; and / or, when the electronic device determines that the touch operation is performed by multiple fingers, it controls the vibration feedback unit to output a second vibration wave. The first vibration wave and the second vibration wave are different.
[0172] Here, the second vibration wave is different from the first vibration wave. This can be understood as the first vibration wave and the second vibration wave being different in terms of vibration intensity, vibration duration, and / or vibration waveform.
[0173] It should be noted that when an electronic device detects a user's touch operation on the virtual button area, it can determine whether to output a first vibration wave or a second vibration wave based on whether the touch operation is performed by a single finger or multiple fingers. This allows the user to clearly perceive whether the touch operation on the virtual button area has been correctly recognized by the electronic device using two different vibration waves.
[0174] This disclosure also provides an electronic device, such as... Figure 4 As shown, Figure 4 This is a schematic diagram of the structure of an electronic device according to an exemplary embodiment. Figure 1 The electronic device includes:
[0175] The sensor module 401 is fixedly installed in the virtual button area; the sensor module 401 includes multiple sensors 4011 for detecting touch operations applied to the virtual button area;
[0176] The first processing module 402 is connected to the sensor module 401 and is used to determine whether the touch operation is performed by a single finger when the sensor module detects a touch operation.
[0177] The control module 403, connected to the first processing module 402, is used to determine the first target function triggered by the touch operation if the touch operation is performed by a single finger; and to execute the first target function; wherein the first target function is independent of the position of the touch operation on the virtual button area.
[0178] It should be noted that the electronic device shown in the embodiments of this disclosure can be an electronic device including a virtual button area. This electronic device can be a mobile terminal, such as a mobile phone, laptop computer, tablet computer, wearable electronic device, etc. The embodiments of this disclosure do not limit this.
[0179] The electronic device shown in this disclosure can be used to perform the touch feedback method shown in one or more of the above embodiments.
[0180] The electronic device may include a housing, on which a virtual button area may be provided. In some embodiments, the virtual button area may be located on the side frame of the housing. In some embodiments, the virtual button area may be located on the back panel of the housing.
[0181] The electronic device may further include a sensor module, a first processing module, and a control module. The sensor module, first processing module, and control module can be housed within the casing of the electronic device, and the sensor module can be fixedly mounted on the virtual button area. Here, the sensor module can be fixed to the virtual button area by means of bonding, screwing, or other methods.
[0182] The sensor module may include multiple sensors. In some embodiments, the sensors may be pressure sensors, capacitive sensors, and / or ultrasonic sensors, etc. It is understood that if the sensor is a capacitive sensor, the capacitance value sensed by the capacitive sensor at the contact point will change when a user's finger touches the virtual button area. Alternatively, if the sensor is a pressure sensor, the pressure value sensed by the pressure sensor at the contact point will increase when a user's finger touches the virtual button area. Thus, the sensor module can be used to detect user touch operations on the virtual button area.
[0183] The first processing module is connected to the sensor module. The first processing module can acquire the sensing data detected by the sensor module, and determine whether the touch operation is performed by a single finger when the user's touch operation on the virtual button area is detected based on the sensing data detected by the sensor module.
[0184] The control module is connected to the first processing module. When the first processing module determines that the touch operation is performed by a single finger, the control module determines the first target function triggered by the touch operation and executes the first target function to complete the response to the touch operation.
[0185] It is worth noting that, in this embodiment, the first target function triggered by a touch operation performed by a single finger is independent of the location of the touch operation on the virtual button area. It is understood that when the first processing module determines, based on sensing data detected by the sensor module, that a user has touched any location on the virtual button area with a single finger, the first processing module can send a first signal to the control module so that the control module knows that the currently detected touch operation was performed by a single finger. At this time, the control module can directly determine the first target function triggered by the touch operation without needing to obtain the location information of the touch operation on the virtual button area.
[0186] In this way, even if the virtual buttons on an electronic device are not visually distinguishable, accidental touches will not occur, thus reducing the impact on the consistency of the electronic device's appearance.
[0187] In some embodiments, the virtual button area includes at least two sub-areas;
[0188] The first processing module includes: at least two signal ports; the at least two signal ports correspond to at least two sub-regions respectively; the first processing module is connected to the control module through the at least two signal ports.
[0189] When the first processing module determines that the detected touch operation is a single-finger press operation, the first processing module controls the first signal port to output a low-level signal. The low-level signal output by the first signal port is used to trigger the control module to determine the first target function and execute the first target function. The first signal port is associated with the sub-region corresponding to the first target function.
[0190] When the first processing module determines that the detected touch operation is a multi-finger press operation, the first processing module controls at least two second signal ports to output low-level signals; the low-level signals output by the at least two second signal ports are used to trigger the control module to determine the second target function and execute the second target function. The second signal ports are associated with sub-regions of the virtual button area where the touch operation occurs.
[0191] In this embodiment, the signal port can be a general-purpose input / output port (GPIO). The virtual button area of the electronic device can include at least two sub-regions. Correspondingly, the first processing module can set at least two signal ports, with each signal port corresponding to a sub-region. Thus, when the first processing module determines that it has detected multiple finger presses by the user on the virtual button area, it can output low-level signals using the signal ports corresponding to the multiple sub-regions pressed by the user. This allows the control module to determine the user's press position and the number of fingers on the virtual button area, thereby determining the second target function.
[0192] In one example, the first processing module may include three signal ports: FUNC2, FUNC1, and PWR, corresponding to the upper, middle, and lower sub-regions of the virtual button area, respectively. When the first processing module determines, based on the first sensing data detected by the sensor module, that the middle sub-region of the virtual button area has been pressed, it can maintain the FUNC1 port outputting a high-level signal while simultaneously starting a timer. The first processing module acquires the second sensing data collected by the sensor module within the first time range indicated by the timer and determines, based on the second sensing data, whether a user press on another sub-region of the virtual button area has been detected.
[0193] If the first processing module determines, based on the second sensor data, that a press on the middle sub-region of the virtual button area has not been released and detects a press on the upper sub-region of the virtual button area, the first processing module can control both ports FUNC1 and FUNC2 to simultaneously output low-level signals. This allows the control module to identify the combination key function of FUNC1 and FUNC2 as the second target function and execute it. After determining that the user has released the press on both the middle and upper sub-regions, the first processing module can control both ports FUNC1 and FUNC2 to resume outputting high-level signals. Figure 5 As shown, Figure 5 This is a schematic diagram of the output signal of a signal port of a first processing module according to an exemplary embodiment. Figure 1 .
[0194] If the first processing module determines, based on the second sensor data, that no press was detected on other sub-areas, the first processing module can control the FUNC1 port to continue outputting a high-level signal and control the PWR port to output a low-level signal, so that the control module can determine the button function of PWR as the first target function and execute the first target function. Figure 6 As shown, Figure 6 This is a schematic diagram of the output signal of a signal port of a first processing module according to an exemplary embodiment. Figure 2 .
[0195] When a user releases a press on the virtual button area, whether the press affects multiple sub-areas or a single sub-area, the corresponding signal output port will be pulled high. A second press detection can only begin after all sub-areas of the virtual button area have been released.
[0196] Here, the timer starts after the first valid press is detected and stops when the time exceeds a first time range or when a combined press targeting multiple sub-areas is detected within the first time range.
[0197] In some embodiments, the sensor module includes:
[0198] The first sensing layer is located close to the virtual button area. The first sensing layer includes multiple capacitive sensors, which are arranged along the length of the virtual button area.
[0199] The second sensing layer is stacked on top of the first sensing layer. The second sensing layer includes multiple pressure sensors arranged along the length of the virtual button area.
[0200] In this embodiment, the sensor module may include a first sensing layer and a second sensing layer. The first and second sensing layers are stacked. Furthermore, the first sensing layer is closer to the virtual button area than the second sensing layer.
[0201] The first sensing layer may include multiple capacitive sensors, which are arranged along the length of the virtual button area. The second sensing layer may include multiple pressure sensors, which are also arranged along the length of the virtual button area.
[0202] It should be noted that the first sensing layer of the sensor module can be attached to the side frame of the electronic device. Furthermore, since the sensor in the first sensing layer is a capacitive sensor in this embodiment, to ensure the normal operation of the capacitive sensor, the side frame where the first sensing layer is attached must be a non-metallic side frame. For example... Figure 7 As shown, Figure 7 This is a schematic diagram illustrating a connection method between a sensor module and a virtual button area according to an exemplary embodiment.
[0203] After the sensor module is fixedly installed in the virtual button area, the touch status of each sub-area of the virtual button area can be detected by the corresponding capacitive and / or pressure sensors of that sub-area. Thus, the first processing module can determine the user's touch position in the virtual button area and the number of fingers the user uses to touch the virtual button area based on the sensing data detected by the capacitive and / or pressure sensors at various locations in the sensor module.
[0204] The multiple sensors corresponding to a sub-region can be understood as multiple sensors placed adjacent to the sub-region. In one example, such as... Figure 8 As shown, Figure 8 This is a schematic diagram illustrating the correspondence between a sensor module and a virtual button area according to an exemplary embodiment. The virtual button area may include three sub-regions: upper, middle, and lower. Capacitive sensors and pressure sensors disposed adjacent to each sub-region in the sensor module can be considered as the sensors corresponding to that sub-region.
[0205] In one embodiment, the number of capacitive sensors in the first sensing layer is greater than the number of pressure sensors in the second sensing layer. For example, such as Figure 9 As shown, Figure 9 This is a schematic diagram of a sensor module according to an exemplary embodiment. The first sensing layer may include nine capacitive sensors (CAP1 to CAP9), and the second sensing layer may include five pressure sensors (pressure sensors 1 to 5).
[0206] During the use of electronic devices, the touch position and number of fingers touched by the user when navigating the virtual button area can be determined by the capacitance values detected by the various capacitive sensors in the first sensing layer. Furthermore, when the user presses the virtual button area, the distribution of touch pressure detected by the various pressure sensors in the second sensing layer can also be used to determine the user's pressing position and the number of fingers in the virtual button area. This achieves accurate detection of touch activity in the virtual button area.
[0207] In some embodiments, the electronic device further includes:
[0208] The second processing module is connected to the first processing module and is used to control the first processing module to perform a reset operation when a fault is detected in the first processing module.
[0209] In this embodiment of the electronic device, a second processing module is further included, which is connected to the first processing module. The second processing module can be used to detect the operating status of the first processing module and, when a fault is detected in the first processing module, output a reset signal to the first processing module to control the first processing module to perform a reset operation.
[0210] It should be noted that the control module of the electronic device determines the corresponding button function and executes it based on the signal output from the first processing module. If the first processing module malfunctions, for example, if it crashes, the sensor module may detect the user's touch operation on the virtual button area. However, because the first processing module cannot output the corresponding signal to the control module in a timely manner, the electronic device will not respond to the user's touch operation, affecting the user's use of the electronic device. In this case, the second processing module can output a reset signal to the first processing module, causing the first processing module to perform a reset operation. This effectively improves the stability of the electronic device's touch feedback.
[0211] In some embodiments, the electronic device further includes:
[0212] The first power supply module is connected to the sensor module, the first processing module, and the second processing module, and is used to supply power to the sensor module, the first processing module, and the second processing module when the electronic device is in a powered-off state.
[0213] In this embodiment of the disclosure, the electronic device further includes a first power supply module, which is connected to the sensor module, the first processing module, and the second processing module. The first power supply module can supply power to the sensor module, the first processing module, and the second processing module when the electronic device is in a powered-off state.
[0214] It should be noted that electronic devices may also include a second power supply module. Normally, when the electronic device is powered off, the user presses the power button to connect the second power supply module to the control module, thus starting the electronic device's operating system.
[0215] However, since the electronic device in this embodiment uses a virtual button area instead of physical buttons, and the electronic device's response to the user's touch operation on the virtual button area requires the participation of the sensor module and the first processing module, when the electronic device is powered off, the sensor module and the first processing module cannot function properly due to the lack of power signal input, and therefore cannot detect the user's touch on the virtual button area. Based on this, the user cannot activate the electronic device by pressing the virtual button area.
[0216] Therefore, when the electronic device is powered off, the first power supply module is needed to power the sensor module and the first processing module, so that the sensor module and the first processing module can still detect and respond to the user's touch operation on the virtual button area even when the electronic device is powered off.
[0217] Furthermore, by using the first power supply module to power the second processing module, the second processing module can maintain monitoring of the operating status of the first processing module when the electronic device is powered off, so as to control the first processing module to perform a reset operation when the first processing module malfunctions.
[0218] In some embodiments, the electronic device further includes:
[0219] A vibration feedback unit is located in the virtual button area;
[0220] A vibration drive module, connected to the first processing module and the vibration feedback unit, is used to control the vibration feedback unit within the virtual button area to output vibration waves when the first processing module determines that a touch operation acting on the virtual button area has been detected.
[0221] In this embodiment of the disclosure, the electronic device further includes a vibration feedback unit and a vibration drive module.
[0222] In some embodiments, the vibration feedback unit may be a linear motor, a rotor motor, or a piezoelectric ceramic, etc. The electronic device may provide a separate vibration feedback unit for the virtual button area, or it may reuse an existing vibration feedback unit to achieve vibration feedback for the virtual button area.
[0223] The vibration drive module is connected to the vibration feedback unit and is used to drive the vibration feedback unit to output vibration waves.
[0224] The vibration drive module is also connected to the first processing module. When the first processing module determines that it has detected a user's touch operation on the virtual button area, it can send a control signal to the vibration drive module, so that the vibration drive module drives the vibration feedback unit to output vibration waves, thereby using the vibration waves to allow the user to clearly perceive that the area currently being touched by the finger is the virtual button area of the electronic device.
[0225] In some embodiments, when the first processing module determines that the detected touch operation is performed by a single finger, it can send a first control signal to the vibration driving module, causing the vibration driving module to drive the vibration feedback unit to output a first vibration wave. When the first processing module determines that the detected touch operation is performed by multiple fingers, it can send a second control signal to the vibration driving module, causing the vibration driving module to drive the vibration feedback unit to output a second vibration wave.
[0226] Here, the second vibration wave is different from the first vibration wave. This can be understood as the first vibration wave and the second vibration wave being different in terms of vibration intensity, vibration duration, and / or vibration waveform.
[0227] After determining whether the touch operation is a single-finger or multi-finger touch operation, the first processing module can control the vibration drive module to output a first vibration wave or a second vibration wave through the vibration feedback unit. This allows the user to clearly perceive whether the current touch operation on the virtual button area has been correctly recognized by the electronic device.
[0228] In one example, such as Figure 10 As shown, Figure 10 This is a schematic diagram of the structure of an electronic device according to an exemplary embodiment. Figure 2 The electronic devices include: sensor module, MCU, main system module, vibration drive module, and vibration feedback unit.
[0229] The sensor module can convert external pressing and sliding operations on the virtual button area into electrical signals and transmit them to the MCU.
[0230] The MCU can detect the signals output by the sensor module and, based on algorithms, identify whether the operation is performed by a single finger or multiple fingers, and determine whether it is a pressing, half-pressing, or sliding operation. It then provides relevant data to the main system module based on the corresponding operation, and provides necessary control information to the vibration drive module.
[0231] In some embodiments, if the sensor module outputs an analog signal, the MCU also needs to convert the analog signal into a digital signal.
[0232] The main system module may include conventional components found in electronic devices and possesses the conventional functions of electronic devices. In this embodiment, the main system module primarily processes information provided by the MCU related to pressing, half-pressing, or sliding operations, and implements corresponding control and feedback.
[0233] The vibration drive module and vibration feedback unit can provide the necessary tactile feedback when the user touches the virtual button area.
[0234] PWR, FUNC1, and FUNC2 are used by the MCU to simulate physical button operations by pulling up or down the corresponding GPIO pins after recognizing the pressed state of each sub-area of the virtual button area. PWR represents the power button, while FUNC1 and FUNC2 represent other buttons, such as volume up and down buttons.
[0235] Communication lines: including I2C, GPIO, reset, and other signals required to ensure normal system operation.
[0236] The GPIO from the MCU to the vibration drive module is used to trigger the vibration drive module to drive the vibration feedback unit to vibrate according to the waveform stored inside it when the MCU recognizes a press. This achieves timely feedback of the press operation.
[0237] In some embodiments, such as Figure 11 As shown, Figure 11 This is a schematic diagram of the structure of an electronic device according to an exemplary embodiment. Figure 3 Since the power button for turning the device on and off is also implemented through a virtual button, the hardware design of electronic devices needs to ensure that the devices can work reliably even when they are turned off.
[0238] This disclosure provides an embodiment that adds an Always-ON power supply system, thereby ensuring that the electronic device can still respond to the user's touch of the corresponding virtual button and generate corresponding vibration feedback even when the electronic device is powered off.
[0239] Furthermore, this embodiment of the invention also includes a reset control circuit to ensure that the MCU system can be reset and restored even when it crashes, thereby ensuring normal touch response to the virtual button area.
[0240] Regarding the apparatus in the above embodiments, the specific manner in which each module performs its operation has been described in detail in the embodiments related to the method, and will not be elaborated upon here.
[0241] Figure 12This is a structural block diagram of an electronic device according to an exemplary embodiment. For example, the electronic device 1200 may be a mobile phone, computer, digital broadcasting terminal, messaging device, game console, tablet device, medical device, fitness equipment, personal digital assistant, etc.
[0242] Reference Figure 12 The electronic device 1200 may include one or more of the following components: processing component 1202, memory 1204, power supply component 1206, multimedia component 1208, audio component 1210, input / output (I / O) interface 1212, sensor component 1214, and communication component 1216.
[0243] Processing component 1202 typically controls the overall operation of electronic device 1200, such as operations associated with at least one of display, telephone call, data communication, camera operation, and recording operation. Processing component 1202 may include one or more processors 1220 to execute instructions to perform all or part of the steps of the methods described above. Furthermore, processing component 1202 may include one or more modules to facilitate interaction between processing component 1202 and other components. For example, processing component 1202 may include a multimedia module to facilitate interaction between multimedia component 1208 and processing component 1202.
[0244] Memory 1204 is configured to store various types of data to support operation on electronic device 1200. Examples of such data include at least one of the following: instructions for any application or method operating on electronic device 1200, contact data, phonebook data, messages, pictures, and videos. Memory 1204 can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as Static Random Access Memory (SRAM), Electrically Erasable Programmable Read-Only Memory (EEPROM), Erasable Programmable Read-Only Memory (EPROM), Programmable Read Only Memory (PROM), Read-Only Memory (ROM), magnetic storage, flash memory, magnetic disk, or optical disk.
[0245] Power supply component 1206 provides power to various components of electronic device 1200. Power supply component 1206 may include at least one of the following: a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power to electronic device 1200.
[0246] Multimedia component 1208 includes a screen that provides an output interface between electronic device 1200 and the user. In some embodiments, the screen may include a Liquid Crystal Display (LCD) and a Touch Panel (TP). If the screen includes a Touch Panel, the screen may be implemented as a touchscreen to receive input signals from the user. The Touch Panel includes one or more touch sensors to sense touches, swipes, and gestures on the Touch Panel. The touch sensors may sense not only the boundaries of touch or swipe actions but also the duration and pressure associated with the touch or swipe operation. In some embodiments, multimedia component 1208 includes a front-facing camera and / or a rear-facing camera. When electronic device 1200 is in an operating mode, such as a shooting mode or a video mode, the front-facing camera and / or rear-facing camera may receive external multimedia data. Each front-facing camera and rear-facing camera may be a fixed optical lens system or have focal length and optical zoom capabilities.
[0247] Audio component 1210 is configured to output and / or input audio signals. For example, audio component 1210 includes a microphone (MIC) configured to receive external audio signals when electronic device 1200 is in an operating mode, such as call mode, recording mode, and voice recognition mode. The received audio signals may be further stored in memory 1204 or transmitted via communication component 1216. In some embodiments, audio component 1210 also includes a speaker for outputting audio signals.
[0248] I / O interface 1212 provides an interface between processing component 1202 and peripheral interface modules, such as keyboards, click wheels, and buttons. These buttons may include, but are not limited to, home buttons, volume buttons, power buttons, and lock buttons.
[0249] Sensor assembly 1214 includes one or more sensors for providing state assessments of various aspects of electronic device 1200. For example, sensor assembly 1214 may detect the on / off state of electronic device 1200, the relative positioning of components such as the display and keypad of electronic device 1200, changes in position of electronic device 1200 or one of its components, the presence or absence of user contact with electronic device 1200, orientation or acceleration / deceleration of electronic device 1200, and temperature changes of electronic device 1200. Sensor assembly 1214 may include a proximity sensor configured to detect the presence of nearby objects without any physical contact. Sensor assembly 1214 may also include an optical sensor, such as a complementary metal-oxide-semiconductor (CMOS) or charge-coupled device (CCD) image sensor, for use in imaging applications. In some embodiments, sensor assembly 1214 may also include, but is not limited to, at least one of the following: an accelerometer, a gyroscope, a magnetometer, a pressure sensor, and a temperature sensor.
[0250] Communication component 1216 is configured to facilitate wired or wireless communication between electronic device 1200 and other devices. Electronic device 1200 can access wireless networks based on communication standards, such as Wi-Fi, 4G, 5G, or combinations thereof. In one exemplary embodiment, communication component 1216 receives broadcast signals or broadcast-related information from an external broadcast management system via a broadcast channel. In one exemplary embodiment, communication component 1216 also includes a Near Field Communication (NFC) module to facilitate short-range communication. For example, the NFC module may be implemented based on Radio Frequency Identification (RFID), Infrared Data Association (IrDA), Ultra Wide Band (UWB), Bluetooth (BT), and other technologies.
[0251] In an exemplary embodiment, the electronic device 1200 may be implemented by one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field-programmable gate arrays (FPGAs), controllers, microcontrollers, microprocessors, or other electronic components.
[0252] In an exemplary embodiment, a non-transitory computer-readable storage medium including instructions is also provided, such as a memory 1204 including executable instructions or a computer program, which can be executed by a processor 1220 of an electronic device 1200 to perform the above-described method. For example, the non-transitory computer-readable storage medium may be a ROM, random access memory (RAM), a compact disc read-only memory (CD-ROM), magnetic tape, floppy disk, and optical data storage device, etc.
[0253] A non-transitory computer-readable storage medium, when instructions in the storage medium are executed by a processor of a mobile terminal, enables the mobile terminal to perform any of the touch feedback methods described in the embodiments of this disclosure. For example, the method includes:
[0254] When a touch operation is detected on the virtual button area of an electronic device, it is determined whether the touch operation was performed by a single finger;
[0255] If the touch operation is performed by a single finger, determine the first target function triggered by the touch operation; wherein, the first target function is independent of the position of the touch operation on the virtual button area;
[0256] Perform the first objective function.
[0257] This disclosure provides a computer program product comprising a computer program or executable instructions stored in a computer-readable storage medium. A processor of a computer device reads the computer program or executable instructions from the computer-readable storage medium and executes the computer program or executable instructions, causing the computer device to perform any of the touch feedback methods described above in this disclosure.
[0258] Other embodiments of this disclosure will readily occur to those skilled in the art upon consideration of the specification and practice of the invention disclosed herein. This disclosure is intended to cover any variations, uses, or adaptations of this disclosure that follow the general principles of this disclosure and include common knowledge or customary techniques in the art not disclosed herein. The specification and examples are to be considered exemplary only, and the true scope and spirit of this disclosure are indicated by the claims.
[0259] It should be understood that this disclosure is not limited to the precise structures described above and shown in the accompanying drawings, and various modifications and changes can be made without departing from its scope. The scope of this disclosure is limited only by the appended claims.
Claims
1. A tactile feedback method, characterized in that, include: When a touch operation is detected on the virtual button area of an electronic device, it is determined whether the touch operation was performed by a single finger; If the touch operation is performed by a single finger, determine the first target function triggered by the touch operation; wherein, the first target function is independent of the position of the touch operation on the virtual button area; Perform the first target function.
2. The method according to claim 1, characterized in that, When a touch operation is detected on the virtual button area of an electronic device, determining whether the touch operation is performed by a single finger includes: Acquire first sensing data collected by multiple sensors within the virtual button area; When it is determined that a first sub-touch operation has been detected based on the first sensing data, the second sensing data collected by the plurality of sensors within a first time range is acquired; Based on the second sensing data, determine whether at least one second sub-touch operation is detected when the first sub-touch operation continues to act on the virtual button area; Based on the detection results of the at least one second sub-touch operation, it is determined whether the touch operation is performed by a single finger.
3. The method according to claim 2, wherein, The method further includes: If the touch operation is performed by multiple fingers, determine the operation information of the first sub-touch operation and the at least one second sub-touch operation; Based on the operation information of the first sub-touch operation and the at least one second sub-touch operation, a second target function is determined from a plurality of preset combination button functions; wherein, each combination button function corresponds to a combination operation information, and the combination operation information includes operation information of at least two sub-touch operations; the operation information of at least one sub-touch operation is different in the combination operation information corresponding to different combination button functions; Perform the second target function.
4. The method according to claim 3, wherein, The method further includes: Based on the first sensing data and the second sensing data, determine the operation type of the first sub-touch operation and the at least one second sub-touch operation; The operation information based on the first sub-touch operation and the at least one second sub-touch operation determines the second target function from a plurality of preset combination key functions, including at least one of the following: If the operation type of the first sub-touch operation and the at least one second sub-touch operation are both press operations, the second target function is determined based on the first sub-region of the virtual button area where the first sub-touch operation is applied and the at least one second sub-touch operation where the at least one second sub-touch operation is applied. If the operation type of the first sub-touch operation and the at least one second sub-touch operation are both sliding operations, the second target function is determined according to the first sliding direction of the first sub-touch operation and the second sliding direction of the at least one second sub-touch operation; If the operation types of the first sub-touch operation and the at least one second sub-touch operation include the sliding operation and the pressing operation, the second target function is determined according to the target sliding direction of the sliding operation and the target sub-area of the pressing operation acting on the virtual button area.
5. The method according to any one of claims 2 to 4, wherein, Determining whether the touch operation is performed by a single finger based on the detection result of the at least one second sub-touch operation includes: If the at least one second sub-touch operation is detected, it is determined that the first sub-touch operation is applied to a first sub-region of the virtual button area, and the at least one second sub-touch operation is applied to a second sub-region of the virtual button area; wherein, the virtual button area includes multiple sub-regions; If the first sub-region and the second sub-region are different sub-regions of the virtual button area, it is determined that the touch operation is performed by multiple fingers. If the first sub-region and the second sub-region are the same sub-region of the virtual button area, it is determined that the touch operation is performed by a single finger.
6. The method according to claim 5, wherein, If the first sub-region and the second sub-region are the same sub-region of the virtual button area, determining that the touch operation is performed by a single finger includes: If the operation type of the first sub-touch operation and the at least one second sub-touch operation includes a press operation, and the first sub-region and the second sub-region are the same sub-region of the virtual button area, it is determined that the touch operation is a press operation performed by a single finger.
7. An electronic device, characterized in that, The electronic device includes a virtual button area, and further includes a sensor module fixedly disposed in the virtual button area; the sensor module includes multiple sensors for detecting touch operations applied to the virtual button area; A first processing module, connected to the sensor module, is used to determine whether the touch operation is performed by a single finger when the sensor module detects the touch operation. A control module, connected to a first processing module, is used to determine a first target function triggered by the touch operation if the touch operation is performed by a single finger; and to execute the first target function; wherein the first target function is independent of the position of the touch operation on the virtual button area.
8. The electronic device according to claim 7, characterized in that, The sensor module includes: A first sensing layer is located near the virtual button area. The first sensing layer includes multiple capacitive sensors arranged along the length direction of the virtual button area. A second sensing layer is stacked on top of the first sensing layer. The second sensing layer includes a plurality of pressure sensors arranged along the length of the virtual button area.
9. The electronic device according to claim 8, characterized in that, The electronic device also includes: The second processing module is connected to the first processing module and is used to control the first processing module to perform a reset operation when a fault is detected in the first processing module.
10. The electronic device according to claim 9, characterized in that, The electronic device also includes: A first power supply module is connected to the sensor module, the first processing module, and the second processing module, and is used to supply power to the sensor module, the first processing module, and the second processing module when the electronic device is in a powered-off state.
11. A non-transitory computer-readable storage medium storing a computer program or instructions, characterized in that, When the computer program or instructions in the storage medium are executed by a processor, the steps of the method according to any one of claims 1 to 6 are implemented.
12. A computer program product, comprising a computer program or instructions, characterized in that, When the computer program or instructions are executed by a processor, they implement the steps of the method according to any one of claims 1 to 6.