Tactile feedback method and apparatus for virtual key, device and storage medium
By detecting the operation status data of the virtual key and selecting an appropriate haptic feedback strategy, the problem that virtual keys cannot bring real haptic feedback is solved, achieving blind operation and a better user experience.
Patent Information
- Application Number
- PCT/CN2023/135058
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2023-11-29
- Publication Date
- 2025-06-05
AI Technical Summary
Virtual keys cannot bring real haptic feedback, resulting in the inability to achieve blind operations and poor user experience.
By detecting the key operation status data, determining the key operation type, and selecting the corresponding haptic feedback strategy according to the type, the actuator is controlled to perform vibration feedback to simulate the real key operation experience.
The tactile feedback of virtual buttons is realized, allowing users to locate and identify virtual buttons, thereby achieving blind operations and improving user operation experience.
Smart Images

Figure CN2023135058_05062025_PF_FP_ABST
Abstract
Description
A tactile feedback method, device, equipment and storage medium for virtual keys Technical Field
[0001] The present application relates to the field of tactile feedback technology, and in particular to a tactile feedback method, device, equipment and storage medium for virtual keys. Background Art
[0002] Mechanical keyboards typically allow users to type blindly based on the layout of the main keys, particularly the 26 most commonly used English letters, and the sense of touch, making them popular for fast input. However, with the development of smart interfaces, virtual keyboards are widely used in electronic devices, especially mobile devices. However, because virtual keyboards lack the authentic tactile feedback of mechanical keyboards, blind typing is not possible, resulting in a poor user experience. Technical issues
[0003] The main purpose of this application is to provide a tactile feedback method, device, equipment and storage medium for virtual keys, which can at least solve the problem in the related art that virtual keys cannot bring real tactile feedback, resulting in the inability to achieve blind operation. Technical Solutions
[0004] To achieve the above-mentioned objectives, the first aspect of the present application provides a tactile feedback method for a virtual key, which is applied to an electronic device, wherein the electronic device includes an actuator, and the tactile feedback method for the virtual key includes: detecting corresponding key operation status data in response to a key operation event; determining a corresponding key operation type based on the key operation status data; wherein the key operation type includes: key tapping operation, key surface touch operation, and key edge touch operation; selecting a corresponding tactile feedback strategy based on the key operation type and the key operation status data; wherein the tactile feedback strategy includes a tactile feedback mode and a tactile feedback attribute corresponding to the tactile feedback mode; and controlling the actuator to enter a corresponding vibration working state according to the tactile feedback strategy.
[0005] According to a second aspect of the present application, there is provided a tactile feedback device for a virtual key, which includes: a detection module for detecting corresponding key operation status data in response to a key operation event; a determination module for determining a corresponding key operation type based on the key operation status data; wherein the key operation type includes: key tapping operation, key surface touch operation, and key edge touch operation; a selection module for selecting a corresponding tactile feedback strategy based on the key operation type and the key operation status data; wherein the tactile feedback strategy includes a tactile feedback mode and a tactile feedback attribute corresponding to the tactile feedback mode; and a control module for controlling an actuator to enter a corresponding vibration working state according to the tactile feedback strategy.
[0006] The third aspect of the present application provides an electronic device, comprising: an actuator, a memory and a processor, wherein the processor is used to execute a computer program stored in the memory. When the processor executes the computer program, it implements the steps of the tactile feedback method for virtual keys provided in the first aspect of the present application.
[0007] The fourth aspect of the present application provides a computer-readable storage medium having a computer program stored thereon. When the computer program is executed by a processor, the steps of the tactile feedback method for virtual keys provided in the first aspect of the present application are implemented. Beneficial effects
[0008] As can be seen from the above, according to the tactile feedback method, device, equipment and storage medium of the virtual key provided by the scheme of the present application, in response to the key operation event, the corresponding key operation status data is detected; the corresponding key operation type is determined according to the key operation status data; wherein the key operation type includes: key tapping operation, key surface touch operation, key edge touch operation; according to the key operation type and the key operation status data, the corresponding tactile feedback strategy is selected; wherein the tactile feedback strategy includes the tactile feedback mode and the tactile feedback attribute corresponding to the tactile feedback mode; according to the tactile feedback strategy, the actuator is controlled to enter the corresponding vibration working state. Through the implementation of the scheme of the present application, according to the user's key operation event type and the key operation status data, the corresponding tactile feedback strategy is selected for tactile feedback, so that the user can locate and identify the virtual key, thereby realizing blind operation and improving the user operation experience. BRIEF DESCRIPTION OF THE DRAWINGS
[0009] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the following briefly introduces the drawings required for use in the embodiments or the description of the prior art. Obviously, the drawings described below are only some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without paying any creative work.
[0010] FIG1 is a schematic structural diagram of an electronic device provided in a first embodiment of the present application;
[0011] FIG2 is a schematic diagram of the basic flow of a tactile feedback method for a virtual key provided in the first embodiment of the present application;
[0012] FIG3 is a schematic diagram of a key operation position division provided by the first embodiment of the present application;
[0013] FIG4 is a schematic diagram of a detailed flow chart of a tactile feedback method for a virtual key provided in a second embodiment of the present application;
[0014] FIG5 is a schematic structural diagram of a tactile feedback system for virtual keys provided in a second embodiment of the present application;
[0015] FIG6 is a module diagram of a tactile feedback device for a virtual key provided in a third embodiment of the present application;
[0016] FIG7 is a schematic structural diagram of an electronic device provided in the fourth embodiment of the present application. Modes for Carrying Out the Invention
[0017] In order to make the purpose, features, and advantages of the invention of this application more obvious and easy to understand, the technical solutions in the embodiments of this application will be clearly and completely described below in conjunction with the drawings in the embodiments of this application. Obviously, the described embodiments are only part of the embodiments of this application, not all embodiments. Based on the embodiments in this application, all other embodiments obtained by those skilled in the art without making creative efforts shall fall within the scope of protection of this application.
[0018] In addition, the terms "first" and "second" are used for descriptive purposes only and should not be understood as indicating or implying relative importance or implicitly indicating the number of the technical features indicated. Therefore, a feature defined as "first" or "second" may explicitly or implicitly include one or more of the features. In the description of the embodiments of this application, the meaning of "plurality" is two or more, unless otherwise clearly specified.
[0019] In order to solve the problem in the related art that virtual keys cannot provide real tactile feedback, resulting in the inability to achieve blind operation, the first embodiment of the present application provides a tactile feedback method for virtual keys, which is applied to electronic devices. Figure 1 is a structural schematic diagram of an electronic device provided by this embodiment, and the electronic device includes an actuator. The number of actuators in this embodiment is at least one, and the actuator can be a deflection mass motor (ERM), a linear resonant actuator (LRA), or a piezoelectric actuator (Piezo). Figure 2 is a basic flow diagram of the tactile feedback method for virtual keys provided by this embodiment. The tactile feedback method for virtual keys includes the following steps:
[0020] Step 201: In response to a key operation event, detect corresponding key operation status data.
[0021] Specifically, in this embodiment, after the virtual keyboard is called up in response to the user's operation instruction, the user's key operation events are monitored in real time through sensors. When the user's key operation is detected, the relevant key operation status data of the key operation event is obtained, and analysis and processing are performed based on these key operation status data; wherein, the virtual keyboard in this embodiment is correspondingly provided with multiple different types of sensors, and the key operation status data is the data detected by each type of sensor, and the key operation status data can be analog data or digital data.
[0022] Step 202: Determine the corresponding key operation type according to the key operation status data.
[0023] Specifically, in this embodiment, after receiving the relevant key operation status data of the key operation event uploaded by the sensor, an evaluation and analysis can be performed based on these key operation status data to determine the user's key operation type, wherein the key operation type can include tapping operations on virtual keys, surface sliding touch operations on virtual keys, and touch operations on the edge of keys when the finger leaves the virtual keyboard or just touches the keyboard, according to the common usage forms of user blind operations.
[0024] In some implementations of this embodiment, the step of determining the corresponding key operation type based on the key operation status data includes: matching multiple types of key operation status data with the preset indicator threshold range of the corresponding type to obtain multiple valid key operation status data; wherein the key operation status data includes: key operation pressure data, key operation position data, and key operation displacement data; and determining the key operation type based on the target key operation status data in the multiple valid key operation status data.
[0025] Specifically, in this embodiment, the sensors provided may be pressure sensors, displacement sensors, acceleration sensors, acoustic wave sensors, position sensors, etc., and these sensors are used to detect key operation status data. Since the status data corresponding to some key operation types are relatively small, they can be ignored. For example, when the key operation type is a key tapping operation, the data detected by the displacement sensor is relatively small and can be ignored. In addition, some sensors may be in an abnormal working state, and the data detected by the sensor in the abnormal working state is also ignored accordingly. Therefore, this embodiment performs a screening operation on the data uploaded by each sensor, thereby reducing the workload of data processing and improving the accuracy of data processing. Specifically, each type of key operation status data can be matched with an indicator threshold range of the corresponding type to obtain valid key operation status data. For example, the pressure data of the key operation uploaded by the pressure sensor is matched with a preset pressure threshold range, and data exceeding the range is removed. Similarly, other types of key operation status data, such as key operation speed data, coordinate data corresponding to the key operation, and displacement data corresponding to the key operation, are also matched with corresponding indicator threshold ranges to filter out valid data. Finally, the key operation type is determined based on the target type of status data in the valid key operation status data.
[0026] Furthermore, in some implementations of this embodiment, the step of determining the key operation type based on the target key operation status data in multiple valid key operation status data includes: when the key operation pressure data in multiple valid key operation status data meets the preset pressure threshold range, determining that the key operation type is a key tapping operation; when the key operation event is a valid key operation event, and the key operation displacement data in multiple valid key operation status data meets the preset displacement threshold range, determining that the key operation type is a key surface touch operation; when the key operation coordinate data in multiple valid key operation status data meets the preset first target coordinate range, determining that the key operation type is a key edge touch operation; wherein, the first target coordinate range corresponds to the coordinates of the edge position of the virtual key.
[0027] Specifically, in this embodiment, corresponding indicator threshold ranges are set for each type of status data based on historical experience values, and each type of indicator threshold range is smaller than the aforementioned indicator threshold range for screening valid data, so as to determine the type of key operation; specifically, when the pressure data value in the valid key operation status data meets the preset pressure threshold range, the key operation type is determined to be a key tapping operation, wherein the key operation pressure data is the pressure value detected by the pressure sensor when the user performs a key operation; and when the displacement data in the valid key operation status data meets the preset displacement threshold range, the key operation type is determined to be a key surface touch operation, wherein the key operation displacement data is the sliding displacement value detected by the displacement sensor when the user performs a key operation; when the coordinate data in the valid key operation status data meets the target coordinate range, the key operation type is determined to be a key edge touch operation, wherein the target coordinate range is the position coordinate range of the edge of each virtual key, and the key operation coordinate data is the coordinate value of the key operation detected by the position sensor. It should be noted that in the above-mentioned determination of the corresponding key operation type based on the target type data, the target type is not limited to the above-mentioned pressure data, coordinate data, and displacement data, and can be adjusted and set according to actual applications. For example, the key operation type can also be determined as a key surface touch operation based on the speed data or pressure data of the key operation.
[0028] Furthermore, in some implementations of this embodiment, before the step of determining that the key operation type is a key surface touch operation, it also includes: matching the key operation coordinate data in the valid key operation status data with a preset second target coordinate range; wherein the second target coordinate range corresponds to the coordinates of the letter key area in the virtual keyboard; when the key operation coordinate data meets the second target coordinate range, determining that the key operation event is a valid key operation event.
[0029] Specifically, in this embodiment, to provide users with more accurate tactile feedback, tactile feedback for key surface touch operations can be set only in the letter distribution area of the virtual keyboard. Therefore, the coordinate data in the valid key operation status data can be matched with the target coordinate range to determine whether the key operation event is a valid key operation event, that is, whether the key operation area is a valid area, where the target coordinate range is the coordinate range of the letter area in the virtual keyboard. In addition, according to actual needs, tactile feedback for surface touch operations can also be set for the numeric area on the virtual keyboard, that is, the numeric area is set as the valid area.
[0030] Step 203: Select a corresponding tactile feedback strategy according to the key operation type and key operation status data.
[0031] Specifically, in this embodiment, after determining the operation type of the key operation event, the corresponding tactile feedback strategy can be selected according to the key operation type and the key operation status data. In this embodiment, the tactile feedback strategy includes a tactile feedback method and a tactile feedback attribute corresponding to the tactile feedback method to accurately present different tactile feedback.
[0032] In some implementations of this embodiment, the step of selecting a corresponding tactile feedback strategy based on the key operation type and the key operation status data includes: determining a corresponding tactile feedback method based on the key operation type; wherein the tactile feedback method includes: vibration feedback and texture feedback; determining a tactile feedback attribute corresponding to the tactile feedback method based on the tactile feedback method and the key operation status data.
[0033] Specifically, in this embodiment, a corresponding tactile feedback method is first selected based on the key operation type, and then the attribute values of the tactile feedback are determined based on the tactile feedback method and the key operation status data. The tactile feedback method in this embodiment can be vibration feedback, texture feedback, force feedback, or other feasible feedback methods such as temperature feedback.
[0034] Furthermore, in some implementations of this embodiment, the step of determining the corresponding tactile feedback method according to the key operation type includes: when the key operation type is a key tapping operation or a key edge touch operation, determining the tactile feedback method as vibration feedback; when the key operation type is a key surface touch operation, determining the tactile feedback method as texture feedback.
[0035] Specifically, this embodiment sets a tactile feedback mode of vibration feedback for key tapping operations and key edge touch operations, and sets a tactile feedback mode of texture feedback for key surface touch operation events; in addition, the tactile feedback mode can be further determined according to the key, so as to set a different tactile feedback mode for each key, for example, a combined feedback mode is set for numeric keys, and a single feedback mode is set for letter keys; the feedback mode corresponding to each key operation type can be a single or a combined feedback mode.
[0036] Furthermore, in some implementations of this embodiment, the step of determining the tactile feedback attributes corresponding to the tactile feedback mode based on the tactile feedback mode and the key operation status data includes: when the tactile feedback mode is vibration feedback, determining the vibration intensity and vibration duration based on the key operation pressure data and the key operation duration in the key operation status data; when the tactile feedback mode is texture feedback, determining the target key object based on the key coordinate data in the key operation status data; and querying the corresponding texture form in the preset texture form index table based on the target key object.
[0037] Specifically, in this embodiment, when the tactile feedback mode of vibration feedback is selected, it is necessary to further determine the properties of the vibration, such as vibration intensity, vibration duration and other properties. Specifically, the corresponding vibration intensity value and vibration duration are determined according to the pressure data in the key operation status data and the duration of the key operation, so as to provide corresponding tactile feedback according to the duration and pressure of the user pressing the key. For example, when the user lightly taps the key, a short and crisp feedback is given to the key, thereby enhancing the confirmation sense of the virtual key and giving the user a real key feeling; and when the user touches the edge of the key, such as position A and position C in the key operation position division diagram shown in Figure 3, that is, when the user leaves the key from the edge and touches the edge of the key, vibration will be triggered, so that the user can Provide users with a clear sense of key boundaries; when the user swipes at position B, that is, selects the tactile feedback mode of texture feedback, it is necessary to determine the target key object based on the coordinate data in the key operation status data. In this embodiment, different or the same texture forms are set for different letter keys. For example, raised textures are set for the letters "F" and "J", and smooth textures are set for the remaining letters such as the "K" key. It can also be set to a corresponding simulated texture such as leather texture according to the graphic type of the virtual keyboard; the texture form index table in this embodiment includes a mapping relationship between different key objects and their corresponding texture forms, and different texture forms have different vibration frequencies; through the tactile feedback of subtle textures, users can accurately distinguish different letter key areas.
[0038] Step 204: Control the actuator to enter a corresponding vibration working state according to the tactile feedback strategy.
[0039] Specifically, in this embodiment, after the tactile feedback strategy, that is, the tactile feedback mode and the tactile feedback attribute value are determined, a corresponding driving signal is generated and transmitted to the actuator to control the actuator to perform a corresponding vibration working state.
[0040] Based on the technical solution of the embodiment of the present application described above, in response to a key operation event, corresponding key operation status data is detected; a corresponding key operation type is determined based on the key operation status data; wherein the key operation types include: key tapping operation, key surface touch operation, and key edge touch operation; a corresponding tactile feedback strategy is selected based on the key operation type and the key operation status data; wherein the tactile feedback strategy includes a tactile feedback mode and a tactile feedback attribute corresponding to the tactile feedback mode; and the actuator is controlled to enter a corresponding vibration working state according to the tactile feedback strategy. Through the implementation of the solution of the present application, a corresponding tactile feedback strategy is selected for tactile feedback based on the user's key operation event type and key operation status data, so that the user can locate and identify the virtual key, thereby realizing blind operation and improving the user's operation experience.
[0041] The method in FIG4 is a refined tactile feedback method for a virtual key provided in the second embodiment of the present application. The tactile feedback method for a virtual key includes:
[0042] Step 401: In response to a key operation event, detecting corresponding key operation status data;
[0043] Step 402: When the key operation pressure data in the plurality of key operation status data meets a preset pressure threshold range, determining that the key operation type is a key tapping operation;
[0044] Step 403: When the key operation displacement data in the plurality of key operation status data meets the preset displacement threshold range, determining that the key operation type is a key surface touch operation;
[0045] Step 404: When the key operation coordinate data in the plurality of key operation status data conforms to a preset target coordinate range, determining that the key operation type is a key edge touch operation;
[0046] Step 405: Determine whether the key operation type is a key surface touch operation; if so, execute step 406; if not, execute step 407;
[0047] Step 406: Determine that the tactile feedback mode is texture feedback;
[0048] Step 407: Determine that the tactile feedback mode is vibration feedback;
[0049] Step 408: Control the actuator to enter a corresponding vibration working state according to the tactile feedback mode and the corresponding tactile feedback attribute.
[0050] Specifically, in this embodiment, tactile feedback is provided for the following key operation types according to the form of blind operation by the user: virtual key tapping operation, virtual key surface touch operation, virtual key edge touch operation. Tactile feedback includes vibration feedback, force feedback, texture feedback, temperature feedback, etc. In order to effectively realize the blind operation of the virtual keyboard, software and hardware coordination is required. The specific structure is, for example, the structural diagram of the tactile feedback system of the virtual key shown in Figure 5. The sensor monitors the trigger event or behavior, the application software controls the trigger event and issues a control instruction, the processor processes the corresponding instruction, and issues data to drive the actuator to respond, so as to realize different tactile feedback for different virtual key operations, thereby realizing blind operation.
[0051] It should be understood that the size of the serial numbers of the steps in this embodiment does not mean the order in which the steps are executed. The order in which the steps are executed should be determined by their functions and internal logic, and should not constitute a sole limitation on the implementation process of the embodiments of this application.
[0052] FIG6 is a tactile feedback device for a virtual key provided in the third embodiment of the present application. The tactile feedback device for a virtual key can be applied to the tactile feedback method for the virtual key. As shown in FIG6 , the tactile feedback device for a virtual key mainly includes:
[0053] Detection module 601, for detecting corresponding key operation status data in response to a key operation event;
[0054] The determination module 602 is used to determine the corresponding key operation type according to the key operation state data; wherein the key operation type includes: key tapping operation, key surface touch operation, key edge touch operation;
[0055] A selection module 603 is configured to select a corresponding tactile feedback strategy according to the key operation type and the key operation state data; wherein the tactile feedback strategy includes a tactile feedback mode and a tactile feedback attribute corresponding to the tactile feedback mode;
[0056] The control module 604 is configured to control the actuator to enter a corresponding vibration operating state according to the tactile feedback strategy.
[0057] In some implementations of this embodiment, the determination module is specifically used to: match multiple types of key operation status data with corresponding types of preset indicator threshold ranges to obtain multiple valid key operation status data; wherein the key operation status data includes: key operation pressure data, key operation position data, key operation displacement data; determine the key operation type based on the target key operation status data in the multiple valid key operation status data.
[0058] Furthermore, in some implementations of this embodiment, the determination module is also used to determine that the key operation type is a key tapping operation when the key operation pressure data in multiple valid key operation status data meets the preset pressure threshold range; when the key operation event is a valid key operation event, and the key operation displacement data in multiple valid key operation status data meets the preset displacement threshold range, determine that the key operation type is a key surface touch operation; when the key operation coordinate data in multiple valid key operation status data meets the preset first target coordinate range, determine that the key operation type is a key edge touch operation; wherein the first target coordinate range corresponds to the coordinates of the edge position of the virtual key.
[0059] Furthermore, in some implementations of this embodiment, before executing the function of determining that the key operation type is a key surface touch operation, the determination module is also used to match the key operation coordinate data in the valid key operation status data with a preset second target coordinate range; wherein the second target coordinate range corresponds to the coordinates of the letter key area in the virtual keyboard; when the key operation coordinate data meets the second target coordinate range, the key operation event is determined to be a valid key operation event.
[0060] In some implementations of this embodiment, the selection module is specifically used to: determine the corresponding tactile feedback method according to the key operation type; wherein the tactile feedback method includes: vibration feedback and texture feedback; determine the tactile feedback attribute corresponding to the tactile feedback method according to the tactile feedback method and the key operation status data.
[0061] Furthermore, in some implementations of this embodiment, the selection module is also used to determine that the tactile feedback mode is vibration feedback when the key operation type is a key tapping operation or a key edge touch operation; and to determine that the tactile feedback mode is texture feedback when the key operation type is a key surface touch operation.
[0062] Furthermore, in some other implementations of this embodiment, the selection module is also used to determine the vibration intensity and vibration duration based on the key operation pressure data and the key operation duration in the key operation status data when the tactile feedback mode is vibration feedback; when the tactile feedback mode is texture feedback, determine the target key object based on the key coordinate data in the key operation status data; and query the corresponding texture form in the preset texture form index table based on the target key object.
[0063] It should be noted that the tactile feedback methods of the virtual keys in the aforementioned embodiments can all be implemented based on the tactile feedback device of the virtual keys provided in this embodiment. Ordinary technicians in the relevant field can clearly understand that for the convenience and conciseness of description, the specific working process of the tactile feedback device of the virtual keys described in this embodiment can refer to the corresponding process in the aforementioned method embodiment, and will not be repeated here.
[0064] Based on the technical solutions of the above-mentioned embodiments of the present application, in response to a key operation event, corresponding key operation status data is detected; the corresponding key operation type is determined based on the key operation status data; wherein the key operation types include: key tapping operation, key surface touch operation, and key edge touch operation; the corresponding tactile feedback strategy is selected based on the key operation type and the key operation status data; wherein the tactile feedback strategy includes a tactile feedback mode and a tactile feedback attribute corresponding to the tactile feedback mode; and the actuator is controlled to enter a corresponding vibration working state according to the tactile feedback strategy. Through the implementation of the solution of the present application, a corresponding tactile feedback strategy is selected for tactile feedback based on the user's key operation event type and key operation status data, so that the user can locate and identify the virtual key, thereby realizing blind operation and improving the user's operation experience.
[0065] FIG7 is a schematic diagram of the structure of an electronic device provided in a fourth embodiment of the present application. The electronic device can be used to implement the tactile feedback method for virtual keys in the aforementioned embodiments, and mainly includes:
[0066] An actuator 701, a memory 702, a processor 703, and a computer program 704 stored in the memory 702 and executable on the processor 703 are provided. The memory 702 and the processor 703 are connected via communication. When the processor 703 executes the computer program 704, the method of the first or second embodiment described above is implemented. The number of processors may be one or more.
[0067] The memory 702 can be a high-speed random access memory (RAM) memory or a non-volatile memory such as a disk drive. The memory 702 is used to store executable program code. The processor 703 is coupled to the memory 702 .
[0068] Furthermore, an embodiment of the present application also provides a computer-readable storage medium, which may be provided in the above-mentioned electronic device. The computer-readable storage medium may be the memory in the embodiment shown in FIG. 7 .
[0069] The computer-readable storage medium stores a computer program that, when executed by a processor, implements the tactile feedback method for virtual keys described in the aforementioned embodiments. Furthermore, the computer-readable storage medium may be a USB flash drive, a mobile hard drive, a read-only memory (ROM), RAM, a magnetic disk, or an optical disk, among other media capable of storing program code.
[0070] In the several embodiments provided in this application, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the device embodiments described above are merely illustrative. For example, the division of modules is only a logical function division. In actual implementation, there may be other division methods, such as multiple modules or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or modules, which can be electrical, mechanical or other forms.
[0071] Modules described as separate components may or may not be physically separate, and components shown as modules may or may not be physical modules, that is, they may be located in one place or distributed across multiple network modules. Some or all of these modules may be selected to achieve the purpose of this embodiment based on actual needs.
[0072] In addition, the functional modules in the various embodiments of the present application may be integrated into a processing module, or each module may exist physically separately, or two or more modules may be integrated into a single module. The above-mentioned integrated modules may be implemented in the form of hardware or software functional modules.
[0073] If the integrated module is implemented as a software functional module and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of this application, or the portion that contributes to the prior art, or all or part of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a readable storage medium and includes several instructions for causing a computer device (which can be a personal computer, server, or network device, etc.) to execute all or part of the steps of the various embodiments of the method of this application. The aforementioned readable storage medium includes various media that can store program code, such as USB flash drives, mobile hard drives, ROM, RAM, magnetic disks, or optical disks.
[0074] It should be noted that for the aforementioned method embodiments, for ease of description, they are all expressed as a series of action combinations, but those skilled in the art should be aware that this application is not limited by the order of the actions described, because according to this application, certain steps can be performed in other orders or simultaneously. Secondly, those skilled in the art should also be aware that the embodiments described in this specification are all preferred embodiments, and the actions and modules involved are not necessarily required by this application.
[0075] In the above embodiments, the description of each embodiment has its own focus. For parts that are not described in detail in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.
[0076] The above is a description of the tactile feedback method, device, equipment and storage medium for virtual keys provided in this application. For technical personnel in this field, based on the ideas of the embodiments of this application, there may be changes in the specific implementation methods and application scope. In summary, the content of this specification should not be understood as a limitation on this application.
Claims
1. A haptic feedback method for virtual keys, characterized in that, applied to an electronic device, the electronic device includes an actuator, and the haptic feedback method includes: Responding to a key operation event, detecting corresponding key operation status data; Determining a corresponding key operation type according to the key operation status data; wherein, the key operation type includes: key tapping operation, key surface touch operation, key edge touch operation; Selecting a corresponding haptic feedback strategy according to the key operation type and the key operation status data; wherein, the haptic feedback strategy includes a haptic feedback method and haptic feedback attributes corresponding to the haptic feedback method; Controlling the actuator to enter a corresponding vibration working state according to the haptic feedback strategy.
2. The haptic feedback method according to claim 1, characterized in that, The step of determining a corresponding key operation type according to the key operation status data includes: Matching multiple types of key operation status data with corresponding preset index threshold ranges respectively to obtain multiple valid key operation status data; wherein, the key operation status data includes: key operation pressure data, key operation position data, key operation displacement data; Determining the key operation type according to the target key operation status data among the multiple valid key operation status data.
3. The haptic feedback method according to claim 2, characterized in that, The step of determining the key operation type according to the target key operation status data among the multiple valid key operation status data includes: When the key operation pressure data among the multiple valid key operation status data meets a preset pressure threshold range, determining that the key operation type is the key tapping operation; When the key operation event is a valid key operation event, and the key operation displacement data among the multiple valid key operation status data meets a preset displacement threshold range, determining that the key operation type is the key surface touch operation; When the key operation coordinate data among the multiple valid key operation status data meets a preset first target coordinate range, determining that the key operation type is the key edge touch operation; wherein, the first target coordinate range corresponds to the coordinates of the virtual key edge position.
4. The haptic feedback method according to claim 3, characterized in that, Before the step of determining that the key operation type is the key surface touch operation, it further includes: Matching the key operation coordinate data in the valid key operation status data with a preset second target coordinate range; wherein, the second target coordinate range corresponds to the coordinates of the letter key area in the virtual keyboard; When the key operation coordinate data meets the second target coordinate range, determining that the key operation event is a valid key operation event.
5. The haptic feedback method according to claim 1, characterized in that, The step of selecting a corresponding haptic feedback strategy according to the key operation type and the key operation status data includes: Determine a corresponding haptic feedback method according to the key operation type; wherein, the haptic feedback method includes: vibration feedback and texture feedback; Determine the haptic feedback attribute corresponding to the haptic feedback method according to the haptic feedback method and the key operation state data.
6. The haptic feedback method according to claim 5, characterized in that, The step of determining a corresponding haptic feedback method according to the key operation type includes: When the key operation type is the key tapping operation or the key edge touch operation, determine that the haptic feedback method is the vibration feedback; When the key operation type is the key surface touch operation, determine that the haptic feedback method is the texture feedback.
7. The haptic feedback method according to claim 5, characterized in that, The step of determining the haptic feedback attribute corresponding to the haptic feedback method according to the haptic feedback method and the key operation state data includes: When the haptic feedback method is the vibration feedback, determine the vibration intensity and vibration duration according to the key operation pressure data and the key operation duration in the key operation state data; When the haptic feedback method is the texture feedback, determine the target key object according to the key coordinate data in the key operation state data; Query the corresponding texture form in the preset texture form index table according to the target key object.
8. A haptic feedback device for virtual keys, characterized in that, comprising: A detection module for detecting corresponding key operation state data in response to a key operation event; A determination module for determining a corresponding key operation type according to the key operation state data; wherein, the key operation type includes: key tapping operation, key surface touch operation, key edge touch operation; A selection module for selecting a corresponding haptic feedback strategy according to the key operation type and the key operation state data; wherein, the haptic feedback strategy includes a haptic feedback method and the haptic feedback attribute corresponding to the haptic feedback method; A control module for controlling the actuator to enter a corresponding vibration working state according to the haptic feedback strategy.
9. An electronic device, characterized in that, comprising an actuator, a memory and a processor, wherein: The processor is used to execute a computer program stored on the memory; When the processor executes the computer program, it implements the steps in the haptic feedback method for virtual keys according to any one of claims 1 to 7.
10. A computer-readable storage medium, on which a computer program is stored, characterized in that, When the computer program is executed by a processor, it implements the steps in the haptic feedback method for virtual keys according to any one of claims 1 to 7.
Citation Information
Patent Citations
System and method for optimizing haptic feedback
CN106255942A
Interaction method of virtual key and terminal equipment
CN107025019A
Gesture operation method of virtual button, mobile terminal and storage medium
CN107728900A
Virtual key touch feedback method, storage medium and device
CN112860092A
Input feedback method and device of virtual keyboard, electronic equipment and storage medium
CN117008809A