Tactile feedback method and device, electronic equipment and storage medium

Abstract

The invention provides a tactile feedback method and device, electronic equipment and a storage medium, and relates to the technical field of tactile feedback, and the tactile feedback method comprises the steps: responding to the operation of a user, and generating a vibration excitation signal based on vibration related information corresponding to the user and the operation; the vibration associated information comprises excitation signal frequency, excitation signal amplitude and excitation signal length; vibration is generated according to the vibration excitation signal. According to the tactile feedback method provided by the invention, the tactile feedback device can generate a vibration effect conforming to the feeling characteristics of the user, and the tactile feedback experience of the user is improved.

Description

TECHNICAL FIELD

[0001] The present disclosure relates to the technical field of haptic feedback, and in particular to a haptic feedback method and device, an electronic device, and a storage medium. BACKGROUND

[0002] Currently, when electronic devices such as mobile phones, tablets, wearable devices, virtual reality (VR) devices, augmented reality (AR) devices, and vehicle displays perform touch operations, they usually vibrate through preset vibration modes. For example, a device outputs a preset waveform driving signal according to touch conditions (such as the position of the touch, the pressing condition, etc.) to generate vibration, and the vibration effect generated by the same device under the same touch condition is basically the same. However, the user's tactile sensation is very subjective, and the experience of different users for the same vibration is quite different, for example, different users may feel different strengths and degrees of realism for the same vibration. Therefore, the device vibrates according to the preset mode, which is difficult to ensure the user experience of each user. SUMMARY

[0003] The present disclosure provides a haptic feedback method, device, and electronic device for improving the user's haptic feedback experience.

[0004] In a first aspect, the present disclosure provides a haptic feedback method, which comprises:

[0005] In response to the operation of the user, generating a vibration excitation signal based on vibration association information corresponding to the user and the operation; the vibration association information includes an excitation signal frequency, an excitation signal amplitude, and an excitation signal length;

[0006] Generating vibration according to the vibration excitation signal.

[0007] In some embodiments, the method for determining the excitation signal amplitude and the excitation signal length corresponding to the user and the operation comprises:

[0008] Obtaining an original signal frequency corresponding to the operation from an original waveform library;

[0009] Obtaining a pair of signal amplitude and signal length corresponding to the original signal frequency according to a tactile sensation reference table associated with the user;

[0010] Determining the excitation signal amplitude and the excitation signal length corresponding to the user and the operation according to the signal amplitude and the signal length.

[0011] In some embodiments, determining the excitation signal amplitude and the excitation signal length corresponding to the user and the operation according to the signal amplitude and the signal length specifically comprises:

[0012] determining the signal amplitude as the excitation signal amplitude corresponding to the user and the operation;

[0013] determining the signal length as the excitation signal length corresponding to the user and the operation.

[0014] In some embodiments, the determination of the excitation signal amplitude and the excitation signal length corresponding to the user and the operation according to the signal amplitude and the signal length specifically comprises:

[0015] determining the excitation signal amplitude according to the signal amplitude and the signal amplitude adjustment parameter associated with the user and the operation;

[0016] determining the excitation signal length according to the signal length and the signal length adjustment parameter associated with the user and the operation.

[0017] In some embodiments, the method for establishing the tactile sensation reference table comprises:

[0018] recording the signal amplitude corresponding to the minimum vibration felt by the user for the set signal frequency and the set signal length;

[0019] recording the signal length corresponding to the minimum vibration felt by the user for the set signal frequency and the set signal amplitude;

[0020] recording the signal frequency corresponding to the minimum vibration felt by the user for the set signal amplitude and the set signal length.

[0021] In some embodiments, the method for establishing the sensation threshold reference table comprises:

[0022] recording the signal amplitude corresponding to the best vibration felt by the user for the set signal frequency and the set signal length;

[0023] recording the signal length corresponding to the best vibration felt by the user for the set signal frequency and the set signal amplitude;

[0024] recording the signal frequency corresponding to the best vibration felt by the user for the set signal amplitude and the set signal length.

[0025] In some embodiments, the method for determining the excitation signal frequency corresponding to the user and the operation comprises:

[0026] determining the original signal frequency as the excitation signal frequency.

[0027] In some embodiments, the method for determining the excitation signal frequency corresponding to the user and the operation comprises:

[0028] determining the excitation signal frequency according to the original signal frequency and the signal frequency adjustment parameter associated with the user and the operation.

[0029] In some embodiments, in response to the operation of the user, the vibration excitation signal is generated based on the vibration association information corresponding to the user and the operation, specifically comprising:

[0030] In response to the first operation of the user, the first vibration excitation signal is generated based on the first vibration association information corresponding to the user and the first operation; the first vibration association information includes the first excitation signal frequency, the first excitation signal amplitude and the first excitation signal length.

[0031] In response to the second operation of the user, the second vibration excitation signal is generated based on the second vibration association information corresponding to the user and the second operation; the second vibration association information includes the second excitation signal frequency, the second excitation signal amplitude and the second excitation signal length; wherein the second excitation signal frequency is different from the first excitation signal frequency, and / or the second excitation signal amplitude is different from the first excitation signal amplitude.

[0032] In some embodiments, the second excitation signal frequency is the same as the first excitation signal frequency, the second excitation signal amplitude is different from the first excitation signal amplitude, and the difference between the second excitation signal amplitude and the first excitation signal amplitude is greater than or equal to the amplitude resolution threshold corresponding to the signal frequency.

[0033] In some embodiments, the second excitation signal amplitude is the same as the first excitation signal amplitude, the second excitation signal frequency is different from the first excitation signal frequency, and the difference between the second excitation signal frequency and the first excitation signal frequency is greater than or equal to the frequency resolution threshold corresponding to the signal amplitude.

[0034] In some embodiments, the vibration excitation signal is generated based on the vibration association information corresponding to the user and the operation, specifically comprising:

[0035] According to the excitation signal frequency, the excitation signal amplitude and the excitation signal length included in the vibration association information, the vibration excitation signal is directly generated.

[0036] In some embodiments, the vibration excitation signal is generated based on the vibration association information corresponding to the user and the operation, specifically comprising:

[0037] According to the original waveform library, the initial excitation signal corresponding to the operation is generated;

[0038] According to the excitation signal frequency, the excitation signal amplitude and the excitation signal length included in the vibration association information, the initial excitation signal is adjusted to the vibration excitation signal.

[0039] In some embodiments, before the vibration excitation signal is generated based on the vibration association information corresponding to the user and the operation, further comprising:

[0040] According to the identity information of the user, the vibration association information corresponding to the user and the operation is determined.

[0041] In some embodiments, the method of determining the identity information of the user comprises:

[0042] determining the identity information of the user according to at least one of the fingerprint recognition result, the portrait recognition result, and the account password verification result.

[0043] In a second aspect, the present disclosure provides a haptic feedback device, comprising:

[0044] a response module configured to, in response to an operation of a user, generate a vibration excitation signal based on vibration association information corresponding to the user and the operation; the vibration association information comprising an excitation signal frequency, an excitation signal amplitude, and an excitation signal length.

[0045] a vibration module configured to generate vibration according to the vibration excitation signal.

[0046] In a third aspect, the present disclosure provides another haptic feedback method, the haptic feedback method comprising:

[0047] obtaining a transfer function of a target device, and vibration association information of the target device corresponding to a user and an operation; the user being a current user of the device;

[0048] in response to an operation of the user, generating a vibration excitation signal based on a transfer function of the device, the transfer function of the target device, and the vibration association information of the target device corresponding to the user and the operation;

[0049] generating vibration according to the vibration excitation signal.

[0050] In a fourth aspect, the present disclosure provides another haptic feedback device, comprising:

[0051] an obtaining module configured to obtain a transfer function of a target device, and vibration association information of the target device corresponding to a user and an operation;

[0052] a response module configured to, in response to an operation of the user, generate a vibration excitation signal based on a transfer function of the device, the transfer function of the target device, and the vibration association information of the target device corresponding to the user and the operation;

[0053] a vibration module configured to generate vibration according to the vibration excitation signal.

[0054] In a fifth aspect, the present disclosure provides an electronic device, comprising:

[0055] a memory for storing a computer program;

[0056] a processor for executing the computer program stored on the memory to implement the method of the first aspect or the third aspect.

[0057] In a sixth aspect, the present disclosure provides a computer-readable storage medium, and the computer-readable storage medium stores a computer program, and the computer program is executed by a processor to implement the method in the first aspect or the third aspect.

[0058] In a seventh aspect, the present disclosure provides a computer program product, and the computer program product comprises computer program code, and when the computer program code is executed on a computer, the computer program code causes the computer to execute the method in any one of the first aspect or the third aspect.

[0059] The present disclosure has the following beneficial effects:

[0060] The present disclosure provides a haptic feedback method, device, electronic equipment and storage medium, the haptic feedback method comprising: in response to a user's operation, generating a vibration excitation signal based on vibration association information corresponding to the user and the operation; the vibration association information comprises an excitation signal frequency, an excitation signal amplitude and an excitation signal length; generating vibration according to the vibration excitation signal. According to the haptic feedback method provided by the present disclosure, the haptic feedback device can generate vibration effects that meet the characteristics of user experience, and improve the user's haptic feedback experience. BRIEF DESCRIPTION OF DRAWINGS

[0061] Figure 1 One of the flowcharts of the haptic feedback method provided by the embodiments of the present disclosure;

[0062] Figure 2 The flowchart of the determination method of the excitation signal amplitude and the excitation signal length corresponding to the user and the operation provided by the embodiments of the present disclosure;

[0063] Figure 3 One of the structural schematic diagrams of the haptic feedback device provided by the embodiments of the present disclosure;

[0064] Figure 4 The second flowchart of the haptic feedback method provided by the embodiments of the present disclosure;

[0065] Figure 5 The second structural schematic diagram of the haptic feedback device provided by the embodiments of the present disclosure;

[0066] Figure 6 The structural schematic diagram of the electronic equipment provided by the embodiments of the present disclosure;

[0067] Figure 7 The haptic feedback synchronization method of the interconnected device system provided by the embodiments of the present disclosure;

[0068] Figure 8A One of the structural schematic diagrams of the interconnected device system provided by the present disclosure;

[0069] Figure 8B The second structural schematic diagram of the interconnected device system provided by the present disclosure;

[0070] Figure 8C Figure 3 is a schematic diagram of a system structure of an interconnection device provided by the present disclosure;

[0071] Figure 8D Figure 4 is a schematic diagram of a system structure of an interconnection device provided by the present disclosure. DETAILED DESCRIPTION

[0072] In order to make the purposes, technical solutions and advantages of the present disclosure clearer, the present disclosure will be further described in detail below with reference to the drawings. The specific operation methods in the method embodiments can also be applied to the device embodiments or system embodiments. It should be noted that in the description of the present disclosure, "multiple" is understood as "at least two". The "and / or" describes the association relationship of the associated objects, which means that there can be three relationships, for example, A and / or B can represent the following three cases: A exists alone, A and B exist together, and B exists alone. A is connected to B, which can represent two cases: A is directly connected to B and A is connected to B through C. In addition, in the description of the present disclosure, "first", "second", and the like are used only for the purpose of distinguishing the description, and cannot be understood as indicating or implying relative importance, nor indicating or implying order.

[0073] At present, when electronic devices such as mobile phones, tablets, wearable devices, virtual reality (VR) devices, augmented reality (AR) devices, and vehicle displays perform touch operations, they usually vibrate through a preset vibration mode. For example, the device outputs a driving signal of a preset waveform according to the touch condition (such as the position of the touch, the pressing condition, etc.) to generate vibration, and the vibration effect generated by the same device under the same touch condition is basically the same. However, the user's tactile sensation is very subjective, and the experience of different users for the same vibration is quite different, for example, different users may feel different strength and realism for the same vibration. Therefore, the device vibrates according to the preset mode, which is difficult to ensure the user experience of each user. Moreover, due to the different hardware conditions of different devices, even for the same driving signal, the vibration effects generated by different devices are not the same, so that the user feels different tactile feedback effects when performing the same touch operation on different devices, and the user is difficult to obtain the same or similar tactile feedback experience on different devices.

[0074] Figure 1 Figure 1 is a flowchart of a tactile feedback method provided by an embodiment of the present disclosure.

[0075] In a first aspect of the present disclosure, a tactile feedback method is provided, which can be executed by a tactile feedback device. As shown in Figure 1, the method comprises the following steps. Figure 1As shown, the haptic feedback method provided by the embodiments of the present disclosure includes the following steps:

[0076] S101: In response to the operation of the user, a vibration excitation signal is generated based on vibration association information corresponding to the user and the operation;

[0077] S102: Vibration is generated according to the vibration excitation signal.

[0078] In the embodiments of the present disclosure, when the haptic feedback device detects the operation of the user, in response to the operation of the user, a vibration excitation signal is generated based on vibration association information corresponding to the user and the operation, and then vibration is generated according to the vibration excitation signal.

[0079] Specifically, the haptic feedback device can be a mobile phone, a tablet, a wearable device, a VR device, an AR device, a vehicle-mounted display, a gamepad, etc. with vibration feedback function. Taking a mobile phone as an example, when the same user makes different types of operations on the same mobile phone, the mobile phone needs to generate different vibration effects to facilitate the user to distinguish the operation types. For example, when the user views a picture, the user can zoom in the picture by double-clicking the picture, and the mobile phone can generate a longer or more intense vibration when the user double-clicks the picture than when the user single-clicks the picture. For another example, when the user plays a shooting game, the mobile phone can generate different vibrations when the user clicks different guns to shoot to simulate the vibration effect of the real gun. At the same time, different users have different feelings about the vibration effect of the mobile phone when they make the same operation on the same mobile phone. For example, some users can feel the vibration feedback when the mobile phone generates a small vibration, and other users can feel the vibration feedback only when the mobile phone generates a larger vibration.

[0080] In the embodiments of the present disclosure, the vibration association information includes excitation signal frequency, excitation signal amplitude and excitation signal length. The vibration association information corresponds to the user and the operation, and specifically refers to that for a specific operation of a user, there is a vibration association information corresponding thereto. For example, for the same mobile phone, operation 1 of user A corresponds to a vibration association information A1, which includes excitation signal frequency aa1, excitation signal amplitude ba1 and excitation signal length ca1 corresponding to operation 1 of user A; operation 2 of user A corresponds to a vibration association information A2, which includes excitation signal frequency aa2, excitation signal amplitude ba2 and excitation signal length ca2 corresponding to operation 2 of user A; operation 1 of user B corresponds to a vibration association information B1, which includes excitation signal frequency ab1, excitation signal amplitude bb1 and excitation signal length cb1 corresponding to operation 1 of user B.

[0081] In implementation, the haptic feedback device such as a mobile phone produces vibration according to the vibration excitation signal generated based on the vibration-related information, which is just consistent with the feeling characteristics of the user corresponding to the vibration-related information when the user performs a specific operation corresponding to the vibration-related information. For example, for operation 1 of user A, the mobile phone generates vibration excitation signal AA based on vibration-related information A1, and the vibration excitation signal AA has excitation signal frequency aa1, excitation signal amplitude ba1 and excitation signal length ca1. At this time, the mobile phone produces vibration according to the vibration excitation signal AA, which is just consistent with the feeling characteristics of user A when the user performs operation 1. The feeling characteristics of the user to the vibration feedback can be that the user can just feel the vibration feedback of the mobile phone, or the user can feel better vibration feedback, or other feeling characteristics, which are not limited herein. Thus, for the same haptic feedback device such as a mobile phone, different operations of different users can produce vibration effects corresponding to the user and the operation, and realize personalized haptic feedback, thereby optimizing the experience of haptic feedback of different users.

[0082] Figure 2 The method for determining the excitation signal amplitude and the excitation signal length corresponding to the user and the operation is provided in the embodiment of the present disclosure.

[0083] In some embodiments, as shown in Figure 2 The excitation signal amplitude and the excitation signal length corresponding to the user and the operation can be determined by the following steps:

[0084] S201: obtaining an initial signal frequency corresponding to the operation from an original waveform library;

[0085] Generally, the type of the user operation depends on the application scenario and the application event of the operation. For example, the application scenario of the operation usually includes but is not limited to text input, picture zoom, game entertainment and the like, and the application event of the operation usually includes but is not limited to single click, double click, long press, sliding, scrolling, dragging and the like. The type of the operation can be determined under the determined application scenario and the application event. For example, in a shooting game scenario, single click on a weapon can perform single shot operation, long press on the weapon can perform continuous shooting operation, and the like. Each application scenario usually has an original waveform library associated with the application scenario, which is used to generate an original excitation signal according to the signal waveform corresponding to a certain operation in the original waveform library in the application scenario. In the related art, the haptic feedback device such as a mobile phone produces vibration according to the original excitation signal, which is not associated with the feeling characteristics of the user, and thus cannot provide personalized haptic feedback experience for the user.

[0086] The signal waveform corresponding to the operation in the original waveform library contains information of the initial signal frequency, the initial signal amplitude and the initial signal length of the original excitation signal. The frequency of vibration has an important influence on the user's tactile experience, for example, different vibration frequencies usually represent different materials, etc. In some embodiments of the present disclosure, the original signal frequency corresponding to the operation is obtained from the original waveform library, and the excitation signal amplitude and the excitation signal length corresponding to the user and the operation are determined according to the original signal frequency.

[0087] S202: According to the tactile sensation table associated with the user, a pair of signal amplitude and signal length corresponding to the original signal frequency are obtained;

[0088] The tactile sensation table associated with the user records a plurality of data groups composed of signal frequency, signal amplitude and signal length which meet the user's feeling characteristics. The tactile sensation table can be stored in the haptic feedback device for easy calling.

[0089] In some embodiments, the tactile sensation table records a plurality of data groups composed of signal frequency, signal amplitude and signal length which the user can just feel the vibration feedback. The establishment process of the tactile sensation table can include the following steps:

[0090] Record the signal amplitude corresponding to the minimum vibration that the user feels for the set signal frequency and the set signal length;

[0091] Record the signal length corresponding to the minimum vibration that the user feels for the set signal frequency and the set signal amplitude;

[0092] Record the signal frequency corresponding to the minimum vibration that the user feels for the set signal amplitude and the set signal length.

[0093] Specifically, the user's perception threshold of signal amplitude, signal length and signal frequency can be tested in the form of question and answer.

[0094] For example, when recording the signal length corresponding to the minimum vibration that a user can feel for a given signal frequency and signal length, the signal amplitude corresponding to the minimum vibration that a user can feel can be given for a single-frequency sinusoidal excitation signal y = Asin(2πft), where A is the signal amplitude and f is the signal frequency. The amplitude of the excitation signal is adjusted when the user confirms that he or she can just feel the vibration, and the amplitude 1 at this time is recorded as the signal amplitude corresponding to the minimum vibration that a user can feel for a signal frequency of frequency 1 and a signal length of length 1. A data group is formed by frequency 1, length 1, and amplitude 1. For a single-frequency excitation signal of frequency 1, the signal length is changed, and the signal amplitude corresponding to the minimum vibration that a user can feel is recorded to form a plurality of data groups associated with the signal frequency. The frequency of the excitation signal is changed, and the above steps are repeated to form a haptic perception reference table subtable 1. For example, the above steps are repeated to record the signal amplitude corresponding to the minimum vibration that a user can feel for a given signal frequency and signal length at a frequency interval Δf = 10 Hz from 50 Hz to 500 Hz. The specific test method can refer to the limit method. In the first measurement, a given voltage amplitude A1 is measured. Under the driving of the voltage, the user can clearly feel the vibration haptic signal of the mobile phone. In the second measurement, a given signal 0.5A1 is measured. If the haptic signal can still be clearly felt, a given signal 0.25A1 is measured. If the haptic signal cannot be clearly felt, a given signal 0.75A1 is measured. The above steps are repeated until the minimum vibration intensity that the user can feel is determined. Other methods, such as the average error method and the constant stimulation method, are also feasible, and are not limited herein.

[0095] Signal frequency Signal length Signal amplitude Frequency 1 Length 1 Amplitude 1 Frequency 1 Length 2 Amplitude 2 Frequency 1 Length 3 Amplitude 3 Frequency 2 Length 1 Amplitude 4 Frequency 2 Length 2 Amplitude 5 Frequency 2 Length 3 Amplitude 6

[0096] Table 1 Haptic perception reference table subtable 1

[0097] When recording the signal length corresponding to the minimum vibration that a user can feel for a given signal amplitude and signal length, the haptic perception reference table subtable 2 can be established by referring to the establishment process of the haptic perception reference table subtable 1.

[0098] Signal frequency Signal amplitude Signal length Frequency 1 Amplitude 7 Length 4 Frequency 1 Amplitude 8 Length 5 Frequency 1 Amplitude 9 Length 6 Frequency 2 Amplitude 7 Length 7 Frequency 2 Amplitude 8 Length 8 Frequency 2 Amplitude 9 Length 9

[0099] Table 2 Haptic perception reference table subtable 2

[0100] When recording the signal frequency corresponding to the minimum vibration that a user can feel for a given signal amplitude and signal length, the haptic perception reference table subtable 3 can be established by referring to the establishment process of the haptic perception reference table subtable 1.

[0101] Signal amplitude Signal length Signal frequency Amplitude 10 Length 10 Frequency 3 Amplitude 10 Length 11 Frequency 4 Amplitude 10 Length 12 Frequency 5 Amplitude 11 Length 10 Frequency 6 Amplitude 11 Length 11 Frequency 7 Amplitude 11 Length 12 Frequency 8

[0102] Table 3 Haptic perception reference table subtable 3

[0103] The haptic perception reference table sub-table 1, the haptic perception reference table sub-table 2 and the haptic perception reference table sub-table 3 constitute the haptic perception reference table.

[0104] According to the haptic perception reference table sub-table 1, the haptic perception reference table sub-table 2 and the haptic perception reference table sub-table 3, it can be seen that for the same signal frequency, the haptic perception reference table has multiple data groups associated with the signal frequency, which all satisfy that the user can just feel the vibration feedback. For example, for the frequency 1, the data group consisting of the frequency 1, the length 1 and the amplitude 1, the data group consisting of the frequency 1, the length 2 and the amplitude 2, and the data group consisting of the frequency 1, the length 3 and the amplitude 3, all satisfy that the user can just feel the vibration feedback. The signal frequency, the signal amplitude and the signal length in the same data group have a corresponding relationship with each other. According to the haptic perception reference table associated with the user, the specific process of selecting a pair of signal amplitude and signal length corresponding to the original signal frequency can be that all the arrays including the same frequency as the original signal frequency are found in the haptic perception reference table, and a signal amplitude and a signal length in a randomly selected array from the arrays are obtained as a pair of signal amplitude and signal length corresponding to the original signal frequency. When the haptic perception reference table associated with the user does not have the same signal frequency as the original signal frequency, the signal amplitude and the signal length can also be obtained from the array having a frequency close to the original signal frequency, which is not limited herein. The signal amplitude and the signal length corresponding to the original signal frequency obtained from the haptic perception reference table associated with the user are used to determine the excitation signal amplitude and the excitation signal length corresponding to the user and the operation.

[0105] In some embodiments, the haptic perception reference table records multiple data groups consisting of signal frequency, signal amplitude and signal length when the user can feel the best vibration feedback. The establishment process of the haptic perception reference table can include the following steps:

[0106] Record the signal amplitude corresponding to the best vibration felt by the user for the set signal frequency and the set signal length;

[0107] Record the signal length corresponding to the best vibration felt by the user for the set signal frequency and the set signal amplitude;

[0108] Record the signal frequency corresponding to the best vibration felt by the user for the set signal amplitude and the set signal length.

[0109] In the embodiment, the specific process of establishing the haptic perception table can refer to the process of establishing the haptic perception table when the haptic perception table records the multiple data groups composed of the signal frequency, the signal amplitude and the signal length at which the user can just feel the vibration feedback in the foregoing embodiment, and details are not repeated herein. In the embodiment, the specific process of selecting the pair of signal amplitude and signal length corresponding to the original signal frequency according to the haptic perception table associated with the user can refer to the corresponding process when the haptic perception table records the multiple data groups composed of the signal frequency, the signal amplitude and the signal length at which the user can just feel the vibration feedback in the foregoing embodiment, and details are not repeated herein.

[0110] S203: determining the excitation signal amplitude and the excitation signal length corresponding to the user and the operation according to the signal amplitude and the signal length.

[0111] In this step, the signal amplitude can be directly determined as the excitation signal amplitude corresponding to the user and the operation, and the signal length can be directly determined as the excitation signal length corresponding to the user and the operation. Alternatively, the excitation signal amplitude can be determined according to the signal amplitude and the signal amplitude adjustment parameter associated with the user and the operation, and the excitation signal length can be determined according to the signal length and the signal length adjustment parameter associated with the user and the operation.

[0112] Specifically, in some embodiments, the signal amplitude is determined as the excitation signal amplitude corresponding to the user and the operation, and the signal length is determined as the excitation signal length corresponding to the user and the operation. That is, the signal amplitude can be directly determined as the excitation signal amplitude corresponding to the user and the operation, and the signal length can be directly determined as the excitation signal length corresponding to the user and the operation, which can meet the feeling characteristics of the user.

[0113] In some embodiments, the signal amplitude is determined as the excitation signal amplitude corresponding to the user and the operation, and the signal length is determined as the excitation signal length corresponding to the user and the operation, which cannot completely meet the feeling characteristics of the user. Then, the signal amplitude and the signal length can be further adjusted according to the signal amplitude adjustment parameter and the signal length adjustment parameter associated with the user and the operation, and the adjusted signal amplitude and the adjusted signal length are respectively taken as the excitation signal amplitude and the excitation signal length. For example, in a mobile phone game scene, the user can adjust the touch feeling through the editing function in the game to achieve the best touch feeling, and the mobile phone records the related adjustment parameters and takes the adjustment of the signal amplitude and the signal length as the signal amplitude adjustment parameter and the signal length adjustment parameter associated with the user and the operation, so as to call the adjustment parameters when the adjustment step of the signal amplitude and the signal length is performed. In other scenes, corresponding adjustment can also be made, which is not limited herein.

[0114] The method for providing haptic feedback provided by the embodiments of the present disclosure further comprises determining the frequency of the excitation signal corresponding to the user and the operation.

[0115] In some embodiments, the frequency of the original signal corresponding to the operation obtained from the original waveform library can be directly used as the frequency of the excitation signal.

[0116] In some embodiments, the frequency of the excitation signal can be determined according to the frequency of the original signal and the signal frequency adjustment parameter associated with the user and the operation. For example, when the original signal frequency directly used as the frequency of the excitation signal cannot fully meet the characteristics of the user's experience, the signal frequency can be further adjusted according to the signal frequency adjustment parameter associated with the user and the operation, and the adjusted signal frequency can be used as the frequency of the excitation signal. For example, in the scenario of a mobile phone game, the user can adjust the touch feeling through the editing function in the game to achieve the best touch feeling, and the mobile phone records the relevant adjustment parameters and uses the adjustment of the signal frequency as the signal frequency adjustment parameter associated with the user and the operation, so as to facilitate the calling of the adjustment of the signal frequency. In other scenarios, corresponding adjustments can also be made, which are not limited herein.

[0117] In some embodiments, at least one of the signal frequency and the signal amplitude of the vibration excitation signal generated in response to different operations of the user can be different, so as to ensure that the user can effectively distinguish the haptic feedback of different operations in the same application scenario. For example, the mobile phone can generate a first vibration excitation signal in response to a first operation of the user based on first vibration associated information corresponding to the user and the first operation, and the first vibration associated information comprises a first excitation signal frequency, a first excitation signal amplitude and a first excitation signal length. The mobile phone can generate a second vibration excitation signal in response to a second operation of the user based on second vibration associated information corresponding to the user and the second operation, and the second vibration associated information comprises a second excitation signal frequency, a second excitation signal amplitude and a second excitation signal length. The second excitation signal frequency is different from the first excitation signal frequency, and / or the second excitation signal amplitude is different from the first excitation signal amplitude. The first operation and the second operation can be any two different operations in the same application scenario, which are not limited herein.

[0118] In some embodiments, the second excitation signal has the same frequency as the first excitation signal, the second excitation signal has a different amplitude than the first excitation signal, and the difference between the second excitation signal amplitude and the first excitation signal amplitude is greater than or equal to an amplitude resolution threshold corresponding to the signal frequency. Specifically, when two different operations of a user correspond to excitation signals having the same frequency, different amplitudes of the excitation signals corresponding to the different operations are used to make the user feel different haptic feedback effects. In specific implementation, the difference between the second excitation signal amplitude and the first excitation signal amplitude can be greater than or equal to an amplitude resolution threshold corresponding to the signal frequency, so as to improve the user's experience. The amplitude resolution threshold is used to represent the minimum difference between two different signal amplitudes under the same signal frequency, so that the user can feel the difference in haptic feedback.

[0119] The amplitude resolution threshold corresponding to a signal frequency can be determined by a limit method. For example, for an excitation signal with a frequency of f = 100 Hz, when the reference signal voltage (i.e., signal amplitude) is A1, the user can clearly feel the haptic signal; when the signal voltage is increased to 2A1, the user can determine whether the difference can be clearly felt, and if so, the signal voltage is reduced to 1.5A1; and so on, until the user cannot feel the difference, and the difference between the signal voltage at this time and the reference signal voltage ΔA1 is recorded as the amplitude resolution threshold corresponding to the signal amplitude A1. For the excitation signal with a frequency of f = 100 Hz, the reference voltages A2, A3, etc. can also be determined and recorded to correspond to the amplitude resolution thresholds, so as to be called later. According to Weber's theorem, the difference threshold limit under all stimulus references can also be calculated (Weber's theorem: C = ΔΨ / Ψ, ΔΨ represents the minimum difference threshold limit, Ψ represents the intensity of the standard stimulus, and C is a constant value of a specific sensory channel, also called Weber ratio or Weber fraction).

[0120] In some embodiments, the second excitation signal has the same amplitude as the first excitation signal, the second excitation signal has a different frequency than the first excitation signal, and the difference between the second excitation signal frequency and the first excitation signal frequency is greater than or equal to a frequency resolution threshold corresponding to the signal amplitude. Specifically, when two different operations of a user correspond to excitation signals having the same amplitude, different frequencies of the excitation signals corresponding to the different operations are used to make the user feel different haptic feedback effects. In specific implementation, the difference between the second excitation signal frequency and the first excitation signal frequency can be greater than or equal to a frequency resolution threshold corresponding to the signal frequency, so as to improve the user's experience. The frequency resolution threshold is used to represent the minimum difference between two different signal frequencies under the same signal amplitude, so that the user can feel the difference in haptic feedback.

[0121] In some embodiments, when generating the vibration excitation signal based on the vibration association information corresponding to the user and the operation, the vibration excitation signal can be directly generated according to the excitation signal frequency, the excitation signal amplitude and the excitation signal length included in the vibration association information. Thus, the vibration excitation signal has the excitation signal frequency, the excitation signal amplitude and the excitation signal length included in the vibration association information.

[0122] In some embodiments, when generating the vibration excitation signal based on the vibration association information corresponding to the user and the operation, the vibration excitation signal can be directly generated according to the excitation signal frequency, the excitation signal amplitude and the excitation signal length included in the vibration association information. Thus, the vibration excitation signal has the excitation signal frequency, the excitation signal amplitude and the excitation signal length included in the vibration association information.

[0123] In the embodiments of the present disclosure, before generating the vibration excitation signal based on the vibration association information corresponding to the user and the operation, the vibration association information corresponding to the user and the operation is determined according to the identity information of the user. In specific implementation, the vibration association information corresponding to the user and the operation can be stored locally in the haptic feedback device or in the server connected to the haptic feedback device after being established, so as to be called when used. Since the same haptic feedback device or the same application program in the device can be used by multiple people, the vibration association information corresponding to multiple different users and their operations can be stored in the device locally or in the cloud server. Therefore, before generating the vibration excitation signal based on the vibration association information corresponding to the user and the operation, the vibration association information corresponding to the user and the operation is determined according to the identity information of the user, so as to realize the differentiated haptic feedback for different users. In specific implementation, the identity information of the user can be determined according to at least one of the fingerprint recognition result, the portrait recognition result and the account password verification result, which is not limited herein.

[0124] Figure 3 A structural schematic diagram of the haptic feedback device provided in the embodiments of the present disclosure.

[0125] The second aspect of the present disclosure also provides a haptic feedback device. As shown in Figure 3 the haptic feedback device 300 includes a response module 301 and a vibration module 302.

[0126] The response module 301 is configured to generate a vibration excitation signal based on vibration association information corresponding to a user and an operation in response to an operation of the user; the vibration association information includes an excitation signal frequency, an excitation signal amplitude and an excitation signal length.

[0127] The vibration module 302 is configured to generate vibration according to the vibration excitation signal. The vibration module 302 can specifically include a linear motor, a piezoelectric ceramic, an electromagnetic valve, etc., which are not limited herein.

[0128] In addition to the above Figure 3 In addition to the above

[0129] The device provided by the embodiments of the present disclosure can implement all the method steps in the method embodiments and achieve the same technical effects. Here, the same parts and beneficial effects of the method embodiments will not be described in detail. In specific implementation, the haptic feedback device can be a mobile phone, a tablet, a wearable device, a VR device, an AR device, a vehicle-mounted display, a gamepad, etc. with vibration feedback function, which are not limited herein.

[0130] Figure 4 The second flowchart of the haptic feedback method provided by the embodiments of the present disclosure.

[0131] The third aspect of the present disclosure also provides a haptic feedback method, which can be executed by a haptic feedback device. As Figure 4 The haptic feedback method provided by the embodiments of the present disclosure includes the following steps:

[0132] S401: Obtain the transfer function of the target device and the vibration association information of the target device corresponding to the user and the operation; the user is the current user of the device;

[0133] In the embodiments of the present disclosure, the haptic feedback device acquires a transfer function of a target device and vibration-related information of the target device corresponding to a user and an operation, for generating a vibration excitation signal subsequently. Specifically, the target device can be a commonly used device of a current user of the haptic feedback device, and the haptic feedback device acquires, from the target device, vibration-related information of the target device corresponding to the current user of the haptic feedback device. The vibration-related information is the same as that described in the haptic feedback method provided in the first aspect of the present disclosure, and will not be repeated here. The haptic feedback device acquires the transfer function of the target device and the vibration-related information of the target device corresponding to the user and the operation, which can be acquired locally from the target device or from the cloud, and will not be limited here. For example, the haptic feedback device can be a vehicle-mounted display, and the target device can be a mobile phone. The vehicle-mounted display can directly acquire relevant information from the mobile phone through carplay, hicar, carlife and other vehicle-machine interconnection methods. For example, the mobile phone uploads the transfer function of the mobile phone and the vibration-related information corresponding to the user and the operation to the game server through a game app, and the vehicle-mounted display can acquire the transfer function of the mobile phone and the vibration-related information corresponding to the user and the operation from the game server when logging into the same game app, which will not be limited here.

[0134] The transfer function RFa(ω) of the target device is used to represent the relationship between the vibration excitation signal Va(t) of the target device and the vibration information Ua(t) of the target device, and the transfer function RFa(ω) of the target device can be defined as: RFa(ω) = Ua(ω) / V1(ω), wherein Va(ω) is the frequency domain response of the vibration excitation signal Va(t) of the target device after Fourier transform, and Ua(ω) represents the frequency domain response of the vibration information Ua(t) of the target device after Fourier transform. The vibration information Ua(t) of the target device can be represented by the amplitude of the vibration of the target device, the acceleration of the vibration or the speed of the vibration, and the vibration information Ua(t) of the target device represented by the amplitude of the vibration of the target device, the acceleration of the vibration or the speed of the vibration has the same effect. Assuming that the amplitude of the vibration of the target device is A wherein A m is the maximum amplitude, f is the frequency, is the initial phase, the speed of the vibration of the target device is The acceleration of the vibration of the target device is

[0135] The acceleration, amplitude, and vibration speed of the vibration of the target device can be measured by a Doppler laser vibration meter under a given vibration excitation signal of the target device, or can be tested by an accelerometer. For example, the acceleration, amplitude, and vibration speed of the vibration of the target device can be measured by an acceleration sensor provided in the target device, which is not limited herein. After the acceleration, amplitude, and vibration speed of the vibration of the target device are measured, one of the acceleration, amplitude, and vibration speed of the vibration of the target device is selected for Fourier transform, and the Fourier-transformed vibration excitation signal of the target device is compared to obtain the transfer function of the target device, and the transfer function of the target device can be stored locally or in the cloud, which is not limited herein.

[0136] S402: In response to the operation of the user, a local vibration excitation signal is generated based on the transfer function of the device, the transfer function of the target device, and the vibration association information of the target device corresponding to the user and the operation.

[0137] The transfer function RFb(ω) of the haptic feedback device is used to represent the relationship between the vibration excitation signal Vb(t) of the haptic feedback device and the vibration information Ub(t) of the haptic feedback device, and the transfer function RFb(ω) of the haptic feedback device can be defined as: RFb(ω)=Ub(ω) / Vb(ω), wherein Vb(ω) is the frequency domain response of the vibration excitation signal Vb(t) of the haptic feedback device after Fourier transform, and Ub(ω) represents the frequency domain response of the vibration information u(t) of the target device after Fourier transform. The transfer function of the haptic feedback device can be determined in the same manner as the target device described above.

[0138] According to the transfer function RFa(ω)=Ua(ω) / V1(ω) of the target device and the transfer function RFb(ω)=Ub(ω) / Vb(ω) of the haptic feedback device, when the vibration information Ua(ω) of the target device is the same as the vibration information Ua(ω) of the haptic feedback device, Vb(ω)=RFa(ω)×V1(ω) / RFb(ω) can be obtained, wherein the vibration excitation signal V1(ω) of the target device is generated based on the vibration association information of the target device corresponding to the user and the operation.

[0139] In specific implementation, the local vibration excitation signal is the vibration excitation signal Vb(ω) of the haptic feedback device, and Vb(ω) satisfies Vb(ω)=RFa(ω)×V1(ω) / RFb(ω), so that the haptic feedback device can generate a local vibration excitation signal based on the transfer function of the device, the transfer function of the target device, and the vibration association information of the target device corresponding to the user and the operation, and the local vibration excitation signal can make the haptic feedback device generate the same or similar vibration effect as the user performs the same operation on the target device in response to the operation of the user.

[0140] S403: generating vibration according to the local vibration excitation signal.

[0141] The haptic feedback device generates vibration according to the local vibration excitation signal, and the same or similar vibration effect or haptic feedback effect as when the current user performs the same operation on the target device can be generated.

[0142] Through the above haptic feedback method provided by the embodiments of the present disclosure, the user can obtain the same or similar haptic feedback effect that conforms to the user's usage habit when using different terminal devices, greatly improving the user experience.

[0143] Figure 5 Structure diagram two of the haptic feedback device provided by the embodiments of the present disclosure.

[0144] The fourth aspect of the present disclosure also provides a haptic feedback device. As shown in the embodiments of the present disclosure, Figure 5 The haptic feedback device 500 includes an acquisition module 501, a response module 502, and a vibration module 503.

[0145] The acquisition module 501 is configured to acquire the transfer function of the target device and the vibration association information of the target device corresponding to the user and the operation;

[0146] The response module 502 is configured to generate a vibration excitation signal based on the vibration association information corresponding to the user and the operation in response to the operation of the user; the vibration association information includes excitation signal frequency, excitation signal amplitude, and excitation signal length.

[0147] The vibration module 503 is configured to generate vibration according to the vibration excitation signal. The vibration module 503 can specifically include a linear motor, a piezoelectric ceramic, an electromagnetic valve, etc., which are not limited here.

[0148] In addition to the above Figure 5 In addition to the above modules shown in the embodiments of the present disclosure, the haptic feedback device provided by the embodiments of the present disclosure also includes other modules required to realize the haptic feedback method provided by the third aspect of the present disclosure and other specific functions, which are not limited here.

[0149] The above device provided by the embodiments of the present disclosure can implement all method steps of the haptic feedback method provided by the third aspect of the present disclosure, and can achieve the same technical effects. Here, the same parts and beneficial effects in the method embodiments will not be described in detail. In specific implementation, the haptic feedback device can be a mobile phone, a tablet, a wearable device, a VR device, an AR device, a vehicle-mounted display, a gamepad, etc. with vibration feedback function, which is not limited here.

[0150] Figure 6 Structure diagram of the electronic device provided by the embodiments of the present disclosure.

[0151] The fifth aspect of the present disclosure also provides an electronic device, which can implement the function of the haptic feedback device provided in the second aspect or the function of the haptic feedback device provided in the fourth aspect. Referring to Figure 6 , the electronic device comprises:

[0152] at least one processor 601 and a memory 602 connected with the at least one processor 601, and the specific connection medium between the processor 601 and the memory 602 is not limited in the embodiments of the present disclosure, Figure 6 In the embodiment, the processor 601 and the memory 602 are connected through the bus 600. The bus 600 is represented by a thick line in Figure 6 , and the connection mode between other components is only schematically illustrated and is not limited. The bus 600 can be divided into an address bus, a data bus, a control bus, etc., for convenience, Figure 6 In the embodiment, only one thick line is used to represent the bus, but it does not mean that there is only one bus or only one type of bus. Alternatively, the processor 601 can also be referred to as a controller, and the name is not limited.

[0153] In the embodiments of the present disclosure, the memory 602 stores instructions executable by the at least one processor 601, and the at least one processor 601 can execute the haptic feedback method provided in the first aspect or the haptic feedback method provided in the third aspect by executing the instructions stored in the memory 602. The processor 601 can implement the functions of various modules in the device as shown in Figure 3 or Figure 5 .

[0154] Among them, the processor 601 is the control center of the device, and can connect various parts of the entire control device through various interfaces and lines, and through running or executing the instructions stored in the memory 602 and calling the data stored in the memory 602, the device Various functions and processing data, thereby overall monitoring the device.

[0155] In a possible design, the processor 601 can include one or more processing units, and the processor 601 can integrate an application processor and a modem processor, wherein the application processor mainly processes operating systems, user interfaces, and application programs, etc., and the modem processor mainly processes wireless communication. It can be understood that the above-mentioned modem processor can also not be integrated into the processor 601. In some embodiments, the processor 601 and the memory 602 can be implemented on the same chip, and in some embodiments, they can also be implemented on independent chips respectively.

[0156] The processor 601 can be a general processor, such as a central processing unit (CPU), a digital signal processor, an application-specific integrated circuit, a field programmable gate array or other programmable logic device, a discrete gate or transistor logic component, a discrete hardware component, and can implement or execute the methods, steps and logic block diagrams disclosed in the embodiments of the present disclosure. The general processor can be a microprocessor or any conventional processor. The steps of the haptic feedback method provided in the first aspect or the third aspect can be directly embodied as execution by a hardware processor, or be executed by a combination of hardware and software modules in the processor.

[0157] The memory 602 is a non-volatile computer readable storage medium, which can be used to store non-volatile software programs, non-volatile computer executable programs and modules. The memory 602 can include at least one type of storage medium, such as flash memory, hard disk, multimedia card, card type memory, random access memory (RAM), static random access memory (SRAM), programmable read-only memory (PROM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), magnetic storage, magnetic disk, optical disk, etc. The memory 602 is any other medium capable of carrying or storing desired program code in the form of instructions or data structures and capable of being accessed by a computer, but is not limited thereto. The memory 602 in the embodiments of the present disclosure can also be a circuit or any other device capable of realizing a storage function, used to store program instructions and / or data.

[0158] By designing and programming the processor 601, the code corresponding to the haptic feedback method provided in the first aspect or the haptic feedback method provided in the third aspect can be fixed into the chip, so that the chip can execute the steps of the haptic feedback method of the embodiments shown in the first aspect or the third aspect at runtime. Figure 1 Or Figure 4 By designing and programming the processor 601, the code corresponding to the haptic feedback method provided in the first aspect or the haptic feedback method provided in the third aspect can be fixed into the chip, so that the chip can execute the steps of the haptic feedback method of the embodiments shown in the first aspect or the third aspect at runtime.

[0159] In a sixth aspect, the embodiments of the present disclosure provide a computer storage medium, which includes computer program codes, and when the computer program codes are executed on a computer, the computer is caused to perform the method of haptic feedback according to any one of the preceding aspects. Since the computer storage medium solves problems in the same principle as the method of haptic feedback, the implementation of the computer storage medium can be referred to the implementation of the method, and the repeated parts will not be described herein.

[0160] In the implementation, the computer storage medium can include a universal serial bus flash drive (USB), a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk, and other storage media that can store program codes.

[0161] In a seventh aspect, the embodiments of the present disclosure also provide a computer program product, which includes computer program codes, and when the computer program codes are executed on a computer, the computer is caused to perform the method of haptic feedback according to any one of the preceding aspects. Since the computer program product solves problems in the same principle as the method of haptic feedback, the implementation of the computer program product can be referred to the implementation of the method, and the repeated parts will not be described herein.

[0162] The computer program product can adopt any combination of one or more readable media. The readable medium can be a readable signal medium or a readable storage medium. The readable storage medium can be, but is not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or apparatus, or any combination of the above. More specific examples (non-exhaustive list) of readable storage media include an electrical connection having one or more wires, a portable disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above.

[0163] The method in the present disclosure can be implemented by software, hardware, firmware or any combination thereof, in whole or in part. When implemented by software, it can be implemented in the form of a computer program product, in whole or in part. The computer program product includes one or more computer programs or instructions. When the computer programs or instructions are loaded and executed on a computer, the processes or functions described in the present disclosure are performed, in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network, a network device, a user equipment, a core network device, an OAM or other programmable devices.

[0164] The computer program or instructions can be stored in or transferred from one computer-readable medium to another computer-readable medium, e.g., from one website, computer, server, or data center to another website, computer, server, or data center, through wired or wireless means. The computer-readable medium can be any available medium accessible by a computer or data storage device such as a server, data center, etc. that integrates one or more available media. The available medium can be a magnetic medium, such as a floppy disk, a hard disk, or a magnetic tape; an optical medium, such as a digital video disc; or a semiconductor medium, such as a solid-state disk. The computer-readable medium can be a volatile or non-volatile storage medium, or can include both volatile and non-volatile storage media.

[0165] Figure 7 The method for synchronizing haptic feedback of the interconnection device system provided by the embodiments of the present disclosure.

[0166] The eighth aspect of the present disclosure also provides a method for synchronizing haptic feedback of an interconnection device system. In the embodiments of the present disclosure, the interconnection device system includes a requesting device and a receiving device interconnected with the requesting device, and the receiving device agrees to the interconnection request of the requesting device and is interconnected with the requesting device. During the interconnection, the requesting device can synchronize its image and audio to the receiving device for playing, and can synchronize its vibration to the device for feedback, and the user can control the requesting device by operating the receiving device. For example, the requesting device is a smart terminal device such as a mobile phone, and the receiving device can be a smart terminal device such as a car display, and the mobile phone can be interconnected with the car display through interconnection schemes such as carplay, hicar, and carlife. In specific implementations, the requesting device can also be a tablet, a wearable device, a VR device, an AR device, a car display, etc., and the receiving device can also be a mobile phone, a tablet, a wearable device, a VR device, an AR device, etc., which are not limited herein. The requesting device and the receiving device can be interconnected through wireless or wired means, which are not limited herein. As shown in the figure, in the embodiments of the present disclosure, the method for synchronizing haptic feedback of the interconnection device system includes the following steps: Figure 7 The method for synchronizing haptic feedback of the interconnection device system includes the following steps:

[0167] S701: The receiving device acquires the vibration association information of the requesting device corresponding to the user and the operation, and the transfer function of the requesting device;

[0168] S702: The receiving device generates a vibration excitation signal based on the transfer function of the receiving device, the vibration association information of the requesting device corresponding to the user and the operation, and the transfer function of the requesting device in response to the operation of the user;

[0169] S703: The receiving device generates vibration according to the vibration excitation signal.

[0170] The determination of the transfer function of the requesting device and the transfer function of the receiving device can refer to the related description of the third aspect of the present disclosure about the transfer function, and will not be repeated here. The confirmation process of the vibration association information of the requesting device corresponding to the user and the operation is the same as the vibration association information described in the haptic feedback method provided by the first aspect of the present disclosure, and will not be repeated here.

[0171] In the embodiments of the present disclosure, the user controls the requesting device through the operation of the receiving device. When the receiving device detects the operation of the user, the receiving device generates a vibration excitation signal based on the transfer function of the receiving device, the transfer function of the requesting device, and the vibration association information of the requesting device corresponding to the user and the operation, and generates vibration according to the vibration excitation signal, which can ensure that when the vibration of the requesting device is synchronized to the receiving device, the vibration effect generated by the receiving device is the same or similar to the vibration effect generated by the requesting device in response to the same operation, which conforms to the user habit and feeling characteristics of the user.

[0172] Figure 8A One of the structure schematic diagrams of the interconnected device system provided by the present disclosure; Figure 8B One of the structure schematic diagrams of the interconnected device system provided by the present disclosure; Figure 8C One of the structure schematic diagrams of the interconnected device system provided by the present disclosure; Figure 8D One of the structure schematic diagrams of the interconnected device system provided by the present disclosure.

[0173] In some embodiments, the receiving device obtains the vibration association information of the requesting device corresponding to the user and the operation and the transfer function of the requesting device, which can be specifically that the receiving device obtains the vibration association information of the requesting device corresponding to the user and the operation and the transfer function of the requesting device from the requesting device. For example, as shown in Figure 8A - Figure 8D the receiving device directly obtains the vibration association information of the requesting device corresponding to the user and the operation and the transfer function of the requesting device from the requesting device through interconnection with the requesting device.

[0174] In some embodiments, the receiving device obtains the vibration association information of the requesting device corresponding to the user and the operation and the transfer function of the requesting device, which can be specifically that the receiving device obtains the vibration association information of the requesting device corresponding to the user and the operation and the transfer function of the requesting device from the requesting device. For example, as shown in Figure 8A - Figure 8DAs shown, when the receiving device and the requesting device are interconnected for the first time, the receiving device can obtain the vibration correlation information corresponding to the user and the operation of the requesting device and the transfer function of the requesting device from the requesting device, and store the vibration correlation information corresponding to the user and the operation of the requesting device and the transfer function of the requesting device in the receiving device locally. In the next interconnection and subsequent interconnection, the receiving device directly obtains the vibration correlation information corresponding to the user and the operation of the requesting device and the transfer function of the requesting device from the receiving device locally.

[0175] In an embodiment, the receiving device obtains the vibration correlation information corresponding to the user and the operation of the requesting device and the transfer function of the requesting device, which can specifically be that the receiving device obtains the vibration correlation information corresponding to the user and the operation of the requesting device and the transfer function of the requesting device from a cloud server connected by the receiving device. For example, as shown in Figure 8A As shown, the receiving device and the requesting device are connected to the same cloud server, and the requesting device can upload the vibration correlation information corresponding to the user and the operation of the requesting device and the transfer function of the requesting device to the cloud server, and the receiving device directly obtains the vibration correlation information corresponding to the user and the operation of the requesting device and the transfer function of the requesting device from the cloud server. For example, as shown in Figure 8C and Figure 8D As shown, the receiving device and the requesting device are connected to different cloud servers respectively, and when the receiving device and the requesting device are interconnected for the first time, the receiving device can obtain the vibration correlation information corresponding to the user and the operation of the requesting device and the transfer function of the requesting device from the requesting device, and upload the vibration correlation information corresponding to the user and the operation of the requesting device and the transfer function of the requesting device to the cloud server for storage. In the next interconnection and subsequent interconnection, the receiving device directly obtains the vibration correlation information corresponding to the user and the operation of the requesting device and the transfer function of the requesting device from the cloud server connected by the receiving device.

[0176] In some embodiments, as shown in Figure 8B The vibration correlation information corresponding to the user and the operation of the requesting device and the transfer function of the requesting device are stored in the local of the requesting device.

[0177] In some embodiments, as shown in Figure 8A , 8C and 8D, the vibration correlation information corresponding to the user and the operation of the requesting device and the transfer function of the requesting device are stored in the cloud server connected by the requesting device.

[0178] In some embodiments, as shown in Figure 8DAs shown, the interconnected device system includes a plurality of request devices, and the plurality of request devices are connected to the same receiving device; one request device corresponds to one user. In specific implementation, the receiving device generates a vibration excitation signal based on the transfer function of the receiving device, the vibration association information of the request device corresponding to the user and the operation, and the transfer function of the request device in response to the operation of the user. Specifically, the receiving device determines the request device corresponding to the user currently making the operation, and generates a vibration excitation signal based on the transfer function of the receiving device, the vibration association information of the request device corresponding to the user currently making the operation and the operation, and the transfer function of the request device corresponding to the user currently making the operation. In specific implementation, when the receiving device is connected to multiple request devices at the same time, the receiving device synchronizes the request device corresponding to the user currently operating the receiving device. For example, as shown in Figure 8D As shown, when the user corresponding to the request device 1 is operating the receiving device, the receiving device synchronously plays the audio and video content of the request device 1, and generates a vibration excitation signal based on the vibration association information of the request device 1 corresponding to the user and the operation, and the transfer function of the request device 1.

[0179] In specific implementation, the receiving device can confirm the user currently making the operation according to the information collected by the camera, and further confirm the request device corresponding to the user. For example Figure 8D As shown, the receiving device can determine that the left user is operating the receiving device according to the information collected by the camera, and further confirm that the request device corresponding to the user currently making the operation is the request device 1. The receiving device can also determine the request device corresponding to the user currently operating the receiving device according to other manners, which are not limited herein.

[0180] In a ninth aspect of the present disclosure, an interconnected device system is provided, as shown in Figure 8A and Figure 8D As shown, the interconnected device system includes a request device and a receiving device interconnected with the request device. The receiving device is configured to acquire the vibration association information of the request device corresponding to the user and the operation, and the transfer function of the request device; generate a vibration excitation signal based on the transfer function of the receiving device, the vibration association information of the request device corresponding to the user and the operation, and the transfer function of the request device in response to the operation of the user; and generate vibration according to the vibration excitation signal.

[0181] In some embodiments, the interconnected device system includes a plurality of request devices, and the plurality of request devices are connected to the same receiving device; one request device corresponds to one user. The receiving device is configured to determine the request device corresponding to the user currently making the operation, and generate a vibration excitation signal based on the transfer function of the receiving device, the vibration association information of the request device corresponding to the user currently making the operation and the operation, and the transfer function of the request device corresponding to the user currently making the operation.

[0182] The tenth aspect of the present disclosure also provides a method for synchronizing haptic feedback of an interconnection device system, the interconnection device system comprising a requesting device and a receiving device interconnected with the requesting device, wherein the method comprises:

[0183] The requesting device acquires a transfer function of the receiving device;

[0184] The requesting device generates a vibration excitation signal based on the transfer function of the requesting device, vibration association information of the requesting device corresponding to the user and the operation, and the transfer function of the receiving device in response to the operation of the user;

[0185] The receiving device receives the vibration excitation signal and generates vibration according to the vibration excitation signal.

[0186] Taking a mobile phone as a requesting device and projecting to a car display as an example, when a user operates a game through the car display, the mobile phone acts as a processor and the car display only acts as a display screen. When a haptic feedback function of a certain game prop needs to be triggered in the game, the mobile phone reads the transfer function RFb(ω) of the car display and the vibration association information corresponding to the prop locally stored by the mobile phone, determines the mobile phone end driving signal V1(t) according to the vibration association information, and calculates the vibration excitation signal of the car end with the first principle that the user can feel the same vibration information, as follows:

[0187] RFa(ω)=Ua(ω) / V1(ω)

[0188] RFb(ω)=Ub(ω) / Vb(ω)

[0189] Wherein Ua(ω)=Ub(ω), the vibration excitation signal of the car display can be obtained as follows:

[0190]

[0191] The vibration excitation signal of the car display can be obtained by performing inverse Fourier transform on Vb(ω). The vibration excitation signal Vb(t) of the car display is calculated, and the mobile phone directly sends it to the car display. The car display generates vibration according to the vibration excitation signal Vb(t).

[0192] Those skilled in the art should understand that the embodiments of the present disclosure can be provided as a method, a system, or a computer program product. Therefore, the present disclosure can take the form of an entirely hardware embodiment, an entirely software embodiment, or an embodiment combining software and hardware aspects. Moreover, the present disclosure can take the form of a computer program product implemented on one or more computer-usable storage media (including, but not limited to, disk storage and optical storage, etc.) containing computer-usable program code.

[0193] The computer program instructions can also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer-implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart block or blocks. Figure 1 one or more flow or blocks. Figure 1 one or more flow or blocks.

[0194] These computer program instructions can also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instructions which implement the function specified in the flowchart block or blocks. Figure 1 one or more flow or blocks. Figure 1 one or more flow or blocks.

[0195] The computer program instructions can also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer-implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart block or blocks. Figure 1 one or more flow or blocks. Figure 1 one or more flow or blocks.

[0196] Obviously, numerous modifications and variations of the present disclosure are possible in light of the above teachings. It is therefore to be understood that within the scope of the appended claims and their equivalents, the present disclosure can be practiced otherwise than as specifically described.

Claims

1. A haptic feedback method, wherein, The method comprises: In response to the operation of the user, generating a vibration excitation signal based on vibration association information corresponding to the user and the operation; the vibration association information comprises an excitation signal frequency, an excitation signal amplitude and an excitation signal length; Generating vibration according to the vibration excitation signal.

2. The method of claim 1, wherein, The determination method of the excitation signal amplitude and the excitation signal length corresponding to the user and the operation comprises: Obtaining an original signal frequency corresponding to the operation from an original waveform library; Obtaining a pair of signal amplitude and signal length corresponding to the original signal frequency according to a tactile sensation reference table associated with the user; Determining the excitation signal amplitude and the excitation signal length corresponding to the user and the operation according to the signal amplitude and the signal length.

3. The method of claim 2, wherein, The determination of the excitation signal amplitude and the excitation signal length corresponding to the user and the operation according to the signal amplitude and the signal length specifically comprises: Determining the signal amplitude as the excitation signal amplitude corresponding to the user and the operation; Determining the signal length as the excitation signal length corresponding to the user and the operation.

4. The method of claim 2, wherein, The determination of the excitation signal amplitude and the excitation signal length corresponding to the user and the operation according to the signal amplitude and the signal length specifically comprises: Determining the excitation signal amplitude according to the signal amplitude and a signal amplitude adjustment parameter associated with the user and the operation; Determining the excitation signal length according to the signal length and a signal length adjustment parameter associated with the user and the operation.

5. The method of claim 2, wherein, The establishment method of the tactile sensation reference table comprises: Recording a signal amplitude corresponding to the minimum vibration felt by the user for a set signal frequency and a set signal length; Recording a signal length corresponding to the minimum vibration felt by the user for a set signal frequency and a set signal amplitude; Recording a signal frequency corresponding to the minimum vibration felt by the user for a set signal amplitude and a set signal length.

6. The method of claim 2, wherein, The establishment method of the sensation threshold reference table comprises: Recording a signal amplitude corresponding to the best vibration felt by the user for a set signal frequency and a set signal length; Recording a signal length corresponding to the best vibration felt by the user for a set signal frequency and a set signal amplitude; Recording a signal frequency corresponding to the best vibration felt by the user for a set signal amplitude and a set signal length.

7. The method of any one of claims 2 to 6, wherein, The determination method of the excitation signal frequency corresponding to the user and the operation comprises: Determining the original signal frequency as the excitation signal frequency.

8. The method of any one of claims 2 to 6, wherein, The determination method of the excitation signal frequency corresponding to the user and the operation comprises: Determining the excitation signal frequency according to the original signal frequency and a signal frequency adjustment parameter associated with the user and the operation.

9. The method of any one of claims 1-8, wherein, The generation of the vibration excitation signal based on the vibration association information corresponding to the user and the operation in response to the operation of the user specifically comprises: In response to a first operation of the user, a first vibration excitation signal is generated based on first vibration association information corresponding to the user and the first operation; the first vibration association information includes a first excitation signal frequency, a first excitation signal amplitude and a first excitation signal length; In response to a second operation of the user, a second vibration excitation signal is generated based on second vibration association information corresponding to the user and the second operation; the second vibration association information includes a second excitation signal frequency, a second excitation signal amplitude and a second excitation signal length; wherein the second excitation signal frequency is different from the first excitation signal frequency, and / or the second excitation signal amplitude is different from the first excitation signal amplitude.

10. The method of claim 9, wherein, The second excitation signal frequency is the same as the first excitation signal frequency, the second excitation signal amplitude is different from the first excitation signal amplitude, and the difference between the second excitation signal amplitude and the first excitation signal amplitude is greater than or equal to the amplitude resolution threshold corresponding to the signal frequency.

11. The method of claim 9, wherein, The second excitation signal amplitude is the same as the first excitation signal amplitude, the second excitation signal frequency is different from the first excitation signal frequency, and the difference between the second excitation signal frequency and the first excitation signal frequency is greater than or equal to the frequency resolution threshold corresponding to the signal amplitude.

12. The method of any one of claims 1-11, wherein, The vibration excitation signal is generated based on the vibration association information corresponding to the user and the operation, specifically including: According to the excitation signal frequency, excitation signal amplitude and excitation signal length included in the vibration association information, the vibration excitation signal is directly generated.

13. The method of any one of claims 1-12, wherein, The vibration excitation signal is generated based on the vibration association information corresponding to the user and the operation, specifically including: According to the original waveform library, an initial excitation signal corresponding to the operation is generated; According to the excitation signal frequency, excitation signal amplitude and excitation signal length included in the vibration association information, the initial excitation signal is adjusted to the vibration excitation signal.

14. The method of any one of claims 1-13, wherein, Before the vibration excitation signal is generated based on the vibration association information corresponding to the user and the operation, it further includes: According to the identity information of the user, the vibration association information corresponding to the user and the operation is determined.

15. The method of claim 14, wherein, The method for determining the identity information of the user includes: According to at least one of the fingerprint recognition result, the portrait recognition result and the account password verification result, the identity information of the user is determined.

16. A haptic feedback device, wherein, It includes: The response module is configured to generate a vibration excitation signal based on vibration association information corresponding to the user and the operation in response to the operation of the user; The vibration association information includes excitation signal frequency, excitation signal amplitude and excitation signal length; The vibration module is configured to generate vibration according to the vibration excitation signal.

17. A haptic feedback method, wherein, The method includes: Obtaining the transfer function of the target device and the vibration association information of the target device corresponding to the user and the operation; the user is the current user of the device; In response to the operation of the user, a vibration excitation signal is generated based on the transfer function of the device, the transfer function of the target device and the vibration association information of the target device corresponding to the user and the operation; Vibration is generated according to the vibration excitation signal.

18. A haptic feedback device, wherein, It includes: An acquisition module configured to acquire a transfer function of a target device and vibration association information of the target device corresponding to a user and an operation; A response module configured to generate a vibration excitation signal based on a transfer function of the device, the transfer function of the target device and the vibration association information of the target device corresponding to the user and the operation in response to an operation of the user; A vibration module configured to generate vibration according to the vibration excitation signal.

19. An electronic device, comprising: The method comprises: a memory for storing a computer program; a processor for executing the computer program stored on the memory to implement the method of any one of claims 1-15, 17.

20. A computer readable storage medium, wherein, The computer program is stored in the computer readable storage medium, and the computer program is executed by the processor to implement the method of any one of claims 1-15, 17.

21. A computer program product, wherein, The computer program product comprises computer program code, which, when executed on a computer, causes the computer to perform the method of any one of claims 1-15, 17.

Images