Haptic feedback synchronization method for interconnected device system and interconnected device system
By acquiring vibration correlation information and transfer function of the requesting device through the receiving device, and generating vibration excitation signal, the problem of inconsistent tactile feedback caused by different device hardware conditions is solved, realizing consistent tactile feedback in device interconnection scenarios and improving user experience.
Patent Information
- Application Number
- PCT/CN2025/102065
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2024-06-26
- Filing Date
- 2025-06-19
- Publication Date
- 2026-01-02
AI Technical Summary
Different devices have different hardware conditions, which results in different vibration effects from the same drive signal on different devices. When users perform the same touch operation on different devices, the tactile feedback effect they feel is also different, making it difficult to obtain the same or similar tactile feedback experience.
By acquiring the vibration association information and transfer function of the requesting device through the receiving device, a vibration excitation signal is generated, so that the vibration effect generated by the receiving device is the same as or similar to the vibration effect of the corresponding operation on the requesting device. This includes storing the vibration association information locally on the receiving device or on a cloud server, and using the transfer function and vibration association information to generate the vibration excitation signal.
In device interconnection scenarios, it improves the user's operating experience, making the vibration effect generated by the receiving device consistent or similar to that of the requesting device, and improving the consistency of tactile feedback for users on different devices.
Smart Images

Figure CN2025102065_02012026_PF_FP_ABST
Abstract
Description
Haptic feedback synchronization method of interconnected device system and interconnected device system
[0001] CROSS-REFERENCE TO RELATED APPLICATIONS
[0002] This application claims priority to the Chinese Patent Application No. 202410841286.X, filed on June 26, 2024, and entitled “Haptic feedback synchronization method of interconnected device system and interconnected device system”, the entire contents of which are incorporated herein by reference. TECHNICAL FIELD
[0003] The present application relates to the field of haptic feedback technology, in particular to a haptic feedback synchronization method of interconnected device system and interconnected device system. BACKGROUND
[0004] Currently, when electronic devices such as mobile phones, tablets, wearable devices, virtual reality (VR) devices, augmented reality (AR) devices, and vehicle displays perform touch operations, they usually vibrate through preset vibration patterns. For example, the device outputs a preset waveform driving signal according to the touch conditions (such as the position of the touch, the pressing situation, etc.) to generate vibration. However, due to the different hardware conditions of different devices, the vibration effects generated by different devices for the same driving signal are not the same, resulting in that users experience different haptic feedback effects when performing the same touch operation on different devices, and users are difficult to obtain the same or similar haptic feedback experience on different devices. SUMMARY
[0005] The present application provides a haptic feedback synchronization method of interconnected device system and interconnected device system to improve the haptic feedback experience.
[0006] In a first aspect, the present application provides a haptic feedback synchronization method of interconnected device system, the interconnected device system comprising a requesting device and a receiving device interconnected with the requesting device, the method comprising:
[0007] The receiving device obtains the vibration association information corresponding to the user and the operation of the requesting device and the transfer function of the requesting device;
[0008] The receiving device generates a vibration excitation signal based on the transfer function of the receiving device, the transfer function of the requesting device, and the vibration association information corresponding to the user and the operation of the requesting device in response to the operation of the user;
[0009] The receiving device generates vibration according to the vibration excitation signal.
[0010] In some embodiments, the receiving device acquires the vibration correlation information corresponding to the user and the operation of the requesting device and the transfer function of the requesting device, specifically including:
[0011] The receiving device acquires the excitation signal parameters of the requesting device and the transfer function of the requesting device from the requesting device.
[0012] In some embodiments, the receiving device acquires the vibration correlation information corresponding to the user and the operation of the requesting device and the transfer function of the requesting device, specifically including:
[0013] The receiving device acquires the excitation signal parameters of the requesting device and the transfer function of the requesting device from the receiving device.
[0014] In some embodiments, the receiving device acquires the vibration correlation information corresponding to the user and the operation of the requesting device and the transfer function of the requesting device, specifically including:
[0015] The receiving device acquires the excitation signal parameters of the requesting device and the transfer function of the requesting device from the cloud server connected to the receiving device.
[0016] In some embodiments, the vibration correlation information corresponding to the user and the operation of the requesting device and the transfer function of the requesting device are stored in the local of the requesting device.
[0017] In some embodiments, the vibration correlation information corresponding to the user and the operation of the requesting device and the transfer function of the requesting device are stored in the cloud server connected to the requesting device.
[0018] In some embodiments, the interconnected device system includes a plurality of requesting devices connected to the same receiving device; one requesting device corresponds to one user;
[0019] The receiving device generates a vibration excitation signal based on the transfer function of the receiving device, the vibration correlation information corresponding to the user and the operation of the requesting device, and the transfer function of the requesting device in response to the operation of the user, specifically including:
[0020] The receiving device determines the requesting device corresponding to the user currently making the operation, and generates a vibration excitation signal based on the transfer function of the receiving device, the vibration correlation information corresponding to the user and the operation of the requesting device corresponding to the user currently making the operation, and the transfer function of the requesting device corresponding to the user currently making the operation.
[0021] In some embodiments, the receiving device determines the requesting device corresponding to the user currently making the operation, specifically including:
[0022] The receiving device determines the requesting device corresponding to the user currently making the operation according to the information collected by the camera.
[0023] In a second aspect, a device interconnection system is provided, including a requesting device and a receiving device interconnected with the requesting device; the receiving device is configured to acquire vibration association information corresponding to a user and an operation of the requesting device and a transfer function of the requesting device; in response to an operation of the user, the receiving device generates a vibration excitation signal based on the transfer function of the receiving device, the vibration association information of the requesting device corresponding to the user and the operation, and the transfer function of the requesting device; and the receiving device generates vibration according to the vibration excitation signal.
[0024] In some embodiments, the device interconnection system includes a plurality of requesting devices connected to the same receiving device; one requesting device corresponds to one user;
[0025] The receiving device is configured to determine the requesting device corresponding to the user currently making the operation, and generate a vibration excitation signal based on the transfer function of the receiving device, the vibration association information of the requesting device corresponding to the user currently making the operation and the operation, and the transfer function of the requesting device corresponding to the user currently making the operation.
[0026] Advantages of the present disclosure:
[0027] The present disclosure provides a haptic feedback synchronization method of a device interconnection system and a device interconnection system. The haptic feedback synchronization method of the device interconnection system includes: a receiving device acquiring vibration association information corresponding to a user and an operation of a requesting device and a transfer function of the requesting device; the receiving device generating a vibration excitation signal based on the transfer function of the receiving device, the transfer function of the requesting device, and the vibration association information of the requesting device corresponding to the user and the operation in response to an operation of the user; and the receiving device generating vibration according to the vibration excitation signal. The haptic feedback synchronization method of the device interconnection system provided by the present disclosure can make the vibration effect generated by the receiving device end be the same as or similar to the vibration effect generated by the requesting device end corresponding to the same operation when the receiving device end is operated, thereby improving the operation experience of the user in the device interconnection scenario. BRIEF DESCRIPTION OF DRAWINGS
[0028] FIG. 1 is a flowchart of a haptic feedback method provided by an embodiment of the present disclosure;
[0029] FIG. 2 is a flowchart of a method for determining an excitation signal amplitude and an excitation signal length corresponding to a user and an operation provided by an embodiment of the present disclosure;
[0030] FIG. 3 is a schematic structural diagram of a haptic feedback device provided by an embodiment of the present disclosure;
[0031] FIG. 4 is a flowchart of a haptic feedback method provided by an embodiment of the present disclosure;
[0032] FIG. 5 is a schematic structural diagram of a haptic feedback device provided by an embodiment of the present disclosure;
[0033] Fig. 6 is a structural schematic diagram of an electronic device according to an embodiment of the present disclosure;
[0034] Fig. 7 is a method for synchronizing haptic feedback of an interconnected device system according to an embodiment of the present disclosure;
[0035] Fig. 8A is a structural schematic diagram of an interconnected device system according to an embodiment of the present disclosure;
[0036] Fig. 8B is a structural schematic diagram of an interconnected device system according to an embodiment of the present disclosure;
[0037] Fig. 8C is a structural schematic diagram of an interconnected device system according to an embodiment of the present disclosure;
[0038] Fig. 8D is a structural schematic diagram of an interconnected device system according to an embodiment of the present disclosure. DETAILED DESCRIPTION
[0039] In order to make the purpose, technical solutions and advantages of the present disclosure clearer, the present disclosure will be further described in detail below with reference to the drawings. The specific operation method in the method embodiment can also be applied to the device embodiment or the system embodiment. It should be noted that in the description of the present disclosure, "multiple" is understood as "at least two". The association relationship of the associated objects is described, which means that there can be three relationships, for example, A and / or B, which means that there are three cases of A alone, A and B, and B alone. A and B are connected, which means that A and B are directly connected and A and B are connected through C. In addition, in the description of the present disclosure, "first", "second", etc. are used only for the purpose of distinguishing the description, and cannot be understood as indicating or implying relative importance, nor can it be understood as indicating or implying order.
[0040] Currently, when electronic devices such as mobile phones, tablets, wearable devices, virtual reality (VR) devices, augmented reality (AR) devices, and vehicle displays perform touch operations, they usually vibrate through preset vibration modes. For example, a device outputs a preset waveform driving signal according to touch conditions (such as the position of the touch, the pressing condition, etc.) to generate vibration, and the vibration effect generated by the same device under the same touch condition is basically the same. However, the user's tactile sensation is very subjective, and the experience of different users for the same vibration is quite different. For example, different users may feel different strengths and degrees of realism for the same vibration. Therefore, the device vibrates according to the preset mode, which is difficult to ensure the user experience of each user. Moreover, because the hardware conditions of different devices are different, even for the same driving signal, the vibration effects generated by different devices are not the same, so that when the user performs the same touch operation on different devices, the user feels different tactile feedback effects, and the user is difficult to obtain the same or similar tactile feedback experience on different devices.
[0041] FIG. 1 is a flowchart of a tactile feedback method provided by an embodiment of the present disclosure.
[0042] In a first aspect, the present disclosure provides a tactile feedback method, which can be executed by a tactile feedback device. As shown in FIG. 1, the tactile feedback method provided by an embodiment of the present disclosure includes the following steps:
[0043] S101: In response to the operation of the user, a vibration excitation signal is generated based on vibration association information corresponding to the user and the operation;
[0044] S102: Vibration is generated according to the vibration excitation signal.
[0045] In an embodiment of the present disclosure, when the tactile feedback device detects the operation of the user, in response to the operation of the user, a vibration excitation signal is generated based on vibration association information corresponding to the user and the operation, and then vibration is generated according to the vibration excitation signal.
[0046] Specifically, the haptic feedback device can be a mobile phone, a tablet, a wearable device, a VR device, an AR device, a car display, a gamepad, etc. with vibration feedback function. Taking a mobile phone as an example, when a same user makes different types of operations on a same mobile phone, the mobile phone needs to generate different vibration effects so as to facilitate the user to distinguish the operation types. For example, when the user views a picture, the user can zoom in the picture by double-clicking the picture, and the mobile phone can generate a longer time or more intense vibration compared with single-clicking the picture. For another example, when the user plays a shooting game, the mobile phone can generate different vibrations to simulate the vibration effects of real guns when the user clicks different guns to shoot.
[0047] In the embodiments of the present disclosure, the vibration-related information includes an excitation signal frequency, an excitation signal amplitude and an excitation signal length. The vibration-related information corresponds to a user and an operation, and specifically, for one user and one specific operation, there is one vibration-related information corresponding thereto. For example, for a same mobile phone, operation 1 of user A corresponds to vibration-related information A1, vibration-related information A1 includes an excitation signal frequency aa1, an excitation signal amplitude ba1 and an excitation signal length ca1 corresponding to operation 1 of user A; operation 2 of user A corresponds to vibration-related information A2, vibration-related information A2 includes an excitation signal frequency aa2, an excitation signal amplitude ba2 and an excitation signal length ca2 corresponding to operation 2 of user A; operation 1 of user B corresponds to vibration-related information B1, vibration-related information B1 includes an excitation signal frequency ab1, an excitation signal amplitude bb1 and an excitation signal length cb1 corresponding to operation 1 of user B.
[0048] In implementation, the haptic feedback device such as a mobile phone produces vibration according to the vibration excitation signal generated based on the vibration-related information, which is just consistent with the feeling characteristics of the user corresponding to the vibration-related information when the user performs a specific operation corresponding to the vibration-related information. For example, for operation 1 of user A, the mobile phone generates vibration excitation signal AA based on vibration-related information A1, and the vibration excitation signal AA has excitation signal frequency aa1, excitation signal amplitude ba1 and excitation signal length ca1. At this time, the mobile phone produces vibration according to the vibration excitation signal AA, which is just consistent with the feeling characteristics of user A when the user performs operation 1. The feeling characteristics of the user to the vibration feedback can be that the user can just feel the vibration feedback of the mobile phone, or the user can feel better vibration feedback, or other feeling characteristics, which are not limited herein. Thus, for the same haptic feedback device such as a mobile phone, the haptic feedback device can produce vibration effects corresponding to different users and different operations of the users, to realize personalized haptic feedback, thereby optimizing the experience of haptic feedback of different users.
[0049] FIG. 2 is a flowchart of a method for determining excitation signal amplitude and excitation signal length corresponding to a user and an operation according to an embodiment of the present disclosure.
[0050] In some embodiments, as shown in FIG. 2, the excitation signal amplitude and the excitation signal length corresponding to the user and the operation can be determined by the following steps:
[0051] S201: obtaining an initial signal frequency corresponding to an operation from an original waveform library;
[0052] Generally, the type of the operation depends on the application scenario and the application event of the operation. For example, the application scenario of the operation usually includes but is not limited to text input, picture zoom, game entertainment and the like, and the application event of the operation usually includes but is not limited to single click, double click, long press, sliding, scrolling, dragging and the like. The type of the operation can be determined under the determined application scenario and application event. For example, in a shooting game scenario, single click on a weapon can perform single shot operation, long press on the weapon can perform continuous shooting operation, and the like. Each application scenario usually has an original waveform library associated with the application scenario, which is used to generate an original excitation signal according to a signal waveform corresponding to an operation in the original waveform library in the application scenario. In related technologies, the haptic feedback device such as a mobile phone produces vibration according to the original excitation signal, which is not associated with the feeling characteristics of the user, and thus cannot provide personalized haptic feedback experience for the user.
[0053] The signal waveform corresponding to the operation in the original waveform library contains information of the initial signal frequency, the initial signal amplitude and the initial signal length of the original excitation signal. The frequency of vibration has an important influence on the user's tactile experience, for example, different vibration frequencies usually represent different materials, etc. In some embodiments of the present disclosure, the original signal frequency corresponding to the operation is obtained from the original waveform library, and the excitation signal amplitude and the excitation signal length corresponding to the user and the operation are determined according to the original signal frequency.
[0054] S202: According to the tactile sensation table associated with the user, a pair of signal amplitude and signal length corresponding to the original signal frequency are obtained;
[0055] The tactile sensation table associated with the user records a plurality of data groups composed of signal frequency, signal amplitude and signal length which meet the user's feeling characteristics. The tactile sensation table can be stored in the haptic feedback device for easy calling.
[0056] In some embodiments, the tactile sensation table records a plurality of data groups composed of signal frequency, signal amplitude and signal length which the user can just feel the vibration feedback. The establishment process of the tactile sensation table can include the following steps:
[0057] Record the signal amplitude corresponding to the minimum vibration that the user feels for the set signal frequency and the set signal length;
[0058] Record the signal length corresponding to the minimum vibration that the user feels for the set signal frequency and the set signal amplitude;
[0059] Record the signal frequency corresponding to the minimum vibration that the user feels for the set signal amplitude and the set signal length.
[0060] Specifically, the user's perception threshold of signal amplitude, signal length and signal frequency can be tested in the form of question and answer.
[0061] For example, when recording the signal length corresponding to the minimum vibration that a user can feel for a given signal frequency and signal length, the signal amplitude corresponding to the minimum vibration that a user can feel can be given a single-frequency sinusoidal excitation signal y=Asin(2πft), where A is the signal amplitude and f is the signal frequency. The amplitude of the excitation signal is adjusted when the user confirms that he or she can just feel the vibration, and the amplitude 1 at this time is recorded as the signal amplitude corresponding to the minimum vibration that a user can feel for a signal frequency of frequency 1 and a signal length of length 1. A data group is formed by frequency 1, length 1, and amplitude 1. For a single-frequency excitation signal of frequency 1, the signal length is changed, and the signal amplitude corresponding to the minimum vibration that a user can feel is recorded to form a plurality of data groups associated with the signal frequency. The frequency of the excitation signal is changed, and the above steps are repeated to form a haptic perception reference table subtable 1. For example, the above steps are repeated to record the signal amplitude corresponding to the minimum vibration that a user can feel for a given signal frequency and signal length at a frequency interval Δf=10 Hz from 50 Hz to 500 Hz. The specific test method can refer to the limit method. In the first measurement, a given voltage amplitude A1 is measured. Under the driving of the voltage, the user can clearly feel the vibration haptic signal of the mobile phone. In the second measurement, a given signal 0.5A1 is measured. If the user can still clearly feel the haptic signal, a given signal 0.25A1 is measured. If the user cannot clearly feel the haptic signal, a given signal 0.75A1 is measured. The above steps are repeated until the minimum vibration intensity that the user can feel is determined. Other methods, such as the average error method and the constant stimulation method, are also feasible, and are not limited herein.
[0062] Table 1 Haptic perception reference table subtable 1
[0063] When recording the signal length corresponding to the minimum vibration that a user can feel for a given signal amplitude and signal length, the haptic perception reference table subtable 2 can be established by referring to the establishment process of the haptic perception reference table subtable 1.
[0064] Table 2 Haptic perception reference table subtable 2
[0065] When recording the signal frequency corresponding to the minimum vibration that a user can feel for a given signal amplitude and signal length, the haptic perception reference table subtable 3 can be established by referring to the establishment process of the haptic perception reference table subtable 1.
[0066] Table 3 Haptic perception reference table subtable 3
[0067] The haptic perception reference table subtable 1, the haptic perception reference table subtable 2, and the haptic perception reference table subtable 3 constitute a haptic perception reference table.
[0068] As can be seen from the haptic perception table sub-table 1, the haptic perception table sub-table 2 and the haptic perception table sub-table 3, for the same signal frequency, there are multiple data groups associated with the signal frequency in the haptic perception table, which all satisfy that the user can just feel the vibration feedback. For example, for the frequency 1, the data group consisting of the frequency 1, the length 1 and the amplitude 1, the data group consisting of the frequency 1, the length 2 and the amplitude 2, and the data group consisting of the frequency 1, the length 3 and the amplitude 3, all satisfy that the user can just feel the vibration feedback. The signal frequency, the signal amplitude and the signal length in the same data group have a corresponding relationship. According to the haptic perception table associated with the user, the specific process of selecting a pair of signal amplitude and signal length corresponding to the original signal frequency can be that all the arrays including the same frequency as the original signal frequency are found in the haptic perception table, and a signal amplitude and a signal length in a randomly selected array are obtained as a pair of signal amplitude and signal length corresponding to the original signal frequency. When the haptic perception table associated with the user does not have the same signal frequency as the original signal frequency, a signal amplitude and a signal length can also be obtained from the array having a frequency close to the original signal frequency, which is not limited herein. The signal amplitude and the signal length corresponding to the original signal frequency obtained from the haptic perception table associated with the user are used to determine the excitation signal amplitude and the excitation signal length corresponding to the user and the operation.
[0069] In some embodiments, the haptic perception table records multiple data groups consisting of signal frequency, signal amplitude and signal length when the user can feel the best vibration feedback. The establishment process of the haptic perception table can include the following steps:
[0070] Record the best signal amplitude corresponding to the best vibration felt by the user for the set signal frequency and the set signal length;
[0071] Record the signal length corresponding to the best vibration felt by the user for the set signal frequency and the set signal amplitude;
[0072] Record the signal frequency corresponding to the best vibration felt by the user for the set signal amplitude and the set signal length.
[0073] In the embodiment, the specific process of establishing the haptic perception table can refer to the process of establishing the haptic perception table when the haptic perception table records the multiple data groups composed of the signal frequency, the signal amplitude and the signal length at which the user can just feel the vibration feedback in the foregoing embodiment, and details are not repeated herein. In the embodiment, the specific process of selecting the pair of signal amplitude and signal length corresponding to the original signal frequency according to the haptic perception table associated with the user can refer to the corresponding process when the haptic perception table records the multiple data groups composed of the signal frequency, the signal amplitude and the signal length at which the user can just feel the vibration feedback in the foregoing embodiment, and details are not repeated herein.
[0074] S203: determining the excitation signal amplitude and the excitation signal length corresponding to the user and the operation according to the signal amplitude and the signal length.
[0075] In this step, the signal amplitude can be directly determined as the excitation signal amplitude corresponding to the user and the operation, and the signal length can be directly determined as the excitation signal length corresponding to the user and the operation. Alternatively, the excitation signal amplitude can be determined according to the signal amplitude and the signal amplitude adjustment parameter associated with the user and the operation, and the excitation signal length can be determined according to the signal length and the signal length adjustment parameter associated with the user and the operation.
[0076] Specifically, in some embodiments, the signal amplitude is determined as the excitation signal amplitude corresponding to the user and the operation, and the signal length is determined as the excitation signal length corresponding to the user and the operation. That is, the signal amplitude can be directly determined as the excitation signal amplitude corresponding to the user and the operation, and the signal length can be directly determined as the excitation signal length corresponding to the user and the operation, which can meet the feeling characteristics of the user.
[0077] In some embodiments, the signal amplitude is determined as the excitation signal amplitude corresponding to the user and the operation, and the signal length is determined as the excitation signal length corresponding to the user and the operation, which cannot completely meet the feeling characteristics of the user. Then, the signal amplitude and the signal length can be further adjusted according to the signal amplitude adjustment parameter and the signal length adjustment parameter associated with the user and the operation, and the adjusted signal amplitude and the adjusted signal length are respectively taken as the excitation signal amplitude and the excitation signal length. For example, in a mobile phone game scene, the user can adjust the touch feeling through the editing function in the game to achieve the best touch feeling, and the mobile phone records the related adjustment parameters and takes the adjustment of the signal amplitude and the signal length as the signal amplitude adjustment parameter and the signal length adjustment parameter associated with the user and the operation, so as to call the adjustment parameters when the adjustment step of the signal amplitude and the signal length is performed. In other scenes, corresponding adjustment can also be made, which is not limited herein.
[0078] The method for providing haptic feedback provided by the embodiments of the present disclosure further comprises determining the frequency of the excitation signal corresponding to the user and the operation.
[0079] In some embodiments, the frequency of the original signal corresponding to the operation obtained from the original waveform library can be directly used as the frequency of the excitation signal.
[0080] In some embodiments, the frequency of the excitation signal can be determined according to the frequency of the original signal and the signal frequency adjustment parameter associated with the user and the operation. For example, when the original signal frequency directly used as the frequency of the excitation signal cannot fully meet the characteristics of the user's experience, the signal frequency can be further adjusted according to the signal frequency adjustment parameter associated with the user and the operation, and the adjusted signal frequency can be used as the frequency of the excitation signal. For example, in the scenario of a mobile phone game, the user can adjust the touch feeling through the editing function in the game to achieve the best touch feeling. The mobile phone records the relevant adjustment parameters and uses the adjustment of the signal frequency as the signal frequency adjustment parameter associated with the user and the operation, so as to facilitate the calling of the adjustment of the signal frequency. In other scenarios, corresponding adjustments can also be made, which are not limited herein.
[0081] In some embodiments, at least one of the signal frequency and the signal amplitude of the vibration excitation signal generated in response to different operations of the user can be different, so as to ensure that the user can effectively distinguish the haptic feedback of different operations in the same application scenario. For example, the mobile phone can generate a first vibration excitation signal in response to a first operation of the user based on first vibration associated information corresponding to the user and the first operation, and the first vibration associated information comprises a first excitation signal frequency, a first excitation signal amplitude and a first excitation signal length. The mobile phone can generate a second vibration excitation signal in response to a second operation of the user based on second vibration associated information corresponding to the user and the second operation, and the second vibration associated information comprises a second excitation signal frequency, a second excitation signal amplitude and a second excitation signal length. The second excitation signal frequency is different from the first excitation signal frequency, and / or the second excitation signal amplitude is different from the first excitation signal amplitude. The first operation and the second operation can be any two different operations in the same application scenario, which are not limited herein.
[0082] In some embodiments, the second excitation signal has the same frequency as the first excitation signal, the second excitation signal has a different amplitude than the first excitation signal, and the difference between the second excitation signal amplitude and the first excitation signal amplitude is greater than or equal to an amplitude resolution threshold corresponding to the signal frequency. Specifically, when two different operations of a user correspond to excitation signals having the same frequency, different amplitudes of the excitation signals corresponding to the different operations are used to make the user feel different haptic feedback effects. In specific implementation, the difference between the second excitation signal amplitude and the first excitation signal amplitude can be greater than or equal to an amplitude resolution threshold corresponding to the signal frequency, so as to improve the user's experience. The amplitude resolution threshold is used to represent the minimum difference between two different signal amplitudes under the same signal frequency, so that the user can feel the difference in haptic feedback.
[0083] The amplitude resolution threshold corresponding to a signal frequency can be determined by a limit method. For example, for an excitation signal with a frequency of f = 100 Hz, when the reference signal voltage (i.e., signal amplitude) is A1, the user can clearly feel the haptic signal; when the signal voltage is increased to 2A1, the user can determine whether the difference can be clearly felt, and if so, the signal voltage is reduced to 1.5A1; and so on, until the user cannot feel the difference, and the difference between the signal voltage at this time and the reference signal voltage ΔA1 is recorded as the amplitude resolution threshold corresponding to the signal amplitude A1. For the excitation signal with a frequency of f = 100 Hz, the reference voltages A2, A3, and other voltage values can also be determined and recorded to correspond to the amplitude resolution thresholds, so as to be called later. According to Weber's theorem, the difference threshold limit under all stimulus references can also be calculated (Weber's theorem: C = ΔΨ / Ψ, ΔΨ represents the minimum difference threshold limit, Ψ represents the intensity of the standard stimulus, and C is a constant value of a specific sensory channel, also called Weber ratio or Weber fraction).
[0084] In some embodiments, the second excitation signal has the same amplitude as the first excitation signal, the second excitation signal has a different frequency than the first excitation signal, and the difference between the second excitation signal frequency and the first excitation signal frequency is greater than or equal to a frequency resolution threshold corresponding to the signal amplitude. Specifically, when two different operations of a user correspond to excitation signals having the same amplitude, different frequencies of the excitation signals corresponding to the different operations are used to make the user feel different haptic feedback effects. In specific implementation, the difference between the second excitation signal frequency and the first excitation signal frequency can be greater than or equal to a frequency resolution threshold corresponding to the signal frequency, so as to improve the user's experience. The frequency resolution threshold is used to represent the minimum difference between two different signal frequencies under the same signal amplitude, so that the user can feel the difference in haptic feedback.
[0085] In some embodiments, when generating the vibration excitation signal based on the vibration association information corresponding to the user and the operation, the vibration excitation signal can be directly generated according to the excitation signal frequency, the excitation signal amplitude and the excitation signal length included in the vibration association information. Thus, the vibration excitation signal has the excitation signal frequency, the excitation signal amplitude and the excitation signal length included in the vibration association information.
[0086] In some embodiments, when generating the vibration excitation signal based on the vibration association information corresponding to the user and the operation, the vibration excitation signal can be directly generated according to the excitation signal frequency, the excitation signal amplitude and the excitation signal length included in the vibration association information. Thus, the vibration excitation signal has the excitation signal frequency, the excitation signal amplitude and the excitation signal length included in the vibration association information.
[0087] In the embodiments of the present disclosure, before generating the vibration excitation signal based on the vibration association information corresponding to the user and the operation, the vibration association information corresponding to the user and the operation is determined according to the identity information of the user. In specific implementation, the vibration association information corresponding to the user and the operation can be stored locally in the haptic feedback device or in the server connected to the haptic feedback device after being established, so as to be called when used. Since the same haptic feedback device or the same application program in the device can be used by multiple people, the vibration association information corresponding to multiple different users and their operations can be stored in the device locally or in the cloud server. Therefore, before generating the vibration excitation signal based on the vibration association information corresponding to the user and the operation, the vibration association information corresponding to the user and the operation is determined according to the identity information of the user, so as to realize the differentiated haptic feedback for different users. In specific implementation, the identity information of the user can be determined according to at least one of the fingerprint recognition result, the portrait recognition result and the account password verification result, which is not limited herein.
[0088] FIG. 3 is a structural schematic diagram of a haptic feedback device provided by the embodiments of the present disclosure.
[0089] The second aspect of the present disclosure further provides a haptic feedback device. As shown in FIG. 3, the haptic feedback device 300 includes a response module 301 and a vibration module 302 in the embodiments of the present disclosure.
[0090] The response module 301 is configured to generate a vibration excitation signal based on vibration association information corresponding to a user and an operation in response to an operation of the user; the vibration association information includes an excitation signal frequency, an excitation signal amplitude and an excitation signal length.
[0091] The vibration module 302 is configured to generate vibration according to the vibration excitation signal. The vibration module 302 can specifically include a linear motor, a piezoelectric ceramic, an electromagnetic valve, etc., which are not limited herein.
[0092] In addition to the modules shown in FIG. 3, the haptic feedback device provided by the embodiments of the present disclosure further includes other modules required for implementing the haptic feedback method and other specific functions, which are not limited herein.
[0093] The device provided by the embodiments of the present disclosure can implement all method steps in the method embodiments and achieve the same technical effects, and the same parts and beneficial effects in the method embodiments will not be described in detail herein. In specific implementation, the haptic feedback device can be a mobile phone, a tablet, a wearable device, a VR device, an AR device, a vehicle-mounted display, a gamepad, etc. with vibration feedback function, which are not limited herein.
[0094] FIG. 4 is a flowchart of a haptic feedback method provided by the embodiments of the present disclosure.
[0095] The third aspect of the present disclosure also provides a haptic feedback method, which can be executed by a haptic feedback device. As shown in FIG. 4, the haptic feedback method provided by the embodiments of the present disclosure includes the following steps:
[0096] S401: obtaining a transfer function of a target device and vibration association information of the target device corresponding to a user and an operation; the user is a current user of the device;
[0097] In the embodiments of the present disclosure, the haptic feedback device obtains the transfer function of the target device and the vibration association information of the target device corresponding to the user and the operation, for generating a vibration excitation signal subsequently. Specifically, the target device can be a commonly used device of the current user of the haptic feedback device, and the haptic feedback device obtains the vibration association information of the target device corresponding to the current user of the haptic feedback device from the target device. The vibration association information is the same as that described in the haptic feedback method provided by the first aspect of the present disclosure, which will not be described herein. The haptic feedback device obtains the transfer function of the target device and the vibration association information of the target device corresponding to the user and the operation, which can be obtained locally from the target device or from the cloud, which is not limited herein. For example, the haptic feedback device can be a vehicle-mounted display, and the target device can be a mobile phone. The vehicle-mounted display can directly obtain the relevant information from the mobile phone through carplay, hicar, carlife, etc. For example, the mobile phone uploads the transfer function of the mobile phone and the vibration association information of the mobile phone corresponding to the user and the operation to a game server through a game app, etc. When the vehicle-mounted display logs in the same game app, the vehicle-mounted display can obtain the transfer function of the mobile phone and the vibration association information of the mobile phone corresponding to the user and the operation from the game server, which is not limited herein.
[0098] The transfer function RFa(ω) of the target device is used to represent the relationship between the vibration excitation signal Va(t) of the target device and the vibration information Ua(t) of the target device, and the transfer function RFa(ω) of the target device can be defined as: RFa(ω) = Ua(ω) / Va(ω), where Va(ω) is the frequency domain response after the Fourier transform of the vibration excitation signal Va(t) of the target device, and Ua(ω) represents the frequency domain response after the Fourier transform of the vibration information Ua(t) of the target device. The vibration information Ua(t) of the target device can be represented by the amplitude of the vibration of the target device, the acceleration of the vibration, or the speed of the vibration, and the vibration information Ua(t) of the target device represented by the amplitude of the vibration of the target device, the acceleration of the vibration, or the speed of the vibration has the same effect. Assuming that the amplitude of the vibration of the target device is where A m is the maximum amplitude, f is the frequency, is the initial phase, the speed of the vibration of the target device is The acceleration of the vibration of the target device is
[0099] The acceleration, amplitude, and vibration speed of the vibration of the target device can be measured by a Doppler laser vibration tester under a given vibration excitation signal of the target device, or can be tested by an accelerometer. For example, the measurement can be performed by the acceleration sensor provided in the target device, which is not limited herein. After measuring the acceleration, amplitude, and vibration speed of the vibration of the target device, one of the acceleration, amplitude, and vibration speed of the vibration of the target device is selected for Fourier transform, and compared with the vibration excitation signal of the target device after Fourier transform, to obtain the transfer function of the target device, and the transfer function of the target device can be stored locally or in the cloud, which is not limited herein.
[0100] S402: In response to the operation of the user, a local vibration excitation signal is generated based on the transfer function of the device, the transfer function of the target device, and the vibration association information of the target device corresponding to the user and the operation;
[0101] The transfer function RFb(ω) of the haptic feedback device is used to represent the relationship between the vibration excitation signal Vb(t) of the haptic feedback device and the vibration information Ub(t) of the haptic feedback device, and the transfer function RFb(ω) of the haptic feedback device can be defined as: RFb(ω) = Ub(ω) / Vb(ω), where Vb(ω) is the frequency domain response after the Fourier transform of the vibration excitation signal Vb(t) of the haptic feedback device, and Ub(ω) represents the frequency domain response after the Fourier transform of the vibration information u(t) of the target device. The transfer function of the haptic feedback device can be determined in the same manner as the above-described target device.
[0102] According to the transfer function RFa(ω) = Ua(ω) / V1(ω) of the target device and the transfer function RFb(ω) = Ub(ω) / Vb(ω) of the haptic feedback device, when the vibration information Ua(ω) of the target device is the same as the vibration information Ua(ω) of the haptic feedback device, Vb(ω) = RFa(ω) x V1(ω) / RFb(ω) can be obtained, where the vibration excitation signal V1(ω) of the target device is generated based on the vibration correlation information of the target device corresponding to the user and the operation.
[0103] In particular implementation, the local vibration excitation signal is the vibration excitation signal Vb(ω) of the haptic feedback device, and Vb(ω) satisfies Vb(ω) = RFa(ω) x V1(ω) / RFb(ω), so that the haptic feedback device can generate the local vibration excitation signal based on the transfer function of the device, the transfer function of the target device, and the vibration correlation information of the target device corresponding to the user and the operation, and the local vibration excitation signal can make the haptic feedback device generate the same or similar vibration effect as the user performs the same operation on the target device.
[0104] S403: generating vibration according to the local vibration excitation signal.
[0105] The haptic feedback device generates vibration according to the local vibration excitation signal, and can generate the same or similar vibration effect or haptic feedback effect as the current user performs the same operation on the target device.
[0106] Through the above haptic feedback method provided by the embodiments of the present disclosure, the user can obtain the same or similar haptic feedback effect that meets the user's use habit when using different terminal devices, and the user experience is greatly improved.
[0107] FIG. 5 is a second structural schematic diagram of a haptic feedback device provided by the embodiments of the present disclosure.
[0108] The fourth aspect of the present disclosure also provides a haptic feedback device. In the embodiments of the present disclosure, as shown in FIG. 5, the haptic feedback device 500 includes an acquisition module 501, a response module 502, and a vibration module 503.
[0109] The acquisition module 501 is configured to acquire the transfer function of the target device and the vibration correlation information of the target device corresponding to the user and the operation.
[0110] The response module 502 is configured to generate a vibration excitation signal based on the vibration correlation information corresponding to the user and the operation in response to the operation of the user; and the vibration correlation information includes an excitation signal frequency, an excitation signal amplitude, and an excitation signal length.
[0111] The vibration module 503 is configured to generate vibration according to the vibration excitation signal. The vibration module 503 can specifically include a linear motor, a piezoelectric ceramic, an electromagnetic valve, etc., which are not limited herein.
[0112] In addition to the modules shown in FIG. 5, the haptic feedback device provided by the embodiments of the present disclosure further includes other modules required for implementing the haptic feedback method provided by the third aspect of the present disclosure and other specific functions, which are not limited herein.
[0113] The device provided by the embodiments of the present disclosure can implement all method steps of the haptic feedback method provided by the third aspect of the present disclosure, and can achieve the same technical effects. Herein, the same parts and beneficial effects of the method embodiments in the present embodiment will not be described in detail. In specific implementation, the haptic feedback device can be a mobile phone, a tablet, a wearable device, a VR device, an AR device, a vehicle-mounted display, a gamepad, etc. with vibration feedback function, which are not limited herein.
[0114] FIG. 6 is a structural schematic diagram of an electronic device provided by the embodiments of the present disclosure.
[0115] The fifth aspect of the present disclosure further provides an electronic device, which can implement the functions of the haptic feedback device provided by the second aspect or the functions of the haptic feedback device provided by the fourth aspect. Referring to FIG. 6, the electronic device includes:
[0116] The electronic device includes at least one processor 601 and a memory 602 connected with the at least one processor 601. In the embodiments of the present disclosure, the specific connection medium between the processor 601 and the memory 602 is not limited, and in FIG. 6, the connection between the processor 601 and the memory 602 is taken as an example through a bus 600. The connection mode between other components is only schematically illustrated, and is not limited. The bus 600 can be divided into an address bus, a data bus, a control bus, etc. For convenience of representation, only one thick line is used in FIG. 6, but it does not mean that there is only one bus or only one type of bus. Alternatively, the processor 601 can also be referred to as a controller, and the name is not limited.
[0117] In the embodiments of the present disclosure, the memory 602 stores instructions executable by the at least one processor 601. The at least one processor 601 can execute the haptic feedback method provided by the first aspect or the haptic feedback method provided by the third aspect by executing the instructions stored in the memory 602. The processor 601 can implement the functions of each module in the device shown in FIG. 3 or FIG. 5.
[0118] The processor 601 is the control center of the device, and can connect all parts of the device through various interfaces and lines. The device performs various functions and processes data by running or executing instructions stored in the memory 602 and calling data stored in the memory 602, thereby monitoring the device as a whole.
[0119] In a possible design, the processor 601 can include one or more processing units, and the processor 601 can integrate an application processor and a modem processor. The application processor can mainly process an operating system, a user interface, and an application program, and the modem processor can mainly process wireless communication. It can be understood that the modem processor can also not be integrated into the processor 601. In some embodiments, the processor 601 and the memory 602 can be implemented on the same chip, and in some embodiments, they can also be implemented on separate chips respectively.
[0120] The processor 601 can be a general-purpose processor, for example, a central processing unit (CPU), a digital signal processor, an application-specific integrated circuit, a field programmable gate array, or other programmable logic device, a discrete gate or transistor logic device, a discrete hardware component, and can implement or execute each method, step, and logic block disclosed in the embodiments of the present disclosure. The general-purpose processor can be a microprocessor or any conventional processor. The steps of the haptic feedback method provided in the first aspect or the haptic feedback method provided in the third aspect can be directly embodied as execution of a hardware processor or execution of a combination of hardware and software modules in the processor.
[0121] The memory 602, as a non-volatile computer readable storage medium, can be used to store non-volatile software programs, non-volatile computer executable programs and modules. The memory 602 can include at least one type of storage medium, for example, can include flash memory, hard disk, multimedia card, card type memory, random access memory (RAM), static random access memory (SRAM), programmable read-only memory (PROM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), magnetic memory, magnetic disk, optical disk, etc. The memory 602 is any other medium capable of carrying or storing desired program code in the form of instructions or data structures and capable of being accessed by a computer, but is not limited thereto. The memory 602 in the embodiments of the present disclosure can also be a circuit or any other device capable of realizing a storage function, used for storing program instructions and / or data.
[0122] By designing and programming the processor 601, the code corresponding to the haptic feedback method provided in the first aspect or the haptic feedback method provided in the third aspect can be fixed into the chip, so that the chip can execute the steps of the haptic feedback method of the embodiments shown in FIG. 1 or FIG. 4 when running. How to design and program the processor 601 is a technology known to those skilled in the art, which will not be repeated here.
[0123] In the sixth aspect of the present disclosure, the embodiments of the present disclosure provide a computer storage medium, which includes computer program code, when the computer program code runs on a computer, so that the computer executes any one of the haptic feedback methods discussed above. Since the principle of solving problems of the above computer storage medium is similar to that of the haptic feedback method, the implementation of the above computer storage medium can be referred to the implementation of the method, and the repeated parts will not be repeated.
[0124] In the specific implementation process, the computer storage medium can include universal serial bus flash drive (USB, Universal Serial Bus Flash Drive), mobile hard disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), magnetic disk or optical disk and various storage media that can store program codes.
[0125] In a seventh aspect, the present disclosure also provides a computer program product, which comprises computer program codes, when the computer program codes are executed on a computer, the computer program codes cause the computer to perform the method of any one of the preceding aspects. Since the principle of solving problems of the computer program product is similar to the method, the implementation of the computer program product can be referred to the implementation of the method, and the repeated parts will not be described here.
[0126] The computer program product can adopt any combination of one or more readable media. The readable medium can be a readable signal medium or a readable storage medium. The readable storage medium may, for example, but is not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or apparatus, or any combination of the above. More specific examples (non-exhaustive list) of readable storage media include: electrical connections having one or more wires, portable disks, hard disks, random access memories (RAM), read-only memories (ROM), erasable programmable read-only memories (EPROM or flash memory), optical fibers, portable compact disk read-only memories (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination of the above.
[0127] The method in the present disclosure can be implemented wholly or partially by software, hardware, firmware or any combination thereof. When implemented by software, it can be implemented wholly or partially in the form of a computer program product. The computer program product includes one or more computer programs or instructions. When the computer programs or instructions are loaded and executed on a computer, the processes or functions described in the present disclosure are wholly or partially performed. The computer can be a general-purpose computer, a special-purpose computer, a computer network, a network device, a user equipment, a core network device, an OAM or other programmable devices.
[0128] The computer programs or instructions can be stored in a computer readable storage medium or transmitted from one computer readable storage medium to another computer readable storage medium, for example, the computer programs or instructions can be transmitted from one website site, computer, server or data center to another website site, computer, server or data center through wired or wireless manner. The computer readable storage medium can be any available medium accessible by a computer or a data storage device such as a server, data center and the like integrated with one or more available media. The available medium can be a magnetic medium, for example, floppy disk, hard disk, magnetic tape; or an optical medium, for example, digital video disc; or a semiconductor medium, for example, solid state disk. The computer readable storage medium can be a volatile or non-volatile storage medium, or can include both volatile and non-volatile storage media.
[0129] FIG. 7 is a method for synchronizing haptic feedback of an interconnection device system according to an embodiment of the present disclosure.
[0130] An eighth aspect of the present disclosure also provides a method for synchronizing haptic feedback of an interconnection device system. In an embodiment of the present disclosure, the interconnection device system includes a requesting device and a receiving device interconnected with the requesting device, and the receiving device agrees to interconnect with the requesting device upon receiving an interconnection request from the requesting device. During the interconnection, the requesting device can synchronize its image and audio to the receiving device for playing, and can synchronize its vibration to the device for feedback. A user can control the requesting device by operating the receiving device. For example, the requesting device can be a smart terminal device such as a mobile phone, and the receiving device can be a smart terminal device such as a car display. The mobile phone can be interconnected with the car display through an interconnection scheme such as carplay, hicar, or carlife. In a specific implementation, the requesting device can also be a tablet, a wearable device, a VR device, an AR device, or a car display, and the receiving device can also be a mobile phone, a tablet, a wearable device, a VR device, or an AR device. In this embodiment, the method for synchronizing haptic feedback of the interconnection device system includes the following steps:
[0131] S701: The receiving device acquires the excitation signal parameters of the requesting device and the transfer function of the requesting device.
[0132] S702: The receiving device generates a vibration excitation signal based on the transfer function of the receiving device, the vibration excitation signal parameters of the requesting device, and the transfer function of the requesting device in response to the user's operation.
[0133] S703: The receiving device generates vibration according to the vibration excitation signal.
[0134] The determination of the transfer function of the requesting device and the transfer function of the receiving device can refer to the related description of the transfer function in the third aspect of the present disclosure, which will not be repeated here. The confirmation process of the vibration-related information of the requesting device corresponding to the user and the operation is the same as the vibration-related information described in the haptic feedback method provided in the first aspect of the present disclosure, which will not be repeated here.
[0135] In an embodiment of the present disclosure, the user controls the requesting device by operating the receiving device. When the receiving device detects the user's operation, it generates a vibration excitation signal based on the transfer function of the receiving device, the transfer function of the requesting device, and the vibration-related information of the requesting device corresponding to the user and the operation, and generates vibration according to the vibration excitation signal. This can ensure that when the vibration of the requesting device is synchronized to the receiving device, the vibration effect generated by the receiving device is the same as or similar to the vibration effect generated by the requesting device in response to the same operation, which conforms to the user habits and feeling characteristics of the user.
[0136] Fig. 8A is a schematic diagram of one of the system structures of the interconnected devices provided by the present disclosure; Fig. 8B is a schematic diagram of another of the system structures of the interconnected devices provided by the present disclosure; Fig. 8C is a schematic diagram of a third of the system structures of the interconnected devices provided by the present disclosure; and Fig. 8D is a schematic diagram of a fourth of the system structures of the interconnected devices provided by the present disclosure.
[0137] In some embodiments, the receiving device obtains the vibration association information corresponding to the user and the operation of the requesting device and the transfer function of the requesting device, specifically, the receiving device can obtain the vibration association information corresponding to the user and the operation of the requesting device and the transfer function of the requesting device from the requesting device. For example, as shown in Figs. 8A-8D, the receiving device directly obtains the vibration association information corresponding to the user and the operation of the requesting device and the transfer function of the requesting device from the requesting device by interconnecting with the requesting device.
[0138] In some embodiments, the receiving device obtains the vibration association information corresponding to the user and the operation of the requesting device and the transfer function of the requesting device, specifically, the receiving device can obtain the excitation signal parameters of the requesting device and the transfer function of the requesting device from the receiving device locally. For example, as shown in Figs. 8A-8D, when the receiving device is initially interconnected with the requesting device, the receiving device can obtain the vibration association information corresponding to the user and the operation of the requesting device and the transfer function of the requesting device from the requesting device, and store the vibration association information corresponding to the user and the operation of the requesting device and the transfer function of the requesting device in the receiving device locally. In the next interconnection and subsequent interconnection, the receiving device directly obtains the excitation signal parameters of the requesting device and the transfer function of the requesting device from the receiving device locally.
[0139] In an embodiment, the receiving device obtains the vibration association information of the requesting device corresponding to the user and the operation and the transfer function of the requesting device. Specifically, the receiving device can obtain the excitation signal parameters of the requesting device and the transfer function of the requesting device from a cloud server to which the receiving device is connected. For example, as shown in FIG. 8A, the receiving device and the requesting device are connected to the same cloud server, and the requesting device can upload the vibration association information of the requesting device corresponding to the user and the operation and the transfer function of the requesting device to the cloud server, and the receiving device directly obtains the vibration association information of the requesting device corresponding to the user and the operation and the transfer function of the requesting device from the cloud server. For example, as shown in FIG. 8C and FIG. 8D, the receiving device and the requesting device are connected to different cloud servers respectively. When the receiving device and the requesting device are connected for the first time, the receiving device can obtain the vibration association information of the requesting device corresponding to the user and the operation and the transfer function of the requesting device from the requesting device, and upload the vibration association information of the requesting device corresponding to the user and the operation and the transfer function of the requesting device to the cloud server for storage. When the receiving device and the requesting device are connected next time and in subsequent connections, the receiving device directly obtains the excitation signal parameters of the requesting device and the transfer function of the requesting device from the cloud server to which the receiving device is connected.
[0140] In some embodiments, as shown in FIG. 8B, the vibration association information of the requesting device corresponding to the user and the operation and the transfer function of the requesting device are stored in the local of the requesting device.
[0141] In some embodiments, as shown in FIG. 8A, 8C and 8D, the vibration association information of the requesting device corresponding to the user and the operation and the transfer function of the requesting device are stored in the cloud server to which the requesting device is connected.
[0142] In some embodiments, as shown in FIG. 8D, the interconnection device system includes a plurality of requesting devices connected to the same receiving device, and one requesting device corresponds to one user. In specific implementation, the receiving device generates a vibration excitation signal based on the transfer function of the receiving device, the vibration association information of the requesting device corresponding to the user and the operation, and the transfer function of the requesting device in response to the operation of the user. Specifically, the receiving device determines the requesting device corresponding to the user currently making the operation, and generates a vibration excitation signal based on the transfer function of the receiving device, the vibration association information of the requesting device corresponding to the user and the operation, and the transfer function of the requesting device. In specific implementation, when the receiving device is connected to a plurality of requesting devices simultaneously, the receiving device synchronizes the requesting device corresponding to the user currently operating the receiving device. For example, as shown in FIG. 8D, when the user corresponding to the requesting device 1 is operating the receiving device, the receiving device synchronously plays the audio and video content of the requesting device 1, and generates a vibration excitation signal based on the vibration association information of the requesting device 1 corresponding to the user and the operation and the transfer function of the requesting device 1.
[0143] In actual implementation, the receiving device can determine the user currently operating the receiving device according to the information collected by the camera, and further determine the request device corresponding to the user. For example, as shown in FIG. 8D, the receiving device can determine that the user on the left is operating the receiving device according to the information collected by the camera, and further determine that the request device corresponding to the user currently operating the receiving device is the request device 1. The receiving device can also determine the request device corresponding to the user currently operating the receiving device according to other manners, which are not limited herein.
[0144] In a ninth aspect of the present disclosure, a system of interconnected devices is provided, as shown in FIGS. 8A and 8D, the system of interconnected devices includes a request device and a receiving device interconnected with the request device. The receiving device is configured to obtain vibration-related information of the request device corresponding to a user and an operation, and a transfer function of the request device; in response to the operation of the user, generate a vibration excitation signal based on the transfer function of the receiving device, the vibration-related information of the request device corresponding to the user and the operation, and the transfer function of the request device; and generate vibration according to the vibration excitation signal.
[0145] In some embodiments, the system of interconnected devices includes a plurality of request devices connected to the same receiving device, and one request device corresponds to one user. The receiving device is configured to determine the request device corresponding to the user currently operating the receiving device, and generate a vibration excitation signal based on the transfer function of the receiving device, the vibration-related information of the request device corresponding to the user currently operating the receiving device corresponding to the user and the operation, and the transfer function of the request device corresponding to the user currently operating the receiving device.
[0146] In a tenth aspect of the present disclosure, a method for synchronizing haptic feedback of a system of interconnected devices is also provided, the system of interconnected devices includes a request device and a receiving device interconnected with the request device, and the method includes:
[0147] The request device obtains a transfer function of the receiving device;
[0148] The request device generates a vibration excitation signal based on the transfer function of the request device, the vibration-related information of the request device corresponding to the user and the operation, and the transfer function of the receiving device in response to the operation of the user;
[0149] The receiving device receives the vibration excitation signal and generates vibration according to the vibration excitation signal.
[0150] Taking a mobile phone as a request device to project to a vehicle display as an example, when a user operates a game through the vehicle display, the mobile phone acts as a processor and the vehicle display only acts as a display screen. When a certain game prop needs to trigger a haptic feedback function in the game, the mobile phone reads the transfer function RFb(ω) of the vehicle display and the vibration correlation information corresponding to the prop locally stored by the mobile phone, determines the mobile phone end driving signal V1(t) according to the vibration correlation information, and calculates the vibration excitation signal of the vehicle display with the first principle that the user can feel the same vibration information. The specific calculation is as follows: RFa(ω) = Ua(ω) / V1(ω) RFb(ω) = Ub(ω) / Vb(ω)
[0151] Wherein Ua(ω) = Ub(ω), the vibration excitation signal of the vehicle display can be obtained as follows:
[0152] The vibration excitation signal of the vehicle display can be obtained by performing inverse Fourier transform on Vb(ω). The mobile phone directly sends the vibration excitation signal Vb(t) of the vehicle display to the vehicle display, and the vehicle display generates vibration according to the vibration excitation signal Vb(t).
[0153] Those skilled in the art should understand that the embodiments of the present disclosure can be provided as a method, a system, or a computer program product. Therefore, the present disclosure can take the form of an entirely hardware embodiment, an entirely software embodiment, or an embodiment combining software and hardware aspects. Moreover, the present disclosure can take the form of a computer program product implemented on one or more computer-usable storage media (including, but not limited to, disk storage and optical storage, etc.) containing computer-usable program code.
[0154] The present disclosure is described with reference to flowcharts and / or block diagrams of methods, devices (systems), and computer program products according to embodiments of the present disclosure. It should be understood that each flow and / or block in the flowcharts and / or block diagrams, and the combination of flows and / or blocks in the flowcharts and / or block diagrams can be implemented by computer program instructions. These computer program instructions can be provided to a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing devices to produce a machine, so that the instructions executed by the processor of the computer or other programmable data processing devices produce the device for implementing the functions specified in one or more flows in the flowcharts and / or one or more blocks in the block diagrams.
[0155] These computer program instructions can also be stored in a computer- readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instructions which implement the function specified in the flowchart or flow diagram block or blocks and / or the flowchart or flow diagram block or blocks.
[0156] These computer program instructions can also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart or flow diagram block or blocks and / or the flowchart or flow diagram block or blocks.
[0157] Obviously, numerous modifications and variations of the present disclosure are possible in light of the above teachings. It is therefore to be understood that within the scope of the present disclosure, the disclosure can be practiced otherwise than as specifically set out herein. Accordingly, any one of the modifications or variations above can be combined with any other of the modifications or variations above to produce yet further modifications and variations within the scope of the present disclosure.
Claims
1. A method of haptic feedback synchronization for an interconnected device system, the interconnected device system comprising a requesting device and a receiving device interconnected with the requesting device, wherein, The method comprises: The receiving device obtains the vibration association information corresponding to the user and the operation of the requesting device and the transfer function of the requesting device; The receiving device generates a vibration excitation signal based on the transfer function of the receiving device, the transfer function of the requesting device and the vibration association information corresponding to the user and the operation of the requesting device in response to the operation of the user; The receiving device generates vibration according to the vibration excitation signal.
2. The method of claim 1, wherein, The receiving device obtains the vibration association information corresponding to the user and the operation of the requesting device and the transfer function of the requesting device, specifically comprising: The receiving device obtains the excitation signal parameters of the requesting device and the transfer function of the requesting device from the requesting device.
3. The method of claim 1, wherein, The receiving device obtains the vibration association information corresponding to the user and the operation of the requesting device and the transfer function of the requesting device, specifically comprising: The receiving device obtains the excitation signal parameters of the requesting device and the transfer function of the requesting device from the cloud server connected to the receiving device.
4. The method of claim 1, wherein, The vibration association information corresponding to the user and the operation of the requesting device and the transfer function of the requesting device are stored in the local of the requesting device. The vibration association information corresponding to the user and the operation of the requesting device and the transfer function of the requesting device are stored in the cloud server connected to the requesting device.
5. The method of any one of claims 1 to 4, wherein, The interconnection device system comprises a plurality of requesting devices connected to the same receiving device; one requesting device corresponds to one user; 6. The method of any one of claims 1 to 4, wherein, The receiving device generates a vibration excitation signal based on the transfer function of the receiving device, the vibration association information corresponding to the user and the operation of the requesting device and the transfer function of the requesting device in response to the operation of the user, specifically comprising:
7. The method of any one of claims 1 to 6, wherein, The receiving device judges the requesting device corresponding to the user currently making the operation, generates a vibration excitation signal based on the transfer function of the receiving device, the vibration association information corresponding to the user and the operation of the requesting device corresponding to the user currently making the operation, and the transfer function of the requesting device corresponding to the user currently making the operation. The receiving device judges the requesting device corresponding to the user currently making the operation, specifically comprising: The receiving device confirms the requesting device corresponding to the user currently making the operation according to the information collected by the camera.
8. The method of claim 7, wherein, 9. An interconnection device system comprising a requesting device and a receiving device interconnected with the requesting device; wherein, The receiving device is configured to obtain the vibration association information corresponding to the user and the operation of the requesting device and the transfer function of the requesting device; In response to the operation of the user, a vibration excitation signal is generated based on the transfer function of the receiving device, the vibration excitation signal parameters of the requesting device and the transfer function of the requesting device; Vibration is generated according to the vibration excitation signal. 10. The interconnect device system of claim 9, wherein, The interconnection device system comprises a plurality of the request devices, and the plurality of the request devices are connected to the same receiving device; one of the request devices corresponds to one user; The receiving device is configured to determine the request device corresponding to the user currently performing the operation, generate a vibration excitation signal based on a transfer function of the receiving device, vibration association information of the request device corresponding to the user currently performing the operation corresponding to the user and the operation, and a transfer function of the request device corresponding to the user currently performing the operation.
Citation Information
Patent Citations
Vibration reduction method and device, range hood and storage medium
CN118224627A
Transitory salient attention capture to draw attention to digital document parts
US20220284071A1