Method for creating haptic effect in real time by means of gesture, and related device

Abstract

Provided in the embodiments of the present invention are a method for creating a haptic effect in real time by means of gestures, and a related device. The method comprises the following steps: acquiring a target image and video file, performing automatic track separation thereon, and displaying track parameters of each track; identifying whether each track has the track parameters; detecting an input gesture haptic signal in real time, generating a corresponding real-time vibration signal from same according to a preset rule, synchronously writing same into the track parameters as an input parameter, and synchronously driving a vibration unit to create a corresponding vibration feedback effect by means of the real-time vibration signal; and binding all real-time vibration signals, generated within a playback duration of the target image and video file, with the target image and video file, so as to form a final vibration signal of the target image and video file. Compared with the prior art, the method for creating the haptic effect in real time by means of gestures and the related device provided in the present invention enable users to create haptic effects in a user-defined manner for target audio / video files, thus achieving simple and convenient operation, and better user experience effect.

Description

Method and related device for creating tactile effects in real time through gestures Technical Field

[0001] The present invention relates to the technical field of tactile effect generation methods, and in particular to a method and related equipment for creating tactile effects in real time through gestures using a touch screen electronic terminal. Background Art

[0002] With the development of electronic products, people have higher requirements for the effects of sound and vibration feedback. Therefore, more and more electronic terminals such as mobile phones and tablets are equipped with speakers as audio output and vibration motors as vibration tactile feedback output. Technical issues

[0003] However, in the related art, the design of vibration effects to achieve tactile vibration feedback mainly relies on pre-programming of code to achieve the relevant effects according to product or scenario requirements, and the effects are fixed. Ordinary users cannot edit or modify the vibration effects to meet their own needs. In addition, since there are no relevant vibration effect production tools on the market, nor are there easy-to-learn vibration effect design methods, tactile vibration design has always been a skill mastered by very few professionals. Therefore, few users have experienced the fun of tactile design, which greatly limits the user experience of the design and effect requirements of tactile vibration feedback.

[0004] Therefore, it is necessary to provide a new method for creating tactile effects in real time through gestures and related equipment to solve the above technical problems. Technical Solutions

[0005] The purpose of the present invention is to provide a method and related equipment for creating tactile effects in real time through gestures, so that users can customize the tactile effects for target audio and video files, and the operation is simple and convenient, and the user experience is better.

[0006] To achieve the above objectives, in a first aspect, an embodiment of the present invention provides a method for creating tactile effects in real time through gestures, the method being applied to a touch screen electronic terminal, the method comprising the following steps:

[0007] Acquire a target image file, automatically divide the target image file into tracks and display track parameters of each track;

[0008] Identify whether each track has track parameters: if so, define the track parameters of the track as adjustable track parameters;

[0009] Detecting input gesture tactile signals in real time, generating corresponding real-time vibration signals according to preset rules based on the real-time detected gesture tactile signals, and simultaneously driving a vibration unit with the real-time vibration signal to produce a corresponding vibration feedback effect, and synchronously writing the real-time vibration signal as an input parameter into the track parameter; wherein the real-time vibration signal is synchronized with the track on the time axis;

[0010] All the real-time vibration signals generated during the playback time of the target image file are bound to the target image file to form a final vibration signal of the target image file, which is used to make the target image file produce a tactile effect.

[0011] Preferably, the target image file includes at least one of an audio file, a video file, an animation file, a gif file, and a dynamic expression file.

[0012] Preferably, the gesture tactile signal includes at least one of tapping, long pressing, and sliding.

[0013] Preferably, the gesture tactile signals are generated by different touch modules displayed on the touch screen.

[0014] Preferably, the preset rules include:

[0015] When the duration of the gesture tactile signal is less than or equal to the preset duration, it is defined as a tap, and a first real-time vibration signal with a duration equal to the preset duration is generated according to the tap duration;

[0016] When the duration of the gesture tactile signal is greater than the preset duration, it is defined as a long press, and a second real-time vibration signal of a corresponding duration is generated according to the duration of the long press.

[0017] Preferably, the preset duration is 100ms.

[0018] Preferably, the preset rules further include:

[0019] When the gesture tactile signal is detected to be continuously pressed and enters different intensity intervals, it is defined as sliding, and a third real-time vibration signal of corresponding duration is generated according to the duration of the sliding, and the vibration intensity value corresponding to the previous intensity interval when entering each different intensity interval is recorded, and converted into a curve point of vibration intensity change, and the curve point is written into the third real-time vibration signal as the intensity change inflection point of the third real-time vibration signal at its different time points; wherein, the intensity interval is to divide the touch screen area where the gesture tactile signal is input into N equal parts from top to bottom, and the difference corresponding to each equal part is X, then the overall intensity interval range of the touch screen area where the gesture tactile signal is input is , where N and X are natural numbers.

[0020] Preferably, the preset rules further include:

[0021] When the third real-time vibration signal drives the vibration unit to generate a real-time vibration feedback effect, when the number of the curve points exceeds an upper limit, the vibration unit stops vibrating, and the curve points exceeding the upper limit are removed, and then the curve points within the upper limit range are written into the third real-time vibration signal to generate a final third real-time vibration signal.

[0022] Preferably, the preset rules further include:

[0023] When the third real-time vibration signal drives the vibration unit to generate a real-time vibration feedback effect, when the number of the curve points is within an upper limit range and the gesture tactile signal remains in the same intensity range while sliding, detecting the duration for which the gesture tactile signal remains in the same intensity range; if the duration exceeds a preset duration, stopping the vibration unit from vibrating, and inserting the curve points into the third real-time vibration signal to generate the final third real-time vibration signal;

[0024] If, at the end of vibration, the number of curve points of the final third real-time vibration signal is less than a lower limit, then, according to the basic criteria of the final third real-time vibration signal, the curve points equal to the lower limit are supplemented at the end of the final third real-time vibration signal to update the final third real-time vibration signal.

[0025] Preferably, N=5, X=20; the intensity range of the touch screen area of ​​the input gesture tactile signal is [0, 100]; the upper limit value of the curve points of the same third real-time vibration signal is 16, and the lower limit value is 4; the preset stagnation time is 5s.

[0026] In a second aspect, the present invention further provides a system for creating tactile effects in real time through gestures, comprising:

[0027] A track division module, the track division module is used to obtain a target image file, automatically divide the target image file into tracks and display track parameters of each track;

[0028] A track parameter identification module, wherein the track parameter identification module is used to identify whether each track has a track parameter; if so, the track parameter of the track is defined as an adjustable track parameter;

[0029] a vibration signal generation module, the vibration signal generation module being configured to detect input gesture tactile signals in real time, generate corresponding real-time vibration signals according to preset rules based on the real-time detected gesture tactile signals, and simultaneously drive a vibration unit with the real-time vibration signal to produce a corresponding vibration feedback effect, and synchronously write the real-time vibration signal as an input parameter into the track parameters; wherein the real-time vibration signal is synchronized with the track on the time axis;

[0030] A tactile effect generation module is used to bind all the real-time vibration signals generated during the playback time of the target image file to the target image file to form a final vibration signal of the target image file, which is used to make the target image file produce a tactile effect.

[0031] In a third aspect, the present invention also provides an electronic device comprising a processor, a memory, and a program for creating tactile effects in real time through gestures, which is stored in the memory and can be run on the processor. When the program for creating tactile effects in real time through gestures is executed by the processor, the steps in the method for creating tactile effects in real time through gestures provided by the present invention are implemented.

[0032] In a fourth aspect, the present invention also provides a computer-readable storage medium, on which is stored a program for creating tactile effects in real time through gestures. When the program for creating tactile effects in real time through gestures is executed by a processor, the steps of the method for creating tactile effects in real time through gestures provided by the present invention are implemented. Beneficial effects

[0033] Compared with the related art, the method and related equipment of the present invention for creating tactile effects in real time through gestures divide the target graphic file into tracks and display the track parameters of each track, then detect the input gesture tactile signal and generate a corresponding real-time vibration signal according to preset rules, and synchronously write the real-time vibration signal into the track parameter as an input parameter, thereby converting the gesture tactile signal into a real-time vibration signal and then outputting it. The gesture has a strong interactive correlation with its intensity, frequency, etc. The converted vibration effect parameters change in real time with the gesture, thereby achieving the purpose of creating tactile effects through gestures, allowing users to customize the tactile effects for the target audio and video files, and the operation is simple and convenient, and the user experience is better. BRIEF DESCRIPTION OF THE DRAWINGS

[0034] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the following briefly introduces the drawings required for describing the embodiments. Obviously, the drawings described below are only some embodiments of the present invention. Those skilled in the art can also derive other drawings based on these drawings without inventive work, among which:

[0035] FIG1 is a flowchart of a method for creating tactile effects in real time through gestures provided by an embodiment of the present invention;

[0036] FIG2 is a schematic diagram illustrating the conversion of a gesture input into a vibration signal when creating a tactile effect through a sliding gesture in a method for creating a tactile effect through gestures in real time according to an embodiment of the present invention;

[0037] FIG3 is a structural block diagram of a system for creating tactile effects in real time through gestures provided by an embodiment of the present invention;

[0038] FIG4 is a structural block diagram of an electronic device provided by an embodiment of the present invention;

[0039] FIG5 is a diagram illustrating an example application scenario of the method for creating tactile effects in real time through gestures provided by an embodiment of the present invention. Modes for Carrying Out the Invention

[0040] The following will clearly and completely describe the technical solutions in the embodiments of the present invention in conjunction with the accompanying drawings. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without making creative efforts are within the scope of protection of the present invention.

[0041] Implementation List 1

[0042] Referring to FIG1 , a method for creating tactile effects in real time through gestures is used in touch screen electronic terminals, such as mobile phones and tablet computers. The method comprises the following steps:

[0043] Step S1: Obtain a target image file, automatically divide the target image file into tracks and display the track parameters of each track.

[0044] In this embodiment, the target image file includes at least one of an audio file, a video file, an animation file, a gif file, and a dynamic expression file. Of course, it is not limited to the above examples, and its purpose is mainly to achieve a synchronous combination of sound, dynamic, and vibration feedback effects for files with dynamic effects.

[0045] The method of creating tactile effects in real time through gestures of the present invention is used to create tactile effects that are highly synchronized with a target graphic file on a time axis, and the creation results can be experienced instantly.

[0046] Step S2: Identify whether each track has track parameters: If so, define the track parameters of the track as adjustable. If not, define the track parameters of the track as non-adjustable, that is, cannot enter the tactile creation.

[0047] Through the identification process in step S2 , the track parameters of the track with adjustable track parameters can be adjusted, that is, vibration parameters are written into the track parameters, which are expressed as feedback of tactile effects.

[0048] Step S3: Detect the input gesture tactile signal in real time, generate a corresponding real-time vibration signal according to a preset rule for the gesture tactile signal detected in real time, and simultaneously drive the vibration unit through the real-time vibration signal to produce a corresponding vibration feedback effect, and synchronously write the real-time vibration signal into the track parameter as an input parameter; wherein the real-time vibration signal is synchronized with the track on the time axis.

[0049] In this step, the input of the gesture tactile signal is achieved through a virtual device, such as the touch screen of an electronic terminal. In this embodiment, the gesture tactile signal is generated by different touch modules displayed on the touch screen. The gesture tactile signal includes at least one of tapping, long pressing, and sliding. Of course, different tactile effects can also be achieved by combining the pressing force and duration to generate creative effects combining vibration and sound effects in real time.

[0050] In this embodiment, specifically, the preset rules include:

[0051] When the duration of the gesture tactile signal is less than or equal to the preset duration, it is defined as a tap, and a first real-time vibration signal with a duration equal to the preset duration is generated based on the tap duration. For example, the preset duration is 100ms. In other words, when the tapping duration of the gesture tactile signal is less than 100ms, it defaults to 100ms, and a first real-time vibration signal corresponding to a duration of 100ms is generated and inserted into the corresponding track parameters.

[0052] When the duration of the gesture tactile signal is greater than the preset duration, it is defined as a long press, and a second real-time vibration signal of a corresponding duration is generated according to the duration of the long press.

[0053] Thereby, haptic effects of long vibration and short vibration can be achieved.

[0054] In addition to the length of vibration, in order to enrich the tactile effect, the present invention also adds tactile effects of different vibration intensities to meet the different tactile feedback at different time points. Specifically, the preset rules also include:

[0055] When the gesture tactile signal is detected to be continuously pressed and enters different intensity intervals, it is defined as sliding, and a third real-time vibration signal of corresponding duration is generated according to the duration of the sliding, and the vibration intensity value corresponding to the previous intensity interval when entering each different intensity interval is recorded, and converted into a curve point of vibration intensity change, and the curve point is written into the third real-time vibration signal. The curve point serves as the inflection point of the intensity change of the third real-time vibration signal at different time points. As shown in Figure 2, it is a schematic diagram of the conversion of gesture input into vibration signal when creating tactile effect through sliding gesture in the method of creating tactile effect through gesture in real time provided by an embodiment of the present invention.

[0056] The intensity range is to divide the touch screen area where the gesture tactile signal is input into N equal parts from top to bottom, and the difference value corresponding to each equal part is X. Then the overall intensity range of the touch screen area where the gesture tactile signal is input is , where N and X are natural numbers.

[0057] In this embodiment, N=5, X=20; the intensity interval of the touch screen area where the gesture tactile signal is input is [0, 100]. Of course, the specific data settings can be set as needed, and the principles are the same.

[0058] When the gesture sliding amplitude is large and the speed is fast, the number of curve points generated is different. In order to further optimize the vibration feedback effects of different intensities and make the tactile effect of the vibration feedback more experiential, in the present invention, the preset rules also include:

[0059] When the third real-time vibration signal drives the vibration unit to generate a real-time vibration feedback effect, when the number of the curve points exceeds an upper limit, the vibration unit stops vibrating, and the curve points exceeding the upper limit are removed, and then the curve points within the upper limit range are written into the third real-time vibration signal to generate a final third real-time vibration signal.

[0060] In this embodiment, the upper limit of the curve points of the same third real-time vibration signal is 16.

[0061] More preferably, in order to better distinguish the vibration effects of long pressing and sliding and improve the tactile feedback experience, the preset rules also include: when the third real-time vibration signal drives the vibration unit to produce a real-time vibration feedback effect, when the number of the curve points is within the upper limit value range and it stops sliding in the same intensity range, the duration of the current gesture tactile signal staying in the same intensity range is detected. If it exceeds the preset stagnation duration, the vibration unit stops vibrating, and the curve point is inserted into the third real-time vibration signal to generate the final third real-time vibration signal.

[0062] In this embodiment, the preset stagnation time is 5 seconds.

[0063] In order to further optimize the vibration feedback effect, the lower limit value of the curve point is limited to avoid being difficult to distinguish from the feedback effect during long pressing. If, when the vibration ends, the number of curve points of the final third real-time vibration signal is less than the lower limit value, then according to the basic criterion of the final third real-time vibration signal, that is, based on the fact that the final third real-time vibration signal has been generated, the curve points equal to the lower limit value are supplemented at the end of the final third real-time vibration signal to update the final third real-time vibration signal.

[0064] For example, in this embodiment, the lower limit is 4. When the number of curve points of the final third real-time vibration signal is less than the lower limit of 4, for example, the number of curve points is 2, then based on the final third real-time vibration signal with 2 curve points, 2 curve points are added at the end thereof to meet the minimum requirement of 4 curve points, thereby updating the final third real-time vibration signal and writing the orbital parameters.

[0065] Step S4: Bind all the real-time vibration signals generated during the playback duration of the target image file to the target image file to form a final vibration signal of the target image file, which is used to make the target image file produce a tactile effect.

[0066] That is, the final first real-time vibration signal, the final second real-time vibration signal, and the final third real-time vibration signal (or the updated final third real-time vibration signal) are all bound to the target image file to form the final vibration signal of the target image file.

[0067] Binding all the real-time vibration signals to the target graphic file is equivalent to writing the vibration signals generated according to preset rules into the original track parameters as the created track parameters, and merging them with the original track parameters, thereby adding new effect output to the effects of the original track parameters, such as adding a tactile effect in the form of vibration feedback to the original sound or animation effect.

[0068] Through the above method, the present invention's method for creating haptic effects through gestures in real time uses user gestures such as tapping, long pressing, and sliding on a virtual device as input parameters, which are converted into vibration effects and ultimately correspond to the output vibrotactile sensations. This allows for segmented tactile design on a touch interface. By combining and optimizing gesture interactions across different virtual areas, personalized tactile effects can be generated, resulting in simple and convenient operation and a superior user experience.

[0069] The present invention's method for creating tactile effects through real-time gestures, also known as gesture tactile input, is a creative approach that, in addition to vibrating music scenes, can also be used to match vibrating tactile sensations to videos, animations, animated graphics, emoticons, and other media. Using the same approach on virtual interfaces, it provides users with a third-dimensional sensory experience beyond vision and hearing. Figure 5 shows an example scenario for the method for creating tactile effects through real-time gestures, as provided in an embodiment of the present invention. When the touch panel is activated, users can create custom vibration-related creations based on animated movements or sound rhythms.

[0070] Compared with the related art, the method and related equipment of the present invention for creating tactile effects in real time through gestures divide the target graphic file into tracks and display the track parameters of each track, then detect the input gesture tactile signal and generate a corresponding real-time vibration signal according to preset rules, and synchronously write the real-time vibration signal into the track parameter as an input parameter, thereby converting the gesture tactile signal into a real-time vibration signal and then outputting it. The gesture has a strong interactive correlation with its intensity, frequency, etc. The converted vibration effect parameters change in real time with the gesture, thereby achieving the purpose of creating tactile effects through gestures, allowing users to customize the tactile effects for the target audio and video files, and the operation is simple and convenient, and the user experience is better.

[0071] Example 2

[0072] FIG3 is a block diagram of a system for creating tactile effects in real time through gestures according to an embodiment of the present invention. The present invention also provides a system 300 for creating tactile effects in real time through gestures, including:

[0073] The track division module 301 is used to obtain a target image file, automatically divide the target image file into tracks and display the track parameters of each track.

[0074] In this embodiment, the target image file includes at least one of an audio file, a video file, an animation file, a gif file, and a dynamic expression file. Of course, it is not limited to the above examples, and its purpose is mainly to achieve a synchronous combination of sound, dynamic, and vibration feedback effects for files with dynamic effects.

[0075] Track parameter identification module 302 is used to identify whether each track has track parameters. If so, the track parameters of the track are defined as adjustable. If not, the track parameters of the track are considered non-adjustable, that is, tactile creation cannot be entered.

[0076] Track parameters are adjusted for tracks with adjustable track parameters, that is, vibration parameters are written into the track parameters, which are expressed as feedback of tactile effects.

[0077] The vibration signal generation module 303 is used to detect the input gesture tactile signal in real time, generate a corresponding real-time vibration signal according to a preset rule for the gesture tactile signal detected in real time, and simultaneously drive the vibration unit through the real-time vibration signal to produce a corresponding vibration feedback effect, and write the real-time vibration signal as an input parameter into the track parameter synchronously; wherein the real-time vibration signal is synchronized with the track on the time axis to ensure that the tactile effect of the vibration feedback is synchronized with the content of the target image file.

[0078] In this embodiment, the input of gesture tactile signals is achieved through a virtual device, such as a touch screen of an electronic terminal. In this embodiment, the gesture tactile signals are generated by different touch modules displayed on the touch screen. The gesture tactile signals include at least one of tapping, long pressing, and sliding. Of course, different tactile effects can also be achieved by combining the pressure and duration of the pressing to generate creative effects that combine vibration and sound effects in real time.

[0079] In this embodiment, specifically, the preset rules include:

[0080] When the duration of the gesture tactile signal is less than or equal to the preset duration, it is defined as a tap, and a first real-time vibration signal with a duration equal to the preset duration is generated based on the tap duration. For example, the preset duration is 100ms. In other words, when the tapping duration of the gesture tactile signal is less than 100ms, it defaults to 100ms, and a first real-time vibration signal corresponding to a duration of 100ms is generated and inserted into the corresponding track parameters.

[0081] When the duration of the gesture tactile signal is greater than the preset duration, it is defined as a long press, and a second real-time vibration signal of a corresponding duration is generated according to the duration of the long press.

[0082] Thereby, haptic effects of long vibration and short vibration can be achieved.

[0083] In addition to the length of vibration, in order to enrich the tactile effect, the present invention also adds tactile effects of different vibration intensities to meet the different tactile feedback at different time points. Specifically, the preset rules also include:

[0084] When the gesture tactile signal is detected to be continuously pressed and enters different intensity intervals, it is defined as sliding, and a third real-time vibration signal of corresponding duration is generated according to the duration of the sliding, and the vibration intensity value corresponding to the previous intensity interval when entering each different intensity interval is recorded, and converted into a curve point of vibration intensity change, and the curve point is written into the third real-time vibration signal. The curve point serves as the inflection point of the intensity change of the third real-time vibration signal at different time points. As shown in Figure 2, it is a schematic diagram of the conversion of gesture input into vibration signal when creating tactile effect through sliding gesture in the method of creating tactile effect through gesture in real time provided by an embodiment of the present invention.

[0085] The intensity range is to divide the touch screen area where the gesture tactile signal is input into N equal parts from top to bottom, and the difference value corresponding to each equal part is X. Then the overall intensity range of the touch screen area where the gesture tactile signal is input is , where N and X are natural numbers.

[0086] In this embodiment, N=5, X=20; the intensity interval of the touch screen area where the gesture tactile signal is input is [0, 100]. Of course, the specific data settings can be set as needed, and the principles are the same.

[0087] When the gesture sliding amplitude is large and the speed is fast, the number of curve points generated is different. In order to further optimize the vibration feedback effects of different intensities and make the tactile effect of the vibration feedback more experiential, in the present invention, the preset rules also include:

[0088] When the third real-time vibration signal drives the vibration unit to generate a real-time vibration feedback effect, when the number of the curve points exceeds an upper limit, the vibration unit stops vibrating, and the curve points exceeding the upper limit are removed, and then the curve points within the upper limit range are written into the third real-time vibration signal to generate a final third real-time vibration signal.

[0089] In this embodiment, the upper limit of the curve points of the same third real-time vibration signal is 16.

[0090] More preferably, in order to better distinguish the vibration effects of long pressing and sliding and improve the tactile feedback experience, the preset rules also include: when the third real-time vibration signal drives the vibration unit to produce a real-time vibration feedback effect, when the number of the curve points is within the upper limit value range and it stops sliding in the same intensity range, the duration of the current gesture tactile signal staying in the same intensity range is detected. If it exceeds the preset stagnation duration, the vibration unit stops vibrating, and the curve point is inserted into the third real-time vibration signal to generate the final third real-time vibration signal.

[0091] In this embodiment, the preset stagnation time is 5 seconds.

[0092] In order to further optimize the vibration feedback effect, the lower limit value of the curve point is limited to avoid being difficult to distinguish from the feedback effect during long pressing. If, when the vibration ends, the number of curve points of the final third real-time vibration signal is less than the lower limit value, then according to the basic criterion of the final third real-time vibration signal, that is, based on the fact that the final third real-time vibration signal has been generated, the curve points equal to the lower limit value are supplemented at the end of the final third real-time vibration signal to update the final third real-time vibration signal.

[0093] For example, in this embodiment, the lower limit is 4. When the number of curve points of the final third real-time vibration signal is less than the lower limit of 4, for example, the number of curve points is 2, then based on the final third real-time vibration signal with 2 curve points, 2 curve points are added at the end thereof to meet the minimum requirement of 4 curve points, thereby updating the final third real-time vibration signal and writing the orbital parameters.

[0094] The tactile effect generation module 304 is used to bind all the real-time vibration signals generated during the playback time of the target image file to the target image file to form a final vibration signal of the target image file, which is used to make the target image file produce a tactile effect.

[0095] In this embodiment, the technical effects and principles achieved by the system for creating tactile effects in real time through gestures are the same as the technical effects and principles achieved by the method for creating tactile effects in real time through gestures provided above in the present invention, and will not be repeated here.

[0096] Example 3

[0097] 4 , an embodiment of the present invention further provides an electronic device 400, including a processor 401, a memory 402, and a program for creating tactile effects in real time through gestures, which is stored in the memory 402 and can be run on the processor 401. When the program for creating tactile effects in real time through gestures is executed by the processor 401, the steps of the method for creating tactile effects in real time through gestures provided by the present invention are implemented as follows:

[0098] Step S1: Obtain a target image file, automatically divide the target image file into tracks and display the track parameters of each track.

[0099] Step S2: Identify whether each track has track parameters: If so, define the track parameters of the track as adjustable track parameters.

[0100] Step S3: Detecting the input gesture tactile signals in real time, generating corresponding real-time vibration signals based on preset rules, and simultaneously driving the vibration unit with the real-time vibration signals to produce corresponding vibration feedback effects. The real-time vibration signals are then written into the track parameters as input parameters; the real-time vibration signals are synchronized with the track on the timeline. The preset rules are the same as those in the above-mentioned method for creating tactile effects through gestures in real time and are not further described here.

[0101] Step S4: Bind all the real-time vibration signals generated during the playback duration of the target image file to the target image file to form a final vibration signal of the target image file, which is used to make the target image file produce a tactile effect.

[0102] Memory 402 can be used to store software programs and various data. Memory 402 may primarily include a program storage area and a data storage area. The program storage area may store an operating system and at least one application required for a function (such as sound playback or image playback); the data storage area may store data generated based on the use of the mobile phone (such as audio data and a phone book). Memory 402 may also include high-speed random access memory and non-volatile memory, such as at least one disk storage device, flash memory device, or other volatile solid-state storage device.

[0103] Processor 401 is the terminal's control center, connecting all components of the terminal using various interfaces and circuits. By running or executing software programs and / or modules stored in memory 402 and accessing data stored in memory 402, it performs various terminal functions and processes data, thereby providing overall terminal monitoring. Processor 401 may include one or more processing units; preferably, processor 401 may integrate an application processor and a modem processor. The application processor primarily processes the operating system, user interface, and application programs, while the modem processor primarily handles wireless communications. It is understood that the modem processor may not be integrated into processor 401.

[0104] It should be noted that when the electronic device 400 is in use, it can achieve the technical effects achieved by the above-mentioned method of creating tactile effects in real time through gestures. Please refer to the description of the above-mentioned method of creating tactile effects in real time through gestures, which will not be repeated here.

[0105] Example 4

[0106] An embodiment of the present invention also provides a computer-readable storage medium, on which is stored a program for creating tactile effects in real time through gestures. When the program for creating tactile effects in real time through gestures is executed by a processor, the steps in the method for creating tactile effects in real time through gestures provided by the present invention are implemented, so that the technical effects that can be achieved are the same as the technical effects achieved by the method for creating tactile effects in real time through gestures, which will not be repeated here.

[0107] The computer-readable storage medium may be a read-only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disk.

[0108] It should be noted that, in this document, the terms "comprises," "includes," or any other variations thereof are intended to encompass non-exclusive inclusion, such that a process, method, article, or apparatus comprising a series of elements includes not only those elements but also other elements not explicitly listed, or elements inherent to such process, method, article, or apparatus. In the absence of further limitations, an element defined by the phrase "comprising a ..." does not exclude the presence of other identical elements in the process, method, article, or apparatus comprising the element.

[0109] Through the above description of the embodiments, those skilled in the art will clearly understand that the methods of the above embodiments can be implemented using software plus the necessary general-purpose hardware platform. Of course, hardware can also be used, but in many cases the former is the more preferred implementation method. Based on this understanding, the technical solution of the present invention, or the portion that contributes to the prior art, can be embodied in the form of a software product. This computer software product is stored in a storage medium (such as ROM / RAM, magnetic disk, or optical disk) and includes a number of instructions for enabling a terminal (such as a mobile phone, computer, server, air conditioner, or network device) to execute the methods described in the various embodiments of the present invention.

[0110] The above description is only an embodiment of the present invention. It should be pointed out that those skilled in the art can make improvements without departing from the creative concept of the present invention, but these improvements all fall within the scope of protection of the present invention.

Claims

1. A method for creating tactile effects in real time through gestures, applied to a touch screen electronic terminal, It is characterized in that The method comprises the following steps: Acquire a target image file, automatically divide the target image file into tracks and display track parameters of each track; Identify whether each track has a track parameter: if so, define the track parameter of the track as an adjustable track parameter; Detecting input gesture tactile signals in real time, generating corresponding real-time vibration signals according to preset rules from the gesture tactile signals detected in real time, and driving the vibration unit to generate corresponding vibration feedback effects through the real-time vibration signals, and writing the real-time vibration signals as input parameters into the track parameters synchronously; wherein the real-time vibration signals are synchronized with the track on the time axis; All the real-time vibration signals generated during the playback time of the target image file are bound to the target image file to form a final vibration signal of the target image file, which is used to make the target image file produce a tactile effect.

2. The method of creating tactile effects in real time by gestures according to claim 1, It is characterized in that The target image file includes at least one of an audio file, a video file, an animation file, a gif file, and a dynamic expression file.

3. The method of creating tactile effects in real time through gestures according to claim 1, It is characterized in that The gesture tactile signal includes at least one of tapping, long pressing, and sliding.

4. The method of creating tactile effects in real time by gestures according to claim 3, It is characterized in that The gesture tactile signals are generated by different touch modules displayed on the touch screen.

5. The method of creating tactile effects in real time by gestures according to claim 3, It is characterized in that The preset rules include: When the duration of the gesture tactile signal is less than or equal to the preset duration, it is defined as a tap, and a first real-time vibration signal with a duration equal to the preset duration is generated according to the tapping duration; When the duration of the gesture tactile signal is greater than the preset duration, it is defined as a long press, and a second real-time vibration signal of a corresponding duration is generated according to the duration of the long press.

6. The method of creating tactile effects in real time by gestures according to claim 5, It is characterized in that The preset duration is 100ms.

7. The method of creating tactile effects in real time by gestures according to claim 3, It is characterized in that The preset rules also include: When the gesture tactile signal is detected to be continuously pressed and enters different intensity intervals, it is defined as sliding, and a third real-time vibration signal of a corresponding duration is generated according to the duration of the sliding, and the vibration intensity value corresponding to the previous intensity interval when entering each different intensity interval is recorded, and converted into a curve point of the vibration intensity change, and the curve point is written into the third real-time vibration signal as the intensity change inflection point of the third real-time vibration signal at different time points; wherein, the intensity interval is to divide the touch screen area where the gesture tactile signal is input into N equal parts from top to bottom, and the difference corresponding to each equal part is X, then the overall intensity interval range of the touch screen area where the gesture tactile signal is input is , where N and X are natural numbers.

8. The method of creating tactile effects in real time by gestures according to claim 7, It is characterized in that The preset rules also include: When the third real-time vibration signal drives the vibration unit to produce a real vibration feedback effect, when the number of the curve points exceeds the upper limit value, the vibration unit stops vibrating, and the curve points exceeding the upper limit value are removed, and then the curve points within the upper limit value range are written into the third real-time vibration signal to generate a final third real-time vibration signal.

9. The method of creating tactile effects in real time by gestures according to claim 8, It is characterized in that The preset rules also include: When the third real-time vibration signal drives the vibration unit to generate a real-time vibration feedback effect, when the number of the curve points is within the upper limit value range and the sliding stops in the same intensity interval, the duration of the current gesture tactile signal staying in the same intensity interval is detected. If the duration exceeds the preset stagnation duration, the vibration unit stops vibrating, and the curve points are inserted into the third real-time vibration signal to generate the final third real-time vibration signal; If, at the end of vibration, the number of curve points of the final third real-time vibration signal is less than a lower limit value, then, according to the basic criteria of the final third real-time vibration signal, the curve points equal to the lower limit value are supplemented at the end of the final third real-time vibration signal to update the final third real-time vibration signal.

10. The method for creating tactile effects in real time by gestures according to claim 9, It is characterized in that N=5, X=20; the intensity interval of the touch screen area of ​​the gesture tactile signal input is [0, 100]; The upper limit value of the curve points of the same third real-time vibration signal is 16, and the lower limit value is 4; The preset duration is 5 seconds.

11. A system for creating tactile effects in real time through gestures, It is characterized in that include: A track division module, the track division module is used to obtain a target image file, automatically divide the target image file into tracks and display track parameters of each track; A track parameter identification module, the track parameter identification module is used to identify whether each track has a track parameter: if so, the track parameter of the track is defined as an adjustable track parameter; A vibration signal generating module, the vibration signal generating module is used to detect the input gesture tactile signal in real time, generate a corresponding real-time vibration signal according to a preset rule from the gesture tactile signal detected in real time, and simultaneously drive the vibration unit to generate a corresponding vibration feedback effect through the real-time vibration signal, and synchronously write the real-time vibration signal into the track parameter as an input parameter; wherein the real-time vibration signal is synchronized with the track on the time axis; A tactile effect generation module is used to bind all the real-time vibration signals generated during the playback time of the target image file to the target image file to form a final vibration signal of the target image file, so as to make the target image file produce a tactile effect.

12. An electronic device, It is characterized in that The method comprises a processor, a memory, and a program for creating tactile effects in real time by gestures, which is stored in the memory and can be run on the processor. When the program for creating tactile effects in real time by gestures is executed by the processor, the steps in the method for creating tactile effects in real time by gestures as described in any one of claims 1 to 10 are implemented.

13. A computer-readable storage medium, It is characterized in that The computer-readable storage medium stores a program for creating tactile effects in real time through gestures, and when the program for creating tactile effects in real time through gestures is executed by a processor, the steps in the method for creating tactile effects in real time through gestures as described in any one of claims 1-10 are implemented.

Images