Haptic effect reproduction method, device, storage medium and computer device
The method and device synchronize haptic effect playback times to address inconsistencies caused by device performance variations, providing a uniform user experience across different devices.
Patent Information
- Application Number
- JP2023531663
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2022-11-04
- Filing Date
- 2023-01-10
- Publication Date
- 2024-11-08
- Estimated Expiration
- Not applicable · inactive patent
AI Technical Summary
Haptic effect playback times vary due to device performance differences, leading to inconsistent user experiences across different devices.
A method and device that generate a haptic effect reproduction instruction, obtain synchronization delay time based on delay time data, and reproduce haptic effects accordingly to ensure synchronized playback across devices.
This approach minimizes playback delays and ensures consistent haptic experiences across devices with varying performance, enhancing user experience.
Smart Images

Figure 2024541149000001_ABST
Abstract
Description
[Technical field]
[0001] The present invention relates to the field of digital image processing, and in particular to a haptic effect reproduction method, apparatus, storage medium and computer device. [Background technology]
[0002] Haptic effects play an important role in the interactive experience of mobile devices, not only by improving usability through vibration feedback, but also by enriching the sensory experience through vibration effects. However, due to various performance differences, such as system differences between different devices and differences in the degree of optimization, the level of haptic effect playback time may differ, which may affect the user experience effect. Summary of the Invention
[0003] In consideration of the above circumstances, an embodiment of the present invention provides a haptic effect playback method, device, storage medium, and computer device that can solve the problem of inconsistency in haptic effect playback times due to differences in device performance and improve the user experience.
[0004] First, an embodiment of the present invention provides a haptic effect playing method, the method including: generating a haptic effect playing instruction in response to a user's operation, obtaining a synchronization delay time based on the haptic effect playing instruction and delay time data, and playing at least one haptic effect corresponding to the haptic effect playing instruction based on the synchronization delay time and the haptic effect playing instruction.
[0005] Preferably, before obtaining the synchronization delay time based on the haptic effect playback instruction and delay time data, the method further comprises receiving delay time data collected by a delay data collector.
[0006] Preferably, the haptic effect playing instruction includes one or more of a visual effect playing instruction, an audio effect playing instruction, and a haptic effect playing instruction.
[0007] Preferably, the haptic effect playback instruction includes a vibration effect playback instruction.
[0008] Preferably, the synchronization delay time is a delay time required for at least one haptic effect corresponding to the haptic effect playback instruction to maintain synchronization.
[0009] Preferably, playing at least one haptic effect corresponding to the haptic effect playback instruction based on the synchronization delay time and the haptic effect playback instruction includes sending the haptic effect playback instruction to at least one haptic effect player corresponding to the haptic effect playback instruction based on the synchronization delay time, and playing at least one haptic effect corresponding to the haptic effect playback instruction using the at least one haptic effect player.
[0010] An embodiment of the present invention also provides a haptic effect playback device, comprising: a processing module that generates a haptic effect playback instruction in response to a user's operation, and a playback module that acquires a synchronization delay time based on the haptic effect playback instruction and delay time data, and plays at least one haptic effect corresponding to the haptic effect playback instruction based on the synchronization delay time and the haptic effect playback instruction.
[0011] Preferably, the apparatus comprises a transceiver module for receiving delay time data collected by a delay data collector.
[0012] An embodiment of the present invention also provides a computer-readable storage medium storing a program, the program including program instructions that, when executed by a computer, cause the computer to perform the method.
[0013] An embodiment of the present invention also provides a computer device comprising a memory and a processor, the memory storing information including program instructions, the processor controlling execution of the program instructions, the program instructions performing the steps of the method when loaded and executed by the processor.
[0014] In the technical solutions of a haptic effect playing method, device, storage medium and computer device provided by the embodiments of the present invention, the method includes: generating a haptic effect playing instruction according to a user's operation, obtaining a synchronization delay time according to the haptic effect playing instruction and delay time data, and playing at least one haptic effect corresponding to the haptic effect playing instruction according to the synchronization delay time and the haptic effect playing instruction, thereby solving the problem of inconsistency in haptic effect playing time caused by different device performances and improving user experience. [Brief description of the drawings]
[0015] In order to more clearly describe the technical solutions according to the embodiments of the present invention, the following briefly describes the accompanying drawings that need to be used in the description of the embodiments. Of course, the accompanying drawings in the following description are only some embodiments of the present invention, and those skilled in the art in the relevant field can obtain other drawings from these accompanying drawings without creative work.
[0016] [Figure 1] 4 is a flowchart of a haptic effect playing method provided by one embodiment of the present invention. [Diagram 2] 4 is a flowchart of a haptic effect playing method provided by another embodiment of the present invention. [Diagram 3] 1 is a schematic diagram of a computing device provided by an embodiment of the present invention. [Figure 4]3 is a specific flowchart of playing at least one haptic effect corresponding to the haptic effect playing instruction according to the synchronization delay time and the haptic effect playing instruction in FIG. 2 . [Diagram 5] 1 is a schematic diagram showing the configuration of a haptic effect reproducing device provided according to an embodiment of the present invention; [Figure 6] 1 is a schematic diagram of a computing device provided by an embodiment of the present invention. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0017] In order to better understand the technical solutions of the present invention, the following detailed description of the embodiments of the present invention is given with reference to the accompanying drawings.
[0018] It should be noted that the embodiments described below are merely some of the embodiments of the present invention and are not limited thereto. All other embodiments that can be obtained by those skilled in the art based on the embodiments of the present invention without performing creative work are included in the scope of protection of the present invention.
[0019] The terms used in the embodiments of the present invention are intended to describe particular embodiments only and are not intended to limit the present invention. As used in the embodiments of the present invention and the appended claims, the singular forms "a," "the," and "this / it" are intended to include the plural forms unless the context clearly indicates otherwise.
[0020] It is also understood that the term "and / or" used herein is merely a description of the association relationship of related objects, and indicates that three relationships may exist. For example, it should be understood that A and / or B may mean that A exists alone, that A and B exist simultaneously, or that B exists alone. Also, the character " / " in this specification generally indicates that there is an "or" relationship between the related objects before and after.
[0021] FIG. 1 is a flow chart of an effect playback delay method provided by an embodiment of the present invention. As shown in FIG. 1, the method includes:
[0022] In step 102, a haptic effect reproduction instruction is generated in response to an operation by a user.
[0023] In step 104, a synchronization delay time is obtained based on the haptic effect playback instruction and the delay time data.
[0024] In step 106, at least one haptic effect corresponding to the haptic effect play instruction is played based on the synchronization delay time and the haptic effect play instruction.
[0025] In a technical solution of a haptic effect playing method provided by an embodiment of the present invention, the method includes: generating a haptic effect playing instruction according to a user's operation, obtaining a synchronization delay time according to the haptic effect playing instruction and delay time data, and playing at least one haptic effect corresponding to the haptic effect playing instruction according to the synchronization delay time and the haptic effect playing instruction, thereby solving the problem of inconsistency in haptic effect playing time caused by different device performances and improving user experience.
[0026] 2 is a flowchart of a haptic effect playing method provided by another embodiment of the present invention. As shown in FIG. 2, the method includes: In step 202, a haptic effect reproduction instruction is generated in response to an operation by a user.
[0027] In an embodiment of the present invention, each step may be performed by a computer device. As shown in Fig. 3, the computer device includes a target application, a control processing module, a delay data collector, and a haptic effect playback player. The target application includes a system application or a third-party application.
[0028] In this step, when a user uses a target application of a computer device, some special interactive operations may trigger one or more haptic effect playback in vision, hearing and touch. An embodiment of the present invention is based on normal playback haptic effect, after a user performs a specific interactive operation, the target application of the computer device normally sends a haptic effect playback instruction to a control processing module, as shown in Figure 3. The haptic effect includes a visual effect, an auditory effect, or a haptic effect.
[0029] The haptic effect play instruction includes one or more of a visual effect play instruction, an audio effect play instruction, and a haptic effect play instruction. The visual effect play instruction is used to cause the computer device to play a visual effect. The audio effect play instruction is used to cause the computer device to play an audio effect. The haptic effect play instruction is used to cause the computer device to play a haptic effect.
[0030] The haptic effect play instruction includes a vibration effect play instruction, which is used to cause the computing device to play a vibration effect.
[0031] In step 204, delay time data collected by a delay data collector is received.
[0032] As shown in FIG. 3, the delay data collector collects delay time data of past haptic effect playbacks by the computing device and transmits the delay time data to the control processing module.
[0033] In step 206, a synchronization delay time is obtained based on the haptic effect playing instruction and the delay time data.
[0034] As shown in Figure 3, the control processing module integrates and processes the acquired delay time data, and uses an algorithm to obtain the synchronization delay time required for multiple visual, auditory, and tactile effect materials to maintain synchronization.
[0035] In this step, the synchronization delay time is the delay time required for at least one haptic effect corresponding to the haptic effect play instruction to maintain synchronization.
[0036] At step 208, at least one haptic effect corresponding to the haptic effect play instruction is played based on the synchronization delay time and the haptic effect play instruction.
[0037] In one embodiment of the present invention, as shown in FIG. 4, step 208 is specifically configured as follows.
[0038] In step 2082, a haptic effect play instruction is sent to at least one haptic effect player corresponding to the haptic effect play instruction based on the synchronization delay time.
[0039] In step 2084, at least one haptic effect corresponding to the haptic effect play instruction is played by at least one haptic effect player.
[0040] The haptic effect player receives and plays a haptic effect playback instruction after a control delay, and completes the perfect synchronization of the playback times of a plurality of materials to achieve a desired playback effect.
[0041] The haptic effect reproducing method provided by the embodiment of the present invention can handle the reproduction delay caused by the difference between different processors, different players, and different computer devices, effectively solve the reproduction delay problem of haptic effects (e.g., vibration effects) caused by the performance difference, minimize the mismatch situation between the haptic effect reproduction and other materials such as audio and screen, and provide a consistent haptic experience to users of different computer devices. In addition, Original Equipment Manufacturers (OEMs) can effectively solve the difference in vibration reproduction effect caused by the difference between high and low performance computer devices and even different types of terminal devices, realize the consistency of experience within the brand, and also ensure that content makers of games, music, videos, etc. can obtain the same experience effect regardless of the computer device used by the player.
[0042] In a technical solution of a haptic effect playing method provided by an embodiment of the present invention, the method includes: generating a haptic effect playing instruction according to a user's operation, obtaining a synchronization delay time according to the haptic effect playing instruction and delay time data, and playing at least one haptic effect corresponding to the haptic effect playing instruction according to the synchronization delay time and the haptic effect playing instruction, thereby solving the problem of inconsistency in haptic effect playing time caused by different device performances and improving user experience.
[0043] 5 is a schematic diagram showing the configuration of a haptic effect playback device provided according to an embodiment of the present invention. As shown in FIG. 5, the device includes a processing module 31 and a playback module 32.
[0044] The processing module 31 generates a haptic effect reproduction instruction in response to an operation by a user.
[0045] The processing module 31 obtains a synchronization delay time based on the haptic effect reproduction instruction and the delay time data.
[0046] The playback module 32 plays at least one haptic effect corresponding to the haptic effect play instruction based on the synchronization delay time and the haptic effect play instruction.
[0047] An embodiment of the present invention also provides a haptic effect playback device, comprising: a processing module that generates a haptic effect playback instruction in response to a user's operation, and a playback module that acquires a synchronization delay time based on the haptic effect playback instruction and delay time data, and plays at least one haptic effect corresponding to the haptic effect playback instruction based on the synchronization delay time and the haptic effect playback instruction.
[0048] Preferably, the device comprises a transceiver module 33 for receiving the delay time data collected by the delay data collector.
[0049] Preferably, the haptic effect playing instruction includes one or more of a visual effect playing instruction, an audio effect playing instruction, and a haptic effect playing instruction.
[0050] Preferably, the haptic effect playback instruction includes a vibration effect playback instruction.
[0051] Preferably, the synchronization delay time is a delay time required for at least one haptic effect corresponding to a haptic effect play instruction to maintain synchronization.
[0052] Preferably, the transceiver module 33 is further used for transmitting the haptic effect playing instruction to at least one haptic effect player corresponding to the haptic effect playing instruction based on the synchronization delay time.
[0053] The playback module 32 is specifically used by at least one haptic effect player to play at least one haptic effect corresponding to a haptic effect playback instruction.
[0054] In the technical solution of the effect playback delay device provided by the embodiment of the present invention, a haptic effect playback instruction is generated according to a user's operation, a synchronization delay time is obtained according to the haptic effect playback instruction and delay time data, and at least one haptic effect corresponding to the haptic effect playback instruction is played according to the synchronization delay time and the haptic effect playback instruction, thereby solving the problem of inconsistency in haptic effect playback time caused by different device performances and improving the user experience.
[0055] Fig. 6 is a schematic diagram of a computer device provided by an embodiment of the present invention. As shown in Fig. 6, a computer device 20 according to this embodiment includes a processor 21, a memory 22, and a program 23 stored in the memory 22 and executable by the processor 21. When executed by the processor 21, this program 23 realizes an effect playback delay method applied in the embodiment, but a description thereof will be omitted here to avoid repetition. Also, when executed by the processor 21, this program realizes the functions of each model / unit in the effect playback delay device applied in the embodiment, but a description thereof will be omitted here to avoid repetition.
[0056] The computer device 20 includes, but is not limited to, a processor 21 and a memory 22. It should be understood by those skilled in the art that FIG. 6 is an example of the computer device 20, and is not limited to the computer device 20, and may include more or fewer components than those shown, may combine some components, or may include different components. For example, the computer device may include an input / output device, a network access device, a communication bus, etc.
[0057] Processor 21 may be a Central Processing Unit (CPU) or other general purpose processor, a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), a Field-Programmable Gate Array (FPGA) or other programmable logic device, a discrete gate or transistor logic device, a discrete hardware component, etc. The general purpose processor may be a microprocessor or any conventional processor, etc.
[0058] The memory 22 may be an internal storage unit of the computer device 20, such as a hard disk or memory of the computer device 20. The memory 22 may be an external storage unit of the computer device 20, such as a plug-in hard disk, a Smart Media Card (SMC), a Secure Digital (SD), or a Flash Card provided in the computer device 20. The memory 22 may also include both an internal storage unit and an external storage unit of the computer device 20. The memory 22 is used to store programs and other programs and data required by the computer device. The memory 22 may also be used to temporarily store output data or data to be output.
[0059] It should be clearly understood by those skilled in the art that the specific operating procedures of the above devices and units can refer to the corresponding procedures in the above method embodiments for convenience and simplification of the description.
[0060] In some embodiments provided by the present invention, it should be understood that the disclosed apparatus and method can be realized in other ways. For example, the above-mentioned apparatus embodiments are merely schematic, and the division of the units is merely a logical division of functions, and can be actually implemented in other ways. For example, multiple units or components can be combined or integrated into another system, or some features can be ignored or not implemented. In addition, the mutual couplings, direct couplings, or communication connections shown or discussed may be indirect couplings or communication connections via some interfaces, devices, or units, which may be electrical, mechanical, or other ways.
[0061] The units described as separate components may or may not be physically separate, and the units shown as units may or may not be physical units, i.e., they may be located in one place or distributed among multiple network units. The objectives of the embodiments of the present invention can be achieved by selecting some or all of the units according to actual needs.
[0062] In addition, each functional unit in various embodiments of the present invention may be integrated into one processing unit, each unit may exist physically separately, or two or more units may be integrated into one unit. The integrated unit may be realized in the form of hardware, or in the form of hardware plus a software functional unit.
[0063] The integrated unit realized in the form of the above software functional unit may be stored in one computer-readable storage medium. The above software functional unit is stored in one storage medium and includes some instructions for a computer device (such as a personal computer (PC), a server, or a network device) or a processor to execute some steps of the method described in each embodiment of the present invention. The above-mentioned storage medium includes a USB memory, a mobile hard drive, a read only memory (ROM), a random access memory (RAM), a disk or a CD-ROM, and various other media that can store program codes.
[0064] It should be noted that the above description is merely a preferred embodiment of the present invention and is not intended to limit the present invention. Any modifications, equivalent replacements, improvements, etc. made within the spirit and principles of the present invention are intended to be included in the scope of protection of the present invention.
Claims
1. 1. A haptic effect reproduction method, comprising: The method comprises: generating a haptic effect reproduction instruction in response to an operation by a user; obtaining a synchronization delay time based on the haptic effect reproduction instruction and delay time data; and playing at least one haptic effect corresponding to the haptic effect playing instruction based on the synchronization delay time and the haptic effect playing instruction. method.
2. Before obtaining the synchronization delay time based on the haptic effect playback instruction and the delay time data, the method further comprises: receiving delay time data collected by a delay data collector.
2. The method of claim 1 .
3. The haptic effect playback instruction includes one or more of a visual effect playback instruction, an auditory effect playback instruction, and a haptic effect playback instruction.
3. The method according to claim 1 or 2.
4. the haptic effect playback instruction includes a vibration effect playback instruction; 4. The method according to claim 3 .
5. the synchronization delay time is a delay time required for at least one haptic effect corresponding to the haptic effect playback instruction to maintain synchronization; 2. The method of claim 1 .
6. reproducing at least one haptic effect corresponding to the haptic effect reproducing instruction based on the synchronization delay time and the haptic effect reproducing instruction, sending the haptic effect playback instruction to at least one haptic effect player corresponding to the haptic effect playback instruction based on the synchronization delay time; and playing at least one haptic effect corresponding to the haptic effect playback instruction using the at least one haptic effect player.
3. The method of claim 2 .
7. A haptic effect reproduction device, comprising: The apparatus comprises: a processing module that generates a haptic effect reproduction instruction in response to an operation by a user; the processing module obtains a synchronization delay time based on the haptic effect reproduction instruction and the delay time data; a playback module configured to play at least one haptic effect corresponding to the haptic effect playback instruction based on the synchronization delay time and the haptic effect playback instruction. An apparatus comprising:
8. a transceiver module for receiving the delay time data collected by the delay data collector; 8. The apparatus according to claim 7 .
9. 1. A computer-readable storage medium, comprising: The computer-readable storage medium stores a program, The program includes program instructions; The program instructions, when executed by a computer, cause the computer to perform the method of claim 1. A computer-readable storage medium comprising:
10. 1. A computing device comprising: A memory and a processor, the memory stores information including program instructions; The processor controls the execution of program instructions; The program instructions, when loaded and executed by the processor, perform the steps of the method of claim 1. A computer apparatus comprising:
Citation Information
Patent Citations
Audio and picture synchronization method and device, vehicle and storage medium
CN114302192A
Recording and reproducing device
JP1993035178A
Systems and methods for recording and playing back point-of-view videos with haptic content
JP2015130169A
Acoustic simulation device
WO2020195407A1
