Information processing device for mixing tactile signals

By using multiple generation units and mixing units in the tactile signal generation device, the problem of generating multiple tactile signals in the prior art is solved, and more natural and effective tactile signal generation is achieved.

CN115136103BActive Publication Date: 2026-11-17SONY GROUP CORP
View PDF 4 Cites 0 Cited by

Patent Information

Application Number
CN202180015404.6
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Priority Date
2020-02-25
Filing Date
2021-01-06
Publication Date
2026-11-17
Estimated Expiration
2041-01-06

AI Technical Summary

Technical Problem

Existing technologies struggle to effectively generate vibration signals that reflect multiple generation strategies. General generation algorithms are typically optimized for a single generation strategy, making it difficult to generate a variety of tactile signals.

Method used

Multiple tactile signal generation units using different generation algorithms are employed, and the generated tactile signals are mixed by a mixing unit. The mixing ratio is controlled to obtain the output tactile signal, including controlling the mixing ratio, selecting tactile signal generation units, and adjusting internal parameters to achieve a more natural intermediate state.

Benefits of technology

It realizes the generation of tactile signals using intermediate states of multiple generation algorithms, avoiding waveform distortion and intensity reduction caused by mixing, and can create a variety of tactile effects more naturally.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN115136103B_ABST
    Figure CN115136103B_ABST
Patent Text Reader

Abstract

The object of this invention is to enable the generation of tactile signals using intermediate states of multiple generation algorithms. The information processing apparatus includes multiple tactile signal generation units that generate tactile signals based on sound signals and using their respective different generation algorithms. A mixing unit mixes the tactile signals generated by at least two of the multiple tactile signal generation units to obtain an output tactile signal. For example, the information processing apparatus also includes a control unit that controls the mixing ratio in the mixing unit.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This technology relates to information processing apparatus and information processing method, and more specifically, to an information signal processing apparatus for obtaining tactile signals. Background Technology

[0002] Traditionally, techniques for generating vibration signals as tactile signals based on sound signals have been proposed (see Patent Document 1). The characteristics of the desired vibration waveform vary depending on the generation strategy. General generation algorithms are typically optimized for a single generation strategy, and therefore, it is difficult to generate vibration signals that reflect a variety of generation strategies using a general generation algorithm.

[0003] Citation List

[0004] Patent documents

[0005] Patent Document 1: WO 2019 / 163283 A Summary of the Invention

[0006] The problem the invention aims to solve

[0007] The purpose of this technology is to enable the generation of tactile signals using intermediate states from multiple generation algorithms.

[0008] Solution to the problem

[0009] The concept of this technology is that,

[0010] An information processing apparatus, comprising:

[0011] Multiple tactile signal generation units, each using a different generation algorithm, generate tactile signals.

[0012] A mixing unit that mixes tactile signals generated by at least two of a plurality of tactile signal generation units to obtain an output tactile signal.

[0013] In this technology, multiple tactile signal generation units generate tactile signals using different generation algorithms. For example, the multiple tactile signal generation units generate tactile signals based on sound signals. A mixing unit mixes the tactile signals generated by at least two of the multiple tactile signal generation units to obtain an output tactile signal.

[0014] As described above, in this technology, multiple tactile signal generation units use different generation algorithms to mix tactile signals to obtain an output tactile signal. Therefore, intermediate states of multiple generation algorithms can be used to generate tactile signals.

[0015] Note that this technology may, for example, also include a control unit for controlling the mixing ratio in the mixing unit. By controlling the mixing ratio, a more appropriate intermediate state of multiple generation algorithms can be used to generate tactile signals. In this case, for example, the control unit can control the mixing ratio to a preset value. Furthermore, in this case, for example, the control unit can control the mixing ratio according to the value of the mixing parameters operated by the user.

[0016] Furthermore, in this case, for example, the control unit can control the mixing ratio to a value based on the characteristics of the tactile device that presents tactile sensation by outputting tactile signals. Furthermore, in this case, for example, the control unit can control the mixing ratio to a value based on the category of the sound signal. For example, if there is a value for the category of the sound signal that has been previously set by user operation, the control unit can control the mixing ratio to said value.

[0017] Furthermore, in this scenario, for example, the control unit can control the blending ratio in a time-series manner. For example, the control unit can control the blending ratio in a time-series manner based on, for example, preset keyframes. Furthermore, in this scenario, for example, the control unit can control the blending ratio to a value based on environmental information. Furthermore, in this scenario, for example, the control unit can control the blending ratio to a value selected from multiple hold values ​​through user operation.

[0018] Furthermore, in this case, for example, the control unit can also control the selection of multiple tactile signal generation units related to the mixing of tactile signals. Furthermore, in this case, for example, in addition to controlling the mixing ratio in the mixing unit, the control unit can also control the value of at least one internal parameter of the multiple tactile signal generation units related to the mixing of tactile signals. By controlling the internal parameters in this way, for example, for tactile signal generation units corresponding to tactile signals with a reduced mixing ratio, the probability of generation strategies of the generation algorithm can be reduced, and intermediate states of multiple generation algorithms can be created more naturally.

[0019] Furthermore, in this technology, for example, each of the plurality of tactile signal generation units related to the mixing of tactile signals can output an envelope signal instead of a tactile signal including a sine wave of a predetermined frequency, and the mixing unit can multiply the signal obtained by mixing the envelope signals output from the plurality of tactile signal generation units related to the mixing of tactile signals by a sine wave of a predetermined frequency to obtain an output tactile signal including a sine wave of a predetermined frequency. When a sine wave conversion is performed in each of the plurality of tactile signal generation units related to the mixing of tactile signals and then the mixing is performed, a problem may occur where there is a phase shift in the sine waves in each tactile signal generation unit, such as a reduction in tactile intensity due to waveform distortion of the output tactile signal obtained by mixing. By outputting the envelope signal from each tactile signal generation unit and mixing it, and then multiplying it by a sine wave to obtain the output tactile signal, such a problem can be avoided.

[0020] Furthermore, in this technology, for example, the mixing unit can convert tactile signals output from multiple tactile signal generation units related to the mixing of tactile signals into the frequency domain, mix these signals, and convert the signal obtained through mixing into the time domain to obtain an output tactile signal. In this case, even if the sine wave signal used in the sine wave conversion unit of the multiple tactile signal generation units related to the mixing of tactile signals has a phase shift, problems such as a decrease in tactile intensity due to waveform distortion of the output tactile signal obtained through mixing can be avoided.

[0021] Furthermore, this technology may include, for example, a post-processing unit that performs normalization or amplitude limiting processing on the output tactile signal obtained by the mixing unit. Therefore, the amplitude level of the output tactile signal can be maintained within an appropriate range. Attached Figure Description

[0022] Figure 1 This is a block diagram illustrating an example configuration of a tactile signal generation device as an implementation.

[0023] Figure 2 This is a block diagram showing the configuration of the vibration signal generation unit (generation strategy A).

[0024] Figure 3 It is a waveform diagram used to describe the operation of each unit of the vibration signal generation unit (generation strategy A).

[0025] Figure 4 It is a waveform diagram used to describe the operation of each unit of the vibration signal generation unit (generation strategy A).

[0026] Figure 5 This is a block diagram showing the configuration of the vibration signal generation unit (generation strategy B).

[0027] Figure 6 It is a waveform diagram used to describe the operation of each unit of the vibration signal generation unit (generation strategy B).

[0028] Figure 7 It is a waveform diagram used to describe the operation of each unit of the vibration signal generation unit (generation strategy B).

[0029] Figure 8 This is a graph illustrating an example of the correspondence between the mixing parameter t and the mixing value f(t) as the mixing ratio of the vibration signal Sha.

[0030] Figure 9 This is a diagram showing an example of a user interface (UI) screen displayed on a display unit when the mixing parameter t is adjusted by the user.

[0031] Figure 10 This is a diagram illustrating an example of the correspondence between the mixing parameter t corresponding to the movement position of the slider's operator, f(t) as the mixing ratio of the vibration signal Sha, and 1-f(t) as the mixing ratio of the vibration signal Shb.

[0032] Figure 11 This is a diagram illustrating an example where the internal parameters of the vibration signal generation unit 114 that generates the vibration signal Shb are related to the mixing ratio.

[0033] Figure 12 This is a diagram showing examples of the waveform changes of the vibration signal Shb at various values ​​of the internal parameter.

[0034] Figure 13 This is a flowchart schematically illustrating the processing steps up to obtaining the vibration signal Sh from the sound signal SA.

[0035] Figure 14 This is a diagram showing an example of the waveform of the vibration signal Sh at various values ​​of the hybrid parameter t.

[0036] Figure 15 This is a diagram showing an example of the waveform displayed on the UI screen during the adjustment of the vibration waveform.

[0037] Figure 16 This is a diagram showing an example of the waveform displayed on the UI screen during the adjustment of the vibration waveform.

[0038] Figure 17 This is a diagram showing an example of the UI screen during the adjustment of the vibration waveform.

[0039] Figure 18 This is a sequence diagram illustrating an example of the processing procedure when a user performs an adjustment operation on the vibration waveform.

[0040] Figure 19 This is a block diagram of a part of the vibration signal generation device.

[0041] Figure 20 It is a diagram used to describe the waveform deformation of the vibration signal obtained by mixing when there is a phase shift in the sine waves used in two vibration signal generation units.

[0042] Figure 21 This is a block diagram showing an example of a configuration change for the vibration signal generation device (1).

[0043] Figure 22 This is a diagram showing an example of the waveforms of the individual units in the configuration change example (1).

[0044] Figure 23 This is a block diagram showing an example (2) of a configuration change for the vibration signal generation device.

[0045] Figure 24 This is a diagram showing an example of the waveforms of the individual units in configuration change example (2).

[0046] Figure 25 It is a graph used to describe the time series control of the mixing ratio.

[0047] Figure 26 This is a diagram showing an example of setting the range of the mixing parameter t to -1 to 2. Detailed Implementation

[0048] The following describes the modes of carrying out the invention (hereinafter referred to as "implementation methods"). Note that the descriptions will be given in the following order.

[0049] 1. Implementation Method

[0050] 2. Modification

[0051] <1. Implementation Method>

[0052] [Configuration example of a vibration signal generation device]

[0053] Figure 1 An example configuration of a tactile signal generating device 10 as an embodiment is shown. The tactile signal generating device 10 includes a control unit 101, a user operation unit 102, a display unit 103, a processing unit 104, a vibration device 105, and a sound output unit 106. Note that in this embodiment, the tactile signal generating device 10 generates vibration signals as tactile signals, but this technology is not limited to embodiments where the tactile signal is a vibration signal.

[0054] The control unit 101 includes a central processing unit (CPU) and controls the operation of each unit of the haptic signal generation device 10. A user operation unit 102 forming a user interface and a display unit 103 are connected to the control unit 101. The user operation unit 102 enables the user to perform various types of operations. For example, the user can refer to the user interface (UI) displayed on the display unit 103 to use the user operation unit 102 to perform operations such as changing mixing parameters or adjusting the vibration waveform.

[0055] Processing unit 104 generates vibration signals (tactile signals) based on sound signals (audio signals). Details of processing unit 104 will be described below. Vibration device 105 presents vibration to a user in contact with it. Vibration device 105 is used to appropriately check the vibration state using the vibration signals generated by processing unit 104. Sound output unit 106 is, for example, a speaker, headphones, etc., and is used to appropriately check the sound using sound signals.

[0056] "Processing Unit Configuration Example"

[0057] The processing unit 104 includes an audio signal storage unit 111, an audio signal processing unit 112, a vibration signal generation unit 113, a vibration signal generation unit 114, a mixing unit 115, a vibration signal processing unit 116, and a vibration signal storage unit 117.

[0058] The audio signal storage unit 111 stores audio signals. The audio signal processing unit 112 performs volume normalization (normalization) processing on the audio signals read from the audio signal storage unit 111, for example, maximizing the peak level within a range that does not result in digital limiting.

[0059] Vibration signal generation unit 113 generates a vibration signal Sha based on the sound signal SA processed by sound signal processing unit 112. Vibration signal generation unit 113 uses a generation algorithm optimized for generation strategy A (expressiveness orientation) to generate the vibration signal Sha. Vibration signal generation unit 114 generates a vibration signal Shb based on the sound signal SA processed by sound signal processing unit 112. Vibration signal generation unit 114 uses a generation algorithm optimized for generation strategy B (intensity orientation) to generate the vibration signal Shb.

[0060] "Configuration example of vibration signal generation unit (generation strategy A)"

[0061] Figure 2An example configuration of the vibration signal generation unit 113 is shown. As described above, the vibration signal generation unit 113 uses a generation algorithm optimized for the expressiveness-oriented generation strategy A to generate a vibration signal Sha. The vibration signal generation unit 113 obtains the expressiveness-oriented vibration signal Sha by picking up all the minute changes included in the sound signal SA and reflecting them in the vibration signal Sha.

[0062] The vibration signal generation unit 113 includes an attack zone detection unit 301, a high-frequency band extraction unit 302, a sine wave A conversion unit 303, a low-frequency band extraction unit 304, a sine wave B conversion unit 305, a high-frequency band extraction unit 306, a pitch shifting unit 307, a low-frequency band extraction unit 308, an addition unit 309, a dynamic compression unit 310, and an addition unit 311.

[0063] The attack segment detection unit 301 detects the segment in the sound signal SA where the sound pressure suddenly increases, i.e. the attack segment, and outputs the envelope signal S10 corresponding to the segment. Figure 3 (a) shows an example of the waveform of the sound signal SA on the left, and Figure 3 The right side of (a) shows an example of the waveform of the envelope signal S10 corresponding to the sound signal SA output from the attack segment detection unit 301. In the attack segment detection unit 301, the intensity of the sine wave conversion is affected by adjusting the parameters to expand or compress the segment.

[0064] The high-frequency band extraction unit 302 extracts a segment containing a large number of high-frequency components corresponding to the attack segment from the output envelope signal S10 from the attack segment detection unit 301, and outputs an envelope signal S11 corresponding to that segment. In the high-frequency band extraction unit 302, the frequency range to be extracted is changed by adjusting parameters, thereby affecting the segment converted into a sine wave A (e.g., a vibration signal of 150 Hz or greater), and thus affecting the optical performance.

[0065] The sine wave A conversion unit 303 multiplies the output envelope signal S11 from the high-frequency band extraction unit 302 by the sine wave A, and outputs the vibration signal S12 of the sine wave A. Figure 3 (b) shows an example of the waveform of the output envelope signal S11 from the high-frequency band extraction unit 302 on the left, and Figure 3 (b) shows an example of the waveform of the vibration signal S12 of the sine wave A output from the sine wave A conversion unit 303, corresponding to the output envelope signal S11. In the sine wave A conversion unit 303, the frequency of the sine wave A is changed by adjusting parameters, thereby affecting the light performance.

[0066] The low-frequency extraction unit 304 extracts a segment containing a large number of low-frequency components corresponding to the seizure segment from the output envelope signal S10 from the seizure segment detection unit 301, and outputs an envelope signal S13 corresponding to the segment. In the low-frequency extraction unit 304, the frequency range to be extracted is changed by adjusting parameters, thereby affecting the segment converted into a sine wave B (e.g., a vibration signal less than 150Hz, especially the resonant frequency f0 of the vibrating device), and thus affecting the repetition performance.

[0067] The sine wave B conversion unit 305 multiplies the output envelope signal S13 from the low frequency band extraction unit 304 by the sine wave B and outputs the vibration signal S14 of the sine wave B. Figure 3 (c) shows an example of the waveform of the output envelope signal S13 from the low-frequency extraction unit 304, and Figure 3 (c) shows an example of the waveform of the vibration signal S14 of the sine wave B output from the sine wave B conversion unit 305, corresponding to the output envelope signal S13. In the sine wave B conversion unit 305, the frequency of the sine wave B is changed by adjusting parameters, thereby affecting the reverberation performance.

[0068] The high-frequency band extraction unit 306 extracts the high-frequency component S15 from the audio signal SA and outputs the high-frequency component S15. Figure 4 The left side of (d) shows an example of the waveform of the sound signal SA, and Figure 4 (d) shows an example of the waveform of the high-frequency component S15 corresponding to the audio signal SA, output from the high-frequency extraction unit 306. In the high-frequency extraction unit 306, the frequency range to be extracted is changed by adjusting parameters.

[0069] The pitch shifting unit 307 shifts the output frequency component S15 from the high-frequency extraction unit 306 to the low-frequency band (making it fall to 1000Hz or less), and outputs the frequency component S16 that has been shifted to the low-frequency band. By shifting the output frequency component S15 to the low-frequency band in this way, the signal can be perceived as vibration. Figure 4 The left side of (e) shows an example of the waveform of the output frequency component S15 from the high-frequency band extraction unit 306, and Figure 4 (e) shows an example of the waveform of the frequency component S16, which corresponds to the output frequency component S15, output from the pitch shifting unit 307. In the pitch shifting unit 307, the degree of shift is changed by adjusting parameters, thereby affecting bodily sensation.

[0070] The low-frequency extraction unit 308 extracts the low-frequency component S17 from the audio signal SA and outputs the low-frequency component S17. Figure 4 The left side of (d) shows an example of the waveform of the sound signal SA, and Figure 4 (d) shows an example of the waveform of the low-frequency component S17 corresponding to the audio signal SA, output from the low-frequency extraction unit 308. In the low-frequency extraction unit 308, the frequency range to be extracted is changed by adjusting parameters.

[0071] Adding unit 309 adds (mixes) the output frequency component S16 from pitch shifting unit 307 and the output frequency component S17 from low-frequency extraction unit 308. Dynamic compression unit 310 adjusts the output frequency component S18 from adding unit 309 to reduce pitch differences, and outputs frequency component 318 as a vibration signal S19. By adjusting pitch differences in this way to reduce them, a vibration signal that makes minute vibrations easier to perceive can be generated. Figure 4 The left side of (f) shows an example of the waveform of the output frequency component S18 from the adder unit 309, and Figure 4 The right side of (f) shows an example of the waveform of the vibration signal S19, which corresponds to the output frequency component S18, output from the dynamic compression unit 310. In the dynamic compression unit 310, the degree of compression is changed by adjusting parameters, thereby affecting the ease of sensing minute vibrations.

[0072] Adding unit 311 adds (mixes) the output vibration signal S12 from sine wave A conversion unit 303, the output vibration signal S14 from sine wave B conversion unit 305, and the output vibration signal S19 from dynamic compression unit 310, and outputs the signal obtained by addition as vibration signal Sha. Note that at this time, for the segment where an attack is detected, processing can be performed to output only the attack signal, i.e., vibration signal S12 and vibration signal S14. In this case, the intensity can be maintained by outputting the attack signal as is.

[0073] Figure 2 The vibration signal generation unit 113 shown in the diagram modifies the sine wave for each target frequency of the attack detection and can generate a vibration signal that well represents the characteristics of sound. Furthermore, Figure 2 The vibration signal generation unit 113 shown in the figure performs vibration transformation even for minute changes in sound pressure, and can generate vibration signals that can express subtle vibrations while losing clarity.

[0074] "Configuration example of vibration signal generation unit (generation strategy B)"

[0075] Figure 5An example configuration of the vibration signal generation unit 114 is shown. As described above, the vibration signal generation unit 114 uses a generation algorithm optimized for intensity-oriented generation strategy B to generate the vibration signal Shb. The vibration signal generation unit 114 obtains the intensity-oriented vibration signal Shb by willingly discarding minor changes included in the sound signal SA.

[0076] The vibration signal generation unit 114 includes an attack zone detection unit 401, a zone expansion unit 402, a sine wave conversion unit 403, a high frequency band extraction unit 404, a pitch shifting unit 405, a low frequency band extraction unit 406, an addition unit 407, a dynamic expansion unit 408, and an addition unit 409.

[0077] The attack segment detection unit 401 detects the segment in the sound signal SA where the sound pressure suddenly increases, which is the attack segment, and outputs the envelope signal S20 corresponding to the segment. Figure 6 (a) shows an example of the waveform of the sound signal SA on the left, and Figure 6 The right side of (a) shows an example of the waveform of the envelope signal S20 corresponding to the sound signal SA output from the attack segment detection unit 401. In the attack segment detection unit 401, the intensity of the sine wave conversion is affected by adjusting the parameters to expand or compress the segment.

[0078] The segment expansion unit 402 expands the output envelope signal S20 from the seizure segment detection unit 301 in the time direction to expand the detected seizure segment, and outputs the envelope signal S21 obtained through expansion. When a sine wave is obtained through conversion, the output time of the sine wave becomes longer due to the expansion of the seizure segment in the time direction, and it is strongly perceived as a bodily sensation. Figure 6 (b) shows an example of the waveform of the output envelope signal S20 from the attack segment detection unit 401 on the left, and Figure 6 (b) shows an example of the waveform of the envelope signal S21, which corresponds to the output envelope signal S20, output from the segment expansion unit 402. In the segment expansion unit 402, the degree of expansion is changed by adjusting parameters, thereby affecting bodily sensation.

[0079] The sine wave conversion unit 403 multiplies the output envelope signal S21 from the segment extension unit 402 by a sine wave (e.g., a vibration signal less than 150Hz, especially the resonant frequency f0 of the vibrating device, etc.) and outputs the vibration signal S22. Figure 6 The left side of (c) shows an example of the waveform of the output envelope signal S21 from the segment extension unit 402, and Figure 6(c) shows an example of the waveform of the vibration signal S22, which corresponds to the output envelope signal S21, output from the sine wave conversion unit 403. In the sine wave conversion unit 403, the frequency of the sine wave is changed by adjusting the parameters, thereby affecting the reverberation performance.

[0080] The high-frequency extraction unit 404 extracts the high-frequency component S23 from the audio signal SA and outputs the high-frequency component S23. Figure 7 The left side of (d) shows an example of the waveform of the sound signal SA, and Figure 7 The upper right portion of (d) shows an example of the waveform of the high-frequency component S23 corresponding to the audio signal SA, output from the high-frequency extraction unit 404. In the high-frequency extraction unit 404, the frequency range to be extracted is changed by adjusting parameters.

[0081] The pitch shifting unit 405 shifts the output frequency component S23 from the high-frequency extraction unit 404 to the low-frequency band (making it fall to 1000Hz or less), and outputs the frequency component S24 that has been shifted to the low-frequency band. By shifting the output frequency component S23 to the low-frequency band in this way, the signal can be perceived as vibration. Figure 7 The left side of (e) shows an example of the waveform of the output frequency component S23 from the high-frequency band extraction unit 404, and Figure 7 (e) shows an example of the waveform of the high-frequency component S24, which corresponds to the output frequency component S23, output from the pitch shifting unit 405. In the pitch shifting unit 405, the degree of shift is changed by adjusting parameters, thereby affecting bodily sensation.

[0082] The low-frequency extraction unit 406 extracts the low-frequency component S25 from the audio signal SA and outputs the low-frequency component S25. Figure 7 The left side of (d) shows an example of the waveform of the sound signal SA, and Figure 7 (d) shows an example of the waveform of the low-frequency component S25 corresponding to the audio signal SA, output from the low-frequency extraction unit 406. In the low-frequency extraction unit 406, the frequency range to be extracted is changed by adjusting parameters.

[0083] Adding unit 407 adds (mixes) the output frequency component S24 from pitch shifting unit 405 and the output frequency component S25 from low-frequency extraction unit 406. Dynamic expansion unit 408 adjusts the output frequency component S26 from adding unit 407 to increase the pitch difference, and outputs the frequency component S26 as a vibration signal S27. By increasing the pitch difference in this way, a vibration signal that allows for the perception of a clear vibration can be generated. Figure 7 The left side of (f) shows an example of the waveform of the output frequency component S26 from the adder unit 407, and Figure 7 The right side of (f) shows an example of the waveform of the vibration signal S27, corresponding to the output frequency component S26, output from the dynamic extension unit 408. In the dynamic extension unit 408, the degree of extension is changed by adjusting parameters, thereby affecting the clarity of the vibration.

[0084] Adding unit 409 adds (mixes) the output vibration signal S22 from sine wave conversion unit 403 and the output vibration signal S27 from dynamic extension unit 408, and outputs the signal obtained by addition as the vibration signal Shb. Note that at this time, for the segment where an attack is detected, processing can be performed to output only the attack signal, i.e., the vibration signal S22. In this case, the intensity can be maintained by outputting the attack signal as is.

[0085] return Figure 1 The mixing unit 115 mixes the vibration signal Sha generated by the vibration signal generation unit 113 and the vibration signal Shb generated by the vibration signal generation unit 114 to obtain a vibration signal Sh that exhibits vibration characteristics at an intermediate state between the two generation algorithms. For example, the control unit 101 controls the mixing ratio to a preset value. Regarding the mixing ratio, when the mixing ratio of the vibration signal Sha is m, the mixing ratio of the vibration signal Shb is (1-m). The preset value of the mixing ratio is, for example, stored in the memory of the control unit 101.

[0086] In addition, the control unit 101 controls the mixing ratio to a value corresponding to the mixing parameter (combination parameter) operated by the user. Figure 8 An example is shown showing the correspondence between the mixing parameter t and the mixing value (combination value) f(t) as the mixing ratio of the vibration signal Sha. In this case, the mixing ratio of the vibration signal Shb is 1-f(t).

[0087] As a corresponding relationship, besides linearity, nonlinearity can also be considered. Figure 8 In the correspondence in (a), the mixing ratio f(t) changes linearly with the change in the mixing parameter t. Furthermore, in Figure 8 (b) and Figure 8 In the correspondence in (c), the mixing ratio f(t) changes nonlinearly with the change in the mixing parameter t. Considering human perception, even in the case where the two vibration signals are mixed one-to-one, it can be reasonably assumed that the two vibration signals are mixed in such a way that the one-to-one mixing is not perceived. In this case, the user's operational sensation can be matched with the sensation of using nonlinear mixing.

[0088] Figure 9An example of a user interface (UI) screen displayed on display unit 103 when the mixing parameter t is adjusted by user operation is shown. The UI screen includes: an operation unit 511, which includes a slider for the user to adjust the display of the mixing parameter t; a first waveform display unit 512, on which a waveform of an audio signal is displayed; and a second waveform display unit 513, on which a waveform of a vibration signal obtained by mixing is displayed.

[0089] The user can adjust the mixing parameter t between 0 and 1 by moving the slider displayed on the operation unit 511. In the example shown, the state where the mixing parameter t is 0.25 is shown. The waveform of the vibration signal obtained by mixing, displayed on the second waveform display unit 513, changes accordingly with the change in the mixing parameter t. By actually vibrating the vibration device 105 with the vibration signal obtained by mixing and referring to the state of vibration, the user can efficiently adjust the mixing parameter t to an appropriate mixing parameter t, and thus adjust the appropriate mixing ratio.

[0090] Figure 10 An example is shown showing the correspondence between the mixing parameter t corresponding to the movement position of the slider's operator, f(t) as the mixing ratio of the vibration signal Sha, and 1-f(t) as the mixing ratio of the vibration signal Shb. Figure 10 (a) shows the movement position of the slider's operator. Figure 10 (b) shows f(t), and Figure 10 (c) shows 1-f(t). The example is in the case where the mixing ratio f(t) and 1-f(t) change linearly with the change of the mixing parameter t.

[0091] Note that it is conceivable that by managing the internal parameters of the possibilities of generation strategy A in vibration signal generation unit 113 and the internal parameters of the possibilities of generation strategy B in vibration signal generation unit 114, which are related to the mixing ratio, the vibration performance of the intermediate state in the mixed case becomes more natural. The internal parameters of only vibration signal generation unit 113, only vibration signal generation unit 114, or both vibration signal generation unit 113 and vibration signal generation unit 114 are related to the mixing ratio.

[0092] Figure 11 An example is shown where the internal parameters of the vibration signal generation unit 114 that generates the vibration signal Shb are related to the mixing ratio. Figure 11 (a) to Figure 11 (c) respectively with Figure 10 (a) is the same as (c). Figure 11(d) illustrates the change in the internal parameters governing the possibility of generation strategy B in the vibration signal generation unit 114. In this case, the internal parameters increase as the mixing ratio 1-f(t) of the vibration signal Shb increases, and the possibility of generation strategy B in the vibration signal generation unit 114 increases. Figure 12 Examples of waveform changes in the vibration signal Shb at various internal parameter values ​​are shown.

[0093] By controlling the internal parameters in relation to the mixing ratio in this way, for example, for a vibration signal generation unit corresponding to a vibration signal with a reduced mixing ratio, the likelihood of generation strategies of the generation algorithm can be reduced, and intermediate states of multiple generation algorithms can be created more naturally.

[0094] return Figure 1 The vibration signal processing unit 116 performs normalization or amplitude limiting processing on the vibration signal Sh obtained by the mixing unit 115 to maintain the amplitude level of the vibration signal Sh within an appropriate range. The vibration signal storage unit 117 stores the vibration signal Sh that has been processed by the vibration signal processing unit 116.

[0095] Figure 13 The flowchart schematically shows until from Figure 1 The diagram illustrates the process by which the sound signal SA in the tactile signal generation device 10 is processed to obtain the vibration signal Sh. In step ST1, the tactile signal generation device 10 acquires the sound signal SA. Next, in step ST2, the tactile signal generation device 10 acquires the mixing ratio.

[0096] Next, in step ST3, the tactile signal generating device 10 generates a vibration signal Sha from the sound signal SA in vibration signal generating unit 113, and generates a vibration signal Shb from the sound signal SA in vibration signal generating unit 114. In this case, the internal parameters can be changed based on the mixing ratio. Next, in step ST4, the tactile signal generating device 10 mixes the vibration signal Sha and the vibration signal Shb generated by the respective vibration signal generating units based on the mixing ratio to obtain the vibration signal Sh.

[0097] As mentioned above, in Figure 1 In the tactile signal generation device 10 shown, vibration signals Sha and Shb generated using two different generation algorithms are mixed to obtain an output vibration signal Sh. Therefore, a vibration signal can be satisfactorily generated using an intermediate state between the two generation algorithms.

[0098] "Editing and processing of mixed vibration signals"

[0099] exist Figure 1In the tactile signal generation device 10 shown, the vibration waveform of the vibration signal Sh obtained by mixing the vibration signal Sha and the vibration signal Shb as described above can be adjusted.

[0100] Figure 14 Examples of waveforms for the vibration signal Sh at various values ​​of the mixing parameter t are shown. As the parameter value increases, the vibration feels stronger. In this case, unwanted sections—such as those enclosed by dashed circles—may be overemphasized, potentially amplifying the vibration.

[0101] During the adjustment of the vibration waveform, for example, such as Figure 15 As shown in (a), the waveform of the vibration signal Sh displayed on the UI screen on the display unit 103 automatically highlights sections that may be overemphasized (overreflecting the generation strategy), and the user can adjust the vibration waveform in a section by selecting the section containing the vibration waveform to be adjusted and performing an operation. As vibration waveform adjustment operations, one can think of reducing the amplitude, shifting the frequency, or regenerating the vibration signal after changing the internal parameters to reduce the influence of the generation strategy.

[0102] In this scenario, for example, if the mouse cursor is placed on a segment, an adjustment UI appears to change the amplitude "dB" and frequency "f", such as... Figure 15 As shown in (b). Furthermore, for example, a right-click of the mouse brings up a menu item for adjustments. Additionally, for example, it is possible to select and delete highlighted segments, and in this case, a low-pass filter is performed to ensure smooth continuation of the waveform before and after the waveform.

[0103] Furthermore, during the adjustment of the vibration waveform, for example, such as Figure 16 As shown in (a), on the UI screen displayed on the display unit 103, a segment of the periodic vibration waveform, including the narrowing interval between vibrations, is automatically highlighted on the waveform of the vibration signal Sh. For example, when the user places the mouse cursor on the segment, an adjustment UI for changing the length of the vibration appears, and as shown in (a), the user can adjust the waveform. Figure 16 As shown in (b), users can also perform operations to shorten the length of multiple consecutive vibration sections at the same time.

[0104] Figure 17 An example of a UI screen displayed on display unit 103 during vibration waveform adjustment is shown. The UI screen includes an operation unit 611 for the user to perform vibration waveform adjustment operations, a first waveform display unit 612 for displaying the waveform of an audio signal, and a second waveform display unit 613 for displaying the waveform of a vibration signal obtained through mixing.

[0105] Figure 18The sequence diagram illustrates an example of the processing procedure when a user performs an adjustment operation on the vibration waveform. In step ST21, the user presses "Read," and then in step ST31, the control unit 101 reads the vibration signal Sh, which is the adjustment target, and the corresponding sound signal SA from the vibration signal storage unit 117 and the sound signal storage unit 111, respectively, and stores them in its internal memory. Therefore, the waveform of the vibration signal Sh related to the adjustment is displayed on the second waveform display unit 613, and the waveform of the sound signal SA corresponding to the vibration signal Sh is displayed on the first waveform display unit 612.

[0106] The user can adjust the waveform of the vibration signal Sh within the range of the waveform displayed on the second waveform display unit 613. When adjusting the waveform of the vibration signal Sh to a different range, the user performs a scrolling operation to change the range of the waveform of the vibration signal Sh displayed on the second waveform display unit 613. Correspondingly, the waveform of the sound signal SA displayed on the first waveform display unit 612 also changes automatically.

[0107] In the waveform of the vibration signal Sh displayed on the second waveform display unit 613, for example, as Figure 15 As shown in (a), sections that may be overemphasized are automatically highlighted, and for example, as Figure 16 As shown in (a), segments of periodic vibration waveforms, including those with narrowing intervals between vibrations, are automatically highlighted. Users can perform waveform adjustments on these highlighted segments.

[0108] Next, in step ST22, the user performs a waveform adjustment operation. For example, as... Figure 15 As shown in (b), by placing the mouse cursor on the segment where waveform adjustment is desired, operations such as changing the amplitude "dB" or frequency "f" or deleting the waveform in the segment can be performed. Furthermore, for example, as... Figure 16 As shown in (b), users can perform operations to shorten the length of multiple consecutive vibration segments at the same time.

[0109] Note that the waveform adjustment operation is not limited to this. For example, the operation may include changing the mixing ratio in the mixing unit 115, and changing the internal parameters of the vibration signal generation units 113 and 114. In this case, during the segment where waveform adjustment is performed, the vibration signal Sh is generated again based on the changed mixing ratio and internal parameters, thereby performing waveform adjustment.

[0110] The user performs a waveform adjustment operation, and then in step ST32, according to the user's operation, the control unit 101 performs waveform adjustment processing on the vibration signal Sh in the segment where the waveform adjustment was performed. In this case, the adjusted waveform of the vibration signal Sh is displayed on the second waveform display unit 613.

[0111] Next, in step ST23, the user presses "Play," and then in step ST33, the control unit 101 outputs a vibration signal Sh, which has undergone waveform adjustment and corresponds to the waveform displayed on the second waveform display unit 613, to the vibration device 105. Therefore, the user can check the vibration caused by the waveform-adjusted vibration signal Sh. Note that in this case, a corresponding sound signal SA can be output to the sound output unit 106 synchronously with the output of the vibration signal Sh. Therefore, the user can check both the vibration and the sound.

[0112] Next, in step ST24, the user determines whether the vibration is satisfactory. If the vibration is unsatisfactory, the user returns to the process in step ST22. On the other hand, if the vibration is satisfactory in step ST24, the user presses "Apply" in step ST25. After the user presses "Apply," the control unit 101 confirms the waveform adjustment within the range of the waveform displayed on the second waveform display unit 613 in step ST34.

[0113] Next, in step ST26, the user determines whether to perform waveform adjustment for a different range of the vibration signal Sh than the range of the waveform displayed on the second waveform display unit 613. Note that if the user does not perform waveform adjustment in step ST22, the process can proceed immediately to step ST26. If waveform adjustment for a different range of the vibration signal Sh is performed, in step ST27, the user performs a scrolling operation to change the range of the vibration signal Sh on the second waveform display unit 613. Afterward, the user returns to the processing of step ST22.

[0114] If no further waveform adjustment is performed in step ST26, the user presses "Export" in step ST28. If the user presses "Export," then in step ST35, the control unit 101 writes the vibration signal Sh, for which waveform adjustment has already been performed, from the internal memory to the vibration signal storage unit 117. In this case, the file can be overwritten or stored as a new file.

[0115] "Change in the configuration of the vibration signal generation device"

[0116] exist Figure 1 In the tactile signal generation device 10 shown, such as Figure 19As shown, the sine wave B conversion unit 305 of the vibration signal generation unit 113 multiplies the envelope signal S13 by a sine wave, for example, the resonant frequency f0 of the vibration device, to obtain a sine wave (f0) vibration signal S14, and the sine wave conversion unit 403 of the vibration signal generation unit 114 multiplies the envelope signal S21 by a sine wave, for example, the resonant frequency f0 of the vibration device, to obtain a sine wave (f0) vibration signal S22, and these are mixed (added) by the mixing unit 115.

[0117] In this case, if there is a phase shift between the sine wave (f0) used in the sine wave B conversion unit 305 and the sine wave (f0) used in the sine wave conversion unit 403, problems such as a decrease in vibration intensity due to waveform deformation of the vibration signal Sh obtained by mixing in the mixing unit 115 may occur.

[0118] Figure 20 An example of a situation where such a problem occurs is shown. Figure 20 (a) shows the waveform of the vibration signal Sha generated by the vibration signal generation unit 113. Figure 20 (b) shows the waveform of the vibration signal Shb generated by the vibration signal generation unit 114, and Figure 20 (c) shows the waveform of the vibration signal Sh obtained by mixing 50% of each component. This example illustrates a situation where there is a 5 ms phase shift in the sine wave (f0) obtained by multiplying the vibration signal generation units 113 and 114 due to the occurrence detection, and the waveform of the vibration signal Sh is distorted. In this case, problems such as a decrease in vibration intensity occur.

[0119] "Configuration Change Example (1)"

[0120] Figure 21 An example of configuration change (1) is shown. Figure 21 In, with Figure 1 , Figure 2 , Figure 5 The corresponding parts in the figures are indicated by the same reference numerals.

[0121] The vibration signal generation unit 113 outputs the envelope signal S13 as is, but does not output the vibration signal S14. In this case, the sine wave B conversion unit 305 is not necessary for the vibration signal generation unit 113. Furthermore, the vibration signal generation unit 114 outputs the envelope signal S21 as is, but does not output the vibration signal S22. In this case, the sine wave conversion unit 403 is not necessary for the vibration signal generation unit 114.

[0122] The envelope signal S13 output from the vibration signal generation unit 113 and the envelope signal S21 output from the vibration signal generation unit 114 are mixed by the mixing unit 121. The mixing ratio in the mixing unit 121 corresponds to the mixing ratio in the mixing unit 115. The sine wave conversion unit 122 multiplies the envelope signal S31 output from the mixing unit 121 by a sine wave (f0) and outputs the vibration signal S32.

[0123] Then, the adder 123 adds the vibration signal S32 output from the sine wave conversion unit 122 and the vibration signal output from the mixing unit 115 to obtain the vibration signal Sh. Note that in this case, the vibration signal Sha from the vibration signal generation unit 113 input to the mixing unit 115 is obtained by removing the vibration signal S14 associated with the sine wave conversion unit 305, and similarly, the vibration signal Shb from the vibration signal generation unit 114 input to the mixing unit 115 is obtained by removing the vibration signal S14 associated with the sine wave conversion unit 403.

[0124] Figure 22 Examples of waveforms of envelope signals S13 and S21 input to mixing unit 121, waveform of mixed envelope signal S31 output from mixing unit 121, and waveform of sine wave (f0) vibration signal S32 output from sine wave conversion unit 122 are shown.

[0125] use Figure 21 The configuration shown can avoid in Figure 19 The problems that occur in the configuration shown are, for example, a decrease in vibration intensity due to waveform distortion of the vibration signal Sh obtained by mixing in the mixing unit 115 when there is a phase shift between the sine wave (f0) used in the sine wave B conversion unit 305 and the sine wave (f0) used in the sine wave conversion unit 403.

[0126] "Configuration Change Example (2)"

[0127] Figure 23 An example of configuration change (2) is shown. Figure 23 In, with Figure 1 The corresponding parts in the figures are indicated by the same reference numerals.

[0128] The vibration signal Sha generated by the vibration signal generation unit 113 is converted into a frequency domain signal Sha' by the Fast Fourier Transform (FFT) unit 131. Furthermore, the vibration signal Shb generated by the vibration signal generation unit 114 is converted into a frequency domain signal Shb' by the FFT unit 132. In the mixing unit 115, the frequency domain signals Sha' and Shb' are mixed.

[0129] Then, the Inverse Fast Fourier Transform (IFFT) unit 133 converts the frequency domain signal Sh' obtained by mixing by the mixing unit 115 into a time domain signal to obtain the vibration signal Sh. Note that phase information is required when the IFFT unit 133 converts the frequency domain signal into a time domain signal. As phase information, for example, the phase information of the vibration signal Sha or the vibration signal Shb is used, or phase information obtained by phase recovery is used.

[0130] Figure 24 Examples of waveforms are shown for the vibration signal Sha output from vibration signal generation unit 113 and input to FFT unit 131, the vibration signal Shb output from vibration signal generation unit 114 and input to FFT unit 132, and the vibration signal Sh output from IFFT unit 133. Although there is a phase shift in the sine wave in the activation detection segment between vibration signal Sha and vibration signal Shb, no waveform distortion due to phase shift occurs in the vibration signal Sh output from IFFT unit 133.

[0131] use Figure 23 The structure shown in the figure, for example, can prevent waveform distortion of the vibration signal Sh obtained by mixing, even if there is a phase shift in the sine wave in the outbreak detection segment between the vibration signal Sha and the vibration signal Shb, and can avoid problems such as a reduction in vibration intensity.

[0132] <2. Modification>

[0133] Note that in the above embodiments, an example has been described in which the control unit 101 controls the mixing ratio of the vibration signal Sha and the vibration signal Shb in the mixing unit 115 to a preset value or according to the value of the mixing parameters operated by the user. However, it is also conceivable that the control unit 101 controls the mixing ratio to the following value. The value obtained by controlling in this way can, for example, also be used as an initial value to enable user operation.

[0134] For example, it is conceivable that the control unit 101 controls the mixing ratio to a value based on the characteristics of the vibration device 105. In this case, the control unit 101 identifies the characteristics of the vibration device 105 by automatically determining the type of the vibration device 105 when connected to it, or by having the user manually input the type of the vibration device 105. In this case, the vibration signal Sh can be obtained by mixing the vibration signal Sha and the vibration signal Shb with a mixing ratio suitable for the characteristics of the vibration device 105.

[0135] Furthermore, for example, it is conceivable that the control unit 101 controls the mixing ratio to a value based on the category of the sound signal SA. In this case, the control unit 101 identifies the category of the sound signal SA by analyzing the sound signal SA, by using metadata belonging to the sound signal SA, or by using information manually input by the user. For example, it analyzes the frequency components included in the sound signal SA and determines the category of the sound signal SA based on the analysis results, such as whether the sound signal SA is a heavy firearm sound or an ambient sound. In this case, the vibration signal Sh can be obtained by mixing the vibration signal Sha and the vibration signal Shb at a mixing ratio suitable for the category of the sound signal SA.

[0136] Furthermore, for example, it is conceivable that if there is a value for the category of the sound signal SA that has been previously set by the user, the control unit 101 controls the mixing ratio to that value. In this case, the vibration signal Sh can be obtained by mixing the vibration signal Sha and the vibration signal Shb with the mixing ratio previously set by the user, and the labor of setting the mixing ratio by the user can be reduced.

[0137] Furthermore, for example, it is conceivable that the control unit 101 controls the mixing ratio to a value based on environmental information or user condition information. Environmental information indicates, for example, the time of day (generally, nighttime is quieter than daytime) and the type of noise conditions present. Furthermore, user condition information indicates user characteristics such as age, gender, mobility, and whether the user is traveling by train. In this case, the vibration signal Sh can be obtained by mixing the vibration signal Sha and the vibration signal Shb at a mixing ratio suitable for the environment or user condition. For example, in the case of midnight, a vibration signal Sh in which the ratio of the force-oriented vibration signal Sha is greater than the ratio of the intensity-oriented vibration signal Shb can be obtained.

[0138] Furthermore, for example, it is conceivable that the control unit 101 controls the mixing ratio to a value selected by the user from a plurality of pre-held values. In this case, associating the plurality of held values ​​with the type (characteristics) of the vibration device 105, the category of the sound signal SA, the environment, user conditions, etc., allows the user to easily select an appropriate value. Note that, although not shown, in this case, a selection screen is displayed as a UI screen, and the user selects an appropriate value as the mixing ratio based on the selection screen.

[0139] Furthermore, in the above embodiments, the mixing ratio of vibration signal Sha and vibration signal Shb in the time-series controlled mixing unit 115 is not mentioned. However, it is conceivable that the control unit 101 controls the mixing ratio in a time-series manner, such as... Figure 25 As shown in (b). Figure 25(a) shows the waveform of the sound signal. In this case, the control unit 101 controls the mixing ratio in a time sequence based on, for example, preset keyframes.

[0140] Furthermore, in the above embodiments, an example has been described where the mixing parameter t is in the range of 0 to 1 via user operation (see [link]). Figure 10 However, it is also conceivable to set the range of the mixing parameter t outside the range of 0 to 1. For example, Figure 26 (a) shows an example of setting the range of the mixing parameter t to -1 to 2, and Figure 26 (b) and Figure 26 (c) shows the mixing ratio f(t) of vibration signal Sha and the mixing ratio 1-f(t) of vibration signal Shb in this case, respectively.

[0141] In this case, within the range of the mixing parameter t from 0 to -1, the vibration signal Sh includes only the component of the vibration signal Sha, and the intensity (level) of the vibration signal Sha increases as the mixing parameter t approaches -1. Furthermore, in this case, within the range of the mixing parameter t from 1 to 2, the vibration signal Sh includes only the component of the vibration signal Shb, and the intensity (level) of the vibration signal Shb increases as the mixing parameter t approaches 2.

[0142] Furthermore, in the above embodiments, an example has been described in which vibration signal generation units 113 and 114 are included, and the vibration signals Sha and Shb generated by them are mixed to obtain a vibration signal Sh. However, it is also conceivable to include three or more vibration signal generation units with different generation algorithms, and to mix the vibration signals generated by them to obtain a vibration signal. Furthermore, it is also conceivable to include multiple vibration signal generation units, and to be able to partially or completely switch a predetermined number of vibration signal generation units related to mixing, for example, two vibration signal generation units. In this case, the control unit controls the selection of multiple vibration signal generation units related to the mixing of vibration signals.

[0143] For example, in addition to vibration signal generation unit A (e.g., vibration signal generation unit 113) and vibration signal generation unit B (e.g., vibration signal generation unit 114), a vibration signal generation unit C, including a low-pass filter, is also included, and the usage state of vibration signal generation units A and B is switched to the usage state of vibration signal generation units A and C. This switching can be performed manually by the user or automatically if the effect of vibration signal generation unit B is determined to be weak.

[0144] Furthermore, in the above embodiments, an example has been described whereby the slider's operator value is changed as a representation on the UI screen for the user to adjust the blending parameter t (see [link]). Figure 9 However, the invention is not limited thereto. For example, it is also conceivable to change the color or transparency as a representation on the UI screen so that the user can adjust the blending parameter t.

[0145] Furthermore, although not described above, it is assumed that the mixing ratio of multiple vibration signals to be mixed will be automatically set in the future—for example, the mixing ratio of vibration signal Sha generated by vibration signal generation unit 113 and vibration signal Shb generated by vibration signal generation unit 114—and that the desired mixing ratio varies depending on the designer. In this case, it is also conceivable that further mixing could be achieved by combining vibration signals generated by multiple designers according to their personal preferences to obtain the desired vibration signal. In this case, the user can change the mixing ratio. Note that in this case, it is also conceivable that the mixing ratio selected by multiple designers can be combined with the user's desired mixing ratio, and that the mixing ratio obtained through mixing can be used to combine multiple vibration signals to obtain the desired vibration signal.

[0146] Furthermore, although not described above, it is conceivable that when a user moves the slider on the UI screen to change the mixing parameter t, each time the slider is moved, the vibrating device repeatedly vibrates at the moved position using a short-term sample vibration signal obtained by using the mixing ratio corresponding to the mixing parameter t. Therefore, the user can actually feel the movement of the slider.

[0147] Furthermore, preferred embodiments of the present disclosure have been described in detail with reference to the accompanying drawings; however, the technical scope of the present disclosure is not limited to such examples. It will be apparent to those skilled in the art that various modifications or alterations will arise within the scope of the technical concept described in the claims, and it will be naturally understood that such modifications and alterations fall within the technical scope of the present disclosure.

[0148] Furthermore, the effects described in this specification are merely illustrative or exemplary and are not restrictive. That is, in conjunction with or instead of the effects described above, the technology according to this disclosure can present other effects that will be apparent to those skilled in the art based on the description herein.

[0149] In addition, this technology can also have the following configurations.

[0150] (1) An information processing device, comprising:

[0151] Multiple tactile signal generation units, each using a different generation algorithm to generate tactile signals; and

[0152] A mixing unit that mixes tactile signals generated by at least two of the plurality of tactile signal generation units to obtain an output tactile signal.

[0153] (2) The information processing apparatus according to (1) further includes

[0154] A control unit that controls the mixing ratio of the mixing unit.

[0155] (3) The information processing apparatus according to (2), wherein,

[0156] The control unit controls the mixing ratio to a preset value.

[0157] (4) The information processing apparatus according to (2), wherein,

[0158] The control unit controls the mixing ratio to a value based on the mixing parameters operated by the user.

[0159] (5) The information processing apparatus according to (2), wherein,

[0160] The control unit controls the mixing ratio to a value based on the characteristics of the tactile device that presents the tactile sensation through the output tactile signal.

[0161] (6) The information processing apparatus according to (2), wherein,

[0162] The plurality of tactile signal generation units generate the tactile signals based on sound signals, and

[0163] The control unit controls the mixing ratio to a value based on the category of the sound signal.

[0164] (7) The information processing apparatus according to (6), wherein,

[0165] The control unit controls the mixing ratio to the value if there is a value previously set by the user for the category of the sound signal.

[0166] (8) The information processing apparatus according to (2), wherein,

[0167] The control unit controls the mixing ratio according to a time sequence.

[0168] (9) The information processing apparatus according to (8), wherein,

[0169] The control unit controls the mixing ratio in a time sequence based on preset keyframes.

[0170] (10) The information processing apparatus according to (2), wherein,

[0171] The control unit controls the mixing ratio to a value based on environmental information.

[0172] (11) The information processing apparatus according to (2), wherein,

[0173] The control unit controls the mixing ratio to a value based on user status information.

[0174] (12) The information processing apparatus according to (2), wherein,

[0175] The control unit controls the mixing ratio to a value selected from multiple hold values ​​by user operation.

[0176] (13) The information processing apparatus according to any one of (2) to (12), wherein,

[0177] The control unit also controls the selection of the plurality of tactile signal generation units related to the mixing of tactile signals.

[0178] (14) The information processing apparatus according to any one of (2) to (13), wherein,

[0179] In addition to controlling the mixing ratio in the mixing unit, the control unit also controls the value of at least one internal parameter in the plurality of tactile signal generation units related to the mixing of tactile signals.

[0180] (15) The information processing apparatus according to any one of (1) to (14), wherein,

[0181] The output envelope signal of each of the plurality of tactile signal generation units related to the mixing of tactile signals, rather than a tactile signal including a sine wave of a predetermined frequency, and

[0182] The mixing unit multiplies the signal obtained by mixing the envelope signals output from the plurality of tactile signal generation units related to the mixing of tactile signals by a sine wave of the predetermined frequency to obtain the output tactile signal including the sine wave of the predetermined frequency.

[0183] (16) The information processing apparatus according to any one of (1) to (14), wherein,

[0184] The mixing unit converts the tactile signals output from the plurality of tactile signal generation units related to the mixing of tactile signals into the frequency domain, mixes the signals, and converts the signals obtained by mixing into the time domain to obtain the output tactile signal.

[0185] (17) The information processing apparatus according to any one of (1) to (16) further includes

[0186] A post-processing unit performs normalization or amplitude limiting processing on the output tactile signal obtained by the mixing unit.

[0187] (18) The information processing apparatus according to any one of (1) to (5) or (8) to (17), wherein,

[0188] The plurality of tactile signal generation units generate the tactile signals based on sound signals.

[0189] (19) An information processing method, comprising:

[0190] Multiple tactile signals are generated using different generation algorithms; and

[0191] At least two of the plurality of tactile signals are mixed to obtain an output tactile signal.

[0192] List of reference numerals

[0193] 10. Tactile signal generation device

[0194] 101 Control Unit

[0195] 102 User Operation Unit

[0196] 103 Display Unit

[0197] 104 processing units

[0198] 105 Vibration Device

[0199] 106 audio output units

[0200] 111 Sound signal storage unit

[0201] 112 Sound Signal Processing Unit

[0202] Vibration signal generation units 113 and 114

[0203] 115 Hybrid Unit

[0204] 116 Vibration Signal Processing Unit

[0205] 117 Vibration signal storage unit

[0206] 301 Seizure Segment Detection Unit

[0207] 302 High-Frequency Band Extraction Unit

[0208] 303 Sine Wave A-Converter Unit

[0209] 304 Low-frequency band extraction unit

[0210] 305 Sine Wave B-Converter Unit

[0211] 306 High-Frequency Band Extraction Unit

[0212] 307 Pitch Shifter

[0213] 308 Low-frequency band extraction unit

[0214] 309 Addition Units

[0215] 310 Dynamic Compression Unit

[0216] 311 Addition Unit

[0217] 401 Seizure Segment Detection Unit

[0218] 402 Section Extension Unit

[0219] 403 Sine Wave Converter Unit

[0220] 404 High-Frequency Band Extraction Unit

[0221] 405 Pitch Shifter

[0222] 406 Low-frequency band extraction unit

[0223] 407 Adder Unit

[0224] 408 Dynamic Expansion Unit

[0225] 409 Addition Units

[0226] 511 Operation Unit

[0227] 512 First Waveform Display Unit

[0228] 513 Second Waveform Display Unit

[0229] 611 Operation Unit

[0230] 612 First Waveform Display Unit

[0231] 613 Second Waveform Display Unit

Claims

1. An information processing apparatus, comprising: Multiple tactile signal generation units, which generate tactile signals using different generation algorithms; as well as A mixing unit that mixes tactile signals generated by at least two of the plurality of tactile signal generation units to obtain an output tactile signal. The output envelope signal of each of the plurality of tactile signal generation units related to the mixing of tactile signals is not a tactile signal including a sine wave of a predetermined frequency, and The mixing unit multiplies the signal obtained by mixing the envelope signals output from the plurality of tactile signal generation units related to the mixing of tactile signals by a sine wave of the predetermined frequency to obtain the output tactile signal including the sine wave of the predetermined frequency.

2. The information processing apparatus according to claim 1, further comprising: A control unit that controls the mixing ratio in the mixing unit.

3. The information processing apparatus according to claim 2, wherein, The control unit controls the mixing ratio to a preset value.

4. The information processing apparatus according to claim 2, wherein, The control unit controls the mixing ratio to a value based on the mixing parameters operated by the user.

5. The information processing apparatus according to claim 2, wherein, The control unit controls the mixing ratio to a value based on the characteristics of the tactile device that presents the tactile sensation through the output tactile signal.

6. The information processing apparatus according to claim 2, wherein, The plurality of tactile signal generation units generate the tactile signals based on sound signals, and The control unit controls the mixing ratio to a value based on the category of the sound signal.

7. The information processing apparatus according to claim 6, wherein, The control unit controls the mixing ratio to the value if there is a value previously set by the user for the category of the sound signal.

8. The information processing apparatus according to claim 2, wherein, The control unit controls the mixing ratio according to a time sequence.

9. The information processing apparatus according to claim 8, wherein, The control unit controls the mixing ratio in a time sequence based on preset keyframes.

10. The information processing apparatus according to claim 2, wherein, The control unit controls the mixing ratio to a value based on environmental information.

11. The information processing apparatus according to claim 2, wherein, The control unit controls the mixing ratio to a value based on user status information.

12. The information processing apparatus according to claim 2, wherein, The control unit controls the mixing ratio to a value selected from multiple hold values ​​by user operation.

13. The information processing apparatus according to claim 2, wherein, The control unit also controls the selection of the plurality of tactile signal generation units related to the mixing of tactile signals.

14. The information processing apparatus according to claim 2, wherein, In addition to controlling the mixing ratio in the mixing unit, the control unit also controls the value of at least one internal parameter in the plurality of tactile signal generation units related to the mixing of tactile signals.

15. The information processing apparatus according to claim 1, further comprising: A post-processing unit performs normalization or amplitude limiting processing on the output tactile signal obtained by the mixing unit.

16. The information processing apparatus according to claim 1, wherein, The plurality of tactile signal generation units generate the tactile signals based on sound signals.

17. An information processing method, comprising: Multiple tactile signals are generated by multiple tactile signal generation units using different generation algorithms. as well as At least two of the plurality of tactile signals are mixed to obtain an output tactile signal. The output envelope signal of each of the plurality of tactile signal generation units related to the mixing of tactile signals, rather than a tactile signal including a sine wave of a predetermined frequency, and The signal obtained by mixing the envelope signals output from the plurality of tactile signal generation units related to the mixing of tactile signals is multiplied by a sine wave of the predetermined frequency to obtain the output tactile signal including the sine wave of the predetermined frequency.

18. A computer-readable medium having a program recorded thereon, the program causing the computer to perform a method when executed by the computer, the method comprising: Multiple tactile signals are generated by multiple tactile signal generation units using different generation algorithms. as well as At least two of the plurality of tactile signals are mixed to obtain an output tactile signal. The output envelope signal of each of the plurality of tactile signal generation units related to the mixing of tactile signals, rather than a tactile signal including a sine wave of a predetermined frequency, and The signal obtained by mixing the envelope signals output from the plurality of tactile signal generation units related to the mixing of tactile signals is multiplied by a sine wave of the predetermined frequency to obtain the output tactile signal including the sine wave of the predetermined frequency.

Citation Information

Patent Citations

  • Information processing device, information processing method, and computer program

    WO2019163283A1

  • Haptic conversion system using segmenting and combining

    CN104423707A

  • Haptic conversion system using segmenting and combining

    CN110244850A

  • Information processing device

    WO2019220758A1