Information processing device, information processing method, program, and data structure

Abstract

An information processing device according to the present disclosure comprises: an acquisition unit that acquires a data file including head-related transfer function coefficient data measured in a measurement environment, first vibration transfer function coefficient data pertaining to the floor or a chair measured in the measurement environment, and second vibration transfer function coefficient data pertaining to a vibration presentation device; and a generation unit that generates third vibration transfer function coefficient data of the vibration presentation device in a playback environment on the basis of the second vibration transfer function coefficient data pertaining to the vibration presentation device acquired by the acquisition unit and the first vibration transfer function coefficient data pertaining to the floor or the chair acquired by the acquisition unit.

Description

Information processing device, information processing method, program, and data structure

[0001] The present disclosure relates to an information processing device, an information processing method, a program, and a data structure.

[0002] Virtual sound source reproduction, which adds a sense of direction and distance to sounds heard through headphones, is becoming widespread. Such virtual sound source reproduction is realized by performing calculations using head-related transfer functions (HRTFs). HRTFs are transfer functions that represent changes in sound caused by surrounding objects, including the auricle, the human head, and even shoulders. For example, the acoustic characteristics of audio content are converted to acoustic characteristics appropriate for a location such as a movie theater by applying HRTFs.

[0003] The sound heard through the headphones is calculated using a binaural room transfer function (BRTF), which is one of the HRTFs and includes the effects of reflection and diffraction that occur in the measurement space, to reproduce the direction and distance from the sound source in the measurement space.

[0004] JP 2009-72600 A

[0005] Conventional technology can faithfully reproduce a sound field by personalizing HRTFs through acoustic measurements. However, conventional technology cannot reproduce the vibrations felt by the sound produced in the room. Therefore, for example, a user cannot recognize the vibrations felt by the bass unit in a movie theater (haptic sensation).

[0006] On the other hand, although there are haptic devices that provide tactile vibrations, the same vibration settings are affected by the playback environment and the user's body shape, and therefore cannot provide accurate tactile vibrations to the user.

[0007] The present disclosure has been made in consideration of the above-described circumstances, and provides an information processing device, an information processing method, a program, and a data structure for providing accurate bodily sensation vibration to a user.

[0008] The information processing device of the present disclosure has an acquisition unit that acquires a data file having head-related transfer function coefficient data measured in a measurement environment, first vibration transfer function coefficient data related to a floor or a chair measured in the measurement environment, and second vibration transfer function coefficient data related to a vibration presentation device, and a generation unit that generates third vibration transfer function coefficient data of the vibration presentation device in a playback environment based on the second vibration transfer function coefficient data related to the vibration presentation device acquired by the acquisition unit and the first vibration transfer function coefficient data related to the floor or the chair acquired by the acquisition unit.

[0009] 1 is a diagram illustrating an example of a configuration of a sound production system according to an embodiment. FIG. 2 is a diagram illustrating a measurement environment according to an embodiment. FIG. 3 is a diagram illustrating measurement of vibration transfer function coefficient data of a floor and a chair at a user's position in a measurement environment according to an embodiment. FIG. 4 is a diagram illustrating an example of an impulse response IR detected by an acceleration sensor. FIG. 5 is a diagram illustrating measurement of vibration transfer function coefficient data of a vibration presentation device of a chair on which a user is seated and a floor vibration presentation device. FIG. 6 is a diagram illustrating an example of a GUI for inputting user information and type information of the vibration presentation device of the chair according to an embodiment. FIG. 7 is a diagram illustrating data stored in a data file DF according to an embodiment. FIG. 8 is a diagram illustrating a flow of a speaker drive signal in a playback device in a playback environment according to an embodiment. FIG. 9 is a functional block diagram of an information processing device according to an embodiment. FIG. 10 is a functional block diagram of a playback device according to an embodiment. FIG. 11 is a flowchart illustrating an operation of generating a data file DF of the information processing device according to an embodiment. FIG. 12 is a flowchart illustrating playback processing of the playback device according to an embodiment. FIG. 13 is a flowchart illustrating an operation of correcting a vibration transfer function of the vibration presentation device according to an embodiment. FIG. 14 is a diagram illustrating how the vibration presentation device of the chair sways in accordance with the weight of a user according to an embodiment. FIG. 15 is a diagram illustrating correction processing for a chair of a type different from that of the chair used during measurement according to an embodiment. 1 is a flowchart for explaining the operation of a pre-processing unit in a vibration reproduction processing unit according to an embodiment. FIG. 2 is a diagram showing an example of vibration transfer function coefficient data of a floor and a chair read from a data file D. FIG. 3 is a diagram showing an example of vibration transfer function coefficient data 52 of a vibration presentation device read from a data file DF. FIG. 4 is a diagram showing the relationship between vibration transfer function coefficient data of a vibration presentation device and a correction filter. FIG. 5 is a diagram showing vibration characteristics for each user's physique, type of chair, and type of vibration presentation device. FIG. 6 is a hardware configuration diagram showing an example of a computer that realizes the arithmetic unit of an information processing device and a playback device according to an embodiment.

[0010] Preferred embodiments of the present disclosure will be described in detail below with reference to the accompanying drawings. In this specification and the drawings, components having substantially the same functional configurations are designated by the same reference numerals, and redundant description will be omitted. The description will be given in the following order.

[0011] 1. Configuration of sound production system 2. Measurement environment 2-1. Measurement of vibration transfer function coefficient data of floor and chair in measurement environment 2-2. Measurement of vibration transfer function coefficient data of floor and chair vibration presentation device 42 2-3. Example of GUI (graphical user interface) for inputting chair type information and user information 2-4. Data stored in data file DF 3. Flow of speaker drive signal in playback device 11 4. Functional block diagram of information processing device 1 5. Functional block diagram of playback device 11 6. Explanation of operation 6-1. Operation of information processing device 1 6-2. Operation of playback device 11 6-2-1. Operation of playback processing 6-2-2. Operation of correcting vibration transfer function of vibration presentation device 42 6-2-3. Operation of vibration reproduction processing unit 63 6-2-3-1. Pre-processing of vibration reproduction processing unit 63 7. Other embodiments 8. Effects 9. Hardware Configuration

[0012] 1. Configuration of an Audio Production System> Fig. 1 is a diagram showing an example of the configuration of an audio production system according to an embodiment. The audio production system in Fig. 1 is composed of equipment on the measurement environment side and equipment on the playback environment side. The audio production system in Fig. 1 is a system used, for example, to produce audio for content such as movies.

[0013] The audio of a movie includes not only the voices of actors, such as lines and narration, but also various other sounds, such as sound effects, environmental sounds, background music, etc. Hereinafter, when it is not necessary to distinguish between the types of sounds, they will be collectively referred to as audio, but in reality, the audio of a movie also includes types of sounds other than voices.

[0014] In the example of Fig. 1, a movie theater used for sound production, such as a dubbing stage, is used as the measurement space. The movie theater is equipped with a screen and multiple speakers. The movie theater is also equipped with an information processing device 1 that acquires HRTF measurement data indicating the transfer characteristics of audio corresponding to the acoustic characteristics of the measurement space and generates a data file DF containing HRTF coefficient data. The information processing device 1 is configured, for example, by a PC. The HRTF coefficient data included in the data file DF may also be BRTF coefficient data.

[0015] In the measurement environment, HRTF measurements are performed, and vibration transfer function coefficient data of the floor and chair in the measurement environment is obtained in addition to the HRTFs. The vibration transfer function coefficient data of the floor and chair in the measurement environment is stored in the data file DF in association with HRTF coefficient data indicating the HRTF measurement results in the information processing device 1. Furthermore, the vibration transfer function coefficient data of the haptic device 13 in the reproduction environment is stored in the data file DF in association with the HRTF coefficient data in the information processing device 1.

[0016] The vibration transfer function coefficient data of the vibration presentation device 13 of the floor and chair may be the measurement results of the vibration presentation device 13 in the measurement environment, or may be vibration transfer function coefficient data specific to the vibration presentation device 13 .

[0017] The vibration transfer function coefficient data 53 of the vibration presentation device 42 includes the vibration transfer function coefficient data 53 of the vibration presentation device 42 of the chair 23 and the vibration presentation device 42 of the floor.

[0018] The data file DF stored in the information processing device 1 is provided to a playback device 11 provided in a playback environment via a network such as the Internet. Although Fig. 1 shows a case where the vibration presentation device 13 is placed in the playback environment, the vibration presentation device 13 may also be placed in a measurement environment. The data file DF may also be provided to the playback device 11 using a recording medium such as a flash memory.

[0019] The playback environment is an environment located in a place other than a movie theater, such as a studio, the creator's home, etc. The playback environment may be prepared in the same place as the measurement environment.

[0020] The playback environment is provided with a playback device 11, which is equipment used for editing, such as mixing, the audio of a movie. The playback device 11 is configured, for example, by a PC. A producer edits the audio of a movie using headphones 12 in the playback environment, such as at home. The headphones 12 are an output device provided in the playback environment.

[0021] The playback environment also includes a vibration presentation device 13, which is included in, for example, a chair and a floor. The vibration presentation device 13 provides vibrations in the playback environment based on the vibration transfer function coefficient data of the vibration presentation device 13 corrected in the playback device 11, to give the user a bodily sensation similar to that in the measurement environment.

[0022] In the embodiment, a description will be given of a case where a playback device 11, which is an information processing device, controls vibration presentation devices 13, for example, on the seat, back, or floor of a chair in a playback environment, based on a data file DF. The vibration presentation devices 13 may be provided in other locations, such as on the armrests of a chair.

[0023] 2. Measurement Environment Fig. 2 is a diagram showing a measurement environment according to an embodiment. As shown in Fig. 2, a user 21 in the measurement environment is wearing headphones 22 and sitting in a chair 23. A plurality of speakers 24 are also provided in the measurement environment.

[0024] 2, air A indicates the air near the user 21, floor B indicates the floor of the user 21, and chair C indicates the chair 23 of the user 21. In a movie sound production environment, the user 21 experiences the reproduced sound (sound quality and sound field) from the speakers 24 of the movie theater.

[0025] 2-1. Measurement of vibration transfer function coefficient data of floor and chair in measurement environment> Fig. 3 is a diagram for explaining measurement of vibration transfer function coefficient data of the floor and chair at the position of user 21 in a measurement environment according to an embodiment. In Fig. 3, an acceleration sensor 31 is provided on floor 30 at the position of user 21 (position B in Figs. 2 and 3), and an acceleration sensor 32 is provided in the air (position A in Figs. 2 and 3).

[0026] Then, the acceleration sensors 31 and 32 detect the impulse response of the sound from the speaker 24. Fig. 4 is a diagram showing an example of the impulse response IR detected by the acceleration sensor 31 or the acceleration sensor 32. The information processing device 1 (see Fig. 1) calculates coefficient data of the vibration transfer functions of the floor and the chair from the impulse response IR, and stores the calculated coefficient data of the vibration transfer functions of the floor and the chair in the data file DF.

[0027] 5 is a diagram for explaining measurement of vibration transfer function coefficient data of the vibration presentation device 42 of the chair on which the user 41 is seated and the vibration presentation device 42 of the floor. The vibration presentation device 42 shown in FIG. 5 may be placed in the measurement environment. In addition to the chair vibration presentation device 42 and the floor vibration presentation device 42, other types of vibration presentation devices 42 may be provided.

[0028] For example, in the case of the chair vibration presentation device 42A, the vibration presentation device 42A may be provided on the seat of the chair, the lower part of the backrest of the chair, and the upper part of the backrest of the chair. In the case of the floor vibration presentation device 42B, the vibration presentation device 42A may be provided on the part of the floor on which the user 21 comes into contact, the entire upper part of the floor vibration presentation device 42B, etc.

[0029] The acceleration sensor 31 provided near the floor vibration presentation device 42B and the two acceleration sensors 32 provided near the chair vibration presentation device 42A detect impulse responses of vibrations of the acceleration sensors 31 and 32 that vibrate in response to sound from the speaker 24 (see FIG. 2 ). The information processing device 1 calculates vibration transfer function coefficient data of the floor and chair vibration presentation devices 42 from the impulse responses IR detected by the acceleration sensors 31 and 32 provided near the vibration presentation devices 42, and stores the data in a data file DF together with the HRTF coefficient data.

[0030] Furthermore, the information processing device 1 acquires user information of the user 41 and stores the acquired user information in a data file DF. The user information may include measurement data such as weight, height, and sitting height, and appearance information such as physique, gender, and clothing.

[0031] Furthermore, the information processing device 1 may acquire other data necessary for correcting the vibration transfer function coefficient data of the vibration presentation device 42, and store the acquired other data in the data file DF. For example, the information processing device 1 may acquire type information indicating the type of the vibration presentation device 42 of the chair of the user 41, and store the acquired type information in the data file DF.

[0032] The information processing device 1 may measure and record the vibration characteristics of only the chair different from the chair used at the time of measurement, and during playback, perform correction processing on the recorded vibration characteristics of only the chair different from the chair used at the time of measurement.The information processing device 1 then provides the corrected vibration characteristics of only the chair different from the chair used at the time of measurement to the chair different from the chair used at the time of measurement.As a result, the chair different from the chair used at the time of measurement obtains vibrations that are close to the bodily sensation of the chair used at the time of measurement.

[0033] 6 is a diagram showing an example of a GUI for inputting chair type information and user information according to an embodiment. As shown in Fig. 6, the GUI allows users to specify items such as chair type 43, backrest type 44, measurement points 45, height 46 of the user 41, sitting height 47, build 48, waist 49, and neck circumference 50.

[0034] The information processing device 1 acquires the chair type information and user information input via the GUI, and stores the acquired user information and type information in a data file DF. Note that the chair type information is not limited to chair type information, and may also be type information of floors, etc.

[0035] Although the case where the information processing device 1 stores the user information and type information in the data file DF has been described, the playback device 11 may store the user information and type information in the data file DF.

[0036] 7 is a diagram showing data stored in the data file DF according to the embodiment. As shown in Fig. 7, the data file DF stores HRTF coefficient data 51, vibration transfer function coefficient data 52 for the floor and chair, vibration transfer function coefficient data 53 for the vibration presentation device 42, user information 54, etc.

[0037] The HRTF coefficient data 51 is the measured HRTF coefficient data 51 of the user 21. The HRTF coefficient data 51 is acquired by the information processing device 1. The information processing device 1 stores the acquired HRTF coefficient data 51 in a data file DF.

[0038] The vibration transfer function coefficient data 52 of the floor and chair (first vibration transfer function coefficient data) is vibration transfer function coefficient data 52 of the floor and chair in the HRTF measurement environment. The vibration transfer function coefficient data 52 of the floor and chair may be vibration transfer function coefficient data 52 of the floor or vibration transfer function coefficient data 52 of the chair. The vibration transfer function coefficient data 52 of the floor and chair is vibration transfer function coefficients of the floor and chair when a signal is input to the speaker 24 and sound is output from the speaker 24. The vibration transfer function coefficient data 52 of the floor and chair also includes air vibration transfer function coefficient data 52 in the measurement environment.

[0039] For example, the floor and chair vibration transfer function coefficient data 52 is obtained by inputting sine waves with equal wave heights but different frequencies into the speakers 24 in the room, determining the frequency amplitude responses of the floor and chair, and then obtaining the floor vibration transfer function coefficient data H_fl (or chair vibration transfer function coefficient data H_ch) from the determined frequency amplitude responses.

[0040] The same sine wave as that input to the room speaker 24 is input as a drive signal to the floor and chair vibration presentation device 42 (vibrator). Then, a frequency amplitude response is obtained for the drive signal input to the vibration presentation device 42. Vibration transfer function coefficient data 53 (second vibration transfer function coefficient data) of the floor and chair vibration presentation device 42 is the vibration transfer function H_hap of the vibration presentation device 42 obtained from the obtained frequency amplitude response.

[0041] The vibration transfer function coefficient data 53 of the vibration presentation device 42 includes the vibration transfer function coefficient data 53 of the vibration presentation device 42 of the chair 23 and the vibration presentation device 42 of the floor 30 .

[0042] The vibration transfer function coefficient data 53 of the vibration presentation device 42 in the chair 23 is, for example, the vibration transfer function coefficient data 53 of the vibration presentation device 42 on the seat of the chair, the vibration transfer function coefficient data 53 of the vibration presentation device 42 on the back of the chair, etc.

[0043] The vibration transfer function coefficient data 53 of the floor vibration presentation device 42 is corrected by Y_fl = (H_fl / H_hap)·X[A]. Y_fl is the vibration transfer function coefficient data of the floor vibration presentation device 42 in the target space (e.g., the space in the measurement environment), H_fl is the vibration transfer function coefficient data of the floor, H_hap is the vibration transfer function coefficient data of the floor and the chair, and X is the speaker drive signal. H_hap may be, for example, the sum of the vibration transfer function coefficient data of the floor and the vibration transfer function coefficient data of the chair.

[0044] Furthermore, when the control points are limited, such as the vibration points of the floor and the chair, as in the embodiment, the vibration transfer function coefficient data H_fl of the floor and the vibration transfer function coefficient data H_ch of the chair from the measurement points are separately obtained, and an adjustment term C is obtained that has an optimum coefficient for simulating the vibration transfer function coefficient data Y_fl of the floor vibration presentation device 42 and the vibration transfer function coefficient data Y_ch of the chair vibration presentation device 42. The vibration transfer function coefficient data H_hap of the floor and the chair may use the coefficient of the obtained adjustment term C.

[0045] Furthermore, the vibration transfer function coefficient data Y_fl=(H_fl / H_hap)·X of the floor vibration presentation device 42 and the vibration transfer function coefficient data Y_ch of the chair vibration presentation device 42 may be controlled as separate systems, thereby improving the vibration reproduction accuracy of the vibration transfer function coefficient data Y_fl and the vibration transfer function coefficient data Y_ch.

[0046] The vibration presentation device 42 has a vibrator in its main body and is created so that its vibration characteristics hardly change depending on its location, as long as it is placed in a stable location. The vibration characteristics of the vibration presentation device 42 are the same at the playback location and in the measurement environment. Note that, in consideration of the possibility that the vibration characteristics of the vibration presentation device 42 may change slightly, the vibration characteristics of the vibration presentation device 42 at the playback location may be stored in the data file DF.

[0047] In the embodiment, an audio signal that is expected to be input to the speaker 24 in the measurement environment is input as a drive signal for the vibrator of the vibration presentation device 42. Therefore, the vibration transfer function coefficient data 53 of the vibration presentation device 42 is vibration transfer function coefficient data of the vibration presentation device 42 for the input signal of the speaker 24 in the target space.

[0048] To acquire the vibration transfer function coefficient data 53 of the vibration presentation device 42, it is sufficient to acquire a transfer function (impulse response). The reason for acquiring the vibration transfer function coefficient data 53 of the vibration presentation device 42 in the measurement environment is that, when a difference in bodily sensation is found by comparing the vibrations of the floor and chair in the measurement environment with the vibrations of the vibration presentation device 42 corrected by the information processing device of the embodiment (reproducing the floor and chair in the target space), it becomes easy to create parameters for adjusting the vibration of the vibration presentation device 42 to fill the difference. The vibration transfer function coefficient data 53 of the vibration presentation device 42 is also used in the sensory evaluation result improvement signal processing described later.

[0049] The user information 54 is user information about the user 41, and includes measurement data such as the weight, height, and sitting height of the user 41, and may also include appearance information such as physique, gender, and clothing.

[0050] The vibration transfer function coefficient data 52 of the floor and chair and the user information 54 stored in the data file DF are used to correct the vibration transfer function coefficient data 53 of the vibration presentation device 42 .

[0051] The vibration transfer function coefficient data 53 of the vibration presentation device 42 is not limited to data measured in the measurement environment, but may be vibration transfer function coefficient data 53 of the characteristics of the vibration presentation device 42 .

[0052] 3. Flow of speaker drive signals in playback device 11> Figure 8 is a diagram for explaining the flow of speaker drive signals in the playback device 11 in the playback environment according to the embodiment. Here, the flow of speaker drive signals in the playback device 11 has been explained, but the flow of speaker drive signals in the information processing device 1 is similar to the flow of speaker drive signals in the playback device 11. As shown in Figure 8, multi-channel audio playback software 61 such as a DAW (Digital Audio Workstation) of the playback device 11 outputs multi-channel speaker drive signals.

[0053] When playback is switched to the headphones 12 and the vibration presentation device 42, the binaural processing unit 62 performs binaural processing on the speaker drive signal using the HRTF coefficient data 51 stored in the data file DF, and outputs the processed speaker drive signal to the headphones 12. The sound heard through the headphones 12 reproduces the direction and distance to the sound source in the measurement space.

[0054] The vibration reproduction processing unit 63 outputs a vibration presentation device drive signal to the vibration presentation device 42 in response to the speaker drive signal. Specifically, the vibration reproduction processing unit 63 corrects the vibration transfer function coefficient data 53 of the vibration presentation device 42 based on the HRTF coefficient data 51, the vibration transfer function coefficient data 52 of the floor and chair, the user information 54, and the like stored in the data file DF so that the bodily sensation approaches the vibration transfer function coefficient data 52 of the floor and chair. The vibration reproduction processing unit 63 outputs a vibration presentation drive signal including the corrected vibration transfer function coefficient data 53 of the vibration presentation device 42 to the vibration presentation device 42. The processing of the vibration reproduction processing unit 63 will be described in detail with reference to the flowchart of FIG. 13 .

[0055] When playback is switched to the speakers in the room in the playback environment, the pass-through processing unit 64 passes through the speaker drive signal and outputs it to the speakers in the room in the playback environment.

[0056] 4. Functional Block Diagram of Information Processing Device 1 In the information processing device 1, the CPU of the PC constituting the information processing device 1 executes a predetermined program, thereby realizing each functional unit shown in FIG.

[0057] 9 is a functional block diagram of an information processing device 1 according to an embodiment. As shown in Fig. 9, the information processing device 1 includes a playback processing unit 71, an output control unit 72, an HRTF coefficient data acquisition unit 73, a floor and chair vibration transfer function coefficient data acquisition unit 74, a vibration presentation device vibration transfer function coefficient data acquisition unit 75, a user information etc. acquisition unit 76, and a data file DF generation unit 77.

[0058] The playback processing unit 71 controls the playback of audio output from the headphones 22 and the speaker 24. An audio signal obtained by playing back the audio data for measurement is supplied to the output control unit 72.

[0059] The output control unit 72 outputs the reproduced sound corresponding to the audio signal supplied from the reproduction processing unit 71 from the headphones 12 and the speaker 24 .

[0060] The HRTF coefficient data acquisition unit 73 acquires HRTF coefficient data of the user 21 in the measurement environment and outputs it to the data file DF generation unit 77. In general, HRTFs are acquired by measuring acoustic signals for measurement using a microphone attached inside the ear of the subject, a dummy head microphone, or the like.

[0061] The floor and chair vibration transfer function coefficient data acquisition unit 74 acquires vibration transfer function coefficient data of the floor 30 (see Figure 3) and chair 23 (see Figure 2) at the position of the user 21 in the measurement environment and outputs it to the data file DF generation unit 77.

[0062] The vibration transfer function coefficient data acquisition unit 75 of the vibration presentation device acquires vibration transfer function coefficient data of the vibration presentation device 42 (see FIG. 5) of the user 41 and outputs it to the data file DF generation unit 77 .

[0063] The user information acquisition unit 76 acquires information necessary for correcting the vibration transfer function coefficient data of the vibration presentation device 42 , such as user information of the user 41 and type information of the vibration presentation device 42 , and outputs it to the data file DF generation unit 77 .

[0064] The data file DF generation unit 77 generates a data file DF containing information necessary for correction, such as HRTF coefficient data, vibration transfer function coefficient data of the vibration presentation device 42, vibration transfer function coefficient data of the floor 30 and chair 23 at the position of the user 21 in the measurement environment, user information of the user 41, and type information of the vibration presentation device 42.

[0065] The data file DF may include audio data such as the sound signal of a movie, etc. The audio data may be transmitted from the information processing device 1 to the playback device 11 separately from the data file DF.

[0066] 5. Functional Block Diagram of Reproduction Device 11> Fig. 10 is a functional block diagram of the reproduction device 11 according to the embodiment. As shown in Fig. 10, the reproduction device 11 has a data file acquisition unit 101, a pre-processing unit 102, a correction unit 103, a sensory evaluation result improvement processing unit 104, an output unit 105, a coefficient reading unit 111, an audio data acquisition unit 112, a convolution processing unit 113, and a reproduction processing unit 114. Although Fig. 10 shows the functional block diagram of the reproduction device 11, the information processing device 1 also has similar functional blocks.

[0067] The data file acquisition unit 101 acquires a data file DF created by the information processing device 1 .

[0068] The pre-processing unit 102 reads the HRTF coefficient data 51, the vibration transfer function coefficient data 52 of the floor and chair, the vibration transfer function coefficient data 53 of the vibration presentation device 42, the user information 54, and the like stored in the data file DF.

[0069] The pre-processing unit 102 allocates multi-channel speaker driving signals to vibration presentation points of the vibration presentation device 42. The pre-processing unit 102 may use the HRTF coefficient data 51 stored in the data file DF for signal processing.

[0070] The correction unit 103 corrects the vibration transfer function coefficient data 53 of the vibration presentation device 42 in the data file DF acquired by the data file acquisition unit 101, based on the vibration transfer function coefficient data 52 of the floor and the chair in the data file DF acquired by the data file acquisition unit 101. Note that the correction by the correction unit 103 can also be defined as generation. The correction unit 103 may be a generation unit that generates third vibration transfer function coefficient data of the vibration presentation device 42 in the playback environment, based on the second vibration transfer function coefficient data of the vibration presentation device acquired by the acquisition unit and the first vibration transfer function coefficient data of the floor or the chair acquired by the acquisition unit.

[0071] The vibration transfer function coefficient data 53 of the vibration presentation device 42 is corrected based on the vibration transfer function coefficient data 52 of the corresponding floor and chair. For example, the vibration transfer function coefficient data 53 of the vibration presentation device 42 at point A shown in FIG. 2 is corrected based on the vibration transfer function coefficient data 52 of the corresponding floor and chair at point A, and the vibration transfer function coefficient data 53 of the vibration presentation device 42 at point B is corrected based on the vibration transfer function coefficient data 52 of the corresponding floor and chair at point B.

[0072] The correction unit 103 may correct the vibration transfer function coefficient data 53 of the vibration presentation device 42 by using the user information 54. Furthermore, the correction unit 103 may correct the vibration transfer function coefficient data 53 of the vibration presentation device 42 by using type information of the vibration presentation device 42.

[0073] The sensory evaluation result improvement processing unit 104 corrects the vibration transfer function coefficient data 53 of the vibration presentation device 42 so that the corrected vibration transfer function coefficient data 53 of the vibration presentation device 42 is indistinguishable from the bodily vibration measured in the measurement environment.

[0074] The output unit 105 outputs a drive signal of the vibration transfer function coefficient data 53 of the vibration presentation device 42 processed by the sensory evaluation result improvement processing unit 104 to the vibration presentation device 42. As a result, a chair or the like having the vibration presentation device 42 in the reproduction environment can obtain accurate bodily sensation vibration in the measurement environment.

[0075] The coefficient reading unit 111 reads the HRTF coefficient data 51 stored in the data file DF acquired by the data file acquisition unit 101 as coefficient data for an FIR (Finite Impulse Response) filter, and supplies it to the convolution processing unit 113 .

[0076] The audio data acquisition unit 112 acquires audio data such as the audio signal of a movie, and supplies the audio data to the convolution processing unit 113 .

[0077] The convolution processing unit 113 uses the HRTF coefficient data 51 read by the coefficient reading unit 111 to perform FIR filter convolution processing on the audio signal supplied from the audio data acquisition unit 112, thereby generating a playback signal. The playback signal generated by the convolution processing unit 113 is supplied to a playback processing unit 114.

[0078] The playback processing unit 114 performs acoustic processing such as 2ch mix processing, sound quality adjustment, and gain adjustment on the playback signal supplied from the convolution processing unit 113, and outputs the playback signal obtained by performing the acoustic processing.

[0079] The output unit 105 outputs the playback signal output from the playback processing unit 114 to the headphones 12. For example, the playback signal for L and the playback signal for R output from the playback processing unit 114 are supplied to the headphones 12. The headphones 12 output playback sound corresponding to the playback signal.

[0080] 6. Description of Operation 6-1. Operation of Information Processing Device 1 FIG. 11 is a flowchart for explaining the operation of generating a data file DF of the information processing device 1 according to the embodiment.

[0081] 11 is described as being performed by the information processing device 1, but this processing may be performed by other devices provided in the measurement environment as appropriate. As described above, the HRTF measurement is performed while the subject is seated in a designated seat in a movie theater with a microphone attached to their ear canal.

[0082] In step S1, the output control unit 72 causes the speaker 24 of the movie theater to output the reproduced sound.

[0083] In step S2, the HRTF coefficient data acquisition unit 73 acquires HRTF coefficient data of the user 21 in the measurement environment.

[0084] In step S3, the floor and chair vibration transfer function coefficient data acquisition unit 74 acquires vibration transfer function coefficient data of the floor 30 (see FIG. 3) and chair 23 (see FIG. 2) at the position of the user 21 in the measurement environment.

[0085] In step S4, the vibration transfer function coefficient data acquisition unit 75 of the vibration presentation device acquires vibration transfer function coefficient data of the vibration presentation device 42 (see FIG. 5) such as the chair of the user 41.

[0086] In step S5, the user information acquiring unit 76 acquires information necessary for correction, such as user information of the user 41 and type information of the vibration presentation device 42.

[0087] In step S6, the data file DF generation unit 77 generates a data file DF containing information necessary for correction, such as HRTF coefficient data, vibration transfer function coefficient data of the vibration presentation device 42, vibration transfer function coefficient data of the floor 30 and chair 23 at the position of the user 21 in the measurement environment, user information of the user 41, and type information of the vibration presentation device 42.

[0088] <6-2. Operation of playback device 11> <6-2-1. Operation of playback processing> Fig. 12 is a flowchart for explaining the playback processing of the playback device 11 according to the embodiment. The playback processing in Fig. 12 is started, for example, in a state where audio data has been acquired in advance by the audio data acquisition unit 112. Fig. 12 shows the flow of the playback processing in the playback device 11, but the flow of the playback processing in the information processing device 1 is the same as that in Fig. 12.

[0089] In step S 11 , the coefficient reading unit 111 reads the HRTF coefficient data 51 stored in the data file DF acquired by the data file acquisition unit 101 as coefficient data for the FIR filter, and supplies it to the convolution processing unit 113 .

[0090] In step S12, the convolution processing unit 113 uses the HRTF coefficient data 51 read by the coefficient reading unit 111 to perform FIR filter convolution processing on the audio signal supplied from the audio data acquisition unit 112, thereby generating a playback signal.

[0091] In step S13, the playback processing unit 114 performs acoustic processing such as 2ch mix processing, sound quality adjustment, and gain adjustment on the playback signal supplied from the convolution processing unit 113, and outputs the playback signal obtained by performing the acoustic processing.

[0092] 6-2-2. Operation of Correcting Vibration Transfer Function of Vibration Presentation Device 42 FIG. 13 is a flowchart for explaining the operation of correcting the vibration transfer function of the vibration presentation device 42 according to the embodiment.

[0093] In step S21, the data file acquisition unit 101 acquires the data file DF created by the information processing device 1.

[0094] In step S22, the pre-processing unit 102 allocates multi-channel speaker driving signals to vibration presentation points (vibration presentation devices 42) such as the floor and chair.

[0095] In step S23, the correction unit 103 corrects the vibration transfer function coefficient data 53 of the vibration presentation device 42 acquired by the data file acquisition unit 101 based on the vibration transfer function coefficient data 52 of the floor and chair in the data file DF acquired by the data file acquisition unit 101.

[0096] In step S24, the sensory evaluation result improvement processing unit 104 corrects the vibration transfer function coefficient data 53 of the vibration presentation device 42 so that the corrected vibration transfer function coefficient data 53 of the vibration presentation device 42 is indistinguishable from the bodily vibration measured in the measurement environment.

[0097] The correction unit 103 may correct the vibration transfer function coefficient data 53 of the vibration presentation device 42 by using the user information 54. Fig. 14 is a diagram for explaining how the vibration presentation device 42 of the chair sways in accordance with the weight of the user 41 according to the embodiment.

[0098] 14 , for example, when the user 41 shown on the left is heavier than a predetermined weight, the chair is less likely to sway due to the user's weight, so the correction unit 103 corrects the amplitude of the vibration transfer function coefficient data 53 of the chair vibration presentation device 42 to be smaller. That is, the correction unit 103 corrects the amplitude of the vibration transfer function coefficient data 53 so that the chair is less likely to sway. When the user 41 is lighter than a predetermined weight, the chair is more likely to sway due to the user's weight, so the correction unit 103 corrects the amplitude of the vibration transfer function coefficient data 53 of the chair vibration presentation device 42 so that it is larger. That is, the correction unit 103 corrects the amplitude of the vibration transfer function coefficient data 53 so that the chair is more likely to sway.

[0099] The correction unit 103 may also correct the amplitude and frequency of the vibration transfer function coefficient data 53 of the vibration presentation device 42 by using type information of the vibration presentation device 42 .

[0100] FIG. 15 is a diagram illustrating the correction process for a chair of a different type from the chair used during measurement according to the embodiment. Three different types of chairs, 23a to 23c, are shown in FIG. Chair 23a is a simpler chair than chair 23b, which is a simpler chair than chair 23c. As shown in FIG. 15, the swaying patterns (impulse responses) of chairs 23a to 23c differ depending on the type of chair. Specifically, the swaying patterns (impulse responses) become more detailed in the order of chair 23a, chair 23b, and chair 23c. The correction unit 103 may correct the vibration transfer function coefficient data 53 of the chair vibration presentation device 42 to approximate the vibration transfer function coefficient data of the floor and chair depending on the type of chair.

[0101] 16 is a flowchart for explaining the operation of the vibration reproduction processing unit 63 according to the embodiment. In FIG. 16, the vibration presentation device 42 is illustrated as an example from point A to point C in the target space (for example, the measurement environment).

[0102] In FIG. 16, the multi-channel speaker driving signals input from the multi-channel audio reproduction software 61 are pre-processed (step S31).

[0103] In the pre-processing in step S31, the HRTF coefficient data 51 from the data file DF is read, and the read HRTF coefficient data 51 (corresponding to the input multi-channel speaker drive signals) is assigned to the vibration presentation point (vibration presentation device 42). The pre-processing also includes signal processing such as rendering and fold-down processing. The pre-processing may also use the HRTFs of the speakers in the signal processing.

[0104] Here, the rendering process is performed on a speaker drive signal. The speaker drive signal is a sound source signal that is to be placed in space. The rendering process is a concept in object audio. The rendering process refers to a process of determining which speaker, among multiple speakers in a room that reproduces the speaker drive signal, to output a sound so that the sound is heard from a desired direction and position in space. An algorithm for realizing the rendering process is, for example, an algorithm such as VBAP (Vector Based Amplitude Panning).

[0105] Fold-down processing is processing in which playback audio signals (for example, 22.2-channel audio signals or 5.1-channel audio signals) that are prepared to be output from multiple speaker channels are added together to combine the left and right speakers into a single channel, thereby reducing the number of channels altogether. A typical example of fold-down processing is fold-down processing that allows the above-mentioned playback audio signals to be output from two channels, L and R, when listening to them through headphones.

[0106] Then, for the target spatial vibration transfer characteristic point A, floor and chair vibration transfer function coefficient data for point A are read from the data file DF (step S32_1). Similarly, for the target spatial vibration transfer characteristic point B, floor and chair vibration transfer function coefficient data for point B are read from the data file DF (step S32_2), and floor and chair vibration transfer function coefficient data for point C are read from the data file DF (step S32_3).

[0107] Next, for the vibration transmission characteristics of the vibration presentation device at point A, coefficient data of the vibration transmission function of the vibration presentation device for point A is read from the data file DF (step S33_1). Similarly, for the vibration transmission characteristics of the vibration presentation device at point B, coefficient data of the vibration transmission function of the vibration presentation device for point B is read from the data file DF (step S33_2). For the vibration transmission characteristics of the vibration presentation device at point C, coefficient data of the vibration transmission function of the vibration presentation device for point C is read from the data file DF (step S33_3).

[0108] Next, a correction process for the vibration transfer function coefficient data of the vibration presentation device is performed (step S34). In Fig. 16, the data file DF stores HRTF coefficient data 51, vibration transfer function coefficient data 52 of the floor and chair, vibration transfer function coefficient data 53 of the vibration presentation device 42, and user information 54, as well as shape and type information 55 of the vibration presentation device. The shape and type information 55 of the vibration presentation device includes shape and type information of the floor and chair, and is used to correct the vibration transfer function coefficient data of the vibration presentation device. The correction process is performed based on the shape and type information 55 of the vibration presentation device and the user information 54 read from the data file DF.

[0109] Then, the corrected multi-channel speaker drive signals are subjected to a sensory evaluation result improvement process (step S35), and the drive signals are output to the vibration presentation device. The sensory evaluation result improvement process is a signal process that performs additional adjustments while switching between speaker playback and playback through headphones and the vibration presentation device, in the event that a difference in bodily sensation results from the signal processing, with the aim of making the resulting bodily sensation vibration indistinguishable from the real thing. This additional adjustment is performed, for example, by adjusting the parameters of the vibration transfer function coefficient data 53 of the vibration presentation device 42.

[0110] The adjustment may include, for example, adjusting the gain of a filter, editing the waveform of an FIR, adding a delay, etc. The sensory evaluation result improvement processing unit 104 outputs a drive signal for the vibration presentation device according to the adjusted adjustment parameters.

[0111] <6-2-3-1.> FIG. 17 is a flowchart for explaining the operation of the pre-processing unit 102 in the vibration reproduction processing unit 63 according to the embodiment.

[0112] 17, parameters used in the processing of steps S42 to S46 are stored in an external file 121. The external file 121 may also include a data file DF. Initial setting values ​​122 are the initial values ​​of the parameters used in the processing of steps S42 to S46.

[0113] The parameter switching processing unit 123 switches between the parameters of the initial setting values ​​122 and the parameters stored in the external file 121 as necessary, and outputs the switched parameters to the parameter information storage unit 124 .

[0114] The parameter information storage unit 124 stores the parameters used in the processing of steps S42 to S46, which are switched and output by the parameter switching processing unit 123.

[0115] When a speaker drive signal is input, the quantized amplitude of the speaker drive signal is normalized (step S41). Thereafter, the pre-processing unit 102 of the vibration reproduction processing unit 63 performs amplitude allocation processing on the quantized speaker drive signal based on the parameter information for amplitude allocation processing stored in the parameter information storage unit 124 (step S42). This amplitude allocation processing is processing for allocating the speaker drive signal, which is an input signal, to n channels of the speaker drive signal in order to input the signal to n vibration presentation devices 42. In other words, the amplitude allocation processing selects which channel's signal is to be input to the vibration presentation device 42.

[0116] The amplitude apportionment process may allocate the amplitude proportionally distributed speaker drive signals so that when the amplitude proportionally distributed speaker drive signals are vector-combined using VBAP, the resulting gain is the same as the original signal gain. Furthermore, the amplitude apportionment process may utilize the HRTF coefficient data 51 stored in the data file DF to calculate the gain of the amplitude apportionment process, using the sound that reaches the ears from the speakers when the input waveform signal is played back in the target space (i.e., the signal obtained by convolving the input signal with an impulse response). Furthermore, the amplitude apportionment process may perform amplitude proportionally distributed speaker drive signals through filtering.

[0117] Next, the speaker drive signal that has been subjected to the amplitude proportional division process is subjected to a filtering process (step S43) based on the parameter information for filtering stored in the parameter information storage unit 124. This filtering process is a process that switches between filtering the speaker drive signal with a 100 Hz low-pass filter and filtering the speaker drive signal with a 90 Hz high-shelving filter according to settings, for example.

[0118] The filtered speaker drive signals are subjected to an addition process (step S44) based on the parameter information for the addition process stored in the parameter information storage unit 124. This addition process switches the setting value of the gain coefficient by which each input channel is multiplied when downfolding in combination with the amplitude apportionment process of step S42. The addition process folds down the speaker drive signals that were filtered in step S43. For example, the addition process folds down the speaker drive signals that are sounding on the left side of the room (e.g., speaker drive signals for the L channel and Ls channel) into a single-channel speaker drive signal.

[0119] The speaker drive signal that has undergone the addition process is subjected to a convolution process (step S45) based on the parameter information for the convolution process stored in the parameter information storage unit 124. For this convolution process, the parameter values ​​of the initial setting values ​​122 are not used (the initial state is that a coefficient of amplitude 1 sample 1 is entered in the FIR filter), and impulse response data according to the reproduction environment is input from the external file 121.

[0120] The speaker drive signal that has undergone the convolution process is subjected to an integration process (step S46) based on the parameter information for the integration process stored in the parameter information storage unit 124. This integration process is a process for adjusting the volume of the speaker drive signal that has undergone the convolution process. Specifically, the integration process is a process for multiplying the speaker drive signal that has undergone the convolution process by a gain coefficient for lowering the volume. The integration process is a process for reading and reproducing a vibration adjustment value from the external file 121 when it becomes necessary to adjust the amplitude of the vibration, for example, when the amplifier that vibrates the vibration presentation device 42 is changed. The integration process is performed because the volume becomes too high when the fold-down process is simply expressed by addition, and therefore the volume is adjusted accordingly. The speaker drive signal that has undergone the integration process is output as an output signal.

[0121] The output signal has the number of channels equal to the number of units, n. The output signal may have silent channels.

[0122] The playback device 11 performs filtering (step S43), addition (step S44), convolution (step S45), and accumulation (step S46), and the contents of these processes can be controlled by parameters. Note that the filtering (step S43), addition (step S44), convolution (step S45), and accumulation (step S46) processes can be performed for only some of the units.

[0123] Furthermore, when VBAP is used in the amplitude allocation process in step S42, if the coordinate information of the excitation point (vibration presentation device 42) is known, the coordinate information of the excitation point may be obtained from an external file and the amplitude allocation process may be performed.

[0124] Figure 18 is a diagram showing an example of floor and chair vibration transfer function coefficient data 52 read from data file DF (external file 121). In Figure 18, the vertical axis represents vibration strength, and the horizontal axis represents frequency. The floor and chair vibration transfer function coefficient data 52 is data on vibration characteristics measured at the position in the target space where the HRTF was measured, by installing a vibration measuring instrument on the floor surface at that position, the chair placed at that position and used for the measurement, the back of the chair, etc. The external file 121 stores data on the vibration characteristics of the chair, floor, etc., and their impulse responses.

[0125] The parameters stored in the external file 121 may be different for the excitation points 1 a, 2 a, and 3 a, or common parameters may be prepared for the excitation points 1 a, 2 a, and 3 a. Note that the convolution operation process in step S45 may include equalizing processing in addition to the convolution process of the impulse response.

[0126] 19 is a diagram showing an example of vibration transfer function coefficient data 53 of the vibration presentation device 42 read from the data file DF (external file 121). In FIG. 20, the vertical axis represents vibration strength, and the horizontal axis represents frequency. The vibration transfer function coefficient data 53 of the vibration presentation device 42 may be data of vibration characteristics measured by placing a vibration measuring instrument on the floor at the position where the HRTF was measured in the target space, on a chair placed at that position and used for the measurement, on the back of the chair, etc. The external file 121 stores data of the vibration characteristics of the vibration presentation device 42, such as the chair and floor, and their impulse responses.

[0127] Fig. 20 is a diagram showing the relationship between the vibration transfer function coefficient data 53 of the vibration presentation device 13 and the correction filter. In Fig. 20, the vertical axis represents vibration strength, and the horizontal axis represents frequency. In Fig. 20, vibration characteristics 125 represent the vibration transfer function coefficient data 53 of the vibration presentation device 13 of Hap_Type A, and vibration characteristics 126 represent the vibration transfer function coefficient data 53 of the vibration presentation device 13 of Hap_Type B. As shown in Fig. 20, the vibration characteristics differ depending on the type of vibration presentation device 13 used (Hap_Type A, Hap_Type B).

[0128] Further, a filter characteristic 127 indicates the correction characteristic of the correction filter for Hap_Type A, and a filter characteristic 128 indicates the correction characteristic of the correction filter for Hap_Type B.

[0129] 20 , the vibration reproduction processing unit 63 creates a correction filter with inverse characteristics (a correction filter for Hap_Type A, a correction filter for Hap_Type B) for each type (Hap_Type A, Hap_Type B) of the vibration presentation device 13. The correction filter with inverse characteristics is an IIR (infinite impulse response filter) filter or an FIR (finite impulse response) filter.

[0130] In the correction process of step S34, the vibration reproduction processing unit 63 performs processes such as convolution of the created IIR / FIR filter with inverse characteristics and adjustment of the gain of the speaker drive signal. The vibration transfer function coefficient data 53 after gain adjustment becomes like the corrected characteristics HF shown in Fig. 20. Therefore, the vibration of the vibration presentation device 13 is aligned by the correction process.

[0131] Fig. 21 is a diagram showing vibration characteristics for each user's physique, type of chair, and type of vibration presentation device 13. In Fig. 21, vibration characteristics 131 indicate the vibration characteristics of chair A + Hap_Type A (vibration presentation device A), vibration characteristics 132 indicate the vibration characteristics of chair B + Hap_Type A, vibration characteristics 133 indicate the vibration characteristics of chair C + Hap_Type A, and vibration characteristics 134 indicate the vibration characteristics of chair D + Hap_Type A. Vibration characteristics 131 to 134 indicate the case where the user has a large physique.

[0132] Vibration characteristics 135 show the vibration characteristics of Chair B + Hap_Type A when the user's physique is small, vibration characteristics 136 show the vibration characteristics of Chair C + Hap_Type A when the user's physique is small, and vibration characteristics 137 show the vibration characteristics of Chair D + Hap_Type A when the user's physique is small.

[0133] The external file 121 stores differences in vibration characteristics due to differences in body size, such as large or small, and changes in vibration characteristics due to the type of chair used, as a filter or gain curve.

[0134] In the correction process of step S34 in FIG. 16, the speaker driving signal may be corrected using these filters or gain curves.

[0135] 16, the vibration reproduction processing unit 63 makes the conditions as close as possible and compares the vibrations in the room with the vibrations from the vibration presentation device 13. If a difference is felt, the parameters are adjusted by signal processing to make the conditions closer.

[0136] 7. Other Embodiments The processing according to each of the above-described embodiments may be implemented in various different forms other than the above-described embodiments.

[0137] Furthermore, among the processes described in the above embodiments, all or part of the processes described as being performed automatically can be performed manually, or all or part of the processes described as being performed manually can be performed automatically using known methods. Furthermore, the information, including the processing procedures, specific names, various data, and parameters shown in the above documents and drawings, can be changed as desired unless otherwise specified. For example, the various information shown in each drawing is not limited to the information shown in the drawings.

[0138] Furthermore, the components of each device shown in the figure are conceptual functional components and do not necessarily have to be physically configured as shown in the figure. In other words, the specific form of distribution and integration of each device is not limited to that shown in the figure, and all or part of them can be functionally or physically distributed and integrated in any unit depending on various loads, usage conditions, etc.

[0139] Furthermore, the above-described embodiments and modifications can be combined as appropriate within the scope of not causing any contradiction in the processing content.

[0140] Furthermore, the effects described in this specification are merely examples and are not limiting, and other effects may also be present.

[0141] 8. Effects An information processing device according to the present disclosure (in the embodiments, the information processing device 1 and the playback device 11) includes an acquisition unit (in the embodiments, the data file acquisition unit 101) that acquires a data file including head-related transfer function coefficient data measured in a measurement environment (in the embodiments, HRTF coefficient data 51), first vibration transfer function coefficient data related to a floor or a chair measured in the measurement environment (in the embodiments, vibration transfer function coefficient data 52 of the floor and the chair), and second vibration transfer function coefficient data related to a vibration presentation device (in the embodiments, vibration transfer function coefficient data 53 of the vibration presentation device 42), and a generation unit (in the embodiments, the correction unit 103) that generates third vibration transfer function coefficient data of the vibration presentation device in the playback environment based on the second vibration transfer function coefficient data related to the vibration presentation device acquired by the acquisition unit and the first vibration transfer function coefficient data related to the floor or the chair acquired by the acquisition unit.

[0142] Therefore, the information device of the embodiment corrects the third vibration transfer function coefficient data of the vibration presentation device in the playback environment using the first vibration transfer function coefficient data of the floor and chair, thereby enabling the vibration presentation device to provide accurate bodily sensation vibration.

[0143] Furthermore, the first vibration transfer function coefficient data and the second vibration transfer function coefficient data are linked to the head-related transfer function coefficient data, and therefore the information device according to the embodiment can manage the first vibration transfer function coefficient data and the second vibration transfer function coefficient data for each user.

[0144] The third vibration transfer function coefficient data is calculated by correcting the second vibration transfer function coefficient data based on the first vibration transfer function coefficient data. Therefore, the information device according to the embodiment allows the vibration presentation device to provide accurate bodily sensation vibration.

[0145] The third vibration transfer function coefficient data is data for an audio signal input to a speaker in the measurement environment. Therefore, the information processing device can provide the user with accurate bodily vibrations by using the audio signal input to the speaker.

[0146] The information processing device has an output unit (in the embodiment, the output unit 105) that outputs the third vibration transfer function coefficient data to the vibration presentation device. Therefore, the information processing device can be provided with a vibration presentation device separate from the information processing device.

[0147] The data file includes user information of the user of the vibration presentation device (in the embodiment, user information 54), and the generation unit corrects the coefficient data of the second vibration transfer function of the vibration presentation device using the user information. Therefore, since the information processing device corrects the coefficient data of the second vibration transfer function of the vibration presentation device using the user information, the vibration presentation device can more accurately provide the user with accurate bodily vibration.

[0148] The data file includes type information indicating the type of the vibration presentation device, and the generation unit corrects the coefficient data of the second vibration transfer function of the vibration presentation device using the type information. Therefore, the information processing device corrects the coefficient data of the second vibration transfer function of the vibration presentation device using the type of the vibration presentation device, so that the vibration presentation device can more accurately provide the user with accurate bodily vibration.

[0149] The second vibration transfer function coefficient data includes vibration transfer function coefficient data of the seat of the chair. Therefore, since the information processing device has the vibration presentation device provided on the seat, it is possible to reliably provide bodily sensation vibration to the user.

[0150] The second vibration transfer function coefficient data includes the vibration transfer function coefficient data of the chair back. Therefore, the information processing device is provided with the second vibration transfer function coefficient data of the vibration presentation device for the chair back in addition to the seat surface of the chair, so that the user can be provided with bodily sensation vibration more reliably and sufficiently reliably.

[0151] The first vibration transfer function coefficient data includes coefficient data of the air vibration transfer function in the measurement environment. Therefore, the information processing device also uses the coefficient data of the air vibration transfer function to correct the coefficient data of the second vibration transfer function of the vibration presentation device, so that the user can be reliably given a more realistic bodily sensation of vibration.

[0152] When the vibration presentation device is a chair, the generation unit corrects coefficient data of the second vibration transfer function of the vibration presentation device, which indicates the swaying of the chair, in accordance with the weight indicated by the user information. Therefore, the information processing device can appropriately correct the coefficient data of the second vibration transfer function of the vibration presentation device in accordance with the weight of the user, thereby providing the user with more realistic and reliable bodily sensation vibration.

[0153] The generation unit corrects coefficient data of the second vibration transfer function of the vibration presentation device, which indicates the swaying of the chair, when the weight indicated by the user information is heavier than a predetermined weight, so that the chair is less likely to sway. Therefore, when the user's weight is heavier than the predetermined weight, the information processing device corrects the coefficient data of the second vibration transfer function so that the chair is less likely to sway, so that the user can be given a more realistic and reliable bodily sensation of vibration.

[0154] The generation unit corrects coefficient data of the second vibration transfer function of the vibration presentation device, which indicates the swaying of the chair, when the weight indicated by the user information is lighter than a predetermined weight, so that the chair sways more easily. Therefore, when the user's weight is lighter than the predetermined weight, the information processing device corrects the coefficient data of the second vibration transfer function so that the chair sways more easily, so that the user can be provided with a more realistic and reliable bodily sensation of vibration.

[0155] When the vibration presentation device is a chair vibration presentation device, the generation unit corrects the coefficient data of the second vibration transfer function of the vibration presentation device, which indicates the swaying of the chair, according to the type information. Therefore, the information processing device can appropriately correct the coefficient data of the second vibration transfer function of the vibration presentation device according to the type of chair, thereby providing the user with more realistic and reliable bodily sensation vibration.

[0156] 9. Hardware Configuration FIG. 22 is a hardware configuration diagram showing an example of a computer 1000 that realizes the arithmetic units of the information processing device 1, the reproduction device 11, and the vibration presentation device 13 according to the embodiment.

[0157] The computer 1000 includes a CPU 1100, a RAM 1200, a ROM (Read Only Memory) 1300, a HDD (Hard Disk Drive) 1400, a communication interface 1500, and an input / output interface 1600. The components of the computer 1000 are connected by a bus 1050.

[0158] The CPU 1100 operates and controls each component based on programs stored in the ROM 1300 or the HDD 1400. For example, the CPU 1100 loads the programs stored in the ROM 1300 or the HDD 1400 into the RAM 1200 and executes processing corresponding to the various programs.

[0159] The ROM 1300 stores boot programs such as a Basic Input Output System (BIOS) that is executed by the CPU 1100 when the computer 1000 is started, as well as programs that depend on the hardware of the computer 1000 .

[0160] HDD 1400 is a computer-readable recording medium that non-temporarily records programs executed by CPU 1100 and data used by such programs. Specifically, HDD 1400 is a recording medium that records an application program according to the present disclosure, which is an example of program data 1450.

[0161] The communication interface 1500 is an interface for connecting the computer 1000 to an external network 1550 (e.g., the Internet). For example, the CPU 1100 receives data from other devices and transmits data generated by the CPU 1100 to other devices via the communication interface 1500.

[0162] The input / output interface 1600 is an interface for connecting the input / output device 1650 and the computer 1000. For example, the CPU 1100 receives data from an input device such as a keyboard or a mouse via the input / output interface 1600. The CPU 1100 also transmits data to an output device such as a display, a speaker, or a printer via the input / output interface 1600. The input / output interface 1600 may also function as a media interface for reading programs and the like recorded on a predetermined recording medium. Examples of media include optical recording media such as DVDs (Digital Versatile Discs) and PDs (Phase Change Rewritable Discs), magneto-optical recording media such as MOs (Magneto-Optical Discs), tape media, magnetic recording media, and semiconductor memories.

[0163] Although the CPU 1100 reads and executes the program data 1450 from the HDD 1400, as another example, the CPU 1100 may obtain these programs from other devices via an external network 1550.

[0164] Although the preferred embodiments of the present disclosure have been described in detail above with reference to the accompanying drawings, the technical scope of the present disclosure is not limited to such examples. It is clear that a person skilled in the art of the present disclosure can conceive of various modified or altered examples within the scope of the technical idea described in the claims, and it is understood that these also naturally fall within the technical scope of the present disclosure.

[0165] Furthermore, the effects described herein are merely descriptive or exemplary and are not limiting. In other words, the technology according to the present disclosure may achieve other effects that will be apparent to those skilled in the art from the description of this specification, in addition to or in place of the above-described effects.

[0166] The present technology may also be configured as follows: (1) An information processing device having: an acquisition unit that acquires a data file including head-related transfer function coefficient data measured in a measurement environment, first vibration transfer function coefficient data related to a floor or a chair measured in the measurement environment, and second vibration transfer function coefficient data related to a vibration presentation device; and a generation unit that generates third vibration transfer function coefficient data of the vibration presentation device in a playback environment based on the second vibration transfer function coefficient data related to the vibration presentation device acquired by the acquisition unit and the first vibration transfer function coefficient data related to the floor or the chair acquired by the acquisition unit. (2) The information processing device according to (1), wherein the first vibration transfer function coefficient data and the second vibration transfer function coefficient data are linked to the head-related transfer function coefficient data. (3) The information processing device according to (1) or (2), wherein the third vibration transfer function coefficient data is obtained by correcting the second vibration transfer function coefficient data based on the first vibration transfer function coefficient data. (4) The information processing device according to any one of (1) to (3), wherein the second vibration transfer function coefficient data is data for an audio signal input to a speaker in the measurement environment. (5) The information processing device according to any one of (1) to (4), further comprising an output unit that outputs the second vibration transfer function coefficient data to the vibration presentation device. (6) The information processing device according to any one of (1) to (5), wherein the data file includes user information of a user of the vibration presentation device, and the generation unit corrects the second vibration transfer function coefficient data by utilizing the user information. (7) The information processing device according to any one of (1) to (5), wherein the data file includes type information indicating a type of the vibration presentation device, and the generation unit corrects the second vibration transfer function coefficient data by utilizing the type information. (8) The information processing device according to any one of (1) to (7), wherein the second vibration transfer function coefficient data includes vibration transfer function coefficient data of a chair seat. (9) The information processing device according to any one of (1) to (8), wherein the second vibration transfer function coefficient data includes vibration transfer function coefficient data of a chair back.(10) The information processing device according to any one of (1) to (9), wherein the first vibration transfer function coefficient data includes airborne vibration transfer function coefficient data in the measurement environment. (11) The information processing device according to (6), wherein the generation unit, when the vibration presentation device is the chair, corrects the second vibration transfer function coefficient data indicating the swaying of the chair in accordance with the weight indicated by the user information. (12) The information processing device according to (7), wherein the generation unit, when the vibration presentation device is the chair, corrects the second vibration transfer function coefficient data indicating the swaying of the chair in accordance with the type information. (13) An information processing method, in which a computer acquires a data file having head-related transfer function coefficient data measured in a measurement environment, first vibration transfer function coefficient data related to a floor or a chair measured in the measurement environment, and second vibration transfer function coefficient data related to a vibration presentation device, and generates third vibration transfer function coefficient data of the vibration presentation device in a reproduction environment based on the acquired second vibration transfer function coefficient data of the vibration presentation device and the acquired first vibration transfer function coefficient data of the floor or the chair. (14) A program for causing a computer to function as: an acquisition unit that acquires a data file having head-related transfer function coefficient data measured in the measurement environment, the first vibration transfer function coefficient data related to the floor or the chair measured in the measurement environment, and second vibration transfer function coefficient data of the vibration presentation device; and a generation unit that generates third vibration transfer function coefficient data of the vibration presentation device in a reproduction environment based on the second vibration transfer function coefficient data of the vibration presentation device acquired by the acquisition unit and the first vibration transfer function coefficient data of the floor or the chair acquired by the acquisition unit.(15) A data structure comprising: an acquisition unit that acquires a data file having head-related transfer function coefficient data measured in a measurement environment; first vibration transfer function coefficient data related to a floor or a chair measured in the measurement environment; and second vibration transfer function coefficient data related to a vibration presentation device; wherein a generation unit that performs a correction process on the vibration transfer function coefficient data of the vibration presentation device generates third vibration transfer function coefficient data of the vibration presentation device in a reproduction environment based on the second vibration transfer function coefficient data and the first vibration transfer function coefficient data related to the floor or the chair.

[0167] 1 Information processing device 11 Playback device 12 Headphones 13, 42 Vibration presentation device 21, 41 User 22 Headphones 23 Chair 24 Speaker 30 Floor 31, 32 Acceleration sensor 51 HRTF coefficient data 52 Vibration transfer function coefficient data of floor and chair 53 Vibration transfer function coefficient data of vibration presentation device 54 User information 55 Shape and type information of floor and chair 61 Multi-channel audio playback software 62 Binaural processing unit 63 Vibration reproduction processing unit 71 Playback processing unit 72 Output control unit 73 HRTF coefficient data acquisition unit 74 Vibration transfer function coefficient data acquisition unit of floor and chair 75 Vibration transfer function coefficient data acquisition unit of vibration presentation device 76 User information etc. acquisition unit 77 Data file DF generation unit 101 Data file acquisition unit 102 Pre-processing unit 103 Correction unit 104 Sensitivity evaluation result improvement processing unit 105 Output unit 111 Coefficient reading unit 112 Audio data acquisition unit 113 Convolution processing unit 114 Playback processing unit 121 External file 122 Initial setting value 123 Parameter switching processing unit 124 Parameter information storage unit DF Data file

Claims

1. An acquisition unit that acquires a data file having head transfer function coefficient data measured in a measurement environment, first vibration transfer function coefficient data regarding a floor or a chair measured in the measurement environment, and second vibration transfer function coefficient data regarding a vibration presentation device; and a generation unit that generates third vibration transfer function coefficient data of the vibration presentation device in a reproduction environment based on the second vibration transfer function coefficient data regarding the vibration presentation device acquired by the acquisition unit and the first vibration transfer function coefficient data regarding the floor or the chair acquired by the acquisition unit. An information processing apparatus.

2. The information processing apparatus according to claim 1, wherein the first vibration transfer function coefficient data and the second vibration transfer function coefficient data are associated with the head transfer function coefficient data.

3. The information processing apparatus according to claim 1, wherein the third vibration transfer function coefficient data is obtained by correcting the second vibration transfer function coefficient data based on the first vibration transfer function coefficient data.

4. The information processing apparatus according to claim 1, wherein the second vibration transfer function coefficient data is data regarding an audio signal input to a speaker in the measurement environment.

5. The information processing apparatus according to claim 1, further comprising an output unit that outputs the second vibration transfer function coefficient data to the vibration presentation device.

6. The data file includes user information of a user of the vibration presentation device, and the generation unit corrects the second vibration transfer function coefficient data using the user information. The information processing apparatus according to claim 1.

7. The data file includes type information indicating the type of the vibration presentation device, and the generation unit corrects the second vibration transfer function coefficient data using the type information. The information processing apparatus according to claim 1.

8. The information processing apparatus according to claim 1, wherein the second vibration transfer function coefficient data includes vibration transfer function coefficient data of a seat surface of a chair.

9. The information processing apparatus according to claim 8, wherein the second vibration transfer function coefficient data includes vibration transfer function coefficient data of a backrest of a chair.

10. The information processing apparatus according to claim 1, wherein the first vibration transfer function coefficient data includes vibration transfer function coefficient data in the air in the measurement environment.

11. The generation unit corrects the second vibration transfer function coefficient data indicating the rocking of the chair according to the weight indicated by the user information when the vibration presentation device is the vibration presentation device of the chair. The information processing apparatus according to claim 6.

12. The generation unit corrects the second vibration transfer function coefficient data indicating the rocking of the chair according to the type information when the vibration presentation device is the vibration presentation device of the chair. The information processing apparatus according to claim 7.

13. An information processing method in which a computer acquires a data file having head transfer function coefficient data measured in a measurement environment, first vibration transfer function coefficient data regarding a floor or a chair measured in the measurement environment, and second vibration transfer function coefficient data regarding a vibration presentation device, and generates third vibration transfer function coefficient data of the vibration presentation device in a reproduction environment based on the acquired second vibration transfer function coefficient data regarding the vibration presentation device and the acquired first vibration transfer function coefficient data regarding the floor or the chair.

14. A program for causing a computer to function as an acquisition unit that acquires a data file having head transfer function coefficient data measured in a measurement environment, first vibration transfer function coefficient data regarding a floor or a chair measured in the measurement environment, and second vibration transfer function coefficient data regarding a vibration presentation device, and a generation unit that generates third vibration transfer function coefficient data of the vibration presentation device in a reproduction environment based on the second vibration transfer function coefficient data regarding the vibration presentation device acquired by the acquisition unit and the first vibration transfer function coefficient data regarding the floor or the chair acquired by the acquisition unit.

15. A data structure having an acquisition unit that acquires a data file having head transfer function coefficient data measured in a measurement environment, first vibration transfer function coefficient data regarding a floor or a chair measured in the measurement environment, and second vibration transfer function coefficient data regarding a vibration presentation device, and a generation unit that performs correction processing on the vibration transfer function coefficient data of the vibration presentation device generates third vibration transfer function coefficient data of the vibration presentation device in a reproduction environment based on the second vibration transfer function coefficient data and the first vibration transfer function coefficient data regarding the floor or the chair.

Images