Information processing device, information processing method, and program
By recording transfer characteristic and sound pressure data, the information processing device ensures consistent sound pressure reproduction through headphones, addressing the discrepancy in HRTF-based sound technologies and facilitating accurate sound editing and production.
Patent Information
- Application Number
- JP2022557619
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Priority Date
- 2021-10-08
- Filing Date
- 2021-10-22
- Publication Date
- 2025-09-09
- Estimated Expiration
- 2041-10-22
AI Technical Summary
Existing 3D sound technologies using Head-Related Transfer Function (HRTF) can accurately localize sound images but fail to reproduce the sound pressure, leading to discrepancies between headphone playback and the original sound pressure in the measurement environment, such as movie theaters.
An information processing device records transfer characteristic data and sound pressure reproduction data to ensure that the sound pressure reproduced through headphones matches that of the measurement environment, using HRTF to localize sound images and adjust headphone volume and voltage to maintain consistent sound pressure.
This approach allows for the reproduction of sound pressure identical to the measurement environment, enabling accurate sound editing and production systems using HRTF without the need for physical presence in the original environment.
Smart Images

Figure 0007736010000002 
Figure 0007736010000003 
Figure 0007736010000004
Abstract
Description
[Technical Field]
[0001] In particular, the present technology relates to an information processing device, an information processing method, and a program that are capable of reproducing the sound pressure of a reproduced sound in a measurement environment. [Background technology]
[0002] There is a 3D sound technology that uses the head-related transfer function (HRTF), which mathematically represents the transfer characteristics of sound from the sound source to the ears.
[0003] By performing calculations using HRTF, it is possible to localize sound images in specific positions and reproduce the sound heard from output devices such as headphones in a three-dimensional manner. The sound heard from the headphones is a reproduction of the sound from the sound source in the HRTF measurement environment. [Prior art documents] [Patent documents]
[0004] [Patent Document 1] Japanese Patent Application Laid-Open No. 2009-260574 Summary of the Invention [Problem to be solved by the invention]
[0005] When HRTF is used, it is possible to guarantee the reproduction of the direction of the sound source, but it is not possible to guarantee the reproduction of the sound pressure. Therefore, when producing sound for movies or music by listening to playback sound using HRTF through headphones, the sound pressure heard through the headphones may differ from the sound pressure of the sound in the HRTF measurement environment.
[0006] The reason for this is that, unlike the sound pressure levels of speakers in studios and movie theaters, there are no standards for the sound pressure levels of headphones, so they are used with the volume set at will.In film sound production, there are standards for the sound pressure levels of headphones.
[0007] By ensuring that the sound pressure reproduced through headphones is the same as that reproduced in the measurement environment, it will be possible to recreate the same acoustic environment as the measurement environment at home, etc., which is expected to lead to the spread of production systems using HRTF.
[0008] The present technology has been made in view of such circumstances, and makes it possible to reproduce the sound pressure of reproduced sound in a measurement environment. [Means for solving the problem]
[0009] An information processing device according to one aspect of the present technology includes an information processing unit that records transfer characteristic data representing the transfer characteristics of sound in a measurement environment in which a speaker is installed, as well as sound pressure reproduction data used to reproduce the sound pressure of the speaker as the sound pressure when the reproduced sound obtained by the reproduction process using the HRTF is output from an output device prepared in the reproduction environment.
[0010] In one aspect of the present technology, together with transfer characteristic data that represents the transfer characteristics of sound in a measurement environment in which a speaker is installed, sound pressure reproduction data that is used to reproduce the sound pressure of the speaker as the sound pressure when the reproduced sound obtained by reproduction processing using HRTF is output from an output device prepared in the reproduction environment is recorded. [Brief explanation of the drawings]
[0011] [Figure 1] 1 is a diagram illustrating an example of the configuration of a sound production system according to an embodiment of the present technology. [Figure 2] FIG. 10 is a diagram showing how the playback sound pressure is reproduced. [Figure 3] FIG. 1 is a diagram showing a measurement flow in a measurement environment. [Figure 4] FIG. 10 is a diagram showing a flow of adjusting the playback sound pressure in the playback environment. [Figure 5] 10 is a flowchart illustrating a measurement process performed by an information processing device. [Figure 6]FIG. 10 is a diagram showing an example of information recorded in an HRTF file. [Figure 7] 6 is a flowchart illustrating the HRTF data generation process performed in step S1 of FIG. 5. [Figure 8] FIG. 2 is a block diagram illustrating an example of a functional configuration of an information processing device. [Figure 9] 10 is a flowchart illustrating a sound pressure reproduction process performed by the sound processing device. [Figure 10] FIG. 10 is a diagram showing an example of display of information related to playback sound pressure. [Figure 11] FIG. 2 is a block diagram illustrating an example of a functional configuration of the sound processing device. [Figure 12] FIG. 2 is a block diagram showing an example of a configuration for voltage measurement. [Figure 13] FIG. 10 is a block diagram showing another example of a configuration related to voltage measurement. [Figure 14] FIG. 10 is a block diagram showing another example of a configuration related to voltage measurement. [Figure 15] FIG. 10 is a block diagram showing another example of a configuration related to voltage measurement. [Figure 16] FIG. 10 is a block diagram showing another example of a configuration related to voltage measurement. [Figure 17] FIG. 10 is a block diagram showing another example of a configuration related to voltage measurement. [Figure 18] FIG. 10 is a block diagram showing another example of a configuration related to voltage measurement. [Figure 19] FIG. 1 is a block diagram illustrating an example of the configuration of a computer. DETAILED DESCRIPTION OF THE INVENTION
[0012] Hereinafter, embodiments of the present technology will be described in the following order. 1. Sound production system configuration 2. Overall workflow for sound production systems 3. Operation and configuration of each device 4. Variations
[0013] <<Audio production system configuration>> FIG. 1 is a diagram showing an example of the configuration of a sound production system according to an embodiment of the present technology.
[0014] The sound production system in Fig. 1 is composed of equipment in the measurement environment and equipment in the playback environment. The sound production system in Fig. 1 is a system used, for example, in producing sound for movies.
[0015] The audio of a movie includes not only the voices of actors, such as lines and narration, but also various other sounds, such as sound effects, environmental sounds, background music, etc. Hereinafter, when it is not necessary to distinguish between the different types of sounds, we will refer to them collectively as audio, but in reality, the audio of a movie also includes types of sounds other than audio.
[0016] As shown on the left side of FIG. 1, the measurement environment is a movie theater, also known as a dubbing stage, used for sound production. The movie theater is equipped with a screen and multiple speakers. The movie theater is also equipped with an information processing device 1 that acquires measurement results of HRTF (Head-Related Transfer Function), which represents the sound transfer characteristics of the measurement environment, and generates information such as an HRTF file. The information processing device 1 is configured, for example, by a PC.
[0017] Typically, in the production environment of movie audio, calibration is performed so that the sound pressure of the reproduced sound output from the speakers is constant, so that viewers can get the same experience no matter which movie theater they are in.
[0018] As shown in the speech bubble in Figure 1, the playback sound pressure of movie audio is set at 85 dBC by standards such as SMPTE. Movie sound producers perform editing and other tasks while keeping in mind that the playback sound pressure should be constant at 85 dBC, the standard sound pressure for movie theaters.
[0019] 1, information is measured to reproduce the same sound pressure as that in the measurement environment during playback in the playback environment. Data representing the measurement results is recorded together with HRTF data, and an HRTF file is generated by the information processing device 1.
[0020] The data representing the measurement results, recorded in the HRTF file together with the HRTF data, serves as sound pressure reproduction data for reproducing the same sound pressure as in the measurement environment during playback using the HRTF. As will be described in detail later, information representing the voltage applied to the headphones is recorded as the sound pressure reproduction data.
[0021] As indicated by the arrow in Fig. 1, an HRTF file containing HRTF data representing the HRTF measurement results and sound pressure reproduction data is provided to a sound processing device 31 provided in the playback environment. The HRTF file may be provided to the sound processing device 31 via a network such as the Internet, or may be provided using a recording medium such as a flash memory.
[0022] The playback environment is an environment located in a place other than a movie theater, such as a studio, the creator's home, etc. The playback environment may be prepared in the same place as the measurement environment.
[0023] The playback environment is provided with an audio processing device 31, which is equipment used to edit the audio of a movie. The audio processing device 31 is also configured, for example, by a PC. As shown in Fig. 2, a producer edits the audio of a movie using headphones 32 in a playback environment such as at home. The headphones 32 are an output device provided in the playback environment.
[0024] 2, audio data constituting the sound of a movie includes object audio and channel audio data. The sound processing device 31 plays back the object audio and channel audio using the HRTF data recorded in the HRTF file.
[0025] By performing playback using the HRTF data, the sound image of the sound output from the speakers in the movie theater used to measure the HRTF is reproduced. The sound of each object heard through headphones 32 is heard as coming from the direction of the respective sound image.
[0026] Furthermore, before editing begins, the sound processing device 31 adjusts the sound pressure using the sound pressure reproduction data recorded in the HRTF file. Object audio and channel audio are played back using the settings after sound pressure adjustment.
[0027] By adjusting the sound pressure using the sound pressure reproduction data, the sound pressure of the sound of each object heard through the headphones 32 becomes the same as the playback sound pressure in the measurement environment. As described above, when measurements are performed with the specified sound pressure set to 85 dBC, the sound pressure of the sound heard through the headphones 32 becomes 85 dBC, as shown in the balloon in FIG.
[0028] In this way, the sound production system in Figure 1 reproduces the direction of the sound source and reproduces the same sound pressure as the playback sound pressure during measurement. The producer can perform editing while listening to sound that comes from the same direction as the sound source in the measurement environment and has the same sound pressure as the playback sound pressure in the measurement environment.
[0029] This allows the producer to edit in the same acoustic environment as a movie theater using headphones 32. Since there is no need to go to a movie theater, the producer can edit at home.
[0030] <<Overall workflow for sound production systems>> The workflow in each of the measurement environment and playback environment will be explained below.
[0031] <Measurement flow in the measurement environment> FIG. 3 is a diagram showing the flow of measurement in the measurement environment.
[0032] Measurements in the measurement environment mainly include HRTF measurement, headphone volume adjustment, and voltage measurement. An HRTF file is generated, as indicated by the tip of arrow #1, based on the HRTF data obtained by the HRTF measurement and the sound pressure reproduction data including voltage information obtained by the voltage measurement.
[0033] HRTF measurement As shown on the left side of FIG. 3, the HRTF is measured, for example, when a listener sits in a predetermined seat in a movie theater and a microphone 21 is attached to the listener's ear.
[0034] The producer of the movie's audio may act as the listener, or a different person may act as the listener. By having the producer act as the listener, it becomes possible to measure an HRTF personalized for that producer. Since HRTFs vary depending on factors such as the shape of the ear, it is preferable to use a personalized HRTF in order to accurately localize the sound image. It is also possible to measure HRTFs using a dummy head.
[0035] In this state, the reproduced sound is output from the speaker 23 in the movie theater, and the HRTF between the speaker 23 and the ear hole position (eardrum position) is measured.
[0036] After the HRTF between the speaker 23 and the ear hole position is measured, the listener puts on the headphones 22 so that they cover the ears to which the microphones 21 are attached. The headphones 22 are an output device prepared in the measurement environment.
[0037] In this state, a reproduced sound is output from the headphones 22, and the HRTF between the headphones 22 and the ear hole position is measured. As the reproduced sound from the headphones 22, the same sound as the reproduced sound output from the speaker 23, for example, is used.
[0038] The HRTF measured in this way between the speaker 23 and the ear hole position, and the HRTF between the headphones 22 and the ear hole position are acquired by the information processing device 1. The information processing device 1 corrects the HRTF between the speaker 23 and the ear hole position based on the HRTF between the headphones 22 and the ear hole position, and generates HRTF data representing the corrected HRTF.
[0039] A movie theater is equipped with multiple speakers, such as an L speaker, an R speaker, and a center speaker. HRTFs between each speaker constituting the speaker 23 and the earhole positions are measured, and HRTFs corresponding to the L speaker, the R speaker, the center speaker, etc. are generated, and HRTF data representing these are generated. Volume adjustments and the like for the headphones 22, which will be described later, are also performed for each speaker constituting the speaker 23.
[0040] HRTF correction is performed, for example, by superimposing the inverse characteristics of the HRTF between the headphones 22 and the ear canal position on the HRTF between the speakers 23 and the ear canal position, i.e., by canceling out the HRTF between the headphones 22 and the ear canal position. This makes it possible to obtain a highly accurate HRTF between the speakers 23 and the ear canal position that takes into account individual differences in the headphones 22. By having the producer of the movie sound himself act as the listener, HRTFs can be measured that are personalized by the producer and that take into account individual differences in the headphones 22.
[0041] -Adjust the headphone volume 3, the volume of the headphones 22 is adjusted so that the sound pressure measured by the microphone 21 when a reproduced sound is output from the speaker 23 is the same as the sound pressure measured by the microphone 21 when the same sound is reproduced using the HRTF and output from the headphones 22. A playback device such as an amplifier is provided between the information processing device 1 and the headphones 22.
[0042] That is, first, a listener with microphone 21 attached to his or her ear is seated in the same seat as when the HRTF was measured, and the sound pressure of the sound output from speaker 23 is measured. Reproduced sounds of specified signals such as pink noise are output in sequence from each speaker constituting speaker 23, and the sound pressure of the reproduced sounds output from each speaker is measured.
[0043] Furthermore, a specified signal is reproduced using the HRTF corresponding to each speaker, and the reproduced sound is output from headphones 22. The sound pressure of the reproduced sound output from headphones 22 is measured by microphone 21, and the volume of headphones 22 is adjusted so that the measured sound pressure becomes the same as the sound pressure of the reproduced sound output from speakers 23.
[0044] Voltage measurement As shown on the right side of FIG. 3, the voltage applied to the headphones 22 is measured when the reproduced sound of the specified signal is output, with the volume of the headphones 22 adjusted using the same settings as those after the volume adjustment.
[0045] For example, the applied voltage measured using the settings after volume adjustment based on the playback sound pressure of the L speaker is the applied voltage to the headphones required to reproduce the same audible sound pressure as the playback sound pressure of the L speaker. The applied voltage is measured using the settings after volume adjustment based on the playback sound pressure of each speaker.
[0046] Sound pressure reproduction data is generated based on the voltage information measured in this way. An HRTF file is also generated by recording the sound pressure reproduction data together with the HRTF data generated by the HRTF measurement.
[0047] <Steps for adjusting sound pressure in the playback environment> FIG. 4 is a diagram showing the flow of sound pressure adjustment in a playback environment.
[0048] Adjusting the playback sound pressure in a playback environment mainly involves measuring the voltage during playback using HRTF data and adjusting the volume based on the sound pressure reproduction data.
[0049] A playback device 33 is connected to an audio processing device 31 prepared in the playback environment, and headphones 32 are connected to a headphone terminal provided on the playback device 33. The headphones 32 are, for example, headphones of the same model number (headphones with the same specifications) manufactured by the same manufacturer as the headphones 22 used in the measurement environment. The headphones 22 that the producer has brought home may be used as the headphones 32.
[0050] For example, the producer operates the playback device 33 while looking at the display 31A connected to the sound processing device 31, and adjusts the playback sound pressure while listening to the sound output from the headphones 32. The playback device 33 is operated by operating the sound processing device 31 or by operating buttons or the like provided on the housing of the playback device 33.
[0051] - Voltage measurement during playback using HRTF data As shown on the left side of Fig. 4, playback is performed using the HRTF data contained in the HRTF file, and the playback sound is output from the headphones 32. The headphones 32 output playback sound of a specified signal, with a sound image localized at a predetermined position by playing back using the HRTF data.
[0052] In addition, the voltage applied to the headphones 32 that output the reproduced sound of the specified signal is measured.
[0053] The sound pressure reproduction data contained in the HRTF file includes information about the reference signal used in the measurement environment when adjusting the volume of the headphones 22. A reproduced sound of the same signal as the reference signal used in the measurement environment is output from the headphones 32, and the applied voltage at that time is monitored.
[0054] -Volume adjustment based on sound pressure reproduction data When the voltage applied to the headphones 32 is measured, for example, the display 31A displays information about the sound pressure calculated based on the voltage applied to the headphones 32 and the voltage represented by the sound pressure reproduction data.
[0055] The producer looks at the display 31A and adjusts the volume of the headphones 32 so that the sound pressure reproduced by the headphones 32 is the same as the specified sound pressure. The voltage applied to the headphones 32 changes in response to the producer's operation, and this changes the sound pressure reproduced by the headphones 32.
[0056] As shown in the balloon, this volume adjustment adjusts the playback sound pressure of the headphones 32 to the specified sound pressure of 85 dBC. In other words, the playback sound pressure in the measurement environment is reproduced in the playback environment.
[0057] After the playback sound pressure has been adjusted in this manner, the same settings are used to edit the audio of the movie.
[0058] In this way, by monitoring the voltage applied to the headphones 32 and adjusting the volume during playback using HRTF data, it is possible to recreate an environment with calibrated playback sound pressure, which is required in the production of movie audio and music.
[0059] <<Operation and configuration of each device>> The operation and configuration of the information processing device 1 provided in the measurement environment and the sound processing device 31 provided in the reproduction environment will be described.
[0060] <Measurement environment> · Operation of information processing device during measurement The measurement process performed by the information processing device 1 in the measurement environment will be described with reference to the flowchart of FIG.
[0061] The measurement process performed by the information processing device 1 is the same as the process described with reference to Fig. 3. Here, the process of all steps in Fig. 5 will be described as being performed by the information processing device 1, but may be performed by other devices prepared in the measurement environment as appropriate.
[0062] In step S1, the information processing device 1 performs an HRTF data generation process. The HRTF data generation process generates HRTF data that is personalized by the producer and that represents an HRTF that takes into account individual differences between the headphones 22. The HRTF data generation process will be described later with reference to the flowchart in FIG.
[0063] In step S2, the information processing device 1 outputs the reproduced sound of the specified signal from the speaker 23. The reproduced sound of the specified signal, such as pink noise, is output in sequence from each speaker constituting the speaker 23.
[0064] In step S3, the information processing device 1 acquires the playback sound pressure of the speaker 23 measured using the microphone 21 provided at the earhole position.
[0065] In step S4, the information processing device 1 reproduces the specified signal using the HRTF and outputs the reproduced sound from the headphones 22.
[0066] In step S5, the information processing device 1 acquires the playback sound pressure of the headphones 22 measured using the microphone 21 provided at the ear hole position.
[0067] In step S6, the information processing device 1 adjusts the volume of the headphones 22 so that the sound pressure is the same as the sound pressure reproduced by the speaker .
[0068] In step S7, the information processing device 1 outputs the reproduced sound of the specified signal from the headphones 22 in the volume-adjusted state.
[0069] In step S8, the information processing device 1 measures the voltage applied to the headphones 22 that output the reproduced sound of the specified signal.
[0070] In step S9, the information processing device 1 generates sound pressure reproduction data including information on the specified signal voltage. The specified signal voltage is a measurement result of the voltage applied to the headphones 22 that outputs the reproduced sound of the specified signal.
[0071] In step S10, the information processing device 1 generates an HRTF file in which the HRTF data and sound pressure reproduction data are recorded.
[0072] FIG. 6 is a diagram showing an example of information recorded in an HRTF file.
[0073] An HRTF file contains HRTF data as well as header data, which contains additional information about the HRTF data. As shown in the speech bubble, the header data contains sound pressure reproduction data and various information required for HRTF playback.
[0074] The sound pressure reproduction data includes information about the measurement location, the headphones used for the measurement, and the device used for the measurement. The sound pressure reproduction data also includes information about the specified sound pressure at the measurement location, the specified signal voltage, and the type and strength of the specified signal.
[0075] The information representing the measurement location is information representing the location of the measurement environment. In the above example, information about the movie theater used as the measurement environment is recorded as information representing the measurement location. For example, a producer who edits the sound of a movie in a playback environment can identify the measurement environment based on the information representing the measurement location and check the placement of speakers installed in the measurement environment.
[0076] The information about the headphones used in the measurement is information about the headphones 22 used in the measurement environment. Identification information such as the manufacturer and model name of the headphones 22, and specification information such as the impedance of the headphones 22 are recorded as information about the headphones used in the measurement. By recording information such as impedance, it becomes possible to determine the voltage change of the headphones 32 based on information such as impedance, even if headphones different from those used in the measurement environment (headphones with a different voltage when set to 0 dB) are used as headphones 32 in the playback environment.
[0077] The information about the devices used in the measurement is information about devices such as the microphone 21, amplifier, and DAC used in the measurement environment.
[0078] The information representing the specified sound pressure at the measurement location represents the reference sound pressure defined as the sound pressure in the measurement environment by standards, etc. In the above example, the information representing the specified sound pressure at the measurement location represents a sound pressure of 85 dBC.
[0079] The information representing the specified signal voltage represents the voltage value of the specified signal voltage. As described above, the measurement result of the voltage applied to the headphones 22 when the sound of the specified signal is output using the settings after volume adjustment is recorded as the specified signal voltage.
[0080] The information indicating the type and strength of the specified signal is information indicating the type and signal strength of the specified signal used in the measurement environment. In the playback environment, the playback sound pressure is adjusted using a specified signal of the same type and signal strength as the specified signal used in the measurement environment. Information such as the frequency of the specified signal may also be included.
[0081] After the sound pressure reproduction data including these pieces of information is recorded in the HRTF file, the processing in FIG. 5 ends.
[0082] Next, the HRTF data generation process performed in step S1 of Fig. 5 will be described with reference to the flowchart of Fig. 7. As described above, HRTF measurements are performed with a listener sitting in a designated seat in a movie theater and with microphones 21 attached to their ears.
[0083] In step S21, the information processing device 1 causes the speaker 23 in the movie theater to output the reproduced sound.
[0084] In step S22, the information processing device 1 measures the HRTF between the speaker 23 and the ear canal position based on the sound collection result by the microphone 21. After the HRTF between the speaker 23 and the ear canal position is measured, the listener puts on the headphones 22 so that they cover the ear to which the microphone 21 is attached.
[0085] In step S23, the information processing device 1 outputs the reproduced sound from the headphones 22 worn by the listener.
[0086] In step S24, the information processing device 1 measures the HRTF between the headphones 22 and the ear hole positions.
[0087] In step S25, the information processing device 1 superimposes the inverse characteristics of the HRTF between the headphones 22 and the ear hole position on the HRTF between the loudspeaker 23 and the ear hole position to generate HRTF data representing the corrected HRTF between the loudspeaker 23 and the ear hole position. Then, the process returns to step S1 in Fig. 5, and the subsequent processes are performed.
[0088] In the above, it has been assumed that HRTFs are measured using the microphone 21, but HRTFs between the speaker 23 and the ear canal position may also be acquired based on an ear image obtained by photographing the listener's ear. In this case, an inference model for HRTF inference that has been generated in advance by machine learning or the like is used. The inference model for HRTF inference is an inference model that takes an ear image as input and outputs an HRTF.
[0089] A simulation may be performed based on the arrangement of the speakers 23, and the HRTF may be acquired.
[0090] Furthermore, in the above description, the measurement of the playback sound pressure of the headphones 22 and the playback sound pressure of the speaker 23 is performed after the measurement of the HRTF, but these measurements may be performed simultaneously with the measurement of the HRTF.
[0091] Configuration of information processing device FIG. 8 is a block diagram showing an example of the functional configuration of the information processing device 1.
[0092] In the information processing device 1, a CPU of a PC constituting the information processing device 1 executes a predetermined program, thereby realizing an information processing unit 101.
[0093] The information processing unit 101 is composed of a playback processing unit 111, an output control unit 112, a playback sound pressure acquisition unit 113, an HRTF acquisition unit 114, an HRTF data generation unit 115, a reference signal voltage acquisition unit 116, a sound pressure reproduction data generation unit 117, and an HRTF file generation unit 118. At least a part of the configuration of the information processing unit 101 may be realized by other equipment such as an amplifier provided in the measurement environment.
[0094] The playback processing unit 111 controls the playback of sounds output from the headphones 22 and the speaker 23. A signal obtained by playing back audio data such as data of a specified signal is supplied to the output control unit 112.
[0095] The output control unit 112 outputs the reproduced sound from the headphones 22 and the speaker 23 based on the signal supplied from the reproduction processing unit 111 .
[0096] Furthermore, the output control unit 112 adjusts the volume of the headphones 22 based on the playback sound pressure of the headphones 22 acquired by the playback sound pressure acquisition unit 113. The volume adjustment of the headphones 22 may be performed automatically by the information processing device 1 or manually by the person performing the measurement.
[0097] 5 are processes performed by the playback processing unit 111 and the output control unit 112. Also, the processes performed by steps S21 and S23 in FIG.
[0098] The reproduction sound pressure acquisition unit 113 acquires the reproduction sound pressure of the headphones 22 and the reproduction sound pressure of the speaker 23 based on the intensity of the signal representing the sound collection result by the microphone 21. Information representing the reproduction sound pressure acquired by the reproduction sound pressure acquisition unit 113 is supplied to the output control unit 112 and used to adjust the volume of the headphones 22. The processes of steps S3 and S5 in FIG. 5 are processes performed by the reproduction sound pressure acquisition unit 113.
[0099] The HRTF acquisition unit 114 acquires the HRTF between the headphones 22 and the ear hole position and the HRTF between the speakers 23 and the ear hole position based on the sound collection results from the microphone 21. Information representing the HRTF acquired by the HRTF acquisition unit 114 is supplied to the HRTF data generation unit 115. The processes of steps S22 and S24 in FIG. 7 are performed by the HRTF acquisition unit 114.
[0100] The HRTF data generation unit 115 corrects the HRTF between the speaker 23 and the ear hole position based on the HRTF acquired by the HRTF acquisition unit 114, and generates HRTF data representing the corrected HRTF. The HRTF data generated by the HRTF data generation unit 115 is supplied to the HRTF file generation unit 118. The processing of step S25 in FIG. 7 is the processing performed by the HRTF data generation unit 115.
[0101] The standard signal voltage acquisition unit 116 acquires the measurement result of the voltage applied to the headphones 22 measured after the volume adjustment. Information representing the measurement result acquired by the standard signal voltage acquisition unit 116 is supplied to the sound pressure reproduction data generation unit 117. The process of step S8 in FIG. 5 is the process performed by the standard signal voltage acquisition unit 116.
[0102] The sound pressure reproduction data generation unit 117 generates sound pressure reproduction data including the various pieces of information described with reference to Fig. 6, based on the information supplied from the specified signal voltage acquisition unit 116. The sound pressure reproduction data generated by the sound pressure reproduction data generation unit 117 is supplied to the HRTF file generation unit 118. The processing of step S9 in Fig. 5 is the processing performed by the sound pressure reproduction data generation unit 117.
[0103] The HRTF file generation unit 118 generates an HRTF file by adding header data including the sound pressure reproduction data supplied from the sound pressure reproduction data generation unit 117 to the HRTF data supplied from the HRTF data generation unit 115. The processing of step S10 in FIG. 5 is the processing performed by the HRTF file generation unit 118.
[0104] <Playback environment side> - Operation of the sound processing device during playback The sound pressure reproduction process performed by the sound processing device 31 in the reproduction environment will be described with reference to the flowchart of FIG.
[0105] The sound pressure reproduction process performed by the sound processing device 31 is the same as the process described with reference to Fig. 4. Here, the process of all steps in Fig. 9 will be described as being performed by the sound processing device 31, but may be performed by other devices provided in the playback environment as appropriate.
[0106] For example, the producer checks the manufacturer and model number of the headphones 22 used in the measurement environment based on the sound pressure reproduction data, prepares headphones 32 with the same specifications, and adjusts the sound pressure before editing.
[0107] In step S51, the sound processing device 31 acquires sound pressure reproduction data from the header data of the HRTF file.
[0108] In step S52, the sound processing device 31 acquires HRTF data from the HRTF file.
[0109] In step S53, the sound processing device 31 identifies the specified signal used in the measurement environment based on the sound pressure reproduction data, and performs a reproduction process on the specified signal that is the same as the specified signal. For example, the reproduction process is performed using a specified signal of the same type and signal strength as the specified signal used in the measurement environment.
[0110] The sound processing device 31 performs binaural processing using the HRTF data to generate a playback signal of a specified signal. Based on the signal obtained by the binaural processing, 2ch mix processing is performed as appropriate, and a playback signal for L and a playback signal for R are supplied to the headphones 32.
[0111] In step S54, the sound processing device 31 outputs the reproduced sound of the specified signal from the headphones 32. The reproduced sound of the specified signal, in which a sound image is localized at a predetermined position by reproducing it using the HRTF data, is output from the headphones 32.
[0112] In step S55 , the sound processing device 31 acquires the measurement result of the voltage applied to the headphones 32 .
[0113] In step S56 , the sound processing device 31 identifies a specified signal voltage based on the sound pressure reproduction data, and calculates the playback sound pressure of the headphones 32 based on the specified signal voltage and the voltage applied to the headphones 32 .
[0114] When the specified sound pressure is 85 dBC, the sound pressure reproduced by the headphones 32 is calculated by the following formula (1).
number
[0115] In step S57, the sound processing device 31 displays information about the playback sound pressure of the headphones 32 on the display 31A and notifies the producer.
[0116] FIG. 10 is a diagram showing an example of display of information related to playback sound pressure.
[0117] 10 is a screen displayed by an application installed in the sound processing device 31. The application installed in the sound processing device 31 reads an HRTF file and displays the screen shown in FIG.
[0118] On the right side of the screen, information about the applied voltage to the headphones 32 is displayed. The item 201 with the name "Headphones" set is a display related to the headphones in use. In the example of Fig. 10, "hpname_1" is displayed as the name of the headphones 32.
[0119] Item 202, named "Required voltage for 85 dBC," displays the voltage required to reproduce the specified sound pressure of 85 dBC. In the example of FIG. 10, "0.836" V is displayed as the required voltage. The value of "0.836" V is displayed based on the specified signal voltage included in the sound pressure reproduction data.
[0120] An item 203 named "Current voltage of HP output volume" displays the current voltage applied to the headphones 32. In the example of FIG. 10, "0.836" V is displayed as the current applied voltage to the headphones 32. The value of "0.836" V is displayed based on the measurement result of the applied voltage to the headphones 32.
[0121] Item 204, which is set with the name "Test Play," indicates a function for outputting the playback sound of a specified signal from headphones 32. In the example of Fig. 10, it indicates that a signal of "1000" Hz is to be played as the specified signal.
[0122] The "Test Play" function is used when measuring voltage. When the PLAY button is pressed, the processes of steps S53 and S54 in Fig. 9 are performed, and the playback sound of the specified signal is output from the headphones 32. Information about the frequency of the specified signal is displayed based on the type of specified signal identified by the sound pressure reproduction data.
[0123] An item 205 named "HP amp volume is aligned at:" displays the playback sound pressure of the headphones 32. In the example of FIG. 10, "85 dBC" is displayed as the playback sound pressure of the headphones 32. The playback sound pressure of "85 dBC" is the playback sound pressure calculated in step S56.
[0124] 10 is a display when the voltage applied to the headphones 32 is the same as the specified signal voltage and a reproduced sound of 85 dBC, which is the specified sound pressure, is output from the headphones 32. For example, if the voltage applied to the headphones 32 is different from the specified signal voltage, a numerical value representing a sound pressure different from the specified sound pressure is displayed in the field for item 205.
[0125] The producer can check how much the playback sound pressure of the headphones 32 deviates from the specified sound pressure by looking at the display of item 205. The producer adjusts the volume of the headphones 32 while checking the playback sound pressure of the headphones 32 displayed in item 205.
[0126] The producer also checks the applied voltage of the headphones 32, which is displayed as item 203, and adjusts the volume of the headphones 32 so that the applied voltage of the headphones 32 is the same as the specified signal voltage, which is displayed as item 202. Volume adjustment based on voltage is performed, for example, when the specifications of the headphones 32, such as their impedance, are the same as those of the headphones 22 used in the measurement environment.
[0127] The volume of the headphones 32 may be automatically adjusted by the sound processing device 31 so that the playback sound pressure of the headphones 32 becomes the same as the specified sound pressure.
[0128] 9, in step S58, the sound processing device 31 adjusts the volume of the headphones 32 to adjust the playback sound pressure. When the playback sound pressure of the headphones 32 reaches 85 dBC, which is the same as the specified sound pressure, the sound pressure reproduction process ends.
[0129] ·Sound processing device configuration FIG. 11 is a block diagram showing an example of the functional configuration of the sound processing device 31.
[0130] In the sound processing device 31, a playback processing unit 301 is realized by the CPU of the PC that constitutes the sound processing device 31 executing a predetermined program.
[0131] The playback processing unit 301 is made up of an HRTF file acquisition unit 311, an HRTF data acquisition unit 312, a sound source data acquisition unit 313, a binaural playback processing unit 314, an acoustic processing unit 315, a sound pressure reproduction data acquisition unit 316, a sound pressure information display unit 317, and a voltage acquisition unit 318. At least a part of the configuration of the playback processing unit 301 may be realized by other equipment provided in the playback environment.
[0132] The HRTF file acquisition unit 311 acquires an HRTF file provided by the information processing device 1. The HRTF file acquired by the HRTF file acquisition unit 311 is supplied to an HRTF data acquisition unit 312 and a sound pressure reproduction data acquisition unit 316.
[0133] The HRTF data acquisition unit 312 acquires HRTF data from the HRTF file. The HRTF data acquired by the HRTF data acquisition unit 312 is supplied to the binaural reproduction processing unit 314. The processing of step S52 in FIG. 9 is the processing performed by the HRTF data acquisition unit 312.
[0134] The sound source data acquisition unit 313 acquires sound source data used when adjusting the playback sound pressure. For example, the type of reference signal used in the measurement environment is identified based on the sound pressure reproduction data supplied from the sound pressure reproduction data acquisition unit 316, and sound source data of the same signal as the identified reference signal is acquired. The sound source data acquired by the binaural reproduction processing unit 314 is supplied to the binaural reproduction processing unit 314.
[0135] The binaural reproduction processing unit 314 performs binaural processing on the sound source data supplied from the sound source data acquisition unit 313 using the HRTF data supplied from the HRTF data acquisition unit 312, and generates a reproduction signal of the specified signal. The reproduction signal of the specified signal generated by the binaural reproduction processing unit 314 is supplied to the acoustic processing unit 315. The processing of step S53 in FIG. 9 is the processing performed by the binaural reproduction processing unit 314.
[0136] The acoustic processing unit 315 performs acoustic processing such as 2ch mix processing, sound quality adjustment (EQ), and gain adjustment on the playback signal supplied from the binaural playback processing unit 314, and outputs the playback signal obtained by performing the acoustic processing. For example, the playback signal for L and the playback signal for R output from the acoustic processing unit 315 are supplied to the headphones 32 via the playback device 33 connected to the acoustic processing device 31. Reproduced sound corresponding to the playback signal is output from the headphones 32. The processing of step S54 in FIG. 9 is the processing performed by the acoustic processing unit 315.
[0137] Furthermore, when gain adjustment is performed in response to an operation by the producer, for example, the sound processing unit 315 outputs information relating to the content of the gain adjustment to the sound pressure information display unit 317. The content of the gain adjustment is reflected in the information presented to the producer as appropriate.
[0138] The sound pressure reproduction data acquisition unit 316 acquires sound pressure reproduction data from the header data of the HRTF file. The sound pressure reproduction data acquired by the sound pressure reproduction data acquisition unit 316 is supplied to the sound source data acquisition unit 313 and the sound pressure information display unit 317. The processing of step S51 in Fig. 9 is the processing performed by the sound pressure reproduction data acquisition unit 316.
[0139] The sound pressure information display unit 317 displays a screen such as that described with reference to FIG. 10 on the display 31A based on the sound pressure reproduction data supplied from the sound pressure reproduction data acquisition unit 316 and the measurement result of the voltage applied to the headphones 32 supplied from the voltage acquisition unit 318.
[0140] That is, the sound pressure information display unit 317 calculates the playback sound pressure of the headphones 32 based on the sound pressure reproduction data and the measurement result of the voltage applied to the headphones 32, and displays information such as the calculated playback sound pressure on the display 31A. The sound pressure information display unit 317 functions as a display processing unit that displays information related to the playback sound pressure of the headphones 32. The processes of steps S56 and S57 in FIG. 9 are performed by the sound pressure information display unit 317.
[0141] The voltage acquisition unit 318 acquires the measurement result of the voltage applied to the headphones 32. Information indicating the measurement result acquired by the voltage acquisition unit 318 is supplied to the sound pressure information display unit 317. The process of step S55 in FIG. 9 is the process performed by the voltage acquisition unit 318.
[0142] <Example of voltage measurement> A specific example of measuring the voltage applied to the headphones 32 will be described.
[0143] First example Fig. 12 is a block diagram showing an example of a configuration related to voltage measurement. Of the configuration shown in Fig. 12, the same components as those explained with reference to Fig. 11 etc. are given the same reference numerals. Duplicate explanations will be omitted as appropriate. The same applies to other examples described later.
[0144] 12 is a configuration in which HRTF data and sound pressure reproduction data are acquired on the side of a sound processing device 31, which is a PC. The reproduction processing unit 301 of the sound processing device 31 has the same configuration as the configuration described with reference to FIG.
[0145] A playback device 33, which is an amplifier, is connected to the sound processing device 31, and a cable on the headphone 32 side is connected to a headphone terminal provided on the playback device 33. The playback signal output from the sound processing unit 315 is supplied to the headphones 32 via the playback device 33.
[0146] The playback device 33 is provided with an output voltage measuring unit 321. The output voltage measuring unit 321 measures the output voltage to the headphones 32 and outputs information indicating the measurement result to the sound processing device 31. The information output from the output voltage measuring unit 321 is acquired by the voltage acquiring unit 318 of the playback processing unit 301.
[0147] In this way, it is possible to have the playback device 33 measure the voltage applied to the headphones 32. By using the playback device 33, it is possible to measure the voltage taking into account the voltage division effect when the headphone 32 cable is plugged in.
[0148] Second example FIG. 13 is a block diagram showing another example of the configuration related to voltage measurement.
[0149] In the configuration shown in FIG. 13, the HRTF data and sound pressure reproduction data are acquired on the sound processing device 31 side, and the voltage applied to the headphones 32 is measured on the headphones 32 side.
[0150] The headphones 32 are provided with an input voltage measuring unit 331. The input voltage measuring unit 331 measures the input voltage to the headphones 32 and outputs information indicating the measurement result to the sound processing device 31. The information output from the input voltage measuring unit 331 is acquired by the voltage acquiring unit 318 of the playback processing unit 301.
[0151] In this way, it is possible for the measurement of the applied voltage of the headphones 32 to be performed at the headphones 32 .
[0152] For example, the headphones 32 are powered by the playback device 33. If the headphones 32 are battery-powered active headphones, the voltage can be measured without an external power supply. If the headphones 32 are wireless headphones, the playback device 33 may not be provided.
[0153] Third example FIG. 14 is a block diagram showing another example of the configuration related to voltage measurement.
[0154] 14 is a configuration in which the HRTF data and sound pressure reproduction data are acquired on the sound processing device 31 side, and the voltage applied to the headphones 32 is measured on the headphones 32 side. In the example of FIG. 14, the reproduction sound pressure is calculated by the headphones 32.
[0155] The headphones 32 are provided with a standard signal voltage information acquisition unit 341, an input voltage measurement unit 342, and a reproduction sound pressure calculation unit 343.
[0156] The standard signal voltage information acquisition unit 341 acquires information on the standard signal voltage included in the sound pressure reproduction data. For example, the sound pressure reproduction data acquired by the sound pressure reproduction data acquisition unit 316 is transmitted from the sound processing device 31 to the headphones 32 and received by the standard signal voltage information acquisition unit 341. The information on the standard signal voltage acquired by the standard signal voltage information acquisition unit 341 is supplied to the reproduction sound pressure calculation unit 343.
[0157] The information on the standard signal voltage may be set by the producer for the headphones 32. In this case, the standard signal voltage information acquisition unit 341 acquires the information on the standard signal voltage set by the producer.
[0158] The input voltage measuring unit 342 measures the input voltage to the headphones 32 and outputs information representing the measurement result to the reproduction sound pressure calculating unit 343 .
[0159] The reproduction sound pressure calculation unit 343 calculates the reproduction sound pressure of the headphones 32 based on the specified signal voltage acquired by the specified signal voltage information acquisition unit 341 and the input voltage measured by the input voltage measurement unit 342, and outputs information representing the calculated reproduction sound pressure to the sound processing device 31. The information output from the reproduction sound pressure calculation unit 343 is supplied to the sound pressure information display unit 317 of the reproduction processing unit 301 and used for screen display.
[0160] In this way, it is possible to have the reproduction sound pressure of the headphones 32 calculated in the headphones 32.
[0161] Fourth Example FIG. 15 is a block diagram showing another example of the configuration related to voltage measurement.
[0162] 15 is a configuration in which the acquisition of HRTF data and sound pressure reproduction data and the measurement of the voltage applied to the headphones 32 are performed on the playback device 33 side. In the example of FIG. 15, the playback sound pressure is also calculated by the playback device 33.
[0163] A playback device 33 having the functions of a D / A converter and an amplifier is connected to the sound processing device 31, and a cable on the headphone 32 side is connected to a headphone terminal provided on the playback device 33. The sound source data output from the sound processing device 31 is supplied to the playback device 33. In addition, a playback signal output from an audio processing unit 315 of the playback device 33 is supplied to the headphones 32.
[0164] The playback device 33 is provided with an HRTF file acquisition unit 311, an HRTF data acquisition unit 312, a binaural playback processing unit 314, an acoustic processing unit 315, and a sound pressure reproduction data acquisition unit 316. The HRTF file acquisition unit 311, the HRTF data acquisition unit 312, the binaural playback processing unit 314, the acoustic processing unit 315, and the sound pressure reproduction data acquisition unit 316 provided in the playback device 33 have the same functions as the HRTF file acquisition unit 311, the HRTF data acquisition unit 312, the binaural playback processing unit 314, the acoustic processing unit 315, and the sound pressure reproduction data acquisition unit 316 provided in the sound processing device 31, respectively.
[0165] The playback device 33 is also provided with an output voltage measurement unit 351 and a playback sound pressure calculation unit 352 .
[0166] The output voltage measuring unit 351 measures the output voltage to the headphones 32 and outputs information representing the measurement result to the reproduction sound pressure calculating unit 352 .
[0167] The reproduction sound pressure calculation unit 352 calculates the reproduction sound pressure of the headphones 32 based on the specified signal voltage represented by the information supplied from the sound pressure reproduction data acquisition unit 316 and the output voltage measured by the output voltage measurement unit 351, and outputs information representing the calculated reproduction sound pressure to the sound processing device 31. The information output from the reproduction sound pressure calculation unit 352 is acquired by the sound pressure information display unit 317 of the reproduction processing unit 301 and is used to display information related to the reproduction sound pressure.
[0168] In this way, the processes of acquiring HRTF data and sound pressure reproduction data, measuring the voltage applied to the headphones 32, and calculating the sound pressure reproduced by the headphones 32 can be performed by the playback device 33.
[0169] Fifth Example FIG. 16 is a block diagram showing another example of the configuration related to voltage measurement.
[0170] 16 is a configuration in which HRTF data and sound pressure reproduction data are acquired on the sound processing device 31 side, and the measurement of the voltage applied to the headphones 32 and the calculation of the reproduced sound pressure are performed on the side of a cable 34 with a microcomputer provided between the playback device 33 and the headphones 32. A playback signal output from the sound processing unit 315 of the sound processing device 31 and subjected to processing such as amplification in the playback device 33 is supplied to the headphones 32 via the cable 34 with a microcomputer.
[0171] In the microcomputer-equipped cable 34, the microcomputer realizes the specified signal voltage information acquisition unit 361, the input voltage measurement unit 362, the reproduced sound pressure calculation unit 363, and the sound pressure information display unit 364. The microcomputer-equipped cable 34 is configured by providing a unit incorporating a microcomputer or the like at a predetermined position on the cable. A display device 365, which is configured by a small LCD or the like, is provided on the surface of the unit incorporating a microcomputer or the like.
[0172] The specified signal voltage information acquisition unit 361, input voltage measurement unit 362, and reproduction sound pressure calculation unit 363 of the microcomputer-equipped cable 34 have functions similar to those of the specified signal voltage information acquisition unit 341, input voltage measurement unit 342, and reproduction sound pressure calculation unit 343 in Figure 14, respectively.
[0173] That is, information on the standard signal voltage included in the sound pressure reproduction data is acquired by a standard signal voltage information acquisition unit 361, and the input voltage to the headphones 32 is measured by an input voltage measurement unit 362. Furthermore, based on the standard signal voltage and the input voltage to the headphones 32, a reproduction sound pressure calculation unit 363 calculates the reproduction sound pressure of the headphones 32. Information representing the reproduction sound pressure calculated by the reproduction sound pressure calculation unit 363 is supplied to a sound pressure information display unit 364.
[0174] The information on the specified signal voltage included in the sound pressure reproduction data may be acquired from the sound processing device 31 or from a memory accessible to the microcomputer. The memory stores the information on the specified signal voltage included in the sound pressure reproduction data.
[0175] The sound pressure information display unit 364 displays information about the playback sound pressure of the headphones 32 calculated by the playback sound pressure calculation unit 363 on the display device 365. The producer checks the display on the display device 365 and adjusts the volume of the headphones 32.
[0176] In this way, it is possible to measure the voltage applied to the headphones 32, calculate the sound pressure reproduced by the headphones 32, and so on in a device different from the headphones 32 and the reproduction device 33.
[0177] Sixth Example FIG. 17 is a block diagram showing another example of the configuration related to voltage measurement.
[0178] 17 is a configuration in which HRTF data and sound pressure reproduction data are acquired on the sound processing device 31 side, and the voltage applied to the headphones 32 is measured using a resistor-equipped circuit 35 provided between the playback device 33 and the headphones 32. For example, a voltage measuring device 36 is connected to the resistor-equipped circuit 35 provided in a jig, and the output voltage of the headphones 32 is measured.
[0179] The voltage measuring device 36 measures the input voltage to the headphones 32 and outputs information indicating the measurement result to the sound processing device 31. The information output from the input voltage measuring unit 331 is acquired by the voltage acquiring unit 318 of the reproduction processing unit 301.
[0180] In this way, by attaching a jig having a resistance equivalent to that of the headphones 32 between the playback device 33 and the headphones 32, it is possible to measure the voltage taking into account the voltage division.
[0181] Seventh Example FIG. 18 is a block diagram showing another example of the configuration related to voltage measurement.
[0182] The configuration shown in Fig. 18 is a configuration in which headphones 32 are not used. A microcomputer-equipped measuring device 37 having a variable resistor 371 is connected to the playback device 33. The configuration of the microcomputer-equipped measuring device 37 is the same as the configuration of the headphones 32 described with reference to Fig. 14, except that the variable resistor 371 is provided.
[0183] The resistance value of the variable resistor 371 is adjusted to be the same as the resistance value provided in the headphones 32 .
[0184] Information on the specified signal voltage included in the sound pressure reproduction data is acquired by a specified signal voltage information acquisition unit 341, and the voltage of a variable resistor 371 simulating headphones 32 is measured by an input voltage measurement unit 342. Furthermore, a reproduction sound pressure is calculated by a reproduction sound pressure calculation unit 343 based on the specified signal voltage and the voltage measured by the input voltage measurement unit 342. Information representing the reproduction sound pressure calculated by the reproduction sound pressure calculation unit 343 is supplied to a sound pressure information display unit 317 of the reproduction processing unit 301 and used for screen display.
[0185] In this way, by using the measuring device 37 with a microcomputer, it is possible to measure the voltage taking into account the voltage division effect in the headphones 32 without connecting the headphones 32 to the playback device 33. Furthermore, even if the impedance (resistance value) of the headphones 32 is low, it is possible to measure the voltage taking into account the voltage division effect when a cable is plugged in.
[0186] In this way, the voltage applied to the headphones 32 that output the reproduced sound of the specified signal can be measured not only by the headphones 32 and the reproduction device 33 but also by using various external devices.
[0187] <<Modifications>> Although overhead headphones are used as the audio output device in the above embodiment, inner-ear headphones (earphones) may also be used. Also, instead of headphones, speakers may be used as the audio output device.
[0188] Although headphones with the same specifications are used in the measurement environment and the playback environment, headphones with different specifications may also be used. For example, even if headphones different from those used in the measurement environment (headphones with a different voltage when set to 0 dB) are used as headphones 32 in the playback environment, the volume is adjusted as described above with reference to the voltage applied to headphones 32.
[0189] Although information representing voltage values actually measured in the measurement environment is recorded as sound pressure reproduction data, information representing average voltage values when headphones with various specifications are used may also be recorded, which also makes it possible to reproduce sound pressure with a certain degree of accuracy.
[0190] Although the sound production system in Figure 1 is used to produce sound for movies, the sound production system in Figure 1 can also be applied to systems used to produce various types of sound, such as systems used to produce music or sound for television programs.
[0191] The sound pressure may be reproduced as described above when the audio is played back on a consumer device, rather than when the audio of the content is produced.
[0192] Example of recording multiple combinations of reference sound pressure and applied voltage in sound pressure reproduction data During measurement in the measurement environment, the volume of the headphones 22 is adjusted so that the playback sound pressure is the same as the playback sound pressure of the speaker 23, using a specified sound pressure such as 85 dBC or 78 dBA used for calibration as a reference, but the volume of the headphones 22 may also be adjusted using a sound pressure different from the specified sound pressure as a reference sound pressure. For example, a sound pressure that is often used during editing, such as -20 dB applied when Dim is set, is set as the reference sound pressure.
[0193] Furthermore, the volume of the headphones 22 may be adjusted using a plurality of reference sound pressures with different sound pressure levels.
[0194] For example, using a certain reference sound pressure as a reference, the volume of the headphones 22 is adjusted so that the playback sound pressure becomes the same as the playback sound pressure of the speaker 23, and the voltage applied to the headphones 22 after the volume adjustment is measured. After measuring the applied voltage, the reference sound pressure is switched, and the volume adjustment of the headphones 22 and the measurement of the applied voltage are repeated.
[0195] This allows multiple combinations of reference sound pressure and applied voltage to be measured. Information representing each combination of reference sound pressure and applied voltage is recorded in the sound pressure reproduction data in addition to information representing a combination of a specified sound pressure and an applied voltage measured using the specified sound pressure. That is, in addition to the information representing the specified sound pressure and the information representing the specified signal voltage (FIG. 6) described above, multiple combinations of information representing the reference sound pressure and information representing the applied voltage are recorded in the sound pressure reproduction data.
[0196] Information representing multiple combinations of reference sound pressure and applied voltage is recorded in the sound pressure reproduction data and provided to the playback environment, making it possible to use it to correct errors that occur when the frequency characteristics of the headphones used in the playback environment change nonlinearly in response to changes in playback sound pressure when adjusting the volume.
[0197] When adjusting the volume in the playback environment, depending on the frequency characteristics of the diaphragm of the headphones used in the playback environment, it may not be possible to reproduce the reference sound pressure even if the volume is adjusted. The error described above refers to the difference between the reference sound pressure that you want to reproduce in the playback environment and the sound pressure of the sound actually output from the headphones (playback sound pressure). By correcting the error that occurs when adjusting the volume in the playback environment based on the relationship between the reference sound pressure and the applied voltage, it is possible to output sound from the headphones at a sound pressure equivalent to the reference sound pressure.
[0198] Computer configuration example The above-described series of processes can be executed by hardware or software. When the series of processes is executed by software, the program constituting the software is installed from a program recording medium into a computer incorporated in dedicated hardware or a general-purpose personal computer.
[0199] 19 is a block diagram showing an example of the hardware configuration of a computer that executes the above-mentioned series of processes by a program. The information processing device 1 and the sound processing device 31 are configured by a PC having the same configuration as that shown in FIG.
[0200] A CPU (Central Processing Unit) 501 , a ROM (Read Only Memory) 502 , and a RAM (Random Access Memory) 503 are interconnected by a bus 504 .
[0201] An input / output interface 505 is further connected to the bus 504. An input unit 506 including a keyboard, a mouse, etc., and an output unit 507 including a display, a speaker, etc. are connected to the input / output interface 505. Also connected to the input / output interface 505 are a storage unit 508 including a hard disk, a nonvolatile memory, etc., a communication unit 509 including a network interface, etc., and a drive 510 that drives removable media 511.
[0202] In the computer configured as above, the CPU 501 loads a program stored in the storage unit 508 into the RAM 503 via the input / output interface 505 and the bus 504 and executes the program, thereby performing the above-described series of processes.
[0203] The program executed by the CPU 501 is installed in the storage unit 508 by being recorded on a removable medium 511, or provided via a wired or wireless transmission medium such as a local area network, the Internet, or digital broadcasting.
[0204] The program executed by the computer may be a program that processes in chronological order according to the order described in this specification, or may be a program that processes in parallel or at the required timing, such as when called.
[0205] In this specification, a system refers to a collection of multiple components (devices, modules (components), etc.), regardless of whether all the components are contained in the same housing. Therefore, multiple devices housed in separate housings and connected via a network, and a single device housed in a single housing with multiple modules, are both systems.
[0206] The effects described in this specification are merely examples and are not limiting, and other effects may also be present.
[0207] The embodiments of the present technology are not limited to the above-described embodiments, and various modifications are possible without departing from the spirit of the present technology.
[0208] For example, this technology can be configured as cloud computing, in which a single function is shared and processed collaboratively by multiple devices via a network.
[0209] Furthermore, each step described in the above flowchart can be executed by one device, or can be shared and executed by multiple devices.
[0210] Furthermore, when one step includes multiple processes, the multiple processes included in that one step can be executed by one device or can be shared and executed by multiple devices.
[0211] <Configuration combination example> The present technology can also be configured as follows.
[0212] (1) The device includes an information processing unit that records transfer characteristic data that indicates the transfer characteristic of sound in a measurement environment in which a speaker is installed, as well as sound pressure reproduction data that is used to reproduce the sound pressure of the speaker as the sound pressure when a reproduced sound obtained by a reproduction process using the transfer characteristic is output from an output device prepared in the reproduction environment. Information processing device. (2) a sound pressure reproduction data generating unit that generates the sound pressure reproduction data including information representing an applied voltage of another output device prepared in the measurement environment, the sound being reproduced by the reproduction process using the transfer characteristics and outputting the reproduced sound at the same sound pressure as the sound pressure of the speaker; The information processing device according to (1) above. (3) The sound pressure reproduction data generating unit generates the sound pressure reproduction data based on a measurement result of an applied voltage of the other output device that outputs a reproduced sound of a specified signal. The information processing device according to (2) above. (4) The sound pressure reproduction data generating unit generates the sound pressure reproduction data based on a measurement result of an applied voltage acquired in a state where the volume of the other output device is adjusted so that the sound pressure of the reproduced sound of the specified signal becomes the same as the sound pressure of the speaker. The information processing device according to (3) above. (5) The sound pressure reproduction data generating unit generates the sound pressure reproduction data further including at least one of information representing a reference sound pressure in the measurement environment, information representing a type of the specified signal, and information relating to the other output devices provided in the measurement environment. The information processing device according to (3) or (4). (6) The audio system further includes a transfer characteristic data generating unit that generates the transfer characteristic data based on a first transfer characteristic measured based on a reproduced sound output from the speaker and a second transfer characteristic measured based on a reproduced sound output from the other output device and obtained by a reproduction process using the first transfer characteristic. The information processing device according to any one of (2) to (5). (7) The transfer characteristic data generating unit corrects the first transfer characteristic by superimposing an inverse characteristic of the second transfer characteristic on the first transfer characteristic, and generates the transfer characteristic data. The information processing device according to (6) above. (8) The information processing device Recording transfer characteristic data representing the transfer characteristics of sound in a measurement environment in which a speaker is installed, along with sound pressure reproduction data used to reproduce the sound pressure of the speaker as the sound pressure when the reproduced sound obtained by a reproduction process using the transfer characteristics is output from an output device prepared in the reproduction environment. Information processing methods. (9) On the computer, Recording transfer characteristic data representing the transfer characteristics of sound in a measurement environment in which a speaker is installed, along with sound pressure reproduction data used to reproduce the sound pressure of the speaker as the sound pressure when the reproduced sound obtained by a reproduction process using the transfer characteristics is output from an output device prepared in the reproduction environment. A program for executing a process. (10) a display processing unit that displays information about the sound pressure of the output device based on sound pressure reproduction data that is recorded together with transfer characteristic data that indicates the transfer characteristic of sound in a measurement environment in which a speaker is installed and that is used to reproduce the sound pressure of the speaker as the sound pressure when a reproduced sound obtained by a reproduction process using the transfer characteristic is output from an output device prepared in the reproduction environment. Sound processing equipment. (11) The display processing unit displays information about the sound pressure of the output device based on the sound pressure reproduction data including information representing an applied voltage of another output device prepared in the measurement environment, which outputs the reproduced sound obtained by the reproduction process using the transfer characteristics at the same sound pressure as the sound pressure of the speaker. The sound processing device according to (10) above. (12) The display processing unit displays information about the sound pressure of the output device based on the sound pressure reproduction data, which further includes at least one of information representing a reference sound pressure in the measurement environment, information representing a type of a specified signal, and information about the other output devices prepared in the measurement environment. The sound processing device according to (11) above. (13) a binaural processing unit that performs binaural processing based on the transfer characteristic data and reproduces the specified signal; a voltage acquisition unit that acquires a measurement result of the applied voltage of the output device that outputs the reproduced sound of the specified signal; The sound processing device according to (12) above, further comprising: (14) The display processing unit displays the sound pressure of the output device calculated based on the measurement result of the applied voltage of the output device and the applied voltage of the other output device represented by information included in the sound pressure reproduction data. The sound processing device according to (13) above. (15) The voltage acquisition unit acquires a measurement result of the applied voltage of the output device measured by an external device or the output device. The sound processing device according to (13) or (14). (16) The sound processing device The information relating to the sound pressure of the output device is displayed based on sound pressure reproduction data recorded together with transfer characteristic data representing the transfer characteristics of sound in a measurement environment in which a speaker is installed, and used to reproduce the sound pressure of the speaker as the sound pressure when a reproduced sound obtained by a reproduction process using the transfer characteristic is output from an output device prepared in the reproduction environment. Acoustic processing methods. (17) On the computer, The information relating to the sound pressure of the output device is displayed based on sound pressure reproduction data recorded together with transfer characteristic data representing the transfer characteristics of sound in a measurement environment in which a speaker is installed, and used to reproduce the sound pressure of the speaker as the sound pressure when a reproduced sound obtained by a reproduction process using the transfer characteristic is output from an output device prepared in the reproduction environment. A program that executes a process. [Explanation of symbols]
[0213] 1 Information processing device, 21 Microphone, 22 Headphones, 23 Speaker, 31 Sound processing device, 32 Headphones, 33 Playback device, 101 Information processing unit, 101, 111 Playback processing unit, 112 Output control unit, 113 Playback sound pressure acquisition unit, 114 HRTF acquisition unit, 115 HRTF data generation unit, 116 Specified signal voltage acquisition unit, 117 Sound pressure reproduction data generation unit, 118 HRTF file generation unit, 301 Playback processing unit, 311 HRTF file acquisition unit, 312 HRTF data acquisition unit, 313 Sound source data acquisition unit, 314 Binaural playback processing unit, 315 Sound processing unit, 316 Sound pressure reproduction data acquisition unit, 317 Sound pressure information display unit, 318 Voltage acquisition unit
Claims
1. The device includes an information processing unit that records HRTF data representing the HRTF of sound in a measurement environment in which a speaker is installed, as well as sound pressure reproduction data that is used to reproduce the sound pressure of the speaker as the sound pressure when a reproduced sound obtained by a reproduction process using the HRTF is output from headphones provided in the reproduction environment. Information processing device.
2. The sound pressure reproduction data generating unit generates the sound pressure reproduction data including information representing an applied voltage of another headphone provided in the measurement environment, which outputs the reproduced sound obtained by the reproduction process using the HRTF at the same sound pressure as the sound pressure of the speaker. The information processing device according to claim 1 .
3. The sound pressure reproduction data generating unit generates the sound pressure reproduction data based on a measurement result of an applied voltage of the other headphones that output a reproduced sound of a specified signal. The information processing device according to claim 2 .
4. The sound pressure reproduction data generating unit generates the sound pressure reproduction data based on a measurement result of an applied voltage acquired in a state where the volume of the other headphones is adjusted so that the sound pressure of the reproduced sound of the specified signal becomes the same as the sound pressure of the speaker. The information processing device according to claim 3 .
5. The sound pressure reproduction data generating unit generates the sound pressure reproduction data further including at least one of information representing a reference sound pressure in the measurement environment, information representing a type of the reference signal, and information relating to the other headphones provided in the measurement environment. The information processing device according to claim 3 .
6. The audio system further includes an HRTF data generator that generates the HRTF data based on a first HRTF measured based on a reproduced sound output from the speaker and a second HRTF measured based on a reproduced sound output from the other headphones, the second HRTF being obtained by a reproduction process using the first HRTF. The information processing device according to claim 2 .
7. The HRTF data generating unit corrects the first HRTF by superimposing the inverse characteristics of the second HRTF on the first HRTF, and generates the HRTF data. The information processing device according to claim 6 .
8. The information processing device Recording HRTF data representing the HRTF of the sound in the measurement environment where the speaker is installed, along with sound pressure reproduction data used to reproduce the sound pressure of the speaker as the sound pressure when the reproduced sound obtained by the reproduction process using the HRTF is output from headphones prepared in the reproduction environment. Information processing methods.
9. On the computer, Recording HRTF data representing the HRTF of the sound in the measurement environment where the speaker is installed, along with sound pressure reproduction data used to reproduce the sound pressure of the speaker as the sound pressure when the reproduced sound obtained by the reproduction process using the HRTF is output from headphones prepared in the reproduction environment. A program for executing a process.
Citation Information
Patent Citations
Sound signal processing device, sound signal processing method and mobile terminal equipped with the sound signal processing device
JP2009260574A