Method for generating target response curve data, system for generating target response curve data, and program

Abstract

The computer (11) plays a test sound from the headphone (13) with respect to each of the frequency bands obtained by dividing the audible range. The computer (11) acquires a sound picked up by a microphone (14) disposed near the tympanic membrane of the subject during this period. The computer (11) determines the amplitude frequency characteristic of the entire audible range from the amplitude values of the discreteness of the sound of each of the plurality of frequency bands thus acquired as a curve A. Also, the computer (11) alternately plays a test sound of a reference frequency band and a test sound of a comparison object frequency band from the headphone (13) with respect to each of the frequency bands obtained by dividing the audible range. During this period, the subject adjusts the sound pressure of the test sound of the comparison object in such a manner that the size of the test sound of the reference and the test sound of the comparison object feel equal. The computer (11) determines the amplitude frequency characteristic of the entire audible range from the increase / decrease amount of the sound pressure of each of the frequency bands shown by the result of the user adjustment as a curve B. The computer (11) generates a target response curve by adding the curve A and the curve B.

Description

Technical Field

[0001] This invention relates to acoustic technology, and more specifically, to target response curves. Background Technology

[0002] The impression that the sound emitted by audio playback devices such as in-ear headphones and over-ear headphones gives to the listener varies depending on the amplitude-frequency characteristics of the sound emitted by these devices. Therefore, manufacturers of audio playback devices seek the amplitude-frequency characteristics, or target response curves, of the sound that will give the listener a good impression.

[0003] For example, a well-known target response curve exists called the Harman Target Response Curve. The Harman Target Response Curve is based on a reference listening room created by Harman Corporation of the Harman Group. According to experiments conducted by Harman, the sound corrected according to the Harman Target Response Curve impressed many listeners compared to, for example, a target response curve corrected according to an anechoic chamber or a target response curve corrected according to a reverberation chamber.

[0004] Patent document 1 is an example of a patent document that discloses the use of a target response curve. In the invention described in Patent Document 1, the audio signal input to the speaker is corrected based on a graphic equalizer so that the sound played conforms to the amplitude-frequency characteristics of a target response curve selected by the listener from a plurality of target response curves.

[0005] Existing technical documents

[0006] Patent documents

[0007] Patent Document 1: Japanese Patent Application Publication No. 2001-224100 Summary of the Invention

[0008] The problem that the invention aims to solve

[0009] In recent years, immersive binaural sound has become popular. Immersive binaural sound refers to the conversion of immersive sound (stereo) that is intended to be played from multi-channel (3 or more channels) speakers arranged in a stereo configuration around the listener, so that the listener can perceive stereo sound when the sound is played from a sound playback device such as headphones or in-ear headphones that plays sound near the listener's left and right outer ear canals.

[0010] For convenience, the sound playback device described in this embodiment, such as over-ear headphones and in-ear headphones that play sound near the left and right ear canals of the listener, and sound playback devices that simulate playing sound near the left and right ear canals of the listener using a speaker array, will be referred to as "ear canal sound playback device".

[0011] The existing target response curve has been tuned to provide a good impression to listeners when applied to two-channel stereo. Therefore, when using existing external auditory cannula sound reproduction devices with amplitude-frequency characteristics that conform to the target response curve to reproduce immersive binaural sound, the following problems exist: the sound image localization direction and distance of the sound source in three-dimensional space, the amplitude, direction, and distance of the three-dimensional space generated by the combination of multiple sound sources (composite sound source), and the sense of sound field expansion caused by reflected sound cannot be reproduced as expected by the original sound source creators.

[0012] In view of the above, the present invention provides a means to reduce the difference between the three-dimensional audio spatial impression desired by the creator of the original immersive sound (stereo) sound source and the three-dimensional audio spatial impression perceived by the listener through immersive binaural sound played from the external auditory cannula.

[0013] Methods for solving problems

[0014] As a first approach, the present invention provides target response curve data, which is composed of amplitude-frequency characteristics corrected for human hearing in order to solve the problem that the spatial impression of the sound source cannot be reproduced when using headphones or in-ear headphones to reproduce immersive binaural sound. The target response curve data sets the acoustic characteristics to eliminate components that help human perception of the recognized sound, while maintaining the timbre recognition characteristics of the human brain.

[0015] Furthermore, as a second approach, the present invention provides a method for generating target response curve data. This target response curve data is composed of amplitude-frequency characteristics that have been corrected to suit human hearing in order to address the problem that the spatial impression of the sound source cannot be reproduced when using headphones or in-ear headphones to reproduce immersive binaural sound. The target response curve data is acoustically set to eliminate components that help human perception of the directionality of the sound being recognized, while maintaining the timbre recognition characteristics of the human brain in recognizing the sound.

[0016] Furthermore, as a third aspect, the present invention provides a sound playback device manufactured with reference to a target response curve. This target response curve is composed of amplitude-frequency characteristics corrected for human hearing in order to solve the problem that the spatial impression of the sound source cannot be reproduced when using headphones or in-ear headphones to reproduce immersive binaural sound. Moreover, the acoustic characteristics of the target response curve are set to eliminate components that help human perception of the directionality of the sound being recognized, while maintaining the timbre recognition characteristics of the human brain in recognizing the sound.

[0017] Furthermore, as a fourth aspect, the present invention provides a sound processing device that corrects the amplitude-frequency characteristics of sound according to a target response curve. This target response curve is composed of amplitude-frequency characteristics corrected to suit human hearing in order to solve the problem that the spatial impression of the sound source cannot be reproduced when using headphones or in-ear headphones to reproduce immersive binaural sound. Moreover, the acoustic characteristics of this target response curve are set to eliminate components that help human perception of the directionality of the sound being recognized, while maintaining the timbre recognition characteristics of the human brain in recognizing the sound.

[0018] Furthermore, as a fifth aspect, the present invention provides a program for causing a computer to perform a process of correcting the amplitude-frequency characteristics of sound in accordance with a target response curve. This target response curve is composed of amplitude-frequency characteristics corrected to suit human hearing in order to solve the problem that the spatial impression of the sound source cannot be reproduced when using headphones or in-ear headphones to reproduce immersive binaural sound. The target response curve sets the acoustic characteristics to eliminate components that help human perception of the directionality of the sound being recognized, while maintaining the timbre recognition characteristics of the human brain in recognizing the sound's timbre.

[0019] Furthermore, as a sixth aspect, the present invention provides a method for generating target response curve data, wherein the acoustic characteristics of the target response curve data are set such that components that contribute to the perception of sound directionality generated by the shape of a person, including at least the head, are removed, while maintaining the timbre recognition characteristics of the brain.

[0020] Furthermore, the target response curve data generation method of the sixth method described above can also adopt the following structure as the seventh method, in which the target response curve data generation method has the following steps: acquiring the acoustic characteristics of sound from the external auditory canal to the tympanic membrane of the test subject; acquiring the sound pressure adjustment characteristics that make the test subject perceive the sound as constant in the entire audible frequency range; and generating target response curve data based on the acoustic characteristics and the sound pressure adjustment characteristics.

[0021] Furthermore, the following structure can also be used as the eighth method in the above-mentioned method for generating the target response curve data in the seventh method. In this structure, the step of obtaining the acoustic characteristics is as follows: generating curve A data representing the amplitude-frequency characteristics of the sound picked up near the eardrum of the test subject during the period when the test sound is played near the external auditory canal of the test subject. The step of obtaining the sound pressure adjustment characteristics is as follows: when the pink noise of the audible full-frequency range is divided into multiple frequency bands and then played sequentially near the external auditory canal of the test subject at a reference sound pressure, the process is as follows: The test subject adjusts the sound pressure of each frequency band outside the reference frequency band in a manner that allows them to perceive a sound level equal to that of the reference frequency band among the plurality of frequency bands. Curve B data is generated, which represents the amplitude-frequency characteristic of the increase or decrease in the sound pressure of each of the plurality of frequency bands determined by the adjustment. The process of generating the target response curve data is as follows: Curve X data is generated, which represents the amplitude-frequency characteristic obtained by adding the amplitude-frequency characteristic shown in the curve A data to the amplitude-frequency characteristic shown in the curve B data, and serves as the target response curve data for the test subject.

[0022] Furthermore, the target response curve data generation method of the above-mentioned eighth method can also adopt the following structure as the ninth method, in which the target response curve data generation method has the following steps: generating curve Y data representing the amplitude-frequency characteristics obtained by averaging the amplitude-frequency characteristics shown by the curve X data generated for multiple test subjects as general target response curve data.

[0023] Furthermore, the following structure can also be used as the 10th method in the above-mentioned method for generating target response curve data in the 7th method. In this structure, the step of obtaining the acoustic characteristics is as follows: For multiple test subjects, curve A data representing the amplitude-frequency characteristics of the sound picked up near the eardrum of the test subject during the period when the test sound is played near the external auditory canal of the test subject is generated respectively; a general curve A data representing the amplitude-frequency characteristics obtained by averaging the amplitude-frequency characteristics shown by the multiple generated curve A data is generated; the step of obtaining the sound pressure adjustment characteristics is as follows: For multiple test subjects, each of the sub-bands obtained by dividing the full audible frequency range pink noise into multiple frequency bands is played sequentially near the external auditory canal of the test subject at a reference sound pressure. In the case of pink noise in the frequency band, the test subject adjusts the sound pressure of each frequency band other than the reference frequency band in a way that allows them to perceive the same sound level as the reference frequency band among the multiple frequency bands. Curve B data representing the amplitude-frequency characteristic of each of the multiple frequency bands determined by the adjustment is generated. A general curve B data representing the amplitude-frequency characteristic obtained by averaging the amplitude-frequency characteristics shown by the multiple generated curve B data is generated. The process of generating the target response curve data is as follows: Curve Y data representing the amplitude-frequency characteristic obtained by adding the amplitude-frequency characteristic shown by the general curve A data and the amplitude-frequency characteristic shown by the general curve B data is generated as the general target response curve data.

[0024] Furthermore, the following structure can also be used as the eleventh method in the above-mentioned method for generating the target response curve data in the seventh method. In this structure, the step of obtaining the acoustic characteristics is as follows: generating curve A data representing the amplitude-frequency characteristics of the sound picked up near the eardrum of the test subject during the period when the test sound is played near the eardrum of the test subject using any external ear canal sound playback device. The step of obtaining the sound pressure adjustment characteristics is as follows: when the external ear canal sound playback device used in the step of generating the curve A data is used near the eardrum of the test subject, or an external ear canal sound playback device of the same type as the external ear canal sound playback device, the pink noise obtained by dividing the full-band audible pink noise into multiple frequency bands is played sequentially at a reference sound pressure. In the case of sound, the test subject adjusts the sound pressure of each frequency band outside the reference frequency band in a way that allows them to perceive a sound level similar to that of the reference frequency band among the plurality of frequency bands. Curve B data is generated, which represents the amplitude-frequency characteristic of the frequency bands determined by the adjustment. The process of generating the target response curve data is as follows: Curve X data is generated, which represents the amplitude-frequency characteristic obtained by adding the amplitude-frequency characteristic shown in the curve A data and the amplitude-frequency characteristic shown in the curve B data. The target response curve data is used for the external auditory cannula sound output device used to generate the curve A data and the curve B data for the test subject, or for an external auditory cannula sound output device of the same type as the external auditory cannula sound output device.

[0025] Furthermore, the target response curve data generation method of the above-mentioned 11th method can also adopt the following structure as the 12th method, in which the target response curve data generation method has the following steps: generating curve Y data representing the amplitude-frequency characteristics obtained by averaging the amplitude-frequency characteristics shown by the curve X data generated for multiple test subjects, and using general target response curve data for the external auditory cannula sound output device used to generate the curve X data or for an external auditory cannula sound output device of the same type as the external auditory cannula sound output device.

[0026] Furthermore, the following structure can also be used as the 13th method in the above-mentioned method for generating target response curve data in the 7th method. In this structure, the step of obtaining the acoustic characteristics is as follows: For multiple test subjects, curve A data representing the amplitude-frequency characteristics of the sound picked up near the eardrum of the test subject during the period when the test sound is played near the eardrum of the test subject using any external ear canal sound playback device is generated. A general curve A data representing the amplitude-frequency characteristics obtained by averaging the amplitude-frequency characteristics shown by the multiple generated curve A data is generated. The step of obtaining the sound pressure adjustment characteristics is as follows: For multiple test subjects, using the external ear canal sound playback device used to generate the curve A data or an external ear canal sound playback device of the same type as the external ear canal sound playback device, each of the various frequency bands obtained by dividing the full audible frequency range pink noise into multiple frequency bands is played sequentially near the eardrum of the test subject at a reference sound pressure. In the case of cross-band pink noise, the test subject adjusts the sound pressure of each frequency band other than the reference frequency band in a way that allows them to perceive the same sound level as the reference frequency band among the multiple frequency bands. Curve B data representing the amplitude-frequency characteristic of each of the multiple frequency bands determined by this adjustment is generated. A general curve B data representing the amplitude-frequency characteristic obtained by averaging the amplitude-frequency characteristics shown by the generated multiple curve B data is also generated. The process of generating the target response curve data is as follows: Curve Y data representing the amplitude-frequency characteristic obtained by adding the amplitude-frequency characteristic shown by the general curve A data to the amplitude-frequency characteristic shown by the general curve B data is generated. The general target response curve data is used for the external auditory cannula sound output device used to generate the curve A data and the curve B data, or for an external auditory cannula sound output device of the same type as the external auditory cannula sound output device.

[0027] Furthermore, the target response curve data generation method of the aforementioned seventh method can also employ the following structure as the fourth method. In this structure, during the step of acquiring the acoustic characteristics, for multiple test subjects, curve A data representing the amplitude-frequency characteristics of the sound picked up near the eardrum of the test subject during the period when the test sound is played near the external auditory canal of the test subject is generated respectively. In the step of acquiring the sound pressure adjustment characteristics, when multiple test subjects are sequentially played with a reference sound pressure near their external auditory canals, each of the sub-band pink noise obtained by dividing the full-range audible pink noise into multiple frequency bands, the test subject can perceive the sound pressure adjustment characteristics. The sound pressure of each frequency band outside the reference frequency band is adjusted in a manner that is the same as the sound pressure of the reference frequency band among the plurality of frequency bands. Curve B data representing the amplitude frequency characteristics shown by the increase or decrease of the sound pressure of each of the plurality of frequency bands determined by the adjustment is generated. The process of generating the target response curve data is as follows: Curve Y data representing the amplitude frequency characteristics obtained by adding the amplitude frequency characteristics shown by the curve A data of each of the plurality of test subjects and the amplitude frequency characteristics shown by the curve B data of each of the plurality of test subjects and averaging them according to the number of the plurality of test subjects is generated as the general target response curve data.

[0028] Furthermore, the following structure can also be used as the 15th method in the above-mentioned method for generating target response curve data in the 7th method. In this structure, in the step of acquiring the acoustic characteristics, for multiple test subjects, curve A data representing the amplitude-frequency characteristics of the sound picked up near the eardrum of the test subject during the period when the test sound is played near the eardrum of the test subject using any external ear canal sound playback device is generated. In the step of acquiring the sound pressure adjustment characteristics, for multiple test subjects, using the external ear canal sound playback device used to generate the curve A data or an external ear canal sound playback device of the same type as the external ear canal sound playback device, and sequentially playing each sub-band pink noise obtained by dividing the full-band audible range pink noise into multiple frequency bands near the eardrum of the test subject at a reference sound pressure, the test subject can perceive The sound pressure of each frequency band outside the reference frequency band is adjusted to the same level as the sound pressure of the reference frequency band among the plurality of frequency bands. Curve B data representing the amplitude-frequency characteristics of the frequency bands determined by the adjustment is generated. The process of generating the target response curve data is as follows: Curve Y data representing the amplitude-frequency characteristics obtained by adding the amplitude-frequency characteristics shown by the curve A data of each of the plurality of test subjects to the amplitude-frequency characteristics shown by the curve B data of each of the plurality of test subjects and averaging them according to the number of the plurality of test subjects is generated. The target response curve data is used for the external auditory cannula sound output device used to generate the curve A data and the curve B data, or for an external auditory cannula sound output device of the same type as the external auditory cannula sound output device.

[0029] Furthermore, the following structure can be used as the 16th method in the method for generating target response curve data in any of the above-mentioned methods 8, 10, 11, 13 to 15, in which the test sound is a sub-band pink noise obtained by dividing the full-band audible pink noise into multiple frequency bands.

[0030] Furthermore, in the method for generating target response curve data in any of the above-mentioned methods 8, 10, 11, 13 to 15, the following structure can be used as method 17, in which the test tone is a pulse.

[0031] Furthermore, in the method for generating target response curve data in any of the above-mentioned methods 8, 10, 11, 13 to 15, the following structure can be used as method 18, in which the test tone is a sweep tone whose frequency changes continuously or intermittently within the audible range.

[0032] Furthermore, in the method for generating target response curve data in any of the above-mentioned methods 8, 10, 11, 13 to 15, the following structure can be used as method 19, in which the reference frequency band is a frequency band centered at 500Hz.

[0033] Furthermore, the following structure can be used as the 20th method in the method for generating target response curve data in any of the above-mentioned methods 8, 10, 11, 13 to 15, in which the reference sound pressure is 65 dB SPL.

[0034] Furthermore, the following structure can be used as the 21st method in the method for generating target response curve data in any of the above-mentioned methods 8, 10, 11, 13 to 15, in which the bandwidth of each of the plurality of frequency bands is 1 / 3 octave.

[0035] Furthermore, as a 22nd aspect, the present invention provides target response curve data, which sets the acoustic characteristics to remove components that contribute to the directionality of sound perception due to the shape of a person, including at least the head, while maintaining the timbre recognition characteristics of the brain.

[0036] Furthermore, as a 23rd aspect, the present invention provides a sound playback device that plays sound with amplitude-frequency characteristics conforming to a target response curve, the target response curve setting the acoustic characteristics to remove components that contribute to the perception of sound directionality due to the shape of a person, including at least the head, while maintaining the brain's timbre recognition characteristics.

[0037] Furthermore, as a 24th aspect, the present invention provides a sound playback device comprising: a sound correction unit that corrects an input sound according to a target response curve that sets acoustic characteristics to remove components that contribute to the perception of sound directionality due to the shape of a person, including at least the head, and to maintain the timbre recognition characteristics of the brain; and a sound playback unit that plays the sound corrected by the sound correction unit.

[0038] Furthermore, the following structure can also be adopted as the 25th method, in which the sound playback device of the aforementioned 23rd or 24th method is any device among headphones, in-ear headphones, headrest speakers, and speaker systems that generate virtual sound sources.

[0039] Furthermore, the sound playback device of the above-described 24th embodiment may also employ the following structure as the 26th embodiment, in which the sound playback device includes: an acquisition unit that acquires target response curve data representing the target response curve; and a storage unit that stores the target response curve data acquired by the acquisition unit, wherein the sound correction unit corrects the input sound according to the target response curve shown by the target response curve data stored in the storage unit.

[0040] Furthermore, as a 27th aspect, the present invention provides a sound processing apparatus having a sound correction unit that corrects the input sound according to a target response curve, the target response curve setting the acoustic characteristics to remove components that contribute to the directionality of sound perception due to the shape of a person, including at least the head, while maintaining the timbre recognition characteristics of the brain.

[0041] Furthermore, the sound processing apparatus of the aforementioned 27th embodiment may also employ the following structure as the 28th embodiment, in which the sound processing apparatus includes: an acquisition unit that acquires target response curve data representing the target response curve; and a storage unit that stores the target response curve data acquired by the acquisition unit, wherein the sound correction unit corrects the input sound according to the target response curve shown by the target response curve data stored in the storage unit.

[0042] Furthermore, as a 29th aspect, the present invention provides a program for causing a computer to perform the following processing: correcting an input sound to conform to a target response curve that sets acoustic characteristics to remove components that contribute to the perception of sound directionality generated by the shape of a person, including at least the head, and to maintain the brain's timbre recognition characteristics.

[0043] Furthermore, as a 30th aspect, the present invention provides a recording medium having a program for causing a computer to perform the following processing: correcting an input sound to conform to a target response curve that sets acoustic characteristics to remove components that contribute to the directionality of sound perception due to the shape of a person, including at least the head, and to maintain the brain's timbre recognition characteristics.

[0044] Furthermore, as a 31st aspect, the present invention provides sound data representing a source sound corrected to conform to a target response curve, the target response curve setting the acoustic characteristics to remove components that contribute to the directionality of sound perception due to the shape of a person, including at least the head, while maintaining the brain's timbre recognition characteristics.

[0045] Furthermore, as a 32nd aspect, the present invention provides a recording medium that records sound data representing sound corrected to conform to a target response curve, wherein the target response curve sets the acoustic characteristics to remove components that contribute to the perception of sound directionality due to the shape of a person, including at least the head, while maintaining the brain's timbre recognition characteristics.

[0046] Furthermore, as a 33rd aspect, the present invention provides an acoustic system comprising: a generation unit that generates stereo audio content representing the location of a sound source and the sound emitted by a sound source for each of a plurality of sound sources; a binaural rendering unit that uses the stereo audio content generated by the generation unit and a head-related transfer function to generate immersive binaural sound as stereo with two channels; and a playback unit that plays the immersive binaural sound generated by the binaural rendering unit, the playback unit playing sound with amplitude-frequency characteristics conforming to a target response curve, the target response curve setting the acoustic characteristics to: remove components that contribute to the directionality of sound perception due to the shape of a person, including at least the head, while maintaining the timbre recognition characteristics of the brain.

[0047] Furthermore, as a 34th aspect, the present invention provides an acoustic system comprising: a generation unit that generates stereo audio content representing the location of a sound source and the sound emitted by a sound source for each of a plurality of sound sources; a binaural rendering unit that uses the stereo audio content generated by the generation unit and a head-related transfer function to generate immersive binaural sound as stereo with two channels; and a playback unit that plays the immersive binaural sound generated by the binaural rendering unit, wherein any one of the generation unit, the binaural rendering unit, and the playback unit corrects the sound to conform to a target response curve that sets the acoustic characteristics to remove components that contribute to the perception of sound due to the shape of a person, including at least the head, while maintaining the timbre recognition characteristics of the brain.

[0048] Furthermore, as a 35th aspect, the present invention provides an acoustic system comprising: a generation unit that generates stereo audio content representing the location of a sound source and the sound emitted by a sound source for each of a plurality of sound sources; a binaural rendering unit that uses the stereo audio content generated by the generation unit and a head-related transfer function to generate immersive binaural sound as stereo sound with two channels; a playback unit that plays the immersive binaural sound generated by the binaural rendering unit; and a sound processing device disposed on the sound transmission path from the generation unit to the playback unit, for correcting the input sound according to a target response curve that sets the acoustic characteristics to remove components that contribute to the directionality of sound perception due to the shape of a person, including at least the head, and to maintain the timbre recognition characteristics of the brain.

[0049] Furthermore, the acoustic system of any one of the above-described methods 33 to 35 can also adopt the following structure as method 36, in which, when the generation unit is set as a stereo audio content generation unit, the acoustic system has: an image generation unit that generates an image in a three-dimensional space with a sense of cross-realism; and a display unit that displays the image generated by the image generation unit, and the binaural rendering unit generates stereo audio content with objects in the three-dimensional space shown by the image generated by the image generation unit as the sound source.

[0050] Furthermore, in any of the acoustic systems described in the 33rd to 35th methods above, the following structure can be used as the 37th method, in which the generating unit continuously acquires the sound source position of the moving sound source and generates stereo audio content representing the sound source position.

[0051] Furthermore, the acoustic system of the aforementioned 37th method can also employ the following structure as the 38th method, in which the sound-emitting unit plays near the listener's external auditory canal, which moves along with the moving sound source.

[0052] Furthermore, as a 39th aspect, the present invention provides a target response curve data generation system comprising: a sound output unit that outputs sound to a sound playback device that plays sound near the external auditory canal of a test subject; a sound acquisition unit that acquires sound picked up by a microphone disposed near the eardrum of the test subject during the period when the sound output unit plays a test sound to the sound playback device; a curve A data generation unit that generates curve A data representing the amplitude-frequency characteristics of the sound acquired by the sound acquisition unit; and a notification unit that, during the period when the sound output unit sequentially outputs pink noise of the audible full-bandwidth spectrum divided into multiple frequency bands at a reference sound pressure level to the sound playback device, the notification unit notifies the test subject to urge the test subject to respond to the reference frequency band among the multiple frequency bands. The system operates the control device to adjust the sound pressure of each frequency band outside the reference frequency band by operating the control device in a manner that is the same as the sound volume; an operation signal acquisition unit acquires an operation signal from the control device corresponding to the operation of the test subject; a curve B data generation unit generates curve B data based on the operation signal acquired by the operation signal acquisition unit, which represents the amplitude-frequency characteristic of the increase or decrease in the sound pressure of each of the multiple frequency bands; and a personal target response curve data generation unit generates curve X data as target response curve data for the test subject, which represents the amplitude-frequency characteristic obtained by adding the amplitude-frequency characteristic of the curve A data generated by the curve A data generation unit to the amplitude-frequency characteristic of the curve B data generated by the curve B data generation unit.

[0053] Furthermore, as a 40th aspect, the present invention provides a system for generating target response curve data, comprising: a sound output unit that outputs sound to a playback device that plays sound near the external auditory canal of a test subject; a sound acquisition unit that acquires sound picked up by a microphone during the period when the sound output unit plays a test sound to the playback device, the microphone being mounted at the end of an extremely fine tube made of a soft raw material and inserted near the eardrum of the test subject; a curve A data generation unit that generates curve A data representing the amplitude-frequency characteristics of the sound acquired by the sound acquisition unit; and a notification unit that, during the period when the sound output unit sequentially outputs pink noise of the audible full-bandwidth spectrum divided into multiple frequency bands at a reference sound pressure to the playback device, the notification unit notifies the test subject to urge them to respond in a way that allows them to perceive the sound. The system includes: an operation device that adjusts the sound pressure of each frequency band outside the reference frequency band by operating the operation device to achieve the same sound pressure level as the reference frequency band; an operation signal acquisition unit that acquires an operation signal from the operation device corresponding to the operation of the test subject; a curve B data generation unit that generates curve B data representing the amplitude-frequency characteristics of the sound pressure increase or decrease of each of the multiple frequency bands based on the operation signal acquired by the operation signal acquisition unit; and a personal target response curve data generation unit that generates curve X data as target response curve data for the test subject, wherein the curve X data represents the amplitude-frequency characteristics obtained by adding the amplitude-frequency characteristics of the curve A data generated by the curve A data generation unit to the amplitude-frequency characteristics of the curve B data generated by the curve B data generation unit.

[0054] Furthermore, the target response curve data generation system of the above-mentioned 39th or 40th method can also adopt the following structure as the 41st method, in which the target response curve data generation system has a general target response curve data generation unit that generates curve Y data as general target response curve data. The curve Y data represents the amplitude frequency characteristics obtained by averaging the amplitude frequency characteristics shown by the target response curve data for each subject generated by the individual target response curve data generation unit for each subject.

[0055] Furthermore, as a 42nd aspect, the present invention provides a system for generating target response curve data, comprising: a sound output unit that outputs sound to a playback device that plays sound near the external auditory canal of a test subject; a sound acquisition unit that acquires sound picked up by a microphone disposed near the eardrum of the test subject during the period when the sound output unit plays a test sound to the playback device; a curve A data generation unit that generates curve A data representing the amplitude-frequency characteristics of the sound acquired by the sound acquisition unit; and a notification unit that, during the period when the sound output unit sequentially outputs pink noise of the audible full-bandwidth spectrum divided into multiple frequency bands at a reference sound pressure to the playback device, the notification unit notifies the test subject to operate the operating device in a manner that allows them to perceive a sound level equal to that of the reference frequency band among the multiple frequency bands. The system includes: an operation signal acquisition unit that acquires an operation signal corresponding to the operation of the test subject from the operation device; a curve B data generation unit that generates curve B data representing the amplitude-frequency characteristics of the increase or decrease in sound pressure of each of the multiple frequency bands based on the operation signal acquired by the operation signal acquisition unit; and a general target response curve data generation unit that generates curve Y data as general target response curve data, which represents the amplitude-frequency characteristics obtained by averaging the amplitude-frequency characteristics shown by the curve A data generated by the curve A data generation unit for each of the multiple test subjects and the amplitude-frequency characteristics obtained by averaging the amplitude-frequency characteristics shown by the curve B data generated by the curve B data generation unit for each of the multiple test subjects.

[0056] Furthermore, as a 43rd aspect, the present invention provides a system for generating target response curve data, comprising: a sound output unit that outputs sound to a playback device that plays sound near the external auditory canal of a test subject; a sound acquisition unit that acquires sound picked up by a microphone during the playback of a test sound by the sound output unit to the playback device, the microphone being mounted at the end of an extremely fine tube made of a soft raw material and inserted near the eardrum of the test subject; a curve A data generation unit that generates curve A data representing the amplitude-frequency characteristics of the sound acquired by the sound acquisition unit; and a notification unit that, during the period when the sound output unit sequentially outputs pink noise of various frequency bands obtained by dividing the full audible frequency band into multiple frequency bands at a reference sound pressure to the playback device, the notification unit notifies the test subject to urge the test subject to use a sound of the same magnitude as the reference frequency band among the multiple frequency bands. The system includes: an operation device that adjusts the sound pressure of frequency bands outside the reference frequency band by operating the operation device according to the volume of the sound; an operation signal acquisition unit that acquires an operation signal corresponding to the operation of the test subject from the operation device; a curve B data generation unit that generates curve B data representing the amplitude-frequency characteristics of the increase or decrease in sound pressure of the multiple frequency bands based on the operation signal acquired by the operation signal acquisition unit; and a general target response curve data generation unit that generates curve Y data as general target response curve data, which represents the amplitude-frequency characteristics obtained by averaging the amplitude-frequency characteristics shown by the curve A data generated by the curve A data generation unit for multiple test subjects and the amplitude-frequency characteristics obtained by averaging the amplitude-frequency characteristics shown by the curve B data generated by the curve B data generation unit for multiple test subjects.

[0057] Furthermore, as a 44th aspect, the present invention provides a target response curve data generation system comprising: a sound output unit that outputs sound to a sound playback device that plays sound near the external auditory canal of a test subject; a sound acquisition unit that acquires sound picked up by a microphone positioned near the eardrum of the test subject during the period when the sound output unit plays a test sound to the sound playback device; a curve A data generation unit that generates curve A data representing the amplitude-frequency characteristics of the sound acquired by the sound acquisition unit; and a notification unit that, during the period when the sound output unit sequentially outputs pink noise of the audible full-bandwidth spectrum divided into multiple frequency bands at a reference sound pressure level to the sound playback device, the notification unit notifies the test subject to operate the operating device in a manner that allows them to perceive a sound level equal to that of the reference frequency band among the multiple frequency bands. The system includes: an operation signal acquisition unit that acquires an operation signal corresponding to the operation of the test subject from the operation device; a curve B data generation unit that generates curve B data representing the amplitude-frequency characteristics of the increase or decrease in sound pressure of each of the multiple frequency bands based on the operation signal acquired by the operation signal acquisition unit; and a general target response curve data generation unit that generates curve Y data as general target response curve data, which represents the amplitude-frequency characteristics obtained by adding the amplitude-frequency characteristics of the curve A data generated by the curve A data generation unit for multiple test subjects and the amplitude-frequency characteristics of the curve B data generated by the curve B data generation unit for multiple test subjects of the same number of test subjects, and then averaging the sum according to the number of test subjects.

[0058] Furthermore, as a 45th aspect, the present invention provides a system for generating target response curve data, comprising: a sound output unit that outputs sound to a playback device that plays sound near the external auditory canal of a test subject; a sound acquisition unit that acquires sound picked up by a microphone during the playback of a test sound by the sound output unit to the playback device, the microphone being mounted at the end of an extremely fine tube made of a soft raw material and inserted near the eardrum of the test subject; a curve A data generation unit that generates curve A data representing the amplitude-frequency characteristics of the sound acquired by the sound acquisition unit; and a notification unit that, during the period during which the sound output unit sequentially outputs pink noise of the audible full-bandwidth spectrum divided into multiple frequency bands at a reference sound pressure to the playback device, the notification unit notifies the test subject to listen to a sound of the same magnitude as the reference frequency band among the multiple frequency bands. The system includes: an operation device that adjusts the sound pressure of frequency bands outside the reference frequency band by operating the device in a large or small manner; an operation signal acquisition unit that acquires an operation signal corresponding to the operation of the test subject from the operation device; a curve B data generation unit that generates curve B data representing the amplitude-frequency characteristics of the sound pressure of the multiple frequency bands based on the operation signal acquired by the operation signal acquisition unit; and a general target response curve data generation unit that generates curve Y data as general target response curve data, which represents the amplitude-frequency characteristics obtained by adding the amplitude-frequency characteristics of the curve A data generated by the curve A data generation unit for multiple test subjects and the amplitude-frequency characteristics of the curve B data generated by the curve B data generation unit for multiple test subjects of the same number of test subjects, and then averaging the sum according to the number of test subjects.

[0059] Furthermore, the following structure can also be used as the 46th method in the target response curve data generation system of any one of the above-mentioned methods 39, 40, 42 to 45, in which the test sound is a frequency-divided pink noise obtained by dividing the full-band audible pink noise into multiple frequency bands.

[0060] Furthermore, the following structure can also be used as the 47th method in the target response curve data generation system of any one of the above-mentioned methods 39, 40, 42 to 45, in which the test tone is a pulse.

[0061] Furthermore, the following structure can also be used as the 48th method in the target response curve data generation system of any one of the above-mentioned methods 39, 40, 42 to 45, in which the test tone is a sweep tone whose frequency changes continuously or intermittently within the audible range.

[0062] Furthermore, the following structure can be used as the 49th method in the target response curve data generation system of any one of the above-mentioned methods 39, 40, 42 to 45, in which the reference frequency band is a frequency band centered at 500Hz.

[0063] Furthermore, the following structure can also be used as the 50th method in the target response curve data generation system of any one of the above-mentioned methods 39, 40, 42 to 45, in which the reference sound pressure is 65 dB SPL.

[0064] Furthermore, the following structure can also be used as the 51st method in the target response curve data generation system of any one of the above-mentioned methods 39, 40, 42 to 45, in which the bandwidth of each of the plurality of frequency bands is 1 / 3 octave.

[0065] Furthermore, as a 52nd aspect, the present invention provides a program for causing a computer to perform the following processes: outputting a test sound to a sound playback device that plays sound near the external auditory canal of a test subject; acquiring sound picked up by a microphone near the eardrum of the test subject during the output of the test sound; generating curve A data representing the amplitude-frequency characteristics of the sound acquired during the acquisition of the sound; sequentially outputting, at a reference sound pressure level, various sub-band pink noises obtained by dividing the full-band audible pink noise into multiple frequency bands to the sound playback device; and, in parallel with the process of outputting the sub-band pink noises, outputting a notification to a notification device that notifies the test subject to urge the test subject to be able to perceive the reference frequency band among the multiple frequency bands. The operation involves adjusting the sound pressure of the pink noise in each frequency band outside the reference frequency band to the same level as the pink noise in the frequency band; acquiring an operation signal corresponding to the operation performed by the test subject on the operation device according to the notification output in the processing of outputting the notification; generating curve B data representing the amplitude-frequency characteristic of the increase or decrease in the sound pressure of each of the multiple frequency bands based on the operation signal acquired in the processing of acquiring the operation signal; and generating curve X data as target response curve data for the test subject, which represents the amplitude-frequency characteristic obtained by adding the amplitude-frequency characteristic shown in curve A data to the amplitude-frequency characteristic shown in curve B data.

[0066] Furthermore, as a 53rd aspect, the present invention provides a program for causing a computer to perform the following processes: outputting a test sound to a sound playback device that plays sound near the external auditory canal of a test subject; acquiring sound picked up by a microphone during the output of the test sound, the microphone being mounted at the end of an extremely fine tube made of a soft raw material inserted near the eardrum of the test subject; generating curve A data representing the amplitude-frequency characteristics of the sound acquired during the acquisition of the sound; sequentially outputting, at a reference sound pressure level, various sub-band pink noises obtained by dividing the full-range audible pink noise into multiple frequency bands to the sound playback device; and, in parallel with the output of the sub-band pink noises, outputting a notification to a notification device that notifies the test subject to urge the test subject to... The system operates by adjusting the sound pressure of the pink noise in each sub-band of a frequency band outside the reference frequency band in a manner that is perceived to be the same as the sound level of the pink noise in the sub-band of the reference frequency band; acquiring an operation signal corresponding to the operation performed by the test subject on the operating device according to the notification output in the processing of outputting the notification; generating curve B data representing the amplitude-frequency characteristic of the increase or decrease in the sound pressure of each of the multiple frequency bands based on the operation signal acquired in the processing of acquiring the operation signal; and generating curve X data as target response curve data for the test subject, wherein curve X data represents the amplitude-frequency characteristic obtained by adding the amplitude-frequency characteristic shown in curve A data to the amplitude-frequency characteristic shown in curve B data.

[0067] Furthermore, the following structure can also be used as the 54th method in the procedure of the 52nd or 53rd method described above, in which the procedure is used to cause the computer to perform the following processing: generating curve Y data as general target response curve data, the curve Y data representing the amplitude frequency characteristics obtained by averaging the amplitude frequency characteristics shown by the curve X data generated for multiple subjects in the process of generating the curve X data respectively.

[0068] Furthermore, as a 55th aspect, the present invention provides a program for causing a computer to perform the following processing: outputting a test tone to a sound playback device that plays sound near the external auditory canal of a test subject; acquiring sound picked up by a microphone near the eardrum of the test subject during the output of the test tone; generating curve A data representing the amplitude-frequency characteristics of the sound acquired during the acquisition of the sound; sequentially outputting, at a reference sound pressure, each sub-band pink noise obtained by dividing the full-range audible pink noise into multiple frequency bands to the sound playback device; and, in parallel with the processing of outputting the sub-band pink noise, outputting a notification to a notification device that notifies the test subject to urge the test subject to a sound at the same volume as the volume of the sub-band pink noise of the reference frequency band among the sub-band pink noise obtained by dividing the full-range audible pink noise into multiple frequency bands. The operating device performs operations to adjust the sound pressure of pink noise in each sub-band of frequency bands outside the reference frequency band; acquires an operation signal corresponding to the operation performed by the test subject on the operating device according to the notification output in the process of outputting the notification; generates curve B data representing the amplitude-frequency characteristics of the increase or decrease in sound pressure in each of the multiple frequency bands based on the operation signal acquired in the process of acquiring the operation signal; and generates curve Y data as general target response curve data, which represents the amplitude-frequency characteristics obtained by averaging the amplitude-frequency characteristics shown in the curve A data generated in the process of generating the curve A data for multiple test subjects and the amplitude-frequency characteristics obtained by averaging the amplitude-frequency characteristics shown in the curve B data generated in the process of generating the curve B data for multiple test subjects.

[0069] Furthermore, as a 56th aspect, the present invention provides a program for causing a computer to perform the following processing: outputting a test sound to a sound playback device that plays sound near the external auditory canal of a test subject; acquiring sound picked up by a microphone during the output of the test sound, the microphone being mounted at the end of an extremely fine tube made of soft raw material inserted near the eardrum of the test subject; generating curve A data representing the amplitude-frequency characteristics of the sound acquired during the sound acquisition process; sequentially outputting, at a reference sound pressure, various sub-band pink noises obtained by dividing the full-range audible pink noise into multiple frequency bands to the sound playback device; and, in parallel with the processing of outputting the sub-band pink noises, outputting a notification to a notification device that notifies the test subject to urge the test subject to perceive the sub-band pink noise that is in the same frequency band as the reference frequency band among the sub-band pink noises obtained by dividing the full-range audible pink noise into multiple frequency bands. The operation involves adjusting the sound pressure of pink noise in each sub-band of a frequency band outside the reference frequency band using the same volume as the sound of the instrument; acquiring an operation signal corresponding to the operation performed by the test subject on the instrument according to the notification output in the process of outputting the notification; generating curve B data representing the amplitude-frequency characteristics of the increase or decrease in sound pressure in each of the multiple frequency bands based on the operation signal acquired in the process of acquiring the operation signal; and generating curve Y data as general target response curve data, which represents the amplitude-frequency characteristics obtained by averaging the amplitude-frequency characteristics shown in the curve A data generated in the process of generating the curve A data for multiple test subjects and adding the amplitude-frequency characteristics obtained by averaging the amplitude-frequency characteristics shown in the curve B data generated in the process of generating the curve B data for multiple test subjects.

[0070] Furthermore, as a 57th aspect, the present invention provides a program for causing a computer to perform the following processes: outputting a test tone to a sound playback device that plays sound near the external auditory canal of a test subject; acquiring sound picked up by a microphone near the eardrum of the test subject during the output of the test tone; generating curve A data representing the amplitude-frequency characteristics of the sound acquired during the acquisition of the sound; sequentially outputting, at a reference sound pressure, each sub-band pink noise obtained by dividing the full-range audible pink noise into multiple frequency bands to the sound playback device; and, in parallel with the process of outputting the sub-band pink noise, outputting a notification to a notification device that notifies the test subject to urge the test subject to operate at a sound level that is the same as the sound level of the sub-band pink noise of the reference frequency band among the sub-band pink noise obtained by dividing the full-range audible pink noise into multiple frequency bands. The device performs operations to adjust the sound pressure of pink noise in each sub-band of frequency bands outside the reference frequency band; acquires an operation signal corresponding to the operation performed by the test subject on the device according to the notification output in the process of outputting the notification; generates curve B data representing the amplitude-frequency characteristics of the increase or decrease in sound pressure in each of the multiple frequency bands based on the operation signal acquired in the process of acquiring the operation signal; and generates curve Y data as general target response curve data, which represents the amplitude-frequency characteristics obtained by adding the amplitude-frequency characteristics of curve A data generated for multiple test subjects in the process of generating curve A data and the amplitude-frequency characteristics of curve B data generated for multiple test subjects in the process of generating curve B data, and then averaging them according to the number of multiple test subjects.

[0071] Furthermore, as a 58th aspect, the present invention provides a program for causing a computer to perform the following processing: outputting a test sound to a sound playback device that plays sound near the external auditory canal of a test subject; acquiring sound picked up by a microphone during the output of the test sound, the microphone being mounted at the end of an extremely fine tube made of soft raw material inserted near the eardrum of the test subject; generating curve A data representing the amplitude-frequency characteristics of the sound acquired during the sound acquisition process; sequentially outputting, at a reference sound pressure, each sub-band pink noise obtained by dividing the full-range audible pink noise into multiple frequency bands to the sound playback device; and, in parallel with the processing of outputting the sub-band pink noise, outputting a notification to a notification device that notifies the test subject to urge the test subject to perceive the sound of the sub-band pink noise that is in relation to the reference frequency band among the sub-band pink noise obtained by dividing the full-range audible pink noise into multiple frequency bands. The operation involves adjusting the sound pressure of pink noise in each sub-band of a frequency band outside the reference frequency band using the same volume of sound; acquiring an operation signal corresponding to the operation performed by the test subject on the operation device according to the notification output in the process of outputting the notification; generating curve B data representing the amplitude-frequency characteristics of the increase or decrease in sound pressure in each of the multiple frequency bands based on the operation signal acquired in the process of acquiring the operation signal; and generating curve Y data as general target response curve data, which represents the amplitude-frequency characteristics obtained by adding the amplitude-frequency characteristics of curve A data generated for multiple test subjects in the process of generating curve A data and the amplitude-frequency characteristics of curve B data generated for multiple test subjects in the process of generating curve B data respectively, and then averaging them according to the number of multiple test subjects.

[0072] Furthermore, the following structure can be used as the 59th method in the procedure of any one of the above methods 52, 53, 55 to 58, in which the test sound is a band-segmented pink noise obtained by dividing the full-band audible pink noise into multiple frequency bands.

[0073] Furthermore, the following structure can be used as the 60th method in any of the above-mentioned methods 52, 53, 55 to 58, in which the test tone is a pulse.

[0074] Furthermore, the following structure can be used as the 61st method in the procedure of any one of the above-mentioned methods 52, 53, 55 to 58, in which the test tone is a sweep tone whose frequency changes continuously or intermittently within the audible range.

[0075] Furthermore, the following structure can be used as the 62nd method in the procedure of any one of the above-mentioned methods 52, 53, 55 to 58, in which the reference frequency band is a frequency band centered at 500Hz.

[0076] Furthermore, the following structure can also be used as the 63rd structure in the procedure of any one of the above-mentioned methods 52, 53, 55 to 58, in which the reference sound pressure is 65 dB SPL.

[0077] Furthermore, the following structure can also be used as the 64th method in the procedure of any one of the above-mentioned methods 52, 53, 55 to 58, in which the bandwidth of each of the plurality of frequency bands is 1 / 3 octave.

[0078] Invention Effects

[0079] When using the external auditory cannula sound emission device with amplitude-frequency characteristics shown in the target response curve data of the present invention to play immersive binaural sound, compared with the case of the external auditory cannula sound emission device of the prior art, the listener can perceive a three-dimensional audio spatial impression that is close to the three-dimensional audio spatial impression desired by the creator of the sound source of the immersive binaural sound. Attached Figure Description

[0080] Figure 1 This is a diagram illustrating the structure of a target response curve data generation system according to one embodiment.

[0081] Figure 2 This is a diagram showing the structure of a data processing apparatus for generating curve A data according to one embodiment.

[0082] Figure 3 This is a diagram illustrating an example of the processing flow performed by a data processing apparatus according to one embodiment to generate curve A data.

[0083] Figure 4 This is a diagram showing the structure of a data processing apparatus for generating curve B data according to one embodiment.

[0084] Figure 5 This is a diagram illustrating an example of the processing flow performed by a data processing apparatus according to one embodiment to generate curve B data.

[0085] Figure 6 This is a diagram illustrating the user interface displayed by a data processing apparatus according to one embodiment.

[0086] Figure 7This is a diagram showing the structure of a data processing apparatus for generating curve X data according to one embodiment.

[0087] Figure 8 This is a diagram illustrating an example of the processing flow performed by a data processing apparatus according to one embodiment to generate curve X data.

[0088] Figure 9 This is a diagram illustrating the structure of a data processing apparatus for generating curve Y data according to one embodiment.

[0089] Figure 10 This is a diagram illustrating an example of the processing flow performed by a data processing apparatus according to one embodiment to generate curve Y data.

[0090] Figure 11 This is a graph showing the target response curve generated by the data processing apparatus according to one embodiment and the target response curve made based on the anechoic chamber.

[0091] Figure 12 This is a diagram illustrating the structure of an acoustic system according to one embodiment.

[0092] Figure 13 This is a diagram showing the structure of a modified audiovisual system. Detailed Implementation

[0093] [Implementation Method]

[0094] The target response curve data of one embodiment of the present invention will be described below.

[0095] The target response curve data generation system 1 is a system for generating target response curve data according to one embodiment of the present invention. The target response curve data generation system 1 includes a computer 11, an audio interface 12 connected to the computer 11, a headset 13 connected to the audio interface 12, and a microphone 14 connected to the audio interface 12.

[0096] The computer 11 includes: a memory that stores various data, including programs; a processor that performs data processing according to the programs stored in the memory; a display that, under the control of the processor, displays information to a user who is a test subject; and an operating device (keyboard, mouse, etc.) that accepts user operations and outputs signals corresponding to those operations to the processor.

[0097] Alternatively, the following structure can be adopted: one or more of the following components—a portion of the memory, a display, and an operating device—are connected as external devices to the main body of the computer 11, which has a processor and at least a portion of the memory. Furthermore, the computer 11 may also have a composite device such as a touchscreen that integrates the display and operating device.

[0098] The audio interface 12 is a device that combines a D / A (Digital to Analog) converter and an A / D (Analog to Digital) converter. The D / A converter converts digital audio data input from the computer 11 into analog audio signals and outputs them to the headphones 13. The A / D converter converts analog audio signals input from the microphone 14 into digital audio data and outputs them to the computer 11.

[0099] The headphones 13 are sound playback devices that play the sound represented by the analog sound signal input from the audio interface 12 near the user's left and right ear canals.

[0100] Microphone 14 is a sound pickup device configured near the left and right eardrums of the user. The sound pickup device picks up sound and outputs an analog sound signal representing the picked-up sound to audio interface 12.

[0101] For example, microphone 14 is a microphone mounted at the end of a very fine tube made of soft raw material that is inserted near the user's left and right eardrums.

[0102] The target response curve data generation system 1 generates curve Y data, which represents a general target response curve referred to as curve Y in this embodiment, that is, a curve used by any listener (the listener is not limited to a specific listener). The generation of this curve Y data is generally carried out through the following steps.

[0103] (1) Generate curve A data

[0104] (2) Generate curve B data

[0105] (3) Generate curve X data

[0106] (4) Generate curve Y data

[0107] Furthermore, the order of either step (1) for generating curve A data or step (2) for generating curve B data is not important. Step (3) for generating curve X data uses the curve A data generated in step (1) and the curve B data generated in step (2), and therefore it is performed after steps (1) and (2). Also, step (4) for generating curve Y data uses the curve X data generated in step (3), and therefore it is performed after step (3).

[0108] (1) Generate curve A data

[0109] The following describes the actions performed by the target response curve data generation system 1 in order to generate curve A data.

[0110] Figure 2 This diagram illustrates the structure of a data processing apparatus (an example of a target response curve data generation system) implemented by a computer 11 when generating curve A data. That is, the computer 11 performs data processing according to a program for generating curve A data, thus acting as a data processing unit with… Figure 2 The device in the structure shown functions.

[0111] The following is about Figure 2 The structural components shown will be explained. Storage unit 110 stores various data. Test tone data is pre-stored in storage unit 110, representing the waveforms of pink noise in each frequency band obtained by dividing the full-range audible pink noise into 1 / 3 octave bands. This test tone data needs to be used consistently for multiple test subjects. The amplitude of the full-range audible pink noise, which forms the basis of the test tone, can be arbitrarily determined within a range where the sound pressure level of the test tone data is not burdensome for the test subject. However, in this embodiment, since the same test tone is used to generate curve A and curve B data, when playing a signal cut from the full-range audible pink noise into 1 / 3 octave bands with a center frequency of 500Hz using headphones, the amplitude needs to be adjusted so that the sound pressure level near the eardrum of the test subject's left or right ear is 65 dB SPL. This 65 dB SPL value is equal to the sound pressure level produced near the eardrum by a band of pink noise with a center frequency of 500 Hz and a bandwidth of 1 / 3 octave band. Hereinafter, these multiple bands of pink noise will be referred to sequentially from the lowest frequency band as band 1, band 2, ..., band n. Furthermore, when the audible range is divided into 1 / 3 octave bands (approximately 10 octaves), the number of multiple bands is approximately 30. This does not place an excessive burden on the test subject in order to generate the curve A data described below, and curve A data of appropriate accuracy can be obtained; therefore, it is preferred. The same applies to the pink noise used to generate the curve B data, as described later.

[0112] The sound output unit 111 outputs sound data representing the test tones used to generate curve A to the audio interface 12. In this embodiment, the test tones used to generate curve A are frequency band pink noise represented by the test tone data stored in the storage unit 110 for each of the n frequency bands from the first frequency band to the nth frequency band. The sound output unit 111 reads the test tone data from the storage unit 110 for each of the n frequency bands, generates sound data representing the test tones (identical sounds on both sides) for the left and right channels, and outputs it to the audio interface 12.

[0113] The sound acquisition unit 112 acquires sound data from the audio interface 12 for each of the n frequency bands, representing the sound of the left and right dual channels picked up by the left and right microphones 14 during the playback of a test sound of that frequency band from the headphones 13. The sound data acquired by the sound acquisition unit 112 is temporarily stored in the storage unit 110.

[0114] The frequency response determination unit 113 determines the amplitude values ​​of the left and right channels of sound data, as shown in the sound acquisition unit 112 and temporarily stored in the storage unit 110, for each of the n frequency bands, and generates frequency band amplitude value data showing the determined amplitude values. The frequency band amplitude value data generated by the frequency response determination unit 113 for each of the n frequency bands is temporarily stored in the storage unit 110.

[0115] The curve A data generation unit 114 interpolates the frequency band amplitude value data (discrete values) temporarily stored in the storage unit 110 for each of the n frequency bands to determine the amplitude-frequency characteristic of the entire audible range. This determined amplitude-frequency characteristic is called curve A. The curve A data generation unit 114 generates curve A data representing curve A. The curve A data generated by the curve A data generation unit 114 is temporarily stored in the storage unit 110. If the curve A data is plotted as a two-dimensional graph with amplitude (dB) on the vertical axis and frequency (Hz) on the horizontal axis, then two curves A (amplitude-frequency characteristics) for each of the left and right channels, i.e., the left and right ears of the test subject, can be displayed.

[0116] Curve A represents the acoustic characteristics of the sound from the subject's external auditory canal to the tympanic membrane, unique to the headphones used in the measurement.

[0117] Figure 3 This diagram illustrates an example of the processing flow performed by a computer 11, which functions as a device with the aforementioned structure, to generate curve A data. Hereinafter, [the following section discusses the process following the principle of conformity]. Figure 3 The process shown will be explained.

[0118] First, the computer 11 substitutes the initial value "1" into the counter i (step S101).

[0119] Next, the computer 11 (sound output unit 111) outputs sound data representing the test tone of the i-th frequency band to the audio interface 12 (step S102). The audio interface 12 outputs the sound signal after D / A conversion of the sound data input from the computer 11 to the headset 13. The headset 13 plays the sound represented by the sound signal input from the audio interface 12.

[0120] The computer 11 (sound acquisition unit 112) acquires sound data representing the sound picked up by the microphone 14 from the audio interface 12 in parallel with the processing in step S102 described above (step S103).

[0121] Next, the computer 11 (frequency band amplitude frequency characteristic determination unit 113) determines the amplitude value of the sound shown by the sound data related to the i-th frequency band obtained in step S103, and generates frequency band amplitude value data representing the determined amplitude value (step S104). The computer 11 (storage unit 110) temporarily stores the frequency band amplitude value data generated in step S104.

[0122] Next, the computer 11 determines whether the counter i is n (step S105).

[0123] If the counter i is not n (step S105; "No"), the computer 11 increments the counter i by "1" (step S106), and repeats steps S102 and S103 and subsequent processing for the new i-th frequency band.

[0124] When counter i is n (step S105; "Yes"), computer 11 (curve A data generation unit 114) interpolates the temporarily stored n frequency band amplitude value data (discrete values) to determine the amplitude frequency characteristic of the entire audible frequency band, i.e., curve A, and generates curve A data representing the determined curve A (step S107). Computer 11 (storage unit 110) temporarily stores the curve A data generated in step S107. Afterward, computer 11 ends the series of processes used to generate curve A data.

[0125] (2) Generate curve B data

[0126] The following describes the actions performed by the target response curve data generation system 1 in order to generate curve B data.

[0127] Figure 4 This diagram illustrates the structure of a data processing apparatus (an example of a target response curve data generation system) implemented by a computer 11 when generating curve B data. That is, the computer 11 performs data processing according to a program for generating curve B data, thus acting as a data processing unit with… Figure 4 The device in the structure shown functions.

[0128] The following is about Figure 4 The structural components shown will be explained. Additionally, in Figure 4 In the middle, to and Figure 2 The common structural part labels shown are as follows: Figure 2 The same labels are used.

[0129] Storage unit 110 stores various data. Storage unit 110 stores test tone data representing the waveforms of pink noise in each of the n 1 / 3 octave bands of bandwidth from the 1st frequency band to the nth frequency band.

[0130] The sound output unit 111 outputs sound data representing the test tone used to generate curve B data to the audio interface 12. In this embodiment, the test tone used to generate curve B data is the same as the test tone used to generate curve A data. That is, the sound output unit 111 reads the test tone data from the storage unit 110 for each of the n frequency bands, generates sound data representing the test tone (the same sound for both left and right channels) for both channels, and outputs it to the audio interface 12.

[0131] The operation signal acquisition unit 115 acquires signals (operation signals) generated by the computer 11's operating devices (keyboard, mouse, etc.) based on the user's operation of the operating devices.

[0132] The frequency band sound pressure increase / decrease determination unit 116 determines the increase / decrease in sound pressure level (dB SPL) of the test tone when adjusting the sound pressure of the test tone of the latter, in a manner that makes the perceived loudness of the test tone (hereinafter referred to as "reference test tone") when the test subject hears the test tone of the reference frequency band, i.e., the k-th frequency band, equal to the perceived loudness of the test tone (hereinafter referred to as "comparison test tone") when the test subject hears test tones (hereinafter referred to as "comparison test tones") from the 1st frequency band to the nth frequency band (excluding the k-th frequency band).

[0133] In this embodiment, the reference frequency band, i.e., the k-th frequency band, is the frequency band centered at 500Hz. Furthermore, the sounds around 500Hz are sounds whose volume (loudness) is easily discernible to many listeners, making it easy to adjust the volume of test tones in other frequency bands to be equal to this reference tone. In this embodiment, the sound pressure level of the reference test tone is 65 dB SPL. Additionally, the sound pressure levels around 65 dB SPL are such that the volume is neither too loud nor too soft for many listeners, making it easy to maintain a consistent volume and less burdensome for the listener.

[0134] The frequency band sound pressure increase / decrease determination unit 116 generates sound pressure increase / decrease data representing the determined increase / decrease in sound pressure for each frequency band from the first frequency band to the nth frequency band (excluding the kth frequency band). The sound pressure increase / decrease data generated by the frequency band sound pressure increase / decrease determination unit 116 is temporarily stored in the storage unit 110.

[0135] The curve B data generation unit 117 interpolates the sound pressure increase / decrease (discrete value) data temporarily stored in the storage unit 110 for each of the n frequency bands (excluding the k-th frequency band) to determine the amplitude-frequency characteristic of the entire audible range. This determined amplitude-frequency characteristic is called curve B. The curve B data generation unit 117 generates curve B data representing curve B. The curve B data generated by the curve B data generation unit 117 is temporarily stored in the storage unit 110.

[0136] Curve B represents the sound pressure adjustment characteristic used to make the test subjects perceive the sound as constant in the entire audible frequency range.

[0137] Figure 5 This diagram illustrates an example of the processing flow performed by a computer 11, which functions as a device with the aforementioned structure, to generate curve B data. Hereinafter, [the following section discusses the process following the principle of conformity]. Figure 5 The process shown will be explained.

[0138] First, computer 11 substitutes the initial value "1" into counter j (step S200). Next, computer 11 substitutes the initial value "1" into counter i (step S201).

[0139] Next, the computer 11 (sound output unit 111) alternately outputs sound data representing the reference test tone and sound data representing the comparison test tone of the i-th frequency band to the audio interface 12 (step S202). The audio interface 12 outputs the sound signal after D / A conversion of the sound data input from the computer 11 to the headset 13. The headset 13 plays the sound shown by the sound signal input from the audio interface 12.

[0140] The computer 11 displays the process in parallel with step S202 on the display (an example of a notification device or notification unit). Figure 6 The user interface shown is shown (step S203).

[0141] Figure 6 (A) is the user interface displayed by the computer 11's monitor during step S202, when sound data representing the reference test tone is output to the audio interface 12. That is, during the playback of the reference test tone from the headphones 13, the computer 11 notifies the user to remember the loudness of the reference test tone.

[0142] Figure 6(B) is the user interface displayed on the monitor of the computer 11 during step S202, when sound data representing the comparison test tone of the i-th frequency band is output to the audio interface 12. That is, while the comparison test tone is played from the headphones 13, the computer 11 prompts the user to operate a virtual control (e.g., a volume controller; hereinafter referred to as "volume controller") in a manner that makes the volume (loudness) of the comparison test tone feel equal to the volume (loudness) of the stored reference test tone, and the computer 11 accepts the user's operation on the volume controller. Based on the operation signal obtained from the operating device (such as a mouse) according to the user's operation on the volume controller, the computer 11 determines the increase or decrease in sound pressure, and increases or decreases the amplitude of the sound data of the comparison test tone output to the audio interface 12 according to the determined increase or decrease in sound pressure. Furthermore, the computer 11 accepts the user's operation on the volume controller. Figure 6 The operation of the virtual "Done" button displayed on the user interface of (B).

[0143] Computer 11 (operation signal acquisition unit 115) acquires signals from the user's operation device (mouse, etc.) when interacting with the device. Figure 6 When the user interface of (B) is operated, the operating device outputs an operation signal. Then, the computer 11 (bandwidth sound pressure increase / decrease determination unit 116) determines that the acquired operation signal is an operation of the "complete" button, and generates sound pressure increase / decrease data indicating the increase / decrease of the sound pressure of the comparison test tone at that moment, as shown by the position of the volume controller. Figure 5 (Step S204). The computer 11 (storage unit 110) temporarily stores the sound pressure increase / decrease data generated in step S204.

[0144] Next, computer 11 determines whether counter i is n ( Figure 5 (Step S205).

[0145] If the counter i is not n (step S205; "No"), the computer 11 increments the counter i by "1" (step S206).

[0146] Next, the computer 11 determines whether the counter i is k (step S207).

[0147] If the counter i is not k (step S207; "No"), the computer 11 repeats steps S202 and S203 and subsequent processing for the new i-th frequency band.

[0148] When the counter i is k (step S207; "Yes"), the computer 11 repeats step S206 and the subsequent processing. That is, by repeating step S206 twice, steps S202 and S203 and the subsequent processing when the counter i is k are skipped (i.e., meaningless processing when the comparison test tone is the reference test tone).

[0149] In step S205, if the counter i is n (step S205; "Yes"), the computer 11 (curve B data generation unit 117) interpolates the increase / decrease of sound pressure (discrete values) shown by the temporarily stored (n-1) sound pressure increase / decrease data to determine the amplitude-frequency characteristic of the entire audible frequency range, i.e., curve B, and generates curve B data representing the determined curve B (step S208). The computer 11 (storage unit 110) temporarily stores the curve B data generated in step S208.

[0150] Next, the computer 11 determines whether the counter j is 2 (step S209). If the counter j is not 2 (step S209; "No"), the computer 11 increments the counter j by 1 (step S210), and then repeats step S201 and the subsequent processing. However, in the second processing step S202, the comparison test sound is played with the sound pressure adjusted by the test subject in the first test, that is, the increase or decrease shown in the sound pressure increase or decrease data corresponding to the temporarily stored i-th frequency band, plus 65 dB SPL.

[0151] That is, the test subject can confirm the results of his / her adjustment in each frequency band, and when it is determined that the magnitude of the reference test tone is different from that of the comparison test tone in each frequency band, in the processing of steps S202 to S204, the amplitude of the sound data of the comparison test tone output to the audio interface 12 is increased or decreased in the same way as in the first time.

[0152] After the second step S208 is completed, the computer 11 determines in step S209 that the counter j is 2 (step S209; "Yes"), and ends the series of processes used to generate curve B data. Thus, the desired curve B data is obtained.

[0153] Furthermore, while steps S202 to S208 are not strictly necessary, they are preferred to improve the accuracy of the test subject's adjustment results. In the example above, the process of gradually changing the comparison test tone from the lowest frequency band to the highest frequency band each time step S202 is repeated is performed twice, but the order in which the comparison test tones are played is not limited to this. For example, the following implementation method is also recommended: From the k-th frequency band, which serves as the reference test tone, to the (k-1)-th frequency band, the (k-2)-th frequency band, ..., the 1st frequency band, while decreasing the frequency, adjust the volume of the comparison test tone in each frequency band to be the same as the reference test tone. Then, from the 1st frequency band to the (k-1)-th frequency band, this time while increasing the frequency, adjust the sound pressure of the comparison test tone in each frequency band. Next, from the (k+1)-th frequency band to the n-th frequency band, while increasing the frequency, adjust the sound pressure of the comparison test tone in each frequency band. Finally, from the n-th frequency band to the (k+1)-th frequency band, while decreasing the frequency, adjust the sound pressure of the comparison test tone in each frequency band, thus ending the series of processes.

[0154] (3) Generate curve X data

[0155] The following describes the actions performed by the target response curve data generation system 1 in order to generate curve X data.

[0156] Figure 7 This diagram illustrates the structure of a data processing apparatus (an example of a target response curve data generation system) implemented by a computer 11 when generating curve X data. That is, the computer 11 performs data processing according to a program for generating curve X data, thus acting as a data processing unit with… Figure 7 The device in the structure shown functions.

[0157] The following is about Figure 7 The structural components shown will be explained. Additionally, in Figure 7 In the middle, to and Figure 2 or Figure 4 The common structural part labels shown are as follows: Figure 2 or Figure 4 The same labels are used.

[0158] Storage unit 110 stores various types of data. Curve A data and curve B data are temporarily stored in storage unit 110.

[0159] The personal target response curve data generation unit 118 reads curve A data and curve B data from the storage unit 110, and generates curve X data, which represents the amplitude-frequency characteristic obtained by adding the amplitude-frequency characteristics shown in curve A data and curve B data. The curve X data generated by the personal target response curve data generation unit 118 is stored in the storage unit 110. The curve X data generated in this way represents the target response curve for the test subject related to the generation of this curve X data.

[0160] Furthermore, the curve X shown in the curve X data generated as described above is most effective when used as a target response curve for an external auditory cannula sound-emitting device of the same type as the one used to generate the curve X data (including the external auditory cannula sound-emitting device itself used to generate the curve X data). However, the curve X shown in the curve X data can also be used as a target response curve for an external auditory cannula sound-emitting device of a different type than the one used to generate the curve X data.

[0161] Figure 8 This diagram illustrates the process performed by the computer 11, which functions as a device with the aforementioned structure, to generate curve X data. Specifically, the computer 11 (personal target response curve data generation unit 118) adds the amplitude-frequency characteristics shown in curve A data to the amplitude-frequency characteristics shown in curve B data to generate curve X data (step S301). The computer 11 (storage unit 110) stores the curve X data generated in step S301. Afterward, the computer 11 terminates the process for generating curve X data.

[0162] Furthermore, in curve X, the absolute values ​​of the amplitude values ​​at each frequency are not significant, but the relative values, i.e., the relative relationships between the amplitude values ​​at each frequency, are meaningful.

[0163] (4) Generate curve Y data

[0164] The following describes the actions performed by the target response curve data generation system 1 in order to generate curve Y data.

[0165] First, the curve Y data is generated using curve X data generated separately for multiple subjects. Therefore, before generating curve Y data, it is necessary to perform the generation of curve A data, curve B data, and curve X data separately for multiple subjects.

[0166] Figure 9This diagram illustrates the structure of a data processing apparatus (an example of a target response curve data generation system) implemented by a computer 11 when generating curve Y data. That is, the computer 11 performs data processing according to a program for generating curve Y data, thus acting as a data processing unit with… Figure 9 The device in the structure shown functions.

[0167] The following is about Figure 9 The structural components shown will be explained. Additionally, in Figure 9 In the middle, to and Figure 2 , Figure 4 or Figure 7 The common structural part labels shown are as follows: Figure 2 , Figure 4 or Figure 7 The same labels are used.

[0168] Storage unit 110 stores various data. Storage unit 110 stores curve X data that are individually correlated with multiple test subjects.

[0169] The general target response curve data generation unit 119 reads multiple curve X data from the storage unit 110 and generates curve Y data representing the amplitude-frequency characteristics obtained by averaging the amplitude-frequency characteristics shown by these curve X data. The curve Y data generated by the general target response curve data generation unit 119 is stored in the storage unit 110. The curve Y data generated in this way represents a general target response curve for any listener.

[0170] Figure 10 This diagram illustrates the process flow of a computer 11, which functions as a device with the aforementioned structure, in generating curve Y data. Specifically, the computer 11 (general target response curve data generation unit 119) averages the amplitude-frequency characteristics shown in the curve X data, which are respectively related to multiple test subjects, to generate curve Y data (step S401). The computer 11 (storage unit 110) stores the curve Y data generated in step S401. Afterward, the computer 11 terminates the process for generating the curve Y data.

[0171] Furthermore, in curve Y, the absolute values ​​of the amplitude values ​​at each frequency are not significant, but the relative values, i.e., the relative relationships between the amplitude values ​​at each frequency, are meaningful.

[0172] Through the processing of the target response curve data generation system 1 described above, curve X data representing the target response curve used by each test subject is generated. Furthermore, through the processing of the target response curve data generation system 1 described above, curve Y data representing the target response curve used by any listener is generated.

[0173] Furthermore, the curve Y shown in the curve Y data generated as described above is most effective when used as a target response curve for an external auditory cannula sound-emitting device of the same type as the external auditory cannula sound-emitting device used to generate the curve X data used in generating the curve Y data (including the external auditory cannula sound-emitting device itself used to generate these curve X data). However, the curve Y shown in the curve Y data can also be used as a target response curve for a different type of external auditory cannula sound-emitting device than the external auditory cannula sound-emitting device used to generate the curve X data used in generating the curve Y data.

[0174] Furthermore, the curve X data generated by the target response curve data generation system 1 described above represents curve X that is separately related to the left and right ears of each subject. However, for many subjects, the curve X that is separately related to the left and right ears is similar. Therefore, the curve X data can also represent curve X that is related to only one of the left and right ears of the subject. Moreover, the curve X data can also represent curve X obtained by averaging the curve X that is separately related to the left and right ears of the subject. However, in the case of subjects whose curve X differs greatly for the left and right ears, it is preferable to use curve X that is separately related to the left and right ears for each ear.

[0175] Furthermore, the curve Y data generated by the aforementioned target response curve data generation system 1 also represents curve Y related to the left and right ears respectively. However, the curve Y obtained by averaging the curve X related to the left ear for many subjects is similar to the curve Y obtained by averaging the curve X related to the right ear for many subjects. Therefore, the curve Y data can also represent curve Y related to only one of the left and right ears. Moreover, the curve Y data can also represent curve Y obtained by averaging the curves Y related to the left and right ears respectively.

[0176] Experiments have confirmed that immersive binaural sound played using headphones or in-ear headphones manufactured with curve Y as a reference has higher reproducibility in terms of spatial impression (sound image localization) and spatial width (or the feeling of being surrounded by sound) compared to immersive binaural sound played using currently popular headphones or in-ear headphones.

[0177] The aforementioned effect is more pronounced with respect to curve Y when the subjects, in relation to the generation of curve X, hear immersive binaural sound played using headphones or in-ear headphones manufactured with reference to curve X.

[0178] The aforementioned curve X or curve Y is a target response curve that sets the acoustic characteristics to remove the components that contribute to the directionality of sound perception generated by the shape of a person, including at least the head, while preserving the brain's timbre recognition characteristics.

[0179] In other words, the external ear canal sound output device with amplitude frequency characteristics of curve X or curve Y plays a sound that eliminates (reduces) only the position information in the position and timbre information of the input stereo while maintaining the timbre information.

[0180] Curve A is the amplitude-frequency characteristic of the headphones or in-ear headphones observed near the eardrum of the test subject while wearing any type of headphones or in-ear headphones. Furthermore, curve B serves to correct the amplitude-frequency characteristic of any type of headphones or in-ear headphones worn, solely for the purpose of enabling the listener to correctly identify the timbre. It is important that curve B contains no information related to the directionality of human sound perception. Therefore, the target response curve data generation system 1 determines a target response curve (curve X or curve Y) by adding these curves A and B, setting the acoustic characteristics to remove components that contribute to the directionality of sound perception due to the shape of the human body, at least including the head, while preserving the brain's timbre recognition characteristics, and generates target response curve data representing this target response curve.

[0181] Figure 11 This is a graph showing curve Y and target response curve T, which is constructed based on the anechoic chamber.

[0182] exist Figure 11 In the target response curve T, the portion enclosed by the ellipse serves to emphasize positional information, thus imparting a sense of stereo sound to two-channel stereo. Immersive binaural sound already contains positional information that contributes to the sense of stereo. Therefore, when an external auditory cannula playing immersive binaural sound follows the amplitude-frequency characteristics of the target response curve T, it emphasizes positional information that would otherwise be unnecessary. As a result, the sound image localization direction and distance in three-dimensional space, the amplitude, direction, and distance in three-dimensional space generated by the combination of multiple sound sources (composite sound sources), and the sense of sound field expansion due to reflected sound, are not reproduced as intended by the original sound source creators. This is a common problem with existing target response curves, such as the Harman target response curve, designed for two-channel stereo listening.

[0183] On the other hand, when an external auditory cannula playing immersive binaural sound follows the amplitude-frequency characteristics of curve Y (or curve X), unlike the above, it does not emphasize the positional information that was not originally needed for the original immersive binaural sound. Furthermore, the timbre information hardly changes due to the amplitude-frequency characteristics derived from the loudness adjustment of the test subject. As a result, the sound image positioning direction and distance perception in three-dimensional space of the sound source, the amplitude perception, direction perception, and distance perception in three-dimensional space generated by the combination of multiple sound sources (composite sound source), and the sense of sound field expansion caused by reflected sound can be reproduced as expected by the creator of the original sound source.

[0184] The above is a description of the target response curve data generation system 1.

[0185] Figure 12 This is a diagram showing the structure of an acoustic system 2 that uses target response curve data (curve X data or curve Y data) generated by a target response curve data generation system 1.

[0186] The acoustic system 2 has a stereo audio content generation device 21, a binaural rendering device 22, a sound reproduction device 23, and a sound playback device 24.

[0187] The stereo audio content generation device 21 (a generation unit, an example of a stereo audio content generation unit) is a device used by producer A to create stereo audio content. Alternatively, the stereo audio content generation device 21 may also be composed of multiple devices (systems) that operate in coordination.

[0188] The stereo audio content data packet representing the stereo audio content generated by the stereo audio content generation device 21 contains sound source position data representing the sound source position of each of the multiple sound sources and sound data representing the sound emitted by the sound source.

[0189] Furthermore, the stereo audio content generation device 21 can generate stereo audio content in any way, such as channel-based, object-based, or combination of these methods.

[0190] The stereo audio content data generated by the stereo audio content generation device 21 is transmitted to the binaural rendering device 22 via the transmission path R1. The transmission path R1 can be any of the following: wired, wireless, communication network, recording medium, or a combination thereof. Furthermore, the stereo audio content generation device 21 and the binaural rendering device 22 can also be configured as a single unit. In this case, the transmission path R1 is constituted by signal lines within the device.

[0191] The binaural rendering device 22 (an example of a binaural rendering unit) is a device that generates immersive binaural sound as stereo sound by using stereo audio content data generated by the stereo audio content generation device 21 and a head-related transfer function. Alternatively, the binaural rendering device 22 may also be composed of multiple devices (systems) that operate in coordination.

[0192] Immersive binaural data, representing the immersive binaural sound generated by the binaural rendering device 22, is transmitted to the sound reproduction device 23 via transmission path R2. Transmission path R2 can be any of the following: wired, wireless, communication network, recording medium, or a combination thereof. Furthermore, the binaural rendering device 22 and the sound reproduction device 23 can also be integrated. In this case, transmission path R2 is constituted by signal lines within the device.

[0193] The sound reproduction device 23 (an example of a sound reproduction unit) is a device that sequentially outputs immersive binaural data generated by the binaural rendering device 22 or immersive binaural signals obtained by D / A conversion of the immersive binaural data to the sound reproduction device 24 at a speed corresponding to the reproduction speed of the immersive binaural data.

[0194] The sound reproduction device 23 outputs sound data or sound signals to the sound playback device 24 via the transmission path R3. The transmission path R3 can be any of the following: wired, wireless, communication network, or a combination thereof.

[0195] The sound playback device 24 is a device that actually plays the sound near the external ear canal of the listener B or simulates it.

[0196] As a sound playback device 24 that actually plays sound near the external ear canal of the listener B, there are headphones, in-ear headphones, headrest speakers, etc. Furthermore, headrest speakers refer to the left and right speakers located on the headrest portion of a seat, or seats equipped with such speakers. Headrest speakers are used in seats of moving vehicles such as automobiles, gaming chairs, etc.

[0197] Furthermore, as a sound playback device 24 that simulates playback near the external ear canal of listener B, there exists a speaker system that uses multiple speakers, such as a speaker array, to generate a virtual sound source near the external ear canal of listener B.

[0198] The playback device 24 sequentially receives immersive binaural data as digital data from the sound reproduction device 23, and plays it back based on the analog signal obtained by performing D / A conversion on the received immersive binaural data. Alternatively, the playback device 24 sequentially receives immersive binaural signals as analog signals from the sound reproduction device 23, and plays it back based on the received immersive binaural signals.

[0199] The X-curve data or Y-curve data generated by the target response curve data generation system 1 can be used in any of the following ways, for example.

[0200] (a) The sound playback device 24 is designed and manufactured according to its physical characteristics to play sound with amplitude-frequency characteristics that conform to the target response curve shown by the curve X data or the curve Y data.

[0201] (b) The playback device 24 has a sound correction unit that corrects the sound data or sound signal received from the sound reproduction device 23 according to the target response curve shown by the X data or Y data, and the playback device 24 plays the sound shown by the sound data or sound signal corrected by the sound correction unit.

[0202] (c) The sound reproduction device 23 has a sound correction unit that corrects the sound data received from the binaural rendering device 22 according to the target response curve shown by the curve X data or the curve Y data. The sound reproduction device 23 outputs the sound data corrected by the sound correction unit or the sound signal obtained by D / A conversion of the sound data corrected by the sound correction unit to the playback device 24.

[0203] (d) The binaural rendering device 22 has a sound correction unit that corrects the sound data contained in the stereo audio content data received from the stereo audio content generation device 21 according to the target response curve shown by the curve X data or the curve Y data. The binaural rendering device 22 transmits the sound data generated by binaural rendering using the sound data corrected by the sound correction unit to the sound reproduction device 23.

[0204] (e) The binaural rendering device 22 has a sound correction unit that corrects the sound data generated by binaural rendering using the sound data contained in the stereo audio content data received from the stereo audio content generation device 21 to conform to the target response curve shown by the curve X data or the curve Y data. The binaural rendering device 22 transmits the sound data corrected by the sound correction unit to the sound reproduction device 23.

[0205] (f) The stereo audio content generation device 21 has a sound correction unit that corrects the sound data generated according to the instructions of the producer A by conforming to the target response curve shown by the curve X data or the curve Y data. The stereo audio content generation device 21 transmits stereo audio content data, including the sound data corrected by the sound correction unit, to the binaural rendering device 22.

[0206] (g) The acoustic system 2 has a sound processing device (in) configured on the transmission path R1, transmission path R2 or transmission path R3. Figure 12(Illustrations omitted) The sound processing device has a sound correction unit that corrects the sound data or sound signal input from the device on the upstream side of the transmission path according to the target response curve shown by the curve X data or curve Y data. The sound processing device outputs the sound data or sound signal corrected by the sound correction unit to the device on the downstream side of the transmission path.

[0207] The sound playback device 24 of the acoustic system 2 plays a sound that allows the listener B to accurately perceive the location of the sound source, thus serving as an acoustic display.

[0208] The above is a description of acoustic system 2.

[0209] [Variation Example]

[0210] The above-described embodiments are one example of the present invention, and various modifications can be made within the scope of the technical concept of the present invention. Examples of their modifications are shown below. Furthermore, two or more of the modifications shown below can be appropriately combined.

[0211] (1) The device in the acoustic system 2 described above that corrects the input sound according to the target response curve shown by the curve X data or curve Y data may also be a computer. In this case, the computer performs the following process according to the program of the present invention: corrects the input sound according to the target response curve shown by the curve X data or curve Y data.

[0212] In one aspect, the present invention provides a program for causing a computer to perform the following process: correcting an input sound to conform to a target response curve shown by curve X data or curve Y data. Furthermore, in another aspect, the present invention provides a recording medium storing a program for causing a computer to perform the following process: correcting an input sound to conform to a target response curve shown by curve X data or curve Y data. Furthermore, in another aspect, the present invention provides a computer comprising: a memory that continuously stores a program for causing the computer to perform the following process, which refers to correcting an input sound to conform to a target response curve shown by curve X data or curve Y data; and a processor that performs data processing according to the program continuously stored in the memory.

[0213] For example, if the stereo audio content generation device 21 is implemented by a computer that operates according to a DAW (Digital Audio Workstation) program, the program for causing the computer to perform correction on the input sound according to the target response curve shown by the curve X data or curve Y data can be provided as plug-in software incorporated into the DAW program.

[0214] (2) The method by which any device in the acoustic system 2 described above corrects the input sound according to the target response curve shown by the curve X data or curve Y data can be any method such as equalizing processing or using finite impulse response (FIR).

[0215] (3) In one aspect, the present invention provides sound data representing a source sound corrected to conform to a target response curve shown by curve X data or curve Y data. Furthermore, in another aspect, the present invention provides a recording medium storing sound data representing a source sound corrected to conform to a target response curve shown by curve X data or curve Y data.

[0216] (4) The acoustic system 2 can also be modified into an audiovisual system, which is configured to have: an image generation device that generates images in a three-dimensional space with cross-realism (virtual reality, augmented reality, mixed reality, alternative reality, etc.); and a display device that displays the images generated by the image generation device, and a binaural rendering device 22 that generates stereo audio content with objects in the three-dimensional space shown by the images generated by the image generation device as sound sources.

[0217] Figure 13 This is a diagram showing the structure of the audiovisual system 3 of this modified example. In addition to the stereo audio content generation device 21, binaural rendering device 22, sound reproduction device 23 and sound playback device 24 possessed by the acoustic system 2, the audiovisual system 3 also has a stereo image content generation device 31, a three-dimensional rendering device 32, an image reproduction device 33 and a display device 34.

[0218] The stereoscopic image content generation device 31 (an example of an image generation unit) is a device that generates stereoscopic image content data representing the position, three-dimensional shape, appearance, etc. of an object (person or object) in a three-dimensional space with a sense of cross-realism.

[0219] The 3D rendering device 32 is a device that performs 3D rendering processing based on the stereoscopic image content data generated by the stereoscopic image content generation device 31, that is, generates a 2D image of a 3D space viewed from the listener's point of view.

[0220] The image reproduction device 33 is a device that sequentially outputs the two-dimensional images generated by the three-dimensional rendering device 32 to the display device 34.

[0221] Display device 34 (an example of a display unit) is a device that displays a two-dimensional image output from image reproduction device 33.

[0222] The stereo audio content generation device 21 generates stereo audio content data that, with respect to the sound source in three-dimensional space, shows the location of the sound source and the sound emitted by the sound source. The stereo image content generation device 31 generates stereo image content data that, with respect to the object in three-dimensional space, shows the location of the object and the object's shape, appearance, etc.

[0223] The three-dimensional coordinates used by the stereoscopic audio content generation device 21 are consistent with those used by the stereoscopic image content generation device 31. Furthermore, the sound source processed by the stereoscopic audio content generation device 21 can be any object among those processed by the stereoscopic image content generation device 31. That is, when an object within the shared three-dimensional space of the stereoscopic audio content generation device 21 and the stereoscopic image content generation device 31 becomes the sound source, the position of that object processed by the stereoscopic image content generation device 31 is consistent with the position of the sound source processed by the stereoscopic audio content generation device 21.

[0224] As described above, the stereo audio content generation device 21 and the stereo image content generation device 31 share the same object (sound source) position information in the same coordinate space. Therefore, the sound played from the playback device 24 is linked to the image displayed on the display device 34. That is, when an object in the three-dimensional space shown in the image emits a sound, the listener B perceives the sound as emanating from the position of the object in that three-dimensional space.

[0225] In the audiovisual system 3, the sound played to listener B conforms to the amplitude-frequency characteristics of the target response curve shown by the X-curve data or the Y-curve data. Therefore, listener B can accurately perceive the location of the sound source in the virtual three-dimensional space.

[0226] The audiovisual system 3 is particularly effective in fields where it is essential to accurately transmit the location of sound sources linked to images to the listener, such as games and telemedicine.

[0227] Alternatively, the display device 34 can also be a wearable device such as a head-mounted display. In this case, data representing the position and orientation of the listener B's head while wearing the head-mounted display (data representing the listener's viewpoint) is transmitted to the binaural rendering device 22 and the 3D rendering device 32 for sound generation by the binaural rendering device 22 and image generation by the 3D rendering device 32. As a result, the listener B is able to see and hear images and sounds that change according to the movement of their head.

[0228] (5) In the acoustic system 2 described above, the stereo audio content generation device 21 may continuously acquire the position of a moving sound source and generate stereo audio content representing the acquired position of the sound source. In this case, the listener B can correctly perceive the changing position of the moving sound source in three-dimensional space.

[0229] In this variation, the sound playback device 24 may play the sound near the outer ear canal of the listener B, who moves along with the moving sound source. For example, if the listener B is a musician wearing the sound playback device 24 as an in-ear monitor, positional data indicating the positions of each musician, including the listener B, and sound data indicating the sounds emitted by each musician's instrument are sent in real time to the stereo audio content generation device 21. The stereo audio content generation device 21 uses this data to generate stereo audio content data. As a result, the listener B can play while perceiving the correct positions of each musician based on the sounds played from the sound playback device 24.

[0230] (6) In the target response curve data generation system 1 described above, the computer 11 (general target response curve data generation unit 119) determines the amplitude-frequency characteristic obtained by averaging the amplitude-frequency characteristics shown by the curve X data, which are respectively related to multiple test subjects, as curve Y. Alternatively, the computer 11 (general target response curve data generation unit 119) determines curve Y by adding the amplitude-frequency characteristic (general curve A) obtained by averaging the amplitude-frequency characteristics shown by the curve A data, which are respectively related to multiple test subjects, and the amplitude-frequency characteristic (general curve B) obtained by averaging the amplitude-frequency characteristics shown by the curve B data, which are respectively related to multiple test subjects. In this case, the test subjects related to the generation of curve A data and the test subjects related to the generation of curve B data can be the same or different.

[0231] Alternatively, the computer 11 (general target response curve data generation unit 119) may determine curve Y as the amplitude-frequency characteristic obtained by adding the amplitude-frequency characteristics shown by curve A data associated with each of the multiple test subjects and the amplitude-frequency characteristics shown by curve A data associated with each of the multiple test subjects in equal numbers, and then averaging the sum according to the number of the multiple test subjects. In this case, the test subjects associated with the generation of curve A data and the test subjects associated with the generation of curve B data may be the same or different. Furthermore, according to this variation, in order to determine curve Y, curve X associated with each test subject, general curve A, and general curve B are not determined.

[0232] (7) Alternatively, the device in the acoustic system 2 described above that corrects the input sound according to the target response curve shown by the curve X data or curve Y data may include: an acquisition unit that acquires the curve X data or curve Y data; and a storage unit that stores the curve X data or curve Y data acquired by the acquisition unit. The device corrects the input sound according to the target response curve shown by the curve X data or curve Y data stored in the storage unit.

[0233] According to this variation, for example, the playback device 24 with a sound correction unit can be customized for listener B by storing curve X data corresponding to listener B. Furthermore, when the suitable curve Y data varies depending on the listener's gender, ethnicity, age, or other attributes, the playback device 24 with a sound correction unit can be customized for listener B by storing curve Y data corresponding to the attributes of listener B. The same applies when a device other than the playback device 24 has a sound correction unit.

[0234] (8) In the above embodiments, the test sound played to the test subject in order to generate curve A data is a frequency-divided pink noise obtained by dividing the full-band pink noise of the audible domain into multiple frequency bands, but is not limited thereto.

[0235] For example, a pulse can be played as a test tone for generating curve A data. In this case, the computer 11 (curve A data generation unit 114) determines the amplitude-frequency characteristics of the sound obtained as a pulse response as curve A. When a pulse is used as a test tone, the time spent by the test subject to generate curve A data is extremely short. That is, from the viewpoint of reducing the burden on the test subject, it is preferable to use a pulse as a test tone.

[0236] Furthermore, as the test tone for generating curve A data, a sweep tone with a frequency that changes continuously or intermittently within the audible range can also be played. In this case, the combination of the frequency of the sweep tone played by the headphones 13 and the amplitude of the sound picked up by the microphone 14 at the moment the sweep tone is played can be obtained across the entire audible range. The curve A data generation unit 114 determines curve A based on this combination of frequency and amplitude. When using a sweep tone as the test tone, the balance between the time spent by the test subject to generate curve A data and the accuracy of the determined curve A can be adjusted by adjusting the sweep speed (in the case of a sweep tone with a continuously changing frequency) or the interval of the sweep frequency (in the case of a sweep tone with an intermittently changing frequency). For example, if the test subject wants to obtain a high-accuracy curve A for their own use even if it takes a long time (or, curve X generated using curve A), a high-accuracy curve A can be obtained by slowing down the sweep speed (in the case of a sweep tone with a continuously changing frequency) or reducing the interval of the sweep frequency (in the case of a sweep tone with an intermittently changing frequency).

[0237] Furthermore, in the above embodiment, the test tone used to generate curve A data employs multiple frequency bands of pink noise, each with a bandwidth of 1 / 3 octave. This pink noise can also be used to generate curve B data, and therefore is preferred from the viewpoint of preparing the test tone. Moreover, when using pink noise to generate curve B data, compared to using pulses as the test tone, it is easier to obtain a more accurate curve A, and generally, compared to using a swept-frequency tone as the test tone, the time spent by the test subject is shorter.

[0238] (9) In the above embodiment, the frequency band of the reference pink noise in the frequency band played to the test subject in order to generate curve B data is a frequency band centered at 500Hz, but is not limited thereto. That is, in order to generate curve B data, frequency band pink noise with a frequency band centered at a frequency other than 500Hz may be played as a reference frequency band.

[0239] Furthermore, in the above-described embodiment, the reference sound pressure level of the cross-band pink noise played to the test subject to generate curve B data is 65 dB SPL, but it is not limited to this. That is, it is also possible to play cross-band pink noise with a sound pressure level other than 65 dB SPL as the reference sound pressure level to generate curve B data.

[0240] Furthermore, in the above-described embodiment, the bandwidth of each of the multiple frequency bands of pink noise played sequentially to the test subject in order to generate curve A data and curve B data is 1 / 3 octave, but it is not limited to this. That is, it is also possible that, in order to generate curve A data or curve B data, pink noise with a bandwidth of 1 / m octave (where m is any positive number) is played.

[0241] Label Explanation

[0242] 1: Target response curve data generation system; 2: Acoustic system; 3: Audiovisual system; 11: Computer; 12: Audio interface; 13: Headphones; 14: Microphone; 21: Stereo audio content generation device; 22: Binaural rendering device; 23: Sound reproduction device; 24: Sound playback device; 31: Stereo image content generation device; 32: Three-dimensional rendering device; 33: Image reproduction device; 34: Display device; 110: Storage unit; 111: Sound output unit; 112: Sound acquisition unit; 113: Frequency band amplitude and frequency characteristic determination unit; 114: Curve A data generation unit; 115: Operation signal acquisition unit; 116: Frequency band sound pressure increase / decrease determination unit; 117: Curve B data generation unit; 118: Personal target response curve data generation unit; 119: General target response curve data generation unit.

Claims

1. A method for generating target response curve data, wherein, The method for generating the target response curve data includes the following steps: Acquire the acoustic characteristics of sound from the external auditory canal to the tympanic membrane of the subject; Acquire sound pressure level characteristics that allow the test subject to perceive a constant volume of sound across the entire audible frequency range; as well as Target response curve data is generated based on the acoustic characteristics and the sound pressure adjustment characteristics. The target response curve data sets the acoustic characteristics to remove the components that contribute to the directionality of sound perception generated by the shape of a person, including at least the head, from stereo with positional and timbre information, while the stereo retains the brain's timbre recognition characteristics.

2. The method for generating target response curve data according to claim 1, wherein, The process of obtaining the acoustic characteristics is as follows: generating curve A data representing the amplitude-frequency characteristics of the sound picked up near the eardrum of the test subject during the period when the test sound was played near the external auditory canal of the test subject. The process of obtaining the sound pressure adjustment characteristics is as follows: When pink noise, which divides the entire audible frequency range into multiple frequency bands, is played sequentially near the external ear canal of the test subject at a reference sound pressure, the test subject adjusts the sound pressure of each frequency band other than the reference frequency band in a manner that allows them to perceive a sound level equal to that of the reference frequency band among the multiple frequency bands. Curve B data is generated, representing the amplitude-frequency characteristics of the increase or decrease in the sound pressure of each of the multiple frequency bands determined by this adjustment. The process of generating the target response curve data is as follows: generating curve X data, which represents the amplitude-frequency characteristic obtained by adding the amplitude-frequency characteristic shown by curve A data and the amplitude-frequency characteristic shown by curve B data, as the target response curve data for the test subject.

3. The method for generating target response curve data according to claim 2, wherein, The method for generating the target response curve data includes the following steps: generating curve Y data representing the amplitude-frequency characteristics obtained by averaging the amplitude-frequency characteristics shown by the curve X data generated for multiple test subjects, as general target response curve data.

4. The method for generating target response curve data according to claim 1, wherein, The process of obtaining the acoustic characteristics is as follows: For multiple test subjects, generate curve A data representing the amplitude-frequency characteristics of the sound picked up near the eardrum of the test subject during the period when the test sound was played near the external auditory canal; generate a general curve A data representing the amplitude-frequency characteristics obtained by averaging the amplitude-frequency characteristics shown by the multiple generated curve A data. The process of obtaining the sound pressure adjustment characteristics is as follows: For multiple test subjects, pink noise, obtained by dividing the full audible frequency band into multiple frequency bands, is played sequentially near each subject's external auditory canal at a reference sound pressure. The test subject adjusts the sound pressure of each frequency band outside the reference band in a manner that allows them to perceive a sound level equal to that of the reference band. Curve B data representing the increase or decrease in sound pressure of each of the multiple frequency bands determined by this adjustment is generated. A general curve B data representing the amplitude-frequency characteristics obtained by averaging the amplitude-frequency characteristics shown by the generated multiple curve B data is also generated. The process of generating the target response curve data is as follows: Generate curve Y data, which represents the amplitude-frequency characteristic obtained by adding the amplitude-frequency characteristic shown by the general curve A data and the amplitude-frequency characteristic shown by the general curve B data, as the general target response curve data.

5. The method for generating target response curve data according to claim 1, wherein, The process of obtaining the acoustic characteristics is as follows: generating curve A data representing the amplitude-frequency characteristics of the sound picked up near the eardrum of the test subject during the period when the test sound was played near the eardrum of the test subject using an arbitrary external auditory cannula sound playback device. The process for obtaining the sound pressure adjustment characteristics is as follows: Near the subject's external auditory canal, using the external auditory canal sound output device used in the process of generating curve A, pink noise of various sub-bands obtained by dividing the full audible frequency band into multiple bands is played sequentially at a reference sound pressure. The subject adjusts the sound pressure of each band outside the reference band in a manner that allows them to perceive a sound level equal to that of the reference band among the multiple bands. Curve B data is generated, representing the amplitude-frequency characteristics of the increase or decrease in sound pressure of each of the multiple bands determined by this adjustment. The process of generating the target response curve data is as follows: generating curve X data representing the amplitude-frequency characteristic obtained by adding the amplitude-frequency characteristic shown in curve A data to the amplitude-frequency characteristic shown in curve B data, and the target response curve data used as the external auditory cannula sound-emitting device used to generate the external auditory cannula sound-emitting device used for generating the external auditory cannula sound-emitting device for the test subject, or an external auditory cannula sound-emitting device of the same type.

6. The method for generating target response curve data according to claim 5, wherein, The method for generating target response curve data includes the following steps: generating curve Y data representing the amplitude-frequency characteristics obtained by averaging the amplitude-frequency characteristics shown by the curve X data generated for multiple test subjects, and using general target response curve data for the external auditory cannula sound output device used to generate the curve X data or for an external auditory cannula sound output device of the same type as the external auditory cannula sound output device.

7. The method for generating target response curve data according to claim 1, wherein, The process of obtaining the acoustic characteristics is as follows: For multiple test subjects, generate curve A data representing the amplitude-frequency characteristics of the sound picked up near the eardrum of the test subject during the period when a test sound is played near the eardrum of the test subject using an arbitrary external auditory cannula sound playback device; generate a general curve A data representing the amplitude-frequency characteristics obtained by averaging the amplitude-frequency characteristics shown by the multiple generated curve A data. The process of obtaining the sound pressure adjustment characteristics is as follows: For multiple test subjects, using the external auditory canal sound output device used to generate the curve A data, pink noise of the full audible frequency band divided into multiple frequency bands is sequentially played near the test subject's external auditory canal at a reference sound pressure. The test subject adjusts the sound pressure of each frequency band outside the reference frequency band in a manner that allows them to perceive a sound level equal to that of the reference frequency band. Curve B data is generated, representing the amplitude-frequency characteristics of the increase or decrease in sound pressure of each of the multiple frequency bands determined by this adjustment. A general curve B data is generated, representing the amplitude-frequency characteristics obtained by averaging the amplitude-frequency characteristics shown by the generated multiple curve B data. The process of generating the target response curve data is as follows: generating curve Y data representing the amplitude-frequency characteristic obtained by adding the amplitude-frequency characteristic shown by the general curve A data and the amplitude-frequency characteristic shown by the general curve B data, and using general target response curve data for external ear canal sound output devices used to generate the curve A data and the curve B data, or for external ear canal sound output devices of the same type as the external ear canal sound output device.

8. The method for generating target response curve data according to claim 1, wherein, In the process of acquiring the acoustic characteristics, for each of the multiple test subjects, curve A data is generated, representing the amplitude-frequency characteristics of the sound picked up near the eardrum of the test subject during the period when the test sound is played near the external auditory canal. In the process of obtaining the sound pressure adjustment characteristics, for multiple test subjects, each subject is sequentially played pink noise of the full audible frequency range divided into multiple frequency bands at a reference sound pressure near their external ear canal. The test subject adjusts the sound pressure of each frequency band outside the reference band in a manner that allows them to perceive a sound level equal to that of the reference band. Curve B data is generated, representing the amplitude-frequency characteristics of the sound pressure increase or decrease determined by this adjustment for each of the multiple frequency bands. The process of generating the target response curve data is as follows: Generate curve Y data representing the amplitude-frequency characteristics obtained by adding the amplitude-frequency characteristics shown by the curve A data of each of the multiple test subjects to the amplitude-frequency characteristics shown by the curve B data of each of the multiple test subjects, and then averaging according to the number of multiple test subjects, as the general target response curve data.

9. The method for generating target response curve data according to claim 1, wherein, In the process of acquiring the acoustic characteristics, for each of the multiple test subjects, curve A data is generated, representing the amplitude-frequency characteristics of the sound picked up near the eardrum of the test subject during the period when the test sound is played near the eardrum of the test subject using an arbitrary external auditory cannula sound playback device. In the process of obtaining the sound pressure adjustment characteristics, for multiple test subjects, using the external auditory canal sound output device used to generate the curve A data, pink noise of each frequency band obtained by dividing the full audible frequency band into multiple frequency bands is sequentially played near the external auditory canal of each test subject at a reference sound pressure. The test subject adjusts the sound pressure of each frequency band other than the reference frequency band in a manner that allows them to perceive a sound level equal to that of the reference frequency band among the multiple frequency bands. Curve B data is generated, representing the amplitude-frequency characteristics of the increase or decrease in the sound pressure of each of the multiple frequency bands determined by this adjustment. The process of generating the target response curve data is as follows: generating curve Y data representing the amplitude-frequency characteristics obtained by adding the amplitude-frequency characteristics shown by the curve A data of each of the plurality of test subjects to the amplitude-frequency characteristics shown by the curve B data of each of the plurality of test subjects and averaging them according to the number of the plurality of test subjects, and using general target response curve data for external ear canal sound emission devices used to generate the curve A data and the curve B data, or for external ear canal sound emission devices of the same type as the external ear canal sound emission device.

10. The method for generating target response curve data according to any one of claims 2, 4, 5, 7 to 9, wherein, The test sound is a band-segmented pink noise obtained by dividing the full-band audible pink noise into multiple frequency bands.

11. The method for generating target response curve data according to any one of claims 2, 4, 5, 7 to 9, wherein, The test sound is a pulse.

12. The method for generating target response curve data according to any one of claims 2, 4, 5, 7 to 9, wherein, The test tone is a sweep tone whose frequency changes continuously or intermittently within the audible range.

13. The method for generating target response curve data according to any one of claims 2, 4, 5, 7 to 9, wherein, The reference frequency band is centered at 500Hz.

14. The method for generating target response curve data according to any one of claims 2, 4, 5, 7 to 9, wherein, The reference sound pressure level is 65 dB SPL.

15. The method for generating target response curve data according to any one of claims 2, 4, 5, 7 to 9, wherein, Each of the multiple frequency bands has a bandwidth of 1 / 3 octave.

16. A system for generating target response curve data, comprising: The sound output unit outputs sound to a sound playback device that plays sound near the external auditory canal of the test subject; The sound acquisition unit acquires the sound picked up by a microphone located near the eardrum of the test subject during the period when the sound output unit plays the test sound to the sound playback device; The curve A data generation unit generates curve A data that represents the amplitude-frequency characteristics of the sound acquired by the sound acquisition unit; During the period when the sound output unit sequentially outputs pink noise of the full audible frequency band into the sound playback device at a reference sound pressure, the notification unit notifies the test subject to operate the operating device to adjust the sound pressure of each frequency band other than the reference frequency band in a manner that allows the test subject to perceive a sound level that is the same as the sound level of the reference frequency band among the multiple frequency bands. An operation signal acquisition unit acquires an operation signal from the operation device that corresponds to the operation of the test subject; The curve B data generation unit generates curve B data representing the amplitude-frequency characteristics of the sound pressure levels of the multiple frequency bands, based on the operation signal acquired by the operation signal acquisition unit; and The personal target response curve data generation unit generates curve X data as the target response curve data for the test subject. This curve X data represents the amplitude-frequency characteristic obtained by adding the amplitude-frequency characteristic shown by the curve A data generated by the curve A data generation unit and the amplitude-frequency characteristic shown by the curve B data generated by the curve B data generation unit. The target response curve data sets the acoustic characteristics to remove the components that contribute to the directionality of sound perception generated by the shape of the human body, including at least the head, from stereo sound with positional and timbre information, while the stereo sound retains the brain's timbre recognition characteristics.

17. A system for generating target response curve data, comprising: The sound output unit outputs sound to a sound playback device that plays sound near the external auditory canal of the test subject; The sound acquisition unit acquires the sound picked up by a microphone during the playback of the test sound to the sound output device by the sound output unit. The microphone is mounted at the end of a very fine tube made of soft raw material and inserted near the eardrum of the test subject. The curve A data generation unit generates curve A data that represents the amplitude-frequency characteristics of the sound acquired by the sound acquisition unit; During the period when the sound output unit sequentially outputs pink noise of the full audible frequency band into the sound playback device at a reference sound pressure, the notification unit notifies the test subject to operate the operating device to adjust the sound pressure of each frequency band other than the reference frequency band in a manner that allows the test subject to perceive a sound level that is the same as the sound level of the reference frequency band among the multiple frequency bands. An operation signal acquisition unit acquires an operation signal from the operation device that corresponds to the operation of the test subject; The curve B data generation unit generates curve B data representing the amplitude-frequency characteristics of the sound pressure levels of the multiple frequency bands, based on the operation signal acquired by the operation signal acquisition unit; and The personal target response curve data generation unit generates curve X data as the target response curve data for the test subject. This curve X data represents the amplitude-frequency characteristic obtained by adding the amplitude-frequency characteristic shown by the curve A data generated by the curve A data generation unit and the amplitude-frequency characteristic shown by the curve B data generated by the curve B data generation unit. The target response curve data sets the acoustic characteristics to remove the components that contribute to the directionality of sound perception generated by the shape of the human body, including at least the head, from stereo sound with positional and timbre information, while the stereo sound retains the brain's timbre recognition characteristics.

18. The system for generating target response curve data according to claim 16 or 17, wherein, The target response curve data generation system has a general target response curve data generation unit, which generates curve Y data as general target response curve data. The curve Y data represents the amplitude frequency characteristics obtained by averaging the amplitude frequency characteristics shown by the target response curve data for each subject generated by the individual target response curve data generation unit for each subject.

19. A system for generating target response curve data, comprising: The sound output unit outputs sound to a sound playback device that plays sound near the external auditory canal of the test subject; The sound acquisition unit acquires the sound picked up by a microphone located near the eardrum of the test subject during the period when the sound output unit plays the test sound to the sound playback device; The curve A data generation unit generates curve A data that represents the amplitude-frequency characteristics of the sound acquired by the sound acquisition unit; During the period when the sound output unit sequentially outputs pink noise of the full audible frequency band into the sound playback device at a reference sound pressure, the notification unit notifies the test subject to operate the operating device to adjust the sound pressure of each frequency band other than the reference frequency band in a manner that allows the test subject to perceive a sound level that is the same as the sound level of the reference frequency band among the multiple frequency bands. An operation signal acquisition unit acquires an operation signal from the operation device that corresponds to the operation of the test subject; The curve B data generation unit generates curve B data, which represents the amplitude-frequency characteristics of the increase or decrease in sound pressure in each of the multiple frequency bands, based on the operation signal acquired by the operation signal acquisition unit. as well as The general target response curve data generation unit generates curve Y data as general target response curve data. This curve Y data represents the amplitude frequency characteristics obtained by averaging the amplitude frequency characteristics shown by the curve A data generated by the curve A data generation unit for multiple test subjects, and the amplitude frequency characteristics obtained by averaging the amplitude frequency characteristics shown by the curve B data generated by the curve B data generation unit for multiple test subjects. The target response curve data sets the acoustic characteristics to remove the components that contribute to the directionality of sound perception generated by the shape of the human body, including at least the head, from stereo sound with positional and timbre information, while maintaining the brain's timbre recognition characteristics.

20. A system for generating target response curve data, comprising: The sound output unit outputs sound to a sound playback device that plays sound near the external auditory canal of the test subject; The sound acquisition unit acquires the sound picked up by a microphone during the playback of the test sound to the sound output device by the sound output unit. The microphone is mounted at the end of a very fine tube made of soft raw material and inserted near the eardrum of the test subject. The curve A data generation unit generates curve A data that represents the amplitude-frequency characteristics of the sound acquired by the sound acquisition unit; During the period when the sound output unit sequentially outputs pink noise of the full audible frequency band into the sound playback device at a reference sound pressure, the notification unit notifies the test subject to operate the operating device to adjust the sound pressure of each frequency band other than the reference frequency band in a manner that allows the test subject to perceive a sound level that is the same as the sound level of the reference frequency band among the multiple frequency bands. An operation signal acquisition unit acquires an operation signal from the operation device that corresponds to the operation of the test subject; The curve B data generation unit generates curve B data, which represents the amplitude-frequency characteristics of the increase or decrease in sound pressure in each of the multiple frequency bands, based on the operation signal acquired by the operation signal acquisition unit. as well as The general target response curve data generation unit generates curve Y data as general target response curve data. This curve Y data represents the amplitude frequency characteristics obtained by averaging the amplitude frequency characteristics shown by the curve A data generated by the curve A data generation unit for multiple test subjects, and the amplitude frequency characteristics obtained by averaging the amplitude frequency characteristics shown by the curve B data generated by the curve B data generation unit for multiple test subjects. The target response curve data sets the acoustic characteristics to remove the components that contribute to the directionality of sound perception generated by the shape of the human body, including at least the head, from stereo sound with positional and timbre information, while maintaining the brain's timbre recognition characteristics.

21. A system for generating target response curve data, comprising: The sound output unit outputs sound to a sound playback device that plays sound near the external auditory canal of the test subject; The sound acquisition unit acquires the sound picked up by a microphone positioned near the eardrum of the test subject during the period when the sound output unit plays the test sound to the sound playback device; The curve A data generation unit generates curve A data that represents the amplitude-frequency characteristics of the sound acquired by the sound acquisition unit; During the period when the sound output unit sequentially outputs pink noise of the full audible frequency band into the sound playback device at a reference sound pressure, the notification unit notifies the test subject to operate the operating device to adjust the sound pressure of each frequency band other than the reference frequency band in a manner that allows the test subject to perceive a sound level that is the same as the sound level of the reference frequency band among the multiple frequency bands. An operation signal acquisition unit acquires an operation signal from the operation device that corresponds to the operation of the test subject; The curve B data generation unit generates curve B data, which represents the amplitude-frequency characteristics of the increase or decrease in sound pressure in each of the multiple frequency bands, based on the operation signal acquired by the operation signal acquisition unit. as well as The general target response curve data generation unit generates curve Y data as general target response curve data. This curve Y data represents the amplitude frequency characteristics obtained by adding together the amplitude frequency characteristics shown by the curve A data generated by the curve A data generation unit for multiple subjects and the amplitude frequency characteristics shown by the curve B data generated by the curve B data generation unit for multiple subjects of the same number of subjects, and then averaging them according to the number of subjects. The acoustic characteristics of this target response curve data are set as follows: removing the components that contribute to the directionality of sound perception generated by the shape of the human body, including at least the head, from stereo sound with position information and timbre information, while the stereo sound retains the timbre recognition characteristics of the brain.

22. A system for generating target response curve data, comprising: The sound output unit outputs sound to a sound playback device that plays sound near the external auditory canal of the test subject; The sound acquisition unit acquires the sound picked up by a microphone during the playback of the test sound to the sound output device by the sound output unit. The microphone is mounted at the end of a very fine tube made of soft raw material and inserted near the eardrum of the test subject. The curve A data generation unit generates curve A data that represents the amplitude-frequency characteristics of the sound acquired by the sound acquisition unit; During the period when the sound output unit sequentially outputs pink noise of the full audible frequency band into the sound playback device at a reference sound pressure, the notification unit notifies the test subject to operate the operating device to adjust the sound pressure of each frequency band other than the reference frequency band in a manner that allows the test subject to perceive a sound level that is the same as the sound level of the reference frequency band among the multiple frequency bands. An operation signal acquisition unit acquires an operation signal from the operation device that corresponds to the operation of the test subject; The curve B data generation unit generates curve B data, which represents the amplitude-frequency characteristics of the increase or decrease in sound pressure in each of the multiple frequency bands, based on the operation signal acquired by the operation signal acquisition unit. as well as The general target response curve data generation unit generates curve Y data as general target response curve data. This curve Y data represents the amplitude frequency characteristics obtained by adding together the amplitude frequency characteristics shown by the curve A data generated by the curve A data generation unit for multiple subjects and the amplitude frequency characteristics shown by the curve B data generated by the curve B data generation unit for multiple subjects of the same number of subjects, and then averaging them according to the number of subjects. The acoustic characteristics of this target response curve data are set as follows: removing the components that contribute to the directionality of sound perception generated by the shape of the human body, including at least the head, from stereo sound with position information and timbre information, while the stereo sound retains the timbre recognition characteristics of the brain.

23. The system for generating target response curve data according to any one of claims 16, 17, 19 to 22, wherein, The test sound is a band-segmented pink noise obtained by dividing the full-band audible pink noise into multiple frequency bands.

24. The system for generating target response curve data according to any one of claims 16, 17, 19 to 22, wherein, The test sound is a pulse.

25. The system for generating target response curve data according to any one of claims 16, 17, 19 to 22, wherein, The test tone is a sweep tone whose frequency changes continuously or intermittently within the audible range.

26. The system for generating target response curve data according to any one of claims 16, 17, 19 to 22, wherein, The reference frequency band is centered at 500Hz.

27. The system for generating target response curve data according to any one of claims 16, 17, 19 to 22, wherein, The reference sound pressure level is 65 dB SPL.

28. The system for generating target response curve data according to any one of claims 16, 17, 19 to 22, wherein, Each of the multiple frequency bands has a bandwidth of 1 / 3 octave.

29. A recording medium storing a program for causing a computer to perform the following processes: The test sound is output to a sound-playing device that plays sound near the external auditory canal of the test subject; Acquire the sound picked up by a microphone near the eardrum of the test subject during the output of the test sound; Generate curve A data representing the amplitude-frequency characteristics of the sound obtained during the sound acquisition process; The sound output device is supplied with a reference sound pressure level and each sub-band pink noise is obtained by dividing the full audible frequency range pink noise into multiple frequency bands. In parallel with the processing of the output of the sub-band pink noise, a notification is output to a notification device that notifies the test subject to urge the test subject to adjust the sound pressure of the sub-band pink noise of each frequency band outside the reference frequency band in a manner that allows the test subject to perceive a sound level that is the same as the sound level of the sub-band pink noise of the reference frequency band among the plurality of frequency bands. Acquire the operation signal corresponding to the operation performed by the test subject on the operating device based on the notification output in the process of outputting the notification; Based on the operating signals acquired during the processing of acquiring the operating signals, curve B data representing the amplitude-frequency characteristics of the increase or decrease in sound pressure levels of the respective frequency bands is generated; and The generated curve X data serves as the target response curve data for the test subject. The curve X data represents the amplitude-frequency characteristic obtained by adding the amplitude-frequency characteristic shown by the curve A data to the amplitude-frequency characteristic shown by the curve B data. The target response curve data sets the acoustic characteristics to remove the components that contribute to the perception of sound direction generated by the shape of the human body, including at least the head, from stereo sound with positional and timbre information, while the stereo sound retains the brain's timbre recognition characteristics.

30. A recording medium storing a program for causing a computer to perform the following processes: The test sound is output to a sound-playing device that plays sound near the external auditory canal of the test subject; The sound picked up by a microphone during the output of the test sound is acquired relative to the end of an extremely fine tube made of soft raw material that is inserted near the eardrum of the test subject. Generate curve A data representing the amplitude-frequency characteristics of the sound obtained during the sound acquisition process; The sound output device is supplied with a reference sound pressure level and each sub-band pink noise is obtained by dividing the full audible frequency range pink noise into multiple frequency bands. In parallel with the processing of the output of the sub-band pink noise, a notification is output to a notification device that notifies the test subject to urge the test subject to adjust the sound pressure of the sub-band pink noise of each frequency band outside the reference frequency band in a manner that allows the test subject to perceive a sound level that is the same as the sound level of the sub-band pink noise of the reference frequency band among the plurality of frequency bands. Acquire the operation signal corresponding to the operation performed by the test subject on the operating device based on the notification output in the process of outputting the notification; Based on the operating signals acquired during the processing of acquiring the operating signals, curve B data representing the amplitude-frequency characteristics of the increase or decrease in sound pressure levels of the respective frequency bands is generated; and The generated curve X data serves as the target response curve data for the test subject. The curve X data represents the amplitude-frequency characteristic obtained by adding the amplitude-frequency characteristic shown by the curve A data to the amplitude-frequency characteristic shown by the curve B data. The target response curve data sets the acoustic characteristics to remove the components that contribute to the perception of sound direction generated by the shape of the human body, including at least the head, from stereo sound with positional and timbre information, while the stereo sound retains the brain's timbre recognition characteristics.

31. The recording medium according to claim 29 or 30, wherein, The program is used to cause the computer to perform the following processing: generating curve Y data as general target response curve data, which represents the amplitude-frequency characteristics obtained by averaging the amplitude-frequency characteristics shown by the curve X data generated for multiple subjects in the processing of generating the curve X data.

32. A recording medium storing a program for causing a computer to perform the following processes: The test sound is output to a sound-playing device that plays sound near the external auditory canal of the test subject; Acquire the sound picked up by a microphone near the eardrum of the test subject during the output of the test sound; Generate curve A data representing the amplitude-frequency characteristics of the sound obtained during the sound acquisition process; The sound output device is supplied with a reference sound pressure level and each sub-band pink noise is obtained by dividing the full audible frequency range pink noise into multiple frequency bands. In parallel with the processing of the output of the frequency band pink noise, a notification is output to the notification device that notifies the test subject to urge the test subject to adjust the sound pressure of the frequency band pink noise of each frequency band other than the reference frequency band in the frequency band pink noise obtained by dividing the full-band pink noise of the audible domain into multiple frequency bands. Acquire the operation signal corresponding to the operation performed by the test subject on the operating device based on the notification output in the process of outputting the notification; Based on the operating signals obtained during the processing of acquiring the operating signals, curve B data representing the amplitude-frequency characteristics of the increase or decrease in sound pressure in each of the multiple frequency bands is generated. as well as The generated curve Y data serves as a general target response curve data. This curve Y data represents the amplitude frequency characteristics obtained by averaging the amplitude frequency characteristics shown in the curve A data generated in the processing of generating curve A data for multiple subjects, and the amplitude frequency characteristics obtained by averaging the amplitude frequency characteristics shown in the curve B data generated in the processing of generating curve B data for multiple subjects. The target response curve data sets the acoustic characteristics to remove the components that contribute to the directionality of sound perception generated by the shape of the human body, including at least the head, from stereo sound with positional and timbre information, while maintaining the brain's timbre recognition characteristics.

33. A recording medium storing a program for causing a computer to perform the following processes: The test sound is output to a sound-playing device that plays sound near the external auditory canal of the test subject; The sound picked up by a microphone during the output of the test sound is acquired relative to the end of an extremely fine tube made of soft raw material that is inserted near the eardrum of the test subject. Generate curve A data representing the amplitude-frequency characteristics of the sound obtained during the sound acquisition process; The sound output device is supplied with a reference sound pressure level and each sub-band pink noise is obtained by dividing the full audible frequency range pink noise into multiple frequency bands. In parallel with the processing of the output of the frequency band pink noise, a notification is output to the notification device that notifies the test subject to urge the test subject to adjust the sound pressure of the frequency band pink noise of each frequency band other than the reference frequency band in the frequency band pink noise obtained by dividing the full-band pink noise of the audible domain into multiple frequency bands. Acquire the operation signal corresponding to the operation performed by the test subject on the operating device based on the notification output in the process of outputting the notification; Based on the operating signals obtained during the processing of acquiring the operating signals, curve B data representing the amplitude-frequency characteristics of the increase or decrease in sound pressure in each of the multiple frequency bands is generated. as well as The generated curve Y data serves as a general target response curve data. This curve Y data represents the amplitude frequency characteristics obtained by averaging the amplitude frequency characteristics shown in the curve A data generated in the processing of generating curve A data for multiple subjects, and the amplitude frequency characteristics obtained by averaging the amplitude frequency characteristics shown in the curve B data generated in the processing of generating curve B data for multiple subjects. The target response curve data sets the acoustic characteristics to remove the components that contribute to the directionality of sound perception generated by the shape of the human body, including at least the head, from stereo sound with positional and timbre information, while maintaining the brain's timbre recognition characteristics.

34. A recording medium storing a program for causing a computer to perform the following processes: The test sound is output to a sound-playing device that plays sound near the external auditory canal of the test subject; Acquire the sound picked up by a microphone near the eardrum of the test subject during the output of the test sound; Generate curve A data representing the amplitude-frequency characteristics of the sound obtained during the sound acquisition process; The sound output device is supplied with a reference sound pressure level and each sub-band pink noise is obtained by dividing the full audible frequency range pink noise into multiple frequency bands. In parallel with the processing of the output of the frequency band pink noise, a notification is output to the notification device that notifies the test subject to urge the test subject to adjust the sound pressure of the frequency band pink noise of each frequency band other than the reference frequency band in the frequency band pink noise obtained by dividing the full-band pink noise of the audible domain into multiple frequency bands. Acquire the operation signal corresponding to the operation performed by the test subject on the operating device based on the notification output in the process of outputting the notification; Based on the operating signals obtained during the processing of acquiring the operating signals, curve B data representing the amplitude-frequency characteristics of the increase or decrease in sound pressure in each of the multiple frequency bands is generated. as well as The generated curve Y data serves as a general target response curve data. This curve Y data represents the amplitude-frequency characteristics obtained by adding together the amplitude-frequency characteristics of curve A data generated by multiple subjects in the process of generating curve A data, and the amplitude-frequency characteristics of curve B data generated by multiple subjects in the process of generating curve B data, and then averaging them according to the number of subjects. The acoustic characteristics of this target response curve data are set as follows: removing the components that contribute to the directionality of sound perception due to the shape of the human body, including at least the head, from stereo sound with positional and timbre information, while maintaining the brain's timbre recognition characteristics.

35. A recording medium storing a program for causing a computer to perform the following processes: The test sound is output to a sound-playing device that plays sound near the external auditory canal of the test subject; The sound picked up by a microphone during the output of the test sound is acquired relative to the end of an extremely fine tube made of soft raw material that is inserted near the eardrum of the test subject. Generate curve A data representing the amplitude-frequency characteristics of the sound obtained during the sound acquisition process; The sound output device is supplied with a reference sound pressure level, and each sub-band pink noise is obtained by dividing the full-range audible pink noise into multiple frequency bands. In parallel with the processing of the output of the frequency band pink noise, a notification is output to the notification device that notifies the test subject to urge the test subject to adjust the sound pressure of the frequency band pink noise of each frequency band other than the reference frequency band in the frequency band pink noise obtained by dividing the full-band pink noise of the audible domain into multiple frequency bands. Acquire the operation signal corresponding to the operation performed by the test subject on the operating device based on the notification output in the process of outputting the notification; Based on the operating signals obtained during the processing of acquiring the operating signals, curve B data representing the amplitude-frequency characteristics of the increase or decrease in sound pressure in each of the multiple frequency bands is generated. as well as The generated curve Y data serves as a general target response curve data. This curve Y data represents the amplitude-frequency characteristics obtained by adding together the amplitude-frequency characteristics of curve A data generated by multiple subjects in the process of generating curve A data, and the amplitude-frequency characteristics of curve B data generated by multiple subjects in the process of generating curve B data, and then averaging them according to the number of subjects. The acoustic characteristics of this target response curve data are set as follows: removing the components that contribute to the directionality of sound perception due to the shape of the human body, including at least the head, from stereo sound with positional and timbre information, while maintaining the brain's timbre recognition characteristics.

36. The recording medium according to any one of claims 29, 30, 32 to 35, wherein, The test sound is a band-segmented pink noise obtained by dividing the full-band audible pink noise into multiple frequency bands.

37. The recording medium according to any one of claims 29, 30, 32 to 35, wherein, The test sound is a pulse.

38. The recording medium according to any one of claims 29, 30, 32 to 35, wherein, The test tone is a sweep tone whose frequency changes continuously or intermittently within the audible range.

39. The recording medium according to any one of claims 29, 30, 32 to 35, wherein, The reference frequency band is centered at 500Hz.

40. The recording medium according to any one of claims 29, 30, 32 to 35, wherein, The reference sound pressure level is 65 dB SPL.

41. The recording medium according to any one of claims 29, 30, 32 to 35, wherein, Each of the multiple frequency bands has a bandwidth of 1 / 3 octave.

Images