Method for generating target response curve data, system for generating target response curve data, and program

Abstract

In the present invention, a computer 11 emits test sounds from headphones 13 relating to each of a plurality of frequency bands into which an audible band has been divided. During that period, the computer 11 acquires sound picked up by a microphone 14 located near the eardrum of a subject. From discrete amplitude values of the sounds of each of the plurality of frequency bands thus acquired, the computer 11 identifies, as a curve A, amplitude frequency characteristics of the entire audible band. In addition, for each of the plurality of frequency bands into which the audible band was divided, the computer 11 emits, from the headphones 13 and in an alternating manner, a test sound of a reference frequency band and a test sound of a frequency band to be compared. During that period, the subject adjusts the sound pressure of the test sound to be compared such that the reference test sound and the test sound to be compared are felt to have the same magnitude. The computer 11 identifies, as a curve B, amplitude frequency characteristics of the entire audible band indicated by an increase / decrease in the sound pressure of the frequency bands indicated by the results of the adjustments by the user. The computer 11 generates a target response curve by adding curve A and curve B.

Description

Target response curve data, target response curve data generating method, sound emitting device, sound processing device, sound data, acoustic system, target response curve data generating system, program, and recording medium

[0001] The present invention relates to acoustic technology, and more particularly to target response curves.

[0002] The impression that a listener receives from a sound emitted by a sound-emitting device such as an earphone or a headphone varies depending on the amplitude-frequency characteristics of the sound emitted by the device. For this reason, sound-emitting device manufacturers are searching for target response curves, which are the amplitude-frequency characteristics of sound that give a good impression to listeners.

[0003] For example, a widely known target response curve is called the Harman target response curve. The Harman target response curve is a target response curve created based on the reference listening room of Harman, a Harman Group company. According to experiments conducted by Harman, for example, sound corrected according to the Harman target response curve leaves a better impression on many listeners than sound corrected according to a target response curve created based on an anechoic chamber or a target response curve created based on a reverberation room.

[0004] Patent Documents disclosing technology using a target response curve include, for example, Patent Document 1. In the invention described in Patent Document 1, an audio signal input to a speaker is corrected by a graphic equalizer so that a sound having amplitude-frequency characteristics according to a target response curve selected by a listener from among a plurality of target response curves is emitted.

[0005] Japanese Patent Application Laid-Open No. 2001-224100

[0006] In recent years, immersive binaural sound has become increasingly popular. This converts immersive sound (stereophonic sound), which was originally created to be emitted from multi-channel (three or more channels) speakers arranged three-dimensionally around the listener, into a stereophonic sound that is perceived by the listener when emitted from a sound-emitting device such as headphones or earphones that emits sound near the listener's left and right external ear canals.

[0007] Hereinafter, for convenience, the sound emitting devices of this embodiment, such as headphones or earphones that emit sound near the left and right external ear canals of a listener, or sound emitting devices that use speaker arrays or the like to emit sound near the left and right external ear canals of a listener, will be referred to as "external ear canal sound emitting devices."

[0008] Conventional target response curves are adjusted to give a good impression to listeners when applied to two-channel stereo sound. Therefore, when immersive binaural sound is played back using an ear canal sound emission device with amplitude-frequency characteristics that follow a conventional target response curve, there are problems in that the sound image localization direction and sense of distance in the three-dimensional space of the sound source, the sense of width, direction, and sense of distance in the three-dimensional space created by the combination of multiple sound sources (composite sound source), and even the sense of spaciousness of the sound field created by reflected sounds are not reproduced as intended by the producer of the original sound source.

[0009] In view of the above circumstances, the present invention provides a means for reducing the difference between the three-dimensional acoustic space impression intended by the creator of the original immersive sound (stereophonic sound) sound source and the three-dimensional acoustic space impression perceived by a listener through immersive binaural sound emitted from an ear canal sound emission device.

[0010] In order to solve the problem that the spatial impression intended by the producer of the sound source is not reproduced when immersive binaural sound is played back through headphones or earphones, the present invention provides, as a first aspect, target response curve data consisting of amplitude-frequency characteristics corrected to suit human hearing, in which blanking is performed to remove components that contribute to the human perception of the directionality of sound, and acoustic characteristics are set so as to maintain the timbre recognition characteristics that allow the human brain to recognize the timbre of sound.

[0011] In addition, in order to solve the problem that the spatial impression intended by the producer of the sound source is not reproduced when immersive binaural sound is played back through headphones or earphones, the present invention provides, as a second aspect, a method for generating target response curve data consisting of amplitude-frequency characteristics corrected to suit human hearing, in which components that contribute to the perception of the directionality of sound as recognized by humans are blanked out, and acoustic characteristics are set so as to maintain the timbre recognition characteristics that allow the human brain to recognize the timbre of sound.

[0012] Furthermore, in order to solve the problem that the spatial impression intended by the producer of the sound source is not reproduced when immersive binaural sound is played back through headphones or earphones, the present invention provides, as a third aspect, a sound emission device manufactured using as reference a target response curve consisting of amplitude-frequency characteristics corrected to suit human hearing, which is blanked out to remove components that contribute to the perception of the directionality of sound as recognized by humans, and which sets acoustic characteristics so as to maintain the timbre recognition characteristics that recognize the timbre of sound by the human brain.

[0013] Furthermore, in order to solve the problem that the spatial impression intended by the producer of the sound source is not reproduced when immersive binaural sound is played back through headphones or earphones, the present invention provides, as a fourth aspect, a sound processing device that corrects the amplitude frequency characteristics of sound in accordance with a target response curve consisting of amplitude frequency characteristics corrected to suit human hearing, which performs blanking to remove components that contribute to the perception of the directionality of sound as recognized by humans, and sets acoustic characteristics so as to maintain the timbre recognition characteristics that recognize the timbre of sound by the human brain.

[0014] Furthermore, in a fifth aspect, the present invention provides a program for causing a computer to execute a process of correcting the amplitude frequency characteristics of sound in accordance with a target response curve consisting of amplitude frequency characteristics corrected to suit human hearing, in order to solve the problem of the spatial impression intended by the producer of the sound source not being reproduced when immersive binaural sound is played back through headphones or earphones, the target response curve being blanked out to remove components that contribute to the perception of the directionality of sound as recognized by humans, and setting acoustic characteristics so as to retain the timbre recognition characteristics that recognize the timbre of sound by the human brain.

[0015] In addition, the present invention provides, as a sixth aspect, a method for generating target response curve data that removes components that contribute to the perception of directionality of sound generated by the external shape of a person, including at least the head, and sets acoustic characteristics so as to preserve the timbre recognition characteristics of the brain.

[0016] Furthermore, in the method for generating target response curve data according to the sixth aspect described above, a configuration may be adopted as a seventh aspect, comprising the steps of: acquiring acoustic characteristics of sound from the subject's external ear canal to the eardrum; acquiring sound pressure adjustment characteristics that cause the subject to perceive the sound as having a constant loudness over the entire audible range; and generating target response curve data based on the acoustic characteristics and the sound pressure adjustment characteristics.

[0017] Furthermore, in the method for generating target response curve data according to the seventh aspect, the step of acquiring acoustic characteristics may be a step of generating curve A data indicating amplitude-frequency characteristics of a sound picked up near the eardrum of the subject while emitting a test sound near the ear canal of the subject; the step of acquiring sound pressure adjustment characteristics may be a step of adjusting the sound pressure of each of the frequency bands other than a reference frequency band so that, when band-specific pink noise, obtained by dividing full-audible band pink noise into a plurality of frequency bands, is sequentially emitted near the ear canal of the subject at a reference sound pressure, the subject perceives the sound as being the same loudness as the sound of the reference frequency band among the plurality of frequency bands, and generating curve B data indicating amplitude-frequency characteristics indicated by the amount of increase or decrease in sound pressure of each of the plurality of frequency bands specified by the adjustment; and the step of generating target response curve data may be a step of generating curve X data indicating amplitude-frequency characteristics obtained by adding together the amplitude-frequency characteristics indicated by the curve A data and the amplitude-frequency characteristics indicated by the curve B data, as the target response curve data for the subject.

[0018] Furthermore, in the method for generating target response curve data according to the eighth aspect described above, a configuration may be adopted as a ninth aspect, further comprising a step of generating curve Y data indicating amplitude-frequency characteristics obtained by averaging the amplitude-frequency characteristics indicated by the curve X data generated for each of a plurality of subjects, as general-purpose target response curve data.

[0019] In the method for generating target response curve data according to the seventh aspect, the step of acquiring the acoustic characteristics is a step of generating, for each of a plurality of subjects, curve A data indicating the amplitude-frequency characteristics of a sound picked up near the eardrum of the subject while a test sound is emitted near the ear canal of the subject, and generating general-purpose curve A data indicating the amplitude-frequency characteristics by averaging the amplitude-frequency characteristics indicated by the plurality of generated curve A data, and the step of acquiring the sound pressure adjustment characteristics is a step of acquiring, for each of the plurality of subjects, curve A data indicating the amplitude-frequency characteristics of a sound picked up near the eardrum of the subject while a test sound is emitted near the ear canal of the subject, the amplitude-frequency characteristics being equal to the loudness of a sound in a reference frequency band among the plurality of frequency bands when band-specific pink noise, which is obtained by dividing a full-audible band pink noise into a plurality of frequency bands, is emitted sequentially at a reference sound pressure near the ear canal of the subject. a step of adjusting the sound pressure of each of the frequency bands other than the reference frequency band so that the subject perceives the sound as being the same loudness; generating curve B data indicating amplitude-frequency characteristics indicated by the increase or decrease in sound pressure of each of the frequency bands specified by the adjustment; and generating general-purpose curve B data indicating amplitude-frequency characteristics obtained by averaging the amplitude-frequency characteristics indicated by the generated plurality of curve B data; and the step of generating the target response curve data may be a step of generating, as general-purpose target response curve data, curve Y data indicating amplitude-frequency characteristics obtained by adding together the amplitude-frequency characteristics indicated by the general-purpose curve A data and the amplitude-frequency characteristics indicated by the general-purpose curve B data.

[0020] In the method for generating target response curve data according to the seventh aspect, the step of acquiring the acoustic characteristics is a step of generating curve A data indicating amplitude-frequency characteristics of a sound picked up near the eardrum of the subject while emitting a test sound near the ear canal of the subject by an arbitrary ear canal sound emitting device, and the step of acquiring the sound pressure adjustment characteristics is a step of acquiring curve A data indicating amplitude-frequency characteristics of a sound picked up near the eardrum of the subject while emitting a test sound near the ear canal of the subject by an ear canal sound emitting device used in the step of generating the curve A data or an ear canal sound emitting device of the same type as the ear canal sound emitting device, and acquiring the sound pressure adjustment characteristics is a step of acquiring curve A data indicating amplitude-frequency characteristics of a sound picked up near the ear canal of the subject while emitting a test sound near the ear canal of the subject by an ear canal sound emitting device used in the step of generating the curve A data or an ear canal sound emitting device of the same type as the ear canal sound emitting device, wherein audible full-band pink noise is divided into a plurality of frequency bands, and the plurality of frequency bands are perceived as having the same loudness as the loudness of the sound in the reference frequency band. an eleventh aspect may adopt a configuration in which the subject adjusts the sound pressure in each of the frequency bands other than the reference frequency band so as to increase or decrease the sound pressure in each of the frequency bands specified by the adjustment, and curve B data is generated that indicates amplitude-frequency characteristics indicated by the amount of increase or decrease in sound pressure in each of the frequency bands specified by the adjustment, and the step of generating the target response curve data is a step of generating curve X data that indicates amplitude-frequency characteristics obtained by adding together the amplitude-frequency characteristics indicated by the curve A data and the amplitude-frequency characteristics indicated by the curve B data, as target response curve data for the external ear canal sound emitting device used to generate the curve A data and the curve B data for the subject, or for an external ear canal sound emitting device of the same type as the external ear canal sound emitting device.

[0021] Furthermore, in the method for generating target response curve data according to the above-mentioned eleventh aspect, a configuration may be adopted as a twelfth aspect, which includes a step of generating curve Y data indicating amplitude-frequency characteristics obtained by averaging the amplitude-frequency characteristics indicated by the curve X data generated for each of a plurality of subjects, as general-purpose target response curve data for the external ear canal sound emitting device used to generate the curve X data or for external ear canal sound emitting devices of the same type as the external ear canal sound emitting device.

[0022] In the method for generating target response curve data according to the seventh aspect, the step of acquiring the acoustic characteristics is a step of generating, for each of a plurality of subjects, curve A data indicating the amplitude-frequency characteristics of a sound picked up near the eardrum of the subject while emitting a test sound near the ear canal of the subject by an arbitrary ear canal sound emitting device, and generating general-purpose curve A data indicating the amplitude-frequency characteristics by averaging the amplitude-frequency characteristics indicated by the plurality of generated curve A data; and the step of acquiring the sound pressure adjustment characteristics is a step of acquiring, for each of a plurality of subjects, curve A data indicating the amplitude-frequency characteristics by averaging the amplitude-frequency characteristics indicated by the plurality of generated curve A data, and a step of generating general-purpose curve B data indicating amplitude-frequency characteristics obtained by averaging the amplitude-frequency characteristics indicated by the generated plurality of curve B data; and the step of generating target response curve data is a step of generating curve Y data indicating amplitude-frequency characteristics obtained by adding the amplitude-frequency characteristics indicated by the general-purpose curve A data and the amplitude-frequency characteristics indicated by the general-purpose curve B data, as general-purpose target response curve data for the external ear canal sound emitting device used to generate the curve A data and the curve B data or for an external ear canal sound emitting device of the same type as the external ear canal sound emitting device.

[0023] In the method for generating target response curve data according to the seventh aspect, the step of acquiring acoustic characteristics includes generating, for each of a plurality of subjects, curve A data indicating the amplitude-frequency characteristics of a sound picked up near the eardrum of the subject while a test sound is emitted near the ear canal of the subject, and the step of acquiring sound pressure adjustment characteristics includes adjusting the sound pressure of each of the plurality of subjects so that, when band-specific pink noise, which is obtained by dividing a full-audible band pink noise into a plurality of frequency bands, is sequentially emitted near the ear canal of the subject at a reference sound pressure, the band-specific pink noise is perceived as the same loudness as the sound in a reference frequency band among the plurality of frequency bands. a step of adjusting the sound pressure of each of the frequency bands other than the reference frequency band, generating curve B data each indicating an amplitude frequency characteristic indicated by the amount of increase or decrease in sound pressure of each of the plurality of frequency bands specified by the adjustment, and generating the target response curve data is a step of adding together the amplitude frequency characteristic indicated by the curve A data of each of the plurality of subjects and the amplitude frequency characteristic indicated by the curve B data of each of the plurality of subjects, and generating curve Y data indicating an amplitude frequency characteristic averaged over the number of the plurality of subjects as general-purpose target response curve data.

[0024] In the method for generating target response curve data according to the seventh aspect, the step of acquiring acoustic characteristics includes generating, for each of a plurality of subjects, curve A data indicating amplitude-frequency characteristics of a sound picked up near the eardrum of the subject while a test sound is emitted near the ear canal of the subject by an arbitrary ear canal sound emitting device, and the step of acquiring sound pressure adjustment characteristics includes adjusting, for each of a plurality of subjects, curve A data indicating amplitude-frequency characteristics of a sound picked up near the eardrum of the subject while a test sound is emitted near the ear canal of the subject by an ear canal sound emitting device used to generate the curve A data or an ear canal sound emitting device of the same type as the ear canal sound emitting device, so that when band-specific pink noise, which is obtained by dividing a full-band audible range pink noise into a plurality of frequency bands, is sequentially emitted at a reference sound pressure near the ear canal of the subject, the sound is perceived as being the same loudness as the loudness of a sound in a reference frequency band among the plurality of frequency bands. A fifteenth aspect may employ a configuration in which a person adjusts the sound pressure of each of the frequency bands other than the reference frequency band, generates each curve B data indicating an amplitude frequency characteristic indicated by the amount of increase or decrease in sound pressure of each of the plurality of frequency bands specified by the adjustment, and the process of generating the target response curve data is a process of adding together the amplitude frequency characteristic indicated by the curve A data of each of the plurality of subjects and the amplitude frequency characteristic indicated by the curve B data of each of the plurality of subjects, and generating curve Y data indicating an amplitude frequency characteristic averaged over the number of the plurality of subjects, as general-purpose target response curve data for the external ear canal sound emitting device used to generate the curve A data and the curve B data or for external ear canal sound emitting devices of the same type as the external ear canal sound emitting device.

[0025] In addition, in the method for generating target response curve data according to any one of the eighth, tenth, eleventh, thirteenth, fourteenth, and fifteenth aspects described above, a configuration in which the test sound is band-specific pink noise obtained by dividing full-band audible pink noise into a plurality of frequency bands may be adopted as a sixteenth aspect.

[0026] In addition, in the method for generating target response curve data according to any one of the eighth, tenth, eleventh, thirteenth, fourteenth, and fifteenth aspects described above, a configuration in which the test sound is an impulse may be adopted as a seventeenth aspect.

[0027] Furthermore, in the method for generating target response curve data according to any one of the eighth, tenth, eleventh, thirteenth, fourteenth, and fifteenth aspects described above, an eighteenth aspect may be adopted in which the test sound is a sweep sound whose frequency changes continuously or intermittently within the audible range.

[0028] Furthermore, in the method for generating target response curve data according to any one of the eighth, tenth, eleventh, thirteenth, fourteenth, and fifteenth aspects described above, a configuration in which the reference frequency band is a frequency band centered at 500 Hz may be adopted as a nineteenth aspect.

[0029] In addition, in the method for generating target response curve data according to any one of the eighth, tenth, eleventh, thirteenth, fourteenth, and fifteenth aspects described above, a configuration in which the reference sound pressure is 65 dB SPL may be adopted as a twentieth aspect.

[0030] Furthermore, in the method for generating target response curve data according to any one of the eighth, tenth, eleventh, thirteenth, fourteenth, and fifteenth aspects described above, a configuration in which the bandwidth of each of the plurality of frequency bands is 1 / 3 octave may be adopted as a twenty-first aspect.

[0031] In addition, the present invention provides, as a 22nd aspect, target response curve data that removes components that contribute to the perception of directionality of sound generated by the external shape of a person, including at least the head, and sets acoustic characteristics so as to preserve the timbre recognition characteristics of the brain.

[0032] In addition, the present invention provides, as a 23rd aspect, a sound emission device that emits sound with amplitude-frequency characteristics that follow a target response curve that removes components that contribute to the perception of directionality of sound generated by the external shape of a person, including at least the head, and sets acoustic characteristics so as to preserve the timbre recognition characteristics of the brain.

[0033] In addition, the present invention provides, as a 24th aspect, a sound emission device comprising: a sound correction unit that removes components that contribute to the perception of sound directionality generated by the external shape of a person including at least the head, from input sound, and performs correction in accordance with a target response curve that sets acoustic characteristics so as to preserve the timbre recognition characteristics of the brain; and a sound emission unit that emits the sound that has been corrected by the sound correction unit.

[0034] Furthermore, a configuration in which the sound emitting device according to the above-mentioned 23rd or 24th aspect is any one of headphones, earphones, headrest speakers, and a speaker system that generates a virtual sound source may be adopted as a 25th aspect.

[0035] Furthermore, in the sound emitting device according to the above-mentioned 24th aspect, a configuration may be adopted as a 26th aspect, which includes an acquisition unit that acquires target response curve data indicating the target response curve, and a storage unit that stores the target response curve data acquired by the acquisition unit, and the sound correction unit corrects the input sound in accordance with the target response curve indicated by the target response curve data stored in the storage unit.

[0036] In addition, the present invention provides, as a 27th aspect, a sound processing device that includes a sound correction unit that removes components that contribute to the perception of sound directionality generated by the external shape of a person including at least the head from input sound, and performs correction in accordance with a target response curve that sets acoustic characteristics so as to preserve the timbre recognition characteristics of the brain.

[0037] Furthermore, in the sound processing device according to the above-mentioned 27th aspect, a configuration may be adopted as a 28th aspect, which includes an acquisition unit that acquires target response curve data indicating the target response curve, and a memory unit that stores the target response curve data acquired by the acquisition unit, and the sound correction unit corrects the input sound in accordance with the target response curve indicated by the target response curve data stored in the memory unit.

[0038] In addition, the present invention provides, as a 29th aspect, a program for causing a computer to execute a process for correcting an input sound in accordance with a target response curve that removes components that contribute to the perception of sound directionality generated by the external shape of a person including at least the head, and sets acoustic characteristics so as to preserve the timbre recognition characteristics of the brain.

[0039] In addition, the present invention provides, as a thirtieth aspect, a recording medium having recorded thereon a program for causing a computer to execute a process for correcting input sound in accordance with a target response curve that removes components that contribute to the perception of sound directionality generated by the external shape of a person including at least the head, and sets acoustic characteristics so as to preserve the timbre recognition characteristics of the brain.

[0040] Furthermore, the present invention provides, as a 31st aspect, sound data representing sound that has been corrected in accordance with a target response curve that removes components that contribute to the perception of sound directionality generated by the external shape of a person, including at least the head, from the source sound, and sets acoustic characteristics so as to preserve the timbre recognition characteristics of the brain.

[0041] Furthermore, the present invention provides, as a 32nd aspect, a recording medium on which sound data representing a source sound that has been corrected in accordance with a target response curve that removes components that contribute to the perception of sound directionality generated by the external shape of a person, including at least the head, and sets acoustic characteristics so as to preserve the timbre recognition characteristics of the brain.

[0042] In addition, the present invention provides, as a 33rd aspect, an acoustic system comprising: a generation unit that generates stereophonic content indicating, for each of a plurality of sound sources, the sound source position and the sound emitted by the sound source; a binaural rendering unit that generates immersive binaural sound, which is two-channel stereophonic sound, using the stereophonic content generated by the generation unit and a head-related transfer function; and a sound emission unit that emits the immersive binaural sound generated by the binaural rendering unit, wherein the sound emission unit removes components that contribute to the perception of directionality of sound generated by the external shape of a person, including at least the head, and emits sound with amplitude-frequency characteristics that follow a target response curve that sets acoustic characteristics so as to preserve the timbre recognition characteristics of the brain.

[0043] Furthermore, the present invention provides, as a 34th aspect, an acoustic system comprising: a generation unit that generates stereophonic content indicating, for each of a plurality of sound sources, the sound source position and the sound emitted by the sound source; a binaural rendering unit that generates immersive binaural sound, which is two-channel stereophonic sound, using the stereophonic content generated by the generation unit and a head-related transfer function; and a sound emission unit that emits the immersive binaural sound generated by the binaural rendering unit, wherein any of the generation unit, the binaural rendering unit, and the sound emission unit removes components that contribute to the perception of the directionality of sound generated by the external shape of a person, including at least the head, and performs correction in accordance with a target response curve that sets acoustic characteristics so as to maintain the timbre recognition characteristics of the brain.

[0044] In addition, the present invention provides, as a 35th aspect, an acoustic system comprising: a generation unit that generates, for each of a plurality of sound sources, stereophonic content that indicates the sound source position of the sound source and the sound emitted by the sound source; a binaural rendering unit that generates immersive binaural sound, which is two-channel stereophonic sound, using the stereophonic content generated by the generation unit and a head-related transfer function; a sound emission unit that emits the immersive binaural sound generated by the binaural rendering unit; and a sound processing device that is positioned on the sound transmission path from the generation unit to the sound emission unit, and that removes components that contribute to the perception of directionality of sound generated by the external shape of a person that includes at least the head from the input sound, and performs correction in accordance with a target response curve that sets acoustic characteristics so as to preserve the timbre recognition characteristics of the brain.

[0045] Furthermore, in an audio system according to any one of the above-mentioned aspects 33 to 35, when the generation unit is a stereophonic content generation unit, a configuration may be adopted as a 36th aspect, in which the system is provided with an image generation unit that generates an image of a cross-reality three-dimensional space, and a display unit that displays the image generated by the image generation unit, and the binaural rendering unit generates stereophonic content whose sound source is an object in the three-dimensional space shown by the image generated by the image generation unit.

[0046] Furthermore, in the audio system according to any one of the above-mentioned aspects 33 to 35, a configuration may be adopted as aspect 37 in which the generation unit continuously acquires the sound source position of a moving sound source and generates stereophonic content indicating the sound source position.

[0047] In addition, in the acoustic system according to the above-mentioned 37th aspect, a configuration in which the sound emitting unit emits sound near the external ear canal of a listener who moves in accordance with the moving sound source may be adopted as a 38th aspect.

[0048] The present invention also provides a sound output unit that outputs sound to a sound output device that outputs sound near the external ear canal of a subject, a sound acquisition unit that acquires sound picked up by a microphone placed near the eardrum of the subject while the sound output unit is outputting a test sound to the sound output device, a curve A data generation unit that generates curve A data indicating amplitude-frequency characteristics of the sound acquired by the sound acquisition unit, and a notification that prompts the subject to operate an operation device to adjust the sound pressure of each of the frequency bands other than the reference frequency band so that the subject perceives the sound as being the same loudness as the loudness of the sound in the reference frequency band among the plurality of frequency bands while the sound output unit is outputting band-specific pink noise obtained by dividing a full-band audible pink noise into a plurality of frequency bands sequentially at a reference sound pressure to the sound output device. A thirty-ninth aspect provides a target response curve data generation system including: a notification unit; an operation signal acquisition unit that acquires an operation signal corresponding to the operation of the subject from the operation device; a curve B data generation unit that generates curve B data indicating amplitude frequency characteristics that indicate an amount of increase or decrease in sound pressure in each of the plurality of frequency bands based on the operation signal acquired by the operation signal acquisition unit; and a personal target response curve data generation unit that generates, as target response curve data for the subject, curve X data that indicates amplitude frequency characteristics obtained by adding together the amplitude frequency characteristics indicated by the curve A data generated by the curve A data generation unit and the amplitude frequency characteristics indicated by the curve B data generated by the curve B data generation unit.

[0049] The present invention also provides a sound output unit that outputs sound to a sound output device that outputs sound near the external ear canal of a subject; a sound acquisition unit that acquires sound picked up by a microphone attached to the end of an extremely fine tube made of a soft material and inserted near the eardrum of the subject while the sound output unit is emitting a test sound to the sound output device; a curve A data generation unit that generates curve A data indicating the amplitude-frequency characteristics of the sound acquired by the sound acquisition unit; and a sound output unit that operates an operation device to generate curve A data indicating the amplitude-frequency characteristics of the sound acquired by the sound acquisition unit while the sound output unit is outputting band-specific pink noise obtained by dividing a full-band audible pink noise into a plurality of frequency bands at a reference sound pressure to the sound output device, so that the subject perceives the sound as being the same loudness as the sound in a reference frequency band among the plurality of frequency bands. a control signal acquisition unit that acquires an operation signal corresponding to the operation of the subject from the operation device; a curve B data generation unit that generates curve B data indicating amplitude-frequency characteristics indicating an amount of increase or decrease in sound pressure in each of the plurality of frequency bands based on the operation signal acquired by the operation signal acquisition unit; and a personal target response curve data generation unit that generates, as target response curve data for the subject, curve X data indicating amplitude-frequency characteristics obtained by adding together the amplitude-frequency characteristics indicated by the curve A data generated by the curve A data generation unit and the amplitude-frequency characteristics indicated by the curve B data generated by the curve B data generation unit.

[0050] Furthermore, in the target response curve data generation system according to the above-mentioned thirty-ninth or fortieth aspect, a forty-first aspect may be adopted in which the system includes a general-purpose target response curve data generation unit that generates curve Y data that indicates amplitude-frequency characteristics obtained by averaging the amplitude-frequency characteristics indicated by the target response curve data for each of a plurality of subjects generated by the personal target response curve data generation unit as general-purpose target response curve data.

[0051] The present invention also provides a sound output unit that outputs sound to a sound output device that outputs sound near the external ear canal of a subject; a sound acquisition unit that acquires sound picked up by a microphone placed near the eardrum of the subject while the sound output unit is emitting a test sound to the sound output device; a curve A data generation unit that generates curve A data indicating amplitude-frequency characteristics of the sound acquired by the sound acquisition unit; a notification unit that, while the sound output unit is dividing a full-audible band pink noise into a plurality of frequency bands and outputting each of the band-specific pink noises at a reference sound pressure to the sound output device, issues a notification urging the subject to operate an operation device to adjust the sound pressure of each of the frequency bands other than the reference frequency band so that the subject perceives the sound as being the same loudness as the sound of the reference frequency band among the plurality of frequency bands; a curve B data generation unit that generates, based on the operation signal acquired by the operation signal acquisition unit, curve B data that indicates amplitude frequency characteristics that indicate the amount of increase or decrease in sound pressure in each of the plurality of frequency bands; and a general-purpose target response curve data generation unit that generates, as general-purpose target response curve data, curve Y data that indicates amplitude frequency characteristics that are obtained by adding together amplitude frequency characteristics that are obtained by averaging amplitude frequency characteristics that are indicated by the curve A data generated by the curve A data generation unit for each of the plurality of subjects and amplitude frequency characteristics that are obtained by averaging amplitude frequency characteristics that are indicated by the curve B data generated by the curve B data generation unit for each of the plurality of subjects.

[0052] The present invention also provides a sound output unit that outputs sound to a sound output device that outputs sound near the external ear canal of a subject; a sound acquisition unit that acquires sound picked up by a microphone attached to the end of an extremely fine tube made of a soft material and inserted near the eardrum of the subject while the sound output unit is emitting a test sound to the sound output device; a curve A data generation unit that generates curve A data indicating amplitude-frequency characteristics of the sound acquired by the sound acquisition unit; a notification unit that, while the sound output unit is dividing a full-band audible pink noise into a plurality of frequency bands and outputting each of the band-specific pink noises at a reference sound pressure to the sound output device, issues a notification urging the subject to operate an operation device to adjust the sound pressure of each of the frequency bands other than the reference frequency band so that the subject perceives the sound as being the same loudness as the sound in the reference frequency band among the plurality of frequency bands; A forty-third aspect of the present invention provides a target response curve data generation system including: an operation signal acquisition unit that acquires an operation signal corresponding to the operation of the subject from an operation device; a curve B data generation unit that generates, based on the operation signal acquired by the operation signal acquisition unit, curve B data indicating amplitude frequency characteristics indicating the amount of increase or decrease in sound pressure in each of the plurality of frequency bands; and a general-purpose target response curve data generation unit that generates, as general-purpose target response curve data, curve Y data indicating amplitude frequency characteristics obtained by adding together amplitude frequency characteristics obtained by averaging amplitude frequency characteristics indicated by the curve A data generated by the curve A data generation unit for each of the plurality of subjects and amplitude frequency characteristics obtained by averaging amplitude frequency characteristics indicated by the curve B data generation unit for each of the plurality of subjects.

[0053] The present invention also provides a sound output unit that outputs sound to a sound output device that outputs sound near the external ear canal of a subject; a sound acquisition unit that acquires sound picked up by a microphone placed near the eardrum of the subject while the sound output unit is emitting a test sound to the sound output device; a curve A data generation unit that generates curve A data indicating amplitude-frequency characteristics of the sound acquired by the sound acquisition unit; a notification unit that, while the sound output unit is dividing a full-band audible pink noise into a plurality of frequency bands and outputting each of the band-specific pink noises at a reference sound pressure to the sound output device, issues a notification urging the subject to operate an operation device to adjust the sound pressure of each of the frequency bands other than the reference frequency band so that the subject perceives the sound as being the same loudness as the sound of the reference frequency band among the plurality of frequency bands; a curve B data generation unit that generates curve B data indicating amplitude frequency characteristics indicated by the amount of increase or decrease in sound pressure in each of the plurality of frequency bands based on the operation signal acquired by the operation signal acquisition unit; and a general-purpose target response curve data generation unit that generates curve Y data indicating amplitude frequency characteristics averaged over the number of subjects by adding together the amplitude frequency characteristics indicated by the curve A data generated by the curve A data generation unit for each of a plurality of subjects and the amplitude frequency characteristics indicated by the curve B data generation unit for each of a plurality of subjects, the number of which is the same as the number of subjects.

[0054] The present invention also provides a sound output unit that outputs sound to a sound output device that outputs sound near the external ear canal of a subject; a sound acquisition unit that acquires sound picked up by a microphone attached to the end of an extremely fine tube made of a soft material and inserted near the eardrum of the subject while the sound output unit is emitting a test sound to the sound output device; a curve A data generation unit that generates curve A data indicating amplitude-frequency characteristics of the sound acquired by the sound acquisition unit; a notification unit that, while the sound output unit is dividing a full-band audible pink noise into a plurality of frequency bands and outputting each of the band-specific pink noises at a reference sound pressure to the sound output device, issues a notification urging the subject to operate an operation device to adjust the sound pressure of each of the frequency bands other than the reference frequency band so that the subject perceives the sound as being the same loudness as the sound in the reference frequency band among the plurality of frequency bands; A forty-fifth aspect of the present invention provides a target response curve data generation system including: an operation signal acquisition unit that acquires, from a device, an operation signal corresponding to the operation of the subject; a curve B data generation unit that generates, based on the operation signal acquired by the operation signal acquisition unit, curve B data that indicates amplitude frequency characteristics that indicate the amount of increase or decrease in sound pressure in each of the plurality of frequency bands; and a general-purpose target response curve data generation unit that generates, as general-purpose target response curve data, curve Y data that indicates amplitude frequency characteristics averaged over the number of subjects by adding together the amplitude frequency characteristics indicated by the curve A data generated by the curve A data generation unit for each of a plurality of subjects and the amplitude frequency characteristics indicated by the curve B data generation unit for each of a plurality of subjects, the same number as the plurality of subjects.

[0055] In addition, in the target response curve data generation system according to any one of the above-mentioned thirty-ninth, forty-ninth, forty-second, forty-third, forty-fourth, and forty-fifth aspects, a forty-sixth aspect may be adopted in which the test sound is band-specific pink noise obtained by dividing full-band audible pink noise into a plurality of frequency bands.

[0056] In addition, in the target response curve data generation system according to any one of the above-mentioned thirty-ninth, forty-ninth, forty-second, forty-third, forty-fourth, and forty-fifth aspects, a configuration in which the test sound is an impulse may be adopted as a forty-seventh aspect.

[0057] Furthermore, in the target response curve data generation system according to any one of the above-mentioned thirty-ninth, forty-ninth, forty-second, forty-third, forty-fourth and forty-fifth aspects, a forty-eighth aspect may be adopted in which the test sound is a sweep sound whose frequency changes continuously or intermittently within the audible range.

[0058] In addition, in the target response curve data generation system according to any one of the above-mentioned thirty-ninth, forty-ninth, forty-second, forty-third, forty-fourth and forty-fifth aspects, a forty-ninth aspect may be adopted in which the reference frequency band is a frequency band centered at 500 Hz.

[0059] In addition, in the target response curve data generation system according to any one of the thirty-ninth, fortieth, forty-second, forty-third, forty-fourth, and forty-fifth aspects described above, a configuration in which the reference sound pressure is 65 dB SPL may be adopted as a fiftieth aspect.

[0060] In addition, in the target response curve data generation system according to any one of the above-mentioned thirty-ninth, forty-ninth, forty-second, forty-third, forty-fourth and forty-fifth aspects, a configuration in which the bandwidth of each of the plurality of frequency bands is 1 / 3 octave may be adopted as a fifty-first aspect.

[0061] The present invention also provides a computer-implemented method for generating curve A data showing the amplitude-frequency characteristics of the sound acquired in the sound acquisition process, the method including: outputting a test sound to a sound output device that outputs the sound near the external ear canal of a subject; acquiring a sound picked up by a microphone near the eardrum of the subject while the test sound is being output; generating curve A data showing the amplitude-frequency characteristics of the sound acquired in the sound acquisition process; and outputting, to the sound output device, band-specific pink noises obtained by dividing a full-band audible pink noise into a plurality of frequency bands at a reference sound pressure, and, in parallel with the process of outputting the band-specific pink noises, outputting, to the sound output device, band-specific pink noises of frequency bands other than the reference frequency band so that the subject perceives the sound as being the same loudness as the loudness of the band-specific pink noise of a reference frequency band among the plurality of frequency bands. A fifty-second aspect of the present invention provides a program for executing the following processes: outputting a notification prompting the subject to operate an operation device to adjust the sound pressure of the range-specific pink noise; acquiring an operation signal corresponding to the operation performed by the subject on the operation device in response to the notification output in the process of outputting the notification; generating curve B data indicating amplitude-frequency characteristics indicating the amount of increase or decrease in sound pressure in each of the plurality of frequency bands based on the operation signal acquired in the process of acquiring the operation signal; and generating curve X data indicating amplitude-frequency characteristics obtained by adding together the amplitude-frequency characteristics indicated by the curve A data and the amplitude-frequency characteristics indicated by the curve B data, as target response curve data for the subject.

[0062] The present invention also provides a computer-implemented method for outputting a test sound to a sound output device that outputs sound near the external ear canal of a subject; acquiring a sound picked up by a microphone attached to the end of an extremely fine tube made of a soft material and inserted near the eardrum of the subject while the test sound is being output; generating curve A data that indicates the amplitude-frequency characteristics of the sound acquired in the sound acquisition process; and outputting, to the sound output device, band-specific pink noises obtained by dividing a full-band audible pink noise into a plurality of frequency bands at a reference sound pressure, each of which is output at a reference sound pressure, to the sound output device. In parallel with the process of outputting the band-specific pink noises, a notification device that notifies the subject notifies the subject of the reference sound pressure so that the subject perceives the sound as being the same loudness as the loudness of the band-specific pink noise in a reference frequency band among the plurality of frequency bands. A fifty-third aspect of the present invention provides a program for executing the following processes: outputting a notification prompting the subject to operate an operation device to adjust the sound pressure of band-specific pink noise in each of the frequency bands other than the predetermined frequency band; acquiring an operation signal corresponding to the operation performed by the subject on the operation device in response to the notification output in the process of outputting the notification; generating curve B data indicating amplitude-frequency characteristics indicating the amount of increase or decrease in sound pressure in each of the plurality of frequency bands based on the operation signal acquired in the process of acquiring the operation signal; and generating curve X data indicating amplitude-frequency characteristics obtained by adding together the amplitude-frequency characteristics indicated by the curve A data and the amplitude-frequency characteristics indicated by the curve B data, as target response curve data for the subject.

[0063] Furthermore, in the program according to the above-mentioned 52nd or 53rd aspect, a configuration may be adopted as a 54th aspect in which the computer is caused to execute a process of generating curve Y data indicating amplitude-frequency characteristics obtained by averaging the amplitude-frequency characteristics indicated by the curve X data generated in the process of generating the curve X data for each of a plurality of subjects, as general-purpose target response curve data.

[0064] The present invention also provides a computer that performs the following processes: outputting a test sound to a sound emitting device that emits sound near the external ear canal of a subject; acquiring a sound picked up by a microphone near the eardrum of the subject while the test sound is being output; generating curve A data that indicates the amplitude-frequency characteristics of the sound acquired in the sound acquiring process; sequentially outputting band-specific pink noise, which is obtained by dividing full-audible band pink noise into a plurality of frequency bands, at a reference sound pressure to the sound emitting device; and, in parallel with the process of outputting the band-specific pink noise, prompting a notification device that notifies the subject to operate an operation device to adjust the sound pressure of each of the band-specific pink noise in a frequency band other than the reference frequency band so that the subject perceives the band-specific pink noise obtained by dividing the full-audible band pink noise into a plurality of frequency bands as the same loudness as the loudness of the band-specific pink noise in the reference frequency band. a process of outputting a notification indicating that the subject has performed an operation on the operating device in response to the notification output by the subject; a process of generating curve B data indicating amplitude frequency characteristics indicating the amount of increase or decrease in sound pressure in each of the plurality of frequency bands based on the operation signal acquired in the process of acquiring the operation signal; and a process of generating, as general-purpose target response curve data, curve Y data indicating amplitude frequency characteristics obtained by adding together amplitude frequency characteristics obtained by averaging the amplitude frequency characteristics indicated by the curve A data generated in the process of generating the curve A data for each of the plurality of subjects and amplitude frequency characteristics obtained by averaging the amplitude frequency characteristics indicated by the curve B data generated in the process of generating the curve B data for each of the plurality of subjects.

[0065] The present invention also provides a computer-implemented method for outputting a test sound to a sound output device that outputs sound near the external ear canal of a subject; acquiring a sound picked up by a microphone attached to the end of an extremely fine tube made of a soft material and inserted near the eardrum of the subject while the test sound is being output; generating curve A data that indicates the amplitude-frequency characteristics of the sound acquired in the sound acquisition process; sequentially outputting band-specific pink noise, which is obtained by dividing full-audible band pink noise into a plurality of frequency bands, at a reference sound pressure to the sound output device; and, in parallel with the process of outputting the band-specific pink noise, adjusting the sound pressure of each of the band-specific pink noise in a frequency band other than the reference frequency band, which is obtained by dividing the full-audible band pink noise into a plurality of frequency bands, so that the subject perceives the band-specific pink noise as being the same loudness as the sound of the band-specific pink noise in a reference frequency band, in a notification device that notifies the subject. A fifty-sixth aspect of the present invention provides a program for executing the following processes: a process of outputting a notification urging the subject to perform an operation on an operation device; a process of acquiring an operation signal corresponding to the operation performed by the subject on the operation device in response to the notification output in the process of outputting the notification; a process of generating curve B data indicating amplitude frequency characteristics indicated by the amount of increase or decrease in sound pressure in each of the plurality of frequency bands based on the operation signal acquired in the process of acquiring the operation signal; and a process of generating, as general-purpose target response curve data, curve Y data indicating amplitude frequency characteristics obtained by adding together amplitude frequency characteristics obtained by averaging amplitude frequency characteristics indicated by the curve A data generated in the process of generating the curve A data for each of the plurality of subjects and amplitude frequency characteristics obtained by averaging amplitude frequency characteristics indicated by the curve B data generated in the process of generating the curve B data for each of the plurality of subjects.

[0066] The present invention also provides a computer-implemented method for outputting a test sound to a sound output device that outputs sound near the external ear canal of a subject, a method for acquiring a sound picked up by a microphone near the eardrum of the subject while the test sound is being output, a method for generating curve A data indicating the amplitude-frequency characteristics of the sound acquired in the sound acquisition method, a method for sequentially outputting band-specific pink noise obtained by dividing a full-audible band pink noise into a plurality of frequency bands at a reference sound pressure to the sound output device, and a method for prompting a notification device that notifies the subject, in parallel with the process of outputting the band-specific pink noise, to operate an operation device to adjust the sound pressure of each of the band-specific pink noise in a frequency band other than the reference frequency band so that the subject perceives the band-specific pink noise obtained by dividing the full-audible band pink noise into a plurality of frequency bands as the same loudness as the loudness of the band-specific pink noise in the reference frequency band. a process for outputting a notification to the subject; a process for acquiring an operation signal corresponding to an operation performed by the subject on the operation device in response to the notification output by the subject in the process for outputting the notification; a process for generating curve B data indicating amplitude frequency characteristics indicated by the amount of increase or decrease in sound pressure in each of the plurality of frequency bands based on the operation signal acquired in the process for acquiring the operation signal; and a process for generating, as general-purpose target response curve data, curve Y data indicating amplitude frequency characteristics averaged over the number of the plurality of subjects by adding together the amplitude frequency characteristics indicated by the curve A data generated in the process for generating the curve A data for each of the plurality of subjects and the amplitude frequency characteristics indicated by the curve B data generated in the process for generating the curve B data for each of a plurality of subjects, the same number as the plurality of subjects.

[0067] The present invention also provides a computer-implemented method for outputting a test sound to a sound output device that outputs sound near the external ear canal of a subject; a process for acquiring a sound picked up by a microphone attached to the end of an extremely fine tube made of a soft material and inserted near the eardrum of the subject while the test sound is being output; a process for generating curve A data that indicates the amplitude-frequency characteristics of the sound acquired in the sound acquisition process; a process for sequentially outputting band-specific pink noises, which are obtained by dividing a full-audible range pink noise into a plurality of frequency bands, at a reference sound pressure to the sound output device; and, in parallel with the process for outputting the band-specific pink noises, a notification device that notifies the subject adjusts the sound pressure of each of the band-specific pink noises in a frequency band other than the reference frequency band so that the subject perceives the band-specific pink noises, which are obtained by dividing the full-audible range pink noise into a plurality of frequency bands, as being the same loudness as the sound of the band-specific pink noise in a reference frequency band. a process of outputting a notification urging the subject to perform the above operation on an operating device in response to the notification output by the subject in the process of outputting the notification; a process of generating curve B data indicating amplitude frequency characteristics indicated by the amount of increase or decrease in sound pressure in each of the plurality of frequency bands based on the operation signal acquired in the process of acquiring the operation signal; and a process of generating, as general-purpose target response curve data, curve Y data indicating amplitude frequency characteristics averaged over the number of the plurality of subjects by adding together the amplitude frequency characteristics indicated by the curve A data generated in the process of generating curve A data for each of the plurality of subjects and the amplitude frequency characteristics indicated by the curve B data generated in the process of generating curve B data for each of a plurality of subjects, the same number as the plurality of subjects.

[0068] In addition, in the program according to any one of the above-mentioned fifty-second, fifty-third, fifty-fifth, fifty-sixth, fifty-seventh and fifty-eighth aspects, a fifty-ninth aspect may be adopted in which the test sound is band-specific pink noise obtained by dividing a full-band audible pink noise into a plurality of frequency bands.

[0069] In addition, in the program according to any one of the above-mentioned fifty-second, fifty-third, fifty-fifth, fifty-sixth, fifty-seventh and fifty-eighth aspects, a configuration in which the test sound is an impulse may be adopted as a sixtieth aspect.

[0070] In addition, in the program according to any one of the above-mentioned aspects 52, 53, 55, 56, 57 and 58, a configuration in which the test sound is a sweep sound whose frequency changes continuously or intermittently within the audible range may be adopted as aspect 61.

[0071] In addition, in the program according to any one of the above-mentioned aspects 52, 53, 55, 56, 57 and 58, a configuration in which the reference frequency band is a frequency band centered at 500 Hz may be adopted as aspect 62.

[0072] In addition, in the program according to any one of the above-mentioned fifty-second, fifty-third, fifty-fifth, fifty-sixth, fifty-seventh and fifty-eighth aspects, a configuration in which the reference sound pressure is 65 dB SPL may be adopted as a sixty-third aspect.

[0073] In addition, in the program according to any one of the above-mentioned aspects 52, 53, 55, 56, 57 and 58, a configuration in which the bandwidth of each of the plurality of frequency bands is 1 / 3 octave may be adopted as aspect 64.

[0074] When immersive binaural sound is emitted using an ear canal sound emission device with amplitude-frequency characteristics indicated by the target response curve data of the present invention, the listener can perceive a three-dimensional acoustic space impression that is closer to the three-dimensional acoustic space impression intended by the creator of the sound source of the immersive binaural sound, compared to when an ear canal sound emission device according to conventional technology is used.

[0075] FIG. 1 is a diagram showing the configuration of a target response curve data generation system according to an embodiment. FIG. 1 is a diagram showing the configuration of a data processing device that generates curve A data according to an embodiment. FIG. 2 is a diagram showing an example of a processing flow performed by a data processing device according to an embodiment to generate curve A data. FIG. 2 is a diagram showing the configuration of a data processing device that generates curve B data according to an embodiment. FIG. 3 is a diagram showing an example of a processing flow performed by a data processing device according to an embodiment to generate curve B data. FIG. 4 is a diagram showing an example of a user interface displayed by a data processing device according to an embodiment. FIG. 3 is a diagram showing the configuration of a data processing device that generates curve X data according to an embodiment. FIG. 4 is a diagram showing an example of a processing flow performed by a data processing device according to an embodiment to generate curve X data. FIG. 5 is a diagram showing the configuration of a data processing device that generates curve Y data according to an embodiment. FIG. 6 is a diagram showing an example of a processing flow performed by a data processing device according to an embodiment to generate curve Y data. Graphs showing a target response curve generated by a data processing device according to an embodiment and a target response curve created based on an anechoic chamber. FIG. 6 is a diagram showing the configuration of an acoustic system according to an embodiment. FIG. 7 is a diagram showing the configuration of an audiovisual system according to a modified example.

[0076] [Embodiment] Target response curve data according to one embodiment of the present invention will be described below.

[0077] The target response curve data generation system 1 is a system for generating target response curve data according to one embodiment of the present invention. The target response curve data generation system 1 includes a computer 11, an audio interface 12 connected to the computer 11, headphones 13 connected to the audio interface 12, and a microphone 14 connected to the audio interface 12.

[0078] The computer 11 includes a memory for storing various data including programs, a processor for processing data according to the programs stored in the memory, a display for displaying information to the subject (user) under the control of the processor, and an operating device (keyboard, mouse, etc.) for receiving user operations and outputting signals corresponding to the operations to the processor.

[0079] It is also possible to adopt a configuration in which one or more of a part of the memory, the display, and the operation device are connected as external devices to the main body of the computer 11, which includes a processor and at least a part of the memory. Also, the computer 11 may include a composite device such as a touch screen in which the display and the operation device are integrated.

[0080] The audio interface 12 is a device that combines a D / A (Digital to Analog) converter that converts digital sound data input from the computer 11 into an analog sound signal and outputs it to the headphones 13, and an A / D (Analog to Digital) converter that converts analog sound signals input from the microphone 14 into digital sound data and outputs it to the computer 11.

[0081] The headphones 13 are sound emitting devices that emit sounds represented by analog sound signals input from the audio interface 12 near the left and right external ear canals of the user.

[0082] The microphone 14 is a sound-collecting device that is placed near the left and right eardrums of the user, picks up sound, and outputs an analog sound signal indicating the picked-up sound to the audio interface 12.

[0083] For example, the microphone 14 is attached to the end of an extremely fine tube made of a soft material that is inserted near the left and right eardrums of the user.

[0084] The target response curve data generation system 1 generates curve Y data that indicates a general-purpose target response curve called curve Y in this embodiment, that is, a target response curve for any listener (not limited to a specific listener). The generation of this curve Y data is performed mainly through the following steps: (1) Generation of curve A data (2) Generation of curve B data (3) Generation of curve X data (4) Generation of curve Y data

[0085] Note that either the curve A data generation step (1) or the curve B data generation step (2) can be performed first. The curve X data generation step (3) is performed using the curve A data generated in step (1) and the curve B data generated in step (2), so it is performed after steps (1) and (2). Furthermore, the curve Y data generation step (4) is performed using the curve X data generated in step (3), so it is performed after step (3).

[0086] (1) Generation of Curve A Data The following describes the operation performed by the target response curve data generation system 1 to generate the curve A data.

[0087] 2 is a diagram showing the configuration of a data processing device (an example of a system for generating target response curve data) realized by the computer 11 when generating the curve A data. That is, the computer 11 functions as a device having the components shown in FIG. 2 by performing data processing in accordance with a program for generating the curve A data.

[0088] The components shown in FIG. 2 will be described below. The storage unit 110 stores various data. The storage unit 110 prestores test sound data indicating the waveforms of band-specific pink noises obtained by dividing the full-audible-range pink noise into ⅓-octave bandwidths. The same test sound data must always be used for multiple subjects. The amplitude of the full-audible-range pink noise that is the source of the test sound may be determined arbitrarily as long as the sound pressure level at which the test sound data is emitted does not burden the subject. However, in this embodiment, the same test sound is used as the test sound for generating the curve A data and the curve B data. Therefore, the amplitude must be adjusted so that when a signal extracted from the full-audible-range pink noise in a ⅓-octave bandwidth with a center frequency of 500 Hz is emitted through headphones, the sound pressure level near the eardrum of the subject's left or right ear is 65 dB SPL. This value of 65 dB SPL is equivalent to the sound pressure level near the eardrum of band-specific pink noise with a 1 / 3 octave bandwidth and a center frequency of 500 Hz when reproducing the curve B data. Hereinafter, the frequency bands of these band-specific pink noises will be referred to as the first frequency band, the second frequency band, ..., the nth frequency band, in order of decreasing frequency. Note that if the audible range (approximately 10 octaves) is divided into 1 / 3 octave bandwidths, the number of frequency bands will be approximately 30, which is desirable because it allows for the generation of the curve A data described below to be obtained with appropriate accuracy without placing an excessive burden on the subject. The same applies to the pink noise used to generate the curve B data described below.

[0089] The sound output unit 111 outputs sound data representing a test sound for generating the curve A data to the audio interface 12. In this embodiment, the test sound for generating the curve A data is band-specific pink noise represented by test sound data stored in the storage unit 110 for each of n frequency bands from the first frequency band to the nth frequency band. The sound output unit 111 reads the test sound data from the storage unit 110 for each of the n frequency bands, generates sound data representing test sounds for two left and right channels (the same sound on the left and right), and outputs the sound data to the audio interface 12.

[0090] The sound acquisition unit 112 acquires, from the audio interface 12, sound data for each of the n frequency bands, indicating sounds of two left and right channels picked up by the left and right microphones 14 while a test sound of that frequency band is being emitted from the headphones 13. The sound data acquired by the sound acquisition unit 112 is temporarily stored in the storage unit 110.

[0091] The band-by-band amplitude frequency characteristic specifying unit 113 specifies, for each of the n frequency bands, the amplitude values ​​of each of the two left and right channel sounds indicated by the sound data acquired by the sound acquisition unit 112 and temporarily stored in the storage unit 110, and generates band-by-band amplitude value data indicating the specified amplitude values. The band-by-band amplitude frequency characteristic specifying unit 113 generates, for each of the n frequency bands, the band-by-band amplitude value data being temporarily stored in the storage unit 110.

[0092] The curve A data generator 114 interpolates band-specific amplitude value data (discrete values) for each of the n frequency bands that are temporarily stored in the storage unit 110 to determine the amplitude frequency characteristics over the entire audible range. The amplitude frequency characteristics determined in this manner are called curve A. The curve A data generator 114 generates curve A data that indicates curve A. The curve A data generated by the curve A data generator 114 is temporarily stored in the storage unit 110. When the curve A data is plotted on a two-dimensional graph with amplitude (dB) on the vertical axis and frequency (Hz) on the horizontal axis, two curves A (amplitude frequency characteristics) for the left and right channels, i.e., for each of the left and right ears of the subject, can be illustrated.

[0093] Curve A shows the acoustic characteristics of the sound from the subject's outer ear canal to the eardrum, which are specific to the headphones used in the measurement.

[0094] 3 is a diagram showing an example of a flow of processing performed by the computer 11 functioning as the device having the above configuration to generate curve A data. The processing following the flow shown in FIG. 3 will be described below.

[0095] First, the computer 11 assigns an initial value "1" to a counter i (step S101).

[0096] Next, the computer 11 (sound output unit 111) outputs sound data representing the test sound in the i-th frequency band to the audio interface 12 (step S102). The audio interface 12 outputs a sound signal obtained by D / A converting the sound data input from the computer 11 to the headphones 13. The headphones 13 emits a sound represented by the sound signal input from the audio interface 12.

[0097] In parallel with the process of step S102, the computer 11 (sound acquisition unit 112) acquires sound data indicating the sound picked up by the microphone 14 from the audio interface 12 (step S103).

[0098] Next, the computer 11 (band-by-band amplitude frequency characteristic specifying unit 113) specifies the amplitude value of the sound indicated by the sound data related to the i-th frequency band acquired in step S103, and generates band-by-band amplitude value data indicating the specified amplitude value (step S104). The computer 11 (storage unit 110) temporarily stores the band-by-band amplitude value data generated in step S104.

[0099] Next, the computer 11 determines whether the counter i is n (step S105).

[0100] If the counter i is not n (step S105; "No"), the computer 11 increments the counter i by "1" (step S106), and repeats the processes from step S102 to S103 for the new i-th frequency band.

[0101] If the counter i is n (step S105; "Yes"), the computer 11 (curve A data generator 114) interpolates the n temporarily stored band-specific amplitude value data (discrete values) to identify the amplitude-frequency characteristics across the entire audible range, i.e., curve A, and generates curve A data indicating the identified curve A (step S107). The computer 11 (storage unit 110) temporarily stores the curve A data generated in step S107. Thereafter, the computer 11 ends the series of processes for generating the curve A data.

[0102] (2) Generation of Curve B Data The following describes the operation performed by the target response curve data generation system 1 to generate the curve B data.

[0103] 4 is a diagram showing the configuration of a data processing device (an example of a system for generating target response curve data) realized by the computer 11 when generating the curve B data. That is, the computer 11 functions as a device having the components shown in FIG. 4 by performing data processing in accordance with a program for generating the curve B data.

[0104] The components shown in Fig. 4 will be described below. In Fig. 4, components common to those shown in Fig. 2 are denoted by the same reference numerals as those used in Fig. 2.

[0105] The storage unit 110 stores various data. The storage unit 110 stores test sound data indicating the waveform of band-specific pink noise for each of n frequency bands, each having a 1 / 3 octave bandwidth, from a first frequency band to an nth frequency band.

[0106] The sound output unit 111 outputs sound data representing test sounds for generating curve B data to the audio interface 12. In this embodiment, the test sounds for generating curve B data are the same as the test sounds for generating curve A data. That is, the sound output unit 111 reads test sound data for each of the n frequency bands from the storage unit 110, generates sound data representing test sounds for two left and right channels (the same sound on the left and right), and outputs the sound data to the audio interface 12.

[0107] The operation signal acquisition unit 115 acquires a signal (operation signal) generated by an operation device (keyboard, mouse, etc.) of the computer 11 in response to a user's operation on the operation device.

[0108] Based on the operation signal acquired by the operation signal acquisition unit 115, the band-specific sound pressure increase / decrease amount specifying unit 116 specifies the amount of increase / decrease in sound pressure level (dB SPL) when the subject adjusts the sound pressure of the test sound in the kth frequency band, which is the reference frequency band (hereinafter referred to as the "reference test sound"), so that the loudness (loudness) perceived by the subject when listening to the test sound in each of the first frequency band to the nth frequency band (excluding the kth frequency band) (hereinafter referred to as the "comparison test sound") is perceived to be equal to the loudness (loudness) perceived by the subject when listening to the latter test sound.

[0109] In this embodiment, the kth frequency band, which is the reference frequency band, is a frequency band centered around 500 Hz. Note that sounds around 500 Hz are sounds that many listeners can easily recognize as loud, so it is easy to adjust the volume of test sounds in other frequency bands to be equal to this reference sound. In this embodiment, the sound pressure of the reference test sound is 65 dB SPL. Note that sounds with a sound pressure around 65 dB SPL are neither too loud nor too quiet for many listeners, making it easy to adjust the volume and less likely to burden the listener.

[0110] The band-specific sound pressure increase / decrease amount specifying unit 116 generates sound pressure increase / decrease amount data indicating the specified sound pressure increase / decrease amount for each of the first to nth frequency bands (excluding the kth frequency band). The sound pressure increase / decrease amount data generated by the band-specific sound pressure increase / decrease amount specifying unit 116 is temporarily stored in the storage unit 110.

[0111] The curve B data generation unit 117 interpolates the sound pressure increase / decrease amounts (discrete values) indicated by the sound pressure increase / decrease amount data temporarily stored in the storage unit 110 for each of the n frequency bands (excluding the kth frequency band), to specify amplitude frequency characteristics over the entire audible range. The amplitude frequency characteristics specified in this manner are called curve B. The curve B data generation unit 117 generates curve B data indicating curve B. The curve B data generated by the curve B data generation unit 117 is temporarily stored in the storage unit 110.

[0112] Curve B indicates the sound pressure adjustment characteristics that allow the subject to perceive the sound volume as constant across the entire audible range.

[0113] 5 is a diagram showing an example of a flow of processing performed by the computer 11 functioning as the device having the above configuration to generate curve B data. The processing following the flow shown in FIG. 5 will be described below.

[0114] First, the computer 11 assigns an initial value of "1" to a counter j (step S20). Then, the computer 11 assigns an initial value of "1" to a counter i (step S201).

[0115] Next, the computer 11 (sound output unit 111) alternately outputs sound data representing the reference test sound and sound data representing the comparison test sound of the i-th frequency band to the audio interface 12 (step S202). The audio interface 12 outputs a sound signal obtained by D / A converting the sound data input from the computer 11 to the headphones 13. The headphones 13 emit a sound represented by the sound signal input from the audio interface 12.

[0116] In parallel with the process of step S202, the computer 11 displays a user interface such as that shown in FIG. 6 on a display (an example of a notification device or notification unit) (step S203).

[0117] 6A shows a user interface displayed on the display of the computer 11 while sound data representing the reference test sound is being output to the audio interface 12 in step S202. That is, while the reference test sound is being emitted from the headphones 13, the computer 11 notifies the user to memorize the loudness of the reference test sound.

[0118] 6B shows a user interface displayed on the display of the computer 11 while sound data representing the comparison test sound of the i-th frequency band is being output to the audio interface 12 in step S202. That is, while the comparison test sound is being emitted from the headphones 13, the computer 11 prompts the user to operate a virtual control (e.g., a fader; hereinafter, for convenience, referred to as the "fader") so that the loudness of the comparison test sound is perceived as equal to the loudness of the stored reference test sound, and accepts the user's operation of the fader. The computer 11 determines the amount of increase or decrease in sound pressure based on an operation signal obtained from an operation device (e.g., a mouse) in response to the user's operation of the fader, and increases or decreases the amplitude of the sound data of the comparison test sound output to the audio interface 12 according to the determined amount of increase or decrease in sound pressure. The computer 11 also accepts the user's operation of a virtual "Done" button displayed on the user interface of FIG. 6B.

[0119] The computer 11 (operation signal acquisition unit 115) acquires an operation signal output by an operation device (such as a mouse) when a user operates the user interface shown in Fig. 6(B) using the operation device. If the computer 11 (band-specific sound pressure increase / decrease amount identification unit 116) determines that the acquired operation signal is an operation on the "Done" button, it generates sound pressure increase / decrease amount data indicating the increase / decrease amount of the sound pressure of the comparison test sound indicated by the fader position at that time (Fig. 5, step S204). The computer 11 (storage unit 110) temporarily stores the sound pressure increase / decrease amount data generated in step S204.

[0120] Next, the computer 11 determines whether the counter i is equal to n (FIG. 5, step S205).

[0121] If the counter i is not equal to n (step S205; "No"), the computer 11 adds "1" to the counter i (step S206).

[0122] Next, the computer 11 determines whether the counter i is k (step S207).

[0123] If the counter i is not k (step S207; "No"), the computer 11 repeats the processes from step S202 to step S203 onwards for the new i-th frequency band.

[0124] If the counter i is k (step S207; "Yes"), the computer 11 repeats the process from step S206 onwards. That is, by repeating step S206 twice, the process from steps S202 and S203 onwards when the counter i is k (i.e., the meaningless process when the comparison test sound is the reference test sound) is skipped.

[0125] In the determination of step S205, if the counter i is n (step S205; "Yes"), the computer 11 (curve B data generation unit 117) interpolates the sound pressure increase / decrease amounts (discrete values) indicated by the temporarily stored (n-1) sound pressure increase / decrease amount data to identify the amplitude-frequency characteristics over the entire audible range, i.e., curve B, and generates curve B data indicating the identified curve B (step S208). The computer 11 (storage unit 110) temporarily stores the curve B data generated in step S208.

[0126] Next, the computer 11 determines whether the counter j is 2 (step S209). If the counter j is not 2 (step S209; "No"), the computer 11 increments the counter j by 1 (step S210) and then repeats the processing from step S201 onwards. However, in the second processing of step S202, the comparison test sound is emitted at the sound pressure adjusted by the subject the first time, i.e., at a sound pressure obtained by adding the increase or decrease indicated by the temporarily stored sound pressure increase or decrease data corresponding to the i-th frequency band to 65 dB SPL.

[0127] In other words, the subject can check the results of his or her adjustments in each frequency band, and if the subject determines that the volume of the reference test sound and the comparison test sound in each frequency band are different, he or she can increase or decrease the amplitude of the sound data of the comparison test sound output to the audio interface 12 in the processing of steps S202 to S204, just as in the first time.

[0128] After that, when the second execution of step S208 is completed, the computer 11 determines in step S209 that the counter j is 2 (step S209; "Yes"), and ends the series of processes for generating the curve B data. In this way, the desired curve B data is obtained.

[0129] The second processing of steps S202 to S208 is not essential, but is preferably performed in order to improve the accuracy of the adjustment results by the subject. Also, in the above example, the processing of changing the comparison test sound from the comparison test sound with the lowest frequency band to the comparison test sound with the highest frequency band is repeated twice each time step S202 is repeated, but the order in which the comparison test sounds are emitted is not limited to this. For example, an embodiment in which the frequency of the reference test sound is lowered from the kth frequency band to the (k-1)th frequency band, the (k-2)th frequency band, ..., the first frequency band, and the volume of the comparison test sound in each frequency band is adjusted to be the same as that of the reference test sound, then the sound pressure of the comparison test sound in each frequency band is adjusted while increasing the frequency from the first frequency band to the (k-1)th frequency band, next the sound pressure of the comparison test sound in each frequency band is adjusted while increasing the frequency from the (k+1)th frequency band to the nth frequency band, and finally the sound pressure of the comparison test sound in each frequency band is adjusted while decreasing the frequency from the nth frequency band to the (k+1)th frequency band, thereby completing the series of processes, is also recommended.

[0130] (3) Generation of Curve X Data The following describes the operation performed by the target response curve data generation system 1 to generate the curve X data.

[0131] 7 is a diagram showing the configuration of a data processing device (an example of a system for generating target response curve data) realized by the computer 11 when generating the curve X data. That is, the computer 11 performs data processing according to a program for generating the curve X data, thereby functioning as a device having the components shown in FIG.

[0132] The components shown in Fig. 7 will be described below. In Fig. 7, components that are common to the components shown in Fig. 2 or 4 are assigned the same reference numerals as those used in Fig. 2 or 4.

[0133] The storage unit 110 stores various data, including curve A data and curve B data.

[0134] The individual target response curve data generating unit 118 reads out the curve A data and the curve B data from the storage unit 110, and generates curve X data indicating amplitude-frequency characteristics obtained by adding together the amplitude-frequency characteristics indicated by the curve A data and the amplitude-frequency characteristics indicated by the curve B data. The curve X data generated by the individual target response curve data generating unit 118 is stored in the storage unit 110. The curve X data generated in this manner is data indicating a target response curve for the subject involved in the generation of the curve X data.

[0135] The curve X indicated by the curve X data generated as described above is most effective when it is used as a target response curve referenced by an external ear canal sound emitting device of the same type as the external ear canal sound emitting device used to generate the curve X data (including the external ear canal sound emitting device itself used to generate the curve X data). However, the curve X indicated by the curve X data may also be used as a target response curve referenced by an external ear canal sound emitting device of a type different from the external ear canal sound emitting device used to generate the curve X data.

[0136] 8 is a diagram showing a flow of processing performed by the computer 11 functioning as the device having the above configuration to generate curve X data. That is, the computer 11 (personal target response curve data generating unit 118) adds the amplitude frequency characteristics indicated by the curve A data and the amplitude frequency characteristics indicated by the curve B data to generate curve X data (step S301). The computer 11 (storage unit 110) stores the curve X data generated in step S301. Thereafter, the computer 11 ends the processing for generating the curve X data.

[0137] In the curve X, the absolute value of the amplitude value of each frequency has no significance, but the relative value, that is, the relative relationship of the amplitude values ​​of each frequency, is significant.

[0138] (4) Generation of Curve Y Data The following describes the operation performed by the target response curve data generation system 1 to generate the curve Y data.

[0139] First, the curve Y data is generated using the curve X data generated for each of the multiple subjects. Therefore, prior to generating the curve Y data, the generation of the curve A data, the generation of the curve B data, and the generation of the curve X data described above must be performed for each of the multiple subjects.

[0140] 9 is a diagram showing the configuration of a data processing device (an example of a system for generating target response curve data) realized by the computer 11 when generating the curve Y data. That is, the computer 11 performs data processing according to a program for generating the curve Y data, thereby functioning as a device having the components shown in FIG.

[0141] The components shown in Fig. 9 will be described below. In Fig. 9, components that are common to the components shown in Fig. 2, Fig. 4, or Fig. 7 are assigned the same reference numerals as those used in Fig. 2, Fig. 4, or Fig. 7.

[0142] The storage unit 110 stores various data, including curve X data for each of a plurality of subjects.

[0143] The general-purpose target response curve data generator 119 reads out a plurality of curve X data from the storage unit 110, and generates curve Y data indicating amplitude-frequency characteristics by averaging the amplitude-frequency characteristics indicated by the curve X data. The curve Y data generated by the general-purpose target response curve data generator 119 is stored in the storage unit 110. The curve Y data generated in this manner is general-purpose, i.e., data indicating a target response curve for any listener.

[0144] 10 is a diagram showing a flow of processing performed by the computer 11 functioning as the device having the above configuration to generate curve Y data. Specifically, the computer 11 (general-purpose target response curve data generating unit 119) averages the amplitude-frequency characteristics indicated by the curve X data for each of a plurality of subjects to generate curve Y data (step S401). The computer 11 (storage unit 110) stores the curve Y data generated in step S401. Thereafter, the computer 11 ends the processing for generating the curve Y data.

[0145] In the curve Y, the absolute value of the amplitude value of each frequency has no significance, but the relative value, that is, the relative relationship of the amplitude values ​​of each frequency, has significance.

[0146] Curve X data indicating a target response curve for each subject is generated by the processing of the target response curve data generation system 1. Curve Y data indicating a target response curve for any listener is also generated by the processing of the target response curve data generation system 1.

[0147] The curve Y indicated by the curve Y data generated as described above is most effective when used as a target response curve referenced by an external ear canal sound emitting device of the same type as the external ear canal sound emitting device used to generate the curve X data used to generate the curve Y data (including the external ear canal sound emitting device itself used to generate the curve X data). However, the curve Y indicated by the curve Y data may also be used as a target response curve referenced by an external ear canal sound emitting device of a type different from the external ear canal sound emitting device used to generate the curve X data used to generate the curve Y data.

[0148] The curve X data generated by the processing of the target response curve data generating system 1 described above indicates the curve X for each of the left and right ears of an individual subject. However, for many subjects, the curve X for each of the left and right ears is similar. Therefore, the curve X data may indicate the curve X for only one of the left and right ears of the subject. Alternatively, the curve X data may indicate the curve X obtained by averaging the curves X for each of the left and right ears of the subject. However, in the case of a subject in which the X curves for each of the left and right ears differ greatly, it is preferable to use the curve X for each of the left and right ears.

[0149] Furthermore, the curve Y data generated by the processing of the target response curve data generation system 1 described above also indicates the curve Y for each of the left and right ears. However, the curve Y obtained by averaging the curves X for the left ears of many subjects and the curve Y obtained by averaging the curves X for the right ears of many subjects are similar. Therefore, the curve Y data may indicate the curve Y for only one of the left or right ear. Furthermore, the curve Y data may indicate the curve Y obtained by averaging the curves Y for each of the left and right ears.

[0150] Experiments have confirmed that immersive binaural sound emitted by headphones or earphones manufactured with Curve Y as a reference has a higher degree of reproducibility in terms of the spatial impression of sound, i.e., sound image localization and spatial width, or the feeling of being surrounded by sound (listener envelopment, LEV), than immersive binaural sound emitted by conventional headphones or earphones.

[0151] When a subject who was involved in the creation of curve X listens to immersive binaural sound emitted through headphones or earphones manufactured with curve X as a reference, the effects described above regarding curve Y become more pronounced.

[0152] The above-mentioned curve X or curve Y is a target response curve that removes components that contribute to the perception of the directionality of sound generated by the external shape of a person, including at least the head, and sets acoustic characteristics so as to preserve the timbre recognition characteristics of the brain.

[0153] In other words, an ear canal sound emission device with the amplitude-frequency characteristics of curve X or curve Y emits sound that retains the timbre information while blanking out (reducing) only the position information of the position information and timbre information contained in the input stereo sound.

[0154] Curve A represents the amplitude-frequency characteristics of headphones or earphones observed near the eardrum of a subject wearing the headphones or earphones. Curve B serves the purpose of correcting the amplitude-frequency characteristics of the headphones or earphones worn, solely to enable the listener to correctly recognize timbre. It is important to note that Curve B does not contain any information related to human sound direction perception. Therefore, by adding Curve A and Curve B, the target response curve data generation system 1 removes components that contribute to the perception of sound directionality generated by the external shape of a person, including at least the head, and identifies a target response curve (Curve X or Curve Y) that sets acoustic characteristics so as to maintain the brain's timbre recognition characteristics, and generates target response curve data that represents that target response curve.

[0155] FIG. 11 is a graph showing the curve Y and the target response curve T created based on an anechoic chamber.

[0156] In Figure 11, the elliptical portion of the target response curve T serves to emphasize positional information to impart a sense of depth to two-channel stereo sound. Immersive binaural sound already contains positional information that imparts a sense of depth. Therefore, when an external ear canal sound-emitting device with amplitude-frequency characteristics conforming to the target response curve T emits immersive binaural sound, unnecessary positional information is emphasized. As a result, the sound image localization direction and sense of distance in three-dimensional space from the sound source, the sense of width, direction, and sense of distance in three-dimensional space from left and right, front and back, and up and down resulting from a combination of multiple sound sources (composite sound source), and the sense of spaciousness of the sound field resulting from reflected sound are not reproduced as intended by the creator of the original sound source. This is a common problem with conventional target response curves intended for listening to two-channel stereo sound, such as the Harman target response curve.

[0157] On the other hand, when an external ear canal sound emission device with an amplitude-frequency characteristic that follows curve Y (or curve X) emits immersive binaural sound, the unnecessary positional information described above is not emphasized in the original immersive binaural sound, and at the same time, the amplitude-frequency characteristic derived from the loudness adjustment by the subject causes almost no change in timbre information. As a result, the sound image localization direction and sense of distance in the three-dimensional space of the sound source, the sense of width, direction, and distance in the left-right, front-back, and up-and-down three-dimensional space resulting from the combination of multiple sound sources (composite sound source), and even the sense of spaciousness of the sound field resulting from reflected sound are reproduced exactly as intended by the producer of the original sound source.

[0158] The above is the description of the target response curve data generating system 1.

[0159] FIG. 12 is a diagram showing the configuration of an acoustic system 2 that uses the target response curve data (curve X data or curve Y data) generated by the target response curve data generating system 1.

[0160] The sound system 2 includes a stereophonic content generating device 21 , a binaural rendering device 22 , a sound reproducing device 23 , and a sound emitting device 24 .

[0161] The stereophonic content generation device 21 (a generation unit, an example of a stereophonic content generation unit) is a device used by a producer A who produces stereophonic content to produce the stereophonic content. Note that the stereophonic content generation device 21 may be composed of a plurality of devices (systems) that operate in conjunction with each other.

[0162] The stereophonic content data representing the stereophonic content generated by the stereophonic content generating device 21 includes sound source position data representing the sound source position of each of a plurality of sound sources, and sound data representing the sound emitted by the sound source.

[0163] The stereophonic content generating device 21 may generate the stereophonic content using any of a channel-based method, an object-based method, a combination of these methods, and the like.

[0164] The stereophonic content data generated by the stereophonic content generation device 21 is delivered to the binaural rendering device 22 via a transfer path R1. The transfer path R1 may be in any form, such as wired, wireless, a communication network, a recording medium, or a combination thereof. The stereophonic content generation device 21 and the binaural rendering device 22 may also be configured as an integrated unit. In this case, the transfer path R1 is configured by signal lines within the device.

[0165] The binaural rendering device 22 (an example of a binaural rendering unit) is a device that generates immersive binaural sound, which is a two-channel stereophonic sound, using the stereophonic content indicated by the stereophonic content data generated by the stereophonic content generation device 21 and a head-related transfer function. Note that the binaural rendering device 22 may be configured from a plurality of devices (systems) that operate in conjunction with each other.

[0166] Immersive binaural sound data representing the immersive binaural sound generated by the binaural rendering device 22 is delivered to the sound reproduction device 23 via a transfer path R2. The transfer path R2 may be in any form, such as a wired or wireless connection, a communication network, a recording medium, or a combination thereof. The binaural rendering device 22 and the sound reproduction device 23 may also be configured as an integrated unit. In this case, the transfer path R2 is configured by a signal line within the device.

[0167] The sound playback device 23 (an example of a sound output unit) is a device that sequentially outputs the immersive binaural sound data generated by the binaural rendering device 22, or the immersive binaural sound signal obtained by D / A converting the immersive binaural sound data, to the sound output device 24 at a speed corresponding to the playback speed of the immersive binaural sound.

[0168] Sound data or a sound signal is output from the sound reproducing device 23 to the sound emitting device 24 via a transmission path R3. The transmission path R3 may be in any form, such as a wired or wireless connection, a communication network, or a combination thereof.

[0169] The sound emitting device 24 is a device that emits sound actually near the external ear canal of the listener B or near the external ear canal of the listener B in a pseudo manner.

[0170] Examples of the sound emitting device 24 that actually emits sound near the external ear canal of the listener B include headphones, earphones, and headrest speakers. A headrest speaker is a speaker placed on the left and right sides of the headrest of a seat, or a seat equipped with such speakers. Headrest speakers are used in seats for moving objects such as automobiles, gaming seats, etc.

[0171] Furthermore, the sound emitting device 24 that emits sound near the external ear canal of the listener B in a pseudo manner may be a speaker system that uses a plurality of speakers such as a speaker array to generate a virtual sound source near the external ear canal of the listener B.

[0172] The sound emitting device 24 sequentially receives immersive binaural sound data, which is digital data, from the sound reproducing device 23, and emits sound in accordance with analog signals obtained by D / A converting the received immersive binaural sound data. Alternatively, the sound emitting device 24 sequentially receives immersive binaural sound signals, which are analog signals, from the sound reproducing device 23, and emits sound in accordance with the received immersive binaural sound signals.

[0173] The curve X data or the curve Y data generated by the target response curve data generating system 1 may be used in any of the following ways, for example.

[0174] (a) The sound emitting device 24 is designed and manufactured so that, due to its physical characteristics, it emits sound having amplitude-frequency characteristics that follow the target response curve indicated by the curve X data or the curve Y data.

[0175] (b) The sound emitting device 24 includes a sound correction unit that corrects the sound data or sound signal received from the sound reproducing device 23 in accordance with the target response curve indicated by the curve X data or the curve Y data, and emits a sound indicated by the sound data or sound signal corrected by the sound correction unit.

[0176] (c) The sound reproduction device 23 includes a sound correction unit that corrects the sound data received from the binaural rendering device 22 in accordance with the target response curve indicated by the curve X data or the curve Y data, and outputs the sound data corrected by the sound correction unit or a sound signal obtained by D / A converting the sound data corrected by the sound correction unit to the sound emission device 24.

[0177] (d) The binaural rendering device 22 includes a sound correction unit that corrects the sound data included in the stereophonic content data received from the stereophonic content generation device 21 in accordance with the target response curve indicated by the curve X data or the curve Y data, and performs binaural rendering using the sound data corrected by the sound correction unit, thereby passing the generated sound data to the sound reproduction device 23.

[0178] (e) The binaural rendering device 22 performs binaural rendering using sound data included in the stereophonic content data received from the stereophonic content generation device 21, and the generated sound data is corrected in accordance with the target response curve indicated by the curve X data or the curve Y data. The sound data corrected by the sound correction unit is then passed to the sound reproduction device 23.

[0179] (f) The stereophonic content generation device 21 has a sound correction unit that corrects the sound data generated in accordance with instructions from producer A in accordance with the target response curve indicated by the curve X data or the curve Y data, and delivers the stereophonic content data including the sound data corrected by the sound correction unit to the binaural rendering device 22.

[0180] (g) The acoustic system 2 includes a sound processing device (not shown in FIG. 12) arranged on the transmission path R1, the transmission path R2, or the transmission path R3, and the sound processing device includes a sound correction unit that corrects sound data or a sound signal input from a device on the upstream side of the transmission path in accordance with a target response curve indicated by the curve X data or the curve Y data, and outputs the sound data or sound signal corrected by the sound correction unit to a device on the downstream side of the transmission path.

[0181] The sound emitting device 24 of the sound system 2 emits a sound that allows the listener B to accurately perceive the location of the sound source, and therefore can serve as an acoustic display.

[0182] This concludes the description of the sound system 2.

[0183] [Modifications] The above-described embodiment is an example of the present invention, and various modifications may be made within the scope of the technical concept of the present invention. Examples of such modifications are shown below. Note that two or more of the modifications shown below may be combined as appropriate.

[0184] (1) Of the devices included in the above-described acoustic system 2, the device that corrects the input sound in accordance with the target response curve indicated by the curve X data or the curve Y data may be a computer. In this case, the computer executes a process of correcting the input sound in accordance with the target response curve indicated by the curve X data or the curve Y data in accordance with the program of the present invention.

[0185] That is, one aspect of the present invention provides a program for causing a computer to execute a process for correcting an input sound in accordance with a target response curve indicated by curve X data or curve Y data. Another aspect of the present invention provides a recording medium having recorded thereon a program for causing a computer to execute a process for correcting an input sound in accordance with a target response curve indicated by curve X data or curve Y data. Another aspect of the present invention provides a computer including: a memory that persistently stores a program for causing a computer to execute a process for correcting an input sound in accordance with the target response curve indicated by curve X data or curve Y data; and a processor that processes data in accordance with the program persistently stored in the memory.

[0186] For example, if the stereophonic content generation device 21 is realized by a computer that operates in accordance with a DAW (Digital Audio Workstation) program, a program for causing the computer to correct input sound in accordance with the target response curve indicated by the curve X data or the curve Y data may be provided as plug-in software to be incorporated into the DAW program.

[0187] (2) The method by which any of the devices included in the above-described acoustic system 2 corrects the input sound in accordance with the target response curve indicated by the curve X data or the curve Y data may be any of a method using equalization processing, a method using finite impulse response (FIR), etc.

[0188] (3) In one aspect, the present invention provides sound data representing a sound obtained by correcting a source sound in accordance with a target response curve indicated by curve X data or curve Y data. Also, in another aspect, the present invention provides a recording medium having recorded thereon sound data representing a sound obtained by correcting a source sound in accordance with a target response curve indicated by curve X data or curve Y data.

[0189] (4) The audio system 2 may be modified to have an audiovisual system including an image generation device that generates images in a three-dimensional space of cross reality (virtual reality, augmented reality, mixed reality, alternative reality, etc.), and a display device that displays the images generated by the image generation device, and the binaural rendering device 22 is configured to generate stereophonic content whose sound source is an object in the three-dimensional space shown by the image generated by the image generation device.

[0190] 13 is a diagram showing the configuration of an audiovisual system 3 according to this modification. In addition to the stereophonic content generation device 21, binaural rendering device 22, sound reproduction device 23, and sound emission device 24 provided in the audio system 2, the audiovisual system 3 also includes a stereoscopic video content generation device 31, a three-dimensional rendering device 32, a video reproduction device 33, and a display device 34.

[0191] The 3D video content generating device 31 (an example of a video generating unit) is a device that generates 3D video content data that indicates the position, 3D shape, appearance, etc. of an object (person or thing) in a cross-reality 3D space.

[0192] The three-dimensional rendering device 32 is a device that performs three-dimensional rendering processing, i.e., processing to generate a two-dimensional image of a three-dimensional space as seen from the viewer's viewpoint, based on the three-dimensional video content data generated by the three-dimensional video content generation device 31.

[0193] The video playback device 33 is a device that sequentially outputs the two-dimensional images generated by the three-dimensional rendering device 32 to the display device 34 .

[0194] The display device 34 (an example of a display unit) is a device that displays two-dimensional images output from the image reproduction device 33 .

[0195] The stereophonic content data generated by the stereophonic content generator 21 indicates, for each sound source in the three-dimensional space, the position of the sound source and the sound emitted by that sound source. The stereophonic video content data generated by the stereophonic video content generator 31 indicates, for each object in the three-dimensional space, the position of the object, the shape, appearance, etc. of the object.

[0196] The coordinates of the three-dimensional space used by the stereophonic content generation device 21 and the coordinates of the three-dimensional space used by the stereophonic video content generation device 31 are the same. Furthermore, the sound source handled by the stereophonic content generation device 21 is one of the objects handled by the stereophonic video content generation device 31. In other words, when an object in the three-dimensional space shared by the stereophonic content generation device 21 and the stereophonic video content generation device 31 is the sound source, the position of the object handled by the stereophonic video content generation device 31 and the position of the sound source handled by the stereophonic content generation device 21 are the same.

[0197] As described above, the stereophonic content generator 21 and the stereoscopic video content generator 31 share the positional information of the same object (sound source) in the same coordinate space, and therefore the sound emitted from the sound emission device 24 is linked to the video displayed on the display device 34. In other words, when an object in the three-dimensional space shown by the video emits a sound, the viewer B perceives that sound as coming from the position of the object in the three-dimensional space.

[0198] In the audiovisual system 3, the sound emitted to the viewer B has amplitude-frequency characteristics that follow the target response curve indicated by the curve X data or the curve Y data, so that the viewer B can accurately perceive the position of the sound source in the virtual three-dimensional space.

[0199] The audiovisual system 3 is particularly effective in fields such as games and remote medical care, where it is highly necessary to accurately convey to viewers the location of a sound source linked to a video image.

[0200] The display device 34 may be a wearable device such as a head-mounted display. In this case, data indicating the position and direction of the head of viewer B wearing the head-mounted display (data indicating the viewer's viewpoint) is passed to the binaural rendering device 22 and the three-dimensional rendering device 32, and is used to generate sound by the binaural rendering device 22 and to generate images by the three-dimensional rendering device 32. As a result, viewer B can view images and sounds that change according to the movement of his or her head.

[0201] (5) In the above-described audio system 2, the stereophonic content generation device 21 may continuously acquire the position of a moving sound source and generate stereophonic content indicating the acquired sound source position. In this case, listener B can correctly perceive the constantly changing position of the sound source moving in three-dimensional space.

[0202] In this modification, the sound emitting device 24 may emit sounds near the outer ear canal of listener B, who moves along with the moving sound source. For example, if listener B is a musical instrument player and wears the sound emitting device 24 as an ear monitor, position data indicating the position of each player, including listener B, and sound data indicating the sounds emitted by each player's instrument are transmitted in real time to the stereophonic content generation device 21. The stereophonic content generation device 21 uses this data to generate stereophonic content data. As a result, listener B can perform music while perceiving the correct position of each player from the sounds emitted from the sound emitting device 24.

[0203] (6) In the target response curve data generation system 1 described above, the computer 11 (general target response curve data generation unit 119) identifies, as curve Y, an amplitude frequency characteristic obtained by averaging the amplitude frequency characteristics indicated by the curve X data for each of the multiple subjects. Alternatively, the computer 11 (general target response curve data generation unit 119) may identify curve Y by adding together an amplitude frequency characteristic (general curve A) obtained by averaging the amplitude frequency characteristics indicated by the curve A data for each of the multiple subjects and an amplitude frequency characteristic (general curve B) obtained by averaging the amplitude frequency characteristics indicated by the curve B data for each of the multiple subjects. In this case, the subjects involved in generating the curve A data and the subjects involved in generating the curve B data may be the same or different.

[0204] Alternatively, the computer 11 (general target response curve data generating unit 119) may add up the amplitude-frequency characteristics indicated by the curve A data for each of a plurality of subjects and the amplitude-frequency characteristics indicated by the curve A data for each of the same number of subjects as the plurality of subjects, and identify the amplitude-frequency characteristics averaged over the number of subjects as curve Y. In this case, the subjects involved in generating the curve A data and the subjects involved in generating the curve B data may be the same or different. Note that, according to this modification, in order to identify curve Y, none of curve X for each subject, the general-purpose curve A, or the general-purpose curve B is identified.

[0205] (7) Among the devices included in the above-described acoustic system 2, the device that corrects input sound in accordance with the target response curve indicated by the curve X data or the curve Y data may include an acquisition unit that acquires the curve X data or the curve Y data, and a storage unit that stores the curve X data or the curve Y data acquired by the acquisition unit, and may correct the input sound in accordance with the target response curve indicated by the curve X data or the curve Y data stored in the storage unit.

[0206] According to this modification, for example, by storing curve X data corresponding to listener B in the sound emitting device 24 equipped with a sound correction unit, the sound emitting device 24 can be customized for listener B. Furthermore, if the appropriate curve Y data differs depending on the attributes of the listener, such as gender, race, age, etc., the sound emitting device 24 equipped with a sound correction unit can be customized for listener B by storing curve Y data corresponding to the attributes of listener B in the sound emitting device 24 equipped with a sound correction unit. The same applies when a device other than the sound emitting device 24 is equipped with a sound correction unit.

[0207] (8) In the above-described embodiment, the test sound emitted to the subject to generate the curve A data is band-specific pink noise obtained by dividing the full-band audible pink noise into multiple frequency bands, but this is not limited to this.

[0208] For example, an impulse may be emitted as the test sound for generating the curve A data. In this case, the computer 11 (curve A data generating unit 114) specifies the amplitude-frequency characteristics of the sound obtained as the impulse response as curve A. When an impulse is used as the test sound, the time spent by the subject for generating the curve A data is extremely short. In other words, using an impulse as the test sound is desirable from the perspective of reducing the burden on the subject.

[0209] Alternatively, a sweep sound whose frequency changes continuously or intermittently within the audible range may be emitted as the test sound for generating the curve A data. In this case, a combination of the frequency of the sweep sound emitted by the headphones 13 and the amplitude of the sound picked up by the microphone 14 at the time the sweep sound is emitted is obtained across the entire audible range. The curve A data generator 114 identifies the curve A from this combination of frequency and amplitude. When a sweep sound is used as the test sound, the speed of the sweep (in the case of a sweep sound whose frequency changes continuously) or the frequency interval of the sweep (in the case of a sweep sound whose frequency changes intermittently) can be adjusted to adjust the balance between the time the subject spends generating the curve A data and the accuracy of the identified curve A. For example, if a subject wants to obtain a highly accurate curve A (or curve X generated using curve A) for himself or herself even if it takes a long time, the highly accurate curve A can be obtained by slowing down the sweep speed (in the case of a sweep sound with a continuously changing frequency) or by shortening the interval between the sweep frequencies (in the case of a sweep sound with an intermittent changing frequency).

[0210] In the above-described embodiment, band-specific pink noise for each of a plurality of frequency bands with a bandwidth of 1 / 3 octave is used as the test sound for generating the curve A data. This band-specific pink noise is also used to generate the curve B data, and is therefore desirable from the perspective of test sound preparation. Furthermore, when band-specific pink noise is used to generate the curve B data, a more accurate curve A is more easily obtained than when the above-described impulse is used as the test sound. Furthermore, the test subject generally spends less time on the test than when the above-described sweep sound is used as the test sound.

[0211] (9) In the above-described embodiment, the frequency band of the reference band-specific pink noise, which is emitted to the subject to generate the curve B data, is a frequency band centered at 500 Hz, but this is not limited thereto. In other words, to generate the curve B data, band-specific pink noise of a frequency band centered at a frequency other than 500 Hz may be emitted as the reference frequency band.

[0212] In the above-described embodiment, the reference sound pressure of the band-specific pink noise emitted to the subject for generating the curve B data is 65 dB SPL, but this is not limiting. That is, band-specific pink noise with a reference sound pressure other than 65 dB SPL may be emitted for generating the curve B data.

[0213] In the above-described embodiment, the bandwidth of each of the frequency bands of the multiple band-specific pink noises sequentially emitted to the subject to generate the curve A data and the curve B data is 1 / 3 octave, but this is not limiting. That is, pink noise of a frequency band with a bandwidth of 1 / m octave (where m is any positive number) may be emitted to generate the curve A data or the curve B data.

[0214] 1...target response curve data generation system, 2...acoustic system, 3...audiovisual system, 11...computer, 12...audio interface, 13...headphones, 14...microphone, 21...stereophonic sound content generation device, 22...binaural rendering device, 23...sound reproduction device, 24...sound emission device, 31...stereoscopic video content generation device, 32...three-dimensional rendering device, 33...video reproduction device, 34...display device, 110...memory unit, 111...sound output unit, 112...sound acquisition unit, 113...band-specific amplitude frequency characteristic determination unit, 114...curve A data generation unit, 115...operation signal acquisition unit, 116...band-specific sound pressure increase / decrease amount determination unit, 117...curve B data generation unit, 118...personal target response curve data generation unit, 119...general-purpose target response curve data generation unit.

Claims

A method for generating target response curve data that removes components contributing to the perception of the directionality of sound generated by the outer shape including at least a human head and sets acoustic characteristics so as to retain the tone recognition characteristics by the brain, comprising: a step of acquiring the acoustic characteristics of sound from the external auditory meatus of the subject to the eardrum; a step of acquiring sound pressure adjustment characteristics in which the subject perceives that the loudness of sound is constant over the entire audible range; a step of generating target response curve data based on the acoustic characteristics and the sound pressure adjustment characteristics; A method for generating target response curve data comprising the above steps.

2. The step of acquiring the acoustic characteristics is a step of generating curve A data indicating the amplitude-frequency characteristics of the sound picked up near the eardrum of the subject while a test sound is emitted near the external auditory meatus of the subject; The step of acquiring the sound pressure adjustment characteristics is such that, when each of the band-limited pink noises obtained by dividing the full audible range pink noise into a plurality of frequency bands is sequentially emitted at a reference sound pressure near the external auditory meatus of the subject, the subject adjusts the sound pressure of each of the frequency bands other than the reference frequency band so as to feel the same loudness as the sound in the reference frequency band, and generates curve B data indicating the amplitude-frequency characteristics indicated by the increase and decrease amounts of the sound pressure of each of the plurality of frequency bands specified by the adjustment; The step of generating the target response curve data is a step of generating curve X data indicating the amplitude-frequency characteristics obtained by adding the amplitude-frequency characteristics indicated by the curve A data and the amplitude-frequency characteristics indicated by the curve B data as the target response curve data for the subject. The method for generating target response curve data according to claim 1.

3. A step of generating curve Y data indicating the amplitude-frequency characteristics obtained by averaging the amplitude-frequency characteristics indicated by the curve X data generated for each of a plurality of subjects as general-purpose target response curve data is provided. The method for generating target response curve data according to claim 2.

4. The step of obtaining the acoustic characteristics is a step of generating curve A data indicating the amplitude-frequency characteristics of the sound picked up near the eardrum of each of a plurality of subjects while emitting a test sound near the external auditory meatus of the subject, and generating general-purpose curve A data indicating the amplitude-frequency characteristics obtained by averaging the amplitude-frequency characteristics indicated by the plurality of generated curve A data. The step of obtaining the sound pressure adjustment characteristics is, for each of a plurality of subjects, when each of the band-by-band pink noises obtained by dividing the audible-range full-band pink noise into a plurality of frequency bands is sequentially emitted at a reference sound pressure near the external auditory meatus of the subject, the subject adjusts the sound pressure of each of the frequency bands other than the reference frequency band so as to feel the same loudness as the sound in the reference frequency band among the plurality of frequency bands, and generates curve B data indicating the amplitude-frequency characteristics indicated by the increase or decrease amount of the sound pressure of each of the plurality of frequency bands specified by the adjustment, and generating general-purpose curve B data indicating the amplitude-frequency characteristics obtained by averaging the amplitude-frequency characteristics indicated by the plurality of generated curve B data. The step of generating the target response curve data is a step of generating curve Y data indicating the amplitude-frequency characteristics obtained by adding the amplitude-frequency characteristics indicated by the general-purpose curve A data and the amplitude-frequency characteristics indicated by the general-purpose curve B data as general-purpose target response curve data. The method for generating target response curve data according to claim 1.

5. The step of obtaining the acoustic characteristics is a step of generating curve A data indicating the amplitude-frequency characteristics of the sound picked up near the eardrum of the subject while emitting a test sound near the external auditory meatus of the subject by an arbitrary external auditory meatus sound-emitting device. The step of obtaining the sound pressure adjustment characteristics is, near the external auditory meatus of the subject, when each of the band-by-band pink noises obtained by dividing the audible-range full-band pink noise into a plurality of frequency bands is sequentially emitted at a reference sound pressure by the external auditory meatus sound-emitting device used in the step of generating the curve A data or an external auditory meatus sound-emitting device of the same type as the external auditory meatus sound-emitting device, the subject adjusts the sound pressure of each of the frequency bands other than the reference frequency band so as to feel the same loudness as the sound in the reference frequency band among the plurality of frequency bands, and generates curve B data indicating the amplitude-frequency characteristics indicated by the increase or decrease amount of the sound pressure of each of the plurality of frequency bands specified by the adjustment. The step of generating the target response curve data is a step of generating curve X data showing an amplitude-frequency characteristic obtained by adding the amplitude-frequency characteristic indicated by the curve A data and the amplitude-frequency characteristic indicated by the curve B data, as target response curve data for the external auditory meatus sound emission device used for generating the curve A data and the curve B data for the subject or for an external auditory meatus sound emission device of the same type as the external auditory meatus sound emission device. The method for generating target response curve data according to claim 1.

6. The method includes a step of generating curve Y data showing an amplitude-frequency characteristic obtained by averaging the amplitude-frequency characteristics indicated by the curve X data generated for each of a plurality of subjects, as general-purpose target response curve data for the external auditory meatus sound emission device used for generating the curve X data or for an external auditory meatus sound emission device of the same type as the external auditory meatus sound emission device. The method for generating target response curve data according to claim 5.

7. The step of obtaining the acoustic characteristics is a step of generating curve A data showing the amplitude-frequency characteristic of the sound picked up near the eardrum of the subject while a test sound is emitted near the external auditory meatus of the subject by an arbitrary external auditory meatus sound emission device for each of a plurality of subjects, and generating general-purpose curve A data showing the amplitude-frequency characteristic obtained by averaging the amplitude-frequency characteristics indicated by the plurality of generated curve A data. The step of obtaining the sound pressure adjustment characteristics is a step of, for each of a plurality of subjects, when each of the band-by-band pink noises obtained by dividing the audible-range full-band pink noise into a plurality of frequency bands is sequentially emitted at a reference sound pressure by the external auditory meatus sound emission device used for generating the curve A data or an external auditory meatus sound emission device of the same type as the external auditory meatus sound emission device near the external auditory meatus of the subject, adjusting the sound pressure of each of the frequency bands other than the reference frequency band by the subject so as to feel the same loudness as the sound in the reference frequency band among the plurality of frequency bands, and generating curve B data showing the amplitude-frequency characteristic indicated by the increase or decrease amount of the sound pressure of each of the plurality of frequency bands specified by the adjustment, and generating general-purpose curve B data showing the amplitude-frequency characteristic obtained by averaging the amplitude-frequency characteristics indicated by the plurality of generated curve B data. The step of generating the target response curve data is a step of generating curve Y data showing an amplitude-frequency characteristic obtained by adding the amplitude-frequency characteristic shown by the general curve A data and the amplitude-frequency characteristic shown by the general curve B data as general target response curve data for an outer ear canal sound emitting device used for generating the curve A data and the curve B data or for an outer ear canal sound emitting device of the same type as the outer ear canal sound emitting device. The method for generating target response curve data according to claim 1.

8. The step of obtaining the acoustic characteristics generates respective curve A data showing the amplitude-frequency characteristic of the sound picked up near the eardrum of each of a plurality of subjects while a test sound is being emitted near the outer ear canal of the subject. The step of obtaining the sound pressure adjustment characteristics is such that, for each of a plurality of subjects, when each of the band-specific pink noises obtained by dividing the audible range full-band pink noise into a plurality of frequency bands is sequentially emitted at a reference sound pressure near the outer ear canal of the subject, the subject adjusts the sound pressure of each of the frequency bands other than the reference frequency band so as to feel the same loudness as the sound in the reference frequency band, and respective curve B data showing the amplitude-frequency characteristic indicated by the increase or decrease amount of the sound pressure of each of the plurality of frequency bands specified by the adjustment are generated. The step of generating the target response curve data is a step of generating curve Y data showing an amplitude-frequency characteristic obtained by adding all of the amplitude-frequency characteristics shown by the respective curve A data of the plurality of subjects and averaging them by the number of the plurality of subjects as general target response curve data. The method for generating target response curve data according to claim 1.

9. The step of obtaining the acoustic characteristics generates respective curve A data showing the amplitude-frequency characteristic of the sound picked up near the eardrum of each of a plurality of subjects while a test sound is being emitted near the outer ear canal of the subject by an arbitrary outer ear canal sound emitting device. The step of obtaining the sound pressure adjustment characteristics is, for each of a plurality of subjects, when each of the band-limited pink noises obtained by dividing the audible-range full-band pink noise into a plurality of frequency bands by the external auditory meatus sound emission device used for generating the curve A data or an external auditory meatus sound emission device of the same type as the external auditory meatus sound emission device is sequentially emitted at the reference sound pressure near the external auditory meatus of the subject, so that the subject feels the same loudness as the sound in the reference frequency band among the plurality of frequency bands, the subject adjusts the sound pressure of each of the frequency bands other than the reference frequency band, and generates each curve B data indicating the amplitude-frequency characteristics indicated by the increase or decrease amount of the sound pressure of each of the plurality of frequency bands specified by the adjustment. The step of generating the target response curve data is a step of generating curve Y data indicating the amplitude-frequency characteristics obtained by adding all of the amplitude-frequency characteristics indicated by the curve A data of each of the plurality of subjects and the amplitude-frequency characteristics indicated by the curve B data of each of the plurality of subjects and averaging by the number of the plurality of subjects, as general-purpose target response curve data for the external auditory meatus sound emission device used for generating the curve A data and the curve B data or an external auditory meatus sound emission device of the same type as the external auditory meatus sound emission device. The method for generating target response curve data according to claim 1.

10. The test sound is band-limited pink noise obtained by dividing the audible-range full-band pink noise into a plurality of frequency bands. The method for generating target response curve data according to any one of claims 2, 4, 5, 7, 8, and 9.

11. The test sound is an impulse. The method for generating target response curve data according to any one of claims 2, 4, 5, 7, 8, and 9.

12. The test sound is a sweep sound whose frequency continuously or intermittently changes within the audible range. The method for generating target response curve data according to any one of claims 2, 4, 5, 7, 8, and 9.

13. The reference frequency band is a frequency band centered on 500 Hz. The method for generating target response curve data according to any one of claims 2, 4, 5, 7, 8, and 9.

14. The reference sound pressure is 65 dB SPL. The method for generating target response curve data according to any one of claims 2, 4, 5, 7, 8, and 9.

15. The bandwidth of each of the plurality of frequency bands is 1 / 3 octave. The method for generating target response curve data according to any one of claims 2, 4, 5, 7, 8, and 9.

16. A sound output unit that outputs sound to a sound emitting device that emits sound near the external auditory meatus of a subject, A sound acquisition unit that acquires the sound picked up by a microphone disposed near the eardrum of the subject while the sound output unit emits a test sound to the sound emitting device, A curve A data generation unit that generates curve A data indicating the amplitude-frequency characteristics of the sound acquired by the sound acquisition unit, While the sound output unit sequentially outputs each of the band-specific pink noises obtained by dividing the audible range full-band pink noise into a plurality of frequency bands to the sound emitting device at a reference sound pressure, a notification unit that gives a notification to prompt the subject to operate an operation device so as to adjust the sound pressure of each of the frequency bands other than the reference frequency band so that the subject feels the same loudness as the sound of the reference frequency band among the plurality of frequency bands, An operation signal acquisition unit that acquires an operation signal corresponding to the operation of the subject from the operation device, A curve B data generation unit that generates curve B data indicating the amplitude-frequency characteristics indicated by the increase and decrease amounts of the sound pressure of each of the plurality of frequency bands based on the operation signal acquired by the operation signal acquisition unit, A personal target response curve data generation unit that generates curve X data indicating the amplitude-frequency characteristics obtained by adding the amplitude-frequency characteristics indicated by the curve A data generated by the curve A data generation unit and the amplitude-frequency characteristics indicated by the curve B data generated by the curve B data generation unit as the target response curve data for the subject A target response curve data generation system comprising:

17. A sound output unit that outputs sound to a sound emitting device that emits sound near the external auditory meatus of a subject, A sound acquisition unit that acquires the sound picked up by a microphone attached to the end of an extremely fine tube made of a soft material inserted near the eardrum of the subject while the sound output unit emits a test sound to the sound emitting device, A curve A data generation unit that generates curve A data indicating the amplitude-frequency characteristics of the sound acquired by the sound acquisition unit, While the sound output unit outputs each of the band-specific pink noises obtained by dividing the audible-range full-band pink noise into a plurality of frequency bands to the sound playback device in sequence at a reference sound pressure, a notification unit gives a notification to prompt the subject to operate an operation device so as to adjust the sound pressure of each of the frequency bands other than the reference frequency band so that the subject feels the same loudness as that of the sound in the reference frequency band among the plurality of frequency bands. An operation signal acquisition unit that acquires an operation signal corresponding to the operation of the subject from the operation device. A curve B data generation unit that generates curve B data indicating an amplitude-frequency characteristic indicated by an increase or decrease amount of the sound pressure of each of the plurality of frequency bands based on the operation signal acquired by the operation signal acquisition unit. A personal target response curve data generation unit that generates curve X data indicating an amplitude-frequency characteristic obtained by adding the amplitude-frequency characteristic indicated by the curve A data generated by the curve A data generation unit and the amplitude-frequency characteristic indicated by the curve B data generated by the curve B data generation unit as the target response curve data for the subject. A target response curve data generation system comprising the above.

18. A general-purpose target response curve data generation unit that generates curve Y data indicating an amplitude-frequency characteristic obtained by averaging the amplitude-frequency characteristics indicated by the target response curve data for the subject generated by the personal target response curve data generation unit for each of a plurality of subjects as general-purpose target response curve data. The target response curve data generation system according to claim 16 or 17.

19. A sound output unit that outputs sound to a sound playback device that plays sound near the external auditory meatus of a subject. A sound acquisition unit that acquires the sound picked up by a microphone arranged near the eardrum of the subject while the sound output unit plays a test sound to the sound playback device. A curve A data generation unit that generates curve A data indicating an amplitude-frequency characteristic of the sound acquired by the sound acquisition unit. While the sound output unit outputs each of the band-specific pink noises obtained by dividing the audible-range full-band pink noise into a plurality of frequency bands to the sound playback device in sequence at a reference sound pressure, a notification unit gives a notification to prompt the subject to operate an operation device so as to adjust the sound pressure of each of the frequency bands other than the reference frequency band so that the subject feels the same loudness as that of the sound in the reference frequency band among the plurality of frequency bands. An operation signal acquisition unit that acquires an operation signal corresponding to the operation of the subject from the operation device; A curve B data generation unit that generates curve B data indicating amplitude-frequency characteristics indicated by increases and decreases in sound pressure of each of the plurality of frequency bands based on the operation signal acquired by the operation signal acquisition unit; A general-purpose target response curve data generation unit that generates curve Y data indicating amplitude-frequency characteristics obtained by adding the amplitude-frequency characteristics obtained by averaging the amplitude-frequency characteristics indicated by the curve A data generated by the curve A data generation unit for each of a plurality of subjects and the amplitude-frequency characteristics obtained by averaging the amplitude-frequency characteristics indicated by the curve B data generated by the curve B data generation unit for each of a plurality of subjects, as general-purpose target response curve data A target response curve data generation system comprising: [

20. ] A sound output unit that outputs sound to a sound emitting device that emits sound near the external auditory meatus of the subject; A sound acquisition unit that acquires sound picked up by a microphone attached to the end of an extremely fine tube made of a soft material and inserted near the eardrum of the subject while the sound output unit is emitting a test sound to the sound emitting device; A curve A data generation unit that generates curve A data indicating amplitude-frequency characteristics of the sound acquired by the sound acquisition unit; A notification unit that, while the sound output unit is sequentially outputting each of the band-specific pink noises obtained by dividing the audible range full-band pink noise into a plurality of frequency bands to the sound emitting device at a reference sound pressure, notifies the subject to operate the operation device so as to adjust the sound pressure of each of the frequency bands other than the reference frequency band so that the subject feels the same loudness as the sound in the reference frequency band; An operation signal acquisition unit that acquires an operation signal corresponding to the operation of the subject from the operation device; A curve B data generation unit that generates curve B data indicating amplitude-frequency characteristics indicated by increases and decreases in sound pressure of each of the plurality of frequency bands based on the operation signal acquired by the operation signal acquisition unit; A general-purpose target response curve data generation unit that generates curve Y data indicating an amplitude-frequency characteristic obtained by adding an amplitude-frequency characteristic obtained by averaging the amplitude-frequency characteristics indicated by the curve A data generated by the curve A data generation unit for each of a plurality of subjects and an amplitude-frequency characteristic obtained by averaging the amplitude-frequency characteristics indicated by the curve B data generated by the curve B data generation unit for each of the plurality of subjects A target response curve data generation system comprising the same.

21. A sound output unit that outputs sound to a sound emission device that emits sound near the external auditory meatus of a subject, A sound acquisition unit that acquires sound picked up by a microphone disposed near the eardrum of the subject while the sound output unit is emitting a test sound to the sound emission device, A curve A data generation unit that generates curve A data indicating the amplitude-frequency characteristic of the sound acquired by the sound acquisition unit, While the sound output unit is sequentially outputting each of the band-specific pink noises obtained by dividing the audible range full-band pink noise into a plurality of frequency bands to the sound emission device at a reference sound pressure, a notification unit that gives a notification to the subject to operate an operation device so as to adjust the sound pressure of each of the frequency bands other than the reference frequency band so that the subject feels the same sound volume as the sound volume of the sound in the reference frequency band, An operation signal acquisition unit that acquires an operation signal corresponding to the operation of the subject from the operation device, A curve B data generation unit that generates curve B data indicating an amplitude-frequency characteristic indicating an increase or decrease amount of the sound pressure of each of the plurality of frequency bands based on the operation signal acquired by the operation signal acquisition unit, A general-purpose target response curve data generation unit that generates curve Y data indicating an amplitude-frequency characteristic obtained by adding all of the amplitude-frequency characteristics indicated by the curve A data generated by the curve A data generation unit for each of a plurality of subjects and the amplitude-frequency characteristics indicated by the curve B data generated by the curve B data generation unit for each of the plurality of subjects having the same number as the plurality of subjects and averaging the result by the number of the plurality of subjects, as general-purpose target response curve data A target response curve data generation system comprising the same.

22. A sound output unit that outputs sound to a sound emission device that emits sound near the external auditory meatus of a subject, A sound acquisition unit that acquires the sound picked up by a microphone attached to the end of an extremely fine tube made of a soft material and inserted near the eardrum of the subject while the sound output unit is emitting a test sound to the sound playback device; A curve A data generation unit that generates curve A data indicating the amplitude-frequency characteristics of the sound acquired by the sound acquisition unit; A notification unit that, while the sound output unit is sequentially outputting each of the band-specific pink noises obtained by dividing the audible-range full-band pink noise into a plurality of frequency bands to the sound playback device at a reference sound pressure, notifies the subject to operate an operation device so as to adjust the sound pressure of each of the frequency bands other than the reference frequency band so that the subject feels the same loudness as the sound in the reference frequency band; An operation signal acquisition unit that acquires an operation signal corresponding to the operation of the subject from the operation device; A curve B data generation unit that generates curve B data indicating the amplitude-frequency characteristics indicated by the increase and decrease amounts of the sound pressure of each of the plurality of frequency bands based on the operation signal acquired by the operation signal acquisition unit; A general-purpose target response curve data generation unit that generates curve Y data indicating the amplitude-frequency characteristics obtained by adding all of the amplitude-frequency characteristics indicated by the curve A data generated by the curve A data generation unit for each of a plurality of subjects and the amplitude-frequency characteristics indicated by the curve B data generated by the curve B data generation unit for each of the same number of subjects as the plurality of subjects and averaging by the number of the plurality of subjects as general-purpose target response curve data; A target response curve data generation system comprising the above.

23. The test sound is band-specific pink noise obtained by dividing the audible-range full-band pink noise into a plurality of frequency bands. The target response curve data generation system according to any one of claims 16, 17, 19, 20, 21, and 22.

24. The test sound is an impulse. The target response curve data generation system according to any one of claims 16, 17, 19, 20, 21, and 22.

25. The test sound is a sweep sound whose frequency continuously or intermittently changes within the audible range. The target response curve data generation system according to any one of claims 16, 17, 19, 20, 21, and 22.

26. The reference frequency band is a frequency band centered on 500 Hz. The target response curve data generation system according to any one of claims 16, 17, 19, 20, 21, and 22.

27. The reference sound pressure is 65 dB SPL The target response curve data generation system according to any one of claims 16, 17, 19, 20, 21, and 22.

28. The bandwidth of each of the plurality of frequency bands is 1 / 3 octave The target response curve data generation system according to any one of claims 16, 17, 19, 20, 21, and 22.

29. To a computer, A process of outputting a test sound to a sound emitting device that emits sound near the external auditory meatus of a subject; A process of acquiring the sound picked up by a microphone near the eardrum of the subject while the test sound is being output; A process of generating curve A data indicating the amplitude-frequency characteristics of the sound acquired in the process of acquiring the sound; A process of sequentially outputting each of the band-specific pink noises obtained by dividing the audible-range full-band pink noise into a plurality of frequency bands to the sound emitting device at the reference sound pressure; In parallel with the process of outputting the band-specific pink noises, a notification device that notifies the subject outputs a notification to prompt the subject to perform an operation on an operation device so as to adjust the sound pressure of each of the band-specific pink noises in the frequency bands other than the reference frequency band so as to feel the same loudness as the loudness of the band-specific pink noise in the reference frequency band among the plurality of frequency bands; A process of acquiring an operation signal corresponding to the operation performed by the subject on the operation device in response to the notification output in the process of outputting the notification by the subject; A process of generating curve B data indicating the amplitude-frequency characteristics indicated by the increase and decrease amounts of the sound pressure of each of the plurality of frequency bands based on the operation signal acquired in the process of acquiring the operation signal; A process of generating curve X data indicating the amplitude-frequency characteristics obtained by adding the amplitude-frequency characteristics indicated by the curve A data and the amplitude-frequency characteristics indicated by the curve B data as the target response curve data for the subject A program for execution.

30. To a computer, A process of outputting a test sound to a sound emitting device that emits sound near the external auditory meatus of a subject; A process of acquiring the sound picked up by a microphone attached to the end of an extremely fine tube made of a soft material inserted near the eardrum of the subject while the test sound is being output; A process of generating curve A data indicating the amplitude-frequency characteristics of the sound acquired in the process of acquiring the sound; A process of sequentially outputting, to the sound playback device, each of the band-specific pink noises obtained by dividing the audible-range full-band pink noise into a plurality of frequency bands, at a reference sound pressure; In parallel with the process of outputting the band-specific pink noises, a process of outputting a notification to a notification device that notifies the subject, prompting the subject to perform, on an operation device, an operation of adjusting the sound pressure of each of the band-specific pink noises in the frequency bands other than the reference frequency band so as to feel the same loudness as the loudness of the sound of the band-specific pink noise in the reference frequency band among the plurality of frequency bands; A process of acquiring an operation signal corresponding to the operation performed by the subject on the operation device in response to the notification output in the process of outputting the notification; A process of generating curve B data indicating the amplitude-frequency characteristics indicated by the increase and decrease amounts of the sound pressure of each of the plurality of frequency bands based on the operation signal acquired in the process of acquiring the operation signal; A process of generating, as target response curve data for the subject, curve X data indicating the amplitude-frequency characteristics obtained by adding the amplitude-frequency characteristics indicated by the curve A data and the amplitude-frequency characteristics indicated by the curve B data; A program for causing the above to be executed.

31. To the computer, A process of generating curve Y data indicating the amplitude-frequency characteristics obtained by averaging the amplitude-frequency characteristics indicated by the curve X data generated in the process of generating the curve X data for each of a plurality of subjects, as general-purpose target response curve data; The program according to claim 29 or 30 for causing the above to be executed.

32. To the computer, A process of outputting a test sound to a sound playback device that plays back the sound near the external auditory meatus of the subject; A process of acquiring the sound picked up by a microphone near the eardrum of the subject while the test sound is being output; A process of generating curve A data indicating the amplitude-frequency characteristics of the sound acquired in the process of acquiring the sound; A process of sequentially outputting, to the sound playback device, each of the band-specific pink noises obtained by dividing the audible-range full-band pink noise into a plurality of frequency bands, at a reference sound pressure; In parallel with the process of outputting the pink noise for each frequency band, a notification device that notifies the subject outputs a notification to prompt the subject to perform an operation on an operation device to adjust the sound pressure of the pink noise for each frequency band other than the reference frequency band so that it feels the same loudness as the loudness of the pink noise for the reference frequency band among the pink noises for each frequency band obtained by dividing the audible full-band pink noise into a plurality of frequency bands. A process of acquiring an operation signal corresponding to an operation performed by the subject on the operation device in response to the notification output in the process of outputting the notification by the subject. A process of generating curve B data indicating an amplitude-frequency characteristic indicated by an increase or decrease amount of the sound pressure of each of the plurality of frequency bands based on the operation signal acquired in the process of acquiring the operation signal. A process of generating curve Y data indicating an amplitude-frequency characteristic obtained by adding an amplitude-frequency characteristic obtained by averaging the amplitude-frequency characteristics indicated by the curve A data generated in the process of generating the curve A data for each of a plurality of subjects and an amplitude-frequency characteristic obtained by averaging the amplitude-frequency characteristics indicated by the curve B data generated in the process of generating the curve B data for each of a plurality of subjects as general-purpose target response curve data. A program for causing the above to be executed.

33. To a computer, A process of outputting a test sound to a sound-emitting device that emits sound near the external auditory meatus of a subject. A process of acquiring the sound picked up by a microphone attached to the end of an extremely fine tube made of a soft material and inserted near the eardrum of the subject while the test sound is being output. A process of generating curve A data indicating the amplitude-frequency characteristic of the sound acquired in the process of acquiring the sound. A process of sequentially outputting each of the pink noises for each frequency band obtained by dividing the audible full-band pink noise into a plurality of frequency bands to the sound-emitting device at a reference sound pressure. In parallel with the process of outputting the pink noise for each frequency band, a notification device that notifies the subject outputs a notification to prompt the subject to perform an operation on an operation device to adjust the sound pressure of the pink noise for each frequency band other than the reference frequency band so that it feels the same loudness as the loudness of the pink noise for the reference frequency band among the pink noises for each frequency band obtained by dividing the audible full-band pink noise into a plurality of frequency bands. A process of obtaining an operation signal corresponding to an operation performed by the subject on the operation device in response to a notification output by the subject in the process of outputting the notification; A process of generating curve B data indicating amplitude-frequency characteristics shown by the increase and decrease amounts of sound pressure in each of the plurality of frequency bands based on the operation signal obtained in the process of obtaining the operation signal; A process of generating curve Y data indicating amplitude-frequency characteristics obtained by adding the amplitude-frequency characteristics obtained by averaging the amplitude-frequency characteristics shown by the curve A data generated in the process of generating the curve A data for each of the plurality of subjects and the amplitude-frequency characteristics obtained by averaging the amplitude-frequency characteristics shown by the curve B data generated in the process of generating the curve B data for each of the plurality of subjects as general-purpose target response curve data; A program for causing the above to be executed.

34. To a computer, A process of outputting a test sound to a sound-emitting device that emits sound near the external auditory meatus of a subject; A process of obtaining the sound picked up by a microphone near the eardrum of the subject while the test sound is being output; A process of generating curve A data indicating the amplitude-frequency characteristics of the sound obtained in the process of obtaining the sound; A process of causing the sound-emitting device to sequentially output each of the band-specific pink noises obtained by dividing the audible-range full-band pink noise into a plurality of frequency bands at a reference sound pressure; In parallel with the process of outputting the band-specific pink noises, a process of outputting a notification to a notification device that notifies the subject, so that the subject feels the same loudness as the loudness of the band-specific pink noise in the reference frequency band among the band-specific pink noises obtained by dividing the audible-range full-band pink noise into a plurality of frequency bands, to prompt the subject to perform an operation on the operation device to adjust the sound pressure of each of the band-specific pink noises in the frequency bands other than the reference frequency band; A process of obtaining an operation signal corresponding to an operation performed by the subject on the operation device in response to a notification output by the subject in the process of outputting the notification; A process of generating curve B data indicating amplitude-frequency characteristics shown by the increase and decrease amounts of sound pressure in each of the plurality of frequency bands based on the operation signal obtained in the process of obtaining the operation signal; In the process of generating the curve A data for each of a plurality of subjects, the amplitude-frequency characteristics indicated by the curve A data generated are added to the amplitude-frequency characteristics indicated by the curve B data generated in the process of generating the curve B data for each of the same number of subjects as the plurality of subjects, and the curve Y data indicating the amplitude-frequency characteristics averaged by the number of the plurality of subjects is generated as general-purpose target response curve data, and A program for causing execution. [

35. ] Causing a computer to Output a test sound to a sound-emitting device that emits sound near the external auditory meatus of a subject, While the test sound is being output, obtain the sound picked up by a microphone attached to the end of an extremely fine tube made of a soft material and inserted near the eardrum of the subject, Generate curve A data indicating the amplitude-frequency characteristics of the sound obtained in the process of obtaining the sound, Cause the sound-emitting device to sequentially output each of the band-specific pink noises obtained by dividing the audible-range full-band pink noise into a plurality of frequency bands at a reference sound pressure, In parallel with the process of outputting the band-specific pink noises, cause a notification device that notifies the subject to output a notification prompting the subject to perform, on an operation device, an operation of adjusting the sound pressure of each of the band-specific pink noises in frequency bands other than the reference frequency band so as to feel the same loudness as the loudness of the band-specific pink noise in the reference frequency band among the band-specific pink noises obtained by dividing the audible-range full-band pink noise into a plurality of frequency bands, Obtain an operation signal corresponding to the operation performed by the subject on the operation device in response to the notification output in the process of outputting the notification by the subject, Based on the operation signal obtained in the process of obtaining the operation signal, generate curve B data indicating the amplitude-frequency characteristics indicated by the increase and decrease amounts of the sound pressure of each of the plurality of frequency bands, In the process of generating the curve A data for each of a plurality of subjects, the amplitude-frequency characteristics indicated by the curve A data generated are added to the amplitude-frequency characteristics indicated by the curve B data generated in the process of generating the curve B data for each of the same number of subjects as the plurality of subjects, and the curve Y data indicating the amplitude-frequency characteristics averaged by the number of the plurality of subjects is generated as general-purpose target response curve data, and A program for causing

36. The test sound is pink noise for each frequency band obtained by dividing the full audible range pink noise into a plurality of frequency bands The program according to any one of claims 29, 30, 32, 33, 34, and 35.

37. The test sound is an impulse The program according to any one of claims 29, 30, 32, 33, 34, and 35.

38. The test sound is a sweep sound whose frequency continuously or intermittently changes within the audible range The program according to any one of claims 29, 30, 32, 33, 34, and 35.

39. The reference frequency band is a frequency band centered at 500 Hz The program according to any one of claims 29, 30, 32, 33, 34, and 35.

40. The reference sound pressure is 65 dB SPL The program according to any one of claims 29, 30, 32, 33, 34, and 35.

41. The bandwidth of each of the plurality of frequency bands is 1 / 3 octave The program according to any one of claims 29, 30, 32, 33, 34, and 35.