Method for generating target response curve data, system for generating target response curve data, and program

Abstract

In the present invention, a computer 11 emits test sounds from headphones 13 relating to each of a plurality of frequency bands into which an audible band has been divided. During that period, the computer 11 acquires sound picked up by a microphone 14 located near the eardrum of a subject. From discrete amplitude values of the sounds of each of the plurality of frequency bands thus acquired, the computer 11 identifies, as a curve A, amplitude frequency characteristics of the entire audible band. In addition, for each of the plurality of frequency bands into which the audible band was divided, the computer 11 emits, from the headphones 13 and in an alternating manner, a test sound of a reference frequency band and a test sound of a frequency band to be compared. During that period, the subject adjusts the sound pressure of the test sound to be compared such that the reference test sound and the test sound to be compared are felt to have the same magnitude. The computer 11 identifies, as a curve B, amplitude frequency characteristics of the entire audible band indicated by an increase / decrease in the sound pressure of the frequency bands indicated by the results of the adjustments by the user. The computer 11 generates a target response curve by adding curve A and curve B.

Description

Technical Field

[0001] The present invention relates to acoustic technology, and more specifically, to a target response curve.

Background Art

[0002] The impression given to a listener by the sound emitted from a sound-emitting device such as an earphone or a headphone changes depending on the amplitude-frequency characteristics of the sound. Therefore, manufacturers of sound-emitting devices are seeking a target response curve, which is the amplitude-frequency characteristic of sound that gives a favorable impression to listeners.

[0003] For example, as a widely known target response curve, there is one called the Harman target response curve. The Harman target response curve is a target response curve created based on the reference listening room of Harman of the Harman Group. According to experiments conducted by Harman, for example, compared with sounds corrected according to a target response curve created based on an anechoic chamber or a target response curve created based on a reverberation chamber, the sound corrected according to the Harman target response curve gives a favorable impression to many listeners.

[0004] As a patent document disclosing a technique using a target response curve, for example, there is Patent Document 1. In the invention described in Patent Document 1, correction by a graphic equalizer is performed on an audio signal input to a speaker so that sound having amplitude-frequency characteristics according to a target response curve selected by a listener from a plurality of target response curves is emitted.

Prior Art Documents

Patent Documents

[0005]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0006] In recent years, immersive binaural sound that converts immersive sound (stereo sound) produced assuming it is played from multi-channel (three or more channels) speakers arranged three-dimensionally around the listener to make the listener perceive stereo sound when played from a sound-emitting device that emits sound near the left and right outer ear canals of the listener, such as headphones or earphones, has been becoming popular.

[0007] Hereinafter, the sound-emitting device of the present embodiment, such as a sound-emitting device that emits sound near the left and right outer ear canals of the listener, such as headphones or earphones, or a sound-emitting device that pseudo-emits sound near the left and right outer ear canals of the listener using a speaker array or the like, is conveniently referred to as an "outer ear canal sound-emitting device".

[0008] Conventional target response curves are adjusted to give a good impression to the listener when applied to two-channel stereo sound. Therefore, when playing immersive binaural sound with an outer ear canal sound-emitting device having amplitude-frequency characteristics according to a conventional target response curve, the sound image localization direction and sense of distance in the three-dimensional space of the sound source, the left-right, front-back, and up-down width senses, direction sense, sense of distance in the three-dimensional space generated from a combination of multiple sound sources (composite sound sources), and further, the sense of spread of the sound field generated by reflected sound are not reproduced as intended by the original sound source producer.

[0009] In view of the above circumstances, the present invention provides means for reducing the difference between the three-dimensional acoustic space impression intended by the producer of the original immersive sound (stereo sound) source and the three-dimensional acoustic space impression perceived by the listener from the immersive binaural sound emitted from the outer ear canal sound-emitting device.

Means for Solving the Problems

[0010] In order to solve the problem that when immersive binaural sound is reproduced with headphones or earphones, the spatial impression intended by the sound source producer is not reproduced, target response curve data consisting of amplitude-frequency characteristics corrected according to human hearing, perform blanking to remove components that contribute to the perception of the directionality of the sound recognized by humans, and set the acoustic characteristics so as to maintain the timbre recognition characteristics for recognizing the timbre of the sound by the human brain provide the target response curve data as a first aspect.

[0011] Also, in order to solve the problem that when immersive binaural sound is reproduced with headphones or earphones, the spatial impression intended by the sound source producer is not reproduced, a method for generating target response curve data consisting of amplitude-frequency characteristics corrected according to human hearing, perform blanking to remove components that contribute to the perception of the directionality of the sound recognized by humans, and set the acoustic characteristics so as to maintain the timbre recognition characteristics for recognizing the timbre of the sound by the human brain provide the method for generating the target response curve data as a second aspect.

[0012] Also, in order to solve the problem that when immersive binaural sound is reproduced with headphones or earphones, the spatial impression intended by the sound source producer is not reproduced, a target response curve consisting of amplitude-frequency characteristics corrected according to human hearing, perform blanking to remove components that contribute to the perception of the directionality of the sound recognized by humans, and provide a sound emitting device manufactured with reference to the target response curve that sets the acoustic characteristics so as to maintain the timbre recognition characteristics for recognizing the timbre of the sound by the human brain as a third aspect.

[0013] Further, in order to solve the problem that the spatial impression intended by the sound source producer is not reproduced when immersive binaural sound is reproduced with headphones or earphones, the present invention provides a target response curve having amplitude-frequency characteristics corrected according to human hearing, which performs blanking to remove components contributing to the perception of the directionality of the sound recognized by humans and sets the acoustic characteristics so as to retain the timbre recognition characteristics for recognizing the timbre of the sound by the human brain. According to the target response curve, a sound processing device for correcting the amplitude-frequency characteristics of sound is provided as a fourth aspect.

[0014] Further, in order to solve the problem that the spatial impression intended by the sound source producer is not reproduced when immersive binaural sound is reproduced with headphones or earphones, the present invention provides a program for causing a computer to execute a process of correcting the amplitude-frequency characteristics of sound according to a target response curve having amplitude-frequency characteristics corrected according to human hearing, which performs blanking to remove components contributing to the perception of the directionality of the sound recognized by humans and sets the acoustic characteristics so as to retain the timbre recognition characteristics for recognizing the timbre of the sound by the human brain. This program is provided as a fifth aspect.

[0015] Further, the present invention provides, as a sixth aspect, a method for generating target response curve data that removes components contributing to the perception of the directionality of sound generated by the outer shape including at least a human head and sets the acoustic characteristics so as to retain the timbre recognition characteristics by the brain.

[0016] Further, in the method for generating target response curve data according to the sixth aspect described above, it may be adopted as a seventh aspect that the method includes a step of acquiring the acoustic characteristics of the sound from the external auditory meatus to the eardrum of the subject, a step of acquiring the sound pressure adjustment characteristics in which the subject perceives that the loudness of the sound is constant in the entire audible range, and a step of generating target response curve data based on the acoustic characteristics and the sound pressure adjustment characteristics.

[0017] Also, in the method for generating target response curve data according to the above-described seventh aspect, the step of obtaining the acoustic characteristics is a step of generating curve A data indicating the amplitude-frequency characteristics of the sound picked up near the eardrum of the subject while emitting a test sound near the external auditory meatus of the subject. The step of obtaining the sound pressure adjustment characteristics is a step of adjusting the sound pressure of each of the frequency bands other than the reference frequency band by the subject so that the subject feels the same loudness as the sound in the reference frequency band when each of the band-specific pink noises obtained by dividing the audible-range full-band pink noise into a plurality of frequency bands is sequentially emitted at the reference sound pressure near the external auditory meatus of the subject, and generating curve B data indicating the amplitude-frequency characteristics indicated by the increase and decrease amounts of the sound pressure of each of the plurality of frequency bands specified by the adjustment. The step of generating the target response curve data is a step of generating curve X data indicating the amplitude-frequency characteristics obtained by adding the amplitude-frequency characteristics indicated by the curve A data and the amplitude-frequency characteristics indicated by the curve B data as the target response curve data for the subject. Such a configuration may be adopted as an eighth aspect.

[0018] Also, in the method for generating target response curve data according to the above-described eighth aspect, a step of generating curve Y data indicating the amplitude-frequency characteristics obtained by averaging the amplitude-frequency characteristics indicated by the curve X data generated for each of a plurality of subjects as the general-purpose target response curve data may be adopted as a ninth aspect.

[0019] Also, in the method for generating target response curve data according to the above-described seventh aspect, the step of obtaining the acoustic characteristics includes, for each of a plurality of subjects, generating curve A data indicating the amplitude-frequency characteristics of the sound picked up near the eardrum of the subject while a test sound is emitted near the external auditory meatus of the subject, and generating general-purpose curve A data indicating the amplitude-frequency characteristics obtained by averaging the amplitude-frequency characteristics indicated by the plurality of generated curve A data. The step of obtaining the sound pressure adjustment characteristics includes, for each of a plurality of subjects, when each of the band-specific pink noises obtained by dividing the audible-range full-band pink noise into a plurality of frequency bands is sequentially emitted at the reference sound pressure near the external auditory meatus of the subject, the subject adjusts the sound pressure of each of the frequency bands other than the reference frequency band so as to feel the same loudness as the sound in the reference frequency band among the plurality of frequency bands, and generating curve B data indicating the amplitude-frequency characteristics shown by the increase and decrease amounts of the sound pressure of each of the plurality of frequency bands specified by the adjustment, and generating general-purpose curve B data indicating the amplitude-frequency characteristics obtained by averaging the amplitude-frequency characteristics indicated by the plurality of generated curve B data. The step of generating the target response curve data is a step of generating curve Y data indicating the amplitude-frequency characteristics obtained by adding the amplitude-frequency characteristics indicated by the general-purpose curve A data and the amplitude-frequency characteristics indicated by the general-purpose curve B data as general-purpose target response curve data. Such a configuration may be adopted as the tenth aspect.

[0020] Also, in the method for generating target response curve data according to the above-described seventh aspect, the step of acquiring the acoustic characteristics is a step of generating curve A data indicating the amplitude-frequency characteristics of the sound picked up near the eardrum of the subject while a test sound is emitted near the external auditory meatus of the subject by an arbitrary external auditory meatus sound-emitting device. The step of acquiring the sound pressure adjustment characteristics is a step of, near the external auditory meatus of the subject, when each of the band-limited pink noises obtained by dividing the audible-range full-band pink noise into a plurality of frequency bands is sequentially emitted at a reference sound pressure by the external auditory meatus sound-emitting device used in the step of generating the curve A data or an external auditory meatus sound-emitting device of the same type as the external auditory meatus sound-emitting device, adjusting the sound pressure of each of the frequency bands other than the reference frequency band by the subject so as to feel the same loudness as the sound of the reference frequency band among the plurality of frequency bands, and generating curve B data indicating the amplitude-frequency characteristics shown by the increase and decrease amounts of the sound pressure of each of the plurality of frequency bands specified by the adjustment. The step of generating the target response curve data is a step of generating, as target response curve data for the external auditory meatus sound-emitting device used for generating the curve A data and the curve B data for the subject or an external auditory meatus sound-emitting device of the same type as the external auditory meatus sound-emitting device, curve X data indicating the amplitude-frequency characteristics obtained by adding the amplitude-frequency characteristics shown by the curve A data and the amplitude-frequency characteristics shown by the curve B data. Such a configuration may be adopted as the eleventh aspect.

[0021] Also, in the method for generating target response curve data according to the above-described eleventh aspect, a step of generating curve Y data indicating the amplitude-frequency characteristics obtained by averaging the amplitude-frequency characteristics shown by the curve X data generated for each of a plurality of subjects, as general-purpose target response curve data for the external auditory meatus sound-emitting device used for generating the curve X data or an external auditory meatus sound-emitting device of the same type as the external auditory meatus sound-emitting device, may be provided. Such a configuration may be adopted as the twelfth aspect.

[0022] Also, in the method for generating target response curve data according to the above-described seventh aspect, the step of obtaining the acoustic characteristics is, for each of a plurality of subjects, while a test sound is being emitted near the external auditory meatus of the subject by an arbitrary external auditory meatus sound-emitting device, generating curve A data indicating the amplitude-frequency characteristics of the sound picked up near the eardrum of the subject, and generating general-purpose curve A data indicating the amplitude-frequency characteristics obtained by averaging the amplitude-frequency characteristics indicated by the plurality of generated curve A data. The step of obtaining the sound pressure adjustment characteristics is, for each of a plurality of subjects, when each of the band-limited pink noises obtained by dividing the audible-range full-band pink noise into a plurality of frequency bands is sequentially emitted at the reference sound pressure by the external auditory meatus sound-emitting device used for generating the curve A data or an external auditory meatus sound-emitting device of the same type as the external auditory meatus sound-emitting device, adjusting the sound pressure of each of the frequency bands other than the reference frequency band by the subject so as to feel the same loudness as the sound in the reference frequency band among the plurality of frequency bands, and generating curve B data indicating the amplitude-frequency characteristics shown by the increase and decrease amounts of the sound pressure of each of the plurality of frequency bands specified by the adjustment, and generating general-purpose curve B data indicating the amplitude-frequency characteristics obtained by averaging the amplitude-frequency characteristics indicated by the plurality of generated curve B data. The step of generating the target response curve data is a step of generating curve Y data indicating the amplitude-frequency characteristics obtained by adding the amplitude-frequency characteristics indicated by the general-purpose curve A data and the amplitude-frequency characteristics indicated by the general-purpose curve B data as general-purpose target response curve data for the external auditory meatus sound-emitting device used for generating the curve A data and the curve B data or an external auditory meatus sound-emitting device of the same type as the external auditory meatus sound-emitting device. Such a configuration may be adopted as the thirteenth aspect.

[0023] Also, in the method for generating target response curve data according to the above-described seventh aspect, the step of acquiring the acoustic characteristics includes, for each of a plurality of subjects, generating respective curve A data indicating the amplitude-frequency characteristics of the sound picked up near the eardrum of the subject while a test sound is emitted near the external auditory meatus of the subject. The step of acquiring the sound pressure adjustment characteristics includes, for each of a plurality of subjects, when each of the band-specific pink noises obtained by dividing the audible-range full-band pink noise into a plurality of frequency bands is sequentially emitted at a reference sound pressure near the external auditory meatus of the subject, adjusting the sound pressure of each of the frequency bands other than the reference frequency band by the subject so as to feel the same loudness as the loudness of the sound in the reference frequency band among the plurality of frequency bands, and generating respective curve B data indicating the amplitude-frequency characteristics indicated by the increase and decrease amounts of the sound pressure of each of the plurality of frequency bands specified by the adjustment. The step of generating the target response curve data is a step of generating curve Y data indicating the amplitude-frequency characteristics obtained by adding all of the amplitude-frequency characteristics indicated by the curve A data of each of the plurality of subjects and averaging by the number of the plurality of subjects as general-purpose target response curve data, and such a configuration may be adopted as the fourteenth aspect.

[0024] Further, in the method for generating target response curve data according to the above-described seventh aspect, in the step of obtaining the acoustic characteristics, for each of a plurality of subjects, while a test sound is being emitted near the external auditory meatus of the subject by an arbitrary external auditory meatus sound-emitting device, each curve A data indicating the amplitude-frequency characteristics of the sound picked up near the eardrum of the subject is generated. In the step of obtaining the sound pressure adjustment characteristics, for each of a plurality of subjects, when each of the band-specific pink noises obtained by dividing the audible-range full-band pink noise into a plurality of frequency bands is sequentially emitted at a reference sound pressure by the external auditory meatus sound-emitting device used for generating the curve A data or an external auditory meatus sound-emitting device of the same type as the external auditory meatus sound-emitting device, the subject adjusts the sound pressure of each of the frequency bands other than the reference frequency band so as to feel the same loudness as the sound in the reference frequency band among the plurality of frequency bands, and each curve B data indicating the amplitude-frequency characteristics shown by the increase and decrease amounts of the sound pressure of each of the plurality of frequency bands specified by the adjustment is generated. The step of generating the target response curve data is a step of generating, as general-purpose target response curve data for the external auditory meatus sound-emitting device used for generating the curve A data and the curve B data or an external auditory meatus sound-emitting device of the same type as the external auditory meatus sound-emitting device, curve Y data indicating the amplitude-frequency characteristics obtained by adding all of the amplitude-frequency characteristics shown by the curve A data of each of the plurality of subjects and the amplitude-frequency characteristics shown by the curve B data of each of the plurality of subjects and averaging them by the number of the plurality of subjects. Such a configuration may be adopted as the fifteenth aspect.

[0025] Further, in the method for generating target response curve data according to any one of the above-described eighth, tenth, eleventh, thirteenth, fourteenth, and fifteenth aspects, a configuration in which the test sound is band-specific pink noise obtained by dividing audible-range full-band pink noise into a plurality of frequency bands may be adopted as the sixteenth aspect.

[0026] Further, in the method for generating target response curve data according to any one of the above-described eighth, tenth, eleventh, thirteenth, fourteenth, and fifteenth aspects, a configuration in which the test sound is an impulse may be adopted as the seventeenth aspect.

[0027] In addition, in the method for generating target response curve data according to any one of the above-described eighth, tenth, eleventh, thirteenth, fourteenth, and fifteenth aspects, the test sound may be a sweep sound whose frequency continuously or intermittently changes within the audible range, and such a configuration may be adopted as the eighteenth aspect.

[0028] In addition, in the method for generating target response curve data according to any one of the above-described eighth, tenth, eleventh, thirteenth, fourteenth, and fifteenth aspects, the reference frequency band may be a frequency band centered on 500 Hz, and such a configuration may be adopted as the nineteenth aspect.

[0029] In addition, in the method for generating target response curve data according to any one of the above-described eighth, tenth, eleventh, thirteenth, fourteenth, and fifteenth aspects, the reference sound pressure may be 65 dB SPL, and such a configuration may be adopted as the twentieth aspect.

[0030] In addition, in the method for generating target response curve data according to any one of the above-described eighth, tenth, eleventh, thirteenth, fourteenth, and fifteenth aspects, the bandwidth of each of the plurality of frequency bands may be 1 / 3 octave, and such a configuration may be adopted as the twenty-first aspect.

[0031] In addition, the present invention provides, as a twenty-second aspect, target response curve data for setting acoustic characteristics so as to remove components contributing to the perception of the directivity of sound generated by the outer shape including at least a human head and to maintain the tone color recognition characteristics by the brain.

[0032] In addition, the present invention provides, as a twenty-third aspect, a sound emitting device that emits a sound having an amplitude-frequency characteristic according to a target response curve for setting acoustic characteristics so as to remove components contributing to the perception of the directivity of sound generated by the outer shape including at least a human head and to maintain the tone color recognition characteristics by the brain.

[0033] Further, the present invention provides, as a 24th aspect, a sound playback device including a sound correction unit that corrects an input sound according to a target response curve that removes components contributing to the perception of the directionality of sound generated by the outer shape including at least a human head and sets acoustic characteristics so as to maintain the tone color recognition characteristics by the brain, and a sound playback unit that plays back the sound corrected by the sound correction unit.

[0034] Further, as a 25th aspect, a configuration may be adopted in which the sound playback device according to the 23rd or 24th aspect described above is any one of headphones, earphones, a headrest speaker, and a speaker system that generates virtual sound sources.

[0035] Further, in the sound playback device according to the 24th aspect described above, an acquisition unit that acquires target response curve data indicating the target response curve and a storage unit that stores the target response curve data acquired by the acquisition unit are provided, and the sound correction unit corrects the input sound according to the target response curve indicated by the target response curve data stored in the storage unit. A configuration may be adopted as the 26th aspect.

[0036] Further, the present invention provides, as a 27th aspect, a sound processing device including a sound correction unit that corrects an input sound according to a target response curve that removes components contributing to the perception of the directionality of sound generated by the outer shape including at least a human head and sets acoustic characteristics so as to maintain the tone color recognition characteristics by the brain.

[0037] Further, in the sound processing device according to the 27th aspect described above, an acquisition unit that acquires target response curve data indicating the target response curve and a storage unit that stores the target response curve data acquired by the acquisition unit are provided, and the sound correction unit corrects the input sound according to the target response curve indicated by the target response curve data stored in the storage unit. A configuration may be adopted as the 28th aspect.

[0038] Furthermore, the present invention provides, as a 29th aspect, a program for causing a computer to execute a process of removing a component that contributes to the perception of the directionality of sound generated by the outer shape including at least a human head from the input sound and performing correction according to a target response curve that sets acoustic characteristics so as to retain the tone color recognition characteristics by the brain.

[0039] Furthermore, the present invention provides, as a 30th aspect, a recording medium recording a program for causing a computer to execute a process of removing a component that contributes to the perception of the directionality of sound generated by the outer shape including at least a human head from the input sound and performing correction according to a target response curve that sets acoustic characteristics so as to retain the tone color recognition characteristics by the brain.

[0040] Furthermore, the present invention provides, as a 31st aspect, sound data indicating sound obtained by removing a component that contributes to the perception of the directionality of sound generated by the outer shape including at least a human head from the source sound and performing correction according to a target response curve that sets acoustic characteristics so as to retain the tone color recognition characteristics by the brain.

[0041] Furthermore, the present invention provides, as a 32nd aspect, a recording medium recording sound data indicating sound obtained by removing a component that contributes to the perception of the directionality of sound generated by the outer shape including at least a human head from the source sound and performing correction according to a target response curve that sets acoustic characteristics so as to retain the tone color recognition characteristics by the brain.

[0042] Further, the present invention provides, as a 33rd aspect, an acoustic system including a generation unit that generates stereophonic content indicating a sound source position of each of a plurality of sound sources and a sound emitted from the sound source, a binaural rendering unit that generates immersive binaural sound, which is two-channel stereophonic sound, using the stereophonic content generated by the generation unit and a head-related transfer function, and a sound playback unit that plays back the immersive binaural sound generated by the binaural rendering unit. The sound playback unit plays back sound having an amplitude-frequency characteristic according to a target response curve that removes a component contributing to the perception of the directionality of sound generated by an outer shape including at least a human head and sets acoustic characteristics so as to retain the tone color recognition characteristics by the brain.

[0043] Further, the present invention provides, as a 34th aspect, an acoustic system including a generation unit that generates stereophonic content indicating a sound source position of each of a plurality of sound sources and a sound emitted from the sound source, a binaural rendering unit that generates immersive binaural sound, which is two-channel stereophonic sound, using the stereophonic content generated by the generation unit and a head-related transfer function, and a sound playback unit that plays back the immersive binaural sound generated by the binaural rendering unit. In any one of the generation unit, the binaural rendering unit, and the sound playback unit, correction is performed according to a target response curve that removes a component contributing to the perception of the directionality of sound generated by an outer shape including at least a human head and sets acoustic characteristics so as to retain the tone color recognition characteristics by the brain.

[0044] Furthermore, the present invention provides, as a 35th aspect, an acoustic system including: a generation unit that generates stereophonic content indicating a sound source position of each of a plurality of sound sources and a sound emitted by the sound source; a binaural rendering unit that generates immersive binaural sound, which is two-channel stereophonic sound, using the stereophonic content generated by the generation unit and a head-related transfer function; a sound playback unit that plays back the immersive binaural sound generated by the binaural rendering unit; and a sound processing device that is disposed on a sound transmission path from the generation unit to the sound playback unit and performs correction according to a target response curve that removes a component contributing to the perception of the directionality of sound generated by an outer shape including at least a human head from the input sound and sets acoustic characteristics so as to maintain the tone color recognition characteristics by the brain.

[0045] Furthermore, in the acoustic system according to any one of the 33rd to 35th aspects described above, when the generation unit is a stereophonic content generation unit, the acoustic system may include a video generation unit that generates a video of a three-dimensional space of cross-reality and a display unit that displays the video generated by the video generation unit, and the binaural rendering unit may generate stereophonic content having an object in the three-dimensional space indicated by the video generated by the video generation unit as a sound source, which is adopted as a 36th aspect.

[0046] Furthermore, in the acoustic system according to any one of the 33rd to 35th aspects described above, the generation unit may be configured to continuously acquire the sound source position of a moving sound source and generate stereophonic content indicating the sound source position, which is adopted as a 37th aspect.

[0047] Furthermore, in the acoustic system according to the 37th aspect described above, the sound playback unit may be configured to play back sound near the ear canal of a listener who moves along with the moving sound source, which is adopted as a 38th aspect.

[0048] Furthermore, the present invention includes a sound output unit that outputs sound to a sound emitting device that emits sound near the external auditory meatus of a subject, a sound acquisition unit that acquires the sound picked up by a microphone disposed near the eardrum of the subject while the sound output unit is emitting a test sound to the sound emitting device, a curve A data generation unit that generates curve A data indicating the amplitude-frequency characteristics of the sound acquired by the sound acquisition unit, a notification unit that, while the sound output unit is sequentially outputting each of the band-specific pink noises obtained by dividing the audible-range full-band pink noise into a plurality of frequency bands to the sound emitting device at a reference sound pressure, notifies the subject to operate an operation device so as to adjust the sound pressure of each of the frequency bands other than the reference frequency band so that the subject feels the same loudness as the sound in the reference frequency band, an operation signal acquisition unit that acquires an operation signal corresponding to the operation of the subject from the operation device, a curve B data generation unit that generates curve B data indicating the amplitude-frequency characteristics indicated by the amount of increase or decrease in the sound pressure of each of the plurality of frequency bands based on the operation signal acquired by the operation signal acquisition unit, and an individual target response curve data generation unit that generates curve X data indicating the amplitude-frequency characteristics obtained by adding the amplitude-frequency characteristics indicated by the curve A data generated by the curve A data generation unit and the amplitude-frequency characteristics indicated by the curve B data generated by the curve B data generation unit as the target response curve data for the subject, and provides a target response curve data generation system including the same as a 39th aspect.

[0049] Further, the present invention includes a sound output unit that outputs sound to a sound emitting device that emits sound near the external auditory meatus of a subject, a sound acquisition unit that acquires sound picked up by a microphone attached to the end of an extremely fine tube made of a soft material and inserted near the eardrum of the subject while the sound output unit is emitting a test sound to the sound emitting device, a curve A data generation unit that generates curve A data indicating the amplitude-frequency characteristics of the sound acquired by the sound acquisition unit, and a notification unit that, while the sound output unit is sequentially outputting each of the band-specific pink noises obtained by dividing the audible range full-band pink noise into a plurality of frequency bands to the sound emitting device at a reference sound pressure, notifies the subject to operate an operation device so as to adjust the sound pressure of each of the frequency bands other than the reference frequency band so that the subject feels the same loudness as the loudness of the sound in the reference frequency band among the plurality of frequency bands, an operation signal acquisition unit that acquires an operation signal corresponding to the operation of the subject from the operation device, a curve B data generation unit that generates curve B data indicating the amplitude-frequency characteristics indicated by the increase and decrease amounts of the sound pressure of each of the plurality of frequency bands based on the operation signal acquired by the operation signal acquisition unit, and a personal target response curve data generation unit that generates curve X data indicating the amplitude-frequency characteristics obtained by adding the amplitude-frequency characteristics indicated by the curve A data generated by the curve A data generation unit and the amplitude-frequency characteristics indicated by the curve B data generated by the curve B data generation unit as the target response curve data for the subject. A target response curve data generation system including the above is provided as a 40th aspect.

[0050] Further, in the target response curve data generation system according to the 39th or 40th aspect described above, a general-purpose target response curve data generation unit that generates curve Y data indicating the amplitude-frequency characteristics obtained by averaging the amplitude-frequency characteristics indicated by the target response curve data for the subject generated by the personal target response curve data generation unit for each of a plurality of subjects may be provided as a 41st aspect.

[0051] In addition, the present invention provides, as a forty-second aspect, a target response curve data generation system including: a sound output unit that outputs sound to a sound emitting device that emits sound near the external auditory meatus of a subject; a sound acquisition unit that acquires sound picked up by a microphone disposed near the eardrum of the subject while the sound output unit is emitting a test sound to the sound emitting device; a curve A data generation unit that generates curve A data indicating the amplitude-frequency characteristics of the sound acquired by the sound acquisition unit; a notification unit that, while the sound output unit is sequentially outputting each of the band-by-band pink noises obtained by dividing the audible range full-band pink noise into a plurality of frequency bands to the sound emitting device at a reference sound pressure, notifies the subject to operate an operation device so as to adjust the sound pressure of each of the frequency bands other than the reference frequency band so that the subject feels the same loudness as the loudness of the sound in the reference frequency band among the plurality of frequency bands; an operation signal acquisition unit that acquires an operation signal corresponding to the operation of the subject from the operation device; a curve B data generation unit that generates curve B data indicating the amplitude-frequency characteristics indicated by the increase and decrease amounts of the sound pressure of each of the plurality of frequency bands based on the operation signal acquired by the operation signal acquisition unit; and a general-purpose target response curve data generation unit that generates curve Y data indicating the amplitude-frequency characteristics obtained by adding the amplitude-frequency characteristics obtained by averaging the amplitude-frequency characteristics indicated by the curve A data generated by the curve A data generation unit for each of a plurality of subjects and the amplitude-frequency characteristics obtained by averaging the amplitude-frequency characteristics indicated by the curve B data generated by the curve B data generation unit for each of the plurality of subjects as general-purpose target response curve data.

[0052] In addition, the present invention provides, as a 43rd aspect, a target response curve data generation system including: a sound output unit that outputs sound to a sound emission device that emits sound near the external auditory meatus of a subject; a sound acquisition unit that acquires sound picked up by a microphone attached to an end of an extremely fine tube made of a soft material and inserted near the eardrum of the subject while the sound output unit emits a test sound to the sound emission device; a curve A data generation unit that generates curve A data indicating the amplitude-frequency characteristics of the sound acquired by the sound acquisition unit; a notification unit that, while the sound output unit sequentially outputs each of the band-by-band pink noises obtained by dividing the audible range full-band pink noise into a plurality of frequency bands to the sound emission device at a reference sound pressure, notifies the subject to operate an operation device so as to adjust the sound pressure of each of the frequency bands other than the reference frequency band so that the subject feels the same loudness as that of the sound in the reference frequency band among the plurality of frequency bands; an operation signal acquisition unit that acquires an operation signal corresponding to the operation of the subject from the operation device; a curve B data generation unit that generates curve B data indicating the amplitude-frequency characteristics indicated by the increase and decrease amounts of the sound pressure of each of the plurality of frequency bands based on the operation signal acquired by the operation signal acquisition unit; and a general-purpose target response curve data generation unit that generates curve Y data indicating the amplitude-frequency characteristics obtained by adding the amplitude-frequency characteristics obtained by averaging the amplitude-frequency characteristics indicated by the curve A data generated by the curve A data generation unit for each of a plurality of subjects and the amplitude-frequency characteristics obtained by averaging the amplitude-frequency characteristics indicated by the curve B data generated by the curve B data generation unit for each of a plurality of subjects, as general-purpose target response curve data.

[0053] In addition, the present invention provides, as a 44th aspect, a target response curve data generation system including: a sound output unit that outputs sound to a sound emission device that emits sound near the external auditory meatus of a subject; a sound acquisition unit that acquires sound picked up by a microphone disposed near the eardrum of the subject while the sound output unit emits a test sound to the sound emission device; a curve A data generation unit that generates curve A data indicating the amplitude-frequency characteristics of the sound acquired by the sound acquisition unit; a notification unit that, while the sound output unit sequentially outputs each of the band-specific pink noises obtained by dividing the audible-range full-band pink noise into a plurality of frequency bands to the sound emission device at a reference sound pressure, notifies the subject to operate an operation device so as to adjust the sound pressure of each of the frequency bands other than the reference frequency band so that the subject feels the same loudness as that of the sound in the reference frequency band; an operation signal acquisition unit that acquires an operation signal corresponding to the operation of the subject from the operation device; a curve B data generation unit that generates curve B data indicating the amplitude-frequency characteristics indicated by the amount of increase or decrease in the sound pressure of each of the plurality of frequency bands based on the operation signal acquired by the operation signal acquisition unit; and a general-purpose target response curve data generation unit that generates curve Y data indicating the amplitude-frequency characteristics obtained by adding all of the amplitude-frequency characteristics indicated by the curve A data generated by the curve A data generation unit for each of the plurality of subjects and the amplitude-frequency characteristics indicated by the curve B data generated by the curve B data generation unit for each of the plurality of subjects having the same number as the plurality of subjects and averaging them by the number of the plurality of subjects, as general-purpose target response curve data.

[0054] Further, the present invention provides, as a forty-fifth aspect, a target response curve data generation system including: a sound output unit that outputs sound to a sound emission device that emits sound near the external auditory meatus of a subject; a sound acquisition unit that acquires sound picked up by a microphone attached to the end of an extremely fine tube made of a soft material and inserted near the eardrum of the subject while the sound output unit is emitting a test sound to the sound emission device; a curve A data generation unit that generates curve A data indicating the amplitude-frequency characteristics of the sound acquired by the sound acquisition unit; a notification unit that, while the sound output unit is sequentially outputting each of the band-by-band pink noises obtained by dividing the audible range full-band pink noise into a plurality of frequency bands to the sound emission device at a reference sound pressure, notifies the subject to operate an operation device so as to adjust the sound pressure of each of the frequency bands other than the reference frequency band so that the subject feels the same loudness as the loudness of the sound in the reference frequency band among the plurality of frequency bands; an operation signal acquisition unit that acquires an operation signal corresponding to the operation of the subject from the operation device; a curve B data generation unit that generates curve B data indicating the amplitude-frequency characteristics indicated by the increase and decrease amounts of the sound pressure of each of the plurality of frequency bands based on the operation signal acquired by the operation signal acquisition unit; and a general-purpose target response curve data generation unit that generates curve Y data indicating the amplitude-frequency characteristics obtained by adding all of the amplitude-frequency characteristics indicated by the curve A data generated by the curve A data generation unit for each of a plurality of subjects and the amplitude-frequency characteristics indicated by the curve B data generated by the curve B data generation unit for each of the same number of subjects as the plurality of subjects and averaging the result by the number of the plurality of subjects, as general-purpose target response curve data.

[0055] Further, in the target response curve data generation system according to any one of the thirty-ninth, fortieth, forty-second, forty-third, forty-fourth, and forty-fifth aspects described above, a configuration in which the test sound is band-by-band pink noise obtained by dividing the audible range full-band pink noise into a plurality of frequency bands may be adopted as a forty-sixth aspect.

[0056] In addition, in the target response curve data generation system according to any one of the above-described aspects 39, 40, 42, 43, 44, and 45, a configuration in which the test sound is an impulse may be adopted as the 47th aspect.

[0057] In addition, in the target response curve data generation system according to any one of the above-described aspects 39, 40, 42, 43, 44, and 45, a configuration in which the test sound is a sweep sound whose frequency continuously or intermittently changes within the audible range may be adopted as the 48th aspect.

[0058] In addition, in the target response curve data generation system according to any one of the above-described aspects 39, 40, 42, 43, 44, and 45, a configuration in which the reference frequency band is a frequency band centered on 500 Hz may be adopted as the 49th aspect.

[0059] In addition, in the target response curve data generation system according to any one of the above-described aspects 39, 40, 42, 43, 44, and 45, a configuration in which the reference sound pressure is 65 dB SPL may be adopted as the 50th aspect.

[0060] In addition, in the target response curve data generation system according to any one of the above-described aspects 39, 40, 42, 43, 44, and 45, a configuration in which the bandwidth of each of the plurality of frequency bands is 1 / 3 octave may be adopted as the 51st aspect.

[0061] Furthermore, the present invention causes a computer to perform a process of outputting a test sound to a sound-emitting device that emits sound near the external auditory meatus of a subject, a process of acquiring the sound picked up by a microphone near the eardrum of the subject while the test sound is being output, a process of generating curve A data indicating the amplitude-frequency characteristics of the sound acquired in the process of acquiring the sound, a process of causing the sound-emitting device to sequentially output each of the band-specific pink noises obtained by dividing the audible-range full-band pink noise into a plurality of frequency bands at a reference sound pressure, and, in parallel with the process of outputting the band-specific pink noises, a process of outputting a notification to an operation device of the subject to prompt the subject to perform an operation to adjust the sound pressure of each of the band-specific pink noises in the frequency bands other than the reference frequency band so as to feel the same loudness as the loudness of the band-specific pink noise in the reference frequency band among the plurality of frequency bands, a process of acquiring an operation signal corresponding to the operation performed by the subject on the operation device in response to the notification output in the process of outputting the notification, a process of generating curve B data indicating the amplitude-frequency characteristics indicated by the increase and decrease amounts of the sound pressure of each of the plurality of frequency bands based on the operation signal acquired in the process of acquiring the operation signal, and a process of generating curve X data indicating the amplitude-frequency characteristics obtained by adding the amplitude-frequency characteristics indicated by the curve A data and the amplitude-frequency characteristics indicated by the curve B data as target response curve data for the subject, and provides it as a 52nd aspect as a program for causing the above to be executed.

[0062] Further, the present invention causes a computer to perform a process of outputting a test sound to a sound emitting device that emits sound near the external auditory meatus of a subject, a process of acquiring, while the test sound is being output, sound picked up by a microphone attached to the end of an extremely fine tube made of a soft material and inserted near the eardrum of the subject, a process of generating curve A data indicating the amplitude-frequency characteristics of the sound acquired in the process of acquiring the sound, a process of causing the sound emitting device to sequentially output each of the band-specific pink noises obtained by dividing the audible-range full-band pink noise into a plurality of frequency bands at a reference sound pressure, and, in parallel with the process of outputting the band-specific pink noises, a process of causing a notification device that notifies the subject to output a notification to the operation device so as to prompt the subject to perform an operation of adjusting the sound pressure of each of the band-specific pink noises in the frequency bands other than the reference frequency band so as to feel the same loudness as the loudness of the sound of the band-specific pink noise in the reference frequency band among the plurality of frequency bands, a process of acquiring an operation signal corresponding to the operation performed by the subject on the operation device in response to the notification output in the process of outputting the notification by the subject, a process of generating curve B data indicating the amplitude-frequency characteristics indicated by the increase and decrease amounts of the sound pressure of each of the plurality of frequency bands based on the operation signal acquired in the process of acquiring the operation signal, and a process of generating curve X data indicating the amplitude-frequency characteristics obtained by adding the amplitude-frequency characteristics indicated by the curve A data and the amplitude-frequency characteristics indicated by the curve B data as target response curve data for the subject, as a 53rd aspect.

[0063] Further, in the program according to the 52nd or 53rd aspect described above, a configuration may be adopted as a 54th aspect in which the computer is caused to perform a process of generating curve Y data indicating the amplitude-frequency characteristics obtained by averaging the amplitude-frequency characteristics indicated by the curve X data generated in the process of generating the curve X data for each of a plurality of subjects as general-purpose target response curve data.

[0064] Further, the present invention causes a computer to perform a process of outputting a test sound to a sound emitting device that emits sound near the external auditory meatus of a subject, a process of acquiring the sound picked up by a microphone near the eardrum of the subject while the test sound is being output, a process of generating curve A data indicating the amplitude-frequency characteristics of the sound acquired in the process of acquiring the sound, a process of causing the sound emitting device to sequentially output each of the band-specific pink noises obtained by dividing the audible-range full-band pink noise into a plurality of frequency bands at a reference sound pressure, and, in parallel with the process of outputting the band-specific pink noises, a process of outputting a notification to an operation device to prompt the subject to perform an operation of adjusting the sound pressure of each of the band-specific pink noises in a frequency band other than the reference frequency band so that the subject feels the same loudness as the loudness of the band-specific pink noise in the reference frequency band among the band-specific pink noises obtained by dividing the audible-range full-band pink noise into a plurality of frequency bands, a process of acquiring an operation signal corresponding to the operation performed by the subject on the operation device in response to the notification output in the process of outputting the notification, a process of generating curve B data indicating the amplitude-frequency characteristics indicated by the increase and decrease amounts of the sound pressure of each of the plurality of frequency bands based on the operation signal acquired in the process of acquiring the operation signal, and a process of generating curve Y data indicating the amplitude-frequency characteristics obtained by adding the amplitude-frequency characteristics obtained by averaging the amplitude-frequency characteristics indicated by the curve A data generated in the process of generating the curve A data for each of a plurality of subjects and the amplitude-frequency characteristics obtained by averaging the amplitude-frequency characteristics indicated by the curve B data generated in the process of generating the curve B data for each of a plurality of subjects as general-purpose target response curve data, and provides, as a 55th aspect, a program for executing these processes.

[0065] Further, the present invention causes a computer to perform a process of outputting a test sound to a sound emission device that emits sound near the external auditory meatus of a subject, a process of acquiring sound picked up by a microphone attached to the end of an extremely fine tube made of a soft material and inserted near the eardrum of the subject while the test sound is being output, a process of generating curve A data indicating the amplitude-frequency characteristics of the sound acquired in the process of acquiring the sound, a process of causing the sound emission device to sequentially output each of the band-specific pink noises obtained by dividing the audible-range full-band pink noise into a plurality of frequency bands at a reference sound pressure, and, in parallel with the process of outputting the band-specific pink noises, a process of outputting a notification to an operation device of the subject to prompt the subject to perform an operation of adjusting the sound pressure of each of the band-specific pink noises in a frequency band other than the reference frequency band so as to feel the same loudness as the loudness of the band-specific pink noise in the reference frequency band among the band-specific pink noises obtained by dividing the audible-range full-band pink noise into a plurality of frequency bands, a process of acquiring an operation signal corresponding to the operation performed by the subject on the operation device in response to the notification output in the process of outputting the notification, a process of generating curve B data indicating the amplitude-frequency characteristics indicated by the increase and decrease amounts of the sound pressure of each of the plurality of frequency bands based on the operation signal acquired in the process of acquiring the operation signal, and a process of generating curve Y data indicating the amplitude-frequency characteristics obtained by adding the amplitude-frequency characteristics obtained by averaging the amplitude-frequency characteristics indicated by the curve A data generated in the process of generating the curve A data for each of a plurality of subjects and the amplitude-frequency characteristics obtained by averaging the amplitude-frequency characteristics indicated by the curve B data generated in the process of generating the curve B data for each of a plurality of subjects as general-purpose target response curve data, and provides a program for executing these processes as a 56th aspect.

[0066] Further, the present invention causes a computer to perform a process of outputting a test sound to a sound emitting device that emits sound near the external auditory meatus of a subject, a process of acquiring a sound picked up by a microphone near the eardrum of the subject while the test sound is being output, a process of generating curve A data indicating the amplitude-frequency characteristics of the sound acquired in the process of acquiring the sound, a process of causing the sound emitting device to sequentially output each of the band-specific pink noises obtained by dividing the audible-range full-band pink noise into a plurality of frequency bands at a reference sound pressure, and, in parallel with the process of outputting the band-specific pink noises, a process of outputting a notification to an operation device to prompt the subject to perform an operation of adjusting the sound pressure of each of the band-specific pink noises in a frequency band other than the reference frequency band so as to feel the same loudness as the loudness of the band-specific pink noise in the reference frequency band among the band-specific pink noises obtained by dividing the audible-range full-band pink noise into a plurality of frequency bands, a process of acquiring an operation signal corresponding to the operation performed by the subject on the operation device in response to the notification output in the process of outputting the notification, a process of generating curve B data indicating the amplitude-frequency characteristics indicated by the increase and decrease amounts of the sound pressure of each of the plurality of frequency bands based on the operation signal acquired in the process of acquiring the operation signal, and a process of generating curve Y data indicating the amplitude-frequency characteristics obtained by adding up and averaging with the number of the plurality of subjects the amplitude-frequency characteristics indicated by the curve A data generated in the process of generating the curve A data for each of the plurality of subjects and the amplitude-frequency characteristics indicated by the curve B data generated in the process of generating the curve B data for each of the plurality of subjects having the same number as the plurality of subjects as general-purpose target response curve data, and provides it as a 57th aspect as a program for causing the above to be executed.

[0067] In addition, the present invention causes a computer to perform a process of outputting a test sound to a sound emitting device that emits sound near the external auditory meatus of a subject, a process of acquiring, while the test sound is being output, sound picked up by a microphone attached to the end of an extremely fine tube made of a soft material and inserted near the eardrum of the subject, a process of generating curve A data indicating the amplitude-frequency characteristics of the sound acquired in the process of acquiring the sound, a process of causing the sound emitting device to sequentially output each of the band-specific pink noises obtained by dividing the audible-range full-band pink noise into a plurality of frequency bands at a reference sound pressure, and, in parallel with the process of outputting the band-specific pink noises, a process of outputting, to a notification device that notifies the subject, a notification prompting the subject to perform an operation of adjusting the sound pressure of each of the band-specific pink noises in frequency bands other than the reference frequency band so as to feel the same loudness as the loudness of the band-specific pink noise in the reference frequency band among the band-specific pink noises obtained by dividing the audible-range full-band pink noise into a plurality of frequency bands on an operation device, a process of acquiring an operation signal corresponding to the operation performed by the subject on the operation device in response to the notification output in the process of outputting the notification to the subject, a process of generating curve B data indicating the amplitude-frequency characteristics indicated by the increase and decrease amounts of the sound pressure of each of the plurality of frequency bands based on the operation signal acquired in the process of acquiring the operation signal, and a process of generating curve Y data indicating the amplitude-frequency characteristics obtained by adding all of the amplitude-frequency characteristics indicated by the curve A data generated in the process of generating the curve A data for each of a plurality of subjects and the amplitude-frequency characteristics indicated by the curve B data generated in the process of generating the curve B data for each of the plurality of subjects equal in number to the plurality of subjects and averaging the result by the number of the plurality of subjects as general-purpose target response curve data, is provided as a 58th aspect.

[0068] Further, in the program according to any one of the 52nd, 53rd, 55th, 56th, 57th, and 58th aspects described above, a configuration in which the test sound is a band-specific pink noise obtained by dividing the audible-range full-band pink noise into a plurality of frequency bands may be adopted as a 59th aspect.

[0069] Further, in the program according to any one of the above-described aspects 52, 53, 55, 56, 57, and 58, a configuration in which the test sound is an impulse may be adopted as aspect 60.

[0070] Further, in the program according to any one of the above-described aspects 52, 53, 55, 56, 57, and 58, a configuration in which the test sound is a sweep sound whose frequency continuously or intermittently changes within the audible range may be adopted as aspect 61.

[0071] Further, in the program according to any one of the above-described aspects 52, 53, 55, 56, 57, and 58, a configuration in which the reference frequency band is a frequency band centered on 500 Hz may be adopted as aspect 62.

[0072] Further, in the program according to any one of the above-described aspects 52, 53, 55, 56, 57, and 58, a configuration in which the reference sound pressure is 65 dB SPL may be adopted as aspect 63.

[0073] Further, in the program according to any one of the above-described aspects 52, 53, 55, 56, 57, and 58, a configuration in which the bandwidth of each of the plurality of frequency bands is 1 / 3 octave may be adopted as aspect 64.

Advantages of the Invention

[0074] When an immersive binaural sound is emitted by an external auditory meatus sound emitting device having an amplitude-frequency characteristic indicated by target response curve data according to the present invention, a listener can perceive a third-order acoustic space impression closer to the third-order acoustic space impression intended by the producer of the sound source of the immersive binaural sound as compared with the case of using an external auditory meatus sound emitting device according to the prior art.

Brief Description of the Drawings

[0075]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Figure 11

Figure 12

Figure 13

Mode for Carrying Out the Invention

[0076] [Embodiment] The following describes target response curve data according to an embodiment of the present invention.

[0077] The target response curve data generation system 1 is a system for generating target response curve data according to an embodiment of the present invention. The target response curve data generation system 1 includes a computer 11, an audio interface 12 connected to the computer 11, headphones 13 connected to the audio interface 12, and a microphone 14 connected to the audio interface 12.

[0078] The computer 11 includes a memory that stores various data including programs, a processor that performs data processing according to the programs stored in the memory, a display that displays information to a user who is a subject under the control of the processor, and an operation device (such as a keyboard and a mouse) that receives a user's operation and outputs a signal corresponding to the operation to the processor.

[0079] Note that a configuration may be adopted in which one or more of a part of the memory, the display, and the operation device are connected as external devices to the main body of the computer 11 including at least a part of the memory and the processor. Further, the computer 11 may include a composite device such as a touch screen in which the display and the operation device are integrated.

[0080] The audio interface 12 is a device that also serves as a D / A (Digital to Analog) converter that converts digital audio data input from the computer 11 into an analog audio signal and outputs it to the headphones 13, and an A / D (Analog to Digital) converter that converts an analog audio signal input from the microphone 14 into digital audio data and outputs it to the computer 11.

[0081] The headphones 13 are a sound emitting device that emits the sound indicated by the analog audio signal input from the audio interface 12 near the user's left and right outer ear canals.

[0082] The microphone 14 is a sound pickup device that is arranged near the left and right tympanic membranes of the user, picks up sound, and outputs an analog sound signal indicating the picked-up sound to the audio interface 12.

[0083] For example, the microphone 14 is a microphone attached to the end of an extremely fine tube made of a soft material and inserted near the left and right tympanic membranes of the user.

[0084] The target response curve data generation system 1 generates curve Y data that represents a general-purpose, that is, a target response curve for any listener (not limited to a specific listener), which is called curve Y in this embodiment. The generation of this curve Y data is mainly performed through the following steps. (1) Generation of curve A data (2) Generation of curve B data (3) Generation of curve X data (4) Generation of curve Y data

[0085] Note that either the step of generating curve A data in (1) or the step of generating curve B data in (2) may be performed first. Since the step of generating curve X data in (3) is performed using the curve A data generated in the step (1) and the curve B data generated in the step (2), it is performed after the steps (1) and (2). Also, since the step of generating curve Y data in (4) is performed using the curve X data generated in the step (3), it is performed after the step (3).

[0086] (1) Generation of curve A data The following describes the operations performed by the target response curve data generation system 1 for generating curve A data.

[0087] FIG. 2 is a diagram showing the configuration of a data processing apparatus (an example of a targetless response curve data generation system) realized by the computer 11 when generating curve A data. That is, the computer 11 functions as an apparatus including the components shown in FIG. 2 by performing data processing according to a program for generating curve A data.

[0088] The components shown in FIG. 2 will be described below. The storage unit 110 stores various data. In the storage unit 110, test sound data showing the waveforms of respective pink noises divided by a 1 / 3 octave bandwidth from the full audible range pink noise is stored in advance. It is necessary to always use the same data for a plurality of subjects for this test sound data. The amplitude of the full audible range pink noise that is the source of the test sound may be arbitrarily determined within a range where the sound pressure level when the test sound data is emitted does not impose a burden on the subject. However, in the present embodiment, since the same test sound is used as the test sound for generating curve A data and curve B data, when a signal cut out from the full audible range pink noise with a 1 / 3 octave bandwidth centered at a central frequency of 500 Hz is emitted through headphones, it is necessary to adjust the amplitude so that the sound pressure level near the eardrum of the left or right ear of the subject becomes 65 dB SPL. This value of 65 dB SPL is equivalent to the sound pressure level near the eardrum due to the pink noise for each frequency band with a 1 / 3 octave bandwidth centered at a central frequency of 500 Hz when reproducing curve B data. Hereinafter, the frequency bands of those plurality of pink noises for each frequency band will be referred to as the first frequency band, the second frequency band, ···, the nth frequency band in order from the band with a lower frequency. When the audible range (about 10 octaves) is divided by a 1 / 3 octave bandwidth, the number of a plurality of frequency bands is about 30, and it is desirable because appropriate accuracy curve A data can be obtained without imposing an excessive burden on the subject for generating curve A data described below. The same applies to the pink noise used for generating curve B data described later.

[0089] The sound output unit 111 outputs sound data indicating a test sound for generating curve A data to the audio interface 12. In the present embodiment, the test sound for generating curve A data is the band-specific pink noise indicated by the test sound data stored in the storage unit 110 for each of the n frequency bands from the first frequency band to the nth frequency band. For each of the n frequency bands, the sound output unit 111 reads the test sound data from the storage unit 110, generates sound data indicating the test sounds of the left and right two channels (the same sound for both left and right), and outputs it to the audio interface 12.

[0090] The sound acquisition unit 112 acquires, from the audio interface 12, sound data indicating the left and right two-channel sounds picked up by the left and right microphones 14 while the test sound of that frequency band is being played from the headphones 13 for each of the n frequency bands. The sound data acquired by the sound acquisition unit 112 is temporarily stored in the storage unit 110.

[0091] For each of the n frequency bands, the band-specific amplitude-frequency characteristic specifying unit 113 specifies the amplitude value of each of the left and right two-channel sounds indicated by the sound data acquired by the sound acquisition unit 112 and temporarily stored in the storage unit 110, and generates band-specific amplitude value data indicating the specified amplitude values. The band-specific amplitude value data generated by the band-specific amplitude-frequency characteristic specifying unit 113 for each of the n frequency bands is temporarily stored in the storage unit 110.

[0092] The curve A data generation unit 114 interpolates the band-specific amplitude value data (discrete values) temporarily stored in the storage unit 110 for each of the n frequency bands to specify the amplitude-frequency characteristic in the entire audible band. The amplitude-frequency characteristic specified in this way is called curve A. The curve A data generation unit 114 generates curve A data indicating curve A. The curve A data generated by the curve A data generation unit 114 is temporarily stored in the storage unit 110. When the data of curve A is plotted on a two-dimensional graph with the vertical axis being amplitude (dB) and the horizontal axis being frequency (Hz), two curves A (amplitude-frequency characteristics) for each of the left and right channels, that is, the left and right ears of the subject, can be illustrated.

[0093] Curve A indicates the acoustic characteristics of the sound from the external auditory meatus to the eardrum of the subject specific to the headphones used for the measurement.

[0094] FIG. 3 is a diagram showing an example of a flow of processing performed by a computer 11 functioning as an apparatus having the above-described configuration to generate Curve A data. Hereinafter, the processing according to the flow shown in FIG. 3 will be described.

[0095] First, the computer 11 assigns an initial value “1” to a counter i (step S101).

[0096] Subsequently, the computer 11 (sound output unit 111) outputs sound data indicating a test sound in the i-th frequency band to the audio interface 12 (step S102). The audio interface 12 outputs a sound signal obtained by D / A converting the sound data input from the computer 11 to the headphones 13. The headphones 13 emit the sound indicated by the sound signal input from the audio interface 12.

[0097] In parallel with the processing of step S102, the computer 11 (sound acquisition unit 112) acquires, from the audio interface 12, sound data indicating the sound picked up by the microphone 14 (step S103).

[0098] Subsequently, the computer 11 (band-specific amplitude frequency characteristic specifying unit 113) specifies the amplitude value of the sound indicated by the sound data regarding the i-th frequency band acquired in step S103, and generates band-specific amplitude value data indicating the specified amplitude value. The computer 11 (storage unit 110) temporarily stores the band-specific amplitude value data generated in step S104.

[0099] Subsequently, the computer 11 determines whether the counter i is n (step S105).

[0100] When the counter i is not n (step S105; "No"), the computer 11 adds "1" to the counter i (step S106), and for the new i-th frequency band, repeats the processes after steps S102 and S103.

[0101] When the counter i is n (step S105; "Yes"), the computer 11 (curve A data generation unit 114) interpolates the n amplitude value data (discrete values) by band temporarily stored, to identify the amplitude-frequency characteristic in the entire audible range, that is, curve A, and generates curve A data indicating the identified curve A (step S107). The computer 11 (storage unit 110) temporarily stores the curve A data generated in step S107. Thereafter, the computer 11 ends the series of processes for generating the curve A data.

[0102] (2) Generation of curve B data The operations performed by the target response curve data generation system 1 for generating the curve B data will be described below.

[0103] FIG. 4 is a diagram showing the configuration of a data processing device (an example of a target response curve data generation system) realized by the computer 11 when generating the curve B data. That is, the computer 11 functions as a device including the components shown in FIG. 4 by performing data processing according to a program for generating the curve B data.

[0104] The components shown in FIG. 4 will be described below. In FIG. 4, the components common to those shown in FIG. 2 are given the same reference numerals as those used in FIG. 2.

[0105] The storage unit 110 stores various data. In the storage unit 110, test tone data indicating the waveforms of the pink noise for each of the n frequency bands with a 1 / 3 octave bandwidth from the first frequency band to the n-th frequency band is stored.

[0106] The sound output unit 111 outputs sound data indicating a test sound for generating Curve B data to the audio interface 12. In the present embodiment, the test sound for generating Curve B data is the same as the test sound for generating Curve A data. That is, for each of the n frequency bands, the sound output unit 111 reads the test sound data from the storage unit 110, generates sound data indicating test sounds for two channels (the same sound for left and right), and outputs it to the audio interface 12.

[0107] The operation signal acquisition unit 115 acquires a signal (operation signal) generated by an operation device (such as a keyboard or a mouse) of the computer 11 in response to a user's operation on the operation device.

[0108] Based on the operation signal acquired by the operation signal acquisition unit 115, the sound pressure level increase / decrease amount specifying unit 116 for each band specifies the increase / decrease amount (dB SPL) of the sound pressure level when the subject adjusts the sound pressure of the test sound in the first to nth frequency bands (excluding the kth frequency band, which is the reference frequency band) so that the loudness of the test sound (hereinafter referred to as the "comparison target test sound") perceived by the subject when listening to it is equal to the loudness of the test sound (hereinafter referred to as the "reference test sound") in the kth frequency band, which is the reference frequency band, perceived by the subject when listening to it.

[0109] In the present embodiment, the kth frequency band, which is the reference frequency band, is a frequency band centered around 500 Hz. Since sounds around 500 Hz are easy for many listeners to recognize the loudness, it is easy to adjust the loudness of test sounds in other frequency bands to be equal to that of this reference sound. Also, in the present embodiment, the sound pressure of the reference test sound is 65 dB SPL. Since sounds with a sound pressure around 65 dB SPL are not too loud or too soft for many listeners, it is easy to adjust the loudness, and the sound pressure is not burdensome to the listeners.

[0110] The sound pressure increase / decrease amount specifying unit 116 generates sound pressure increase / decrease amount data indicating the specified increase / decrease amount of sound pressure for each of the first to nth frequency bands (excluding the kth frequency band). The sound pressure increase / decrease amount data generated by the sound pressure increase / decrease amount specifying unit 116 for each band is temporarily stored in the storage unit 110.

[0111] The curve B data generation unit 117 interpolates the increase / decrease amount (discrete value) of the sound pressure indicated by the sound pressure increase / decrease amount data temporarily stored in the storage unit 110 for each of the n frequency bands (excluding the kth frequency band), and specifies the amplitude-frequency characteristics in the entire audible range. The amplitude-frequency characteristics specified in this way are called curve B. The curve B data generation unit 117 generates curve B data indicating curve B. The curve B data generated by the curve B data generation unit 117 is temporarily stored in the storage unit 110.

[0112] Curve B indicates the sound pressure adjustment characteristics for the subject to perceive that the loudness of the sound is constant in the entire audible range.

[0113] FIG. 5 is a diagram showing an example of a flow of processing performed by the computer 11 functioning as an apparatus having the above configuration to generate curve B data. The processing according to the flow shown in FIG. 5 will be described below.

[0114] First, the computer 11 assigns an initial value of "1" to the counter j (step S20). Subsequently, the computer 11 assigns an initial value of "1" to the counter i (step S201).

[0115] Subsequently, the computer 11 (sound output unit 111) alternately outputs the sound data indicating the reference test sound and the sound data indicating the test sound of the comparison target test sound in the ith frequency band to the audio interface 12 (step S202). The audio interface 12 converts the sound data input from the computer 11 into a sound signal by D / A conversion and outputs it to the headphones 13. The headphones 13 emit the sound indicated by the sound signal input from the audio interface 12.

[0116] In parallel with the process of step S202 described above, the computer 11 displays a user interface as shown in FIG. 6 on a display (an example of a notification device or a notification unit) (step S203).

[0117] FIG. 6(A) is a user interface displayed on the display of the computer 11 while sound data indicating a reference test sound is output to the audio interface 12 in step S202. That is, while the reference test sound is being emitted from the headphones 13, the computer 11 gives a notification prompting the user to remember the loudness of the reference test sound.

[0118] FIG. 6(B) is a user interface displayed on the display of the computer 11 while sound data indicating a comparison target test sound in the i-th frequency band is output to the audio interface 12 in step S202. That is, while the comparison target test sound is being emitted from the headphones 13, the computer 11 prompts the user to operate a virtual operator (for example, a fader; hereinafter, referred to as a "fader" for convenience) so that the user feels that the loudness of the comparison target test sound is equal to the loudness of the remembered reference test sound, and accepts an operation by the user on the fader. The computer 11 identifies the increase or decrease amount of the sound pressure based on an operation signal obtained from the operation device according to the operation performed by the user on the fader using an operation device (such as a mouse), and increases or decreases the amplitude of the sound data of the comparison target test sound output to the audio interface 12 according to the identified increase or decrease amount of the sound pressure. Further, the computer 11 accepts an operation by the user on a virtual "complete" button displayed in the user interface of FIG. 6(B).

[0119] When the computer 11 (operation signal acquisition unit 115) acquires an operation signal output by the operation device when the user operates the user interface in Fig. 6(B) using an operation device (such as a mouse). Then, when the computer 11 (band-specific sound pressure increase / decrease amount specifying unit 116) determines that the acquired operation signal is an operation on the "Complete" button, it generates sound pressure increase / decrease amount data indicating the increase / decrease amount of the sound pressure of the comparison target test sound indicated by the position of the fader at that time (Fig. 5, step S204). The computer 11 (storage unit 110) temporarily stores the sound pressure increase / decrease amount data generated in step S204.

[0120] Subsequently, the computer 11 determines whether the counter i is equal to n (Fig. 5, step S205).

[0121] If the counter i is not equal to n (step S205; "No"), the computer 11 adds "1" to the counter i (step S206).

[0122] Subsequently, the computer 11 determines whether the counter i is equal to k (step S207).

[0123] If the counter i is not equal to k (step S207; "No"), the computer 11 repeats the processes after steps S202 and S203 for the new i-th frequency band.

[0124] If the counter i is equal to k (step S207; "Yes"), the computer 11 repeats the processes after step S206. That is, by repeating step S206 twice, the processes after steps S202 and S203 when the counter i is equal to k (i.e., the meaningless processes when the comparison target test sound is the reference test sound) are skipped.

[0125] In the determination of step S205, when the counter i is n (step S205; "Yes"), the computer 11 (curve B data generation unit 117) interpolates the increase and decrease amount (discrete value) of the sound pressure indicated by the (n - 1) sound pressure increase and decrease amount data temporarily stored, to identify the amplitude-frequency characteristic in the entire audible range, that is, curve B, and generates curve B data indicating the identified curve B (step S208). The computer 11 (storage unit 110) temporarily stores the curve B data generated in step S208.

[0126] Subsequently, the computer 11 determines whether the counter j is 2 (step S209). When the counter j is not 2 (step S209; "No"), the computer 11 adds 1 to the counter j (step S210), and then repeats the processes after step S201. However, in the process of the second step S202, the comparison target test sound is emitted at a sound pressure obtained by adding the increase and decrease amount indicated by the sound pressure increase and decrease amount data corresponding to the first frequency band temporarily stored, that is, the increase and decrease amount adjusted by the subject for the first time, to 65 dB SPL.

[0127] That is, the subject can confirm the results of their own adjustment in each frequency band, and if it is determined that the magnitudes of the reference test sound and the comparison target test sound in each frequency band are different, in the processes of steps S202 to S204, the amplitude of the sound data of the comparison target test sound output to the audio interface 12 can be increased or decreased in the same manner as the first time.

[0128] After that, when the second step S208 is completed, the computer 11 determines that the counter j is 2 in step S209 (step S209; "Yes"), and ends the series of processes for generating the curve B data. Thereby, the required curve B data is obtained.

[0129] Note that the processing in the second round of steps S202 to S208 is not essential, but it is preferably performed to improve the accuracy of the adjustment results by the subject. Also, in the above example, each time step S202 is repeated, the process of changing the comparison target test sound from the comparison target test sound in the lowest frequency band to the comparison target test sound in the highest frequency band is repeated twice. However, the order in which the comparison target test sounds are emitted is not limited to this. For example, an embodiment is also recommended in which adjustment is performed to make the magnitude of the comparison target test sound in each frequency band the same as the reference test sound while decreasing the frequency from the k-th frequency band, which is the reference test sound, to the (k-1)-th frequency band, the (k-2)-th frequency band, ···, the first frequency band. Next, pressure adjustment of the comparison target test sound in each frequency band is performed while increasing the frequency from the first frequency band to the (k-1)-th frequency band. Then, pressure adjustment of the comparison target test sound in each frequency band is performed while increasing the frequency from the (k+1)-th frequency band to the n-th frequency band. Finally, pressure adjustment of the comparison target test sound in each frequency band is performed while decreasing the frequency from the n-th frequency band to the (k+1)-th frequency band, and a series of processes is terminated.

[0130] (3) Generation of Curve X Data The operations performed by the target response curve data generation system 1 for generating curve X data are described below.

[0131] FIG. 7 is a diagram showing the configuration of a data processing device (an example of a target response curve data generation system) realized by the computer 11 when generating curve X data. That is, the computer 11 functions as a device including the constituent parts shown in FIG. 7 by performing data processing according to a program for generating curve X data.

[0132] The constituent parts shown in FIG. 7 are described below. In FIG. 7, the constituent parts common to those shown in FIG. 2 or FIG. 4 are given the same reference numerals as those used in FIG. 2 or FIG. 4.

[0133] The memory unit 110 stores various data. The memory unit 110 temporarily stores curve A data and curve B data.

[0134] The personal target response curve data generation unit 118 reads the curve A data and the curve B data from the memory unit 110, and generates curve X data indicating an amplitude-frequency characteristic obtained by adding the amplitude-frequency characteristic indicated by the curve A data and the amplitude-frequency characteristic indicated by the curve B data. The curve X data generated by the personal target response curve data generation unit 118 is stored in the memory unit 110. The curve X data generated in this way is data indicating a target response curve for the subject involved in the generation of the curve X data.

[0135] Note that the curve X indicated by the curve X data generated as described above is used as a target response curve with a reference being an ear canal sound emission device of the same type as the ear canal sound emission device used for the generation of the curve X data (including the ear canal sound emission device itself used for the generation of the curve X data), and in this case, its effect is maximally exerted. However, the curve X indicated by the curve X data may be used as a target response curve with a reference being an ear canal sound emission device of a different type from the ear canal sound emission device used for the generation of the curve X data.

[0136] FIG. 8 is a diagram showing a flow of processing performed by the computer 11 functioning as a device having the above configuration to generate curve X data. That is, the computer 11 (personal target response curve data generation unit 118) adds the amplitude-frequency characteristic indicated by the curve A data and the amplitude-frequency characteristic indicated by the curve B data to generate curve X data (step S301). The computer 11 (memory unit 110) stores the curve X data generated in step S301. Thereafter, the computer 11 ends the processing for generating the curve X data.

[0137] Note that in curve X, the absolute value of the amplitude value at each frequency has no important meaning, and the relative value, that is, the relative relationship of the amplitude values at each frequency, has meaning.

[0138] (4) Generation of curve Y data The operations performed by the target response curve data generation system 1 for generating curve Y data are described below.

[0139] First, curve Y data is generated using curve X data generated for each of a plurality of subjects. Therefore, prior to the generation of curve Y data, the generation of curve A data, the generation of curve B data, and the generation of curve X data described above need to be executed for each of the plurality of subjects.

[0140] FIG. 9 is a diagram showing the configuration of a data processing apparatus (an example of a target response curve data generation system) realized by the computer 11 when generating curve Y data. That is, the computer 11 functions as an apparatus including the components shown in FIG. 9 by performing data processing according to a program for generating curve Y data.

[0141] The components shown in FIG. 9 are described below. In FIG. 9, components common to the components shown in FIG. 2, FIG. 4, or FIG. 7 are given the same reference numerals as those used in FIG. 2, FIG. 4, or FIG. 7.

[0142] The storage unit 110 stores various data. Curve X data for each of a plurality of subjects is stored in the storage unit 110.

[0143] The general-purpose targetless response curve data generation unit 119 reads a plurality of curve X data from the storage unit 110 and generates curve Y data indicating an amplitude-frequency characteristic obtained by averaging the amplitude-frequency characteristics indicated by those curve X data. The curve Y data generated by the general-purpose targetless response curve data generation unit 119 is stored in the storage unit 110. The curve Y data generated in this way is data indicating a general-purpose, that is, a targetless response curve for any listener.

[0144] FIG. 10 is a diagram showing a flow of processing performed by the computer 11 that functions as an apparatus having the above-described configuration to generate curve Y data. That is, the computer 11 (general-purpose targetless response curve data generation unit 119) averages the amplitude-frequency characteristics indicated by the curve X data for each of a plurality of subjects and generates curve Y data (step S401). The computer 11 (storage unit 110) stores the curve Y data generated in step S401. Thereafter, the computer 11 ends the processing for generating the curve Y data.

[0145] In curve Y, the absolute value of the amplitude value of each frequency has no important meaning, and the relative value, that is, the relative relationship of the amplitude values of each frequency has meaning.

[0146] By the processing of the targetless response curve data generation system 1 described above, curve X data indicating the targetless response curve for each subject is generated for each subject. Also, by the processing of the targetless response curve data generation system 1 described above, curve Y data indicating a targetless response curve for any listener is generated.

[0147] Note that the curve Y represented by the curve Y data generated as described above is most effective when it is used as a target response curve referenced by an ear canal sound emission device of the same type as the ear canal sound emission device used for generating the curve X data used for generating the curve Y data (including the ear canal sound emission device itself used for generating the curve X data). However, the curve Y represented by the curve Y data may be used as a target response curve referenced by an ear canal sound emission device of a different type from the ear canal sound emission device used for generating the curve X data used for generating the curve Y data.

[0148] Note that the curve X data generated by the processing of the target response curve data generation system 1 described above represents the curve X for each of the left and right ears of an individual subject. However, for many subjects, the curve X for each of the left and right ears is similar. Therefore, the curve X data may represent the curve X for only one of the left and right ears of the subject. Also, the curve X data may represent the curve X obtained by averaging the curves X for each of the left and right ears of the subject. However, in the case of a subject with a large difference in the X curve for each of the left and right ears, it is desirable to use the curve X for each of the left and right ears for each of the left and right ears.

[0149] Also, the curve Y data generated by the processing of the target response curve data generation system 1 described above also represents the curve Y for each of the left and right ears. However, for many subjects, the curve Y obtained by averaging the curve X for the left ear is similar to the curve Y obtained by averaging the curve X for the right ear. Therefore, the curve Y data may represent the curve Y for only one of the left and right ears. Also, the curve Y data may represent the curve Y obtained by averaging the curves Y for each of the left and right ears.

[0150] Experimentally, it has been confirmed that the immersive binaural sound emitted by headphones or earphones manufactured with Curve Y as a reference has higher reproducibility of the spatial impression of sound, that is, the sound image localization and the spatial width or the listener envelopment (LEV), than the immersive binaural sound emitted by conventional popular headphones or earphones.

[0151] When the subject involved in the generation of Curve X listens to the immersive binaural sound emitted by headphones or earphones manufactured with Curve X as a reference, the effects described above for Curve Y appear more prominently.

[0152] Curve X or Curve Y described above is a target response curve that removes the components contributing to the perception of the sound directionality generated by the outer shape including at least a human head, and sets the acoustic characteristics to retain the tone color recognition characteristics by the brain.

[0153] In other words, the outer ear canal sound emitting device with the amplitude frequency characteristics of Curve X or Curve Y emits a sound that retains the tone color information while blanking out (reducing) only the position information among the position information and the tone color information of the input stereo sound.

[0154] Curve A is the amplitude-frequency characteristic of the headphone or earphone observed near the eardrum of a subject when wearing any headphone or earphone. Curve B aims only to enable a listener to correctly recognize timbre and plays a role in correcting the amplitude-frequency characteristic of any worn headphone or earphone. It is important that no information related to the human sound direction perception is included in this Curve B. Therefore, the target response curve data generation system 1 removes the component contributing to the perception of the sound directionality generated by the outer shape including at least the human head by adding these Curve A and Curve B, and specifies a target response curve (Curve X or Curve Y) for setting the acoustic characteristic so as to retain the timbre recognition characteristic by the brain, and generates target response curve data indicating the target response curve.

[0155] FIG. 11 is a graph showing Curve Y and a target response curve T created based on an anechoic chamber.

[0156] In FIG. 11, in the target response curve T, the portion surrounded by the ellipse serves to emphasize the position information in order to give a three-dimensional feeling to the two-channel stereo sound. The immersive binaural sound already includes the position information giving a three-dimensional feeling. Therefore, when the outer ear canal sound emitting device with the amplitude-frequency characteristic according to the target response curve T emits the immersive binaural sound, the emphasis on the originally unnecessary position information is performed. As a result, the sound image localization direction and the sense of distance in the three-dimensional space of the sound source, the left-right, front-back, and up-down width senses, the sense of direction, the sense of distance, and further the sense of spread of the sound field generated by the reflected sound in the three-dimensional space generated from the combination of a plurality of sound sources (composite sound source) are not reproduced as intended by the original sound source producer. This point is a common problem in the target response curve for the purpose of listening to conventional two-channel stereo sound such as the Harman target response curve.

[0157] On the one hand, when the external auditory meatus sound-emitting device with amplitude-frequency characteristics following curve Y (or curve X) emits immersive binaural sound, the original immersive binaural sound is not emphasized with the unnecessary positional information as described above. On the other hand, the timbre information hardly changes due to the amplitude-frequency characteristics derived from the loudness adjustment by the subject. As a result, the sound image localization direction and sense of distance of the sound source in the three-dimensional space, the sense of width, direction, and distance in the left-right, front-back, and up-down directions in the three-dimensional space generated by the combination of multiple sound sources (composite sound sources), and further, the sense of expansion of the sound field caused by the reflected sound are reproduced as intended by the producer of the original sound source.

[0158] The above is the description of the target response curve data generation system 1.

[0159] FIG. 12 is a diagram showing the configuration of the acoustic system 2 using the target response curve data (curve X data or curve Y data) generated by the target response curve data generation system 1.

[0160] The acoustic system 2 includes a stereophonic content generation device 21, a binaural rendering device 22, a sound reproduction device 23, and a sound-emitting device 24.

[0161] The stereophonic content generation device 21 (an example of a generation unit and a stereophonic content generation unit) is a device used by producer A who produces stereophonic content to produce stereophonic content. Note that the stereophonic content generation device 21 may be composed of a plurality of devices (systems) that operate in a coordinated manner.

[0162] The stereophonic content data indicating the stereophonic content generated by the stereophonic content generation device 21 includes sound source position data indicating the sound source position of each of the plurality of sound sources and sound data indicating the sound emitted by the sound source.

[0163] Note that the method by which the stereophonic content generation device 21 generates stereophonic content may be any of a channel-based method, an object-based method, a method combining them, or the like.

[0164] The stereophonic content data generated by the stereophonic content generation device 21 is delivered to the binaural rendering device 22 via the transmission path R1. The transmission path R1 may be in any form such as wired, wireless, a communication network, a recording medium, or a combination thereof. Also, the stereophonic content generation device 21 and the binaural rendering device 22 may be integrally configured. In that case, the transmission path R1 is constituted by a signal line within the device.

[0165] The binaural rendering device 22 (an example of a binaural rendering unit) is a device that generates immersive binaural sound, which is stereophonic sound that has been converted to two channels, using the stereophonic content indicated by the stereophonic content data generated by the stereophonic content generation device 21 and the head transfer function. Note that the binaural rendering device 22 may be constituted by a plurality of devices (systems) that operate in a coordinated manner.

[0166] The immersive binaural sound data indicating the immersive binaural sound generated by the binaural rendering device 22 is delivered to the sound playback device 23 via the transmission path R2. The transmission path R2 may be in any form such as wired, wireless, a communication network, a recording medium, or a combination thereof. Also, the binaural rendering device 22 and the sound playback device 23 may be integrally configured. In that case, the transmission path R2 is constituted by a signal line within the device.

[0167] The sound playback device 23 (an example of a sound output unit) is a device that sequentially outputs the immersive binaural sound data generated by the binaural rendering device 22, or an immersive binaural sound signal obtained by D / A converting the immersive binaural sound data, to the sound output device 24 at a speed corresponding to the playback speed of the immersive binaural sound.

[0168] Sound data or a sound signal is output from the sound playback device 23 to the sound emitting device 24 via the transmission path R3. The transmission path R3 may be in any form such as wired, wireless, a communication network, or a combination thereof.

[0169] The sound emitting device 24 is a device that emits sound actually near the external auditory meatus of the listener B or virtually near the external auditory meatus of the listener B.

[0170] Examples of the sound emitting device 24 that actually emits sound near the external auditory meatus of the listener B include headphones, earphones, headrest speakers, etc. Note that a headrest speaker is a speaker arranged on the left and right of the headrest portion of a seat or a seat equipped with such speakers. Headrest speakers are adopted in seats of moving bodies such as automobiles and gaming seats.

[0171] Examples of the sound emitting device 24 that virtually emits sound near the external auditory meatus of the listener B include a speaker system that generates a virtual sound source near the external auditory meatus of the listener B using a plurality of speakers such as a speaker array.

[0172] The sound emitting device 24 sequentially receives immersive binaural sound data, which is digital data, from the sound playback device 23 and emits sound according to an analog signal obtained by D / A converting the received immersive binaural sound data. Alternatively, the sound emitting device 24 sequentially receives an immersive binaural sound signal, which is an analog signal, from the sound playback device 23 and emits sound according to the received immersive binaural sound signal.

[0173] The curve X data or curve Y data generated by the target response curve data generation system 1 may be used, for example, in any of the following modes.

[0174] (a) The sound emitting device 24 is designed and manufactured so as to emit sound having an amplitude-frequency characteristic according to the target response curve indicated by the curve X data or the curve Y data due to its physical characteristics.

[0175] (b) The sound playback device 24 includes a sound correction unit that corrects the sound data or sound signal received from the sound playback device 23 according to the target response curve indicated by the curve X data or the curve Y data, and plays the sound indicated by the sound data or sound signal corrected by the sound correction unit.

[0176] (c) The sound playback device 23 includes a sound correction unit that corrects the sound data received from the binaural rendering device 22 according to the target response curve indicated by the curve X data or the curve Y data, and outputs the sound data corrected by the sound correction unit, or the sound signal obtained by D / A converting the sound data corrected by the sound correction unit, to the sound playback device 24.

[0177] (d) The binaural rendering device 22 includes a sound correction unit that corrects the sound data included in the stereophonic content data received from the stereophonic content generation device 21 according to the target response curve indicated by the curve X data or the curve Y data, and transfers the sound data generated by performing binaural rendering using the sound data corrected by the sound correction unit to the sound playback device 23.

[0178] (e) The binaural rendering device 22 includes a sound correction unit that corrects the sound data generated by performing binaural rendering using the sound data included in the stereophonic content data received from the stereophonic content generation device 21 according to the target response curve indicated by the curve X data or the curve Y data, and transfers the sound data corrected by the sound correction unit to the sound playback device 23.

[0179] (f) The stereophonic content generation device 21 includes a sound correction unit that corrects the sound data generated according to the instruction of producer A according to the target response curve indicated by the curve X data or the curve Y data, and transfers the stereophonic content data including the sound data corrected by the sound correction unit to the binaural rendering device 22.

[0180] (g) The audio system 2 includes an audio processing device (not shown in FIG. 12) disposed on the transmission path R1, the transmission path R2, or the transmission path R3. The audio processing device includes an audio correction unit that corrects the audio data or audio signal input from the device on the upstream side of the transmission path according to the target response curve indicated by the curve X data or the curve Y data, and outputs the audio data or audio signal corrected by the audio correction unit to the device on the downstream side of the transmission path.

[0181] The sound emitting device 24 of the audio system 2 can serve as an audio display in order to emit sound that allows the listener B to accurately perceive the position of the sound source.

[0182] The above is the description of the audio system 2.

[0183] [Modification Example] The above-described embodiment is an example of the present invention and can be variously modified within the scope of the technical idea of the present invention. Examples of such modifications are shown below. Note that two or more of the modification examples shown below may be combined as appropriate.

[0184] (1) Among the devices included in the above-described audio system 2, the device that corrects the input sound according to the target response curve indicated by the curve X data or the curve Y data may be a computer. In that case, the computer executes a process of correcting the input sound according to the target response curve indicated by the curve X data or the curve Y data according to the program according to the present invention.

[0185] That is, in one aspect, the present invention provides a program for causing a computer to execute a process of correcting an input sound according to a target response curve indicated by curve X data or curve Y data. Further, in one aspect, the present invention provides a recording medium having recorded thereon a program for causing a computer to execute a process of correcting an input sound according to a target response curve indicated by curve X data or curve Y data. Further, in one aspect, the present invention provides a computer including a memory that persistently stores a program for causing a computer to execute a process of correcting an input sound according to a target response curve indicated by curve X data or curve Y data, and a processor that performs data processing according to the program persistently stored in the memory.

[0186] For example, when the stereophonic content generation device 21 is realized by a computer operating according to a DAW (Digital Audio Workstation) program, a program for causing the computer to execute correction according to a target response curve indicated by curve X data or curve Y data for an input sound may be provided as a plugin software incorporated in the DAW program.

[0187] (2) The method by which any device included in the above-described acoustic system 2 corrects an input sound according to a target response curve indicated by curve X data or curve Y data may be any method such as an equalizing process method or a method using a finite impulse response (FIR).

[0188] (3) In one aspect, the present invention provides sound data indicating a sound obtained by correcting a source sound according to a target response curve indicated by curve X data or curve Y data. Further, in one aspect, the present invention provides a recording medium having recorded thereon sound data indicating a sound obtained by correcting a source sound according to a target response curve indicated by curve X data or curve Y data.

[0189] (4) The audio system 2 may be modified to include a video generation device that generates video in a three-dimensional space of cross-reality (virtual reality, augmented reality, mixed reality, alternative reality, etc.) and a display device that displays the video generated by the video generation device, and the binaural rendering device 22 may be configured to generate stereophonic content using an object in the three-dimensional space shown in the video generated by the video generation device as a sound source, thereby forming an audiovisual system.

[0190] FIG. 13 is a diagram showing the configuration of the audiovisual system 3 according to this modification example. The audiovisual system 3 includes a stereoscopic video content generation device 31, a three-dimensional rendering device 32, a video playback device 33, and a display device 34, in addition to the stereophonic content generation device 21, the binaural rendering device 22, the sound playback device 23, and the sound output device 24 included in the audio system 2.

[0191] The stereoscopic video content generation device 31 (an example of a video generation unit) is a device that generates stereoscopic video content data indicating the position, three-dimensional shape, appearance, etc. of an object (person or thing) in the three-dimensional space of cross-reality.

[0192] The three-dimensional rendering device 32 is a device that performs a three-dimensional rendering process, that is, a process of generating a two-dimensional video of the three-dimensional space as seen from the viewer's perspective, based on the stereoscopic video content data generated by the stereoscopic video content generation device 31.

[0193] The video playback device 33 is a device that sequentially outputs the two-dimensional video generated by the three-dimensional rendering device 32 to the display device 34.

[0194] The display device 34 (an example of a display unit) is a device that displays the two-dimensional video output from the video playback device 33.

[0195] The stereophonic content data generated by the stereophonic content generating device 21 indicates, for each sound source in the three-dimensional space, the position of the sound source and the sound emitted by the sound source. The stereoscopic video content data generated by the stereoscopic video content generating device 31 indicates, for each object in the three-dimensional space, the position of the object, the shape, appearance, etc. of the object.

[0196] The coordinates of the three-dimensional space used by the stereophonic content generating device 21 and the coordinates of the three-dimensional space used by the stereoscopic video content generating device 31 are the same. Also, the sound sources handled by the stereophonic content generating device 21 are any of the objects handled by the stereoscopic video content generating device 31. That is, when an object in the three-dimensional space shared by the stereophonic content generating device 21 and the stereoscopic video content generating device 31 serves as a sound source, the position of the object handled by the stereoscopic video content generating device 31 and the position of the sound source handled by the stereophonic content generating device 21 are the same.

[0197] As described above, since the stereophonic content generating device 21 and the stereoscopic video content generating device 31 share the position information of the same object (sound source) in the same coordinate space, the sound emitted from the sound playback device 24 and the video displayed on the display device 34 are interlocked. That is, when an object in the three-dimensional space shown in the video emits a sound, the sound will be perceived by the viewer B as a sound emitted from the position of the object in the three-dimensional space.

[0198] In the audiovisual system 3, the sound emitted to the viewer B is a sound having an amplitude-frequency characteristic according to the target response curve indicated by the curve X data or the curve Y data. Therefore, the viewer B can accurately perceive the position of the sound source in the virtual three-dimensional space.

[0199] The audiovisual system 3 is particularly effective in fields such as games and telemedicine where it is highly necessary for the position of the sound source linked to the video to be accurately transmitted to the viewer.

[0200] Note that the display device 34 may be a wearable device such as a head-mounted display. In that case, data indicating the position and direction of the head of viewer B wearing the head-mounted display (data indicating the viewing point of the viewer) is passed to the binaural rendering device 22 and the three-dimensional rendering device 32, and is used for the generation of sound by the binaural rendering device 22 and the generation of video by the three-dimensional rendering device 32. As a result, viewer B can view video and sound that change according to the movement of his or her head.

[0201] (5) In the above-described audio system 2, the stereo content generation device 21 may continuously acquire the sound source position of a moving sound source and generate stereo content indicating the acquired sound source position. In that case, listener B can correctly perceive the constantly changing position of the sound source moving in the three-dimensional space.

[0202] In this modification, the sound emitting device 24 may emit sound near the external ear canal of listener B who moves along with the moving sound source. For example, when listener B is a musical instrument player and the sound emitting device 24 is worn as an ear monitor, position data indicating the positions of each player including listener B and sound data indicating the sound emitted by the musical instrument of each player are transmitted to the stereo content generation device 21 in real time. The stereo content generation device 21 generates stereo content data using those data. As a result, listener B can perform the performance while perceiving the correct positions of each player from the sound emitted from the sound emitting device 24.

[0203] (6) In the above-described target response curve data generation system 1, the computer 11 (general-purpose target response curve data generation unit 119) specifies, as curve Y, the amplitude-frequency characteristic obtained by averaging the amplitude-frequency characteristics indicated by the curve X data for each of a plurality of subjects. Alternatively, the computer 11 (general-purpose target response curve data generation unit 119) may add the amplitude-frequency characteristic obtained by averaging the amplitude-frequency characteristics indicated by the curve A data for each of a plurality of subjects (general-purpose curve A) and the amplitude-frequency characteristic obtained by averaging the amplitude-frequency characteristics indicated by the curve B data for each of a plurality of subjects (general-purpose curve B) to specify curve Y. In that case, the subjects involved in the generation of curve A data and the subjects involved in the generation of curve B data may be the same or different.

[0204] Further, the computer 11 (general-purpose target response curve data generation unit 119) may add all of the amplitude-frequency characteristics indicated by the curve A data for each of a plurality of subjects and the amplitude-frequency characteristics indicated by the curve A data for each of the same number of subjects as those plurality of subjects, and specify, as curve Y, the amplitude-frequency characteristic obtained by averaging them by the number of those plurality of subjects. In that case, the subjects involved in the generation of curve A data and the subjects involved in the generation of curve B data may be the same or different. Note that according to this modification example, for the specification of curve Y, none of curve X for individual subjects, general-purpose curve A, and general-purpose curve B is specified.

[0205] (7) Among the devices included in the above-described acoustic system 2, a device that corrects an input sound according to a target response curve indicated by curve X data or curve Y data includes an acquisition unit that acquires curve X data or curve Y data, and a storage unit that stores the curve X data or curve Y data acquired by the acquisition unit, and may correct the input sound according to the target response curve indicated by the curve X data or curve Y data stored in the storage unit.

[0206] According to this modification example, for example, by storing the curve X data corresponding to listener B in the sound emission device 24 provided with a sound correction unit, the sound emission device 24 can be customized for listener B. Further, when the suitable curve Y data differs depending on attributes such as the gender, race, age, etc. of the listener, by storing the curve Y data corresponding to the attributes of listener B in the sound emission device 24 provided with a sound correction unit, the sound emission device 24 can be customized for listener B. The same applies when a device other than the sound emission device 24 is provided with a sound correction unit.

[0207] (8) In the above-described embodiment, the test sound emitted to the subject for generating the curve A data was assumed to be band-specific pink noise obtained by dividing the audible range full-band pink noise into a plurality of frequency bands, but it is not limited thereto.

[0208] For example, an impulse may be emitted as the test sound for generating the curve A data. In that case, the computer 11 (curve A data generation unit 114) specifies the amplitude-frequency characteristic of the sound obtained as the impulse response as curve A. When an impulse is used as the test sound, the time taken by the subject for generating the curve A data is extremely short. That is, using an impulse as the test sound is desirable from the viewpoint of reducing the burden on the subject.

[0209] Also, as a test sound for generating curve A data, a sweep sound whose frequency changes continuously or intermittently within the audible range may be emitted. In that case, the combination of the frequency of the sweep sound emitted by the headphones 13 and the amplitude of the sound picked up by the microphone 14 at the time of emission of the sweep sound can be obtained over the entire audible range. The curve A data generation unit 114 identifies curve A from those combinations of frequency and amplitude. When a sweep sound is used as the test sound, by adjusting the sweep speed (in the case of a sweep sound whose frequency changes continuously) or the interval of the sweep frequency (in the case of a sweep sound whose frequency changes intermittently), it is possible to adjust the balance between the time taken by the subject for generating curve A data and the accuracy of the identified curve A. For example, if the subject wants to obtain a highly accurate curve A (or curve X generated using curve A) for themselves even if it takes a long time, the sweep speed (in the case of a sweep sound whose frequency changes continuously) can be slowed down or the interval of the sweep frequency (in the case of a sweep sound whose frequency changes intermittently) can be made smaller, so that a highly accurate curve A can be obtained.

[0210] In addition, in the above-described embodiment, as a test sound for generating curve A data, pink noise for each frequency band with a 1 / 3 octave bandwidth is adopted. Since this pink noise for each frequency band is also used in generating curve B data, it is desirable from the viewpoint of preparing the test sound. Also, when using pink noise for each frequency band for generating curve B data, a highly accurate curve A is more likely to be obtained compared to the case of using the above-described impulse as the test sound, and generally, the time taken by the subject is shorter compared to the case of using the above-described sweep sound as the test sound.

[0211] (9) In the above-described embodiment, the frequency band of the pink noise by band for emission to the subject for generating the curve B data is set to be the frequency band centered on 500 Hz, but it is not limited thereto. That is, for generating the curve B data, the pink noise by band having a frequency band centered on a frequency other than 500 Hz may be emitted as the pink noise by band of the reference frequency band.

[0212] Also, in the above-described embodiment, the reference sound pressure of the pink noise by band for emission to the subject for generating the curve B data is set to 65 dB SPL, but it is not limited thereto. That is, for generating the curve B data, the pink noise by band having a sound pressure other than 65 dB SPL as the reference sound pressure may be emitted.

[0213] Also, in the above-described embodiment, the bandwidth of each of the frequency bands of the plurality of pink noises by band sequentially emitted to the subject for generating the curve A data and the curve B data is set to 1 / 3 octave, but it is not limited thereto. That is, for generating the curve A data or the curve B data, the pink noise of the frequency band having a bandwidth of 1 / m octave (where m is an arbitrary positive number) may be emitted.

Explanation of Signs

[0214] 1... Target response curve data generation system, 2... Acoustic system, 3... Audio-visual system, 11... Computer, 12... Audio interface, 13... Headphones, 14... Microphone, 21... Stereo content generation device, 22... Binaural rendering device, 23... Sound playback device, 24... Sound output device, 31... Stereoscopic video content generation device, 32... 3D rendering device, 33... Video playback device, 34... Display device, 110... Memory unit, 111... Sound output unit, 112... Sound acquisition unit, 113... Band-specific amplitude-frequency characteristic identification unit, 114... Curve A data generation unit, 115... Operation signal acquisition unit, 116... Band-specific sound pressure increase / decrease amount identification unit, 117... Curve B data generation unit, 118... Personal target response curve data generation unit, 119... General-purpose target response curve data generation unit.

Claims

1. A method for generating target response curve data that removes components contributing to the perception of the directionality of sound generated by the outer shape including at least the head of a person and sets acoustic characteristics so as to retain the tone recognition characteristics by the brain, comprising: a step of acquiring the acoustic characteristics of sound from the external auditory meatus of the subject to the eardrum; a step of acquiring sound pressure adjustment characteristics in which the subject perceives that the loudness of sound is constant over the entire audible range; a step of generating target response curve data based on the acoustic characteristics and the sound pressure adjustment characteristics; A method for generating target response curve data comprising the above steps.

2. The step of acquiring the acoustic characteristics is a step of generating curve A data indicating the amplitude-frequency characteristics of the sound picked up near the eardrum of the subject while a test sound is emitted near the external auditory meatus of the subject; The step of acquiring the sound pressure adjustment characteristics is a step of adjusting the sound pressure of each of the frequency bands other than the reference frequency band so that the subject feels the same loudness as the sound in the reference frequency band when, near the external auditory meatus of the subject, each of the band-by-band pink noises obtained by dividing the pink noise over the entire audible range into a plurality of frequency bands is sequentially emitted at the reference sound pressure, and generating curve B data indicating the amplitude-frequency characteristics shown by the increase and decrease amounts of the sound pressure of each of the plurality of frequency bands specified by the adjustment; The step of generating the target response curve data is a step of generating curve X data indicating the amplitude-frequency characteristics obtained by adding the amplitude-frequency characteristics indicated by the curve A data and the amplitude-frequency characteristics indicated by the curve B data as the target response curve data for the subject. The method for generating target response curve data according to Claim 1.

3. A step of generating curve Y data indicating the amplitude-frequency characteristics obtained by averaging the amplitude-frequency characteristics indicated by the curve X data generated for each of a plurality of subjects as general-purpose target response curve data is provided. The method for generating target response curve data according to Claim 2.

4. The step of acquiring the acoustic characteristics is a step of generating curve A data indicating the amplitude-frequency characteristics of the sound picked up near the eardrum of each of a plurality of subjects while a test sound is emitted near the external auditory meatus of each subject, and generating general-purpose curve A data indicating the amplitude-frequency characteristics obtained by averaging the amplitude-frequency characteristics indicated by the plurality of generated curve A data. The step of obtaining the sound pressure adjustment characteristics is, for each of a plurality of subjects, when sequentially emitting each of the band-specific pink noises obtained by dividing the audible-range full-band pink noise into a plurality of frequency bands at a reference sound pressure near the external auditory meatus of the subject, so that the subject feels the same loudness as that of the sound in the reference frequency band among the plurality of frequency bands, the subject adjusts the sound pressure of each of the frequency bands other than the reference frequency band, and generates curve B data indicating the amplitude-frequency characteristics shown by the increase and decrease amounts of the sound pressure of each of the plurality of frequency bands specified by the adjustment, and generates general-purpose curve B data indicating the amplitude-frequency characteristics obtained by averaging the amplitude-frequency characteristics shown by the generated plurality of curve B data. The step of generating the target response curve data is a step of generating curve Y data indicating the amplitude-frequency characteristics obtained by adding the amplitude-frequency characteristics shown by the general-purpose curve A data and the amplitude-frequency characteristics shown by the general-purpose curve B data as general-purpose target response curve data. The method for generating target response curve data according to claim 1.

5. The step of obtaining the acoustic characteristics is a step of generating curve A data indicating the amplitude-frequency characteristics of the sound picked up near the eardrum of the subject while emitting a test sound near the external auditory meatus of the subject by an arbitrary external auditory meatus sound-emitting device. The step of obtaining the sound pressure adjustment characteristics is, near the external auditory meatus of the subject, when sequentially emitting each of the band-specific pink noises obtained by dividing the audible-range full-band pink noise into a plurality of frequency bands at a reference sound pressure by the external auditory meatus sound-emitting device used in the step of generating the curve A data, so that the subject feels the same loudness as that of the sound in the reference frequency band among the plurality of frequency bands, the subject adjusts the sound pressure of each of the frequency bands other than the reference frequency band, and generates curve B data indicating the amplitude-frequency characteristics shown by the increase and decrease amounts of the sound pressure of each of the plurality of frequency bands specified by the adjustment. The step of generating the target response curve data is a step of generating curve X data indicating the amplitude-frequency characteristics obtained by adding the amplitude-frequency characteristics shown by the curve A data and the amplitude-frequency characteristics shown by the curve B data as target response curve data for the subject and for the external auditory meatus sound-emitting device used for generating the curve A data and the curve B data or for an external auditory meatus sound-emitting device of the same type as the external auditory meatus sound-emitting device. The method for generating target response curve data according to claim 1.

6. A step of generating curve Y data showing an amplitude-frequency characteristic obtained by averaging the amplitude-frequency characteristics shown by the curve X data generated for each of a plurality of subjects, as general-purpose target response curve data for an external auditory meatus sound emission device used for generating the curve X data or an external auditory meatus sound emission device of the same type as the external auditory meatus sound emission device. The method for generating target response curve data according to claim 5.

7. The step of obtaining the acoustic characteristics is a step of generating curve A data showing the amplitude-frequency characteristic of the sound picked up near the eardrum of each of a plurality of subjects while a test sound is emitted near the external auditory meatus of the subject by an arbitrary external auditory meatus sound emission device, and generating general-purpose curve A data showing the amplitude-frequency characteristic obtained by averaging the amplitude-frequency characteristics shown by the generated plurality of curve A data. The step of obtaining the sound pressure adjustment characteristic is, for each of a plurality of subjects, when each of the band-by-band pink noises obtained by dividing the audible range full-band pink noise into a plurality of frequency bands is sequentially emitted at a reference sound pressure by the external auditory meatus sound emission device used for generating the curve A data near the external auditory meatus of the subject, the subject adjusts the sound pressure of each of the frequency bands other than the reference frequency band so as to feel the same loudness as the sound of the reference frequency band among the plurality of frequency bands, and generates curve B data showing the amplitude-frequency characteristic of the increase or decrease amount of the sound pressure of each of the plurality of frequency bands specified by the adjustment, and generates general-purpose curve B data showing the amplitude-frequency characteristic obtained by averaging the amplitude-frequency characteristics shown by the generated plurality of curve B data. The step of generating the target response curve data is a step of generating curve Y data showing the amplitude-frequency characteristic obtained by adding the amplitude-frequency characteristic shown by the general-purpose curve A data and the amplitude-frequency characteristic shown by the general-purpose curve B data, as general-purpose target response curve data for an external auditory meatus sound emission device used for generating the curve A data and the curve B data or an external auditory meatus sound emission device of the same type as the external auditory meatus sound emission device. The method for generating target response curve data according to claim 1.

8. The step of obtaining the acoustic characteristics generates, for each of a plurality of subjects, respective curve A data indicating the amplitude-frequency characteristics of the sound picked up near the eardrum of the subject while a test sound is emitted near the external auditory meatus of the subject. The step of obtaining the sound pressure adjustment characteristics is, for each of a plurality of subjects, when each of the band-specific pink noises obtained by dividing the audible-range full-band pink noise into a plurality of frequency bands is sequentially emitted at a reference sound pressure near the external auditory meatus of the subject by the external auditory meatus sound emission device used for generating the curve A data, the subject adjusts the sound pressure of each of the frequency bands other than the reference frequency band so as to feel the same loudness as the sound in the reference frequency band among the plurality of frequency bands, and generates respective curve B data indicating the amplitude-frequency characteristics indicated by the increase or decrease amount of the sound pressure of each of the plurality of frequency bands specified by the adjustment. The step of generating the target response curve data is a step of generating curve Y data indicating the amplitude-frequency characteristics obtained by adding all of the amplitude-frequency characteristics indicated by the curve A data of each of the plurality of subjects and averaging by the number of the plurality of subjects, as general-purpose target response curve data. The method for generating target response curve data according to claim 1.

9. The step of obtaining the acoustic characteristics generates, for each of a plurality of subjects, respective curve A data indicating the amplitude-frequency characteristics of the sound picked up near the eardrum of the subject while a test sound is emitted near the external auditory meatus of the subject by an arbitrary external auditory meatus sound emission device. The step of obtaining the sound pressure adjustment characteristics is, for each of a plurality of subjects, when each of the band-specific pink noises obtained by dividing the audible-range full-band pink noise into a plurality of frequency bands is sequentially emitted at a reference sound pressure near the external auditory meatus of the subject by the external auditory meatus sound emission device used for generating the curve A data, the subject adjusts the sound pressure of each of the frequency bands other than the reference frequency band so as to feel the same loudness as the sound in the reference frequency band among the plurality of frequency bands, and generates respective curve B data indicating the amplitude-frequency characteristics indicated by the increase or decrease amount of the sound pressure of each of the plurality of frequency bands specified by the adjustment. The step of generating the target response curve data is a step of generating curve Y data showing an amplitude-frequency characteristic obtained by adding all of the amplitude-frequency characteristics indicated by the curve A data of each of the plurality of subjects and the amplitude-frequency characteristics indicated by the curve B data of each of the plurality of subjects and averaging the result by the number of the plurality of subjects, as general-purpose target response curve data for an external auditory meatus sound emission device used for generating the curve A data and the curve B data or an external auditory meatus sound emission device of the same type as the external auditory meatus sound emission device. The method for generating target response curve data according to claim 1.

10. The test sound is band-specific pink noise obtained by dividing audible-range full-band pink noise into a plurality of frequency bands. The method for generating target response curve data according to any one of claims 2, 4, 5, 7, 8, and 9.

11. The test sound is an impulse. The method for generating target response curve data according to any one of claims 2, 4, 5, 7, 8, and 9.

12. The test sound is a sweep sound whose frequency changes continuously or intermittently within the audible range. The method for generating target response curve data according to any one of claims 2, 4, 5, 7, 8, and 9.

13. The reference frequency band is a frequency band centered on 500 Hz. The method for generating target response curve data according to any one of claims 2, 4, 5, 7, 8, and 9.

14. The reference sound pressure is 65 dB SPL. The method for generating target response curve data according to any one of claims 2, 4, 5, 7, 8, and 9.

15. The bandwidth of each of the plurality of frequency bands is 1 / 3 octave. The method for generating target response curve data according to any one of claims 2, 4, 5, 7, 8, and 9.

16. A sound output unit that outputs sound to a sound emission device that emits sound near the external auditory meatus of a subject; A sound acquisition unit that acquires the sound picked up by a microphone disposed near the eardrum of the subject while the sound output unit emits a test sound to the sound emission device; A curve A data generation unit that generates curve A data indicating the amplitude-frequency characteristic of the sound acquired by the sound acquisition unit; While the sound output unit outputs each of the band-specific pink noises obtained by dividing the audible-range full-band pink noise into a plurality of frequency bands to the sound playback device in sequence at a reference sound pressure, a notification unit gives a notification to prompt the subject to operate an operation device so as to adjust the sound pressure of each of the frequency bands other than the reference frequency band so that the subject feels the same loudness as that of the sound in the reference frequency band among the plurality of frequency bands. An operation signal acquisition unit that acquires an operation signal corresponding to the operation of the subject from the operation device. A curve B data generation unit that generates curve B data indicating an amplitude-frequency characteristic indicated by the increase / decrease amount of the sound pressure of each of the plurality of frequency bands based on the operation signal acquired by the operation signal acquisition unit. A personal target response curve data generation unit that generates curve X data indicating an amplitude-frequency characteristic obtained by adding the amplitude-frequency characteristic indicated by the curve A data generated by the curve A data generation unit and the amplitude-frequency characteristic indicated by the curve B data generated by the curve B data generation unit as the target response curve data for the subject. A system for generating target response curve data, comprising the above components.

17. A sound output unit that outputs sound to a sound playback device that plays sound near the external auditory meatus of a subject. A sound acquisition unit that acquires the sound picked up by a microphone attached to the end of an extremely fine tube made of a soft material and inserted near the eardrum of the subject while the sound output unit is playing a test sound to the sound playback device. A curve A data generation unit that generates curve A data indicating the amplitude-frequency characteristic of the sound acquired by the sound acquisition unit. While the sound output unit outputs each of the band-specific pink noises obtained by dividing the audible-range full-band pink noise into a plurality of frequency bands to the sound playback device in sequence at a reference sound pressure, a notification unit gives a notification to prompt the subject to operate an operation device so as to adjust the sound pressure of each of the frequency bands other than the reference frequency band so that the subject feels the same loudness as that of the sound in the reference frequency band among the plurality of frequency bands. An operation signal acquisition unit that acquires an operation signal corresponding to the operation of the subject from the operation device. A curve B data generation unit that generates curve B data indicating an amplitude-frequency characteristic indicated by the increase / decrease amount of the sound pressure of each of the plurality of frequency bands based on the operation signal acquired by the operation signal acquisition unit. A personal target response curve data generation unit that generates curve X data indicating an amplitude-frequency characteristic obtained by adding the amplitude-frequency characteristic indicated by the curve A data generated by the curve A data generation unit and the amplitude-frequency characteristic indicated by the curve B data generated by the curve B data generation unit as the target response curve data for the subject A target response curve data generation system comprising the same.

18. A general-purpose target response curve data generation unit that generates curve Y data indicating an amplitude-frequency characteristic obtained by averaging the amplitude-frequency characteristics indicated by the target response curve data for the subject generated by the personal target response curve data generation unit for each of a plurality of subjects as general-purpose target response curve data The target response curve data generation system according to claim 16 or 17.

19. A sound output unit that outputs sound to a sound emission device that emits sound near the external auditory meatus of a subject, A sound acquisition unit that acquires the sound picked up by a microphone disposed near the eardrum of the subject while the sound output unit is emitting a test sound to the sound emission device, A curve A data generation unit that generates curve A data indicating the amplitude-frequency characteristic of the sound acquired by the sound acquisition unit, While the sound output unit is sequentially outputting each of the band-specific pink noises obtained by dividing the audible range full-band pink noise into a plurality of frequency bands to the sound emission device at a reference sound pressure, a notification unit that gives a notification to the subject to operate an operation device so as to adjust the sound pressure of each of the frequency bands other than the reference frequency band so as to feel the same loudness as the sound in the reference frequency band, An operation signal acquisition unit that acquires an operation signal corresponding to the operation of the subject from the operation device, A curve B data generation unit that generates curve B data indicating an amplitude-frequency characteristic indicated by the increase and decrease amount of the sound pressure of each of the plurality of frequency bands based on the operation signal acquired by the operation signal acquisition unit A general-purpose target response curve data generation unit that generates curve Y data indicating an amplitude-frequency characteristic obtained by adding an amplitude-frequency characteristic obtained by averaging the amplitude-frequency characteristics indicated by the curve A data generated by the curve A data generation unit for each of a plurality of subjects and an amplitude-frequency characteristic obtained by averaging the amplitude-frequency characteristics indicated by the curve B data generated by the curve B data generation unit for each of the plurality of subjects, as general-purpose target response curve data A target response curve data generation system comprising the same. **Claim 20** A sound output unit that outputs sound to a sound emitting device that emits sound near the external auditory meatus of a subject, A sound acquisition unit that acquires sound picked up by a microphone attached to the end of an extremely fine tube made of a soft material and inserted near the eardrum of the subject while the sound output unit is emitting a test sound to the sound emitting device, A curve A data generation unit that generates curve A data indicating the amplitude-frequency characteristic of the sound acquired by the sound acquisition unit, While the sound output unit is sequentially outputting each of the band-by-band pink noises obtained by dividing the audible-range full-band pink noise into a plurality of frequency bands to the sound emitting device at a reference sound pressure, a notification unit that gives a notification to the subject to operate an operation device so as to adjust the sound pressure of each of the frequency bands other than the reference frequency band so that the subject feels the same loudness as the sound in the reference frequency band, An operation signal acquisition unit that acquires an operation signal corresponding to the operation of the subject from the operation device, A curve B data generation unit that generates curve B data indicating an amplitude-frequency characteristic indicating the increase or decrease amount of the sound pressure of each of the plurality of frequency bands based on the operation signal acquired by the operation signal acquisition unit, A general-purpose target response curve data generation unit that generates curve Y data indicating an amplitude-frequency characteristic obtained by adding an amplitude-frequency characteristic obtained by averaging the amplitude-frequency characteristics indicated by the curve A data generated by the curve A data generation unit for each of a plurality of subjects and an amplitude-frequency characteristic obtained by averaging the amplitude-frequency characteristics indicated by the curve B data generated by the curve B data generation unit for each of the plurality of subjects, as general-purpose target response curve data A target response curve data generation system comprising the same. **Claim 21** A sound output unit that outputs sound to a sound emitting device that emits sound near the external auditory meatus of a subject, A sound acquisition unit that acquires the sound picked up by a microphone disposed near the eardrum of the subject while the sound output unit is emitting a test sound to the sound playback device; A curve A data generation unit that generates curve A data indicating the amplitude-frequency characteristics of the sound acquired by the sound acquisition unit; While the sound output unit is sequentially outputting each of the band-by-band pink noises obtained by dividing the audible range full-band pink noise into a plurality of frequency bands to the sound playback device at a reference sound pressure, the subject is made to feel the same loudness as that of the sound in the reference frequency band among the plurality of frequency bands, and a notification unit that gives a notification to prompt the subject to operate an operation device to adjust the sound pressure of each of the frequency bands other than the reference frequency band; An operation signal acquisition unit that acquires an operation signal corresponding to the operation of the subject from the operation device; A curve B data generation unit that generates curve B data indicating the amplitude-frequency characteristics indicated by the amount of increase and decrease in the sound pressure of each of the plurality of frequency bands based on the operation signal acquired by the operation signal acquisition unit; A general-purpose target response curve data generation unit that generates curve Y data indicating the amplitude-frequency characteristics obtained by adding all of the amplitude-frequency characteristics indicated by the curve A data generated by the curve A data generation unit for each of a plurality of subjects and the amplitude-frequency characteristics indicated by the curve B data generated by the curve B data generation unit for each of the same number of subjects as the plurality of subjects and averaging them by the number of the plurality of subjects as general-purpose target response curve data A system for generating target response curve data including the above.

22. A sound output unit that outputs sound to a sound playback device that emits sound near the external auditory meatus of the subject; A sound acquisition unit that acquires the sound picked up by a microphone attached to the end of an extremely fine tube made of a soft material inserted near the eardrum of the subject while the sound output unit is emitting a test sound to the sound playback device; A curve A data generation unit that generates curve A data indicating the amplitude-frequency characteristics of the sound acquired by the sound acquisition unit; While the sound output unit is sequentially outputting each of the band-by-band pink noises obtained by dividing the audible range full-band pink noise into a plurality of frequency bands to the sound playback device at a reference sound pressure, the subject is made to feel the same loudness as that of the sound in the reference frequency band among the plurality of frequency bands, and a notification unit that gives a notification to prompt the subject to operate an operation device to adjust the sound pressure of each of the frequency bands other than the reference frequency band; An operation signal acquisition unit that acquires an operation signal corresponding to the operation of the subject from the operation device; A curve B data generation unit that generates curve B data indicating an amplitude-frequency characteristic indicated by an increase or decrease amount of sound pressure in each of the plurality of frequency bands based on the operation signal acquired by the operation signal acquisition unit; A general-purpose target response curve data generation unit that generates curve Y data indicating an amplitude-frequency characteristic obtained by adding all of the amplitude-frequency characteristics indicated by the curve A data generated by the curve A data generation unit for each of a plurality of subjects and the amplitude-frequency characteristics indicated by the curve B data generated by the curve B data generation unit for each of the same number of subjects as the plurality of subjects and averaging the result by the number of the plurality of subjects, as general-purpose target response curve data; A target response curve data generation system comprising the above.

23. The test sound is band-specific pink noise obtained by dividing audible-range full-band pink noise into a plurality of frequency bands. The target response curve data generation system according to any one of claims 16, 17, 19, 20, 21, and 22.

24. The test sound is an impulse. The target response curve data generation system according to any one of claims 16, 17, 19, 20, 21, and 22.

25. The test sound is a sweep sound whose frequency changes continuously or intermittently within the audible range. The target response curve data generation system according to any one of claims 16, 17, 19, 20, 21, and 22.

26. The reference frequency band is a frequency band centered on 500 Hz. The target response curve data generation system according to any one of claims 16, 17, 19, 20, 21, and 22.

27. The reference sound pressure is 65 dB SPL. The target response curve data generation system according to any one of claims 16, 17, 19, 20, 21, and 22.

28. The bandwidth of each of the plurality of frequency bands is 1 / 3 octave. The target response curve data generation system according to any one of claims 16, 17, 19, 20, 21, and 22.

29. In a computer, a process of outputting a test sound to a sound emitting device that emits sound near the external auditory meatus of a subject; a process of acquiring the sound picked up by a microphone near the eardrum of the subject while the test sound is being output; A process of generating curve A data indicating the amplitude-frequency characteristics of the sound acquired in the process of acquiring the sound; A process of sequentially outputting, to the sound playback device, each of the band-specific pink noises obtained by dividing the audible-range full-band pink noise into a plurality of frequency bands, at a reference sound pressure; In parallel with the process of outputting the band-specific pink noises, a process of outputting, to a notification device that notifies the subject, a notification prompting the subject to perform, on an operation device, an operation of adjusting the sound pressure of each of the band-specific pink noises in the frequency bands other than the reference frequency band so as to feel the same loudness as the loudness of the band-specific pink noise in the reference frequency band among the plurality of frequency bands; A process of acquiring an operation signal corresponding to the operation performed by the subject on the operation device in response to the notification output in the process of outputting the notification; A process of generating curve B data indicating the amplitude-frequency characteristics indicated by the increase and decrease amounts of the sound pressure of each of the plurality of frequency bands based on the operation signal acquired in the process of acquiring the operation signal; A process of generating, as target response curve data for the subject, curve X data indicating the amplitude-frequency characteristics obtained by adding the amplitude-frequency characteristics indicated by the curve A data and the amplitude-frequency characteristics indicated by the curve B data; A program for causing the above to be executed.

30. To a computer, A process of outputting a test sound to a sound playback device that plays back sound near the external auditory meatus of a subject; A process of acquiring the sound picked up by a microphone attached to the end of an extremely fine tube made of a soft material and inserted near the eardrum of the subject while the test sound is being output; A process of generating curve A data indicating the amplitude-frequency characteristics of the sound acquired in the process of acquiring the sound; A process of sequentially outputting, to the sound playback device, each of the band-specific pink noises obtained by dividing the audible-range full-band pink noise into a plurality of frequency bands, at a reference sound pressure; In parallel with the process of outputting the band-specific pink noises, a process of outputting, to a notification device that notifies the subject, a notification prompting the subject to perform, on an operation device, an operation of adjusting the sound pressure of each of the band-specific pink noises in the frequency bands other than the reference frequency band so as to feel the same loudness as the loudness of the band-specific pink noise in the reference frequency band among the plurality of frequency bands; A process of acquiring an operation signal corresponding to an operation performed by the subject on the operation device in response to a notification output by the subject in the process of outputting the notification; A process of generating curve B data indicating an amplitude-frequency characteristic indicated by an increase or decrease amount of sound pressure in each of the plurality of frequency bands based on the operation signal acquired in the process of acquiring the operation signal; A process of generating curve X data indicating an amplitude-frequency characteristic obtained by adding the amplitude-frequency characteristic indicated by the curve A data and the amplitude-frequency characteristic indicated by the curve B data as target response curve data for the subject; A program for causing the above to be executed.

31. For the computer, A process of generating curve Y data indicating an amplitude-frequency characteristic obtained by averaging the amplitude-frequency characteristics indicated by the curve X data generated in the process of generating the curve X data for each of a plurality of subjects as general-purpose target response curve data; The program according to claim 29 or 30 for causing the above to be executed.

32. For the computer, A process of outputting a test sound to a sound emitting device that emits sound near the external auditory meatus of the subject; A process of acquiring the sound picked up by a microphone near the eardrum of the subject while the test sound is being output; A process of generating curve A data indicating an amplitude-frequency characteristic of the sound acquired in the process of acquiring the sound; A process of sequentially outputting each of the band-by-band pink noises obtained by dividing the audible-range full-band pink noise into a plurality of frequency bands to the sound emitting device at a reference sound pressure; In parallel with the process of outputting the band-by-band pink noise, a notification device that notifies the subject outputs a notification prompting the subject to perform an operation on the operation device to adjust the sound pressure of each of the band-by-band pink noises in frequency bands other than the reference frequency band so as to feel the same loudness as the loudness of the band-by-band pink noise in the reference frequency band; A process of acquiring an operation signal corresponding to an operation performed by the subject on the operation device in response to a notification output by the subject in the process of outputting the notification; A process of generating curve B data indicating an amplitude-frequency characteristic indicated by an increase or decrease amount of sound pressure in each of the plurality of frequency bands based on the operation signal acquired in the process of acquiring the operation signal; In the process of generating the curve A data for each of a plurality of subjects, the amplitude-frequency characteristic obtained by averaging the amplitude-frequency characteristics indicated by the generated curve A data, and the amplitude-frequency characteristic obtained by averaging the amplitude-frequency characteristics indicated by the generated curve B data in the process of generating the curve B data for each of the plurality of subjects, and generating curve Y data indicating the amplitude-frequency characteristic obtained by adding the two, as general-purpose target response curve data, and A program for causing the execution.

33. To a computer, Output a test sound to a sound emission device that emits sound near the external auditory meatus of the subject, and While outputting the test sound, acquire the sound picked up by a microphone attached to the end of an extremely fine tube made of a soft material and inserted near the eardrum of the subject, and Generate curve A data indicating the amplitude-frequency characteristic of the sound acquired in the process of acquiring the sound, and To the sound emission device, sequentially output each of the band-specific pink noises obtained by dividing the audible-range full-band pink noise into a plurality of frequency bands at a reference sound pressure, and In parallel with the process of outputting the band-specific pink noise, to a notification device that notifies the subject, so that the subject feels the same loudness as the loudness of the band-specific pink noise in the reference frequency band among the band-specific pink noises obtained by dividing the audible-range full-band pink noise into a plurality of frequency bands, output a notification prompting the subject to perform an operation to adjust the sound pressure of each of the band-specific pink noises in the frequency bands other than the reference frequency band on an operation device, and Acquire an operation signal corresponding to the operation performed by the subject on the operation device in response to the notification output in the process of outputting the notification by the subject, and Based on the operation signal acquired in the process of acquiring the operation signal, generate curve B data indicating the amplitude-frequency characteristic indicated by the increase or decrease amount of the sound pressure of each of the plurality of frequency bands, and In the process of generating the curve A data for each of a plurality of subjects, the amplitude-frequency characteristic obtained by averaging the amplitude-frequency characteristics indicated by the generated curve A data, and the amplitude-frequency characteristic obtained by averaging the amplitude-frequency characteristics indicated by the generated curve B data in the process of generating the curve B data for each of the plurality of subjects, and generating curve Y data indicating the amplitude-frequency characteristic obtained by adding the two, as general-purpose target response curve data, and A program for causing the execution.

34. Cause a computer to output a test sound to a sound-emitting device that emits sound near the external auditory meatus of a subject, acquire the sound picked up by a microphone near the eardrum of the subject while the test sound is being output, generate curve A data indicating the amplitude-frequency characteristics of the sound acquired in the process of acquiring the sound, cause the sound-emitting device to sequentially output each of the band-specific pink noises obtained by dividing the audible-range full-band pink noise into a plurality of frequency bands at a reference sound pressure, in parallel with the process of outputting the band-specific pink noises, cause a notification device that notifies the subject to output a notification to prompt the subject to perform, on an operation device, an operation of adjusting the sound pressure of each of the band-specific pink noises in frequency bands other than the reference frequency band so as to feel the same loudness as the loudness of the band-specific pink noise in the reference frequency band among the band-specific pink noises obtained by dividing the audible-range full-band pink noise into a plurality of frequency bands, acquire an operation signal corresponding to the operation performed by the subject on the operation device in response to the notification output in the process of outputting the notification, generate curve B data indicating the amplitude-frequency characteristics indicated by the increase and decrease amounts of the sound pressure of each of the plurality of frequency bands based on the operation signal acquired in the process of acquiring the operation signal, generate curve Y data indicating the amplitude-frequency characteristics obtained by adding all of the amplitude-frequency characteristics indicated by the curve A data generated in the process of generating the curve A data for each of a plurality of subjects and the amplitude-frequency characteristics indicated by the curve B data generated in the process of generating the curve B data for each of the same number of a plurality of subjects as the plurality of subjects and averaging the result by the number of the plurality of subjects as general-purpose target response curve data A program for causing the above to be executed.

35. Cause a computer to output a test sound to a sound-emitting device that emits sound near the external auditory meatus of a subject, acquire the sound picked up by a microphone attached to the end of an extremely fine tube made of a soft material inserted near the eardrum of the subject while the test sound is being output, generate curve A data indicating the amplitude-frequency characteristics of the sound acquired in the process of acquiring the sound, cause the sound-emitting device to sequentially output each of the band-specific pink noises obtained by dividing the audible-range full-band pink noise into a plurality of frequency bands at a reference sound pressure, In parallel with the process of outputting the pink noise for each frequency band, a notification is output to a notification device that notifies the subject, so that the subject feels the same sound volume as the sound volume of the pink noise for the reference frequency band among the pink noises for each frequency band obtained by dividing the audible range full-band pink noise into a plurality of frequency bands, prompting the subject to perform an operation on an operation device to adjust the sound pressure of the pink noise for each frequency band other than the reference frequency band. A process of acquiring an operation signal corresponding to an operation performed by the subject on the operation device in response to the notification output in the process of outputting the notification by the subject. A process of generating curve B data indicating an amplitude-frequency characteristic indicated by an increase or decrease amount of the sound pressure of each of the plurality of frequency bands based on the operation signal acquired in the process of acquiring the operation signal. A process of generating curve Y data indicating an amplitude-frequency characteristic obtained by adding all of the amplitude-frequency characteristics indicated by the curve A data generated in the process of generating the curve A data for each of a plurality of subjects and the amplitude-frequency characteristics indicated by the curve B data generated in the process of generating the curve B data for each of the plurality of subjects equal in number to the plurality of subjects and averaging by the number of the plurality of subjects, as general-purpose target response curve data. A program for executing the above.

36. The test sound is pink noise for each frequency band obtained by dividing the audible range full-band pink noise into a plurality of frequency bands. The program according to any one of claims 29, 30, 32, 33, 34, and 35.

37. The test sound is an impulse. The program according to any one of claims 29, 30, 32, 33, 34, and 35.

38. The test sound is a sweep sound whose frequency changes continuously or intermittently within the audible range. The program according to any one of claims 29, 30, 32, 33, 34, and 35.

39. The reference frequency band is a frequency band centered at 500 Hz. The program according to any one of claims 29, 30, 32, 33, 34, and 35.

40. The reference sound pressure is 65 dB SPL. The program according to any one of claims 29, 30, 32, 33, 34, and 35.

41. The bandwidth of each of the plurality of frequency bands is 1 / 3 octave. The program according to any one of claims 29, 30, 32, 33, 34, and 35.

Images