Signal processing apparatus, audio output apparatus, and signal processing method
By generating different combinations of output frequency bands in a multi-channel audio output driver for frequency analysis and response compilation, the problem of user perception and discomfort in traditional measurement methods is solved, and faster and more comfortable frequency response measurement is achieved.
Patent Information
- Application Number
- CN202380029234.6
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Priority Date
- 2022-03-28
- Filing Date
- 2023-02-24
- Publication Date
- 2024-11-08
AI Technical Summary
In the case of multi-channel audio output drivers, traditional time-sharing measurement methods make it easy for users to perceive the measurement process, which is long measurement time and may cause discomfort for users, especially due to strange noise during D/A conversion.
The output control unit generates different combinations of audio output frequency bands, so that multiple audio output drivers can perform frequency analysis and response compilation at the same time, avoiding individual switches of drivers and reducing mute and noise.
The measurement time is shortened, the possibility of the user perceived the measurement process, and the discomfort caused by the measurement is reduced.
Smart Images

Figure CN118923131A_ABST
Abstract
Description
Technical Field
[0001] The present technology relates to a signal processing device, an audio output device, and a signal processing method, and more particularly, to a technology for measuring a frequency response of each audio output driver in a case where audio output is generated by a plurality of audio output drivers. Background Art
[0002] For example, in the following patent document 1, for an audio output device such as headphones, there is a technology that can be used for signal processing (e.g., noise cancellation signal generation processing) of collecting sound output from an audio output driver, measuring its frequency response, and adjusting the sound signal according to the measured frequency response.
[0003] Specifically, a sound based on the measurement signal is output from the audio output driver to perform frequency analysis on the collected sound signal, and thus a frequency response indicating the sound pressure level and phase of each frequency is measured. For example, in this case, there is a technology that can be used to measure the frequency response while outputting a content sound reproduction signal instead of the measurement signal. This makes it possible to measure the frequency response without the user knowing.
[0004] [Citation List]
[0005] [Patent Document]
[0006] [Patent Document 1]
[0007] Japanese Patent Publication No. 2016-15585 Summary of the invention
[0008] [Technical issues]
[0009] It should be noted that in recent years, headphones and other wearable audio output devices configured to reproduce stereo sounds such as 3D (three-dimensional) audio and 360-degree audio have also become popular. For headphones for stereo reproduction, a multi-channel audio output driver (driver unit) is provided in each of the left ear unit and the right ear unit, allowing the user to perceive content sounds in different directions. By the way, in the subsequent description, the audio output driver may sometimes be referred to as a "driver".
[0010] Now assume that the frequency response of an audio output device having multiple drivers as described above is measured. Specifically, the frequency response of each driver is measured in order to, for example, adjust the noise cancellation process described above.
[0011] When adopting the past method, for each driver, it is conceivable to output a sound signal for measurement so that the frequency response can be measured based on the collected sound signal. That is, the sound output and measurement of each driver are performed in a time-sharing manner.
[0012] However, when the sound output and measurement of each driver are performed in a time-sharing manner as described above, the following problem arises.
[0013] 1) Drivers other than the one being measured are silent. This makes it easier for the user to notice that a measurement is being taken.
[0014] 2) The sound output and measurement of each driver are performed independently. As a result, an interval needs to be set between the sound output and measurement of each driver. As a result, the measurement tends to take a considerable amount of time.
[0015] 3) Further, when the measurement object is switched from one driver to another, strange noise may occur due to D / A conversion and give a user a sense of discomfort.
[0016] The present technology has been created in view of the above circumstances. An object of the present technology is to shorten the measurement time while making it difficult for the user to notice that the frequency response is being measured, and to reduce the user's discomfort caused by the measurement when measuring the frequency response of multiple audio output drivers.
[0017] [Solution to the problem]
[0018] The signal processing device according to the present technology includes an output control unit, a frequency analysis unit, and a frequency response compilation unit. The output control unit enables a plurality of audio output drivers arranged in an audio output device to generate a plurality of audio outputs having different combinations of output frequency bands of sound signals to be outputted from the audio output drivers respectively. The frequency analysis unit performs frequency analysis on the collected sound signals when generating each of the plurality of audio outputs, and obtains a frequency response of each of the plurality of audio outputs. The frequency response compilation unit compiles the frequency response of each audio output driver from the frequency response of each audio output obtained by the frequency analysis unit.
[0019] As described above, a plurality of audio outputs are generated using different combinations of output frequency bands of sound signals to be respectively output from a plurality of audio output drivers, and the frequency response of each audio output driver is compiled based on the frequency response of each audio output. By adopting this method, it is not necessary to sequentially switch the measurement object from one driver to another, thereby eliminating the possibility that a measurement object sound output driver becomes silent.
[0020] In addition, the audio output device according to the present technology includes a plurality of audio output drivers, a sound collection unit, an output control unit, a frequency analysis unit, and a frequency response compilation unit. The sound collection unit collects the sound output from the audio output driver. The output control unit enables the audio output driver to generate a plurality of audio outputs having different combinations of output frequency bands of the sound signal output from the audio output driver. The frequency analysis unit performs frequency analysis on the collected sound signal collected by the sound collection unit when generating each of the plurality of sound output units, and obtains the frequency response of each of the plurality of sound output units. The frequency response compilation unit compiles the frequency response of each audio output driver from the frequency response of each audio output obtained by the frequency analysis unit.
[0021] The above-described audio output device also provides operations similar to those provided by the signal processing device according to the present technology.
[0022] In addition, the signal processing method according to the present technology performed by the signal processing device includes: performing output control processing to enable multiple audio output drivers arranged in the audio output device to generate multiple audio outputs with different combinations of output frequency bands of sound signals to be output from the audio output drivers respectively; performing frequency analysis processing when generating each of the multiple audio outputs, the frequency analysis processing performs frequency analysis on the collected sound signals and obtains the frequency response of each of the multiple audio outputs, and performing a frequency response compilation process, which compiles the frequency response of each audio output driver from the frequency response of each audio output obtained by the frequency analysis processing.
[0023] The above-described signal processing method also provides operations similar to those provided by the signal processing apparatus according to the present technology. BRIEF DESCRIPTION OF THE DRAWINGS
[0024] Figure 1 is a diagram showing a configuration example of the audio output device according to the first embodiment.
[0025] Figure 2 : is a diagram showing an exemplary layout of an audio output driver and a sound collecting section in an audio output device according to an embodiment.
[0026] Figure 3 is a graph showing the frequency response of each audio output driver if the audio output device is not properly adapted.
[0027] Figure 4 is an explanatory diagram showing an example of sound signal processing adjustment based on the measured frequency response.
[0028] Figure 5 is an explanatory diagram showing a specific example of the frequency response measurement method according to the embodiment.
[0029] Figure 6 is a flowchart showing an example of a processing procedure for realizing the frequency response measurement method according to the first embodiment.
[0030] Figure 7 is a diagram showing an example of the configuration of an audio output device according to the second embodiment.
[0031] Figure 8 1 is an explanatory diagram showing a silent period, a soft sound period, and a loud sound period occurring in content sound.
[0032] Fig. 9 is a flowchart showing an example of a processing procedure for realizing the frequency response measurement method according to the second embodiment.
[0033] Fig.10 : is an explanatory diagram showing a frequency response measurement method according to a modification example.
[0034] Fig.11 It is an explanatory diagram showing an example of performing frequency response measurement according to a user's instruction.
[0035] Fig.12 is an explanatory diagram showing another example of frequency response measurement according to an instruction of a user. DETAILED DESCRIPTION
[0036] Embodiments according to the present technology will now be described in the following order with reference to the drawings.
[0037] <1. First Embodiment>
[0038] (1-1. Configuration of audio output device)
[0039] (1-2. Frequency Response Measurement Method According to Embodiment)
[0040] (1-3. Processing procedures)
[0041] <2. Second Embodiment>
[0042] <3. Modifications>
[0043] <4. Overview of Embodiments>
[0044] <5. This technology>
[0045] The following assumes that a pair of headphones is used as an example of an audio output device to describe the embodiment. The description given below relates to an example of listening to 3D audio or other stereo content. It should be noted that the audio output driver installed in the headphones is sometimes also referred to as a "driver" below.
[0046] <1. First Embodiment>
[0047] (1-1. Configuration of audio output device)
[0048] Figure 1 An example of the configuration of the headphones 1 according to the first embodiment of the audio output device of the present technology is shown.
[0049] As shown in the figure, the headphones 1 include multiple drivers 2, a frequency response measuring unit 3, a decoder 4, an adding unit 5, a D / A (digital-to-analog) conversion unit 6, an amplifier 7, a sound collecting unit 8, an amplifier 9, an A / D (analog-to-digital) conversion unit 10, an NC (noise cancellation) signal generating unit 11, a sound collecting unit 12, an amplifier 13 and an A / D conversion unit 14.
[0050] The earphone 1 includes a set of drivers for generating audio output for the user's left ear and a set of drivers for generating audio output for the user's right ear. However, regarding the configuration in the output stage of the decoder 4, Figure 1 The configuration of one of the left and right ears is depicted. The configuration of the other ear is similar to the depicted configuration and will not be redundantly depicted.
[0051] Here, as an example for explanation, it is assumed that the headphone 1 has three drivers 2 on each of the left and right sides.
[0052] Figure 2 An exemplary layout of the driver 2 and the sound collecting portion 12 in the earphone 1 is schematically shown.
[0053] As shown in the figure, a plurality of drivers 2 are provided at predetermined positions in the housing of the earphone 1 covering the user's ear 100. In addition, the sound collecting portion 12 is also arranged at a predetermined position in the housing.
[0054] The sound collecting unit 12 is provided to collect sounds from each driver 2 for frequency response measurement described later. Therefore, the sound collecting unit 12 is disposed in a housing capable of collecting sounds output from each driver 2 .
[0055] Reference Figure 1 As described, content sound data CT, which is content sound data such as data of stereo content, is transmitted to the headphones 1 from a source external to the headphones 1. It should be noted that the source of the content sound data CT may be provided within the headphones 1.
[0056] In this example, the content audio data CT is encoded by a predetermined encoding method, and the decoder 4 obtains an audio signal in the form of a digital signal by decoding the content audio data CT.
[0057] When the content audio data CT is stereo content data, the decoder 4 outputs an audio signal for each driver 2 .
[0058] It should be noted that the earphone 1 in this example also supports stereo reproduction using two channels (i.e., a left channel and a right channel), and stereo content sound data can be input as the content sound data CT. In this case, the decoder 4 outputs a monaural sound signal for each of the left channel and the right channel. That is, the circuit parts for the left ear and the right ear in the output stage of the decoder 4 receive the corresponding output monaural sound signals, respectively.
[0059] For example, in the headphone 1 , the functions of the frequency response measuring section 3 and the NC signal generating section 11 are realized by one or more microprocessors.
[0060] Furthermore, in the headphone 1 , a sound signal supply line is formed for each of a plurality of drivers 2 (three drivers 2 in this example) provided corresponding to the audio output of stereo content.
[0061] When audio data of stereo content is sent as content audio data CT and audio signals of each driver 2 are input from decoder 4 , frequency response measurement unit 3 (output control unit 31 described later) outputs the audio signals of each driver 2 to the power supply line of the corresponding driver 2 .
[0062] The sound signal of each driver 2 output from the frequency response measurement unit 3 passes through the adder 5, is converted into an analog signal by the D / A converter 6, is amplified by the amplifier 7, and is provided to each driver 2 as a drive signal.
[0063] As a result, each driver 2 generates a sound output based on the corresponding sound signal.
[0064] In addition, the headphone 1 in the present embodiment has a configuration for noise cancellation, which includes a sound collecting section 8, an amplifying section 9, an A / D converting section 10, an NC signal generating section 11, and an adding section 5. Here, as a configuration for noise cancellation, a configuration for performing NC processing using the FF (feedforward) method is exemplified. However, a configuration for performing NC processing by using the FB (feedback) method can also be applied to the configuration for noise cancellation.
[0065] For example, the sound collecting unit 8 includes one or more microphones and collects sound according to the FF method. Specifically, the sound propagating from the outside of the shell to the shell for the earphone 1 is collected as noise sound. Therefore, the microphone of the sound collecting unit 8 is configured outside the shell, for example, and can collect sound from outside the shell.
[0066] The sound signal collected by the sound collecting unit 8 is amplified by the amplifying unit 9 , converted into a digital signal by the A / D converting unit 10 , and output to the NC signal generating unit 11 .
[0067] The NC signal generating unit 11 processes the collected sound signal obtained from the sound collected by the sound collecting unit 8 input via the A / D converting unit 10, that is, the collected sound data of the sound propagated from outside the housing as noise, and generates an NC signal for eliminating the noise. Figure 1 As shown, when the output from the output control unit 31 is input to the NC signal generating unit 11, the drive signal information of the driver 2 can be used for NC signal generation. In this embodiment, the NC signal generating unit 11 generates NC signals by executing processing based on the FF-NC algorithm, for example.
[0068] In the present embodiment, the NC signal generating unit 11 generates the NC signal of each driver 2 and outputs the NC signal of each driver 2 to the adding unit 5 .
[0069] The adding unit 5 adds the NC signal of each driver 2 input from the NC signal generating unit 11 and the sound signal of each driver 2 input from the frequency response measuring unit 3 .
[0070] When the NC function is turned on, the sound signal to which the NC signal is added by the adding section 5 is supplied to the corresponding driver 2 via the D / A converter 6 and the amplifier 9. As a result, the NC effect is achieved.
[0071] Here, the NC signal generating section 11 of the present example has a function of adjusting the NC signal generating process according to information on the frequency response measured by the frequency response measuring section 3. However, such a function of the NC signal generating section 11 will be described later.
[0072] In the headphone 1 , the sound collecting section 12 , the amplifying section 13 , and the A / D converting section 14 are provided so that the frequency response measuring section 3 can measure the frequency response.
[0073] The sound collecting unit 12 includes one or more microphones. As described above, the sound collecting unit 12 collects the sound output from each driver 2. The collected sound signal collected by the sound collecting unit 12 is amplified by the amplifier 13, converted into a digital signal by the A / D converter 14, and output to the frequency response measuring unit 3.
[0074] The frequency response measurement unit 3 has the functions of an output control unit 31, a frequency analysis unit 32, and a frequency response compilation unit 33, and obtains the frequency response of each driver 2 based on the result of output control of the sound signal used for frequency response measurement and the result of frequency analysis performed on the collected sound signal collected by the sound collection unit 12.
[0075] The frequency response measurement section 3 is an embodiment of a signal processing device according to the present technology.
[0076] It should be noted that the processing performed by the frequency response measurement section 3 according to the embodiment will be described later.
[0077] (1-2. Frequency Response Measurement Method According to Embodiment)
[0078] Here, it should be noted that when the frequency response is measured by frequency analysis of the collected sound signal collected by the sound collecting portion 12 provided in the shell, it is possible to estimate the fitting state of the user wearing the earphone 1. For example, in the case where the shell is not in sufficient contact with the periphery of the user's ear 100 due to, for example, inappropriate fitting of the earphone 1, the frequency response of the sound pressure level in the attenuated low frequency range (low frequency band) is measured because the degree of sealing provided by the shell is lower than the expected degree of sealing.
[0079] Figure 3 Shown is the frequency response (sound pressure level characteristics at each frequency) of each driver 2 in the case where the headphone 1 is not properly fitted as described above.
[0080] like Figure 3 As shown, in the case where the earphone 1 is not properly assembled, the frequency response of each driver 2 is such that the sound pressure level in the low frequency range tends to be reduced. However, the drivers 2 are arranged at different positions. Therefore, the frequency response of the drivers 2 is not necessarily consistent, and the frequency response varies more or less from one driver to another.
[0081] Therefore, for example, when adjusting the NC signal generation processing of the NC signal generation unit 11 based on the result of frequency response measurement, in order to adjust the NC signal generation processing of each driver 2 based on the frequency response of each driver 2, it is necessary to measure the frequency response of each driver 2 respectively.
[0082] Here, it is conceivable that the NC signal generation process adjustment to be performed by the NC signal generation unit 11 may be performed based on the difference between the measured frequency response R (which is the actually measured frequency response) and the target frequency response T, for example, as Figure 4 That is, the NC signal generation process can be adjusted to eliminate the difference between the measured frequency response R and the target frequency response T.
[0083] It should be noted that the above-mentioned difference between the measured frequency response R and the target frequency response T does not essentially need to be determined for the purpose of adjustment of the NC signal generation process. For example, when adjustment is performed in order to suppress the reduction of the NC effect caused by the inappropriate headphone 1, a plurality of frequency responses may be defined based on the degree of inappropriateness caused by the inappropriate headphone 1, and an NC signal generation process adjustment parameter for suppressing the reduction of the NC effect may be defined in association with each defined frequency response. The next step may be to determine which of the plurality of defined frequency responses corresponds to the measured frequency response R. In the event that a corresponding frequency response is found, the NC signal generation process may be performed by using the adjustment parameter associated with the corresponding frequency response (i.e., the NC signal generation process may be adjusted).
[0084] Here, when measuring the frequency response of each driver 2 individually, the output of the measurement sound signal and the frequency response measurement may be performed in a time-division manner for each driver 2 .
[0085] However, if this method is adopted, the above-mentioned problems 1) to 3) will occur.
[0086] Therefore, the present embodiment is configured so that Figure 1 The frequency response measurement section 3 described in has the functions of an output control section 31 , a frequency analysis section 32 , and a frequency response compilation section 33 .
[0087] Specifically, the output control unit 31 causes the driver 2 to generate a plurality of audio outputs having different combinations of output frequency bands of audio signals output by each driver 2 .
[0088] Furthermore, the frequency analysis unit 32 performs frequency analysis on the collected sound signal when generating each of the plurality of sound output units, and obtains the frequency response of each of the plurality of sound output units.
[0089] Furthermore, the frequency response compiling section 33 compiles the frequency response of each driver 2 from the frequency response of each audio output obtained by the frequency analyzing section 32 .
[0090] In this example, the frequency response of each driver 2 is measured in the output of the content sound reproduction signal, specifically, in the output of the sound signal which is the stereo content reproduction signal.
[0091] Figure 5 is an explanatory diagram showing a specific example of the frequency response measurement method according to the embodiment.
[0092] Hereinafter, a description will be given of a case where there are three drivers 2. When the drivers 2 are distinguished from each other, they are designated by using reference symbols "Dr1", "Dr2" and "Dr3".
[0093] First, if Figure 5 As shown in A of FIG. 1 , the output control section 31 in the frequency response measurement section 3 sets the combination of the output frequency bands for the sound signal of each driver 2 to a predetermined combination, and causes each driver 2 to generate an audio output. Specifically, in this case, when the output frequency bands of the drivers Dr1, Dr2, and Dr3 are regarded as a low frequency range, a middle frequency range, and a high frequency range, respectively, the sound signal of each driver 2 (the sound signal of the content sound in this example) is output.
[0094] In the above case, for the sound signal to be output to the driver Dr1, LPF (low pass filter) processing is performed on the sound signal of the driver Dr1 input from the decoder 4 so as to pass only the low frequency. In addition, for the sound signal to be output to the driver Dr2, BPF (band pass filter) processing is performed on the sound signal of the driver Dr2 input from the decoder 4 so as to pass only the intermediate frequency. For the sound signal to be output to the driver Dr3, HPF (high pass filter) processing is performed on the sound signal of the driver Dr3 input from the decoder 4 so as to pass only the high frequency.
[0095] Next, in this way, after the frequency analysis unit 32 causes each driver 2 to generate a sound output by setting the combination of the output frequency bands of the sound signals of each driver 2 to a predetermined combination, the frequency analysis unit 32 performs frequency analysis on the sound signals collected by the sound collection unit 12 and input via the A / D conversion unit 14, for example, by Fourier transform such as FFT (Fast Fourier Transform), thereby obtaining a frequency response of the generated sound output.
[0096] Then, if Figure 5 As shown in FIG. 1B, the output control unit 31 sets the combination of the output frequency bands of the sound signals of each driver 2 to be the same as Figure 5 The combination shown in A is different from the combination shown in A, so that each driver 2 generates a sound output. Specifically, in this case, when the output frequency bands of drivers Dr1, Dr2 and Dr3 are respectively regarded as the middle frequency range, the high frequency range and the low frequency range, the sound signal of each driver 2 is output.
[0097] Next, in this way, after causing each driver 2 to generate a sound output with a different combination of output frequency bands of the sound signal generated by each driver 2, the frequency analysis unit 32 performs frequency analysis on the collected sound signal collected by the sound collection unit 12 and input through the A / D conversion unit 14, thereby obtaining a frequency response of the generated sound output.
[0098] In addition, if Figure 5As shown in C, the output control unit 31 sets the combination of the output frequency bands of the sound signals of each driver 2 to a combination different from the combination shown in A and B, so that each driver 2 generates a sound output. Specifically, in this case, when the output frequency bands of the drivers Dr1, Dr2, and Dr3 are respectively regarded as the high frequency range, the low frequency range, and the middle frequency range, the sound signal of each driver 2 is output.
[0099] Next, in this way, after causing each driver 2 to generate a sound output with a different combination of output frequency bands of the sound signal generated by each driver 2, the frequency analysis unit 32 performs frequency analysis on the collected sound signal collected by the sound collection unit 12 and input through the A / D conversion unit 14, thereby obtaining a frequency response of the generated sound output.
[0100] Then, as described above, the output control section 31 causes the driver 2 to generate a plurality of sound outputs having different combinations of output frequency bands of the sound signal of each driver 2, and then the frequency analysis section 32 obtains a frequency response of each audio output by frequency analyzing the collected sound signal when generating each of the plurality of audio outputs, and the frequency response compilation section 33 compiles the frequency response of each audio output driver from the frequency response of each audio output obtained by the frequency analysis section 32. Specifically, the frequency response compilation section 33 extracts, for each driver 2, the frequency response of the frequency band output when generating each audio output from the frequency response obtained when generating the above-mentioned respective audio outputs, and obtains the frequency response of each driver 2 by combining the frequency responses extracted for each driver 2.
[0101] More specifically, in Figure 5 In the example of , the frequency response compiling section 33 compiles the frequency response of the driver Dr1 in the following manner. That is, the frequency response in the low frequency range is extracted from the frequency response obtained when the first audio output is generated ( Figure 5 A), extracting the frequency response in the mid-frequency range from the frequency response obtained when generating the second audio output ( Figure 5 B), extracting the frequency response in the high frequency range from the frequency response obtained when generating the third audio output ( Figure 5 C), then, the extracted frequency responses in each frequency range are combined.
[0102] In addition, regarding the frequency response of driver Dr2, the frequency response in the mid-frequency range is extracted from the frequency response obtained when the first audio output is generated, the frequency response in the high-frequency range is extracted from the frequency response obtained when the second audio output is generated, and the frequency response in the low-frequency range is extracted from the frequency response obtained when the third audio output is generated, and then the extracted frequency responses in each frequency range are combined.
[0103] In addition, regarding the frequency response of driver Dr3, the frequency response in the high-frequency range is extracted from the frequency response obtained when the first audio output is generated, the frequency response in the low-frequency range is extracted from the frequency response obtained when the second audio output is generated, and the frequency response in the mid-frequency range is extracted from the frequency response obtained when the third audio output is generated, and then the extracted frequency responses in each frequency range are combined.
[0104] In the present example, the frequency response compiling section 33 outputs the frequency response of each driver 2 to the NC signal generating section 11 in response to the above-described compilation of the frequency response of each driver 2 .
[0105] Thus, the NC signal generation unit 11 can adjust the NC signal generation processing of each driver 2 using, for example, the above-mentioned method.
[0106] In addition, in the above example, corresponding to the case where there are three drivers 2, the output frequency band of the sound signal at each audio output is divided into three frequency ranges, namely, a low frequency range, a medium frequency range, and a high frequency range. As described above, when the number of divisions of the output frequency band of the sound signal at each sound output is the same as the number of drivers 2 measured, the measurement time required to obtain the frequency response of each driver 2 can be minimized. For example, when there are three target drivers 2 and the number of divisions of the output frequency band is twice that of the target drivers 2, that is, six, six different combinations of output frequency bands are required. Therefore, this increases the required measurement time.
[0107] In the above description, the number of divisions of the output frequency band of the audio signal is not limited to the same number as the number of target drivers 2. The number of divisions of the output frequency band of the audio signal should be at least equal to or greater than the number of target drivers 2.
[0108] (1-3. Processing procedures)
[0109] Now refer to Figure 6 The flowchart of describes a specific example of a processing procedure for implementing the frequency response measurement method of the embodiment described above. When the processing for implementing the frequency response measurement method according to the embodiment is performed by software processing, Figure 6 The processing described in can be considered as the processing process.
[0110] First, in step S101, the frequency response measurement section 3 determines a combination of output frequency bands for each driver 2. For example, as previously described Figure 5 As shown in A, the predetermined combination is defined as a combination of output frequency bands for each driver 2.
[0111] In step S102 following step S101, the frequency response measurement unit 3 processes the sound signal output by each driver 2 by frequency filtering according to the determination. That is, in order to extract the components of each determined output frequency band, the sound signal of each driver 2 input from the decoder 4 is frequency filtered, and the sound signal of each driver 2 after the frequency filtering is output to the adder 5.
[0112] Thus, each driver 2 generates a sound output of a sound of the frequency band extracted according to the determination.
[0113] In step S103 following step S102, the frequency response measurement unit 3 performs frequency analysis on the collected sound signal. That is, the frequency of the collected sound signal collected by the sound collection unit 12 and input via the A / D conversion unit 14, that is, the frequency of the collected sound signal of the sound output generated by each driver 2 according to the output processing of step S102, is analyzed by Fourier transform through the A / D conversion unit 14. Thus, the frequency response of the audio output is obtained.
[0114] In step S104 following step S103, the frequency response measurement section 3 determines whether the number of analysis times is equal to or greater than M. More specifically, the frequency response measurement section 3 determines whether the number of execution times of the frequency analysis in step S103 is equal to or greater than a predetermined number of times M. The predetermined number of times M is the number of analyses required to compile the frequency response of each driver 2 using the frequency response measurement method involved in this embodiment. Figure 5 In the case of the example described in , the predetermined number M is 3.
[0115] When it is determined in step S104 that the number of analyses is not equal to or greater than M, the frequency response measurement unit 3 proceeds to step S105 to determine a different output frequency band combination for each driver 2 and returns to step S102 .
[0116] Thus, the audio output from the driver 2 and the collected sound signal are subjected to frequency analysis, and the combination of the output frequency bands of each driver 2 is set to a different combination.
[0117] Incidentally, for confirmation, the "different combinations" mentioned in step S105 are alternative combinations determined for each specific number of analysis times.
[0118] On the other hand, when it is determined in step S104 that the number of analyses is greater than or equal to M, the frequency response measurement unit 3 proceeds to step S106 to compile the frequency response of each driver 2. Specifically, for each driver 2, the frequency response of the frequency band output when each audio output is generated is extracted from the frequency response of each audio output when steps S101 to S105 are executed, and the extracted frequency responses are combined for each driver 2 to obtain the frequency response of each driver 2.
[0119] In step S107 following step S106 , the frequency response measurement unit 3 performs a process of outputting the frequency response of each driver 2 to the NC signal generation unit 11 .
[0120] When step S107 is completed, the frequency response measurement unit 3 ends. Figure 6 A series of processes described in .
[0121] <2. Second Embodiment>
[0122] A second embodiment will now be described.
[0123] The second embodiment is configured so that, when measurement is performed during output of content sound, the user is unlikely to notice a change in the output frequency band of each driver 2 .
[0124] Incidentally, in the following description, contents similar to those already described are designated by the same reference symbols or step numbers as the corresponding reference numerals or step numbers, and will not be redundantly described.
[0125] Figure 7 is a diagram showing an example of the configuration of headphones 1A according to the second embodiment.
[0126] The headphone 1A is different from the headphone 1 according to the first embodiment in that the headphone 1A includes a frequency response measuring section 3A instead of the frequency response measuring section 3 .
[0127] The frequency response measurement section 3A is different from the frequency response measurement section 3 in that it includes an output control section 31A instead of the output control section 31 .
[0128] It should be noted that in the case of measuring while outputting content sound, the content sound may have Figure 8 A of the embodiment of the present invention may be marked with, for example, an X in the A of the embodiment of the present invention, for example, a period of silence or a period of very soft sound, or may have a period of silence or a period of very soft sound in the A of the embodiment of the present invention. Figure 8 The extremely loud sound period (e.g., clipping sound period) marked as (e.g.) Y in B of FIG. For example, when the content sound is music, the period X may exist as a period between songs. In addition, the period Y may exist as a plosive sound (explosion sound), for example.
[0129] In the above-mentioned periods X, Y, even if the output frequency band of each driver 2 is changed, it is difficult for the user to perceive the change in sound caused by the change in the output frequency band. For example, in period X, no sound is reproduced, making it difficult for the user to perceive the change in frequency response in the reproduced sound, even if such a change occurs when the output frequency band is changed. In addition, in period Y, it is difficult for the user to perceive additional strange noise occurring due to clipping.
[0130] Therefore, in the second embodiment, a method is adopted in which the combination of the output frequency bands of each driver 2 is changed during the period corresponding to the period X, Y, that is, during the period when the signal level of the sound signal satisfies the predetermined signal level condition.
[0131] Fig. 9 : is a flowchart showing an example of a processing procedure that should be performed by the frequency response measurement section 3A to realize the frequency response measurement method according to the second embodiment.
[0132] The frequency response measurement unit 3A determines the combination of output frequency bands of the drivers 2 in step S101 and proceeds to step S201 .
[0133] In step S201, the frequency response measurement section 3A waits until a predetermined signal level condition is satisfied. That is, the frequency response measurement section 3A waits until the signal level of the sound signal input from the decoder 4 satisfies the predetermined signal level condition, or more specifically, waits until the signal level is equal to or lower than a predetermined signal level or equal to or higher than a predetermined signal level.
[0134] If it is determined in step S201 that the predetermined signal level condition is satisfied, the frequency response measurement section 3A proceeds to step S102. Step S102 and the above are similar to Figure 6 , except that in response to the process of determining a different combination performed in step S105, processing returns to step S201 rather than step S102.
[0135] Through the above-described processing performed by the frequency response measuring section 3A, the output frequency band of each driver 2 is changed during a period in which the signal level of the sound signal satisfies a predetermined signal level condition, such as a silent or soft sound period or a loud sound period.
[0136] As a result, it may be made difficult for a user to notice that the frequency response is being measured.
[0137] In addition, according to Fig. 9 In the process shown in , according to the determination in step S101, a predetermined signal level condition is applied as a condition for performing audio output of each driver 2, that is, as a condition for performing initial audio output for frequency response measurement.
[0138] As a result, when the normal output of the content sound (the normal output state in which the output frequency band of each driver 2 is not divided during measurement) is changed to the output of the measurement sound, it is difficult for the user to perceive the sound change caused by the change in the output state. That is, in this aspect as well, it may be difficult for the user to notice that the frequency response is being measured.
[0139] Although the above examples of “predetermined signal level conditions” indicate that the signal level should be equal to or lower than a predetermined signal level, or should be equal to or higher than a predetermined signal level, the above “predetermined signal level conditions” may be signal level conditions under which it is estimated that the user is not likely to perceive changes in the output frequency band combination.
[0140] It should be noted that the above example describes a case in which it is determined in real time whether the predetermined signal level condition is satisfied. However, alternatively, the content sound to be reproduced may be analyzed in advance to predetermine a time period in which the predetermined signal level condition is satisfied. At the time of measurement, it is appropriate to wait for the arrival of such a predetermined period, and then, in response to the arrival of the predetermined period, change the combination of the output frequency bands of each driver 2.
[0141] In addition, the above example describes the case where a silent or soft sound period or a loud sound period is to be detected. However, an alternative configuration may be used in which a silent or soft sound period and a loud sound period are to be detected so as to change the combination of the output frequency band in response to the arrival of any of these periods.
[0142] <3. Modifications>
[0143] It should be noted that the embodiments are not limited to the above-described specific examples. Various modifications may be made to the configurations of the above-described embodiments.
[0144] Here, for example, for the purpose of power saving, in the case where a plurality of drivers 2 are arranged in each of the left earphone 1 and the right earphone 1 (or 1A), a mode (hereinafter referred to as "single driver mode") that allows only one driver 2 in each of the left earphone and the right earphone to generate an audio output may be provided. It should be noted that the single driver mode may be regarded as a stereo reproduction mode in which each of the left earphone and the right earphone generates a monaural audio output.
[0145] Here, consider the case where the frequency response of each driver 2 is measured in the above-mentioned single driver mode.
[0146] In this case, if the sound output and measurement of each driver 2 are performed in time division as in the conventional method, the switching of the driver 2 is likely to be felt by the user. In addition, the abnormal noise generated by the D / A conversion accompanying the switching of the driver 2 may sometimes make the user feel uncomfortable.
[0147] Therefore, it is proposed Fig.10 The measurement method described in .
[0148] Basically, the frequency response of each driver 2 is measured by generating an audio output of the entire frequency band to be measured for each driver 2. However, when driver switching is performed from switching the source driver to switching the destination driver, the width of the output frequency band gradually changes.
[0149] Specifically, Fig.10 An example of output frequency band change when measuring frequency responses of three drivers 2 (ie, drivers Dr1, Dr2, and Dr3) is shown.
[0150] First, for driver Dr1, an audio output is generated, where the width of the output frequency band is the width of the entire frequency band to be measured ( Fig.10 Regarding the audio output, the frequency response of the driver Dr1 is measured based on the sound signal collected by the sound collecting unit 12.
[0151] Subsequently, when the measurement target is switched from the driver Dr1 to the next driver (ie, the driver Dr2), the width of the output frequency band of each of the drivers Dr1 and Dr2 gradually changes ( Fig.10 B to Fig.10 Specifically, the output frequency band of the driver Dr1 (i.e., the switching source driver) that has been measured gradually narrows, and the output frequency band of the driver Dr2 (i.e., the switching destination driver) that is the next measurement target gradually widens, and finally, as Fig.10 As shown in E, the width of the output frequency band is increased to the width of the entire frequency band to be measured. Then, while generating an audio output with the width of the output frequency band of the driver Dr2 as the width of the entire frequency band, the frequency response of the driver Dr2 is measured based on the collected sound signal collected by the sound collection unit 12.
[0152] Similarly, when the measurement target is switched from driver Dr2 to driver Dr3, the output frequency band of driver Dr2 as the switching source driver gradually narrows, and the output frequency band of driver Dr3 as the switching target driver gradually widens (see Fig.10 Then, while generating an audio output with the width of the output frequency band of the driver Dr3 as the width of the entire frequency band, the frequency response of the driver Dr3 is measured based on the collected sound signal collected by the sound collecting section 12.
[0153] When the above method is adopted in the mode in which the number of drivers 2 to be used is limited, the frequency response of each driver 2 can be measured without causing discomfort to the user and without causing the user to notice.
[0154] In addition, even when using Fig.10 In the case of the method shown, as in the second embodiment described above, while the signal level of the audio signal satisfies the predetermined signal level condition, the combination of the output frequency bands of each driver 2 can be changed. This makes it more difficult for the user to notice that the frequency response is being measured.
[0155] In addition, in the above description, the case where the frequency response of each driver 2 is measured during the process of outputting the content sound reproduction signal is described, but the frequency response measurement method of the present technology can also be performed during the process of outputting the measurement sound reproduction signal other than the content sound reproduction signal. For example, in the frequency response measurement mode, the measurement sound can be output from each driver 2 to measure the frequency response.
[0156] In the above example, the measurement signal for outputting the measurement sound may be any signal including the frequency components of the frequency band to be measured. It is conceivable that the measurement signal for outputting the measurement sound may be, for example, a sweep signal or a signal in which a plurality of sine waves with different frequencies are superimposed.
[0157] In addition, although not specifically mentioned in the above description, it is conceivable that the frequency response can be measured according to an instruction from the user. That is, the output control section 31 (or 31A) controls a plurality of audio outputs according to an instruction from the user, the frequency analysis section 32 can perform frequency analysis, and the frequency response compilation section 33 can compile the frequency response of each driver 2.
[0158] For example, in the case where the headset includes an operation unit 15 that allows the user to perform an operation input, Fig.11 As in the case of the headphone 1B described in , the frequency response measurement section 3 measures the frequency of each driver 2 by using the method according to the above-described embodiment, according to an instruction from the user specified by an operation input to the operation section 15 .
[0159] Alternatively, in e.g. Fig.12 In the case of the headset 1C as depicted in FIG. 1 and configured to be capable of wireless communication with an external device (ie, the host device 50 ), instructions from the user may be given through the user interface of the host device 50 .
[0160] exist Fig.12 In the figure, for example, the host device 50 is configured as a computer device such as a smartphone or a tablet computer, and includes a wireless communication section 51, a control section 52, an operation section 53, and a display section 54 as shown in the figure.
[0161] In addition, Fig.12 , the earphone 1C is different from the earphone 1 according to the first embodiment in that a wireless communication section 16 is added, and a frequency response measurement section 3C is provided instead of the frequency response measurement section 3 .
[0162] In the host device 50 , the control section 52 includes a microcomputer having, for example, a CPU (Central Processing Unit), a ROM (Read Only Memory), and a RAM (Random Access Memory), and carries out overall control of the host device 50 .
[0163] The control unit 52 is connected to the operation unit 53 , the display unit 54 , and the wireless communication unit 51 .
[0164] The operation section 53 is a comprehensive representation of physical operation elements (such as various buttons) and operation elements (such as a touch screen) used by a user to perform operation input on the host device 50. The operation section 53 outputs an operation signal based on the operation input to the control section 52. The control section 52 interprets the operation input according to the operation signal.
[0165] Furthermore, the display section 54 is configured as, for example, an LCD (Liquid Crystal Display) or an organic EL (Electro Luminescence) display, and displays an image in accordance with an instruction from the control section 52 .
[0166] The wireless communication unit 51 performs wireless data communication with the wireless communication unit 16 in the headset 1C. In addition, the wireless communication between these wireless communication units 51 and 16 may be performed in accordance with a short-range wireless communication standard such as BL (Bluetooth (registered trademark)). Alternatively, the wireless communication between the wireless communication units 51 and 16 may be performed via a network such as a LAN (Local Area Network).
[0167] In the above case, the content sound data CT transmitted from the host device 50 through the wireless communication section 51 is input to the decoder 4 in the headphone 1C through the wireless communication section 16. Therefore, each driver 2 in the headphone 1C generates an audio output based on the sound signal wirelessly output from the external device (i.e., the host device 50).
[0168] Subsequently, the frequency response measurement section 3C in the headphone 1C measures the frequency response of each driver 2 by using the method according to the above-described embodiment, according to the user operation performed on the operation section 53 of the host device 50 .
[0169] For example, in the case of measuring the frequency response while outputting the content sound, as assumed in the description of the first and second embodiments, a user instruction for measuring the frequency response during the output of the content sound (hereinafter referred to as a "content reproduction period execution instruction") is issued by an operation performed on the operation section 53 of the host device 50. Then, the control section 52 of the host device 50 outputs an execution instruction signal Sc indicating the content reproduction period execution instruction to the headphone 1C through the wireless communication section 51. The execution instruction signal Sc is input to the frequency response measurement section 3C through the wireless communication section 16. Then, based on the execution instruction signal Sc, the frequency response measurement section 3C measures the frequency response during the output of the content sound by using the method described in conjunction with the above embodiments.
[0170] In some cases, as described above, the frequency response may be measured by outputting a measurement sound in addition to the content sound. In this case, for example, an instruction for performing frequency response measurement in the measurement mode is issued by an operation performed on the operation section 53 of the host device 50, so that an instruction signal for performing such frequency response measurement in the measurement mode is input to the frequency response measurement section 3C of the headphone 1C as an execution instruction signal Sc. In response to the input of the execution instruction signal Sc, the frequency response measurement section 3C measures the frequency response of each driver 2 by outputting a measurement signal that changes the combination of the output frequency bands of each driver 2, as described in conjunction with the aforementioned embodiment.
[0171] Here, if we assume that the Fig.12 In the audio output system of the host device 50 described in the figure, based on the measured frequency response of each driver 2, the frequency response measurement section 3C can exercise control to notify the user of the fitting status of the earphone 1C through the host device 50.
[0172] Specifically, in a case where the result of the frequency response measurement by each driver 2 indicates the previously mentioned inappropriate adaptation state of the headphone 1C, the frequency response measurement unit 3C outputs a notification instruction signal Ss for instructing the control unit 52 to issue the above-mentioned notification, so that notification information indicating that inappropriate adaptation has occurred appears on the display unit 54 of the host device 50.
[0173] It should be noted that a smartphone or tablet has been shown as an example of the host device 50. However, it is conceivable that the host device 50 may alternatively be, for example, an HMD (head mounted display), a personal computer, or a television receiver. In addition, it is also conceivable that the host device 50 may be a device that does not have a display portion 54, such as a fixed game console. In this case, it is conceivable that an external display device attached to such a device displays a notification of improper assembly. Even in this case, the notification is still "issued to the user via the external display device."
[0174] Further, the notification of the adaptation status is not limited to visual information presentation. It is conceivable that such notification can be issued through auditory or tactile information presentation.
[0175] Here, the frequency sound pressure level characteristics indicating the sound pressure level characteristics of each frequency are listed as an example of the measured frequency response of each driver 2. However, for example, the frequency phase characteristics indicating the phase characteristics of each frequency may also be cited as an example of the frequency response.
[0176] With the present technology, the frequency response can be obtained by measuring the acoustic characteristics of each frequency.
[0177] Furthermore, the description given so far relates to an example of adjusting the NC signal generation process using the measurement results of the frequency response of each driver 2. However, alternatively, the results of the measurement may be used to adjust processes other than the NC signal generation process, such as equalization processing.
[0178] In addition, the above description describes an example in which the sound collecting unit 12 used for frequency response measurement is provided separately from the sound collecting unit 8 used for NC signal generation. However, when the FB method is used for NC signal generation, for example, the sound collecting unit 12 may be used as a sound collecting unit for NC signal generation.
[0179] Furthermore, the description given so far deals with an example in which three drivers 2 are provided on each of the left and right sides. However, the present technology can be appropriately applied to a case in which at least two drivers 2 are provided on each of the left and right sides.
[0180] Furthermore, in the description given so far, headphones have been cited as an example of an audio output device. However, the present technology is also applicable to other audio output devices such as various types of headphones including in-ear type and ear canal type headphones.
[0181] The present technology can be suitably applied to a wearable audio output device worn on the ear of a user.
[0182] <4. Overview of Implementation Methods>
[0183] As described above, according to an embodiment, there is provided a signal processing device (frequency response measuring section 3, 3A, 3C), which includes an output control section (output control section 31, 31A), a frequency analysis section (frequency analysis section 32), and a frequency response compiling section (frequency response compiling section 33). The output control section causes a plurality of audio output drivers (drivers 2) arranged in an audio output device to generate a plurality of audio outputs having different combinations of output frequency bands of sound signals to be respectively output from the audio output drivers. The frequency analysis section performs frequency analysis on the collected sound signals when generating each of the plurality of audio outputs, and obtains a frequency response of each of the plurality of audio outputs. The frequency response compiling section compiles the frequency response of each audio output driver from the frequency response of each audio output obtained by the frequency analysis section.
[0184] As described above, a plurality of audio outputs are generated using different combinations of output frequency bands of sound signals to be respectively output from a plurality of audio output drivers, and the frequency response of each audio output driver is compiled based on the frequency response of each audio output. By adopting this method, it is not necessary to sequentially switch the measurement object from one driver to another, thereby eliminating the possibility that a measurement object sound output driver becomes silent.
[0185] Therefore, in the case of measuring the frequency responses of a plurality of audio output drivers, the present embodiment makes it possible to shorten the measurement time while making it difficult for the user to notice that the frequency responses are being measured and reducing the user's discomfort caused by the measurement.
[0186] Furthermore, in the signal processing device according to the embodiment, the frequency response compiling section extracts the frequency response of the frequency band output when generating the respective audio outputs from the frequency response of each audio output, and combines the extracted frequency responses for each audio output driver.
[0187] As a result, the frequency response of each audio output driver can be appropriately obtained from the frequency response for each of a plurality of audio outputs generated using different combinations of output frequency bands of sound signals.
[0188] Furthermore, in the signal processing device according to the embodiment, the output control section outputs the reproduction signal of the content sound as the sound signal when the plurality of audio outputs are generated.
[0189] Therefore, when the user listens to content sound such as music, the frequency response can be measured.
[0190] As a result, it is not necessary to output a measurement signal other than the reproduction signal of the content sound at the time of frequency response measurement, making it difficult for the user to notice that measurement is being performed. In addition, it is not necessary to interrupt the user or prompt the user to perform a measurement operation while the user is listening to the content sound. This makes it possible to provide increased convenience.
[0191] Furthermore, in the signal processing device according to the embodiment, the output control section outputs the stereo content reproduction signal as the sound signal when generating the plurality of audio outputs.
[0192] As a result, when a user is listening to stereo content, the frequency response can be measured.
[0193] In the signal processing device (frequency response measurement unit 3A) of the present embodiment, the output control unit (output control unit 31A) changes the combination of output frequency bands for each audio output driver while the signal level of the audio signal satisfies a predetermined signal level condition.
[0194] As a result, the output frequency band combination of each audio output driver can be changed, for example, during silent periods between songs, periods of explosive sound clips, or other periods that meet predetermined signal level conditions, so that the user is difficult to perceive the change in the output frequency band combination.
[0195] As a result, it may be made difficult for a user to notice that the frequency response is being measured.
[0196] Furthermore, in the signal processing device according to the embodiment, the output control section performs the above-mentioned change during a period in which the signal level of the sound signal is equal to or lower than a predetermined signal level.
[0197] As a result, the output frequency band combination of each audio output driver may change during silence periods between songs or other periods, where the change in the output frequency band combination is not easily perceived by a user due to the low signal level of the measured output sound.
[0198] As a result, it may be made difficult for a user to notice that the frequency response is being measured.
[0199] Furthermore, in the signal processing device according to the embodiment, the output control section makes the change during a period in which the signal level of the sound signal is equal to or higher than a predetermined signal level.
[0200] As a result, the combination of output frequency bands of each audio output driver may change during periods of, for example, explosive sound clipping or other periods where the change in the combination of output frequency bands is not easily perceived by the user due to the high signal level of the output sound for measurement.
[0201] As a result, it may be made difficult for a user to notice that the frequency response is being measured.
[0202] Furthermore, the signal processing device according to the embodiment includes a signal processing adjustment section (NC signal generation unit 11) that adjusts the sound signal processing of each audio output driver according to the frequency response of each audio output driver obtained by the frequency response compilation unit.
[0203] As a result, the sound effects generated by the sound signal processing for each audio output driver may be adjusted based on the actual measured frequency response for each audio output driver.
[0204] Therefore, the sound effect for each audio output driver generated by the sound signal processing can be adaptively adjusted according to the actual usage environment of the user.
[0205] Furthermore, in the signal processing device according to the embodiment, the signal processing adjustment section adjusts the noise cancellation signal generation process of each audio output driver according to the frequency response of each audio output driver.
[0206] Therefore, the noise cancellation process for each audio output driver can be adaptively adjusted according to the user's actual usage environment.
[0207] Furthermore, in the signal processing device according to the embodiment, according to an instruction from a user, the output control section controls a plurality of audio outputs, the frequency analysis section performs frequency analysis, and the frequency response compilation section compiles the frequency response of each audio output driver.
[0208] Therefore, the frequency response of each audio output driver can be measured in a suitable execution mode according to the user's intention.
[0209] According to an embodiment, an audio output device (earphones 1, 1A, 1B, 1C) is provided, which includes a plurality of audio output drivers, a sound collection unit, an output control unit, a frequency analysis unit, and a frequency response compilation unit. The sound collection unit collects the sound output from the audio output driver. The output control unit enables the audio output driver to generate a plurality of audio outputs having different combinations of output frequency bands of the sound signal output from the audio output driver. The frequency analysis unit performs frequency analysis on the collected sound signal collected by the sound collection unit when generating each of the plurality of sound output units, and obtains the frequency response of each of the plurality of sound output units. The frequency response compilation unit compiles the frequency response of each audio output driver from the frequency response of each audio output obtained by the frequency analysis unit.
[0210] The above-described audio output device also provides operations and advantages similar to those provided by the above-described signal processing device according to the embodiment.
[0211] Furthermore, in the audio output device (headphone 1C) according to the embodiment, the audio output driver is configured to be able to communicate wirelessly with an external device, and is configured to generate an audio output according to a sound signal wirelessly output from the external device.
[0212] Therefore, for example, in the case where the employed device is configured to generate audio output from a sound signal wirelessly output from an external device such as a smartphone or tablet, the frequency response of each audio output driver can be appropriately measured.
[0213] In addition, in the audio output device (headphone 1C) according to the embodiment, according to the instructions given by the user through the user interface of the external device, the output control unit controls multiple audio outputs, the frequency analysis unit performs frequency analysis, and the frequency response compilation unit compiles the frequency response of each audio output driver.
[0214] Therefore, the frequency response of each audio output driver can be measured in a suitable execution mode according to the user's intention.
[0215] In addition, the audio output device (headphone 1C) according to the embodiment is configured as a wearable audio output device worn on the ears of the user, and is configured to control the notification indicating the adaptation state of the audio output device to the user through an external device based on the frequency response of each audio output driver obtained by the frequency response compilation unit.
[0216] Thus, in response to a situation where, for example, the results of a frequency response measurement indicate that the audio output device is estimated to be improperly fitted, a notification indicating such improper fitting may be issued to the user, for example, via a display or speaker of an external device.
[0217] Therefore, it is possible to provide an excellent audio output system capable of notifying a user of the fitting state of an audio output device based on the estimated fitting state.
[0218] In addition, according to an embodiment, a signal processing method performed by a signal processing device is provided. The signal processing method includes: performing an output control process so that a plurality of audio output drivers arranged in an audio output device generate a plurality of audio outputs having different combinations of output frequency bands of sound signals to be respectively output from the audio output drivers; performing a frequency analysis process when generating each of the plurality of audio outputs, the frequency analysis process frequency-analyzing the collected sound signals and obtaining a frequency response of each of the plurality of audio outputs, and performing a frequency response compilation process, the frequency response compilation process compiling a frequency response of each audio output driver from the frequency response of each audio output obtained by the frequency analysis process.
[0219] The above-described signal processing method also provides operations and advantages similar to those provided by the above-described signal processing apparatus according to the embodiment.
[0220] It should be noted that the advantages described in this document are merely illustrative and not limiting. The present technology may additionally provide advantages other than those described in this document.
[0221] <5. This technology>
[0222] The present technology can also adopt the following configurations. (1)
[0224] A signal processing device, comprising:
[0225] an output control section that causes a plurality of audio output drivers disposed in the audio output device to generate a plurality of audio outputs having different combinations of output frequency bands of sound signals to be respectively output from the audio output drivers;
[0226] a frequency analysis unit that performs frequency analysis on the collected sound signals generated by each of the plurality of sound output units to obtain a frequency response of each of the plurality of sound output units; and
[0227] A frequency response compiling section compiles a frequency response of each audio output driver from the frequency response of each audio output obtained by the frequency analyzing section. (2)
[0229] According to the signal processing device of (1) above,
[0230] The frequency response compiling section extracts the frequency response of a frequency band output when generating each audio output from the frequency response of each audio output, and combines the extracted frequency responses for each audio output driver. (3)
[0232] The signal processing device according to any one of (1) or (2) above,
[0233] The output control unit outputs a reproduction signal of the content sound as a sound signal when the plurality of audio outputs are generated. (4)
[0235] The signal processing device according to any one of (1) to (3) above,
[0236] Here, the output control unit outputs a reproduction signal of the stereo content as the sound signal when generating the plurality of audio outputs. (5)
[0238] The signal processing device according to any one of (3) or (4) above,
[0239] The output control section changes a combination of output frequency bands for each audio output driver during a period in which a signal level of the sound signal satisfies a predetermined signal level condition. (6)
[0241] According to the signal processing device of (5) above,
[0242] Here, the output control section performs the change during a period in which a signal level of the sound signal is equal to or lower than a predetermined signal level. (7)
[0244] According to the signal processing device of (5) or (6) above,
[0245] Here, the output control section changes a combination of output frequency bands for each audio output driver during a period in which a signal level of the sound signal is equal to or higher than a predetermined signal level. (8)
[0247] The signal processing device according to any one of (1) to (7) above, further comprising:
[0248] The signal processing adjustment unit adjusts the sound signal processing of each audio output driver according to the frequency response of each audio output driver obtained by the frequency response compilation unit. (9)
[0250] According to the signal processing device of (8) above,
[0251] The signal processing adjustment unit adjusts the noise cancellation signal generation process of each audio output driver according to the frequency response of each audio output driver. (10)
[0253] The signal processing device according to any one of (1) to (9) above,
[0254] The output control unit controls multiple audio outputs according to instructions from the user, the frequency analysis unit performs frequency analysis, and the frequency response compilation unit compiles the frequency response of each audio output driver. (11)
[0256] An audio output device, comprising:
[0257] Multiple audio output drivers;
[0258] A sound collection unit, collecting the sound output from the audio output driver;
[0259] an output control section that causes the audio output driver to generate a plurality of audio outputs having different combinations of output frequency bands of sound signals to be respectively output from the audio output driver;
[0260] a frequency analysis unit that performs frequency analysis on the collected sound signal collected by the sound collection unit when each of the plurality of sound outputs is generated, and obtains a frequency response of each of the plurality of sound outputs; and
[0261] A frequency response compiling section compiles a frequency response of each of the audio output drivers from the frequency response of each of the plurality of audio outputs obtained by the frequency analyzing section. (12)
[0263] According to the audio output device of (11),
[0264] The audio output driver is configured to be able to wirelessly communicate with an external device, and is configured to generate an audio output according to a sound signal wirelessly output from the external device. (13)
[0266] According to the audio output device of (12),
[0267] According to the instructions given by the user through the user interface of the external device, the output control unit controls multiple audio outputs, the frequency analysis unit performs frequency analysis, and the frequency response compilation unit compiles the frequency response of each audio output driver. (14)
[0269] The audio output device according to (12) or (13),
[0270] The audio output device is configured as a wearable audio output device worn on the ear of a user, and is configured to control the notification indicating the adaptation state of the audio output device to the user through an external device according to the frequency response of each of the audio output drivers obtained by the frequency response compiling unit. (15)
[0272] A signal processing method performed by a signal processing device, the method comprising:
[0273] performing output control processing to cause a plurality of audio output drivers arranged in the audio output device to generate a plurality of audio outputs having different combinations of output frequency bands of sound signals to be respectively output from the audio output drivers;
[0274] performing a frequency analysis process when each of the plurality of audio outputs is generated, the frequency analysis process frequency-analyzing the collected sound signal and obtaining a frequency response of each of the plurality of audio outputs; and
[0275] A frequency response compilation process of compiling each audio output driver from the frequency response of each audio output obtained through the frequency analysis process is performed.
[0276] [Reference Numbers List]
[0277] 100: Ears
[0278] 1. 1A, 1B, 1C: Headphones
[0279] 2: Driver (audio output driver)
[0280] 3.3A, 3C: Frequency response measurement section
[0281] 31, 31A: Output control unit
[0282] 32: Frequency Analysis Department
[0283] 33: Frequency Response Compilation Department
[0284] 4: Decoder
[0285] 5: Addition Department
[0286] 6: D / A conversion unit
[0287] 7: Enlargement
[0288] 8: Sound Collection Department
[0289] 9: Enlargement
[0290] 10: A / D conversion unit
[0291] 11: NC signal generation unit
[0292] 12: Sound Collection Department
[0293] 13: Enlargement
[0294] 14: A / D conversion unit
[0295] CT: Content sound data
[0296] 15: Operation Department
[0297] 16: Wireless Communication Department
[0298] 50: Host device
[0299] 51: Wireless Communications Department
[0300] 52: Control Department
[0301] 53: Operation Department
[0302] 54: Display unit
[0303] Sc: Execute command signal
[0304] Ss: Notification command signal
Claims
1. A signal processing device, comprising: an output control section that causes a plurality of audio output drivers disposed in the audio output device to generate a plurality of audio outputs having different combinations of output frequency bands of sound signals respectively output from the audio output drivers; a frequency analysis unit that performs frequency analysis on the collected sound signal when generating each of the plurality of audio outputs and obtains a frequency response of each of the plurality of audio outputs; as well as A frequency response compiling section compiles a frequency response of each of the audio output drivers from the frequency response of each of the audio outputs obtained by the frequency analyzing section.
2. The signal processing device according to claim 1, in, The frequency response compiling section extracts a frequency response of the frequency band output when the corresponding audio output is generated from the frequency response of each of the audio outputs, and combines the extracted frequency responses for each of the audio output drivers.
3. The signal processing device according to claim 1, in, The output control section outputs a reproduction signal of content sound as a sound signal when generating the plurality of audio outputs.
4. The signal processing device according to claim 1, in, The output control section outputs a reproduction signal of stereo content as a sound signal when generating the plurality of audio outputs.
5. The signal processing device according to claim 3, in, The output control section changes a combination of output frequency bands of each of the audio output drivers during a period in which a signal level of the sound signal satisfies a predetermined signal level condition.
6. The signal processing device according to claim 5, in, The output control section performs the changing during a period in which a signal level of the sound signal is equal to or lower than a predetermined signal level.
7. The signal processing device according to claim 5, in, The output control section changes a combination of output frequency bands of each of the audio output drivers during a period in which a signal level of the sound signal is equal to or higher than a predetermined signal level.
8. The signal processing device according to claim 1, further comprising: The signal processing adjustment unit adjusts the sound signal processing of each of the audio output drivers according to the frequency response of each of the audio output drivers obtained by the frequency response compilation unit.
9. The signal processing device according to claim 8, in, The signal processing adjustment section adjusts a noise cancellation signal generation process of each of the audio output drivers according to a frequency response of each of the audio output drivers.
10. The signal processing device according to claim 1, in, The output control section controls the plurality of audio outputs according to an instruction from a user, the frequency analysis section performs frequency analysis, and the frequency response compilation section compiles a frequency response of each of the audio output drivers.
11. An audio output device, comprising: Multiple audio output drivers; A sound collecting unit, which collects the sound output from the audio output driver; an output control section that causes the audio output driver to generate a plurality of audio outputs having different combinations of output frequency bands of sound signals respectively output from the audio output drivers; a frequency analysis unit that performs frequency analysis on the collected sound signal collected by the sound collection unit when each of the plurality of audio outputs is generated, and obtains a frequency response of each of the plurality of audio outputs; as well as A frequency response compiling section compiles a frequency response of each of the audio output drivers from the frequency response of each of the plurality of audio outputs obtained by the frequency analyzing section.
12. The audio output device according to claim 11, in, The audio output driver is configured to be capable of wireless communication with an external device, and is configured to generate an audio output according to the sound signal wirelessly output from the external device.
13. The audio output device according to claim 12, in, The output control section controls the plurality of audio outputs according to instructions given by a user through a user interface of the external device, the frequency analysis section performs frequency analysis, and the frequency response compilation section compiles a frequency response of each of the audio output drivers.
14. The audio output device according to claim 12, in, The audio output device is configured as a wearable audio output device worn on an ear of a user, and is configured to control, based on the frequency response of each of the audio output drivers obtained by the frequency response compiling section, to issue a notification indicating a fitting state of the audio output device to the user through the external device.
15. A signal processing method performed by a signal processing device, the method comprising: performing output control processing to cause a plurality of audio output drivers arranged in the audio output device to generate a plurality of audio outputs having different combinations of output frequency bands of sound signals respectively output from the audio output drivers; performing a frequency analysis process of performing frequency analysis on the collected sound signal when generating each of the plurality of audio outputs, and obtaining a frequency response of each of the plurality of audio outputs; as well as A frequency response compiling process of compiling a frequency response of each of the audio output drivers from the frequency response of each of the audio outputs obtained by the frequency analysis process is performed.
Citation Information
Patent Citations
Signal processor, signal processing method and computer program
JP2016015585A
