Sound processing device and program

Abstract

To provide a sound processing device for controlling an audio signal so as not to cause excessive reverberation.SOLUTION: A sound processing device 100 includes: a first level limitation unit 127 and a first linear conversion unit 128 that generate a first limiting signal obtained by limiting the gain of a change amount signal indicating the amount of change in an envelope of an audio signal to a signal of 0 dB or less, and generates a first fluctuation detection signal indicating the gain of the first limiting signal in terms of amplitude; a second level limitation unit 129 and a second linear conversion unit 130 that generate a second limiting signal obtained by limiting the gain of the change amount signal to 0 dB or more, and generates a second fluctuation detection signal indicating the gain of the second limiting signal in terms of amplitude; a second weighting unit 150 that generates a low-frequency reverberation complementary signal obtained by subtracting from, the audio signal, a signal obtained by multiplying the audio signal by a third limited signal obtained by limiting the amplitude of a multiplied signal obtained by multiplying the first fluctuation detection signal by the second fluctuation detection signal to 1 or more; and a synthesizing unit 190 that adds the low-frequency reverberation complementary signal to the audio signal.SELECTED DRAWING: Figure 2

Description

[Technical field]

[0001] The present invention relates to a sound processing device and a program. [Background technology]

[0002] Conventionally, there is known a device that expands the dynamic range of an audio signal read from a CD or DVD. For example, the sound processing device disclosed in Patent Document 1 includes an envelope detection means for detecting the envelope of an audio signal output from a sound source, a decibel conversion means for converting the envelope into decibels, a differentiation means for generating a change amount signal indicating the amount of change in the envelope, an inversion means for inverting the change amount signal, a linear conversion means for converting the inverted change amount signal into a linear signal to generate a detection signal, a complementary signal generation means for generating a complementary signal by subtracting a signal obtained by multiplying the audio signal by the detection signal from the audio signal, and an addition means for adding the complementary signal to the audio signal. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2013-55384 A Summary of the Invention [Problem to be solved by the invention]

[0004] However, the sound processing device disclosed in Patent Document 1 does not take into consideration the falling components. If the convergence of the time response of the speaker is poor, the reverberation of the speaker is added to the reverberation of the sound source, which may result in excessive reverberation.

[0005] The present invention has been made in consideration of the above circumstances, and has an object to provide a sound processing device and a program that can suitably control the reverberation of an audio signal. [Means for solving the problem]

[0006] In order to solve the above problems, the reverberation control device of the present invention includes a detection unit that detects an envelope signal of an input audio signal, a conversion unit that performs decibel conversion on the detected envelope signal, a differentiation processing unit that performs differential processing on the converted envelope signal to generate a change amount signal indicating an amount of change in the envelope signal, an inversion unit that inverts a signal level of the change amount signal, a first fluctuation detection signal generation unit that generates a first limiting signal by limiting the gain of the inverted change amount signal to a signal of 0 dB or less and generates a first fluctuation detection signal in which the gain of the generated first limiting signal is indicated by an amplitude, and the audio signal is generated by multiplying the first fluctuation detection signal by the second fluctuation detection signal and generating a third limited signal by limiting the amplitude of the generated multiplied signal to 1 or more; a first complementary signal generation unit that subtracts a signal obtained by multiplying the audio signal by the third limited signal from the audio signal to generate a first complementary signal; and an adder that adds the first complementary signal to the audio signal. Effect of the Invention

[0007] According to the present invention, it is possible to control an audio signal so as not to produce excessive reverberation. [Brief description of the drawings]

[0008] [Figure 1] 1 is a block diagram showing a schematic configuration of a sound processing device. [Diagram 2] 4 is a block diagram showing a schematic configuration of a first fluctuation detection section. FIG. [Diagram 3] 4 is a block diagram showing a schematic configuration of a second fluctuation detection section. FIG. [Figure 4] 4 is a block diagram showing a schematic configuration of a first weighting section. FIG. [Diagram 5] 4 is a block diagram showing a schematic configuration of a second weighting section. FIG. [Figure 6]FIG. 4 is a block diagram showing a schematic configuration of a third weighting section. [Figure 7] FIG. 2 is a diagram showing an example of a signal waveform of an input audio signal. [Figure 8] FIG. 4 is a diagram showing an example of a signal waveform of a low-frequency audio signal. [Figure 9] 2 shows an example of a signal waveform of a decibel envelope signal. [Figure 10] FIG. 4 is a diagram showing an example of a signal waveform of a change amount signal; [Figure 11] 13 is a diagram showing an example of a signal waveform of a change amount signal inverted by an inversion process. FIG. [Figure 12] FIG. 4 is a diagram illustrating an example of a signal waveform of a first limiting signal. [Figure 13] 13 is a diagram illustrating an example of a signal waveform of a second limiting signal. FIG. [Figure 14] 6 is a diagram showing an example of a signal waveform of a first fluctuation detection signal. FIG. [Figure 15] 13 is a diagram showing an example of a signal waveform of a second fluctuation detection signal. FIG. [Figure 16] 13 is a diagram showing an example of a signal waveform of a first fluctuation detection signal that has been smoothed. FIG. [Figure 17] 4 is a diagram showing an example of a signal waveform of a first fluctuation detection signal output by a first multiplier. FIG. [Figure 18] 13 is a diagram showing an example of a signal waveform of a low-frequency attack weighting signal; FIG. [Figure 19] 13 is a diagram showing an example of a signal waveform of a second fluctuation detection signal that has been smoothed. FIG. [Figure 20] 13 is a diagram showing a signal waveform of a second fluctuation detection signal after multiplication processing output from a multiplier to a level limiting section. FIG. [Figure 21] FIG. 13 is a diagram illustrating an example of a signal waveform of a third limiting signal. [Figure 22] 13 shows an example of a signal waveform after multiplication by a third multiplier. [Figure 23] 13 is a diagram showing an example of a signal waveform of a low-frequency reverberation weighting signal; FIG. [Figure 24]11 is a diagram showing a signal waveform of a signal obtained by adding a low-frequency reverberation complementary signal to a low-frequency audio signal. FIG. [Diagram 25] 13 is a diagram showing a signal waveform of a signal obtained when a low-frequency reverberation complementary signal generated based on a second fluctuation detection signal that has been subjected to repeat processing and smoothing processing is added to a low-frequency audio signal. FIG. [Figure 26] 13 is a diagram showing a signal waveform of a signal obtained by adding a low-frequency reverberation complementary signal and a low-frequency attack complementary signal to a low-frequency audio signal. FIG. [Figure 27] 4 is a flowchart showing the operation of the sound processing device. [Figure 28] 13 is a flowchart showing a detailed flow of step S3. [Figure 29] 13 is a flowchart showing the detailed flow of step S4. [Diagram 30] 13 is a flowchart showing details of step S7. [Diagram 31] FIG. 11 is a diagram illustrating a system configuration of a second embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0009] [Overall configuration of the sound processing device 100] FIG. 1 is a block diagram showing the configuration of a sound processing device 100. As shown in FIG. The sound processing device 100 has a function of expanding the gain of an audio signal that has been smoothed by compressing the dynamic range, and a function of suppressing excessive reverberation in the low frequency range of the audio signal.

[0010] The sound processing device 100 includes an LPF (Low-pass filter) 110, a first variation detection unit 120, a first weighting unit 140, a second weighting unit 150, an HPF (High-pass filter) 160, a second variation detection unit 170, a third weighting unit 180, and a synthesis unit 190. The synthesis unit 190 corresponds to an addition unit.

[0011] An audio signal with a compressed dynamic range is input to the sound processing device 100. This audio signal is, for example, an audio signal with a compressed dynamic range accompanying recording onto a CD (Compact Disc) or the like. The audio signal input to the sound processing device 100 is input to an LPF 110, an HPF 160, and a synthesis unit 190 as shown in FIG.

[0012] The LPF 110 performs a filtering process on the input audio signal to extract low-frequency components of the audio signal. The low-frequency components of the audio signal extracted by the LPF 110 are hereinafter referred to as a low-frequency audio signal. The HPF 160 performs filtering on the input audio signal to extract high-frequency components of the audio signal. The high-frequency components of the audio signal extracted by the HPF 160 are hereinafter referred to as high-frequency audio signals.

[0013] 7 shows an example of a signal waveform of an audio signal input to the sound processing device 100. This audio signal is a reproduced audio signal recorded on a CD, and displays the first one second of a song. FIG. 8 shows an example of a signal waveform of a low-frequency audio signal filtered by the LPF 110. As shown in FIG.

[0014] The first fluctuation detection unit 120 detects the envelope of the low-frequency audio signal input from the LPF 110. The first fluctuation detection unit 120 detects the amount of change in the detected envelope, outputs a first fluctuation detection signal indicating the amount of change in the detected envelope to the first weighting unit 140, and outputs a second fluctuation detection signal indicating the amount of change in the envelope to the second weighting unit 150. The first fluctuation detection signal and the second fluctuation detection signal will be described in detail later.

[0015] The second variation detection unit 170 detects the envelope of the high-frequency audio signal input from the HPF 160. The second variation detection unit 170 detects the amount of change in the detected envelope, and outputs a third variation detection signal indicating the amount of change in the detected amplitude to the third weighting unit 180.

[0016] The first weighting unit 140 generates a low-frequency attack complementary signal based on the first fluctuation detection signal. The low-frequency attack complementary signal is a signal that amplifies the amplitude of the low-frequency audio signal smoothed by dynamic range compression. The low-frequency attack complementary signal corresponds to the second complementary signal. The first weighting unit 140 outputs the generated low-frequency attack complementary signal to the synthesis unit 190.

[0017] The second weighting unit 150 generates a low-frequency reverberation complementary signal based on the second variation detection signal. The low-frequency reverberation complementary signal is a signal that attenuates the reverberation of the low-frequency audio signal. The low-frequency reverberation complementary signal corresponds to the first complementary signal. The second weighting unit 150 outputs the generated low-frequency reverberation complementary signal to the synthesis unit 190.

[0018] The third weighting unit 180 generates a high-frequency attack complementary signal based on the third variation detection signal. The high-frequency attack complementary signal is a signal that amplifies the amplitude of the high-frequency audio signal smoothed by dynamic range compression. The third weighting unit 180 outputs the generated high-frequency attack complementary signal to the synthesis unit 190.

[0019] The synthesis unit 190 adds a low-frequency attack complementary signal, a low-frequency reverberation complementary signal, and a high-frequency attack complementary signal to the input audio signal. This emphasizes the rise of the audio signal, improving the sense of sharpness, realism, and sound quality. It also speeds up the convergence of the reverberation of the fall of the low-frequency audio signal, and suppresses excessive reverberation caused by the sound source, speakers, etc.

[0020] [Configuration of the first fluctuation detection unit 120 and the second fluctuation detection unit 170] FIG. 2 is a block diagram showing a schematic configuration of the first fluctuation detection section 120. As shown in FIG. The configuration of the first fluctuation detection section 120 will be described. The first fluctuation detection unit 120 includes a first maximum value detection unit 121, a first maximum value hold unit 122, a first smoothing processing unit 123, a first decibel conversion unit 124, a first differential processing unit 125, a first inversion processing unit 126, a first level limiting unit 127, a first linear conversion unit 128, a second level limiting unit 129, and a second linear conversion unit 130. First maximum value detection section 121, first maximum value hold section 122 and first smoothing processing section 123 correspond to a detection section. The first decibel conversion unit 124 corresponds to a conversion unit. The first differential processing unit 125 corresponds to the differential processing unit. The first inversion processing unit 126 corresponds to an inversion unit. The first level limiting section 127 and the first linear conversion section 128 correspond to a first fluctuation detection signal generating section. The second level limiting section 129 and the second linear conversion section 130 correspond to a second fluctuation detection signal generating section.

[0021] The low-frequency audio signal filtered by the LPF 110 is input to the first maximum value detection unit 121 . The first maximum value detection unit 121 converts the amplitude of the input low-frequency audio signal into an absolute value, and detects the maximum value of the absolute value of the amplitude of the low-frequency audio signal within a predetermined time. The first maximum value detection unit 121 outputs the maximum value for every m samples, which is the number of samples within the predetermined time, to the first maximum value hold unit 122. m is any natural number.

[0022] The first maximum value hold section 122 receives as input a signal indicating the maximum value from the first maximum value detection section 121 . The first maximum value hold unit 122 obtains the maximum value that indicates the largest value among the past n maximum values ​​including the maximum value indicated by the input signal. n is any natural number. In other words, the first maximum value hold unit 122 obtains the highest maximum value among n×m samples. The first maximum value hold unit 122 outputs a signal indicating the obtained maximum value to the first smoothing processing unit 123 at predetermined time intervals. It should be noted that first maximum value detector 121 and first maximum value hold unit 122 have a preset detection range for detecting maximum values, and do not detect signal levels below the set detection range.

[0023] The first smoothing processor 123 performs an integration process on the signal indicating the maximum value input from the first maximum value hold unit 122, and performs a smoothing process to smooth fluctuations in the maximum value. By performing the smoothing process on the signal indicating the maximum value, an envelope signal indicating the envelope of the low-frequency audio signal is detected.

[0024] The first decibel converter 124 converts the envelope signal of the low-frequency audio signal obtained by the smoothing process into an envelope signal in decibels. The envelope signal input to the first decibel converter 124 has linear signal characteristics in which the gain is indicated by the amplitude. The decibel envelope signal converted by the first decibel converter 124 has signal characteristics in which the gain is indicated in decibel units. The first decibel converter 124 outputs the converted decibel envelope signal to the first differential processor 125. FIG. 9 shows an example of a signal waveform of the decibel envelope signal output from the first decibel conversion section 124 to the first differential processing section 125. In FIG.

[0025] The first differential processing unit 125 performs differential processing on the input decibel envelope signal to generate a change amount signal indicating the amount of change in the envelope signal. The change amount signal changes according to the change in the envelope signal. For example, when the amount of change in the envelope signal is large, the change amount signal indicates a large value, and when the amount of change in the envelope signal is small, the change amount signal indicates a small value. The first differential processing unit 125 outputs the generated change amount signal to the first inversion processing unit 126. FIG. 10 shows an example of a signal waveform of the change amount signal.

[0026] The differentiation process in the first differentiation processor 125 is realized by performing a filtering process using a high-pass filter on the audio signal from which low-frequency components have been extracted by the LPF 110. In addition, by changing the set value of the normalized cutoff frequency in this high-pass filter, it is possible to adjust the change time of the amount of change obtained by the filtering process.

[0027] For example, the state in which the dynamic range is compressed and the amplitude is smoothed differs depending on the settings of the compressor or limiter, and the dynamic range compression state differs between CDs and DVDs. Therefore, by adjusting the normalized cutoff frequency according to the dynamic range compression state of the audio signal, it is possible to adjust the dynamic range expansion time to suit the dynamic range compression state.

[0028] The first inversion processing unit 126 performs an inversion process to invert the signal level of the input change amount signal. The first inversion processing unit 126 inverts the signal level, i.e., the positive and negative sides of the signal, by multiplying the change amount signal by -1. The first inversion processing unit 126 outputs the inverted change amount signal to the first level limiting unit 127 and the second level limiting unit 129. An example of a signal waveform of the change amount signal whose signal level has been inverted by inversion processing is shown in Fig. 11. The change amount signal shown in Fig. 11 and the change amount signal shown in Fig. 10 have the positive and negative signals inverted.

[0029] The first level limiting unit 127 limits the signal level of the input change amount signal to a first range of -6 dB or more and 0 dB or less to generate a first limiting signal. When the signal level of the input change amount signal is smaller than -6 dB, the first level limiting unit 127 converts the signal level of the change amount signal to -6 dB to generate a first limiting signal. When the signal level of the input change amount signal is larger than 0 dB, the first level limiting unit 127 converts the signal level of the change amount signal to 0 dB to generate a first limiting signal. The first level limiting section 127 outputs the generated first limiting signal to the first linear conversion section 128. Fig. 12 shows an example of a signal waveform of the first limiting signal.

[0030] The second level limiting section 129 limits the signal level of the input change amount signal to a second range of 0 dB or more and 6 dB or less to generate a second limiting signal. If the signal level of the input change amount signal is greater than 6 dB, the second level limiting unit 129 converts the signal level of the change amount signal to 6 dB to generate a second limiting signal. If the signal level of the input change amount signal is less than 0 dB, the second level limiting unit 129 converts the signal level of the change amount signal to 0 dB to generate a second limiting signal. The second level limiting section 129 outputs the generated second limiting signal to the second linear conversion section 130. FIG. 13 shows an example of a signal waveform of the second limiting signal.

[0031] The first linear conversion unit 128 converts the input first limiting signal into a signal having linear signal characteristics that indicate the gain of the first limiting signal by amplitude. The first linear conversion unit 128 outputs the converted signal to the first weighting unit 140 as a first fluctuation detection signal. FIG. 14 shows an example of a signal waveform of the first fluctuation detection signal.

[0032] The second linear conversion unit 130 converts the input second limiting signal into a signal having linear signal characteristics that indicate the gain of the second limiting signal by amplitude. The second linear conversion unit 130 outputs the converted signal to the second weighting unit 150 as a second fluctuation detection signal. FIG. 15 shows an example of a signal waveform of the second fluctuation detection signal.

[0033] FIG. 3 is a block diagram showing a schematic configuration of the second variation detection section 170. As shown in FIG. The second fluctuation detection unit 170 includes a second maximum value detection unit 171, a second maximum value hold unit 172, a second smoothing processing unit 173, a second decibel conversion unit 174, a second differential processing unit 175, a second inversion processing unit 176, a third level limiting unit 177 and a third linear conversion unit 178.

[0034] The operations of the second maximum value detection unit 171, the second maximum value hold unit 172, the second smoothing processing unit 173, the second decibel conversion unit 174, the second differential processing unit 175 and the second inversion processing unit 176 are the same as those of the first fluctuation detection unit 120, so detailed explanations will be omitted.

[0035] The third level limiting unit 177 limits the signal level of the change amount signal input from the second inversion processing unit 176 to a fourth range of −30 dB or more and 0 dB or less to generate a fourth limiting signal. When the signal level of the input change amount signal is less than -30 dB, the third level limiting unit 177 converts the signal level of the change amount signal to -30 dB to generate a fourth limiting signal. When the signal level of the input change amount signal is greater than 0 dB, the third level limiting unit 177 converts the signal level of the change amount signal to 0 dB to generate a fourth limiting signal. The third level limiting section 177 outputs the generated fourth limiting signal to the third linear conversion section 178.

[0036] The third linear conversion unit 178 converts the input fourth limiting signal into a signal having linear signal characteristics that indicate the gain of the fourth limiting signal by amplitude. The third linear conversion unit 178 outputs the converted signal to the third weighting unit 180 as a third fluctuation detection signal.

[0037] [First weighting unit 140, second weighting unit 150, and third weighting unit 180] 4 is a block diagram showing a schematic configuration of the first weighting section 140. The first weighting section 140 includes a first repeat processing section 141, a third smoothing processing section 142, a first multiplier 143, a first subtractor 144, and a first gain adjustment section 145. The first multiplier 143 and the first subtractor 144 correspond to a second complementary signal generating unit. The first gain adjustment section 145 corresponds to the gain adjustment section.

[0038] The first repeat processing unit 141 receives the first fluctuation detection signal from the first fluctuation detection unit 120. The first repeat processing unit 141 executes a repeat process for matching the frame length of the input first fluctuation detection signal with the frame length of the low-frequency audio signal output from the LPF 110. For example, assume that the frame length of the low-frequency audio signal output from the LPF 110 is 256 samples, and the frame length of the first fluctuation detection signal is 32 samples. In this case, the first repeat processing unit 141 repeatedly outputs the same first fluctuation detection signal to the third smoothing processing unit 142, with 8 samples being 256 / 32.

[0039] The third smoothing unit 142 performs a smoothing process to smooth the signal waveform of the input first fluctuation detection signal by low-pass filtering. The third smoothing unit 142 outputs the first fluctuation detection signal after the smoothing process to the first multiplier 143 and the second weighting unit 150. FIG. 16 shows an example of a signal waveform of the first fluctuation detection signal after the smoothing process.

[0040] The first multiplier 143 receives the low-frequency audio signal output by the LPF 110 and the first fluctuation detection signal that has been smoothed. The first multiplier 143 performs a multiplication process to multiply the input low-frequency audio signal by the smoothed first fluctuation detection signal. The first multiplier 143 outputs the multiplied first fluctuation detection signal to the first subtractor 144. By the multiplication process of the first multiplier 143, a portion of the low-frequency audio signal where the signal level changes from a low level to a high level is amplified in accordance with the detection amount of the first fluctuation detection signal. FIG. 17 shows an example of a signal waveform of the first fluctuation detection signal output by the first multiplier 143. In FIG.

[0041] The first subtractor 144 receives the low-frequency audio signal output by the LPF 110 and the first fluctuation detection signal output by the first multiplier 143 after multiplication processing. The first subtractor 144 subtracts the multiplied first fluctuation detection signal from the input low-frequency audio signal. By performing subtraction processing in the first subtractor 144, the signal level difference between the low-frequency audio signal before amplification and the audio signal after amplification is calculated as a weighting amount at a portion of the low-frequency audio signal where the signal level changes from a low level to a high level. The first subtractor 144 outputs a signal indicating the calculated weighting amount to the first gain adjustment section 145 as a low-frequency attack weighting signal. FIG. 18 shows an example of a signal waveform of a low-frequency attack weighted signal.

[0042] The first gain adjustment unit 145 amplifies and attenuates the amplitude of the input low-frequency attack weighted signal to adjust the weighting amount, and generates a low-frequency attack complement signal. The first gain adjustment unit 145 outputs the generated first low-frequency complement signal to the synthesis unit 190.

[0043] Since the low-frequency attack weighting signal is generated based on the change in the maximum value in the envelope signal, it is possible to expand the gain in the portion where the dynamic range has been compressed and smoothed. However, the gain of the dynamic range to be expanded differs for each audio signal whose dynamic range has been compressed and smoothed, and adding the low-frequency attack weighting signal to the audio signal as is may result in insufficient expansion of the dynamic range or may result in the dynamic range being expanded too much, which may actually result in a deterioration in sound quality.

[0044] Therefore, by amplifying and attenuating the gain of the low-frequency attack weighted signal in advance in the first gain adjustment unit 145 depending on the compression state of the audio signal, etc., to generate a first low-frequency complementary signal with an adjusted weighting amount, it is possible to appropriately expand and adjust the dynamic range of the signal obtained by adding the first low-frequency complementary signal to the audio signal in the synthesis unit 190.

[0045] The first limiting signal is a signal in which the gain of the change amount signal is limited to 0 dB or less. A first fluctuation detection signal indicating the gain of this first limiting signal by amplitude is generated in the first linear conversion unit 128. Therefore, the first fluctuation detection signal is a signal with an amplitude of 1 or less. The second limiting signal is a signal in which the gain of the change amount signal is limited to 0 dB or more. A second fluctuation detection signal indicating the gain of this second limiting signal by amplitude is generated in the second linear conversion unit 130. Therefore, the second fluctuation detection signal is a signal with an amplitude of 1 or more. If the low frequency attack complementary signal output from the first subtractor 144 is "Y2", the audio signal input to the first multiplier 143 and the first subtractor 144 is "S1", and the first fluctuation detection signal input to the first multiplier 143 is "W2", then the low frequency attack complementary signal Y2 is calculated by the following formula. Y2=S1-(W2×S1)=(1-W2)×S1 Since the first fluctuation detection signal W2 is a signal whose amplitude is 1 or less, 1-W2 is 0 or a positive value, and the low frequency attack complementary signal Y2 is a signal in phase with the audio signal S1. Therefore, by adding the in-phase low frequency attack complementary signal Y2 to the audio signal S1, the amplitude of the audio signal S1 can be amplified by the low frequency attack complementary signal Y2.

[0046] [Second weighting unit 150] 5 is a block diagram showing a schematic configuration of the second weighting section 150. The second weighting section 150 includes a second repeat processing section 151, a fourth smoothing processing section 152, a second multiplier 153, a fourth level limiting section 154, a third multiplier 155, a second subtractor 156, and a second gain adjustment section 157. The second multiplier 153 and the fourth level limiting section 154 correspond to a limiting signal generating section. The third multiplier 155 and the second subtractor 156 correspond to a first complementary signal generating unit. The second gain adjustment section 157 corresponds to the gain adjustment section.

[0047] The second repeat processing unit 151 receives the second fluctuation detection signal from the first fluctuation detection unit 120. The second repeat processing unit 151 executes a repeat process for matching the frame length of the input second fluctuation detection signal with the frame length of the low-frequency audio signal output from the LPF 110. The operation of the second repeat processing unit 151 is the same as that of the first repeat processing unit 141, and therefore a detailed description thereof will be omitted.

[0048] The fourth smoothing processor 152 performs a smoothing process by low-pass filtering to smooth the signal waveform of the second fluctuation detection signal input from the second repeat processor 151. The fourth smoothing processor 152 outputs the smoothed second fluctuation detection signal to the second multiplier 153. FIG. 19 shows an example of a signal waveform of the smoothed second fluctuation detection signal.

[0049] The second multiplier 153 receives the first fluctuation detection signal output by the third smoothing processor 142 of the first weighting section 140 and the second fluctuation detection signal output by the fourth smoothing processor 152 . The second multiplier 153 multiplies the input first fluctuation detection signal and the second fluctuation detection signal together to generate a multiplied signal. The second multiplier 153 outputs the generated multiplied signal to the fourth level limiting section 154. Fig. 20 shows an example of a signal waveform of the multiplied signal output by the second multiplier 153.

[0050] The fourth level limiting unit 154 generates a third limited signal by limiting the amplitude of the input multiplied signal to a third range of 1 or more. The fourth level limiting unit 154 converts the amplitude of the second fluctuation detection signal, which has an amplitude of 1 or less, to 1 to generate a third limiting signal. The fourth level limiting unit 154 outputs the third limiting signal, whose amplitude is limited to 1 or more, to the third multiplier 155.

[0051] FIG. 21 shows an example of a signal waveform of the third limiting signal. In the rising edge section (0.2 seconds to 0.4 seconds) of the audio signal shown in range a of the smoothed second fluctuation detection signal shown in Fig. 19, the amplitude gradually converges to 1, but in the rising edge section (0.2 seconds to 0.4 seconds) of the audio signal shown in range b of the third limiting signal shown in Fig. 21, the amplitude is sharply limited to 1. This is achieved by multiplying the second fluctuation detection signal by the first fluctuation detection signal. By sharply limiting the amplitude to 1 at the rising edge of the audio signal, it is possible to suppress reduction in the sense of attack at the rising edge of the audio signal due to the low-frequency reverberation complement signal.

[0052] The third multiplier 155 receives the low-frequency audio signal output by the LPF 110 and the third limited signal. The third multiplier 155 performs a multiplication process of multiplying the low-frequency audio signal by the third limiting signal. The third multiplier 155 outputs the multiplied signal to the second subtractor 156. Fig. 22 shows an example of a signal waveform of the signal multiplied by the third multiplier 155.

[0053] The second subtractor 156 receives the low-frequency audio signal output by the LPF 110 and the output signal of the third multiplier 155 . The second subtractor 156 performs subtraction processing to subtract the output signal of the third multiplier 155 from the low-frequency audio signal. By performing subtraction processing in the second subtractor 156, a signal level difference between the low-frequency audio signal before amplification and the audio signal after amplification is calculated as a weighting amount at a portion of the low-frequency audio signal where the signal level changes from a high level to a low level. The second subtractor 156 outputs a signal indicating the calculated weighting amount to the second gain adjustment section 157 as a low-frequency reverberation weighting signal. FIG. 23 shows an example of a signal waveform of the low-frequency reverberation weighting signal.

[0054] The second gain adjustment unit 157 amplifies and attenuates the amplitude of the input low-frequency reverberation weighting signal to adjust the weighting amount, and generates a low-frequency reverberation complementary signal. The second gain adjustment unit 157 outputs the generated low-frequency reverberation complementary signal to the synthesis unit 190.

[0055] The first limiting signal is a signal in which the gain of the change amount signal is limited to 0 dB or less. A first fluctuation detection signal indicating the gain of this first limiting signal by amplitude is generated by the first linear conversion unit 128. Therefore, the first fluctuation detection signal is a signal with an amplitude of 1 or less. The second limiting signal is a signal in which the gain of the change amount signal is limited to 0 dB or more. A second fluctuation detection signal indicating the gain of this second limiting signal by amplitude is generated by the second linear conversion unit 130. Therefore, the second fluctuation detection signal is a signal with an amplitude of 1 or more. Furthermore, a third limited signal, which is obtained by limiting the amplitude of a multiplied signal obtained by multiplying the first fluctuation detection signal by the second fluctuation detection signal to 1 or more, becomes a signal with an amplitude of 1 or more. If the low-frequency reverberation complementary signal output from the second subtractor 156 is "Y1," the audio signal input to the third multiplier 155 and the second subtractor 156 is "S1," and the third limited signal input to the third multiplier 155 is "W1," the low-frequency reverberation complementary signal Y1 is calculated by the following formula. Y1 = S1 - (W1 x S1) = (1 - W1) x S1 Since the third limiting signal W1 is a signal with an amplitude of 1 or more, 1-W1 is 0 or a negative value, and the low-frequency reverberation complementary signal Y1 is a signal with an opposite phase to the audio signal S1. Therefore, by adding the opposite-phase low-frequency reverberation complementary signal Y1 to the audio signal S1, the amplitude of the audio signal S1 can be attenuated by the low-frequency reverberation complementary signal Y1.

[0056] 6 is a block diagram showing a schematic configuration of the third weighting section 180. The third weighting section 180 includes a third repeat processing section 181, a fifth smoothing processing section 182, a fourth multiplier 183, a third subtractor 184, and a third gain adjustment section 185.

[0057] The third weighting unit 180 has the same functional units as the first weighting unit 140. In the third weighting unit 180, a third subtractor 184 subtracts, from the high frequency audio signal input from the HPF 160, the high frequency audio signal that has been subjected to an amplification process corresponding to the detection amount indicated by the third variation detection signal, to obtain a weighting amount for the high frequency audio signal. Moreover, the third weighting unit 180 adjusts the determined weighting amount in a third gain adjustment unit 185 to generate a high frequency complement signal. The configuration and roles of the functional units in the third weighting unit 180 are the same as those of the first weighting unit 140 shown in FIG. 4, and therefore will not be described.

[0058] [Synthesis section] The synthesis unit 190 adds the low-frequency attack complementary signal calculated by the first weighting unit 140, the low-frequency reverberation complementary signal calculated by the second weighting unit 150, and the high-frequency complementary signal calculated by the third weighting unit 180 to the audio signal input to the sound processing device 100. By performing addition processing, audio signals of low and high frequency components that have been gain-complemented according to the amount of change in the signal envelope are added to the audio signal of the sound source, which has been smoothed by compressing the dynamic range. This expands the dynamic range and improves the sense of clarity, realism, and sound quality when heard. Furthermore, by adding the low-frequency reverberation complement signal to the audio signal, the reverberation of the low-frequency audio signal can be attenuated.

[0059] In addition, the sound processing device 100 according to the present embodiment does not perform dynamic range expansion processing on mid-frequency components. This is because mid-frequency components generally have high hearing sensitivity and contain many voice components such as vocals, and therefore expanding the dynamic range of the mid-frequency components may cause a listener to feel a sense of fluctuation in hearing. However, the sound processing device 100 according to the present embodiment only shows an example in which the dynamic range expansion processing is performed on only low-frequency components and high-frequency components, and it is also possible to configure the sound processing device 100 according to the present embodiment to perform dynamic range expansion processing on mid-frequency components as well. Furthermore, it is also possible to perform dynamic range expansion processing by various combinations, such as only low-frequency components, only mid-frequency components, only high-frequency components, only low-frequency components and mid-frequency components, and only high-frequency components and mid-frequency components.

[0060] Fig. 24 shows a signal waveform of a signal obtained by adding a low-frequency reverberation complementary signal to a low-frequency audio signal. The low-frequency attack complementary signal and the high-frequency complementary signal are not added to the signal shown in Fig. 24. The dotted envelope in Fig. 24 shows the signal when the low-frequency reverberation complementary signal is not added to the low-frequency audio signal, that is, the envelope of the low-frequency audio signal. 24, the amplitude of the signal waveform is smaller than the envelope after 0.5 seconds, which indicates that the signal is attenuating.

[0061] Fig. 25 shows a signal waveform of a signal when the second weighting section 150 does not include the second multiplier 153 and the fourth level limiting section 154, and the second fluctuation detection signal that has been subjected to the repeat process and the smoothing process is directly input to the third multiplier 155, and the generated low-frequency reverberation complementary signal is added to the low-frequency audio signal. In other words, the signal waveform of the low-frequency audio signal is shown when the first fluctuation detection signal is not multiplied by the second fluctuation detection signal. In this case, too, the low-frequency attack complementary signal and the high-frequency complementary signal are not added to the low-frequency audio signal. The envelope shown by the dashed line in Fig. 25 indicates the envelope of the low-frequency audio signal. The signal waveform of the signal shown in Figure 25 has an amplitude smaller than the envelope after 0.5 seconds, but the amplitude attenuates at the rising edge of the signal, for example, in the range c surrounded by a solid line in Figure 25, and the sense of attack of the rising edge of the signal is reduced.

[0062] 26 shows a signal waveform of a signal obtained by adding a low-frequency reverberation complementary signal and a low-frequency attack complementary signal to a low-frequency audio signal. The envelope shown by the dashed line in FIG. 26 indicates the envelope of the low-frequency audio signal. As shown in FIG. 26, by adding a low-frequency reverberation complementary signal and a low-frequency attack complementary signal to a low-frequency audio signal, the auditory sense of sharpness, realism, and sound quality can be improved, and by speeding up the convergence time of the fall of the low-frequency audio signal, excessive reverberation caused by the sound source, speakers, etc. can be suppressed.

[0063] 27 to 30 are flowcharts showing the operation of the sound processing device 100. The operation of the sound processing device 100 will be described with reference to the flowcharts shown in FIGS. First, when an audio signal is input to the sound processing device 100 (step S1), the sound processing device 100 processes the input audio signal with the LPF 110 and the HPF 160. The LPF 110 filters the input audio signal to generate a low-frequency audio signal (step S2), while the HPF 160 filters the input audio signal to generate a high-frequency audio signal (step S3). The LPF 110 outputs the generated low-frequency audio signal to the first weighting section 140, the first fluctuation detection section 120, and the second weighting section 150. The HPF 160 outputs the generated high-frequency audio signal to the second fluctuation detection section 170 and the third weighting section 180.

[0064] The first fluctuation detection unit 120 generates a first fluctuation detection signal and a second fluctuation detection signal based on the input low-frequency audio signal (step S4). The first fluctuation detection unit 120 outputs the generated first fluctuation detection signal to the first weighting unit 140, and outputs the generated second fluctuation detection signal to the second weighting unit 150. Details of step S4 will be described with reference to the flowchart of FIG.

[0065] The second fluctuation detection unit 170 also generates a third fluctuation detection signal based on the input high-frequency audio signal (step S5). The second fluctuation detection unit 170 outputs the generated third fluctuation detection signal to the third weighting unit 180.

[0066] Next, the first weighting unit 140 generates a low-frequency attack complementary signal based on the input low-frequency audio signal and the first fluctuation detection signal (step S6). The first weighting unit 140 outputs the generated low-frequency attack complementary signal to the synthesis unit 190. Details of step S6 will be described with reference to the flowchart of FIG.

[0067] The second weighting unit 150 generates a low-frequency reverberation complementary signal based on the input low-frequency audio signal and the second fluctuation detection signal (step S7). The second weighting unit 150 outputs the generated low-frequency reverberation complementary signal to the synthesis unit 190. Details of step S7 will be described with reference to the flowchart of FIG.

[0068] Furthermore, the third weighting unit 180 generates a high frequency attack complementary signal based on the input high frequency audio signal and the third fluctuation detection signal (step S8). The third weighting unit 180 outputs the generated high frequency attack complementary signal to the synthesis unit 190.

[0069] Next, the synthesis unit 190 synthesizes the input audio signal with the low frequency attack complementary signal, the low frequency reverberation complementary signal, and the high frequency attack complementary signal (step S9), and outputs the synthesized signal to a downstream processing circuit (step S10). The downstream processing circuit corresponds to, for example, the D / A converter 12 and the amplifier 13 shown in FIG. 31. Step S9 corresponds to a "step of adding the first complementary signal to the audio signal."

[0070] FIG. 28 is a flowchart showing the details of step S4. The operation of the first fluctuation detection section 120 will be described with reference to the flowchart shown in FIG. When the low-frequency audio signal is input from the LPF 110, the first variation detection unit 120 detects a maximum value of the low-frequency audio signal by the first maximum value detection unit 121, holds the detected maximum value of the low-frequency audio signal by the first maximum value hold unit 122, and detects an envelope signal (step S401). Step S401 corresponds to a "step of detecting an envelope signal of an input audio signal".

[0071] Next, the first fluctuation detection unit 120 smoothes the detected envelope signal using the first smoothing processing unit 123, and converts the smoothed envelope signal into an envelope signal in decibels (step S402). Step S402 corresponds to a "step of converting the envelope signal into decibels."

[0072] Next, the first fluctuation detection unit 120 performs differentiation processing on the decibel envelope signal to generate a change amount signal (step S403). Step S403 corresponds to "the procedure of generating a change amount signal indicating the amount of change in the envelope signal". Next, the first variation detection section 120 performs inversion processing by multiplying the generated change amount signal by −1 using the first inversion processing section 126 (step S404). Step S404 corresponds to a “step of inverting the signal level of the change amount signal”.

[0073] Next, the first fluctuation detection unit 120 limits the signal range of the inverted change amount signal to a first range by the first level limiting unit 127 to generate a first limited signal, and limits it to a second range by the second level limiting unit 129 to generate a second limited signal (step S405). Step S405 corresponds to "the step of generating a first limited signal by limiting the gain of the change amount signal to a signal equal to or less than 0 dB" and "the step of generating a second limited signal by limiting the gain of the change amount signal to 0 dB or more". The first range is the range from -6 dB or more to 0 dB or less. The second range is the range from 0 dB or more to 6 dB or less.

[0074] Next, the first fluctuation detection unit 120 linearly converts the first limiting signal using the first linear conversion unit 128 to generate a first fluctuation detection signal, and linearly converts the second limiting signal using the second linear conversion unit 130 to generate a second fluctuation detection signal (step S406). Step S406 corresponds to "the procedure of generating a first fluctuation detection signal in which the gain of the first limiting signal is indicated by an amplitude" and "the procedure of generating a second fluctuation detection signal in which the gain of the second limiting signal is indicated by an amplitude".

[0075] FIG. 29 is a flowchart showing the details of step S6. The operation of first weighting section 140 will be described with reference to the flowchart shown in FIG. First, when the first weighting unit 140 receives the first fluctuation detection signal from the first fluctuation detection unit 120, the first weighting unit 140 repeats the input first fluctuation detection signal in the first repeat processing unit 141, and smoothes the repeat-processed first fluctuation detection signal in the third smoothing processing unit 142 (step S601). The first weighting unit 140 outputs the repeat-processed and smoothed first fluctuation detection signal to the first multiplier 143 and the second weighting unit 150.

[0076] Next, the first weighting unit 140 multiplies the first fluctuation detection signal that has been subjected to the repeat process and the smoothing process by the low-frequency audio signal by the first multiplier 143 (step S602). Next, the first weighting unit 140 subtracts the signal multiplied by the first multiplier 143 from the low frequency audio signal to generate a low frequency attack weighted signal (step S603).

[0077] Next, the first weighting unit 140 adjusts the gain of the weighted signal by the first gain adjustment unit 145 to generate a complementary signal for low frequency attack (step S604). Next, the first weighting unit 140 outputs the generated complementary signal for low frequency attack to the synthesis unit 190 (step S605).

[0078] FIG. 30 is a flowchart showing details of step S7. The operation of second weighting section 150 will be described with reference to the flowchart shown in FIG. First, when the second weighting unit 150 receives the second fluctuation detection signal from the first fluctuation detection unit 120, the second weighting unit 150 repeats the input second fluctuation detection signal in the second repeat processing unit 151, and smoothes the repeat-processed second fluctuation detection signal in the fourth smoothing processing unit 152 (step S701).

[0079] Next, the second weighting unit 150 multiplies the second fluctuation detection signal that has been subjected to the repeating process and the smoothing process by the first fluctuation detection signal input from the first weighting unit 140 (step S702). Step S702 corresponds to "the procedure of multiplying the first fluctuation detection signal by the second fluctuation detection signal to generate a multiplied signal." Next, the second weighting unit 150 generates a third limited signal by limiting the signal range of the product signal multiplied by the second multiplier 153 to a third range by the fourth level limiting unit 154 (step S703). The third range is a range in which the amplitude is 1 or more. Step S703 corresponds to "a procedure for generating a third limited signal in which the amplitude of the product signal is limited to 1 or more."

[0080] Next, the second weighting unit 150 multiplies the low-frequency audio signal by the third limited signal using the third multiplier 155 (step S704), and subtracts the signal multiplied by the third multiplier 155 from the low-frequency audio signal using the second subtractor 156 to generate a weighted signal for reverberation (step S705). Step S705 corresponds to "a procedure of subtracting a signal obtained by multiplying the audio signal by the third limited signal from the audio signal to generate a first complementary signal."

[0081] Next, the second weighting unit 150 adjusts the gain of the weighted signal for reverberation by the second gain adjustment unit 157 to generate a low-frequency reverberation complementary signal (step S706). Next, the second weighting unit 150 outputs the generated low-frequency reverberation complementary signal to the synthesis unit 190 (step S707).

[0082] As described above, the sound processing device 100 of this embodiment includes the first variation detection section 120, the second weighting section 150, and the synthesis section 190. The first fluctuation detection unit 120 includes a first maximum value detection unit 121, a first maximum value hold unit 122, a first decibel conversion unit 124, a first differential processing unit 125, a first inversion processing unit 126, a first level limiting unit 127, a first linear conversion unit 128, a second level limiting unit 129 and a second linear conversion unit 130.

[0083] The first maximum value detection section 121 and the first maximum value hold section 122 detect the envelope signal of the input audio signal. The first decibel converter 124 converts the detected envelope signal into a decibel signal. The first differential processing unit 125 performs differential processing on the decibel-converted envelope signal to generate a change amount signal indicating the amount of change in the envelope signal. The first inversion processing unit 126 inverts the signal level of the generated change amount signal. The first level limiting section 127 generates a first limiting signal by limiting the gain of the inverted change amount signal to a signal equal to or lower than 0 dB. The first linear conversion section 128 generates a first fluctuation detection signal in which the gain of the generated first limiting signal is indicated by an amplitude. The second level limiting unit 129 and the second linear conversion unit 130 generate a second limiting signal that limits the gain of the inverted change amount signal to 0 dB or more, and generate a second fluctuation detection signal in which the gain of the generated second limiting signal is indicated by an amplitude.

[0084] The second weighting section 150 includes a second multiplier 153 , a fourth level limiting section 154 , a third multiplier 155 and a second subtractor 156 . The second multiplier 153 multiplies the first fluctuation detection signal by the second fluctuation detection signal to generate a multiplied signal. The fourth level limiting unit 154 generates a third limiting signal by limiting the amplitude of the generated multiplied signal to 1 or more. The third multiplier 155 multiplies the audio signal by the third limited signal. The second subtractor 156 subtracts the signal obtained by multiplying the audio signal by the third limiting signal from the audio signal to generate a low-frequency reverberation complementary signal. The synthesis unit 190 adds the low-frequency reverberation complementary signal to the audio signal.

[0085] The second limiting signal is a signal in which the gain of the change amount signal is limited to 0 dB or more. The second linear conversion unit 130 generates a second fluctuation detection signal that indicates the gain of the second limiting signal by its amplitude. Therefore, the second fluctuation detection signal has an amplitude of 1 or more. The first limiting signal is a signal in which the gain of the change amount signal is limited to 0 dB or less. The first linear conversion unit 128 generates a first fluctuation detection signal that indicates the gain of the first limiting signal by its amplitude. Therefore, the first fluctuation detection signal has an amplitude of 1 or less. Furthermore, a third limited signal, which is obtained by limiting the amplitude of a multiplied signal obtained by multiplying the first fluctuation detection signal by the second fluctuation detection signal to 1 or more, becomes a signal with an amplitude of 1 or more. If the low-frequency reverberation complementary signal output from the second subtractor 156 is "Y1," the audio signal input to the third multiplier 155 and the second subtractor 156 is "S1," and the third limited signal input to the third multiplier 155 is "W1," the low-frequency reverberation complementary signal Y1 is calculated by the following formula. Y1 = S1 - (W1 x S1) = (1 - W1) x S1 Since the third limiting signal W1 is a signal with an amplitude of 1 or more, 1-W1 is 0 or a negative value, and the low-frequency reverberation complementary signal Y1 is a signal with an opposite phase to the audio signal S1. Therefore, by adding the opposite-phase low-frequency reverberation complementary signal Y1 to the audio signal S1, the amplitude of the audio signal S1 can be attenuated by the low-frequency reverberation complementary signal Y1.

[0086] The sound processing device 100 also includes a first weighting section 140 . The first weighting section 140 includes a first multiplier 143 and a first subtractor 144 . The first multiplier 143 multiplies the audio signal by the first fluctuation detection signal. The first subtractor 144 subtracts a signal obtained by multiplying the audio signal by the first fluctuation detection signal from the audio signal to generate a complementary signal for low frequency attack. The synthesis unit 190 adds the low-frequency attack complementary signal and the low-frequency reverberation complementary signal to the audio signal.

[0087] The first limited signal is a signal whose amplitude is 1 or less, as described above. If the low frequency attack complementary signal output from the first subtractor 144 is "Y2", the audio signal input to the first multiplier 143 and the first subtractor 144 is "S1", and the first fluctuation detection signal input to the first multiplier 143 is "W2", then the low frequency attack complementary signal Y2 is calculated by the following formula. Y2=S1-(W2×S1)=(1-W2)×S1 Since the first fluctuation detection signal W2 is a signal whose amplitude is 1 or less, 1-W2 is 0 or a positive value, and the low frequency attack complementary signal Y2 is a signal in phase with the audio signal S1. Therefore, by adding the in-phase low frequency attack complementary signal Y2 to the audio signal S1, the amplitude of the audio signal S1 can be amplified by the low frequency attack complementary signal Y2.

[0088] The sound processing device 100 also includes a second gain adjustment section 157 that adjusts the gain of the low-frequency reverberation complementary signal, and a first gain adjustment section 145 that adjusts the gain of the low-frequency attack complementary signal. The synthesis unit 190 adds the low-frequency reverberation complementary signal and the low-frequency attack complementary signal, the gains of which have been adjusted by the second gain adjustment unit 157 and the first gain adjustment unit 145, to the audio signal. Therefore, by generating a low-frequency reverberation complementary signal and a low-frequency attack complementary signal with adjusted weighting amounts, it is possible to appropriately adjust the amplification rate and attenuation rate of the amplitude of the audio signal.

[0089] As a differentiation process, the first differential processing unit 125 performs filtering process on the audio signal using a high-pass filter. Furthermore, the change time of the change amount of the envelope signal obtained by the filtering process is adjusted by changing the setting value of the normalized cutoff frequency in the high-pass filter. Therefore, it is possible to adjust the dynamic range expansion time in accordance with the state of dynamic range compression.

[0090] [Second embodiment] FIG. 31 is a diagram showing a system configuration of the second embodiment. The second embodiment includes a sound source device 11, a sound processing device 200, a D / A converter 12, an amplifier 13, and a speaker .

[0091] The sound source device 11 reproduces content and outputs an audio signal. The content includes, for example, audio sources recorded on a CD, a DVD, a BD (Blu-ray (registered trademark) Disc), a hard disk, a semiconductor memory, etc. The content may also be a streaming audio signal received by the sound source device 11 from an external device such as a server, when the sound source device 11 has a wireless communication unit.

[0092] The D / A converter 12 receives an audio signal processed by the sound processing device 200. The D / A converter 12 converts the input digital audio signal into an analog signal and outputs the converted analog audio signal to the amplifier 13. The amplifier 13 amplifies the input audio signal and outputs the amplified audio signal to the speaker 14 .

[0093] The sound processing device 200 is a computer device including a control unit 230 having a memory 210 and a processor 220. The control unit 230 controls the overall operation of the sound processing device 200 by the processor 220 operating in accordance with a control program 211 stored in the memory 210.

[0094] The memory 210 includes semiconductor memories such as a RAM (Random Access Memory) and a ROM (Read Only Memory). The RAM is used for temporary storage of various data, and the ROM stores a control program 211 for controlling the operation of the sound processing device 200, various setting information, and the like.

[0095] The processor 220 is an arithmetic processing device configured with a CPU (Central Processing Unit) and an MPU (Micro Processing Unit). The processor 220 executes the control program 211 to control each part of the sound processing device 200. The processor 220 may be configured with a single processor, or may be configured with multiple processors. The processor 220 may be configured with a part or all of the memory 210 or a system-on-a-chip (SoC) integrated with other circuits. The processor 220 may be configured with a combination of a CPU that executes a program and a DSP that executes a predetermined arithmetic processing. Furthermore, all of the functions of the processor 220 may be implemented in hardware, or may be configured using a programmable device.

[0096] By the processor 220 executing the control program 211, the control unit 230 functions as the LPF 110, the first fluctuation detection unit 120, the first weighting unit 140, the second weighting unit 150, the HPF 160, the second fluctuation detection unit 170, the third weighting unit 180 and the synthesis unit 190 shown in FIG. 1.

[0097] The control unit 230 executes the steps of detecting an envelope signal of an input audio signal, converting the detected envelope signal into decibels, differentiating the converted envelope signal to generate a change amount signal indicating an amount of change in the envelope signal, inverting a signal level of the generated change amount signal, generating a first limiting signal by limiting the gain of the inverted change amount signal to a signal equal to or less than 0 dB, generating a first fluctuation detection signal in which the gain of the generated first limiting signal is indicated by an amplitude, generating a second limiting signal by limiting the gain of the inverted change amount signal to 0 dB or more, generating a second fluctuation detection signal in which the gain of the generated second limiting signal is indicated by an amplitude, multiplying the first fluctuation detection signal by the second fluctuation detection signal, generating a third limiting signal by limiting the amplitude of the signal obtained by multiplying the first fluctuation detection signal by the second fluctuation detection signal to 1 or more, subtracting a signal obtained by multiplying the audio signal by the third limiting signal from the audio signal to generate a first complementary signal, and adding the first complementary signal to the audio signal.

[0098] The above-described embodiment is merely an example of one aspect of the present invention, and any modification and application are possible without departing from the gist of the present invention.

[0099] For example, the configuration of the sound processing device 100 shown in Figs. 1 to 6 is a schematic diagram showing the functions of these devices classified according to the main processing contents. The configuration of the sound processing device 100 can be further divided into more blocks according to the processing contents. Furthermore, these functional blocks may be configured so that more processing is executed by one block shown in Figs. 1 to 6. Furthermore, the processing of each block may be executed by one piece of hardware or by multiple pieces of hardware. Furthermore, the processing of each block may be realized by one program or by multiple programs.

[0100] 27 to 30 are divided according to the main processing contents in order to facilitate understanding of the processing of the sound processing device 100, and the present invention is not limited by the manner in which the processing units are divided or the names of the processing units. The processing of the sound processing device 100 may be divided into more processing units according to the processing contents. Furthermore, the processing of the sound processing device 100 may be divided so that one processing unit includes more processes.

[0101] Furthermore, when the program of the present invention is realized using a computer, the program executed by the computer can be configured in the form of a recording medium or a transmission medium for transmitting the program. The recording medium can be a magnetic or optical recording medium or a semiconductor memory device. Specific examples of the recording medium include portable or fixed recording media such as a flexible disk, HDD, CD-ROM (Compact Disk Read Only Memory), DVD, Blu-ray Disc, magneto-optical disk, flash memory, and card-type recording medium. The recording medium may also be a non-volatile storage device such as a ROM or HDD provided in the sound processing device 100. [Explanation of symbols]

[0102] 11 Sound source device 12 D / A converter 13 Amplifier 14 Speakers 100, 200 Sound processing device 110 LPF 120 First fluctuation detection unit 121 First maximum value detector 122 1st maximum value hold section 123 First smoothing processing section 124 First decibel converter 125 First differential processing section 126 First inversion processing section 127 First Level Restrictions 128 First Linear Conversion Unit 129 Second Level Restrictions 130 Second Linear Conversion Unit 140 First weighting unit 141 First repeat processing section 142 Third smoothing processing section 143 First Multiplier 144 First subtractor 145 First gain adjustment unit 150 Second weighting section 151 Second repeat processing section 152 Fourth smoothing processing section 153 Second Multiplier 154 4th Level Restrictions 155 3rd multiplier 156 Second subtractor 157 Second gain adjustment section 160 HPF 170 Second fluctuation detection unit 171 Second maximum value detector 172 Second maximum value hold section 173 Second smoothing processing section 174 Second decibel converter 175 Second Differential Processing Section 176 Second inversion processing section 177 Third Level Restrictions 178 3rd Linear Conversion Unit 180 Third weighting section 181 Third repeat processing section 182 5th smoothing processing section 183 Fourth Multiplier 184 Third subtractor 185 3rd gain adjustment section 190 Synthesis Section 210 Memory 211 Control Program 220 Processor 230 Control Unit

Claims

1. a detector for detecting an envelope signal of an input audio signal; A conversion unit that converts the detected envelope signal into decibels; a differential processing unit that performs differential processing on the converted envelope signal to generate a change amount signal that indicates a change amount of the envelope signal; an inversion unit that inverts a signal level of the change amount signal; a first fluctuation detection signal generating unit that generates a first limiting signal by limiting the gain of the inverted change amount signal to a signal equal to or less than 0 dB, and generates a first fluctuation detection signal in which the gain of the generated first limiting signal is indicated by an amplitude; a second fluctuation detection signal generating unit that generates a second limiting signal by limiting the gain of the inverted change amount signal to 0 dB or more, and generates a second fluctuation detection signal in which the gain of the generated second limiting signal is indicated by an amplitude; a limiting signal generating unit that generates a multiplied signal by multiplying the first fluctuation detection signal by the second fluctuation detection signal, and generates a third limiting signal by limiting the amplitude of the generated multiplied signal to 1 or more; a first complementary signal generating unit that generates a first complementary signal by subtracting a signal obtained by multiplying the audio signal by the third limited signal from the audio signal; an adder for adding the first complementary signal to the audio signal; An audio processing device comprising:

2. a second complementary signal generating unit that generates a second complementary signal by subtracting a signal obtained by multiplying the audio signal by the first fluctuation detection signal from the audio signal, The sound processing device according to claim 1 , wherein the adder adds the first complementary signal and the second complementary signal to the audio signal.

3. a gain adjustment unit that adjusts gains of the first complementary signal and the second complementary signal generated by the first complementary signal generation unit and the second complementary signal generation unit, 3. The sound processing device according to claim 2, wherein the adder adds the first complementary signal and the second complementary signal, the gains of which have been adjusted by the gain adjuster, to the audio signal.

4. the differential processing unit performs filtering processing on the audio signal using a high-pass filter as the differential processing; 4. The sound processing device according to claim 1, wherein the change time of the change amount of the envelope signal obtained by the filtering process is adjusted by changing a setting value of a normalized cutoff frequency in the high-pass filter.

5. On the computer, detecting an envelope signal of an input audio signal; converting the detected envelope signal into decibels; a step of differentiating the converted envelope signal to generate a change amount signal indicating a change amount of the envelope signal; inverting a signal level of the generated change amount signal; generating a first limiting signal by limiting the gain of the inverted change amount signal to a signal equal to or less than 0 dB; generating a first fluctuation detection signal in which the gain of the generated first limiting signal is indicated by an amplitude; generating a second limiting signal by limiting the gain of the inverted change amount signal to 0 dB or more; generating a second fluctuation detection signal in which the gain of the generated second limiting signal is indicated by an amplitude; multiplying the first fluctuation detection signal by the second fluctuation detection signal to generate a multiplied signal; A step of generating a third limited signal by limiting the amplitude of the generated multiplication signal to 1 or more; multiplying the audio signal by the third limited signal and subtracting the resultant signal from the audio signal to generate a first complementary signal; adding said first complementary signal to said audio signal; A program characterized by:

Images