Audio signal processing device, audio signal processing program

Abstract

To provide a voice signal processing device capable of up-mixing without distorting a stereo sound source.SOLUTION: A voice signal processing device 100 is used to up-mix a stereo sound source to a surrounding sound source. The voice signal processing device 100 includes a separation unit 10, for separating the stereo sound source into a direct sound and an indirect sound, a setting unit 20, for generating parameters for adjusting at least one of the direct sound and the indirect sound, a coefficient generating unit 30, for generating coefficients to be multiplied on the direct sound and the indirect sound for each channel of the surrounding sound source on the basis of the parameters, and a calculation unit 40, for multiplying the coefficients on the direct sound and indirect sound to up-mix a stereo sound source to the surrounding sound source.SELECTED DRAWING: Figure 2

Description

[Technical field]

[0001] The present invention relates to an audio signal processing device and an audio signal processing program that upmix an audio signal while suppressing deterioration in sound quality. [Background technology]

[0002] In recent years, with the realization of 4K and 8K broadcasting, there is an increasing demand to upmix stereo (2ch) audio formats to generate 22.2ch surround audio formats that are compatible with 5.1ch surround and 3D audio. In live broadcasts, 4K and 8K broadcasts can be carried out simultaneously with 2K broadcasts by generating 5.1ch surround and 22.2ch surround audio formats from stereo audio formats in real time.

[0003] As a specific method of upmixing, as described in Patent Document 1, a stereo sound source is separated into a direct sound and an indirect sound for each of the left and right sides, and various processes such as delay processing are performed on these four sound sources to output each channel in surround. In addition, in the technology described in Patent Document 2, a method is also known in which a stereo sound source is separated into a direct sound and an indirect sound for each of the left and right sides, and then upmixed using HRIR. Note that, as a method of separating a stereo sound source into a direct sound and an indirect sound, a method of extracting a coherent component from a stereo sound source is excellent, as described in Patent Document 3. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2015-076857 A [Patent Document 2] JP 2017-163458 A [Patent Document 3] International Publication No. 2017 / 188141 Summary of the Invention [Problem to be solved by the invention]

[0005] However, in Patent Documents 1 and 2, after separating the stereo sound source, delay processing and filter processing associated with HRIR are performed, which causes a problem of distortion in the original sound source. In particular, in recent years, there has been a demand for downmixing a surround sound source generated by upmixing a stereo sound source back to a stereo sound source, but if distortion occurs in the original sound source during upmixing, such distortion remains when downmixed to a stereo sound source. In addition, Patent Document 2 requires a reference HRIR, but there is also a problem that it is difficult to obtain.

[0006] SUMMARY OF THE PRESENT DISCLOSURE In order to solve the above problems, an object of the present invention is to provide an audio signal processing device capable of upmixing without causing distortion in a stereo sound source. [Means for solving the problem]

[0007] The audio signal processing device of the present invention has the following configuration. (1) An audio signal processing device that upmixes a stereo sound source into a surround sound source. (2) A separation unit that separates the stereo sound source into direct sound and indirect sound. (3) A setting unit that generates a parameter for adjusting at least one of the direct sound and the indirect sound. (4) A coefficient generating unit that generates a coefficient by which the direct sound and the indirect sound are multiplied for each channel in the surround sound source based on the parameters. (5) a calculation unit that upmixes the stereo sound source to the surround sound source by multiplying the direct sound and the indirect sound by the coefficient.

[0008] The audio signal processing device of the present invention may further include the following configuration. (1) The parameters include parameters for adjusting the balance between a center sound source and a sound source other than the center sound source in a front channel of the surround sound source. (2) The parameters include parameters for adjusting the balance between a center sound source and a sound source other than the center sound source in a rear channel of the surround sound source. (3) The parameters include parameters for adjusting the mixing amount of the indirect sound relative to the direct sound output from a front channel of the surround sound source. (4) The surround sound source supports 3D audio, and the parameters include parameters for adjusting the balance between the direct sound and the indirect sound output from a middle-layer channel in the surround sound source and the direct sound and the indirect sound output from upper and lower layer channels. (5) The parameters include parameters for adjusting the balance between the direct sound and the indirect sound. (6) The setting unit includes a direct sound / indirect sound balance adjustment unit that adjusts the balance between the direct sound and the indirect sound.

[0009] The audio signal processing program of the present invention has the following configuration. (1) An audio signal processing program that causes a computer to perform a process of upmixing a stereo sound source into a surround sound source. (2) A separation procedure for separating the stereo sound source into direct sound and indirect sound. (3) A setting step for generating parameters for adjusting at least one of the direct sound or the indirect sound. (4) A coefficient generation step of generating a coefficient by which the direct sound and the indirect sound are multiplied for each channel in the surround sound source based on the parameters. (5) A calculation procedure for upmixing the stereo sound source to the surround sound source by multiplying the direct sound and the indirect sound by the coefficient. Effect of the Invention

[0010] According to the present invention, it is possible to upmix a stereo sound source without causing distortion. [Brief description of the drawings]

[0011] [Figure 1] 1 is a block diagram showing a configuration of an audio signal processing device according to an embodiment; [Diagram 2] FIG. 2 is a block diagram showing in detail a portion of the configuration of the audio signal processing device according to the embodiment. [Diagram 3] 5A to 5C are diagrams showing the operation of a direct sound / indirect sound balance adjustment unit according to the embodiment. [Figure 4] 6A to 6C are diagrams illustrating the operation of the front balance adjustment unit according to the embodiment. [Diagram 5] 5A to 5C are diagrams illustrating the operation of the rear balance adjuster according to the embodiment. [Figure 6] 5A and 5B are diagrams illustrating the operation of a mixing amount adjustment unit according to the embodiment. [Figure 7] 6A to 6C are diagrams illustrating the operation of an interlayer balance adjustment unit according to an embodiment. [Figure 8] FIG. 4 is a diagram showing the operation of a calculation unit according to the embodiment. [Figure 9] 4 is a flowchart showing the operation of the audio signal processing device according to the embodiment. [Figure 10] FIG. 11 is a block diagram showing in detail a portion of the configuration of an audio signal processing device according to another embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0012] [First embodiment] [composition] The audio signal processing device 100 of the present embodiment shown in FIG. 1 is known as, for example, an audio mixing console or a mixer. In the following description, an upmix from stereo to 22.2ch surround is taken as an example, and the audio signal input to the audio signal processing device 100 is a stereo sound source. The 22.2ch surround is composed of 24 channels, 1 to 24. Specifically, it is composed of 9 channels in the upper layer, 10 channels in the middle layer, and 3.2 channels in the lower layer. The 3.2 channels in the lower layer include two LFEs. The 22.2ch surround can also be considered as being divided into 11.2 channels on the front side and 11 channels on the side and rear sides. For ease of explanation, it is considered that direct sound is mainly output from the front side channels, and indirect sound is mainly output from the side side channels and rear side channels, but the indirect sound may be output from the front side channels.

[0013] The audio signal processing device 100 includes a separation unit 10 that separates a stereo sound source into direct sound and indirect sound for each of the left and right sides, a setting unit 20 that generates various parameters for adjusting the separated sound source, a coefficient generation unit 30 that generates coefficients based on the generated parameters, and a calculation unit 40 that generates an upmixed surround sound source from the coefficients and the separated sound source.

[0014] The separation unit 10 separates the stereo sound source into a direct sound and an indirect sound for each of the left and right. That is, the sound is separated into four sound sources: a left direct sound DL, a right direct sound DR, a left indirect sound RL, and a right indirect sound RR. As a method for separating the stereo sound source into a direct sound and an indirect sound, a well-known technique such as the technique of Patent Document 3 described in the background art can be used. The separation unit 10 outputs these four sound sources to a calculation unit 40 provided in a subsequent stage. Note that a direct sound is a sound that reaches the ear directly, and an indirect sound is a sound that reaches the ear after being reflected by a wall or the like.

[0015] The setting unit 20 generates parameters for adjusting the four sound sources separated by the separation unit 10. As shown in Fig. 2, the setting unit 20 includes a direct sound / indirect sound balance adjustment unit 21 that adjusts the balance between the direct sound and the indirect sound, a front balance adjustment unit 22 that adjusts the balance between the center sound source and the sound sources other than the center sound source in the direct sound, a rear balance adjustment unit 23 that adjusts the balance between the center sound source and the sound sources other than the center sound source in the indirect sound, a mixing amount adjustment unit 24 that adjusts the mixing amount of the direct sound and the indirect sound, and an interlayer balance adjustment unit 25 that adjusts the balance between the output from the middle layer channel and the output from the upper and lower layer channels in the direct sound and the indirect sound.

[0016] As shown in Fig. 3, the direct sound / indirect sound balance adjustment unit 21 has, for example, one operator, and rotating this operator to the left increases the mixing amount of the direct sound, and rotating it to the right increases the mixing amount of the indirect sound. By rotating this operator to the left or right, the mixing engineer adjusts the balance between the direct sound and the indirect sound in the surround sound source after upmixing. The degree of this adjustment is output as a ROOM value to the calculation unit 40 provided at the downstream stage.

[0017] As shown in FIG. 4, the front balance adjustment unit 22 adjusts the balance between the center sound source and the sound source other than the center sound source among the direct sound. This center sound source is a component of the direct sound that is localized in the center. Also, this sound source other than the center sound source is a component of the direct sound other than the center sound source. The front balance adjustment unit 22 has, for example, one operator, and rotating this operator to the left increases the mixing amount of the center sound source, and rotating it to the right increases the mixing amount of the sound source other than the center sound source. By rotating this operator to the left and right, the mixing engineer adjusts the balance between the center sound source output from the front side channel and the sound source other than the center sound source in the surround sound source after upmixing. The degree of this adjustment is output as an Fdiv value to the coefficient generation unit 30 provided at the subsequent stage.

[0018] As shown in FIG. 5, the rear balance adjustment unit 23 adjusts the balance between the center sound source and the sound source other than the center sound source among the indirect sound. This center sound source is a component of the indirect sound that is localized in the center. Also, this sound source other than the center sound source is a component of the indirect sound other than the center sound source. The rear balance adjustment unit 23 has, for example, one operator, and rotating this operator to the left increases the mixing amount of the center sound source, and rotating it to the right increases the mixing amount of the sound source other than the center sound source. By rotating this operator to the left and right, the mixing engineer adjusts the balance between the center sound source output from the rear channel and the sound source other than the center sound source in the surround sound source after upmixing. The degree of this adjustment is output as an Rdiv value to the coefficient generation unit 30 provided at the subsequent stage.

[0019] 6, the mixing amount adjustment unit 24 adjusts the mixing ratio of the indirect sound to the direct sound output from the front channel, and the mixing ratio of the direct sound to the indirect sound output from the rear channel. To this end, the mixing amount adjustment unit 24 includes, for example, a main operator X and a sub-operator Y.

[0020] The main operator X adjusts the balance between the direct sound and the indirect sound output from the front channel. For example, rotating the main operator X to the left decreases the mixing amount of the direct sound and the indirect sound, and rotating it to the right increases the mixing amount of the direct sound and the indirect sound. On the other hand, the sub-operator Y adjusts the amount of the direct sound mixed with the indirect sound and the amount of the indirect sound mixed with the direct sound output from the front channel. For example, rotating the sub-operator Y to the left decreases the amount of the direct sound mixed with the indirect sound and the amount of the indirect sound mixed with the direct sound, and rotating it to the right increases the amount of the direct sound mixed with the indirect sound and the amount of the indirect sound mixed with the direct sound. The mixing engineer adjusts the mixing ratio of the indirect sound to the direct sound output from the front channel and the mixing ratio of the direct sound to the indirect sound by rotating the main operator X and the sub-operator Y. The main operator X and the sub-operator Y may be linked, or the main operator X may be fixed and only the sub-operator Y may rotate. When linking them, it is preferable that the sub-operator Y rotates in the opposite direction to the rotation direction of the main operator X. The degree of this adjustment is output as the FRdiv value to the coefficient generation unit 30 provided at the subsequent stage.

[0021] As shown in FIG. 7, when the surround sound source after upmixing corresponds to 3D audio, the interlayer balance adjustment unit 25 adjusts the balance between the direct sound and indirect sound output from the middle layer channel and the direct sound and indirect sound output from the upper and lower layer channels. That is, the interlayer balance adjustment unit 25 has, for example, one operator, and when the operator is rotated to the left, the direct sound and indirect sound output from the middle layer channel are emphasized, and when the operator is rotated to the right, the direct sound and indirect sound output from the upper and lower layer channels are emphasized. The mixing engineer adjusts the balance between the direct sound and indirect sound output from the middle layer channel and the direct sound and indirect sound output from the upper and lower layer channels by rotating the operator to the left and right. The degree of this adjustment is output to the coefficient generation unit 30 provided at the subsequent stage as an ELdiv value.

[0022] Returning to Fig. 2, the coefficient generating unit 30 generates coefficients A, B, C, and D by arbitrarily combining the four parameters Fdiv, Rdiv, FRdiv, and ELdiv generated by the setting unit 20 and performing arithmetic operations. The combinations and arithmetic operations differ for each channel in the surround sound. That is, 24 sets of coefficients A1 to D1, ..., A24 to D24 are generated by combining the values ​​of Fdiv, Rdiv, FRdiv, and ELdiv for each of the 22.2 channels.

[0023] The generation of each of the coefficients An to Dn will be described in more detail. Fdiv is made up of AnFdiv, BnFdiv, CnFdiv, and DnFdiv. Similarly, Rdiv is made up of AnRdiv, BnRdiv, CnRdiv, and DnRdiv, FRdiv is made up of AnFRdiv, BnFRdiv, CnFRdiv, and DnFRdiv, and ELdiv is made up of AnELdiv, BnELdiv, CnELdiv, and DnELdiv.

[0024] For example, AnFdiv and BnFdiv are generated for each channel in the surround sound source by rotating the control of the front balance adjustment unit 22. Similarly, CnRdiv and DnRdiv are generated for each channel in the surround sound source by rotating the control of the rear balance adjustment unit 23, AnFRdiv, BnFRdiv, CnFRdiv, and DnFRdiv are generated for each channel in the surround sound source by rotating the control of the mixing amount adjustment unit 24, and AnELdiv, BnELdiv, CnELdiv, and DnELdiv are generated for each channel in the surround sound source by rotating the control of the interlayer balance adjustment unit 25.

[0025] And An to Dn are generated by the following formulas. An=AnFdiv×AnRdiv×AnFRdiv×AnELdiv Bn=BnFdiv×BnRdiv×BnFRdiv×BnELdiv Cn=CnFdiv×CnRdiv×CnFRdiv×CnELdiv Dn=DnFdiv×DnRdiv×DnFRdiv×DnELdiv

[0026] The coefficients A1 to D1, . . . , A24 to D24 generated in the above manner are output to a calculation unit 40 provided at the subsequent stage.

[0027] As shown in FIG. 8, the calculation unit 40 calculates the audio signals to be output from each channel in the surround after upmixing based on the four sound sources DL, DR, RL, and RR separated by the separation unit 10, the parameter ROOM generated by the direct sound / indirect sound balance adjustment unit 21, and the coefficients A1 to D1, . . . , A24 to D24 generated by the coefficient generation unit 30. The calculation unit 40 calculates the output T from each channel using the following (Equation 1). Note that in (Equation 1), n ​​attached to the output T and each of the coefficients A, B, C, and D is the channel number in the surround, and for example, T1 is the output T of channel 1. Also, DL', DR', RL', and RR' are obtained by adjusting DL, DR, RL, and RR with the ROOM value, respectively. As a result, the calculation unit 40 generates outputs T1 to T24 from channels 1 to 24, respectively, and generates the surround sound source. The upmixed surround sound source is output to the outside from an output device such as a speaker (not shown) provided for each channel. (Number 1) Tn=An×DL'+Bn×DR'+Cn×RL'+Dn×RR'...(Formula 1)

[0028] [Effect] The operation of the audio signal processing device 100 in this embodiment will be described with reference to Fig. 9. First, a stereo sound source, which is an original audio signal, is input to the separation unit 10. The separation unit 10 separates the stereo sound source into four sound sources, a left direct sound DL, a right direct sound DR, a left indirect sound RL, and a right indirect sound RR (step S01). The four separated sound sources are input to the calculation unit 40.

[0029] In the setting unit 20, the direct sound / indirect sound balance adjustment unit 21 generates a ROOM value, the front balance adjustment unit 22 generates an Fdiv value, the rear balance adjustment unit 23 generates an Rdiv value, the mixing amount adjustment unit 24 generates an FRdiv value, and the interlayer balance adjustment unit 25 generates an ELdiv value, and these are output to the coefficient generation unit 30 or the calculation unit 40 provided in the subsequent stage (step S02). More specifically, in each of these configurations, a mixing engineer rotates one or two controls to adjust the mixing amount to adjust at least one of the direct sound or the indirect sound. As a result of this adjustment, each of the above-mentioned parameters is generated. The ROOM value and the coefficients generated based on the four parameters Fdiv, Rdiv, FRdiv, and ELdiv are input to the calculation unit 40 and are reflected in the surround sound source after upmixing. In other words, the adjustment of the mixing amount in the setting unit 20 can also be said to adjust the surround sound source after upmixing.

[0030] The coefficient generating unit 30 generates coefficients A, B, C, and D for each channel in the surround output by arbitrarily combining the four parameters Fdiv, Rdiv, FRdiv, and ELdiv generated by the setting unit 20 and performing arithmetic operations. That is, 24 sets of coefficients A1 to D1, . . ., A24 to D24 are generated by combining the values ​​of Fdiv, Rdiv, FRdiv, and ELdiv for each of the 22.2 channels (step S03). The coefficients A1 to D1, . . ., A24 to D24 are output to the calculation unit 40 provided in the subsequent stage. Note that, in generating the coefficients Cn and Dn of the indirect sounds RL and RR, the Fdiv value related to the mixing amount of the direct sound may not be used. Similarly, in generating the coefficients An and Bn of the direct sounds DL and DR, the Rdiv value related to the mixing amount of the indirect sound may not be used. In this way, it is not necessary to use all parameters in generating each coefficient. Also, depending on the channel, it is not necessary to generate all the coefficients by arithmetic operations. For example, the coefficients of the left channel output on the front side of the middle layer can be Bn=Dn=1.

[0031] The calculation unit 40 calculates outputs T1 to T24 of each channel in 22.2ch surround from the above (Equation 1) based on the four sound sources DL, DR, RL, and RR generated by the separation unit 10, the parameter ROOM generated by the direct sound / indirect sound balance adjustment unit 21, and the 24 sets of coefficients A1 to D1, . . . , A24 to D24 generated by the coefficient generation unit 30 (step S04). The calculated outputs T1 to T24 are output from speakers (not shown) provided for each channel in the surround.

[0032] [effect] (1) In the audio signal processing device 100 of the present embodiment, the separation unit 10 separates the stereo sound source and generates four sound sources, namely, the left direct sound DL, the right direct sound DR, the left indirect sound RL, and the right indirect sound RR, by adjusting the ROOM value generated by the direct sound / indirect sound balance adjustment unit 21, and then the calculation unit 40 multiplies the coefficients generated by the coefficient generation unit 30 based on the four parameters Fdiv, Rdiv, FRdiv, and ELdiv generated by the setting unit 20, to generate a surround sound source from the stereo sound source. In this way, the stereo sound source is upmixed without performing delay processing or filter processing, so that the distortion of the sound source due to the upmix can be suppressed. Therefore, even if the upmixed surround sound source is downmixed again to the stereo sound source, the distortion generated in the stereo sound source is small.

[0033] (2) The setting unit 20 of the audio signal processing device 100 of this embodiment includes a front balance adjustment unit 22. This makes it possible to emphasize only the center sound source in the front channel output compared to other sound sources, thereby making it possible to avoid a situation in which the center sound source is buried in other sound sources and becomes difficult to hear. In particular, when the center sound source contains important information such as a comment, it is possible to avoid a situation in which the comment cannot be heard.

[0034] (3) The setting unit 20 of the audio signal processing device 100 of this embodiment includes a rear balance adjustment unit 23. This makes it possible to adjust the balance between the center sound source and other sound sources in the rear channel output, thereby adjusting the spread of the sound output from the rear channel.

[0035] (4) The setting unit 20 of the audio signal processing device 100 of this embodiment includes a mixing amount adjustment unit 24. As a result, even if the center sound source is weaker than the other sound sources, the center sound source output from the front side channel can be reinforced by mixing the indirect sound with the direct sound output from the front side channel, making it easier to hear the sound localized in the center. Similarly, the center sound source can be reinforced by mixing the direct sound with the indirect sound.

[0036] (5) The setting unit 20 of the audio signal processing device 100 of this embodiment includes an inter-layer balance adjustment unit 25. This makes it possible to spread the direct sound and indirect sound of the middle layer in the surround sound to the upper and lower layers as well.

[0037] (6) The setting unit 20 of the audio signal processing device 100 of this embodiment includes a direct sound / indirect sound balance adjustment unit 21. This makes it possible to emphasize the indirect sound in the surround sound source after upmixing.

[0038] [Other embodiments] The present invention is not limited to the above-described embodiment, and in the implementation stage, the components can be modified and embodied without departing from the gist of the invention. In addition, various inventions can be formed by appropriate combinations of the multiple components disclosed in the above-described embodiment. For example, some components may be deleted from all the components shown in the embodiment. Specifically, the following other embodiments are also included.

[0039] (1) In the above embodiment, upmixing from stereo to 22.2 ch surround has been described, but the present invention can also be applied to upmixing from stereo to 5.1 ch surround, or from stereo to 5.1.2 ch surround corresponding to 3D audio.

[0040] (2) In the above embodiment, the output Tn of each channel is calculated separately, but this is not limited to this. For example, the outputs of the left and right channels on the front side and the left and right channels on the side and rear sides may be the same. This can reduce the amount of calculations in the coefficient generating unit 30 and the calculation unit 40.

[0041] (3) The setting unit 20 in the above embodiment generates four parameters Fdiv, Rdiv, FRdiv, and ELdiv, but this is not limited to this. If the setting unit 20 can generate at least one parameter, it is possible to finely adjust the output Tn of each channel n by diversifying the four arithmetic operations for generating the coefficients An to Dn. Also, as shown in FIG. 10, the coefficients An to Dn may be generated using five parameters including the Room value. In this case, the coefficients can be generated, for example, by the following formulas. However, AnRoom=BnRoom, CnRoom=DnRoom=1-AnRoom. An=AnRoom×AnFdiv×AnRdiv×AnFRdiv×AnELdiv Bn=BnRoom×BnFdiv×BnRdiv×BnFRdiv×BnELdiv Cn=CnRoom×CnFdiv×CnRdiv×CnFRdiv×CnELdiv Dn=DnRoom×DnFdiv×DnRdiv×DnFRdiv×DnELdiv

[0042] (4) In the setting unit 20 of the above embodiment, the mixing engineer generates parameters by operating the controls provided in each component, but the parameters may also be generated by operating a GUI provided in the audio signal processing device 100.

[0043] (5) In the above embodiment, the setting unit 20 includes the direct sound / indirect sound balance adjustment unit 21, the front balance adjustment unit 22, the rear balance adjustment unit 23, the mixing amount adjustment unit 24, and the interlayer balance adjustment unit 25. In addition to these components, the setting unit 20 may include an equalizer. In this case, the equalizer is used to the extent that it does not distort the stereo sound source too much.

[0044] (6) In the above embodiment, the mixing amount adjustment unit 24 adjusts the amount of indirect sound to be mixed with the direct sound and the amount of direct sound to be mixed with the indirect sound, but it may adjust only the former. In other words, it is not necessary to mix the direct sound with the indirect sound.

[0045] (7) In the above embodiment, the interlayer balance adjustment unit 25 uses one operator to spread the direct sound and indirect sound from the middle layer of the surround sound source to the upper and lower layers, but by providing two operators, it is also possible to adjust the direct sound and the indirect sound separately. The two operators may be linked, or one may be fixed and the other may rotate alone. When linked, it is preferable that one rotates in the opposite direction to the other.

[0046] (8) In the above embodiment, the hardware of the audio signal processing device 100 has been described, but the same effect can be achieved by software such as a program that causes a computer to execute the functions of each component of the audio signal processing device 100 as a procedure. For example, instead of the audio signal processing device 100 including the separation unit 10, the setting unit 20, the coefficient generation unit 30, and the calculation unit 40, the same effect can be achieved by an audio signal processing program that causes a computer to execute a separation procedure for separating a stereo sound source into a direct sound and an indirect sound, a setting procedure for generating parameters for adjusting at least one of the direct sound or the indirect sound, a coefficient generation procedure for generating coefficients for multiplying the direct sound and the indirect sound for each channel of the surround sound source based on the parameters, and a calculation procedure for upmixing the stereo sound source to the surround sound source by multiplying the direct sound and the indirect sound by the coefficients. This procedure is performed in the same manner as in the description of FIG. 9, for example. [Explanation of symbols]

[0047] 100...Audio signal processing device 10…Separation part 20. Setting section 21…Direct sound / indirect sound balance adjustment section 22…Front balance adjustment section 23…Rear balance adjustment section 24…Mixing amount adjustment section 25…Interlayer balance adjustment section 30...Coefficient generation section 40...Arithmetic section X…Main controller Y...Secondary control DL: Left direct sound DR: Right direct sound RL: Left indirect sound RR: Right indirect sound A~D…Coefficients T…Output

Claims

1. An audio signal processing device that upmixes a stereo sound source into a surround sound source corresponding to 3D audio, a separation unit that separates the stereo sound source into a direct sound and an indirect sound; a direct sound / indirect sound balance adjustment unit that generates a ROOM value that adjusts the balance between the direct sound and the indirect sound; a front balance adjustment unit that generates a parameter for adjusting a balance between a center sound source and a sound source other than the center sound source among the direct sounds in a front channel of the surround sound source; a rear balance adjustment unit that generates a parameter for adjusting a balance between a center sound source and a sound source other than the center sound source among the indirect sounds in a rear channel of the surround sound source; a mixing amount adjustment unit that generates a parameter for adjusting a mixing amount of the indirect sound with respect to the direct sound output from a front channel of the surround sound source; an inter-layer balance adjustment unit that generates a parameter for adjusting a balance between the direct sound and the indirect sound output from a channel in a middle layer in the surround sound source and the direct sound and the indirect sound output from a channel in an upper layer and a lower layer; a coefficient generation unit that generates a coefficient by which the direct sound and the indirect sound are multiplied for each channel in the surround sound source based on the parameters; An audio signal processing device comprising: a calculation unit that adjusts the direct sound and the indirect sound by the ROOM value and multiplies the direct sound and the indirect sound by the coefficient, thereby upmixing the stereo sound source to the surround sound source.

2. An audio signal processing program for causing a computer to execute a process of upmixing a stereo sound source into a surround sound source corresponding to 3D audio, a separation step of separating the stereo sound source into a direct sound and an indirect sound; a direct / indirect sound balance step for generating a ROOM value for adjusting the balance between the direct sound and the indirect sound; a front balance adjustment step of generating a parameter for adjusting a balance between a center sound source and a sound source other than the center sound source among the direct sounds in a front channel of the surround sound source; a rear balance adjustment step of generating a parameter for adjusting a balance between a center sound source and a sound source other than the center sound source among the indirect sounds in a rear channel of the surround sound source; a mixing amount adjustment step of generating a parameter for adjusting a mixing amount of the indirect sound with respect to the direct sound output from a front channel of the surround sound source; an inter-layer balance adjustment procedure for generating parameters for adjusting a balance between the direct sound and the indirect sound output from a middle layer channel in the surround sound source and the direct sound and the indirect sound output from upper and lower layer channels; a coefficient generation step of generating a coefficient by which the direct sound and the indirect sound are multiplied for each channel of the surround sound source based on the parameters; An audio signal processing program that causes a computer to execute a calculation procedure for upmixing the stereo sound source to the surround sound source by adjusting the direct sound and the indirect sound with the ROOM value and multiplying the direct sound and the indirect sound by the coefficient.

Images