Audio signal processing device, audio system, and audio signal processing method

Abstract

To provide an audio signal processing device capable of shortening a setting time related to setting data for each channel.SOLUTION: In an audio system that has a mixing device and an audio signal processing device, an audio signal processing device 3 that is connected comprises: an operation acceptance unit 37 that accepts from a user a selection operation for selecting a channel of the mixing device; an audio signal input unit 32 that receives an audio signal to the channel accepted by the operation acceptance unit; a sound source identification unit 361 that analyzes the audio signal received by the audio signal input unit 32 to identify the type of a sound source; a setting data acquisition unit 362 that acquires setting data according to the type of the sound source identified by the sound source identification unit 361; and a setting data setting unit 363 that makes the mixing device set the setting data acquired by the setting data acquisition unit 362 to the accepted channel.SELECTED DRAWING: Figure 3

Description

[Technical field]

[0001] An embodiment of the present invention relates to signal processing of audio signals. [Background technology]

[0002] Conventionally, there exists a tablet terminal on which a setting program for an audio signal processing device is executed, and a mixer to which the tablet terminal is connected (for example, Patent Document 1).

[0003] The mixer in Patent Document 1 receives mixing information for mixing processing suitable for the audio signal of a sound source such as an instrument selected by the user from a tablet terminal. When the user operates the tablet terminal, the instrument name (instrument icon) displayed on the tablet terminal is associated with a member (channel). The mixer assigns the mixing information of the instrument associated with the member. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2017-073631 A Summary of the Invention [Problem to be solved by the invention]

[0005] The program in Patent Document 1 is a program for novice mixer users. The program in Patent Document 1 does not accept channel selection from the user. In other words, the program in Patent Document 1 does not set mixing information (mixing data) such as names and signal processing parameters for each channel selected by the user.

[0006] SUMMARY OF THE PREFERRED EMBODIMENTS An object of one embodiment of the present invention is to shorten the time required for setting mixing data for each channel. [Means for solving the problem]

[0007] An audio signal processing device according to one embodiment of the present invention includes an operation receiving unit that receives a selection operation from a user to select a channel of a mixing device, an audio signal input unit that inputs an audio signal for the channel received by the operation receiving unit, a sound source identification unit that analyzes the audio signal input by the audio signal input unit and identifies the type of sound source, a setting data acquisition unit that acquires setting data corresponding to the type of sound source identified by the sound source identification unit, and a setting data setting unit that causes the mixing device to set the setting data acquired by the setting data acquisition unit to the received channel. Effect of the Invention

[0008] According to an embodiment of the present invention, it is possible to reduce the time required for setting mixing data for each channel. [Brief description of the drawings]

[0009] [Figure 1] FIG. 1 is a diagram showing the main configuration of an audio system. [Diagram 2] FIG. 2 is a block diagram showing the main configuration of a mixer. [Diagram 3] FIG. 2 is a block diagram showing the main configuration of a tablet. [Figure 4] FIG. 2 is an explanatory diagram illustrating an example of a screen of a display of a tablet. [Diagram 5] 11 is a flowchart showing an example of audio signal processing by a tablet. [Figure 6] FIG. 13 is an explanatory diagram showing a screen for selecting a plurality of mixing data in the first modified example. [Figure 7] 11 is a flowchart of audio signal processing when there are multiple pieces of mixing data. [Figure 8] FIG. 11 is an explanatory diagram showing an example of a screen displayed by a display device according to the second modified example. [Figure 9] FIG. 13 is an explanatory diagram showing a screen for selecting mixing data from a performer's name. [Figure 10] FIG. 13 is an explanatory diagram showing a screen for selecting mixing data from a user name. [Figure 11] FIG. 11 is a diagram showing the configuration of an audio system according to a second modified example. [Figure 12] FIG. 11 is an explanatory diagram showing an example of a screen including a DCA (Digital Controlled Amplifier) ​​function. [Figure 13] FIG. 11 is a diagram showing the configuration of an audio system according to a third modified example. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0010] Fig. 1 is a configuration diagram showing the main components of an audio system 100. As shown in Fig. 1, the audio system 100 includes a mixer (mixing device) 1 and a tablet terminal (hereinafter simply referred to as a tablet) 3. In this example, the tablet 3 is an example of an audio signal processing device of the present invention.

[0011] Fig. 2 is a block diagram showing the main components of the mixer 1. As shown in Fig. 2, the mixer 1 includes a display 11, an operation unit 12, an audio I / O (Input / Output) 13, a signal processing unit 14, a PC_I / O 15, a MIDI_I / O 16, an Other_I / O 17, a network I / F 18, a CPU 19, a flash memory 21, and a RAM 22.

[0012] The display 11, operation unit 12, audio I / O 13, signal processing unit 14, PC_I / O 15, MIDI_I / O 16, other_I / O 17, CPU 19, flash memory 21, and RAM 22 are connected to one another via a bus 25. In addition, the audio I / O 13 and signal processing unit 14 are also connected to a waveform bus 27 for transmitting audio signals.

[0013] The audio I / O 13 is an interface for accepting an audio signal to be processed by the signal processing unit 14. The audio I / O 13 is provided with an analog input port, a digital input port, or the like for accepting an audio signal from the sound source 2. The audio I / O 13 is also an interface for outputting the audio signal after being processed by the signal processing unit 14. The audio I / O 13 is provided with an analog output port, a digital output port, or the like for outputting the audio signal.

[0014] The PC_I / O 15, the MIDI_I / O 16, and the other_I / O 17 are interfaces for connecting various external devices and performing input and output. For example, a data processing device such as a personal computer is connected to the PC_I / O 15. For example, a MIDI-compatible device such as a physical controller or an electronic musical instrument is connected to the MIDI_I / O 16. For example, a display is connected to the other_I / O 17. Alternatively, a UI (User Interface) device such as a mouse or a keyboard is connected to the other_I / O 17. Any standard such as Ethernet (registered trademark) or USB (Universal Serial Bus) can be adopted as a standard used for communication with external devices. These connections may be wired or wireless.

[0015] The network I / F 18 communicates with the tablet 3 via the network. The network I / F 18 receives mixing data, which will be described later, from the tablet 3 via the network.

[0016] The CPU 19 is a control unit that controls the operation of the mixer 1. The CPU 19 performs various operations by reading out a predetermined program stored in a flash memory 21, which is a storage unit, into a RAM 22. Note that the program does not have to be stored in the flash memory 21 of the device itself. For example, the program may be downloaded each time from another device such as a server (not shown) and read into the RAM 22.

[0017] The display unit 11 displays various data under the control of the CPU 19. The display unit 11 is configured by, for example, an LCD or a light emitting diode (LED).

[0018] The operation unit 12 receives operations from a user on the mixer 1. The operation unit 12 is composed of various keys, buttons, a rotary encoder, a fader (slider), etc. The operation unit 12 is also composed of a touch panel laminated on the LCD which is the display device 11.

[0019] The signal processing unit 14 is composed of one or more DSPs (Digital Signal Processors) for performing various signal processing such as mixing, effects, etc. The signal processing unit 14 performs signal processing such as mixing, effects, etc. on the audio signal supplied from the audio I / O 13 via a waveform bus 27. The signal processing unit 14 outputs the processed digital audio signal again to the audio I / O 13 via the waveform bus 27.

[0020] The mixer 1 accepts operations from a user and performs appropriate signal processing on the input audio signal. The mixer 1 also receives mixing data for each channel from the tablet 3. The mixing data in this example corresponds to the setting data of the present invention.

[0021] The tablet 3 will be described with reference to the drawings. Fig. 3 is a block diagram showing the main configuration of the tablet 3. Fig. 4 is an example of a screen of the display 31 of the tablet 3.

[0022] 3, the tablet 3 includes a display 31, a microphone 32, a flash memory 33, a RAM 34, a network I / F 35, a CPU 36, and a touch panel 37. The display 31, the microphone 32, the flash memory 33, the RAM 34, the network I / F 35, the CPU 36, and the touch panel 37 are connected to one another via a bus 39. Note that the network I / F 35 in this example corresponds to the communication unit of the present invention. Also, the microphone 32 in this example is an example of the audio signal input unit of the present invention.

[0023] The network I / F 35 communicates with the mixer 1 via a network. The network I / F 35 transmits to the mixer 1, for example, mixing data suitable for an audio signal.

[0024] The display 31 displays various data under the control of the CPU 36. The display 31 is composed of, for example, an LCD. The screen shown in Fig. 4 is a screen for setting the send level of each input channel to a certain MIX bus. As shown in Fig. 4, the display 31 displays channel buttons 311, channel names 312, and faders 313 for each channel on the screen. The display 31 displays, for example, "MAIN GUITAR", "SUB GUITAR", etc. as the channel names. The display 31 also displays faders 313 corresponding to each channel name 312. The faders 313 indicate the send levels at which audio signals of each channel, such as "MAIN GUITAR", "SUB GUITAR", etc., are output to the MIX bus.

[0025] Touch panel 37 is layered on the LCD that is display device 31 to form a GUI (Graphical User Interface). Touch panel 37 accepts various operations from the user. For example, touch panel 37 accepts a channel selection operation when the user selects (presses) channel button 311. Note that touch panel 37 in this example is an example of an operation acceptance unit of the present invention.

[0026] The microphone 32 receives an audio signal from the sound source 2 .

[0027] The flash memory 33 stores various programs for implementing audio signal processing.

[0028] The flash memory 33 also stores types of sound sources and mixing data corresponding to the types of sound sources. The types of sound sources are, for example, instrument names (including vocals). In this example, the mixing data includes channel names or signal processing data required for processing audio signals. The signal processing data includes, for example, at least one of data indicating the type of effect used in each channel, gain of each channel, data indicating the destination of the audio signal of each channel, send level, and signal processing parameters such as effect parameters (delay).

[0029] Furthermore, the flash memory 33 stores in advance feature data indicating feature quantities (amplitude waveform, spectrum, cepstrum, etc.) related to the timbre of each instrument for each type (instrument name) of the instrument.

[0030] The CPU 36 reads the operating system and application programs stored in the flash memory 33 into the RAM 34, and performs overall control of the tablet 3. The programs read by the CPU 36 do not need to be stored in the flash memory 33 within the device itself. For example, the programs may be stored in a storage medium of an external device such as a server. In this case, the CPU 36 may read the programs from the server (not shown) into the RAM 34 each time and execute them.

[0031] The CPU 36 includes a sound source identification unit 361, a mixing data acquisition unit 362, and a mixing data setting unit 363. The CPU 36 executes an application program to read out programs relating to the sound source identification process, the mixing data acquisition process, and the mixing data setting process from the flash memory 33 to the RAM 22. In this way, the CPU 36 configures the sound source identification unit 361, the mixing data acquisition unit 362, and the mixing data setting unit 363. The mixing data acquisition unit 362 in this example is an example of the setting data acquisition unit of the present invention. Also, the mixing data setting unit 363 in this example is an example of the setting data setting unit.

[0032] The sound source identification unit 361 analyzes the audio signal input to the microphone 32 and identifies the type of the input sound source, for example, the name of an instrument such as an electric guitar, drums, or vocals. More specifically, when an audio signal is input, the sound source identification unit 361 performs an identification process such as waveform analysis and pattern matching of the audio signal. The identification process includes a process of analyzing the audio signal input to the tablet 3 and generating feature data. For example, the sound source identification unit 361 calculates a correlation value between the generated feature data and each of the multiple feature data in the flash memory 33. The sound source identification unit 361 determines the type of instrument that is higher than a predetermined threshold value among the multiple correlation values ​​as the type of instrument of the input audio data.

[0033] The mixing data acquisition unit 362 reads out mixing data corresponding to the type of sound source identified by the sound source identification unit 361 from the flash memory 33. In this example, mixing data (channel name, gain, destination, send level, etc.) for each type of sound source (instrument name) previously set by the user is stored in the flash memory 33. For example, if the type of sound source identified by the sound source identification unit 361 is an electric guitar, the mixing data acquisition unit 362 reads out and acquires the channel name (for example, MAIN GUITAR) corresponding to the electric guitar from the flash memory 33. The mixing data acquisition unit 362 also acquires data such as the gain, destination, and send level corresponding to the electric guitar.

[0034] The mixing data setting unit 363 associates the mixing data acquired by the mixing data acquisition unit 362 with the channel accepted by the touch panel unit (selected by the user). For example, the mixing data setting unit 363 associates the channel name of MAIN GUITAR with channel 1. The mixing data setting unit 363 also associates data such as gain, destination, and send level with channel 1. After that, the mixing data setting unit 363 transmits the mixing data associated with channel 1 (data indicating the channel name, data indicating the gain, data indicating the destination and send level, etc.) to the mixer 1 via the network I / F 35. As a result, the mixing data setting unit 363 causes the mixer 1 to set the acquired mixing data (e.g., channel name, gain, destination, and send level, etc.) to the channel accepted by the touch panel 37 (e.g., channel 1).

[0035] Here, the audio signal processing by the tablet 3 will be described with reference to Fig. 5. Fig. 5 is a flowchart showing an example of the audio signal processing by the tablet 3.

[0036] When the tablet 3 receives a channel selection operation (channel 1) from the user via the touch panel 37 (S11: Yes), it inputs an audio signal from the microphone 32 (S12). The user or performer plays an instrument corresponding to channel 1. The microphone 32 inputs the performance sound. The tablet 3 identifies the type of sound source (instrument name) of the input audio signal by the sound source identification unit 361. In other words, the tablet 3 analyzes the waveform of the audio signal and determines the instrument name from the analysis result (S13).

[0037] The tablet 3 obtains mixing data (data such as channel name, gain, destination, and send level) corresponding to the instrument name of the input audio signal from the flash memory 33 (S14). The tablet 3 associates the mixing data obtained from the flash memory 33 with the channel selected by the user (S15). The tablet 3 displays the channel name 312 corresponding to the channel selected by the user on the display 31, and changes the position of the fader 313 according to the send level to the MIX bus (S16) (see FIG. 4). The tablet 3 transmits the mixing data associated with the channel selected by the user to the mixer 1 (S17).

[0038] The above-mentioned process is an example, and is not limited thereto. The tablet 3 may switch the processes of S16 and S17. Furthermore, the tablet 3 is not limited to the example in which an audio signal is input via the microphone 32. The tablet 3 may, for example, directly input an audio signal from a musical instrument via an audio signal I / F (not shown).

[0039] Conventionally, a user would set mixing data such as a channel name for each channel (e.g., channel 1, channel 2) beforehand, for example, before a rehearsal. In this case, the user would listen to the sound corresponding to each channel, identify the instrument, and set the channel name corresponding to the identified instrument. However, manually inputting mixing data such as a channel name for each channel before each rehearsal is time-consuming and cumbersome.

[0040] In contrast, in the tablet 3 of this embodiment, once the user has associated the instrument name with the mixing data and stored it in memory, the user can then simply input sound from the sound source to have the mixer 1 automatically set the mixing data for the channel selected by the user. This eliminates the need for the user to manually set the mixing data for the tablet 3, thereby shortening the time required to set the mixing data for each channel.

[0041] [Variation 1] The tablet 3A of the first modified example will be described with reference to Fig. 6 and Fig. 7. Fig. 6 is an explanatory diagram showing a screen for selecting a plurality of mixing data. Fig. 7 is a flowchart of audio signal processing when there are a plurality of mixing data. Note that the same components as those of the tablet 3 of the above-mentioned embodiment are given the same reference numerals and description thereof will be omitted.

[0042] When the mixing data acquisition unit 362 acquires a plurality of mixing data corresponding to the type (instrument name) of the musical instrument, the mixing data setting unit 363 sets the mixing data selected by the user for the mixer 1.

[0043] More specifically, when the mixing data acquisition unit 362 acquires a plurality of mixing data corresponding to the type (instrument name) of the instrument, the mixing data setting unit 363 displays a plurality of options (candidates of mixing data) (hereinafter, referred to as a candidate list 314) on the display 31. The user selects the desired mixing data from the displayed candidate list 314.

[0044] In this example, it is assumed that a user has previously set two different channel names (MAIN GUITAR and SUB GUITAR) for one instrument name (e.g., electric guitar) and signal processing data corresponding to each of these channel names. In this case, for one instrument name of electric guitar, the channel names MAIN GUITAR and SUB GUITAR and the corresponding signal processing data are stored in the flash memory 33.

[0045] 6, for example, the display 31 displays a candidate list 314 of channel names below the fader 313. In this case, when the user presses either MAIN GUITAR or SUB GUITAR displayed on the display 31, the mixing data setting unit 363 causes only the channel name pressed by the user to be displayed on the display 31. The mixing data setting unit 363 causes the mixer 1 to set the mixing data of the channel name pressed (selected) by the user to the channel selected by the user.

[0046] The audio signal processing when there are multiple pieces of mixing data corresponding to the instrument name will be described with reference to FIG.

[0047] When the tablet 3 receives a channel selection operation and an audio signal is input (S11: Yes, S12: Yes), it identifies the type of sound source of the audio signal (instrument name) (S13). When the tablet 3 obtains a plurality of mixing data corresponding to the identified instrument name (S21), it displays a candidate list 314 showing a plurality of channel names corresponding to the instrument name on the screen (S22). When the tablet 3 receives a channel name selection operation from the user (S23: Yes), it determines the channel name selected by the user as the channel name of the channel selected by the user (e.g., channel 1) (S24). The tablet 3 displays the channel name 312 corresponding to the channel selected by the user on the display 31, and changes the position of the fader 313 according to the send level (S16). The tablet 3 transmits the mixing data selected by the user to the mixer 1 (S17).

[0048] In this way, when the tablet 3 of the first modification acquires multiple mixing data for one type of musical instrument, the tablet 3 determines the mixing data selected by the user from the multiple mixing data. This allows the tablet 3 to set the mixing data that is more suitable for the type of musical instrument to the channel.

[0049] In the above example, a plurality of mixing data (candidates for channel names) exists for an electric guitar, but the present invention is not limited to this.

[0050] [Variation 2] In the second modification, an example of setting mixing data from the type of musical instrument (instrument name) and performer data (performer name) will be described with reference to Fig. 8 and Fig. 9. Note that the same components as those of the tablet 3 in the above embodiment are given the same reference numerals and the description thereof will be omitted.

[0051] Fig. 8 is an explanatory diagram showing an example of a screen displayed by the display 31 in the modified example 2. Fig. 9 is an explanatory diagram showing a screen for selecting mixing data based on the performer name.

[0052] In this example, in addition to previously identified instrument names, a performer name previously input by the user (e.g., JOHN) is associated with mixing data and stored in the flash memory 33. The tablet 3 sets mixing data (e.g., channel name (MAIN_VOCAL JOHN), gain, destination, send level, etc.) corresponding to the combination of the identified instrument name and the performer name whose input has been accepted.

[0053] The sound source identification unit 361 identifies the instrument name (VOCAL) of the audio signal input to the microphone 32. The user inputs a desired performer name (JOHN in this example) in the input field 315 displayed on the screen shown in FIG. 8. The touch panel 37 accepts the performer name input by the user in the input field 315. The mixing data acquisition unit 362 reads out mixing data corresponding to the combination of the identified instrument name and the accepted performer name from the flash memory 33. The display unit 31 may temporarily display the instrument name in the channel name 312 until the performer name is determined by the user's operation.

[0054] When the mixing data is acquired, the display unit 31 displays the channel name on the screen in the channel name 312. In this case, the channel name is a name previously set by the user, such as "MAIN_VOCAL JOHN" which combines the instrument name (VOCAL) and the performer name (for example, JOHN).

[0055] Even if the type of instrument is the same, the mixing data differs depending on the performer playing the instrument. In this example, the tablet 3, when the user inputs (selects) the performer name, obtains not only the instrument name of the input audio signal but also mixing data corresponding to the combination of the instrument name and the performer name selected by the user. By obtaining mixing data corresponding to the combination of the instrument name and performer name, the tablet 3 further improves the accuracy of the channel name and parameters to be used.

[0056] The display 31 may also display one or more performer names previously input by the user as a performer name list 316. Each of the input performer names is associated with individual mixing data. In this case, for example, after the sound source identification unit 361 identifies the instrument name of the input audio signal, the mixing data acquisition unit 362 reads out from the flash memory 33 a performer name corresponding to the instrument name and multiple mixing data corresponding to the combination of the instrument name and the performer name.

[0057] When there are multiple pieces of mixing data corresponding to the combination of the read instrument name and performer name, the mixing data setting unit 363 causes the display unit 31 to display a performer name list 316 of performer names so that the user can select desired mixing data by selecting a performer name. The user selects a desired performer name from the performer name list 316. The mixing data setting unit 363 determines mixing data corresponding to the combination of the performer name and instrument name selected by the user. The mixing data setting unit 363 causes the mixer 1 to set the determined mixing data to the channel selected by the user. Note that the display unit 31 may temporarily display the instrument name in the channel name 312 after the instrument name is identified and until the performer name is selected by the user.

[0058] This makes it possible for the tablet 3 to prevent input errors by the user and to reduce the time required for setting.

[0059] FIG. 10 is an explanatory diagram showing a screen for selecting mixing data based on a user name.

[0060] The tablet 3 may cause the mixer 1 to set mixing data using a user name instead of a performer name. In this case, the display 31 displays a user name input field (not shown) where the user inputs a user name, as in the case of the performer name. The display 31 may also display, for example, a user name list 316A of user names under a channel name 312, as shown in FIG. 10. The touch panel 37 accepts a user name input or selected by the user. The mixing data setting unit 363 acquires or determines mixing data corresponding to a combination of the accepted user name and instrument name. The mixing data setting unit 363 causes the display 31 to display the acquired or determined channel name in the channel name 312. The mixing data setting unit 363 causes the mixer 1 to set the acquired or determined mixing data to the channel selected by the user. The display 31 may temporarily display the instrument name after the instrument name is identified until the user selects a user name.

[0061] Even if the type of instrument is the same, the mixing data differs depending on the user who uses the mixer 1. In this example, when the user inputs (selects) a user name, the tablet 3 obtains not only the instrument name of the input audio signal but also mixing data corresponding to the combination of the instrument name and the user name selected by the user. By obtaining mixing data corresponding to the combination of the instrument name and the user name, the tablet 3 further improves the accuracy of the channel name and parameters to be used.

[0062] The tablet 3 of the second modified example may be configured so that the user inputs (selects) the performance location or the tablet data used by the user in addition to the performer data and user data. In this case, the performance location previously input by the user is associated with the mixing data and stored in the flash memory 33. The mixing data acquisition unit 362 acquires the mixing data corresponding to the combination of the performance location and the instrument name or the mixing data corresponding to the combination of the tablet data and the instrument name.

[0063] Also, the tablet data and mixing data previously input by the user are associated with each other and stored in the flash memory 33. In this case, the mixing data acquisition unit 362 acquires mixing data corresponding to a combination of the tablet data and the instrument name.

[0064] Moreover, the performer data and user data are not limited to names, and may be face photos, etc. In this case, the performer or user takes a face photo, for example, using the camera function, which is one of the functions of the tablet 3. The tablet 3 sets the face photo and mixing data in the mixer 1. After this setting, if the user takes a face photo of the performer or user using the tablet 3 and the taken face photo matches the face photo when the mixing data was previously set, the tablet 3 causes the mixer 1 to set the mixing data corresponding to the combination of the instrument name and face photo to the channel selected by the user.

[0065] [Variation 3] The tablet 3 of the modified example 3 will be described. The tablet 3 of the modified example 3 selects appropriate mixing data by a predetermined algorithm (AI: Artificial Intelligence) such as a neural network. The tablet 3 also has a learning function for constructing the algorithm.

[0066] The tablet 3 automatically selects (generates) mixing data based on the past history or settings input in advance by the user.

[0067] The tablet 3 is divided into a learning stage, in which a model for selecting mixing data is trained, and a utilization stage, in which mixing data is selected using the model obtained from the learning stage (trained model), and operates according to each of the learning stage and utilization stage.

[0068] An example using the learning stage and the utilization stage will now be described.

[0069] A case will be described where the tablet 3 selects mixing data based on the type of musical instrument identified by the sound source identification unit 361. In the learning stage, the tablet 3 uses the type of musical instrument as an element of input data. The tablet 3 also uses mixing data (channel name, gain, destination, send level, etc.) as an element of output data. The tablet 3 uses data that is a combination of these input data and output data as teacher data to learn a model that selects mixing data.

[0070] In the stage of using the trained model, the mixing data acquisition unit 362 acquires mixing data from the output data of the trained model by using the type of musical instrument identified by the sound source identification unit 361 as input data for the trained model. The mixing data setting unit 363 transmits the acquired mixing data to the mixer 1.

[0071] The model used for learning may be weighted according to the setting frequency, for example. The tablet 3 counts the setting frequency of a certain mixing data for a certain musical instrument type, and outputs the mixing data with a high setting frequency.

[0072] In addition, a support vector machine or a neural network can also be applied to the model. A deep neural network (DNN) can also be used as the neural network. The tablet 3 may use a convolutional neural network (CNN) or a recurrent neural network (RNN) as the DNN. The tablet 3 may also use a long-short term model (LSTM) as the RNN. When the tablet 3 uses a CNN, it can handle image data as the instrument type data to be input to the model. This allows the tablet 3 to handle, for example, handwritten characters of a user, an icon of an instrument, or an image such as a photograph as input data. When the tablet 3 uses an RNN, it can handle the instrument name or an explanatory text about the instrument as the instrument type data to be input to the model. This allows the tablet 3 to save the effort of changing the instrument name to label data in order to apply it to the model. The tablet 3 can also select mixing data for an instrument whose name is unknown to the user.

[0073] The flash memory 33 stores mixing data (channel name, gain, destination, send level, etc.) for each type of sound source (instrument name) previously set by the user. The tablet 3 uses, for example, the types of sound sources (instrument names) previously set by the user as elements of input data, and the mixing data as elements of output data. By using such input data and output data, the generated model learns the correspondence (regularity) between instrument names and mixing data, taking into account the tendency or habit of the user of the tablet 3 in setting mixing data previously set.

[0074] Generally, for example, each performer in a band often listens to the bass sound with emphasis. In this case, the user sets the send level from the input channel where the bass sound is input to each destination (each output channel that is the sound source listened to by each performer) to a high level. In the learning stage, the input data is the sound source type of the band performance, and the output data is the send level that the user used in the past for mixing settings for the band performance. In the usage stage, the learned model selects mixing data that sets the send level to a high level. In other words, if the type of instrument identified is bass, the tablet 3 selects mixing data that sets the send level to a high level.

[0075] Also, for example, in the learning stage, the tablet 3 inputs a plurality of conditions such as the performer's name, user name, and performance location as input data. The tablet 3 selects mixing data from these multiple conditions and outputs it as output data. In this case, the trained model depends on a plurality of conditions such as the performer's name, user name, and performer. For example, when the performer's name is input as input data in the learning stage, the mixing data acquisition unit 362 acquires mixing data that takes into account the performer's habits in the effector setting of the input channel to which the performer's performance sound is input in the use stage. Also, the mixing data acquisition unit 362 acquires mixing data desired by the performer for the output channel that the performer listens to. Also, for example, when the user's name is input as input data in the learning stage, the mixing data acquisition unit 362 acquires mixing data that the user, the mixing engineer, usually performs in the use stage. Also, for example, when a performance location is input as input data in the learning stage, the mixing data acquisition unit 362 acquires mixing data that reproduces a sound field specialized for that performance location in the utilization stage. For example, if the performance location is prone to feedback or swell in a specific frequency band, the mixing data acquisition unit 362 acquires mixing data including an equalizer setting that reduces the gain for that frequency band.

[0076] Also, the tablet 3 may select mixing data based on the feature amount of the sound. In this case, in the learning stage, the tablet 3 uses the sound input to the channel as an element of the input data. Also, the tablet 3 uses the mixing data (channel name, gain, destination, send level, etc.) as an element of the output data. In this way, the tablet 3 learns a model for selecting mixing data. In the utilization stage of the learned model, the mixing data acquisition unit 362 uses the sound input to the channel as input data of the learned model, and acquires mixing data from the output data of the learned model. By using such a learned model, for example, the tablet 3 can analyze the feature amount of the sound of an electric guitar and select the most suitable mixing data from among multiple mixing data corresponding to the electric guitar.

[0077] When a large amount of mixing data is stored in the database, it becomes difficult for the user to select mixing data suitable for the type of sound source from among the many mixing data. Therefore, the tablet 3 automatically selects mixing data corresponding to the identified type of sound source using AI. This eliminates the user's need to choose mixing data suitable for the type of sound source, and the tablet 3 can reduce the time required for setting the mixing data.

[0078] [Variation 4] An audio system 100A according to the fourth modification will be described with reference to Figs. 11 and 12. Fig. 11 is a diagram showing the configuration of the audio system 100A according to the fourth modification. Fig. 12 is an explanatory diagram showing an example of a screen including a DCA (Digital Controlled Amplifier) ​​function. Note that the same components as those of the tablet 3 according to the above embodiment are given the same reference numerals and will not be described.

[0079] DCA is a function that adjusts the parameters of multiple channels (e.g. send level) collectively with one fader while maintaining the balance of the levels of the multiple channels. In this example, DCA1 is used to collectively control the send levels of channels 1, 2, and 3.

[0080] Here, as shown in Fig. 12, an example will be described in which the send levels of multiple instruments (bass drum, snare drum, and hi-hat) that make up a drum set are collectively controlled by the fader of DCA1. In this example, the mixing data includes group definition data for defining groups consisting of multiple channels. The group definition data is data that indicates which DCA each channel belongs to.

[0081] In this example, it is assumed that the user has previously set the send levels of the bass drum, snare drum, and hi-hat to be collectively controlled by DCA1 on the tablet 3. At this time, the tablet 3 stores in the flash memory 33 group definition data that indicates that the bass drum, snare drum, and hi-hat belonged to DCA1 as part of the mixing data for each of the bass drum, snare drum, and hi-hat.

[0082] The mixing data acquisition unit 362 reads out the group definition data of the instrument (bass drum) of the sound source 2-1 included in the mixing data from the flash memory 33. The mixing data setting unit 363 transmits the mixing data including the data of the channel (channel 1 in this example) selected by the user and the group definition data to the mixer 1. The mixer 1 sets DCA1 so that channel 1 (bass drum) belongs to DCA1 (DRUMS) according to the group definition data.

[0083] Also, similarly to the above, when the sound source identification unit 361 identifies the instrument (snare drum) of the sound source 2-2, the mixing data acquisition unit 362 reads out mixing data including group data indicating that it belongs to DCA1. The mixing data setting unit 363 transmits mixing data including the channel selected by the user (channel 2 in this case) and group definition data to the mixer 1. The mixer 1 sets DCA1 so that channel 2 (snare drum) belongs to DCA1 (DRUMS) according to the group definition data.

[0084] Furthermore, when the sound source identification unit 361 identifies the instrument (hi-hat) of sound source 2-3, the mixing data acquisition unit 362 reads out mixing data including group data indicating that it belongs to DCA 1. The mixing data setting unit 363 transmits mixing data including the channel selected by the user (channel 3 in this case) and group definition data to the mixer 1. The mixer 1 sets DCA 1 so that channel 3 (hi-hat) belongs to DCA 1 (DRUMS) according to the group definition data.

[0085] According to the group definition data transmitted from the tablet 3, the mixer 1 sets channel 1 (bass drum), channel 2 (snare drum) and channel 3 (hi-hat) to DCA1.

[0086] In this way, in the fourth modification, the tablet 3 transmits group definition data indicating that multiple channels belong to a DCA to the mixer 1, and the mixer 1 automatically sets the DCA. In other words, the user does not need to set a new DCA for a channel that was previously set to a DCA. This saves the user the trouble of setting the DCA, allowing the user to work efficiently.

[0087] In addition, in the case of using the tablet 3 described in the modified example 3 in the modified example 4, in this example, in the learning stage, the channel name of the channel is used as an element of the input data. The tablet 3 determines whether or not the corresponding input data (channel name) belongs to a DCA from the output data. Furthermore, when the corresponding input data belongs to a DCA from the output data, the tablet 3 learns the number of the DCA. In the usage stage, the tablet 3 obtains mixing data from the output data of the trained model. In this example, the model can be applied in the same manner as described in the modified example 3.

[0088] Group definition data may be set in advance (before the user uses the tablet 3). For example, mixing data indicating that the bass drum, snare drum, and hi-hat instruments are associated with DCA1 may be stored in advance in the flash memory 33. In this case, when the user uses the tablet 3 for the first time, the instruments related to the drums are set to the same DCA.

[0089] [Variation 5] An audio system 100B according to the fifth modification will be described with reference to Fig. 13. Fig. 13 is a configuration diagram showing an example in which a tablet 3 is connected to a server 4 via a network 5.

[0090] The network I / F 35 transmits and receives various data to and from the server 4 via the network 5 .

[0091] In this example, the server 4 communicates with multiple devices (such as a personal computer, a mixer, and a tablet). The server 4 receives data indicating the type of musical instrument (instrument name) and mixing data associated with the musical instrument name from the multiple devices. The server 4 accumulates the musical instrument name and the mixing data associated with the musical instrument name in a database. The database may be provided in the server 4, or may be configured in an external memory connected to the server 4.

[0092] The server 4 is also provided with a learning function. The server 4 learns regularities from a database showing the correspondence between the names of a plurality of accumulated musical instruments and mixing data by machine learning or deep learning, and selects suitable mixing data based on a predetermined algorithm constructed by the regularities. The method of training a model for selecting mixing data (learning stage) and the method of generating mixing data using the model (use stage) are omitted because they are similar to the operation of the tablet 3 of the modified example 3. However, the tablet 3 of the modified example 3 mainly uses mixing data previously set in the tablet 3 as teacher data. In contrast, the server 4 is different in that it uses mixing data set in a plurality of devices connected to the server 4 as teacher data. The server 4 generates a learning model from a huge amount of teacher data, so it is possible to generate a model with higher accuracy and robustness than the tablet 3 of the modified example 3.

[0093] For example, when the server 4 receives data indicating the name of an instrument from the tablet 3, it searches the database for mixing data corresponding to the instrument name. As an example of the algorithm, for example, the mixing data most frequently used in the past month is detected. Then, the server 4 transmits the mixing data corresponding to the instrument name to the tablet 3 that transmitted the instrument name.

[0094] Since the database stores a large amount of mixing data from many devices, the accuracy of the detection algorithm is dramatically improved compared to the case where suitable mixing data is selected from mixing data stored in each tablet 3. Also, in this example, the tablet 3 can accurately detect mixing data from the server 4 even in a state where the use (setting) history of mixing data is not stored in the tablet 3 itself. In this way, the tablet 3 can obtain more suitable mixing data by being connected to the server 4.

[0095] The server 4 is not limited to accumulating mixing data associated with instrument names by instrument name. The server 4 may receive an audio signal from the tablet 3 and detect suitable mixing data from a database based on the feature of the received audio signal. In this case, the server 4 extracts the feature of the received audio signal and detects mixing data corresponding to the approximate feature.

[0096] Furthermore, the server 4 may receive a channel name obtained by using the type of sound source (instrument name) identified by the tablet 3, and detect mixing data from the channel name in a database.

[0097] The description of the present embodiment should be considered to be illustrative in all respects and not restrictive. The scope of the present invention is indicated by the claims, not by the above-described embodiments. Furthermore, the scope of the present invention is intended to include all modifications within the meaning and scope of the claims. [Explanation of symbols]

[0098] 1...Mixer (mixing device) 3...Tablet (audio signal processing device) 4. Server 31...Indicator 32...Microphone (audio signal input) 35...Network I / F (communication section) 37…Touch panel (operation reception section) 361…Sound source identification unit 362…Mixing data acquisition section 363…Mixing data setting section

Claims

1. a display for displaying, for each channel, a channel number of a mixing device having a plurality of channels, a level setting operator for receiving a level setting operation for each of the plurality of channels, and a channel selection operator for receiving a selection operation for at least one of the plurality of channels, in association with each channel; an operation receiving unit that receives, via the channel selection operator, a selection operation for selecting at least one channel of the mixing apparatus from a user; a microphone for inputting an audio signal corresponding to the channel accepted by the operation acceptance unit; a sound source identification unit that analyzes the audio signal input by the microphone and identifies a type of a sound source of the audio signal corresponding to the channel accepted by the operation acceptance unit; a setting data acquisition unit that acquires setting data corresponding to the type of the sound source identified by the sound source identification unit; a setting data setting unit that causes the mixing device to set the setting data acquired by the setting data acquisition unit to the accepted channel; and an audio signal processing device connected to the mixing device as an external device.

2. a communication unit that communicates with a server that detects setting data corresponding to the type of the sound source; The communication unit receives setting data corresponding to the type of the sound source transmitted to the server from the server. The audio signal processing apparatus according to claim 1 .

3. the operation reception unit receives, when there are a plurality of the setting data, a selection operation from the user to select a desired setting data from the plurality of the setting data; The setting data setting unit sets the desired setting data accepted by the operation accepting unit to the accepted channel.

3. An audio signal processing apparatus according to claim 1 or 2.

4. The setting data setting unit associates the setting data with the received channel.

4. An audio signal processing apparatus according to claim 1.

5. The display unit displays the type of the sound source identified by the sound source identification unit in association with the channel.

5. An audio signal processing apparatus according to claim 1.

6. The type of the sound source includes a musical instrument name.

6. An audio signal processing apparatus according to claim 1.

7. The type of the sound source includes vocals.

7. An audio signal processing apparatus according to claim 1.

8. The setting data includes group definition data for defining a group consisting of a plurality of channels.

8. An audio signal processing apparatus according to claim 1.

9. the operation receiving unit receives a selection operation for selecting performer data from a user; The setting data acquisition unit acquires setting data corresponding to the performer data and the type of the sound source.

9. An audio signal processing apparatus according to claim 1.

10. the operation reception unit receives a selection operation for selecting user data from a user; The setting data acquisition unit acquires setting data corresponding to the user data and the type of the sound source.

10. An audio signal processing apparatus according to claim 1.

11. An audio signal processing device according to any one of claims 1 to 10, the mixing device for setting setting data for each channel; With the audio signal processing device is a general-purpose data processing device, the audio signal processing device causes the mixing device to set the setting data for the channel for which the selection operation has been accepted; the mixing device processes the audio signal of the channel selected by the selection operation in accordance with the setting data set by the audio signal processing device; Audio system.

12. an audio signal processing device is connected as an external device to a mixing device having a plurality of channels, and a display unit of the audio signal processing device displays, for each channel, a number of each channel of the mixing device, a level setting operator for receiving a level setting operation for each of the plurality of channels, and a channel selection operator for receiving a selection operation for at least one of the plurality of channels, in correspondence with each channel; receiving, from a user, a selection operation for selecting at least one channel of the mixing device via the channel selection operator in the audio signal processing device; An audio signal corresponding to the channel is inputted by a microphone of the audio signal processing device; In the audio signal processing device, the audio signal input by the microphone is analyzed to identify a type of a sound source of the audio signal corresponding to the received channel; In the audio signal processing device, setting data corresponding to a type of the sound source is acquired; causing the mixing device to set the setting data for the channel; A method for processing an audio signal.

13. Communicating with a server that detects setting data corresponding to the type of the sound source; receiving setting data corresponding to the type of the sound source transmitted to the server from the server; 13. A method for processing an audio signal according to claim 12.

14. When there are a plurality of the setting data, a selection operation is received from the user to select a desired setting data from the plurality of the setting data; setting the desired setting data to the channel; 14. A method for processing an audio signal according to claim 12 or 13.

15. Associating the setting data with the channel; 15. A method for processing an audio signal according to any one of claims 12 to 14.

16. Displaying the type of the sound source in association with the channel.

16. A method for processing an audio signal according to any one of claims 12 to 15.

17. The type of the sound source includes an instrument name and a vocal.

17. A method for processing an audio signal according to any one of claims 12 to 16.

18. The setting data includes group definition data for defining a group consisting of a plurality of channels. A method for processing an audio signal according to any one of claims 12 to 17.

19. Accepting a selection operation from a user to select performer data; When the performer data is selected, acquiring setting data corresponding to the performer data and the type of the sound source. A method for processing an audio signal according to any one of claims 12 to 18.

20. Accepting a selection operation from a user to select user data; When the user data is selected, acquiring setting data corresponding to the user data and the type of the sound source.

20. A method for processing an audio signal according to any one of claims 12 to 19.

Images