Sound source system, method, and program
By performing clock phase alignment and data transmission of multiple sound source cores in the sound source system, the problem of increasing the circuit scale of the sound source system in the prior art is solved, and DSP resource sharing between multiple sound source cores is realized. Musical sound data processing reduces system costs.
Patent Information
- Application Number
- CN202380029031.7
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Priority Date
- 2022-03-23
- Filing Date
- 2023-02-20
- Publication Date
- 2024-11-12
AI Technical Summary
The existing sound source system cannot effectively share DSP resources between multiple sound source cores, resulting in an increase in the circuit scale and the inability to input the signal of one sound source core to another for further processing.
The phase control unit aligns the clock phases between the plurality of sound source cores, and uses the connection control unit to transmit the musical sound data of the aligned clock phases between the plurality of sound source cores to realize the sharing of DSP resources.
Without increasing the circuit scale, DSP resource sharing between multiple sound source cores is realized, which reduces system costs and simplifies sound source core management.
Smart Images

Figure CN118946926A_ABST
Abstract
Description
Technical Field
[0001] The disclosure of this specification relates to a sound source system, method, and program. Background Art
[0002] A sound source system having a plurality of sound source cores is known. For example, Patent Document 1 describes a specific structure of such a sound source system.
[0003] The sound source system described in Patent Document 1 uses a mixer to mix digital musical sound data output from a plurality of sound source cores, performs effect processing on the mixed digital musical sound data, adds the effect-processed digital musical sound data, converts it into an analog signal, and outputs it.
[0004] Prior art literature
[0005] Patent Literature
[0006] Patent Document 1: Japanese Patent Application Laid-Open No. 7-129161 Summary of the invention
[0007] Problem that the invention aims to solve
[0008] Thus, the sound source system described in Patent Document 1 is a structure in which the circuit at the rear stage of the sound source core performs effect processing on the digital musical sound data output from a plurality of sound source cores connected in parallel. However, in this structure, for example, a structure in which the signal of one sound source core is input to another sound source core and the DSP (Digital Signal Processor) resource of the other sound source core is used to further process the sound cannot be adopted. In addition, if the DSP resources of a plurality of sound source cores can be shared between the sound source cores, there is a concern that the circuit scale of the sound source system will increase.
[0009] The present invention has been made in view of the above circumstances, and an object of the present invention is to provide a sound source system, method, and program capable of sharing DSP resources among a plurality of sound source cores without increasing the circuit scale.
[0010] Means used to solve problems
[0011] A sound source system according to one embodiment of the present invention comprises: a plurality of sound source cores for processing musical sound data; a phase control unit for aligning the phase of a clock that specifies the input and output timing of the musical sound data for the sound source cores among the plurality of sound source cores; and a connection control unit for controlling the connection between the plurality of sound source cores so as to transmit the musical sound data with the phase of the clock aligned among the plurality of sound source cores.
[0012] Effects of the Invention
[0013] According to one embodiment of the present invention, there is provided a sound source system, method, and program capable of sharing DSP resources among a plurality of sound source cores without increasing the circuit scale. BRIEF DESCRIPTION OF THE DRAWINGS
[0014] Figure 1 This is a block diagram showing the configuration of a sound source system according to one embodiment of the present invention.
[0015] Figure 2 This is a block diagram showing the structure of a sound source core included in the sound source system according to one embodiment of the present invention.
[0016] Figure 3 This is a block diagram showing the structure of a reset pulse input / output circuit included in a sound source core according to an embodiment of the present invention.
[0017] Figure 4 It means I 2 Figure 1.1 shows the timing diagram of Inter-IC Sound Interface (IC Sound Interface) data.
[0018] Figure 5 This is a block diagram showing the configuration of a switch matrix circuit included in a sound source system according to an embodiment of the present invention.
[0019] Figure 6 It is a diagram showing an example of effect processing by the DSP included in the sound source system according to one embodiment of the present invention.
[0020] Fig. 7A It is an embodiment of the present invention that I 2 This diagram shows the latency when digital musical sound data is transmitted in the S format.
[0021] Figure 7B This is a diagram showing delay when digital musical sound data is transmitted via a shared memory in one embodiment of the present invention.
[0022] Figure 8 It is a diagram showing an example of effect processing by the DSP included in the sound source system according to the first modification of the present invention.
[0023] Fig. 9A This is a block diagram showing a configuration for performing synchronous control of an action counter according to a second modification of the present invention.
[0024] Fig. 9B This is a block diagram showing a configuration for performing synchronous control of an action counter according to a second modification of the present invention.
[0025] Fig.10 It is a block diagram showing the structure of a sound source system according to Modification 3 of the present invention. DETAILED DESCRIPTION
[0026] A sound source system, a method, and a program according to an embodiment of the present invention will be described in detail with reference to the accompanying drawings.
[0027] Figure 1 This is a block diagram showing the structure of a sound source system 1 according to an embodiment of the present invention. The sound source system 1 is composed of, for example, LSI (Large Scale Integration) and is built into an electronic musical instrument such as an electronic keyboard. The sound source system 1 is not limited to electronic musical instruments, but may also be built into a smartphone, PC (Personal Computer), tablet terminal, portable game console, feature phone, PDA (Personal Digital Assistant), etc.
[0028] like Figure 1 As shown, the sound source system 1 includes a CPU (Central Processing Unit) 10, a RAM (Random Access Memory) 11, a ROM (Read Only Memory) 12, a GPIO (General Purpose Input / Output) 13, a MEMIF (Memory Interface) 14, and a core unit 15. The various components of the sound source system 1 are connected via a bus 16. The various components of the sound source system 1 operate by a basic operation clock supplied by a clock generator (not shown).
[0029] The CPU 10 reads out the program and data stored in the ROM 12, and controls the entire sound source system 1 by using the RAM 11 as a work area. That is, the sound source system 1 is operated by the CPU 10 executing the program.
[0030] The CPU 10 is, for example, a single processor or a multiprocessor, and includes at least one processor. In the case of a structure including a plurality of processors, the CPU 10 may be packaged as a single device, or may be composed of a plurality of physically separated devices within the sound source system 1 .
[0031] RAM 11 is, for example, an SRAM (Static Random Access Memory), which operates at a higher speed than a DRAM (Dynamic Random Access Memory) 2 described later. Therefore, RAM 11 temporarily holds data and programs in processing that require high-speed operation. RAM 11 holds programs and data read from ROM 12 and data required for communication.
[0032] In addition, as described later, the RAM 11 operates as a shared memory shared among a plurality of sound source cores.
[0033] The ROM 12 is a nonvolatile semiconductor memory such as a flash memory, an EPROM (Erasable Programmable ROM), or an EEPROM (Electrically Erasable Programmable ROM), and stores programs and data used by the CPU 10 to perform various processes.
[0034] In addition, the ROM 12 stores waveform data for each key number for each tone (guitar, bass, piano, etc.), for example.
[0035] GPIO 13 is a general-purpose port installed in the sound source system 1 as an LSI. For example, a MIDI (Musical Instrument Digital Interface) device not shown is connected to GPIO 13. In this case, MIDI data (an example of SMF (Standard MIDI File) data) conforming to the MIDI standard is input from the MIDI device via GPIO 13.
[0036] MEMIF14 is an interface connected to an external DRAM2, for example. Compared with SRAM, the reading and writing of data in DRAM2 is generally slow but the capacity is large. Therefore, data that does not require high-speed processing or data with large capacity, such as SMF data, is stored in DRAM2. In this case, SMF data is input from DRAM2 via MEMIF14.
[0037] The music data input via the GPIO 13 or the MEMIF 14 is not limited to the SMF data, and may be music data conforming to other standards.
[0038] The core unit 15 includes two sound source cores 15CM and 15CS and a switch matrix circuit 15SW. In this embodiment, the circuits of the sound source cores 15CM and 15CS are identical in structure. In addition, when the sound source cores 15CM and 15CS are generally described, they are each described as "sound source core 15C".
[0039] The core unit 15 converts the digital musical sound data generated by each sound source core 15C into 2 The S format is output to the sound system 3 via the switch matrix circuit 15SW. The number of the sound source cores 15C included in the core unit 15 is not limited to two, and may be three or more.
[0040] The audio system 3 includes a D / A converter, an amplifier, and a speaker. 2 The digital musical sound data input in the S format is converted into an analog signal, amplified by an amplifier, and output from a speaker. Thus, for example, musical sound corresponding to the MIDI data is reproduced.
[0041] The sound system 3 may include input means such as an A / D converter and a microphone. For example, a singing voice input from a microphone may be converted into digital data by an A / D converter and then input to the core unit 15 to perform processing such as adding effects to the singing voice.
[0042] Figure 2 1 is a block diagram showing the structure of a sound source core 15C for processing digital musical sound data. In this embodiment, two sound source cores 15C of the same structure are used, and there is no need to prepare a plurality of sound source cores 15C of different structures, thereby reducing the cost of the source system 1 and facilitating the management of the sound source cores 15C.
[0043] The sound source core 15C includes a sound source unit 100 of n channels (for example, 128 channels), a mixer 102, a DSP 104, a BIF 106, an I 2 S interface 108 , reset pulse input and output circuit 110 , and action counter 112 .
[0044] The sound source unit 100 includes a BIF (Bus Interface) 100a, an SG (Sound Generator) 100b, a DCF (Digital Controlled Filter) 100c, an EQ (Equalizer) 100d, and a DCA (Digital Controlled Amplifier) 100e.
[0045] BIF100a is an interface connected to each part of the sound source system 1 via the bus 16. For example, according to MIDI data input to GPIO13, CPU10 instructs the sound source core 15C to read corresponding waveform data from a plurality of waveform data stored in ROM12. This instruction signal is input to SG100b via BIF100a.
[0046] SG100b reads waveform data from ROM12 according to an instruction signal from CPU10, and generates digital musical sound data based on the read waveform data. Since the sound source core 15C includes 128-channel sound source units 100, it can simultaneously produce a maximum of 128 musical sounds.
[0047] The digital musical sound data generated by the SG 100 b is output to the mixer 102 after being processed by a digital filter by the DCF 100 c , by an equalizer by the EQ 100 d , and by an amplification by the DCA 100 e .
[0048] The mixer 102 mixes digital musical sound data of a maximum of 128 musical sounds input from the sound source unit 100 , and outputs the mixed digital musical sound data to the DSP 104 .
[0049] The DSP 104 performs effect processing on the digital musical sound data input from the mixer 102 and outputs the digital musical sound data to the I 2 S interface 108 . In addition, the DSP 104 is connected to each unit of the sound source system 1 via the BIF 106 .
[0050] I 2 The S interface 108 is used to communicate between the DSPs 104 of the sound source cores 15C or between the DSPs 104 and the switch matrix circuit 15SW in an I / O manner. 2 For convenience, the interface will be referred to as I 2 The digital sound data transmitted in S format is described as “I 2 S data".
[0051] I 2 The S data includes a BCK signal, a LRCK signal, and a DATA signal. The BCK signal is a clock for latching the DATA signal as serial data on the rising edge, and is sometimes referred to as a bit clock. The LRCK signal is a signal for distinguishing the L channel and the R channel of the digital musical sound data and indicating the position of the highest bit of the DATA signal, and is sometimes referred to as a word clock. The DATA signal is a signal of a bit string of musical sound data, and includes the highest bit MSB (Most Significant Bit) and the lowest bit LSB (Least Significant Bit).
[0052] I 2 The S interface 108 has three input ports and three output ports. 2 The S interface 108 performs I 2 S data input and output. In addition, I 2 The number of input ports and output ports included in the S interface 108 is not limited to three. The number of input ports and output ports may be two or less, or four or more.
[0053] Figure 3This is a block diagram mainly showing the structure of the reset pulse input / output circuit (control signal output unit) 110. The CPU 10 outputs an instruction signal for instructing the issuance of a reset pulse to the reset pulse input / output circuit 110 at a predetermined timing (for example, when the sound source system 1 is activated or when the sound source core 15CS in a stopped state is restarted as described later). The reset pulse input / output circuit 110 generates a reset pulse (reset signal) as an example of a trigger signal according to the instruction signal from the CPU 10, and outputs the generated reset pulse to the action counter (value generation unit) 112.
[0054] like Figure 3 As shown, the reset pulse input / output circuit 110 includes a setting register (setting unit) 110a, an edge detection unit 110b, and an OR circuit (logical sum circuit or control signal output circuit) 110c. Here, operation examples 1 and 2 of the reset pulse input / output circuit 110 are described.
[0055] In the first operation example, when the reset pulse input / output circuit 110 receives an instruction signal for issuing a reset pulse from the CPU 10, the setting register 110a modulates the setting value from "0" to "1". The edge detection unit 110b detects the rising edge of the signal when the setting value in the setting register 110a is modulated from "0" to "1", generates a reset pulse corresponding to the edge, and outputs the generated reset pulse to the OR circuit 110c.
[0056] One input terminal T1 of the OR circuit 110c is connected to the edge detection unit 110b, and the other input terminal T2 is connected to the other sound source core 15C. However, in the operation example 1, the input to the input terminal T2 is fixed to "0". Therefore, only when the reset pulse from the edge detection unit 110b is input to the input terminal T1, the OR circuit 110c outputs an output signal corresponding to the reset pulse from the edge detection unit 110b to the operation counter 112.
[0057] The action counter 112 is, for example, a timing generator, and always generates a value mc that serves as an action reference for the sound source core 15C during the action of the sound source system 1. The value mc is used, for example, to generate a BCK signal and a LRCK signal as clocks. 2 The logic circuit of the S interface 108 generates the BCK signal and the LRCK signal based on the value mc generated by the motion counter 112 .
[0058] When a reset pulse is input from the reset pulse input / output circuit 110 to the operation counter 112 , the value mc generated by the operation counter 112 is reset to “0”.
[0059] That is, when the CPU 10 issues a reset pulse instruction signal to each sound source core 15C, the value mc is simultaneously reset to “0” in each sound source core 15C. After the value mc is reset, the counting of the value mc is restarted simultaneously in each sound source core 15C.
[0060] As a result, the values mc of the motion counters 112 of the sound source cores 15C are synchronized (substantially identical). Therefore, the phases of the BCK signal and the LRCK signal generated based on the value mc are aligned between the two sound source cores 15C.
[0061] There are individual differences in the action counters 112 of each sound source core 15C. Therefore, strictly speaking, the BCK signal and the LRCK signal are not synchronized, but are in a phase-aligned state. However, since the individual differences of the action counters 112 are small, there is no substantial problem in stating that "the BCK signal and the LRCK signal are synchronized between the two sound source cores 15C." Here, phase alignment means, for example, that even in the case where the clock waveform is distorted or deformed due to major factors such as capacitance between wiring or in the case where the clock is slightly offset between the sound source cores 15C due to delay, the high interval of the clock waveform of one sound source core 15C is roughly consistent with the high interval of the clock waveform of another sound source core 15C, and the low interval of the clock waveform of one sound source core 15C is roughly consistent with the low interval of the clock waveform of another sound source core 15C.
[0062] In addition, since the plurality of action counters 112 operate synchronously, the fanout of one action counter 112 is reduced.
[0063] In the operation example 1, the CPU 10 instructs all the sound source cores 15C to issue a reset pulse. In contrast, in the operation example 2, the CPU 10 instructs only the sound source core 15CM set as the master to issue a reset pulse.
[0064] In the operation example 2, the reset pulse input / output circuit 110 of the sound source core 15CM outputs a reset pulse not only to the operation counter 112 but also to another sound source core 15CS set as a slave.
[0065] The input to the input terminal T2 of the OR circuit 110c of the sound source core 15CM is fixed to "0" as in the case of operation 1. Therefore, the OR circuit 110c of the sound source core 15CM outputs the reset pulse to the action counter 112 only when the reset pulse from the edge detection unit 110b is input to the input terminal T1 as in the case of operation 1.
[0066] On the other hand, the input to the input terminal T2 of the OR circuit 110c of the sound source core 15CS is not fixed. In addition, since the reset pulse is not generated in the sound source core 15CS, there is no input to the input terminal T1. Therefore, only when the reset pulse from the sound source core 15CM is input to the input terminal T2, the OR circuit 110c of the sound source core 15CS outputs it to the action counter 112.
[0067] In the second operation example, by instructing only the sound source core 15CM to issue a reset pulse, the value mc is simultaneously reset to "0" in each sound source core 15C, and the phases of the BCK signal and the LRCK signal are aligned between the two sound source cores 15C.
[0068] When the operation is performed in Operation Example 1 or Operation 2, since the sound source cores 15C having the same structure are used, it is not necessary to separately prepare and load a plurality of types of sound source cores 15C.
[0069] In this way, the CPU 10 operates as a phase control unit, and the phase control unit supplies a reset pulse as an example of a trigger signal to each of the plurality of sound source cores 15C by executing a program stored in the ROM 12. When the reset pulse is supplied to each of the plurality of sound source cores 15C, the value mc of the motion counter 112 is synchronized between the plurality of sound source cores 15C, and each of the plurality of sound source cores 15C generates a BCK signal and a LRCK signal as an example of a clock based on the value mc of the motion counter 112 in the synchronized state. That is, the CPU 10 operating as a phase control unit aligns the phases of the clocks (BCK signal and LRCK signal) that define the input and output timing of the digital musical sound data to the sound source core 15C among the plurality of sound source cores 15C.
[0070] Figure 4 It means I 2 Figure 1.1 shows the timing diagram of the S data. Figure 4 , an example of transmitting data of two channels in one sample and an example of transmitting data of four channels in one sample at a higher speed are shown together. In the former example, data of the L channel and data of the R channel are transmitted in sequence in one sample. In the latter example, data of the L channel, data of the R channel, data of the L channel, and data of the R channel are transmitted in sequence in one sample.
[0071] In any transmission example, the BCK signal and the LRCK signal are based on Figure 4 The value mc shown in the top layer is generated.
[0072] Furthermore, a configuration in which data of more channels, such as 8, 16, or 32 channels, is transmitted in one sample is also within the scope of the present invention.
[0073] In addition, the transmission format of digital musical sound data is not limited to I 2 The S format may also be other formats such as left justified or right justified.
[0074] Figure 5 1 is a block diagram showing the structure of a switch matrix circuit 15SW that can be connected to each of the plurality of sound source cores 15C. Figure 5 As shown, the switch matrix circuit 15SW includes six selector switches 150 to 155. The selector switches 150 to 155 are 9 to 1 selector switches and are 1-bit selector switches.
[0075] The switch matrix circuit 15SW has nine system inputs. Specifically, the I from the two sound source cores 15C 2 The S interface 108 includes three output ports (a total of six inputs: IN1 to IN6) and three inputs (IN7 to IN9) from the outside (for example, the sound system 3). In addition, the switch matrix circuit 15SW includes six systems for distributing outputs. Specifically, there are I2Cs to the two sound source cores 15C. 2 The outputs of the three input ports of the S interface 108 (a total of six systems of distribution outputs: OUT1 to OUT6). In addition, in the switch matrix circuit 15SW, the input from the sound source core 15C is directly output to the outside. Therefore, the switch matrix circuit 15SW has a structure with six 9-to-1 selector switches.
[0076] For example, in order to process the LR signal (digital musical sound data) of the sound source core 15CS in the sound source core 15CM, consider the case where two systems of the LR signal of the sound source core 15CS are input to the sound source core 15CM. In this case, for example, in the selector switch 150, by selecting the bit 4, that is, IN4, IN4 and OUT1 are connected. Similarly, in the selector switch 151, by selecting the bit 5, that is, IN5, IN5 and OUT2 are connected. As a result, the L signal and the R signal input to IN4 and IN5 from the sound source core 15CS are output from OUT1 and OUT2, respectively, and input to the sound source core 15CM.
[0077] As another example, consider the case where an external input signal is input to the sound source core 15CS. In this case, for example, in the selector switch 155, by selecting bit 7, that is, IN7, IN7 and OUT6 are connected. Thus, the external input signal input from the outside to IN7 is output from OUT6 and input to the sound source core 15CS.
[0078] By configuring the switch matrix circuit 15SW in this manner, various operation modes of the switch matrix circuit 15SW can be set. For example, it is possible to set the operation mode of transmitting I from the sound source core 15CS to the sound source core 15CM. 2 S data operation mode, or can be set to transmit I from the sound source core 15CM to the sound source core 15CM 2 S data operation mode.
[0079] Whether the switch matrix circuit is mounted in a product adopting the former operation mode or in a product adopting the latter operation mode, the same switch matrix circuit 15SW can be used. Since the same switch matrix circuit 15SW can be used between different products, cost reduction can be achieved, for example.
[0080] Conventionally, for example, it is considered that in a state where the phases of the BCK signal and the LRCK signal are not aligned between the two sound source cores 15C, I 2 S data is transmitted between two sound source cores 15C. In this case, it is necessary to 2 All BCK signals, LRCK signals, and DATA signals in the S data set the switch matrix. Therefore, each of the selector switches 150 to 155 needs to be composed of a 3-bit selector switch.
[0081] In contrast, in this embodiment, as described above, the phases of the BCK signal and the LRCK signal can be aligned between the two sound source cores 15C. 2 The BCK signal and LRCK signal in the S data set the switch matrix. Since each switch in the selector switches 150 to 155 can be formed by a 1-bit selector switch for the DATA signal, the circuit scale of the switch matrix circuit 15SW is suppressed to be small. In other words, since the signal connected by the switch matrix circuit 15SW does not contain the clock signal (BCK signal and LRCK signal), the circuit scale of the switch matrix circuit 15SW is suppressed to be small.
[0082] Figure 6 1 is a diagram showing an example of effect processing performed by DSP 104. Figure 6 In Figure 2In the mixer 102 and DSP 104 shown, the mixer 102 and DSP 104 of the sound source core 15CM are described as "mixer 102M" and "DSP 104M", respectively, and the mixer 102 and DSP 104 of the sound source core 15CS are described as "mixer 102S" and "DSP 104S", respectively. In addition, while the DSP 104M has system effect processing units 202, 204 and main effect processing units 206, 208 described later, the DSP 104S does not have system effect processing units 202, 204 and main effect processing units 206, 208, but since these processing units are set by software, the DSP 104M and the DSP 104S are identical in hardware circuit configuration.
[0083] like Figure 6 As shown, the DSP 104M includes system effect processing units 202, 204, main effect processing units 206, 208, insertion effect processing units 210, 212, and adders 220, 222, 224. The DSP 104S includes insertion effect processing units 302, 304, 306, and adders 320, 322, 324.
[0084] The system effect processing units 202 and 204 apply system effects shared by the sound source cores 15C (for example, general reverberation effects that are connected to the send return terminal and add background sound to the entire musical sound). Therefore, the system effect processing units 202 and 204 are connected not only to the mixer 102M of the DSP 104M but also to the DSP 104S.
[0085] Here, in the insert effect processing units 210, 212, 302, 304, 306 and the system effect processing unit 204, Figure 6 The amplifier of the output signal on the left side (mixer 102M or 102S side) functions as a send volume of the signal input to the effect processing sections 202 and 204 .
[0086] On the other hand, in the system effect processing units 202 and 204, Figure 6 The amplifiers of the output signals on the right side of the figure function as the return volumes of the return signals from the system effect processing units 202 and 204, respectively. However, the chorus of the system effect processing unit 204 in this embodiment may also function as an insertion effect. When the chorus of the system effect processing unit 204 functions as an insertion effect, the volume sent by the processing unit to the system effect processing unit 202 may be set to "0", and the volume sent by each insertion effect processing unit 210, 212, 302, 304, 306 to the system effect processing unit 204 may be set to "0".
[0087] The adder 220 disposed at the preceding stage of the system effect processing section 202 adds the digital musical sound data (waveform data for reverberation processing) output from the mixer 102M, the system effect processing section 204, and the insertion effect processing sections 210 and 212, and further adds the digital musical sound data output from the DSP 104S (more specifically, the waveform data for reverberation processing output from the insertion effect processing sections 302, 304, 306 and added by the adder 320). The system effect processing section 202 generates a reverberation musical sound using the waveform data input from the adder 220, and outputs the waveform data of the generated reverberation musical sound.
[0088] The adder 222 disposed at the front stage of the system effect processing section 204 adds the digital musical sound data (waveform data for chorus processing) output from the mixer 102M and the insertion effect processing sections 210 and 212, and further adds the digital musical sound data output from the DSP 104S (more specifically, the waveform data for chorus processing output from the insertion effect processing sections 302, 304, 306 and added by the adder 322). The system effect processing section 204 generates chorus musical sound using the waveform data input from the adder 222, and outputs the waveform data of the generated chorus musical sound.
[0089] The main effect processing sections 206 and 208 apply the main effect shared by each sound source core 15C at the subsequent stage of each system effect processing section and each insertion effect processing section. Therefore, the main effect processing sections 206 and 208 are connected to each system effect processing section, each insertion effect processing section, and the mixer 102M.
[0090] The adder 224 disposed at the front stage of the main effect processing unit 206 adds the waveform data output from the mixer 102M, the system effect processing units 202, 204 and the insertion effect processing units 210, 212, and further adds the waveform data output from the DSP 104S (more specifically, the waveform data output from the mixer 102S, the insertion effect processing units 302, 304, 306 and added via the adder 324).
[0091] The main effect processing section 206 performs compression processing on the digital musical sound data added by the adder 224. The main effect processing section 208 performs equalizer processing on the digital musical sound data compressed by the main effect processing section 206. The digital musical sound data after the equalizer processing is passed through I 2 The S interface 108 outputs to the audio system 3 .
[0092] The main effect processing units 206 and 208 play a role in adjusting the volume difference or adjusting the frequency characteristics in the final output stage of the musical sound to adjust the overall musical sound. Therefore, for direct sound to which the system effect is not applied, it is preferred to suppress the delay to the minimum, add a signal in a state where the phases of the plurality of sound source cores 15C are aligned as much as possible through the adder 224, and input it to the main effect processing unit 206.
[0093] The insertion effect processing sections 210 and 212 apply insertion effects only to the digital musical sound data input from the mixer 102M. That is, the insertion effect processing sections 210 and 212 apply effects that are not shared by the sound source cores 15C. For example, the insertion effect processing section 210 and the insertion effect processing section 212 apply insertion effects that are different from each other (for example, a flanger or a phase shifter, etc.).
[0094] The insertion effect processing sections 302, 304, and 306 apply insertion effects only to the digital musical sound data input from the mixer 102S. That is, the insertion effect processing sections 302, 304, and 306 also apply different effects that are not shared by the sound source cores 15C.
[0095] The output signals of the insertion effect processing units 210, 212, 302, 304, 306 are divided into Figure 6 The signal to the left side (mixer 102M or 102S side) and to which the system effects are applied, and the signal to the Figure 6 The signal of the direct sound on the center right side without the system effects applied. It is preferred that the direct sound has less delay than the background sound with the system effects such as reverb and chorus applied.
[0096] In this embodiment, the digital musical sound data generated by the sound source core 15CS is transmitted to the sound source core 15CM via the switch matrix circuit 15SW or the shared memory. Fig. 7A represents the delay in the case of transmitting digital musical sound data via the switch matrix circuit 15SW. Figure 7B Indicates the delay in the case of transferring digital tone data via the shared memory.
[0097] In this embodiment, the RAM 11 (SRAM) having a small single access delay is used as a shared memory.
[0098] like Fig. 7A As shown, when the switch matrix circuit 15SW is used, the register of the DSP 104S is written with I 2 S data, transmit the written I 2 S data, the transmitted I 2 The S data is written into the register of the DSP 104M. Therefore, the digital musical sound data generated by the sound source core 15CS is delayed by about 2 samples with respect to the digital musical sound data generated by the sound source core 15CM.
[0099] like Figure 7B As shown in the figure, in the case of using a shared memory, a shared memory area is secured, the digital musical sound data is written into the secured shared memory area, the written digital musical sound data is read out from the shared memory area, and the read digital musical sound data is written into the cache memory of the DSP 104M. Therefore, the digital musical sound data generated by the sound source core 15CS is delayed by about 3 samples relative to the digital musical sound data generated by the sound source core 15CM.
[0100] Furthermore, the write delay and read delay in the shared memory are likely to become larger depending on the operation status of the RAM 11. Therefore, the digital musical sound data generated by the sound source core 15CS may have a larger delay than the digital musical sound data generated by the sound source core 15CM.
[0101] That is, when the digital musical tone data is transmitted via the switch matrix circuit 15SW, the delay is suppressed to be smaller than the delay when the digital musical tone data is transmitted via the shared memory.
[0102] As described above, it is preferable that the direct sound from each insertion effect has a lower delay than the sound to which the system effect is applied. Therefore, under the control of the CPU 10, the digital musical sound data output from the mixer 102S and the insertion effect processing sections 302, 304, and 306 of the DSP 104S, that is, the waveform data added by the adder 324, is transmitted from the sound source core 15CS to the main effect processing section 206 via a path with a small delay, that is, via the switch matrix circuit 15SW.
[0103] However, the number of input and output paths through the switch matrix circuit 15SW is limited. When the number of input and output paths is increased, the number of input and output of the switch matrix circuit 15SW increases, and the circuit scale of the switch matrix circuit 15SW increases.
[0104] In contrast, if a ring buffer is formed on the RAM 11 via a shared memory, the number of paths that can be transmitted is almost unlimited. In addition, by increasing the size of the ring buffer, the amount of data transmitted per path can be increased. However, in this case, the delay before the written data is read becomes larger. In addition, as described above, the reverb processing and chorus processing performed by the system effect processing sections 202 and 204 can be delayed slightly more than the insertion effect processing.
[0105] Therefore, in the present embodiment, under the control of the CPU 10, the digital musical sound data output from the insertion effect processing sections 302, 304, and 306 of the DSP 104S, that is, the waveform data added by the adder 320, is transmitted from the sound source core 15CS to the system effect processing section 202 via the shared memory. Furthermore, under the control of the CPU 10, the digital musical sound data output from the insertion effect processing sections 302, 304, and 306 of the DSP 104S, that is, the waveform data added by the adder 322 is transmitted from the sound source core 15CS to the system effect processing section 204 via the shared memory.
[0106] As described above, in the present embodiment, by using the switch matrix circuit 15SW and the shared memory together, a large amount of data can be transferred in one sampling while keeping the circuit scale of the switch matrix circuit 15SW small.
[0107] also, Figure 6 The processing example shown is only an example. Configurations that do not share reverb, chorus, compressor, and equalizer, and configurations that share insertion effects that are not shared in this embodiment are also within the scope of the present invention. Figure 6 Other effect processing structures not illustrated are also within the scope of the present invention.
[0108] Thus, the CPU 10 operates as a connection control unit that controls the connection between the plurality of sound source cores 15C by executing a program stored in the ROM 12 so that digital musical sound data with phases of clocks (BCK signal and LRCK signal) are transmitted between the plurality of sound source cores 15C. More specifically, the CPU 10 operating as a connection control unit controls the connection between the plurality of sound source cores 15C via the switch matrix circuit 15SW.
[0109] In addition, one of the sound source cores 15CM in the plurality of sound source cores 15C performs a first effect processing and a second effect processing on the first musical sound data and the second musical sound data from each of the plurality of sound source cores 15C. The first musical sound data is digital musical sound data to which a first effect processing (e.g., an insertion effect processing) is performed with a smaller tolerance value for delay during transmission than that of the second effect processing (e.g., a reverberation processing, a chorus processing), and the plurality of sound source cores 15C are connected in a manner of I 2 The second musical sound data is digital musical sound data that has been subjected to a second effect processing that has a larger tolerance for delay during transmission than the first effect processing, and is transmitted between the plurality of sound source cores 15C via a shared memory. Incidentally, the first effect processing can be said to be processing that requires a smaller delay during transmission of the musical sound data than the second effect processing.
[0110] As described above, in this embodiment, since the phases of the BCK signal and the LRCK signal are aligned between multiple sound source cores 15C, even if the structure is such that the effect is shared among multiple sound source cores 15C, each switch in the selector switches 150 to 155 can be composed of a 1-bit selector switch, and the circuit scale of the switch matrix circuit 15SW can be suppressed to be small.
[0111] In addition, the present invention is not limited to the above-mentioned embodiments, and various modifications can be made in the implementation stage without departing from the spirit of the present invention. In addition, the functions performed in the above-mentioned embodiments can be combined as appropriately as possible. The above-mentioned embodiments include various stages, and various inventions can be obtained by appropriately combining the disclosed multiple constituent elements. For example, if the effect can be obtained even if a part of the constituent elements is deleted from all the constituent elements shown in the embodiment, the structure in which the constituent elements are deleted can be obtained as an invention.
[0112] Figure 8 It is a diagram showing an example of effect processing by the DSP 104 in the first modification of the present invention.
[0113] As described above, the digital musical sound data generated by the sound source core 15CS has a delay in transmission, and is therefore delayed relative to the digital musical sound data generated by the sound source core 15CM. Therefore, in Modification 1, a delay circuit 230 is provided at the subsequent stage of the system effect processing sections 202 and 204 and the insertion effect processing sections 210 and 212. The delay circuit 230 delays the input waveform data by, for example, 2 samples.
[0114] The waveform data delayed by the delay circuit 230 and the waveform data from the mixer 102M are added by the adder 226, and the added data is further added by the waveform data transmitted from the sound source core 15CS via the switch matrix circuit 15SW through the adder 224 and input to the main effect processing section 206.
[0115] That is, in variant example 1, digital musical sound data obtained by suppressing the phase difference between the digital musical sound data generated by the sound source core 15CS (waveform data via the switch matrix circuit 15SW) and the digital musical sound data generated by the sound source core 15CM (waveform data not passing through the switch matrix circuit 15SW) is input into the main effect processing unit 206.
[0116] As described above, the sound source core 15CM includes the delay circuit 230 (an example of a phase difference suppressing unit) that suppresses the phase difference of the musical sound data from each of the plurality of sound source cores 15C.
[0117] The method of synchronously controlling the action counters 112 between the plurality of sound source cores 15C is not limited to the method using the reset pulse.
[0118] Fig. 9A , Fig. 9B This is the figure corresponding to the sound source core of 15CM. Fig. 9B 15CS corresponds to the sound source core 15CS, and is a block diagram showing the configuration of the switch 110' and the operation counter 112 according to the second modification of the present invention. The sound source system 1 according to the second modification includes Fig. 9A and Fig. 9B The structure shown here is replaced by Figure 3 The structure shown.
[0119] The CPU 10 outputs a master enable signal of value 1 to the sound source core 15CM set as the master, and outputs a master enable signal of value 0 to the sound source core 15CS set as the slave. The master enable signal is a control signal for the switch 110'.
[0120] like Fig. 9A As shown, in the sound source core 15CM, the switch 110' is connected to the contact T11 according to the main enable signal. As a result, the action counter 112 of the sound source core 15CM is connected to the inside of the sound source core 15CM (the supply destination of the value mc), and the action counter 112 of the sound source core 15CS is disconnected from the inside of the sound source core 15CM.
[0121] In addition, if Fig. 9B As shown, in the sound source core 15CS, the switch 110' is connected to the contact T12 according to the main enable signal. As a result, the connection between the action counter 112 of the sound source core 15CS and the inside of the sound source core 15CS (the supply destination of the value mc) is cut off, and the action counter 112 of the sound source core 15CM is connected to the inside of the sound source core 15CS.
[0122] Therefore, the value mc generated by the action counter 112 of the sound source core 15CM is supplied to the inside of the sound source core 15CM and to the inside of the sound source core 15CS. Since the common value mc is supplied to the two sound source cores 15C, the phases of the BCK signal and the LRCK signal generated based on the value mc are aligned between the two sound source cores 15C.
[0123] Depending on the state of musical sound generation (for example, when there are few musical sounds to be generated), it becomes unnecessary to operate at least one sound source core 15C. Therefore, in order to reduce the current consumption of the sound source system 1, the supply of the basic operation clock to at least one sound source core 15C may be stopped according to the state of musical sound generation (in other words, according to the processing status of musical sound data).
[0124] Fig.10 : is a block diagram showing the structure of the sound source system 1 according to the third modification of the present invention. Fig.10, there is shown a clock generator 17 that supplies a basic operation clock to each part of the sound source system 1. The clock generator 17 is an example of a basic operation clock supply unit that supplies a basic operation clock for operating the plurality of sound source cores 15C.
[0125] like Fig.10 As shown, in Modification 3, a clock gating switch 18M is arranged between the clock generator 17 and the sound source core 15CM. In addition, a clock gating switch 18S is arranged between the clock generator 17 and the sound source core 15CS.
[0126] The CPU 10 writes a value to the setting register 19 according to the state of the musical sound. For example, when a value of 1 is written to the sound source core 15CM, an enable signal of a value of 1 is output from the setting register 19 to the clock gating switch 18M. As a result, the clock gating switch 18M connects the clock generator 17 and the sound source core 15CM, and the basic operation clock is supplied from the clock generator 17 to the sound source core 15CM. When a value of 0 is written to the sound source core 15CM, an enable signal of a value of 0 is output from the setting register 19 to the clock gating switch 18M. As a result, the clock gating switch 18M cuts off the connection between the clock generator 17 and the sound source core 15CM, and stops the supply of the basic operation clock from the clock generator 17 to the sound source core 15CM. Therefore, the sound source core 15CM stops.
[0127] The clock gating switch 18S performs the same operation for the sound source core 15CS, and connects and disconnects the clock generator 17 and the sound source core 15CS. While the clock generator 17 and the sound source core 15CS are connected, the basic operation clock is supplied from the clock generator 17 to the sound source core 15CS. While the clock generator 17 and the sound source core 15CS are disconnected, the supply of the basic operation clock from the clock generator 17 to the sound source core 15CS is stopped, and the sound source core 15CS is stopped.
[0128] In this way, CPU 10 acts as a supply control unit, which controls the supply of basic action clocks to each of the multiple sound source cores 15C and stops the supply of basic action clocks by the clock generator 17 (an example of a basic action clock supply unit) according to the processing status of the digital musical sound data by executing the program stored in ROM 12.
[0129] When applying Modification 3 to Modification 2, first, Fig. 9A and Fig. 9BIn the structure shown, the sound source core 15CM supplies the value mc to the sound source core 15CS. When only the sound source core 15CM is stopped, the value mc is not supplied to the sound source core 15CS, so the operation of the sound source core 15CS is malfunctioning. Therefore, when there is only one sound source core 15C that can be stopped, only the sound source core 15CS is stopped. When the number of sound source cores 15C that can be stopped reaches two, the sound source core 15CM is also stopped.
[0130] exist Fig. 9A and 9B In the structure shown, even if only the operation of the sound source core 15CS is restarted from the state where the two sound source cores 15C are stopped, the value mc is not supplied to the sound source core 15CS. Therefore, the operation of the sound source core 15CS is malfunctioning. Therefore, first, only the operation of the sound source core 15CM is restarted, and then, if necessary, the operation of the sound source core 15CS is also restarted.
[0131] exist Fig. 9A and 9B In the structure shown, when the operation of the sound source core 15CS is resumed, the value mc generated by the operation counter 112 of the sound source core 15CM is also supplied to the inside of the sound source core 15CS. Therefore, even after the operation is resumed, the phases of the BCK signal and the LRCK signal are aligned between the two sound source cores 15C.
[0132] exist Figure 3 In the illustrated configuration, when the operation of the sound source core 15CS is resumed, a reset pulse is supplied to each sound source core 15C. Therefore, in this case, even after the operation is resumed, the phases of the BCK signal and the LRCK signal are aligned between the two sound source cores 15C.
[0133] Although the embodiments of the present disclosure are described above, the technical scope of the present disclosure is not limited to the above embodiments as it is, but can be variously modified within the scope of the main purpose of the present disclosure. In addition, the constituent elements across different embodiments and variations can also be appropriately combined. In addition, the effects in each embodiment described in this specification are merely exemplary and not limiting, and other effects may also be possible.
[0134] Description of Reference Numerals
[0135] 1: Sound source system
[0136] 2: DRAM
[0137] 3: Sound system
[0138] 10: CPU
[0139] 11: RAM
[0140] 12: ROM
[0141] 13: GPIO
[0142] 14: MEMIF
[0143] 15: Nuclear Department
[0144] 15C: Sound source core
[0145] 15SW: Switch Matrix Circuit
[0146] 16: Bus
[0147] 100: Sound source
[0148] 102: Mixer
[0149] 104: DSP
[0150] 106: BIF
[0151] 108:I 2 S-Mount
[0152] 110: Reset pulse input and output circuit
[0153] 112: Action counter
[0154] 150~155: Selector switch
Claims
1. A sound source system, wherein: have: Multiple sound source cores to process musical sound data; a phase control unit that aligns the phases of a clock that specifies input and output timings of the musical sound data for the sound source cores among the plurality of sound source cores; as well as The connection control unit controls the connection between the plurality of sound source cores so as to transmit the musical sound data whose phases are aligned with the clock between the plurality of sound source cores.
2. The sound source system according to claim 1, wherein: The device further includes a switch matrix circuit that can be connected to each of the plurality of sound source cores, and the connection control unit controls the connection between the plurality of sound source cores via the switch matrix circuit.
3. The sound source system according to claim 2, wherein: The signals for controlling the connection by the switch matrix circuit do not include the clock signal.
4. The sound source system according to any one of claims 1 to 3, wherein: Between the multiple sound source cores, 2 S format transmits the first musical sound data, the I 2 S is an integrated circuit audio interface.
5. The sound source system according to any one of claims 1 to 4, wherein: A shared memory shared among the plurality of sound source cores is further provided, and the second musical sound data is transmitted among the plurality of sound source cores via the shared memory.
6. The sound source system according to claim 5, wherein: With respect to the first musical sound data and the second musical sound data from each sound source core among the multiple sound source cores, one sound source core among the multiple sound source cores performs a first effect processing on the first musical sound data and performs a second effect processing on the second musical sound data, wherein the first effect processing is a processing requiring a smaller delay when transmitting the musical sound data than the second effect processing.
7. The sound source system according to claim 6, wherein: The one sound source core includes a phase difference suppressing section that suppresses a phase difference between the musical sound data from each of the plurality of sound source cores.
8. The sound source system according to any one of claims 1 to 7, wherein: The phase control unit supplies an indication signal to each of the multiple sound source cores. When the indication signal is supplied to each of the multiple sound source cores, the value of the action counter of the sound source core is synchronized among the multiple sound source cores, and each of the multiple sound source cores generates the clock based on the value of the action counter in the synchronized state.
9. The sound source system according to claim 8, wherein: Each of the plurality of sound source cores comprises: a control signal output unit, which outputs a control signal corresponding to the indication signal; and The value generating unit generates a value based on the control signal.
10. The sound source system according to claim 9, wherein: The control signal output unit comprises: a setting unit, modulating a setting value according to the indication signal; an edge detection unit that detects a rising edge of a signal according to the modulation of the setting value in the setting unit and generates a reset signal corresponding to the edge; as well as The control signal output circuit outputs an output signal according to an input of a reset signal from the edge detection unit and an input of a reset signal from an edge detection unit of another sound source core among the plurality of sound source cores.
11. The sound source system according to claim 10, wherein: The value generating section generates the value based on the output signal.
12. The sound source system according to any one of claims 1 to 11, wherein: Also available: a basic operation clock supply unit that supplies a basic operation clock for operating the plurality of sound source cores; and The supply control unit controls the basic operation clock supply unit to supply the basic operation clock to each of the plurality of sound source cores and to stop supplying the basic operation clock according to a processing status of the musical sound data.
13. The sound source system according to any one of claims 1 to 12, wherein: The multiple sound source cores have the same circuit structure.
14. A method for controlling a sound source system, the sound source system comprising a plurality of sound source cores for processing musical sound data, the method causing the sound source system to perform the following processing: The phase of a clock that specifies the input and output timing of the musical sound data for the sound source core is aligned between the plurality of sound source cores, and the connection between the plurality of sound source cores is controlled to transmit the musical sound data with the phase of the clock aligned between the plurality of sound source cores.
15. A program for controlling a sound source system, the sound source system comprising a plurality of sound source cores for processing musical sound data, the program causing the sound source system to perform the following processing: The phase of a clock that specifies the input and output timing of the musical sound data for the sound source core is aligned between the plurality of sound source cores, and the connection between the plurality of sound source cores is controlled to transmit the musical sound data with the phase of the clock aligned between the plurality of sound source cores.
