Automatic musical instrument, electronic musical instrument, method, and program

Abstract

To provide an automatic performance device capable of easily realizing effective side chain.SOLUTION: An automatic performance device according to an embodiment comprises a sound source and a processor. The processor is configured to check whether a note value of a second sound is longer than a predetermined threshold, where the second sound belongs to a part other than a first part of music data consisting of multiple parts including the first part and is generated at the same time as a first sound belonging to the first part. When affirmative, the processor makes the sound source generate the second sound of a volume less than a volume specified in the music data as a generating volume for the second sound for at least a part of a period corresponding to the note value of the second sound.SELECTED DRAWING: Figure 2

Description

Technical Field

[0001] The present invention relates to an automatic performance device, an electronic musical instrument, a method, and a program.

Background Art

[0002] An automatic performance device (sequencer) is widely used as a function of an electronic keyboard instrument, as a dedicated embedded device, or in the form of computer software or the like. This type of device plays a music piece by passing performance information recorded in a data file (Standard MIDI File: SMF) based on, for example, the MIDI (Musical Instruments Digital Interface) standard to a sound source module and causing it to produce sound. In particular, it has been increasingly used in dance music such as EDM (Electronic Dance Music).

[0003] Sidechain or ducking is one of the ways to process sound and is often used in EDM. This mainly emphasizes the pronunciation of the kick (bass drum) by lowering the volume of other parts in conjunction with the pronunciation of the kick, producing an effect of making the beat stand out.

[0004] Patent Document 1 discloses metadata for ducking control. This document describes including a ducking value in an audio asset representing a sound program content piece.

Prior Art Documents

Patent Documents

[0005]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0006] A side chain or ducking (hereinafter collectively referred to as side chain) is said to be effective for relatively long (long in note value) sounds such as pads or strings. This is because when a side chain is applied to a sound with a short note value, the pronunciation period of that sound itself is short, so the pronunciation ends while the volume is decreasing, and the phrase becomes incomplete.

[0007] However, it is difficult for beginners in music production to determine which part to apply the side chain to for effective results. Also, reducing the volume of all parts other than the kick with the side chain effect is often not desired by music producers (creators). To improve the quality of music, it is necessary to specify the on / off of the side chain for each note, which is a great burden on the creator. This is particularly prominent when there is a phrase that mixes long and short sounds in one part, and it also discourages the creator's motivation.

[0008] This invention was made against the above background, and its purpose is to provide an automatic performance device, an electronic musical instrument, a method, and a program that can easily realize an effective side chain.

Means for Solving the Problems

[0009] The automatic performance device according to the embodiment determines whether the note value of the second sound included in the other parts other than the first part, which is pronounced superimposed on the pronunciation of the first sound included in the first part of the music data having a plurality of parts including the first part, is equal to or greater than a preset threshold value. When it is determined that the note value of the second sound is equal to or greater than the threshold value, a pronunciation process is executed to weaken the second sound at the pronunciation timing of the first sound to a volume lower than the volume set in the music data as the pronunciation volume of the second sound. When it is determined that the note value of the second sound is less than the threshold value, a pronunciation process is executed to pronounce the second sound at the pronunciation timing of the first sound at the volume set in the music data. and the threshold value is set based on the interval between each sound of the first part 。

Effects of the Invention

[0010] According to the present invention, an effective side chain can be easily realized.

Brief Description of the Drawings

[0011]

Figure 1

Figure 2

Figure 3

Figure 4A

Figure 4B

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Figure 11

Figure 12

Figure 13

Figure 14

Figure 15

Figure 16

Mode for Carrying Out the Invention

[0012] Hereinafter, embodiments according to one aspect of the present invention will be described with reference to the drawings. The embodiments described below are merely examples of the present invention in every aspect, and various improvements and modifications can be made without departing from the scope of the present invention. That is, when implementing the present invention, a specific configuration according to the embodiment may be appropriately adopted.

[0013] [First Embodiment] <Appearance and Keyboard> Figure 1 is an external view showing an example of an electronic musical instrument according to the first embodiment. In the first embodiment, a digital keyboard 100 is assumed as the electronic musical instrument. The digital keyboard 100 includes a keyboard 101, a first switch panel 102, a second switch panel 103, and an LCD (Liquid Crystal Display) 104.

[0014] The keyboard 101 is a set of a plurality of keys. Each key is an operator for specifying a pitch. A light-emitting diode or the like can be embedded in each key to serve as a performance guide by lighting it.

[0015] The keyboard 101 includes a code input keyboard 101a and a melody input keyboard 101b provided on the higher pitch side than the code input keyboard 101a. The code input keyboard 101a is pressed with the left hand to specify the bass note and chords in automatic accompaniment. The melody input keyboard 101b is played with the right hand to play the melody. The split point, which is the boundary between the code input keyboard 101a and the melody input keyboard 101b, is preset to a key of, for example, pitch F3. There are also models in which the split point can be changed.

[0016] The first switch panel 102 is a user interface for instructing various settings such as volume designation, tempo setting of automatic performance, and start of automatic performance. The second switch panel 103 is used to select various modes, select an automatic performance piece, or select a timbre. The LCD 104 functions as a display unit that displays lyrics and various setting information during automatic accompaniment and automatic performance. Further, the digital keyboard 100 may be provided with a speaker (sound emitting unit) that emits musical sounds generated by performance on the back surface, side surface, or back surface.

[0017] <Configuration> FIG. 2 is a block diagram showing an example of the digital keyboard 100 according to the first embodiment. The digital keyboard 100 includes a RAM (Random Access Memory) 105, a ROM (Read Only Memory) 106, an LCD 104, an LCD controller 107, an LED (Light Emitthing Diode) controller 108, a keyboard 101, a first switch panel 102, a second switch panel 103, a key scanner 109, a MIDI interface (I / F) 110, a system bus 117, a CPU (Central Processing Unit) 111, a timer 112, a sound source system 300, and a sound system 400. The sound source system 300 includes a sound source 113 realized as, for example, a DSP (Digital Signal Processor), and an effector 115. The sound system 400 includes a digital-to-analog converter 114 and an amplifier 116.

[0018] The CPU 111, ROM 106, RAM 105, sound source 113, digital-to-analog converter 114, effector 115, key scanner 109, LED controller 108, LCD controller 107, and MIDI interface 110 are each connected to the system bus 117.

[0019] The CPU 111 is a processor that controls the digital keyboard 100. That is, the CPU 111 reads the program stored in the ROM 106 into the RAM 105 as a working memory and executes it to realize various functions of the digital keyboard 100. The CPU 111 operates according to the clock supplied from the timer 112. The clock is used, for example, to control the sequence of automatic performance and automatic accompaniment.

[0020] The ROM 106 stores a program for realizing the processing according to the first embodiment, various setting data, automatic accompaniment data, etc. The automatic accompaniment data may include preset rhythm patterns, chord progressions, bass patterns, or melody data such as obligatos. The melody data may include pitch information of each sound, pronunciation timing information of each sound, etc.

[0021] The pronunciation timing of each sound may be the interval time between each pronunciation or the elapsed time from the start of the automatic performance piece. The unit of time often used is tick. Tick is a unit based on the tempo of the song used in a general sequencer. For example, if the resolution of the sequencer is 480, 1 / 480 of the time of a quarter note is 1 tick.

[0022] The automatic accompaniment data is not limited to the ROM 106 and may be stored in an information storage device or information storage medium (not shown). The format of the automatic accompaniment data may conform to the file format for MIDI.

[0023] The sound source 113 is a so-called GM sound source that complies with, for example, the GM (General MIDI) standard. This type of sound source can change the timbre by giving a program change as a MIDI message, and can control the default effects by giving a control change.

[0024] The sound source 113 has the ability to simultaneously produce, for example, a maximum of 256 voices. The sound source 113 reads out musical tone waveform data from, for example, a waveform ROM (not shown) and outputs it to the effector 115 as digital musical tone waveform data. The effector 115 processes the digital musical tone waveform data and adds various effects. For example, an equalizer that emphasizes a specific band, a chorus that overlaps slightly shifted sounds, a delay that produces an echo effect, etc. are typical examples. The effected wet sound or the non-effected dry sound is output to the digital-to-analog converter 114 as digital musical tone waveform data.

[0025] The digital-to-analog converter 114 converts the digital musical tone waveform data into an analog musical tone waveform signal. The analog musical tone waveform signal is amplified by the amplifier 116 and output from a speaker (not shown) or an output terminal.

[0026] In the first embodiment, a compressor is assumed as the effector 115. The compressor is a typical model of a type called a dynamics system, and by suppressing the amplification factor of a sound with a volume exceeding a certain value, it brings about the effect of making the sound grains uniform.

[0027] Note that even without the effector 115, the sound source 113 can be controlled with MIDI messages to obtain effects. For example, portamento can be turned on / off by a control change as a MIDI message, and the degree of application (portamento time) can be specified in increments of 0 to 127. Various effects such as reverb, tremolo, chorus, and celeste are also defined in MIDI. Effects such as brightness and modulation can also be controlled by control changes. Furthermore, the effects obtained by operating the pitch bender or modulation wheel can also be controlled by control changes.

[0028] The key scanner 109 constantly monitors the key press / release state of the keyboard 101, the switch operation states of the first switch panel 102, and the second switch panel 103. Then, the key scanner 109 transmits the states of the keyboard 101, the first switch panel 102, and the second switch panel 103 to the CPU 111.

[0029] The LED controller 108 is, for example, an IC (Integrated Circuit). The LED controller 108 lights up the keys of the keyboard 101 according to an instruction from the CPU 111 to guide the performance of the performer. The LCD controller 107 is an IC that controls the display state of the LCD 104.

[0030] The MIDI interface 110 inputs MIDI messages (performance data, etc.) from external devices such as the MIDI device 4 and outputs MIDI messages to external devices. The digital keyboard 100 can exchange MIDI messages and MIDI data files with external devices using an interface such as USB (Universal Serial Bus). The received MIDI message is passed to the sound source 113 via the CPU 111. The sound source 113 produces sound according to the timbre, volume, timing, etc. specified by the MIDI message.

[0031] The storage device 3 as a removable medium may be connected to the system bus 117 via, for example, USB. Examples of the storage device 3 include a USB memory, a flexible disk drive (FDD), a hard disk drive (HDD), a CD-ROM drive, and a magneto-optical disk (MO) drive. When no program is stored in the ROM 106, a program can be stored in the storage device 3 and read into the RAM 105, so that the CPU 111 can execute the same operations as when the program is stored in the ROM 106.

[0032] In the above configuration, the RAM 105, the ROM 106, the system bus 117, the CPU 111, the timer 112, the sound source system 300, and the sound system 400 realize the function as an automatic performance device. The digital keyboard 100 is an electronic musical instrument including this automatic performance device and the keyboard 101 as an operator.

[0033] FIG. 3 is a functional block diagram showing an example of the processing function of the CPU 111 according to the first embodiment and the content stored in the ROM 106. In addition to the program 106a that realizes the processing function of the CPU 111, the ROM 106 stores preset piece data a1 to an preset in advance at the time of factory shipment, user piece data b1 to bm composed by the user, and a threshold value 106b. The preset piece data and the user piece data are a set of, for example, MIDI data created for each of a plurality of parts. The plurality of parts include at least a first part and a second part.

[0034] In the embodiments, [Part] and [Track] are described as follows. Under the MIDI standard, in many cases, a [Track] is associated with one musical instrument. However, for a drum track, multiple percussion instruments are associated with one track. For example, kick, tom-tom, snare, ride cymbal, hi-hat, crash cymbal, etc. are all different parts in one drum track. In view of such standard agreements, in the embodiments, for a drum track, individual musical instruments are referred to as [Part], and for other tracks, [Part] and [Track] are described as synonymous.

[0035] As the first part, in the embodiments, the kick part of the drum track is assumed. Incidentally, in a GM sound source, the kick part corresponds to note number 35 (Acoustic Bass Drum) or 36 (Bass Drum) in the drum set. The second part is, for example, strings, pad, organ, or a bass part (track), etc.

[0036] The threshold value 106b is preset by a user operation using, for example, the first switch panel 102 or the second switch panel 103. The threshold value 106b is compared with the length of each musical sound emitted from the sound source 113. In the embodiments, when the kick part sounds, at least a part of the period of the sound that sounds for a period longer than the threshold value 106b is muted. That is, a side-chain effect is imparted. As the unit of the sound length, a musical value represented by the notation on the musical note, the absolute value of the sounding period (such as milliseconds) or a tick, etc. can be adopted.

[0037] <Regarding the functions of CPU111> The CPU 111 includes, as processing functions according to the first embodiment, a playback control unit 111a, a threshold value setting unit 111b, and a side-chain control unit 111c. These functions are realized by the program 500.

[0038] The playback control unit 111a instructs the sound source 113 to start playing the song specified by a user operation using, for example, the first switch panel 102 or the second switch panel 103. That is, the playback control unit 111a reads out the selected preset song data or user song data from the ROM 106. Also, the playback control unit 111a passes the MIDI messages included in the read song data to the sound source system 300 at the specified timing. The sound source system 300 converts the acquired MIDI data into audio data for each part and outputs it to the sound system 400.

[0039] The threshold setting unit 111b accepts the setting of the threshold by the user and stores the input value in the ROM 106 as the threshold 106b. The CPU 111 may automatically set an appropriate threshold by analyzing the song data (for example, obtaining each note value from the intervals between each note in the kick part included in the song data).

[0040] When the playback of the song data by the playback control unit 111a is started, the side chain control unit 111c compares the note value of the sound (second sound) included in another part, which is sounded superimposed on the sounding of the first sound included in the first part (kick) of the song data, with the threshold 106b. If the note value of the second sound is longer than the threshold 106b, this second sound is muted.

[0041] To mute, a method of instructing the sound source system 300 to instantaneously lower the limit level of, for example, a compressor (effector 115) to suppress the volume can be considered. Alternatively, the numerical value of the velocity of the song data may be directly rewritten. That is, muting can be said to be playing the musical sound at a volume smaller than the intensity (velocity) originally given on the MIDI data.

[0042] The muting period is at least a part of the sounding period given to the second sound, that is, the period corresponding to the note value of the second sound. By the above processing, ducking, that is, a side chain effect, can be given to the second sound.

[0043] FIGS. 4A and 4B are schematic diagrams for explaining the side-chain effect in detail. To obtain the side-chain effect, it is common to specify a first part / track (the key part / track of the side chain) for which the sound is to be emphasized and a second part / track to be ducked, and control the volume of the second part by an effect similar to a compressor.

[0044] Here, the first part / track (the key part / track of the side chain) for which the sound is to be emphasized is referred to as the key part in the embodiment.

[0045] As shown in FIG. 4A, when the side chain is invalid, the volume of other parts does not change regardless of the change in the volume (waveform diagram) of the kick part. On the other hand, as shown in FIG. 4B, when the side chain is valid, the volume of parts other than the kick part is muted in synchronization with the maximum volume (attack) of the kick part. In the muted waveform diagram (other parts), at the moment of the kick attack, for example, the volume becomes zero (mute), and then the volume gradually recovers and reaches the normal level in the vicinity where the volume of the kick becomes zero. By changing the waveform in this way, the contour of the kick attack sound can be made prominent, and the typical side-chain effect can be obtained.

[0046] <Regarding the relationship between Duration and Threshold> FIG. 5 is a diagram for explaining the relationship between Duration and Threshold in the embodiment. While Threshold means the threshold value, Duration means the pronunciation period. The musical score in FIG. 5(a) can be represented by the piano roll shown in FIG. 5(b). The note values of each sound such as quarter notes, eighth notes, and half notes are represented by the length of the horizontal axis in the piano roll.

[0047] Here, assume that an eighth note is set as the Threshold. Assuming that the music data in Fig. 5(a) is played under this setting, the side-chain control unit 111c compares the Duration of each note of C3, D3, E3, F3, G3, A3, B3, and C4 with the Threshold every time each note is played. This can be achieved, for example, by reading the Duration described in the MIDI message of each note and comparing the value with the value of the Threshold. Then, for the notes where Duration ≥ Threshold holds, the side-chain control unit 111c applies ducking. In Fig. 5, ducking will only be applied to C3 and C4. Next, the operation in the above configuration will be described.

[0048] <Operation> Fig. 6 is a flowchart showing an example of the procedure related to the setting of the Threshold in the embodiment. In Fig. 6, the Threshold setting unit 111b waits for the user to input the Threshold (step S1). Then, when it detects that the Threshold has been input by the user (Yes in step S1), the Threshold setting unit 111b sets the given Threshold value in a specific storage area of the ROM 106 (step S2).

[0049] On the other hand, for Duration, the value in parts other than the key part, that is, the Nth part (N≠1), has meaning. In the embodiment, each part other than the key part is assigned a buffer (Duration) that holds the length of the currently sounding note. The actual form of this buffer is, for example, a predetermined storage area of the RAM 105, and Duration is acquired and set in the buffer during the pronunciation of each part.

[0050] As shown in Fig. 7, after the performance playback starts, when the performance data of the Nth part (N≠1) is played (step S3), the Duration of this Nth part is acquired from the performance data and set in the buffer (step S4).

[0051] FIG. 8 is a flowchart showing an example of a processing procedure during automatic performance playback. In FIG. 8, when the performance data of the kick, which is the first part, i.e., the key part, is reproduced (step S10), the side chain control unit 111c substitutes 2 for N (N = 2) and starts the processing related to volume control from the second part (step S11). If the Nth part is not sounding (No in step S12), the side chain control unit 111c increments N (step S17), and the processing procedure returns to step S12.

[0052] If the Nth part is sounding (Yes in step S12), the side chain control unit 111c compares the buffered Duration of the Nth part with the set Threshold (step S13).

[0053] If Duration < Threshold (No in step S13), the side chain control unit 111c excludes the Nth part from the side chain target, increments N as it is (normal sounding) without changing the volume (step S17), and the processing procedure returns to step S12.

[0054] On the other hand, if Duration ≧ Threshold (Yes in step S13), the side chain control unit 111c substitutes 0 for SideExp, which is a parameter related to volume setting (SideExp = 0) (step S14), and then executes the pronunciation volume change process (step S15). The processing of step S15 will be described with reference to FIG. 11. And the above procedure is repeated until the processing is completed for all parts of the reproduced music piece (Yes in step S16).

[0055] In the description of the embodiment, [SideExp] is introduced as an index indicating the expression value related to the side chain. This parameter is defined for each part and is temporarily stored, for example, in a predetermined storage area of the RAM 105. The volume of each part increases or decreases according to the value of SideExp. If SideExp = 0, the volume is zero, and as the value of SideExp increases in the positive direction, the volume of the corresponding part increases. The maximum value of SideExp is, for example, 100.

[0056] FIG. 9 is a diagram showing an example of a processing procedure related to volume change using SideExp. The flowchart shown in FIG. 9 is called at regular intervals by a trigger such as a hardware interrupt during performance playback. In FIG. 9, it is determined whether the value of SideExp is the normal value (default) (step S20). Here, as the default, SideExp = 100. If SideExp = 100, the process exits. If SideExp ≠ 100 (No in step S20), the side chain control unit 111c determines the elapsed time since the value of SideExp was changed (step S21). For example, if SideExp is defined as a structure including its value and the change time (timestamp), the change time of the value of SideExp can be obtained by referring to this structure in step S21.

[0057] In step S21, if, for example, 5 milliseconds (ms) have elapsed (Yes), the side chain control unit 111c adds a fixed value (for example, 1) to SideExp (step S22), and the processing procedure proceeds to the pronunciation volume change process (step S15).

[0058] According to the processing procedure of FIG. 9, the volume that once became zero (SideExp = 0) steps up by 1 every 5 ms as shown in FIG. 10 and returns to the default volume (SideExp = 0) after 0.5 seconds. To the listener's ear, the attack of the kick is emphasized while the volumes of other parts linearly return to their original volumes.

[0059] Of course, the amount of step-up and the return time can be arbitrarily determined by the user. When the volume return time is set by the user, for example, by dividing that value by 100, the step X of the SideExp step-up period can be obtained. X = (volume return time / 100) ··· (1) Figure 11 is a flowchart for explaining the pronunciation volume change process of step S15. In Figure 11, the side chain control unit 111c multiplies the set volume value of the part to be ducked by the value of SideExp at that time and calculates it as the pronunciation volume value (step S151). Next, the side chain control unit 111c sets the pronunciation volume of the part to the magnitude of the calculated pronunciation volume value (step S11).

[0060] Specifically, by changing the gain of the compressor of the effector 115 (Figure 2) according to the pronunciation volume value, the volume of the ducking target part can be controlled. Alternatively, by giving a MIDI control change including the velocity changed according to the pronunciation volume value to the sound source 204, the volume of the part can be similarly controlled.

[0061] <Effect> Figure 12 is a flowchart for explaining the effect in the first embodiment. In Figure 12, the passage of time is indicated by a rightward arrow, and vertically, the volume of each part is schematically shown. In Figure 12, the kick (□), which is the key part, beats regularly at a certain tempo (for example, quarter note) as time passes.

[0062] Assume that strings (part 2), organ (part 3), and bass (part 4) are recorded as parts other than the kick. In (1), the third chain process is started at the timing of the key part (kick). Since the note value of the strings is long as in (2) and Duration ≧ Threshold holds, a side chain occurs. That is, it is muted at the timing of the kick and then the volume gradually recovers after being muted once.

[0063] Since the organ is played with a short note value as in (3), Duration < Threshold, and no side chain is generated.

[0064] The bass part is playing a mixture of short and long notes. Conventionally, in such cases, the user had to set the enable / disable of the side chain for each note or set the volume return time finely, which was a great deal of trouble and burden for the user.

[0065] In contrast, in the embodiment, as shown in the strings and bass part of FIG. 12, the side chain effect is automatically applied. That is, the side chain effect can be automatically given according to the length (Duration) of the sound when it is pronounced. For the user, the composed song can be finished like dance music with a simple operation.

[0066] As described above, in the first embodiment, a threshold (Threshold) for setting the enable / disable of the side chain is set in advance, and the length of the sound (Duration) of other parts pronounced when the key part (for example, the kick part) is pronounced is determined with the threshold. Then, the side chain effect is applied to the pronunciation of the part whose pronunciation length is equal to or greater than the threshold, and the side chain effect is not applied to the pronunciation of the part whose pronunciation length is shorter than the threshold.

[0067] By doing so, it is automatically determined whether to apply the side chain effect according to the length of the sound pronunciation. Therefore, the burden on the user is dramatically reduced, and even a beginner in music production can easily apply the side chain effect suitable for the performance of the track. That is, regardless of the user's music production skills, music production using an effective side chain can be achieved. Also, even for those who are not beginners, the side chain effect can be applied to a track with mixed long and short sounds without manual setting.

[0068] According to the first embodiment, it is possible to provide an automatic performance device, an electronic musical instrument, a method, and a program that can easily implement an effective side chain.

[0069] [Second Embodiment] In the first embodiment, an example in which a side chain function is mounted on the digital keyboard 100 and combined with the automatic accompaniment function has been described. In the second embodiment, an example in which the side chain function is implemented in a music production application (sequencer software) installed on a computer, for example, in the form of a plugin, will be described.

[0070] FIG. 13 is an external view showing an example of an information device including sequencer software. In the second embodiment, a portable information device such as a smartphone or a tablet is assumed as the information device. The information device 200 includes a display panel 204 as a two-way user interface. In FIG. 13, an example of the GUI (Graphical User Interface) screen of the sequencer software is shown on the display panel 204. The GUI screen includes clickable buttons and a part information display area for displaying information for each part, similar to a piano roll.

[0071] FIG. 14 is a functional block diagram showing an example of the information device 200. The information device 200 includes a CPU 111, a ROM 106, a RAM 218, a display unit 220, an operation unit 222, a communication interface (communication I / F) unit 224, a digital / analog converter (DAC) 228, and a speaker 230. These are connected to a system bus 232. That is, the information device 200 is a computer including a CPU 111 as a processor and a ROM 106 and a RAM 218 as memories. Note that a part of the memory including the ROM 106 and the RAM 218 may be detachable from the information device 200.

[0072] The display unit 220 displays various types of information on the display panel 204, and the operation unit 222 passes various operation information provided from the display panel 204 to the CPU 111. The processing functions of the CPU 111 and the content stored in the ROM 106 are the same as those in FIG. 3.

[0073] The display panel 204 of the display unit 220 is a liquid crystal display, an organic EL display, or the like that can display characters, numbers, images, and the like. The display panel 204 displays various types of information based on input operations in the operation unit 222 and processes executed inside the information device 200.

[0074] The operation unit 222 has operation switches 202 and a touch panel integrally provided on the display panel 204, and converts operations such as touch, click, and swipe by the user into data and passes it to the CPU 111.

[0075] The communication I / F unit 224 transmits and receives various types of data stored in the ROM 106 and the RAM 218 between the information device 200 and other communication devices. Here, the communication performed via the communication I / F unit 224 may be, for example, a communication method using various wired or wireless means to directly connect the information device 200 and an external communication device to transmit and receive data, or may be a method of transmitting and receiving data via a network such as the Internet. Also, it may be a method of transferring data using a storage medium such as a memory card. The DAC 228 converts digital audio data into an analog signal and outputs it amplified from the speaker 132 during music playback, calls, etc. in the information device 200.

[0076] FIG. 15 is a diagram for explaining the icons and operations displayed on the display panel 204 of the information device 200. In FIG. 15, when button (a) is tapped, a menu screen for specifying music data and the like is opened. When a music is selected by the user on the menu screen, the title of the selected music is displayed in area (b). Also, the music data of the selected music is displayed in area (c).

[0077] Area (c) includes, for example, four small areas c1 to c4. Performance data for Parts 1 to 4 are displayed in each of the small areas c1 to c4, for example, in the form of a piano roll. Numbers indicating bar numbers are displayed, for example, at the upper part of Area (c). As the performance starts and the bars progress, Area (c) scrolls to the left. For piece data containing three or fewer parts, three small areas c1 to c3 are displayed. When piece data containing four or more parts is selected, for example, a vertical scroll button may be displayed to enable scrolling up and down.

[0078] Buttons (d) and (e) are displayed, for example, on the left side of Area (c), that is, in the scroll direction. Button (d) is a button for specifying the key part (key part selection button), and is indicated by, for example, an icon of a key mark. The user taps the button (d) of the part for which the user wants to specify the key part. Then the color of the tapped button (d) changes (indicated by hatching), and it is set that it is the key part.

[0079] Button (e) is a button for specifying the part to which the side-chain effect is applied (side-chain part selection button), and is indicated by, for example, an icon of a chain mark. The user taps the button (e) of the part to which the user wants to apply the side-chain effect. Then the color of the tapped button (e) changes, and it is set that it is the part to which the side-chain is applied. Note that, due to exclusive control, it is not possible to apply the side-chain effect to the key part. In the setting of FIG. 15, it can be seen that Part 1 is the key part, and the side-chain effect is set to be applied to Parts 2 and 3.

[0080] Button (f) is a button (Auto Side-Chain Execute) for specifying whether to apply the side-chain effect or not. When button (f) is tapped, new music data with the side-chain effect applied to the selected music data is automatically generated. The part settings at that time follow the states of button (d) and button (e).

[0081] Button (g) is a button (Threshold Setting) for setting the threshold of the side-chain effect. When button (g) is tapped, a pop-up window such as shown in FIG. 16 is opened.

[0082] FIG. 16 is a diagram showing an example of a setting window that is pop-up displayed on the information device 200. In FIG. 16, it is possible to select on / off of the side-chain with the slide button of the GUI. Also, the value of Threshold can be set in note values such as 16th notes, 8th notes, 4th notes, etc. Of course, Threshold can also be set with a numerical value in tick units, for example. If the length of a 4th note is 96 ticks, it can be seen from FIG. 16 that a length slightly shorter than that is set as Threshold.

[0083] As described above, in the second embodiment, functions related to automatic side-chain can be implemented in the form of, for example, a plugin of music production software. Thereby, also by the second embodiment, it is possible to provide an automatic performance device, an electronic musical instrument, a method, and a program that can easily realize an effective side-chain.

[0084] Note that the present invention is not limited to the above-described embodiments. For example, it is also possible to implement the function of the sound source 113 as software that utilizes the computing resources of the CPU 111. Also, of course, it is possible to control the sound source 113 with control messages based on an original standard instead of MIDI messages, and it is not essential for the sound source 113 to conform to the MIDI standard. In addition, in the embodiment, the form of giving an instruction to the sound source 113 to change the musical sound has been described. However, the musical sound is not limited to this, and can also be changed by controlling the effector 115. Also, the key part was set to the kick, but it is not limited to this. For example, the snare drum may be set as the key part. Although it is common at present to set the beat instrument located at the strong beat as the key part, it is not limited to this, and any part may be set as the key part according to the creativity of the creator. Furthermore, both the kick and the snare drum may be set as the key part.

[0085] In addition, the present invention can be applied not only to the information device in the form shown in the second embodiment, but also to a music production environment known as so-called DTM (Desk Top Music) or DAW (Digital Audio Workstation).

[0086] As described above, the present invention is not limited to specific embodiments, and the technical scope of the present invention includes various modifications and improvements within the scope in which the object of the present invention is achieved, which is obvious to those skilled in the art from the description of the claims.

[0087] The invention described in the claims first attached to the application of this application is appended below. The claim numbers described in the appendix are as in the claims first attached to the application of this application. <Claim 1> A sound source, A processor, and the processor Determines whether the pitch value of the second sound included in the other parts other than the first part that is sounded superimposed on the pronunciation of the first sound included in the first part of the music data having a plurality of parts including the first part is longer than a preset threshold value, When it is determined that it is long, in at least a part of the period corresponding to the pitch value of the second sound, the second sound is made to sound at a volume lower than the volume set in the music data as the pronunciation volume of the second sound to the sound source, An automatic performance device. <Claim 2> The processor is configured to: when it is determined that the second sound is long, instruct the sound source to apply a side-chain effect to the pronunciation of the second sound; The automatic performance device according to claim 1. <Claim 3> The processor is configured to: when it is not determined that the second sound is long, instruct the sound source to pronounce the second sound at the volume set in the music data; The automatic performance device according to claim 1 or 2. <Claim 4> The plurality of parts include a second part in which the processor determines that the note value of the second sound is longer than the threshold value, and a third part in which the processor determines that the note value of the second sound is not longer than the threshold value. The automatic performance device according to any one of claims 1 to 3. <Claim 5> The first part is a kick part, The other parts include a strings part. The automatic performance device according to any one of claims 1 to 4. <Claim 6> The automatic performance device according to any one of claims 1 to 5, an operator, and the processor is configured to: in response to a user operation on the operator, instruct the sound source to start playing the music data and to pronounce at a specified pitch; An electronic musical instrument. <Claim 7> Causing a computer of an automatic performance device to: determine whether the note value of a second sound included in a part other than the first part, which is pronounced superimposed on the pronunciation of a first sound included in the first part of music data having a plurality of parts including the first part, is longer than a preset threshold value; when it is determined that the note value is long, during at least a part of a period corresponding to the note value of the second sound, make the second sound quieter than the volume set in the music data as the pronunciation volume of the second sound; A method. <Claim 8> The computer of the music generation device is caused to judge whether the pitch value of the second sound included in the other parts other than the first part that is pronounced superimposed on the pronunciation of the first sound included in the first part of the first music data having a plurality of parts including the first part is longer than a preset threshold value, and when it is judged to be long, generate second music data in which the second sound is muted to a volume lower than the volume set in the first music data as the pronunciation volume of the second sound in at least a part of the period corresponding to the pitch value of the second sound. Program.

Explanation of Signs

[0088] 3…Storage device 4…MIDI device 100…Digital keyboard 101…Keyboard 101a…Code input keyboard 101b…Melody input keyboard 102…Switch panel 103…Switch panel 105…RAM 106…ROM 106a…Program 106b…Threshold 107…LCD controller 108…LED controller 109…Key scanner 110…MIDI interface 111…CPU 111a…Playback control unit 111b…Value setting unit 111c…Side chain control unit 112…Timer 113…Sound source 114…Digital-to-analog converter 115…Effecter 116…Amplifier 117…System bus 132…Speaker 200…Information device 202…Operation switch 204…Display panel 218…RAM 220…Display unit 222…Operation unit 224…Communication interface unit 228…Digital / analog converter 230…Speaker 232…System bus 300…Sound source system 400…Sound system 500…Program a1~an…Preset song data b1~bm…User song data.

Claims

1. Determine whether the pitch of the second sound included in parts other than the first part of the curved data having a plurality of parts including the first part, which is pronounced superimposed on the pronunciation of the first sound included in the first part of the curved data, is equal to or higher than a preset threshold value, When it is determined that the pitch of the second sound is equal to or higher than the threshold value, execute a pronunciation process of weakening the second sound at the pronunciation timing of the first sound to a volume lower than the volume set in the curved data as the pronunciation volume of the second sound, When it is determined that the pitch of the second sound is less than the threshold value, execute a pronunciation process of pronouncing the second sound at the pronunciation timing of the first sound at the volume set in the curved data, The threshold value is set based on the interval between each sound of the first part, An automatic performance device.

2. The pronunciation process is a process of applying a side-chain effect to the pronunciation of the second sound when it is determined that the pitch of the second sound is equal to or higher than the threshold value. The automatic performance device according to claim 1.

3. The plurality of parts include a second part in which it is determined that the pitch of the second sound is equal to or higher than the threshold value, and a third part in which it is determined that the pitch of the second sound is less than the threshold value. The automatic performance device according to claim 1 or 2.

4. The first part is a kick part, The other parts include a strings part. The automatic performance device according to any one of claims 1 to 3.

5. The automatic performance device according to any one of claims 1 to 4, An operator, A sound source, A processor, Including, The processor, In response to a user operation on the operator, instruct the sound source to start playing the curved data, Instruct the sound source to pronounce at a specified pitch, An electronic musical instrument.

6. In a computer of an automatic performance device, Determine whether the pitch of the second sound included in the other parts other than the first part that is pronounced superimposed on the pronunciation of the first sound included in the first part of the curved data having a plurality of parts including the first part is equal to or greater than a preset threshold value. When it is determined that the pitch of the second sound is equal to or greater than the threshold value, execute a pronunciation process of making the second sound at the pronunciation timing of the first sound weaker than the volume set in the curved data as the pronunciation volume of the second sound. When it is determined that the pitch of the second sound is less than the threshold value, execute a pronunciation process of pronouncing the second sound at the pronunciation timing of the first sound at the volume set in the curved data. The threshold value is set based on the interval between each sound of the first part. Method. **Claim 7**: On the computer of the music generation device, Determine whether the pitch of the second sound included in the other parts other than the first part that is pronounced superimposed on the pronunciation of the first sound included in the first part of the first music data having a plurality of parts including the first part is equal to or greater than a preset threshold value. When it is determined that the pitch of the second sound is equal to or greater than the threshold value, generate second music data in which a pronunciation process of making the second sound at the pronunciation timing of the first sound weaker than the volume set in the first music data as the pronunciation volume of the second sound is performed. When it is determined that the pitch of the second sound is less than the threshold value, generate second music data in which a pronunciation process of pronouncing the second sound at the pronunciation timing of the first sound at the volume set in the first music data is performed. The threshold value is set based on the interval between each sound of the first part. Program.

Images